linear probes

Do LLMs Learn Grammar Beyond Likelihood?

A probe study finds hidden layers in language models encode grammaticality better than string probability, but not plausibility.