Evidence Against Syntactic Encapsulation in Large Language Models
{{output}}
Transformer-based large language models (LLMs) have recently demonstrated exceptional performance in a variety of linguistic tasks. LLMs primarily combine information across words in a sentence using the attention mechanism, implemented by "attention heads:"... ...