首页 正文

Evidence Against Syntactic Encapsulation in Large Language Models

{{output}}
Transformer-based large language models (LLMs) have recently demonstrated exceptional performance in a variety of linguistic tasks. LLMs primarily combine information across words in a sentence using the attention mechanism, implemented by "attention heads:"... ...