ONE PHRASE, IN CONTEXT
long context
长上下文（大模型处理长文本的能力）
GET TO KNOW THE MEANING
读懂它，也学会这样说。
01长上下文（大模型处理长文本的能力）
IN A SENTENCE
And the memory usage also is a lot lower when you have long context, so your KV cache doesn't explode because of the convolution layers.
而且当你拥有长上下文时，内存占用也低得多，所以你的 KV 缓存不会因为卷积层而爆炸。