[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"tag-attention":3},{"tag":4,"articles":10},{"id":5,"name":6,"slug":6,"article_count":7,"description_zh":8,"description_en":9},"daa534d2-e208-4693-968f-b9e6a4ef4e86","attention",3,"注意力機制是大型語言模型的核心，決定模型如何在長上下文中檢索資訊、維持狀態與控制計算成本。這個主題涵蓋傳統 Transformer、KV cache、長上下文優化，以及把 attention 與 state-space、記憶模組結合的新設計。","Attention is the core mechanism that lets LLMs route information across tokens, shaping long-context recall, state tracking, and compute cost. This topic covers classic Transformers, KV cache tradeoffs, and newer hybrids that blend attention with state-space or memory modules.",[11,20,27],{"id":12,"slug":13,"title":14,"summary":15,"category":16,"image_url":17,"cover_image":17,"language":18,"created_at":19},"dbd84f6a-1f4e-44c3-ae97-165482ff2d21","persistent-visual-memory-lvml-visual-drift-zh","PVM 讓 LVLM 不再視覺漂移","Persistent Visual Memory（PVM）用輕量級平行模組，試圖讓 LVLM 在長篇生成時持續保留視覺資訊，減少視覺訊號隨文字變長而衰減的問題。","research","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1777876263458-zklg.png","zh","2026-05-04T06:30:30.018682+00:00",{"id":21,"slug":22,"title":23,"summary":24,"category":16,"image_url":25,"cover_image":25,"language":18,"created_at":26},"4700e9ba-80dd-47e9-9665-7461287fbbcb","sessa-attention-inside-state-space-memory-zh","Sessa 把注意力放進狀態空間記憶","Sessa 把 attention 放進 state-space 的回饋路徑，想同時保留長上下文檢索與穩定記憶。摘要主打 power-law 記憶尾巴，並宣稱長上下文 benchmark 表現領先。","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1776751615013-ugp9.png","2026-04-21T06:06:37.215599+00:00",{"id":28,"slug":29,"title":30,"summary":31,"category":16,"image_url":32,"cover_image":32,"language":18,"created_at":33},"e7d8242f-edab-4282-8317-9a27fec3cb91","sebastian-raschka-llm-architecture-gallery-zh","Sebastian Raschka 的 LLM 架構圖鑑","Raschka 的 LLM Architecture Gallery 把 GPT-2、Llama 3、OLMo 2、DeepSeek、Qwen 等模型的層數、注意力與 KV cache 數字攤開來比，工程師一眼就能看出部署差異。","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1775121663540-srg4.png","2026-04-02T07:27:33.561537+00:00"]