“DeepSeek R1 was just the start—this new Chinese research from @Kimi_Moonshot lets RAG AI agents devour entire codebases and documentation with no context limits. Mixture of Experts and Sparse attention make near-infinite context possible. 🧵1/n đź“Ś Challenge of Long-Context https://x.com/rohanpaul_ai/status/1892535262879617101
“self-training for reasoning & retrieval before it was cool + some thoughts on what novelty means in modern ML ColBERT-QA: https://x.com/lateinteraction/status/1892687808508387483
