Locally Run Models: AI News Week Ending 01/24/2025
“PSA: It takes <2 minutes to set up R1 as a free+offline coding assistant 💁♀️ Big shout out to @lmstudio and @continuedev! 🫶”
“These are very large gains in ability for a small model over the course of a month.” / X
“big news: the free tier of chatgpt is going to get o3-mini! (and the plus tier will get tons of o3-mini usage)” / X
Why o3-mini had to be free: the coming DeepSeek R1, 2.0 Flash, and Sky-T1 Price War
“Seems like RL finetuning small models is definitively worse than distilling the capabilities of a much larger RL finetuned model. We truly are about to enter the Alpaca era of reasoning models. May the best CoT win!” / X
arcee-ai/Virtuoso-Small · Hugging Face
“Phi-4 (4-bit) in @lmstudio on an M4 max is quite fast and quite good:”
