Running a Local Vision Language Model with LM Studio to sort out my screenshot mess – Daniel van Strien
“100B LLMs locally on your CPU (No GPUs!) and get 5-7 tokens/second. From @Microsoft ‘s newly open-sourced the code for the classic Paper of 2024 🔥 “The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits” The secret ❓ 📌 It requires almost no multiplication” / X
“Moondream raises $4.5M to prove that smaller AI models can still pack a punch
“Can we teach small, local LMs to *use* large, remote LMs as *tools*? Papillon with @Sylvia_Sparkle & team shows that this can be very consequential for privacy. Using DSPy optimizers, we can teach Llama3-8B to reach 86% of frontier LLMs’ quality while hiding your private data!” / X
“🤯 Plot twist: Size isn’t everything in AI! A lean 32B parameter model just showed up to the party and outperformed a 70B one. Efficiency > Scale? The AI world just got more interesting…” / Xhttps://twitter.com/fdaudens/status/1849542380992503908
Leave a Reply