Ethan B. Holland

Over 56,600 manually organized AI links and counting

a modern, futuristic open-plan workspace bathed in warm, natural light. Diverse individuals are collaboratively working around a central holographic display, which shows a complex, glowing neural network model. The workspace is sleek and filled with high-tech equipment, reflecting the theme of innovation in AI technology. The atmosphere is transparent and inclusive, symbolizing open-source development and collaboration in advancing AI. --ar 16:9

Open Source AI News: Week Ending 03/22/2024

March 22, 2024

Mistral

“Stanford researchers just developed Quiet-STaR, a new training method that enables AI models to ‘think’ before responding. When applied to the Mistral 7B language model, Quiet-STaR nearly doubled its scores on math and common sense reasoning benchmarks. https://twitter.com/rowancheung/status/1771027959198957952

“Language models today are trained to reason either 1) generally, imitating online reasoning data or 2) narrowly, self-teaching on their own solutions to specific tasks Can LMs teach themselves to reason generally?🌟Introducing Quiet-STaR, self-teaching via internal monologue!🧵 https://twitter.com/ericzelikman/status/1768663835106513041

Grok

“The largest ever open LLM, trained by a world class team, dropped by a magnet link. Apache 2.0. I wonder what it feels like to be out-opened by @grok. 314B, mixture of expert (2 out of 8 active). Even the active parameters only (86B) is more than the biggest Llama. Can’t wait… https://twitter.com/DrJimFan/status/1769490454201114862

GitHub – xai-org/grok-1: Grok open release – https://github.com/xai-org/grok-1

Open Release of Grok-1 – https://x.ai/blog/grok-os

“🚨 The open sourced Grok is out! – 314 Billion parameters – Mixture of 8 experts – 300 GB https://twitter.com/_Borriss_/status/1769451000643850625

“@elonmusk @xai ░W░E░I░G░H░T░S░I░N░B░I░O░” / X – https://twitter.com/grok/status/1769441648910479423

“Elon Musk and xAI just released the weights + architecture of Grok-1. It’s a massive 314B parameter language model that’s 2x the size of GPT-3.5. Big win for collaborative and transparent AI development, and nice to see Elon walking the walk. https://twitter.com/rowancheung/status/1769509605585952984

Other Open Source News

What I learned from looking at 900 most popular open source AI tools – https://huyenchip.com/2024/03/14/ai-oss.html

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #25: Week Ending 03/22/2024 with Executive Summary and Top 55 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.