a sunny day at the beach. architects blueprints are scattered across the beach. the words “Open Source” are drawn in the sand –ar 5:3 –style raw
“# Reproduce GPT-2 (124M) in llm.c in 90 minutes for $20 ✨ The GPT-2 (124M) is the smallest model in the GPT-2 series released by OpenAI in 2019, and is actually quite accessible today, even for the GPU poor. For example, with llm.c you can now reproduce this model on one 8X
URL: https://x.com/karpathy/status/1795484547267834137
Hugging Face
Reward Bench Leaderboard – a Hugging Face Space by allenai
Meta/Llama
“Today’s highlight is LlamaFS – a self-organizing file manager 🦙🗃️ Given a directory of messy files (e.g. your ~/Downloads directory), it will automatically and reorganize the entire set of files into an organized directory structure with interpretable names. It can “watch”
GitHub – iyaja/llama-fs: A self-organizing file system with llama 3
RLHFlow/ArmoRM-Llama3-8B-v0.1 · Hugging Face
“We’re excited to launch a huge feature making @llama_index the framework for building knowledge graphs with LLMs: The Property Graph Index 💫 (There’s a lot of stuff to unpack here, let’s start from the top) You now have a sophisticated set of tools to construct and query a
Mistral
The Mistral AI Non-Production License | Mistral AI | Frontier AI in your hands
Mistral AI, France’s Startup Darling, Takes Aim at the US Market – Bloomberg
Codestral: Hello, World! | Mistral AI | Frontier AI in your hands
“Announcing Codestral: our first-ever code model. – Open-weights under the new Mistral AI Non-Production License – New endpoint via La Plateforme:
URL: https://x.com/MistralAILabs/status/1795820935540584909
“Today we are releasing Codestral-22B, our first code model! Codestral is trained on more than 80 programming languages and outperforms the performance of previous code models, including the largest ones. It is available on our API platform, through instruct and
Other Open Source News
“Excited to announce RoboCasa, a large-scale simulation framework of everyday tasks! We use generative AI tools to create diverse objects, scenes, and tasks. Simulation plays a pivotal role in our Data Pyramid for training generalist robots. Open-source at
“We’ve found a cozy home for our robots in the world of bits! RoboCasa: a place where robot arms, dogs, and humanoids can train safely for daily tasks in procedurally generated simulations. It’s all open-source, check it out in Yuke’s thread!” / X
“despite recent progress and endless cheerleading, open-source AI is a worsening investment for model builders, an inferior option for developers and consumers, and a national security risk. I wrote about the closed-source future of foundation models here
“Meteor Mamba-based Traversal of Rationale for Large Language and Vision Models The rapid development of large language and vision models (LLVMs) has been driven by advances in visual instruction tuning. Recently, open-source LLVMs have curated high-quality visual
“We’re glad to announce our first open-source project, Mbodied Agents!
“Congrats to xAI and Elon on the new $6B funding! This should be enough compute for GPT-5 and 6 class models Would be great to have another serious player in the arena and hopefully they will continue to support open source!
Leave a Reply