Ethan B. Holland

Over 54,900 manually organized AI links and counting

a realistic baroque oil painting in an ornate gilded frame, depicting a home, a small, elegant nameplate at the bottom of the fame is engraved with the title: "Local" --chaos 20 --ar 4:3 --style raw --personalize t9u6ckr --v 6.1

Locally Run AI Models News: Week Ending 07/12/2024

July 12, 2024

a realistic baroque oil painting in an ornate gilded frame, depicting a home, a small, elegant nameplate at the bottom of the fame is engraved with the title: “Local” –chaos 20 –ar 4:3 –style raw –personalize t9u6ckr –v 6.1

“MobileLLM: nice paper from @AIatMeta about running sub-billion LLMs on smartphones and other edge devices. TL;DR: more depth, not width; shared matrices for token->embedding and embedding->token; shared weights between multiple transformer blocks; Paper:

MobileLLM: nice paper from @AIatMeta about running sub-billion LLMs on smartphones and other edge devices.
TL;DR: more depth, not width; shared matrices for token->embedding and embedding->token; shared weights between multiple transformer blocks;

Paper: https://t.co/TDWQWdZeIy pic.twitter.com/3IBklvTiBI
— Yann LeCun (@ylecun) July 7, 2024

“Launching GPT4All 3.0: The Open-Source Local LLM Desktop App – Completely Private Experience – Supports 1000’s of models and all major operating systems – Major UI/UX Improvements – Local File Chat – MIT Licensed Get started below:

Launching GPT4All 3.0: The Open-Source Local LLM Desktop App

– Completely Private Experience
– Supports 1000’s of models and all major operating systems
– Major UI/UX Improvements
– Local File Chat
– MIT Licensed

Get started below: pic.twitter.com/I2cUOfACHW
— Nomic AI (@nomic_ai) July 2, 2024

“Meet Salesforce Einstein “Tiny Giant.” Our 1B parameter model xLAM-1B is now the best micro model for function calling, outperforming models 7x its size, including GPT-3.5 & Claude. On-device agentic AI is here. Congrats Salesforce Research! Paper:

Meet Salesforce Einstein “Tiny Giant.” Our 1B parameter model xLAM-1B is now the best micro model for function calling, outperforming models 7x its size, including GPT-3.5 & Claude. On-device agentic AI is here. Congrats Salesforce Research!

Paper: https://t.co/SrntYvgxR5… pic.twitter.com/pPgIzk82xT
— Marc Benioff (@Benioff) July 3, 2024

Gemma 2

Improving Open Language Models at a Practical Size

In this post, we take a deep dive into the architectural components of Gemma 2 such as Grouped Query Attention, Sliding Window Attention, RoPE Embeddings, Logit soft-capping & Model-merging!

https://amaarora.github.io/posts/2024-07-07%20Gemma.html

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #41: Week Ending 07/12/2024 with Executive Summary and Top 58 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.