Ethan B. Holland

Over 63,400 manually organized AI links and counting

a desk in an office. A small computer with the label "Local". An oscillating fan is blowing onto it. --chaos 30 --ar 4:3 --style raw --personalize qko3v53 --v 6.1

Locally Run AI Models News: Week Ending 07/05/2024

a desk in an office. A small computer with the label “Local”. An oscillating fan is blowing onto it. –chaos 30 –ar 4:3 –style raw –personalize qko3v53 –v 6.1

“Meet Salesforce Einstein “Tiny Giant.” Our 1B parameter model xLAM-1B is now the best micro model for function calling, outperforming models 7x its size, including GPT-3.5 & Claude. On-device agentic AI is here. Congrats Salesforce Research! Paper: 

“🚀 We have released InternLM 2.5, the best model under 12B on the @huggingface Open LLM Leaderboard. 🔥 Outstanding reasoning capability 🚀 1M context window 🔧 Stronger tool use Try using it to build your amazing application! 

The new Chrome’s http://window.ai API would be going live soon.

So I gave a hands on this weekend and came up with this.

A truly locally run gemini nano AI model in the browser to generate some DANK replies on tweets.

“Exciting news: nanoLLaVA-1.5 has arrived! 🚀 • Same compact size (1B parameters) • Significantly improved performance • Major upgrade from v1.0 Experience the power of efficient AI vision! 👁️‍🗨️💡 Thanks to @TensorWaveCloud and @cognitivecompai for the computation sponsor 

“Excited and honored to be the recipient of the first-ever Tinybox built by @realGeorgeHotz and the @__tinygrad__ team. NVIDIA’s monopoly on AI GPUs is not only dangerous for society but also unhealthy for the market. Tinygrad is on a mission to fix that, and I’m glad to support 

“RT @armandjoulin: Gemma 2 27B is now the best open model while being 2.5x smaller than alternatives! This validates the work done by the te…” / X

“This is fast. Chrome running Gemini locally on my laptop. 2 lines of code. 

“This is open source AI Anyone with a computer can do this in a couple of hours Next year anyone with a phone can do it in a few minutes The year after in a few seconds 

“@AndroidAuth Nomic AI launched GPT4All 3.0, the latest version of the leading open-source local LLM desktop app. The new version of the desktop app supports thousands of open-sourced models that you can run on all major operating systems, completely local and private. 

“Announcing GPT4All 3.0: The Open Source Local LLM Desktop App – Supports 1000’s of models and all major operating systems – Major UI/UX Improvements – Local File Chat with LocalDocs 

“Google just announced its largest-ever expansion of Google Translate, adding support for 110 new languages enabled by the company’s PaLM 2 LLM model. The new languages represent over 614M speakers, covering about 8% of the global population. 

Google Translate adds 110 languages in its biggest expansion yet

https://blog.google/products/translate/google-translate-new-languages-2024

“What’s noteworthy in the newly released Gemma 2 LLMs? The main theme is that they explore techniques w/o necessarily increasing the dataset sizes but rather focus on developing relatively small & efficient LLMs. The are 3 main design choices to create the 2B & 9B models: 

“The @UnslothAI lib keeps delivering. Gemma 2 finetuning 2x faster 63% less memory, allow 3-5x longer contexts than HF+FA2. Amazing 🤯 And with unsloth you can eazily finetune Gemma-2 27B on a 24GB Consumer GPU. And in fact you can go up to a 34B model to be finetuned with an https://x.com/rohanpaul_ai/status/1808858018253074591

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #40: Week Ending 07/05/2024 with Executive Summary and Top 65 Links 

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.

For previous issues, please visit the archives!

Thanks for reading!

Leave a Reply

Trending