Ethan B. Holland

Over 54,400 manually organized AI links and counting

a phone in a forest next to a trail sign that reads "Local" --ar 5:3 --style raw

Locally Run AI Models News: Week Ending 05/24/2024

May 24, 2024

a phone in a forest next to a trail sign that reads “Local” –ar 5:3 –style raw

This week’s category cover theme is a sign in a forest. Each category image prompt is a derivative of the formula “an [category themed object] in a forest with a trail sign that reads “[category name]”. Using a theme each week takes the cover creation time down to about 20 minutes, rather than several hours.

Microsoft Phi-Silica: 3.3B small AI model made for Copilot+ PC NPUs | VentureBeat

Microsoft introduces Phi-Silica, a 3.3B parameter model made for Copilot+ PC NPUs

New models added to the Phi-3 family, available on Microsoft Azure | Microsoft Azure Blog

New models added to the Phi-3 family, available on Microsoft Azure

“Phi-3 small & medium are now available under the MIT license! 🚀@Microsoft has just launched Phi-3 small (7B) and medium (14B) 🤯. The Phi-3 small model claims to outperform @AIatMeta’s Llama 3 and @MistralAI, and the Phi-3 medium model GPT-3.5 and @cohere Command R+. 🤔 TL;DR:

Phi-3 small & medium are now available under the MIT license! 🚀@Microsoft has just launched Phi-3 small (7B) and medium (14B) 🤯. The Phi-3 small model claims to outperform @AIatMeta's Llama 3 and @MistralAI, and the Phi-3 medium model GPT-3.5 and @cohere Command R+. 🤔

TL;DR:… pic.twitter.com/UsOsKvvFdz
— Philipp Schmid (@_philschmid) May 21, 2024

“You can now have an AI agent in your mobile operating system. Here are 3 things it can do: 1. Hook into system-level triggers like notifications 2. Use any app that’s already installed on the device 3. Read data and gather context across sandboxed applications

You can now have an AI agent in your mobile operating system. Here are 3 things it can do:

1. Hook into system-level triggers like notifications

2. Use any app that's already installed on the device

3. Read data and gather context across sandboxed applications pic.twitter.com/Nmmb86f2A4
— Sam Hall (@Shmall27) May 21, 2024

“The built-in GPU on an M3 MacBook Pro is fast. I’m testing it by multiplying two 10,000 x 10,000 matrices using PyTorch. 3.72 ms when running on metal. 14.4 ms on the CPU (4 times slower.) I get similar results using TensorFlow and JAX. I love this computer.

The built-in GPU on an M3 MacBook Pro is fast.

I'm testing it by multiplying two 10,000 x 10,000 matrices using PyTorch.

3.72 ms when running on metal.
14.4 ms on the CPU (4 times slower.)

I get similar results using TensorFlow and JAX.

I love this computer. pic.twitter.com/g7WQpQhSdL
— Santiago (@svpino) May 22, 2024

“No cloud, no cost, no data sent to anyone, no problem. Welcome to local AI on Hugging Face!

No cloud, no cost, no data sent to anyone, no problem. Welcome to local AI on Hugging Face! pic.twitter.com/DtLeLGePKh
— clem 🤗 (@ClementDelangue) May 20, 2024

“Unleash your creative potential with Cocreator, an amazing new, fast, and free way to create in real-time with AI on your PC. Here is a demo from my colleague Erica. https://twitter.com/yusuf_i_mehdi/status/1792626471552336101

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #34: Week Ending 05/24/2024 with Executive Summary and Top 47 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.