Ethan B. Holland

Over 57,200 manually organized AI links and counting

cinematic still. wide shot. lightning strikes the ground, an iphone is laying on the grass. --ar 5:3 --style raw

Locally Run AI Models News: Week Ending 04/26/2024

April 27, 2024

cinematic still. wide shot. lightning strikes the ground, an iphone is laying on the grass. –ar 5:3 –style raw

“Microsoft just announced Phi-3, a new family of small language models. The smallest model, Phi-3-mini, impressively rivals Mixtral and GPT 3.5 despite being significantly smaller. It also has a staggering 128k context window. https://twitter.com/rowancheung/status/1782954997811970148

“phi-3 is here, and it’s … good :-). I made a quick short demo to give you a feel of what phi-3-mini (3.8B) can do. Stay tuned for the open weights release and more announcements tomorrow morning! (And ofc this wouldn’t be complete without the usual table of benchmarks!) https://twitter.com/SebastienBubeck/status/1782627991874678809

“Apple just acquired Datakalab, an AI startup that specializes in low-power AI algorithms for apps that can run on devices rather than rely on the cloud. Also of note: in 2023, Apple acquired 32 AI startups, the most of any tech company. Read more: https://twitter.com/rowancheung/status/1782955027771859452

Apple Acquires French AI Company Specializing in On-Device Processing – MacRumors – https://www.macrumors.com/2024/04/22/apple-acquires-french-ai-company/

Gurman: Apple Working on On-Device LLM for Generative AI Features – MacRumors – https://www.macrumors.com/2024/04/21/apple-working-on-on-device-llm/

Introducing Phi-3: Redefining what’s possible with SLMs | Microsoft Azure Blog – https://azure.microsoft.com/en-us/blog/introducing-phi-3-redefining-whats-possible-with-slms/

Phi-3 Technical Report, Impressive! : r/singularity – https://www.reddit.com/r/singularity/comments/1catcdv/phi3_technical_report_impressive/

“Pretty clear signaling from the flurry of papers by Microsoft and Apple that local LLMs on phones connecting to bigger LLMs in the cloud are coming. Phi 3 is already far better than Siri or Alexa, and with tools and the ability to call on a smarter intelligence, it can do a lot https://twitter.com/emollick/status/1783154136629870857

“3 ways to run Llama-3 locally (100% free and without internet):” / X – https://twitter.com/Saboo_Shubham_/status/1781748135473131740

“Run Apple’s new OpenELM models in MLX LM thanks to @Prince_Canuma pip install -U mlx-lm 270M model in 16-bit runs quite fast on an 8GB M2 Mini (512 tokens at 115 toks/sec). Also pretty good quality for the size: https://twitter.com/awnihannun/status/1783646659362332940

“Apple is reportedly building an LLM that will be completely on-device instead of cloud-based. The move could improve privacy and speed up response times for AI on devices. Apple’s marketing strategy for AI will apparently be based on how it can be useful, rather than power. https://twitter.com/rowancheung/status/1782251032988270956

Apple’s new AI model hints at how AI could come to the iPhone – The Verge – https://www.theverge.com/2024/4/24/24139266/apple-ai-model-openelm-iphone-laptops-strategy

The Rundown University – https://university.therundown.ai/c/daily-tutorials/access-the-most-advanced-open-source-llm-llama-3-on-your-phone-3bc18501-071a-4438-aa52-36bd1bcb9eb0

[2404.14219] Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone – https://arxiv.org/abs/2404.14219

Apple releases OpenELM: small, open source AI for devices | VentureBeat – https://venturebeat.com/ai/apple-releases-openelm-small-open-source-ai-models-designed-to-run-on-device/

Apple Releases Open Source AI Models That Run On-Device – MacRumors – https://www.macrumors.com/2024/04/24/apple-ai-open-source-models/

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #30: Week Ending 04/26/2024 with Executive Summary and Top 39 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.