a sunny day with blue skies. an apple orchard. a wooden crate with the word “local” –chaos 50 –ar 4:3 –style raw –personalize 9zxyhz8
“This is a great little example of how simple agent-based systems can lead to emergent behavior, even with tiny AIs like Apple’s on-device LLM. Matt Webb built a demo AI smart home, when he asks it “turn on the light for my dog” the home figures out how.
“Apple AI on device is equivalent to other tiny models. Apple AI Server is equivalent to GPT-3.5ish Frontier models they are not, but will still give you supercharged Siri & okay-ish writing help. I don’t think this has much to do with high-end use cases.
“Introducing Phi-3 WebGPU, a private and powerful AI chatbot that runs locally in your browser, powered by 🤗 Transformers.js and onnxruntime-web! 🔒 On-device inference: no data sent to a server ⚡️ WebGPU-accelerated (> 20 t/s) 📥 Model downloaded once and cached Try it out! 👇
PowerInfer-2: Fast Large Language Model Inference on a Smartphone | PowerInfer
“How will Apple walk the fine line of massively deploying AI on phones and computers w/o compromising privacy? Good blog post explaining how Apple wants to walk this fine line 🧵” / X
Introducing Apple’s On-Device and Server Foundation Models – Apple Machine Learning Research
“Everyone’s expecting a reborn Siri at WWDC today. Well, Apple already published a paper on it that disclosed way more details than what we expect from Apple. It’s called “Ferret-UI”, a multimodal vision-language model that understands icons, widgets, and text on iOS mobile
“Yesterday Apple strongly advocated for on-device AI with @Apple Intelligence! Today, we know they will run ~3B LLM on device (Mac, iPhone, iPad) using fine-tuned LoRA Adapters for different tasks, claiming to outperform other 7B and 3B LLMs! 👀 What we know: 📱 On-device 3B
“Love how @Apple is advocating for on-device AI at WWDC . Local, smaller, specialized models are the future of private, secure and efficient AI.” / X
“🚀 Chat with MLX 0.2 is here – a whole new LLM experience on your Apple Silicon Mac! 🍎 – Revamped UI/UX – Fully-featured Chat UI – Chat, Completion, Model Manager – Better and Faster RAG Upgrade your AI conversations now! 💻 GitHub –
“Was toying around with LLM model eval that run well on a laptop. Turns out Llama 3 8B Instruct is a pretty good evaluator that runs on a MacBook Air. I got a pretty high 0.8 correlation with GPT-4 scores. Standalone notebook here if you want to give it a try:
Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.
Be Sure To Read This Week’s Main Post:
This week’s executive overview and top links are here:
AI News #37: Week Ending 06/14/2024 with Executive Summary and Top 7 Must-Read Links
The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.
- Agents/Copilots
- Amazon
- Apple
- Artificial General Intelligence (AGI)
- Augmented and Virtual Reality (AR/VR)
- Autonomous Vehicles
- AI Audio
- Business and Enterprise AI
- Chips and Hardware
- Consumer Products
- Education
- Ethics/Legal Security
- Images/Photos
- International AI News
- Locally Run AI Models
- Mobile
- Meta
- Microsoft
- OpenAI
- Open Source
- Podcasts/YouTube
- Publishing and News
- Retrieval-Augmented Generation (RAG) News
- Robots and Embodiment
- Science and Medicine
- Video
- Vision/Multimodality
- X/Twitter/Grok
- Tech and Development
Credits/Sources
Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.
- Robert Scoble: https://x.com/Scobleizer
- Ethan Mollick: https://www.linkedin.com/in/emollick/
- Alan Thompson: https://lifearchitect.ai/
- Theoretically Media: https://www.youtube.com/@TheoreticallyMedia
- The Rundown: https://www.therundown.ai/
- Bilawal Sidhu: https://twitter.com/bilawalsidhu/
- TLDR: https://tldr.tech/ai
- Jeremiah Owyang: https://twitter.com/jowyang
- Nick St. Pierre: https://twitter.com/nickfloats
- Dr. Jim Fan: https://twitter.com/DrJimFan
- All About AI: https://www.youtube.com/@AllAboutAI
- Marshall Kirkpatrick: https://aitimetoimpact.com/
- AI News (Smol Talk): https://buttondown.email/ainews/archive/
- Andrej Karpathy: https://x.com/karpathy
- Brett Adcock: https://x.com/adcock_brett
- Florent Daudens: https://x.com/fdaudens
- Ate-a-Pi: https://x.com/8teAPi
- Francesco Marconi: https://x.com/fpmarconi
- Charlie Beckett: https://x.com/CharlieBeckett
For previous issues, please visit the archives!
Thanks for reading!
Leave a Reply