Ethan B. Holland

Over 56,600 manually organized AI links and counting

the giant from Jack in the Beanstalk wearing a hoodie with the word "Phi-3" on it. --ar 5:3

Microsoft AI News: Week Ending 04/26/2024

April 27, 2024

the giant from Jack in the Beanstalk wearing a hoodie with the word “Phi-3” on it. –ar 5:3

Microsoft Reports Rising Revenues as A.I. Investments Bear Fruit – The New York Times – https://www.nytimes.com/2024/04/25/technology/microsoft-earnings.html

Introducing Phi-3: Redefining what’s possible with SLMs | Microsoft Azure Blog – https://azure.microsoft.com/en-us/blog/introducing-phi-3-redefining-whats-possible-with-slms/

“Pretty clear signaling from the flurry of papers by Microsoft and Apple that local LLMs on phones connecting to bigger LLMs in the cloud are coming. Phi 3 is already far better than Siri or Alexa, and with tools and the ability to call on a smarter intelligence, it can do a lot https://twitter.com/emollick/status/1783154136629870857

Phi-3 Technical Report, Impressive! : r/singularity – https://www.reddit.com/r/singularity/comments/1catcdv/phi3_technical_report_impressive/

“The new CEO of Microsoft AI, @MustafaSuleyman, with a $100B budget at TED: “AI is a new digital species.” “To avoid existential risk, we should avoid: 1) Autonomy 2) Recursive self-improvement 3) Self-replication We have a good 5 to 10 years before we’ll have to confront this.” https://twitter.com/FutureJurvetson/status/1782201734158524435

“Microsoft just announced Phi-3, a new family of small language models. The smallest model, Phi-3-mini, impressively rivals Mixtral and GPT 3.5 despite being significantly smaller. It also has a staggering 128k context window. https://twitter.com/rowancheung/status/1782954997811970148

“phi-3 is here, and it’s … good :-). I made a quick short demo to give you a feel of what phi-3-mini (3.8B) can do. Stay tuned for the open weights release and more announcements tomorrow morning! (And ofc this wouldn’t be complete without the usual table of benchmarks!) https://twitter.com/SebastienBubeck/status/1782627991874678809

Microsoft hires former Meta exec to bolster AI supercomputing team – The Verge – https://www.theverge.com/2024/4/22/24137391/microsoft-hires-meta-ai-supercomputing-jason-taylor

“Microsoft presents Multi-Head Mixture-of-Experts Sparse Mixtures of Experts (SMoE) scales model capacity without significant increases in training and inference costs, but exhibits the following two issues: (1) Low expert activation, where only a small subset of experts are https://twitter.com/_akhaliq/status/1782952067339858036

[2404.14219] Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone – https://arxiv.org/abs/2404.14219

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #30: Week Ending 04/26/2024 with Executive Summary and Top 39 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.