Ethan B. Holland

Over 56,600 manually organized AI links and counting

a middle school art project showcasing the computer chip, a small written sign says: "Chips" –chaos 30 –ar 4:3 –style raw –personalize t9u6ckr –v 6.1 --chaos 20 --ar 4:3 --style raw --personalize x3p86jc --v 6.1

Chips, Hardware, and Infrastructure: Week Ending 07/19/2024

July 19, 2024

a middle school art project showcasing the computer chip, a small written sign says: “Chips” –chaos 30 –ar 4:3 –style raw –personalize t9u6ckr –v 6.1 –chaos 20 –ar 4:3 –style raw –personalize x3p86jc –v 6.1

Broadcom (AVGO) Shares Gain on Report That It’s Discussing Chip With OpenAI – Bloomberg

https://www.bloomberg.com/news/articles/2024-07-18/broadcom-gains-on-report-that-it-s-discussing-chip-with-openai?accessToken=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJzb3VyY2UiOiJTdWJzY3JpYmVyR2lmdGVkQXJ0aWNsZSIsImlhdCI6MTcyMTM0NzQ4MiwiZXhwIjoxNzIxOTUyMjgyLCJhcnRpY2xlSWQiOiJTR1U0NThEV1JHRzAwMCIsImJjb25uZWN0SWQiOiJFQTExNDNDNTM4NEE0RUY5QTg5RjJEN0IxMTg2MzcwOSJ9.JFOLpDlLLB4le75avbm_VYGxJMfnbxGNKj6AC7BECBI

Broadcom held discussions with OpenAI about producing AI chip: report (NASDAQ:AVGO) | Seeking Alpha

https://seekingalpha.com/news/4125638-broadcom-held-discussions-with-openai-about-producing-ai-chip-report

“OpenAI has hired former members of a Google AI chip unit as it seeks to develop its own AI chip, in possible threat to Nvidia.

OpenAI has hired former members of a Google AI chip unit as it seeks to develop its own AI chip, in possible threat to Nvidia.https://t.co/XybfS4tVfH

From @QianerLiu and @amir
— The Information (@theinformation) July 18, 2024

Groq

“Groq’s open-source & synthetic-only model beats closed models! 🚀🧬 Groq’s Llama, trained solely on synthetic data, tops the function calling leaderboard: • 70B version: 90.76% accuracy • 8B version: 89.06% accuracy • Outperforms GPT-4 and Claude. “By achieving top performance using only synthetic data, Groq challenges the notion that vast amounts of real-world data are necessary for creating cutting-edge AI models.”

Groq's open-source & synthetic-only model beats closed models! 🚀🧬

Groq’s Llama, trained solely on synthetic data, tops the function calling leaderboard:
• 70B version: 90.76% accuracy
• 8B version: 89.06% accuracy
• Outperforms GPT-4 and Claude

"By achieving top…
— Florent Daudens (@fdaudens) July 19, 2024

Groq’s open-source Llama AI model tops leaderboard, outperforming GPT-4o and Claude in function calling | VentureBeat – https://venturebeat.com/ai/groq-open-source-llama-ai-model-tops-leaderboard-outperforming-gpt-4o-and-claude-in-function-calling/

Intel

Investing in our future – Intuit Blog

“Today we will be communicating to approximately 1,800 employees, which is 10% of our workforce, that they will be leaving Intuit.”

Investing in our future

NVIDIA

Las Vegas Sphere Delivers Dazzling Displays | NVIDIA Blog

https://blogs.nvidia.com/blog/sphere-las-vegas

Mistral NeMo | Mistral AI | Frontier AI in your hands

https://mistral.ai/news/mistral-nemo

Mistral AI and NVIDIA Unveil Mistral NeMo 12B, a Cutting-Edge Enterprise AI Model | NVIDIA Blog

https://blogs.nvidia.com/blog/mistral-nvidia-ai-model

“Mistral NeMo is out! 🔥😱 A new exciting model from Mistral 👐NVIDIA – 12B model – 128k context length – Apache 2.0 license – Base + instruct-tuned – Multilingual – Function calling Exciting release 🥳 Announcement:

Mistral NeMo is out! 🔥😱

A new exciting model from Mistral 👐NVIDIA
– 12B model
– 128k context length
– Apache 2.0 license
– Base + instruct-tuned
– Multilingual
– Function calling

Exciting release 🥳

Announcement: https://t.co/j6KHC4mygv
Models https://t.co/bWhj8mnamI
— Omar Sanseviero (@osanseviero) July 18, 2024

“Mistral NeMo looks to be a damn good model – 12B so it fine-tunes quickly and cheaply – fast inference (small + trained w/ quantisation awareness) – new tokenizer that handles many languages efficiently

Mistral NeMo looks to be a damn good model

– 12B so it fine-tunes quickly and cheaply
– fast inference (small + trained w/ quantisation awareness)
– new tokenizer that handles many languages efficiently pic.twitter.com/znIOyI9bao
— Matt Shumer (@mattshumer_) July 18, 2024

“Very happy to release our new small model, Mistral NeMo, a 12B model trained in collaboration with @nvidia. Mistral NeMo supports a context window of 128k tokens, comes with a FP8 aligned checkpoint, and performs extremely well on all benchmarks. Check it out!

Very happy to release our new small model, Mistral NeMo, a 12B model trained in collaboration with @nvidia. Mistral NeMo supports a context window of 128k tokens, comes with a FP8 aligned checkpoint, and performs extremely well on all benchmarks. Check it out!… pic.twitter.com/BokevEFrIr
— Guillaume Lample @ ICLR 2024 (@GuillaumeLample) July 18, 2024

“Mistral has released NeMo, a new open-source, long context, smaller model as a successor to Mistral 7B. Why it is exciting below 👇 – Open source model with a 128k context window: Large context window open-source models have been few and far between and the most popular models,

Mistral has released NeMo, a new open-source, long context, smaller model as a successor to Mistral 7B. Why it is exciting below 👇

– Open source model with a 128k context window: Large context window open-source models have been few and far between and the most popular models,… pic.twitter.com/C47v6sgsJz
— Artificial Analysis (@ArtificialAnlys) July 18, 2024

“Mistral releases 12B open LLM! 🤯 Mistral Nemo comes as a base and instruct version with a 128k Context window and is multilingual in 9 Language with a new tokenizer. 👀 TL;DR: 🧠 12B Base and Instruct drop-in-replacement for Mistral 7B 🪟 Supports 128k context window and new

Mistral releases 12B open LLM! 🤯 Mistral Nemo comes as a base and instruct version with a 128k Context window and is multilingual in 9 Language with a new tokenizer. 👀

TL;DR:
🧠 12B Base and Instruct drop-in-replacement for Mistral 7B
🪟 Supports 128k context window and new… pic.twitter.com/emxGlMBahV
— Philipp Schmid (@_philschmid) July 18, 2024

“Somehow this got passed over in my feed today; Mistral released a new base model, slams l3 8b for 4B params more – not sure if its the same arch as old mistrals as its called Mistral Nemo:

Somehow this got passed over in my feed today; Mistral released a new base model, slams l3 8b for 4B params more – not sure if its the same arch as old mistrals as its called Mistral Nemo:https://t.co/kLlukNM5Qc pic.twitter.com/KdM4EOe8sr
— Teknium (e/λ) (@Teknium1) July 18, 2024

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #42: Week Ending 07/19/2024 with Executive Summary and Top 58 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.