Ethan B. Holland

Over 54,900 manually organized AI links and counting

Chips, Hardware, and Infrastructure: Week Ending 06/28/2024

June 28, 2024

album art for a record titled “Microchip” –chaos 40 –ar 4:3 –style raw –personalize t1hfffm

Exclusive: China’s ByteDance working with Broadcom to develop advanced AI chip | Reuters

https://www.reuters.com/technology/artificial-intelligence/chinas-bytedance-working-with-broadcom-develop-advanced-ai-chip-sources-say-2024-06-24

Etched is building an AI chip that only runs one type of model | TechCrunch

Etched is building an AI chip that only runs one type of model

“Meet Sohu, the fastest AI chip of all time. With over 500,000 tokens per second running Llama 70B, Sohu lets you build products that are impossible on GPUs. One 8xSohu server replaces 160 H100s. Sohu is the first specialized chip (ASIC) for transformer models. By specializing,

Meet Sohu, the fastest AI chip of all time.

With over 500,000 tokens per second running Llama 70B, Sohu lets you build products that are impossible on GPUs. One 8xSohu server replaces 160 H100s.

Sohu is the first specialized chip (ASIC) for transformer models. By specializing,… pic.twitter.com/IndYfP2CN0
— Etched (@Etched) June 25, 2024

NVIDIA

“🤖 From this week’s issue: @nvidia announced Nemotron-4 340B, a family of open models that developers can use to generate synthetic data for training large language models.

🤖 From this week's issue: @nvidia announced Nemotron-4 340B, a family of open models that developers can use to generate synthetic data for training large language models.https://t.co/WYle0xJUka
— Deep Learning Weekly (@dl_weekly) June 23, 2024

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #39: Week Ending 06/28/2024 with Executive Summary and Top 67 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.