Chips and Hardware: Week Ending 01/12/2024

Chips/Hardware

NVIDIA

You can now use NVIDIA end-to-end developer tools to create & deploy LLM applications on NVIDIA RTX AI-ready PCs. NVIDIA’s TensorRT-LLM backend supports community models including Phi-2, Llama2, Mistral-7B and Code Llama, and with LlamaIndex you can wrap a chat interface around them in just a few lines of code!

Supercharging LLM Applications on Windows PCs with NVIDIA RTX Systems

Nvidia rolled out three new chips that will let gamers, designers and other users make better use of AI on their personal computers

Nvidia rolled out three new chips that will let gamers, designers and other users make better use of AI on their personal computers https://t.co/5KkVz3ljh4
— Bloomberg Technology (@technology) January 8, 2024

Intel

Intel presents Efficient LLM inference solution on Intel GPU

Intel presents Efficient LLM inference solution on Intel GPU

paper page: https://t.co/pfyXLXvKa8

Transformer based Large Language Models (LLMs) have been widely used in many fields, and the efficiency of LLM inference becomes hot topic in real applications. However, LLMs are… pic.twitter.com/pGU8ns8Gzb
— AK (@_akhaliq) January 12, 2024

Shanghai AI Chip

NEW: HongShan (formerly Sequoia Capital China) has invested in Iluvatar CoreX, a Shanghai-based AI chip unicorn that competes with Nvidia in China. The deal comes as U.S. export curbs have limited China’s access to Nvidia’s most advanced chips.

NEW: HongShan (formerly Sequoia Capital China) has invested in Iluvatar CoreX, a Shanghai-based AI chip unicorn that competes with Nvidia in China. The deal comes as U.S. export curbs have limited China’s access to Nvidia’s most advanced chips. https://t.co/6lpWtL1yOy
— Juro Osawa (@JuroOsawa) January 12, 2024

Be Sure To Read “This Week in AI“

This is an extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.