Announcing the world’s fastest AI platform SambaNova Cloud runs Llama 3.1 405B @ 132t/s at full precision ✅ Llama 3.1 405B @ 132 tokens/sec ✅ Llama 3.1 70B @ 570 tokens/sec ✅ 10X Faster Inference than GPUs Start developing #FastAI ➡️
Proposed underwater data center surprises regulators who hadn’t heard about it – Ars Technica
“WILD speed at SambaNova – They just launched World’s fastest API 🤯 👉 Llama 3.1 405B @ 132 tokens/sec 👉 Llama 3.1 70B @ 570 tokens/sec @SambaNovaAI
“📣 Announcing the world’s fastest AI platform SambaNova Cloud runs Llama 3.1 405B @ 132t/s at full precision ✅ Llama 3.1 405B @ 132 tokens/sec ✅ Llama 3.1 70B @ 570 tokens/sec ✅ 10X Faster Inference than GPUs Start developing #FastAI ➡️
“The ecosystem around Llama is continuing to push the limits. SambaNova Cloud is setting a new bar for
inference on 405B and it’s available for developers to start building today.” / X
Groq
“Groq just set a new speed record. And, we still plan to get a liiiiiiitle bit faster still 😉” / X
NVIDIA
Oracle To Deploy A Supercluster Of ~130,000 NVIDIA Blackwell GPUs, Alludes To A “Gigawatt” Capacity Data Center That Will Be Powered By 3 Nuclear Reactors
“Nvidia is starting to lose share to AI chip startups for the first time. You can hear it in the hallways of every AI conference in the past few months.” / X
“Nvidia $NVDA CEO Jensen Huang just “I think the days of every line of code being written by software engineers is completely over”” / Xhttps://x.com/StockMKTNewz/status/1833879578676527433
Leave a Reply