Ethan B. Holland

Over 56,600 manually organized AI links and counting

Nikon D850 photo, a humanoid robot assisting in a modern, high-tech warehouse. The robot is precisely organizing packages on a conveyor belt, demonstrating its superhuman dexterity and efficiency. In the background, both human workers and other robots are visible, working together seamlessly. The warehouse is filled with the warm glow of artificial lighting, casting soft shadows and highlighting the advanced technology and the smooth interaction between humans and machines. The scene captures the essence of collaboration between humans and advanced AI in the workplace, symbolizing the future of labor and industry --ar 16:9

Robotics and Embodiment News: Week Ending 03/22/2024

March 22, 2024

“@SmokeAwayyy Optimus limbs, replacing lost human limbs, could ultimately be controlled with superhuman dexterity by an implanted Neuralink. Deus Ex / Cyberpunk irl.” / X – https://twitter.com/elonmusk/status/1770705794117574692

“Mercedes-Benz partners with Apptronik to test humanoid robot Apollo for automating some low-skill, physically challenging tasks Video credit: Joerg Burzer, LinkedIn https://twitter.com/herbertong/status/1768662694196888041

“1X’s mission is to create an abundant supply of physical labor through androids that work alongside humans. We’re excited to share our latest progress on teaching EVEs general-purpose skills. The following is all autonomous, all 1X speed, all controlled with a single set of… https://twitter.com/1x_tech/status/1770106870105358770

“Autonomous biped robot testing in the wild ⛰ With zero-shot learning, non-protected and fully open testing conditions, this Biped successfully navigates an completely unknown forest, demonstrating impressive control and stability post reinforcement learning. P1 is LimX… https://twitter.com/circuitrobotics/status/1770567577561083933

“Today is the beginning of our moonshot to solve embodied AGI in the physical world. I’m so excited to announce Project GR00T, our new initiative to create a general-purpose foundation model for humanoid robot learning. The GR00T model will enable a robot to understand multimodal… https://twitter.com/DrJimFan/status/1769860044324319658

“Nvidia showcases AI-driven digital twin technology for warehouse operations. Features a 100,000 sq. ft. warehouse digital twin built with Nvidia Omniverse. Integrates digital workers, AMRs, and infrastructure. Utilizes Nvidia Isaac, Metropolis, and Kuopo software for… https://twitter.com/hadi__co/status/1770121360892670195

(37) Stretch at MODEX 2024 | Boston Dynamics – YouTube – https://www.youtube.com/watch?v=rCZHlfS_pdM

“NVIDIA announced today at GTC 2024 is bringing OpenUSD Omniverse enterprise digital twins to the Apple Vision Pro! See this demo now 👇🏼 This show the capabilities of spatial computing by blending 3D photo real environments with the real world. https://twitter.com/hughhoufilm/status/1769900268051988924

“#ICLR24🚀🚀 Introduce DIFFTACTILE, A physics-based differentiable tactile simulation system designed to enhance contact-rich robotic manipulation with dense and physically accurate tactile feedback! 👉👉Project page: https://twitter.com/gan_chuang/status/1771268662353150183

“Very happy to announce that DROID, one of the most diverse robotic datasets, is finally released! https://twitter.com/svlevine/status/1770693505754517613

NVIDIA

“2024 is the Year of Humanoid. There’s no robot hardware more general-purpose. We are all in.” / X – https://twitter.com/DrJimFan/status/1769892846482702658

Today is the beginning of our moonshot to solve embodied AGI in the physical world. I’m so excited to announce Project GR00T, our new initiative to create a general-purpose foundation model for humanoid robot learning.

The GR00T model will enable a robot to understand multimodal instructions, such as language, video, and demonstration, and perform a variety of useful tasks. We are collaborating with many leading humanoid companies around the world, so that GR00T may transfer across embodiments and help the ecosystem thrive.

GR00T is born on NVIDIA’s deep technology stack. We simulate in Isaac Lab (new app on Omniverse Isaac Sim for humanoid learning), train on OSMO (new compute orchestration system to scale up models), and deploy to Jetson Thor (new edge GPU chip designed to power GR00T).

Announced in Jensen’s keynote, Project GR00T is a cornerstone for the “Foundation Agent” roadmap of the newly founded GEAR Lab. At GEAR, we are building generally capable agents that learn to act skillfully in many worlds, virtual and real. See if you can spot “GEAR” in the video 😉

Join us on the journey to land on the moon.

Today is the beginning of our moonshot to solve embodied AGI in the physical world. I’m so excited to announce Project GR00T, our new initiative to create a general-purpose foundation model for humanoid robot learning.

The GR00T model will enable a robot to understand multimodal… pic.twitter.com/EqN19Z3cXH
— Jim Fan (@DrJimFan) March 18, 2024

Nvidia announces “moonshot” to create embodied human-level AI in robot form | Ars Technica – https://arstechnica.com/information-technology/2024/03/nvidia-announces-moonshot-to-create-embodied-human-level-ai-in-robot-form/

We are working on Project GR00T, a general-purpose foundation model for humanoid robots. GR00T will enable the robots to follow natural language instructions and learn new skills from human videos and demonstrations.

Generalist robots need a versatile body and an intelligent mind. The NVIDIA GEAR group, led by

@DrJimFan

and me, is working closely with partner robotics companies to develop robot foundation models, with the goal of deploying millions of general-purpose robots to real-world tasks.

NVIDIA Announces Project GR00T Foundation Model for Humanoid Robots and Major Isaac Robotics Platform Update | NVIDIA Newsroom – https://nvidianews.nvidia.com/news/foundation-model-isaac-robotics-platform

Reach out if you want to join us on this mission!

https://twitter.com/yukez/status/1769890557667746000
“Tue 3/19, 8 am PT, SJCC 220B (L2), first GTC talk in the morning, “Generally Capable Agents in Open-Ended Worlds [S62816]”. I will present to you the roadmap of Foundation Agent and *one more thing*: a special cuisine that GEAR Lab has been cooking. Please come in person if you… https://twitter.com/DrJimFan/status/1769744624116232256

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #25: Week Ending 03/22/2024 with Executive Summary and Top 55 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.