iphone photo of a futuristic, robotic penguin, standing in a snowy landscape under a clear blue sky. –ar 16:9 –style raw

Gaussian Splatting and Nerfs

“📢We introduce “RefFusion”, a novel inpainting method for scenes reconstructed using 3D Gaussian Splatting. 🔗 https://twitter.com/ashmrz10/status/1780719104883601817 

3D Modeling

“Making 3D objects from a single photograph was a big challenge, but Tecent’s image mesh can create one in 10 seconds There is a free demo to play with. I made a penguin mech in Midjourney (the upper lefthand image) and it made it a 3D model. Impressive.  https://twitter.com/emollick/status/1779925387721732528 

“🤯InstantMesh from Tencent is insane – Super fast Image-to-3D with high quality output ⬇️ Link below – Generate a 3D model from a single image in 30 seconds for free 🔥🔥  https://twitter.com/victormustar/status/1779896687504290245 

“Computer vision is so dope. You can map your space in real-time with the phone in your pocket — creating a simplified 3D model with ‘semantically meaningful’ entities representing the room, walls, windows and furniture within that space. Basically, a 3D floor plan. This is…  https://twitter.com/bilawalsidhu/status/1779317092048925157

“ok, @splinetool just released their text/image-to-3D model and it’s quite good You can generate 3D objects from text directly in the spline editor & export content into your websites and apps It supports image-to-3D too, and you can remix/run variations on any output 👀  https://twitter.com/nickfloats/status/1780323053672526158

Robot Training

“Rapid prototyping ultrasonic transducers. Idea to simulation to fabrication in 48 hours.  https://twitter.com/PropheticAI/status/1770097641906376730 

Other AR/VR News

“New toys for capturing reality in immaculate 3D with LiDAR SLAM. It’s so fun seeing it build out a 3D representation of your space in real-time. The Lixel K1 captures 200,000 points per second and has a 36 megapixel panoramic camera. These puppies can also produce radiance…  https://twitter.com/bilawalsidhu/status/1781443758909010226 

VASA-1 – Microsoft Research   Given such context, we have no plans to release an online demo, API, product, additional implementation details, or any related offerings until we are certain that the technology will be used responsibly and in accordance with proper regulations.  – https://www.microsoft.com/en-us/research/project/vasa-1/

“Ultra realistic AI-video from a photo This is VASA-1 from Microsoft research The improvements in quality we’re getting between each new release is incredible. Links below  https://twitter.com/LinusEkenstam/status/1780754955441209750

“We made an open-source visionOS + AI app for “spatial brainstorming.” Introducing Oxygen:  https://twitter.com/Haolun_Yang/status/1779646983919325213

“Video2Game Real-time, Interactive, Realistic and Browser-Compatible Environment from a Single Video Creating high-quality and interactive virtual environments, such as games and simulators, often involves complex and costly manual modeling processes. In this paper, we present  https://twitter.com/_akhaliq/status/1780082314497659288 

EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams – https://4dqv.mpi-inf.mpg.de/EventEgo3D/

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #28: Week Ending 04/12/2024 with Executive Summary and Top 48 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

• Agents/Copilots
• Amazon
• Apple
• Artificial General Intelligence (AGI)
• Augmented and Virtual Reality (AR/VR)
• Autonomous Vehicles
• AI Audio
• Business and Enterprise AI
• Chips and Hardware
• Consumer Products
• Education
• Ethics/Legal Security
• Google
• Images/Photos
• International AI News
• Locally Run AI Models
• Mobile
• Meta
• Microsoft
• OpenAI
• Open Source
• Podcasts/YouTube
• Publishing and News
• Robots and Embodiment
• Science and Medicine
• Video
• Vision/Multimodality
• X/Twitter/Grok
• Tech and Development

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.

• Robert Scoble: https://x.com/Scobleizer 
• Ethan Mollick:  https://www.linkedin.com/in/emollick/ 
• Alan Thompson: https://lifearchitect.ai/ 
• Theoretically Media: https://www.youtube.com/@TheoreticallyMedia   
• The Rundown: https://www.therundown.ai/ 
• Bilawal Sidhu:  https://twitter.com/bilawalsidhu/  
• TLDR: https://tldr.tech/ai  
• Jeremiah Owyang: https://twitter.com/jowyang  
• Nick St. Pierre: https://twitter.com/nickfloats  
• Dr. Jim Fan: https://twitter.com/DrJimFan 
• All About AI: https://www.youtube.com/@AllAboutAI   
• Marshall Kirkpatrick:  https://aitimetoimpact.com/
• AI News (Smol Talk): https://buttondown.email/ainews/archive/

For previous issues, please visit the archives!

Thanks for reading!