Apple Vision Pro

Apple reportedly ’accelerating’ entry-level Vision Pro — and it could cost $2,000 less | Tom’s Guide – https://www.tomsguide.com/computing/vr-ar/apple-reportedly-accelerating-entry-level-vision-pro-and-it-could-cost-dollar2000-less

Vision Pro is an over-engineered “devkit” // Hardware bleeds genius & audacity but software story is disheartening // What we got wrong at Oculus that Apple got right // Why Meta could finally have its Android moment – Hugo’s Blog – https://hugo.blog/2024/03/11/vision-pro/

Splats and Nerfs

“This is a massive 3D Gaussian Splat captured in 15 minutes (!) with a Lixel L2. You get the speed and precision of LiDAR SLAM combined with the fidelity of radiance fields 😍 Capturing this type of scene with a DSLR would take *so* much longer. https://twitter.com/bilawalsidhu/status/1768648663214018885

“3d scanning nerds rejoice! You can now use Polycam to edit your radiance fields and render out animations 🛠️ https://twitter.com/bilawalsidhu/status/1768408891015278906

Projectpage of SplattingAvatar – https://initialneil.github.io/SplattingAvatar

3D Modeling

ViewFusion: Towards Multi-View Consistency via Interpolated Denoising – https://wi-sc.github.io/ViewFusion.github.io/

V3D: Video Diffusion Models are Effective 3D Generators – https://heheyas.github.io/V3D/

World Models

“Introduce 3D-VLA, a 3D Generative World Model! Humans use mental models to predict and plan for the future. Similarly, 3D-VLA achieves this by linking 3D perception, future prediction, and action executions through a generative world model. https://twitter.com/gan_chuang/status/1768715113794506843

Other AR/VR News

“Introducing SIMA: the first generalist AI agent to follow natural-language instructions in a broad range of 3D virtual environments and video games. 🕹️ It can complete tasks similar to a human, and outperforms an agent trained in just one setting. 🧵 https://twitter.com/GoogleDeepMind/status/1767918515585994818

Kopia | AI Virtual Try-On – https://www.brands.trykopia.com/

“Combining #augmentedreality with tractography in real-time, #SurgicalAR helps elevate precision in brain tumor removal while preserving crucial brain functions. Our latest case showcases the transformative potential for neurosurgery, enhancing safety and efficacy.… https://twitter.com/Medivis_AR/status/1768281368398557574

[2403.05056v1] Stealing Stable Diffusion Prior for Robust Monocular Depth Estimation – https://arxiv.org/abs/2403.05056v1

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #24: Week Ending 03/15/2024 with Executive Summary and Top 36 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.