an 80s video game still. a sunny day with blue skies. an apple orchard. a wooden sign says “VR” –ar 4:3 –style raw –personalize 9zxyhz8
Apple Vision Pro
“Power On: Apple’s AI push isn’t so much about its current devices, but enabling its next wave of hardware from AR glasses to AirPods with cameras to potentially humanoid robots and more.
Meta
Gaussian Splatting and Nerfs
HGM Generalizable Human Gaussians from Single-View Image
3D Modeling
DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data
Robot Training
“With @Harvard, we built a ‘virtual rodent’ powered by AI to help us better understand how the brain controls movement. 🧠 With deep RL, it learned to operate a biomechanically accurate rat model – allowing us to compare real & virtual neural activity. →
Segmentation
“Depth Anything V2 This work presents Depth Anything V2. Without pursuing fancy techniques, we aim to reveal crucial findings to pave the way towards building a powerful monocular depth estimation model. Notably, compared with V1, this version produces much finer and more
“TikTok presents Depth Anything V2 Trained from 595K synthetic labeled images and 62M+ real unlabeled images, providing the most capable monocular depth estimation model proj:
World Models
“🔥Introducing Pandora 🌏 🪐 a World Model that generates videos of world states with real-time language control 🎥🕹️ Simulate the world across domains in an _interactive_ way! check out more
“MMWorld Towards Multi-discipline Multi-faceted World Model Evaluation in Videos Multimodal Language Language Models (MLLMs) demonstrate the emerging abilities of “world models” — interpreting and reasoning about complex real-world dynamics. To assess these abilities,
Other AR/VR News
“Immersive video got a huge boost today with a new Blackmagic 3D camera + Resolve editing support. Insane specs: > 8K per eye @ 90 fps > That’s 235 megapixels! > 16 stops of dynamic range > Immersive RAW format w/ lens calibration metadata > Live preview on Apple Vision Pro 😎
“A remarkable example of human’s extraordinary ability to do “cross-embodiment transfer”: the person steers himself in 3rd person “NPC view” by streaming the camera feed from a drone following him to his VR headset. We are born to process egocentric view, yet we have no trouble
“comparing LLM outputs was boring… but comparing 3D meshes is the so satisfying <3 3D Arena:
“3D capture is dope for delight, but the utility might be even more impactful. This digital twin of Boston fuses together aerial 3d scans + vector maps + building (BIM) data + historical crime data + utility waterlines + zoning data. You can answer questions like: 1. Which
LE3D Lighting Every Darkness with 3DGS:
Fast Training and Real-Time Rendering for HDR View Synthesis
https://srameo.github.io/projects/le3d/
Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.
Be Sure To Read This Week’s Main Post:
This week’s executive overview and top links are here:
AI News #37: Week Ending 06/14/2024 with Executive Summary and Top 7 Must-Read Links
The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.
- Agents/Copilots
- Amazon
- Apple
- Artificial General Intelligence (AGI)
- Augmented and Virtual Reality (AR/VR)
- Autonomous Vehicles
- AI Audio
- Business and Enterprise AI
- Chips and Hardware
- Consumer Products
- Education
- Ethics/Legal Security
- Images/Photos
- International AI News
- Locally Run AI Models
- Mobile
- Meta
- Microsoft
- OpenAI
- Open Source
- Podcasts/YouTube
- Publishing and News
- Retrieval-Augmented Generation (RAG) News
- Robots and Embodiment
- Science and Medicine
- Video
- Vision/Multimodality
- X/Twitter/Grok
- Tech and Development
Credits/Sources
Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.
- Robert Scoble: https://x.com/Scobleizer
- Ethan Mollick: https://www.linkedin.com/in/emollick/
- Alan Thompson: https://lifearchitect.ai/
- Theoretically Media: https://www.youtube.com/@TheoreticallyMedia
- The Rundown: https://www.therundown.ai/
- Bilawal Sidhu: https://twitter.com/bilawalsidhu/
- TLDR: https://tldr.tech/ai
- Jeremiah Owyang: https://twitter.com/jowyang
- Nick St. Pierre: https://twitter.com/nickfloats
- Dr. Jim Fan: https://twitter.com/DrJimFan
- All About AI: https://www.youtube.com/@AllAboutAI
- Marshall Kirkpatrick: https://aitimetoimpact.com/
- AI News (Smol Talk): https://buttondown.email/ainews/archive/
- Andrej Karpathy: https://x.com/karpathy
- Brett Adcock: https://x.com/adcock_brett
- Florent Daudens: https://x.com/fdaudens
- Ate-a-Pi: https://x.com/8teAPi
- Francesco Marconi: https://x.com/fpmarconi
- Charlie Beckett: https://x.com/CharlieBeckett
For previous issues, please visit the archives!
Thanks for reading!
Leave a Reply