Ethan B. Holland

Over 63,400 manually organized AI links and counting

Augmented Reality (AR/VR): Week Ending 01/12/2024

Augmented/Virtual Reality (AR/VR)

Apple Vision Pro

Apple Vision Pro will have a brand-new App Store, where people can discover and download all the incredible apps for visionOS. A few days ago, Apple opened up the Apple Vision Pro App Store to developers for app submission 

Luma AI

This is the ChatGPT moment for 3D objects generation! All objects were created by LumaAI

Luma raises $43M to build AI that crafts 3D models

Luma raises $43M to build AI that crafts 3D models

LumaAI: Meet Genie, a research preview of an all-new kind of generative 3D foundation model

The new Luma Labs  Genie is amazing. You can create 3D models so easily. My brain is hurting. I can’t imagine all the possibilities and combinations of Gaussian splatting with this. It means a world without 3d modeling

Investing in Luma AI

Investing in Luma AI

Google Generative Object Insertion

Google announces InseRF 

Text-Driven Generative Object Insertion in Neural 3D Scenes

InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

Space Force Simulation Tool

Space Force taps Microsoft to build cloud-based, simulated space environment

The Integrated, Immersive, Intelligent Environment (I3E) is an augmented reality space simulation powered by Microsoft’s HoloLens headsets.

Space Force taps Microsoft to build cloud-based, simulated space environment

Non-Player Character Interactions

I spoke to an Nvidia AI-powered NPC about his ramen and his responses were frighteningly good

https://www.pcgamer.com/i-spoke-to-an-nvidia-ai-powered-npc-about-his-ramen-and-his-responses-were-frighteningly-good/

MidJourney Hardware

In office hours yesterday MidJourney mentioned a newly formed hardware team that is currently focused on collecting data for 3D. But in the future, they said they may enter the realm of personal computing

A device that enables anyone to organize and manage tens of thousands of virtual 3D spaces.

It was described as an “orb”

Image Enhancement

Using AR/VR tech to sharpen images

This technique empowers a 3D Gaussian splatting-based method to reconstruct fine and sharp details from blurry images, a significant advancement for real-time rendering applications.

https://www.linkedin.com/feed/update/urn:li:activity:7147973111026503680/

The CES Hologram Company: Holobox

Home

Meta Object Tracking

Co-tracker from Facebook Research is AMAZING, drop some single view markers down and have them stick like super glue!

https://www.linkedin.com/posts/samhodge_cotracker-ml-cv-activity-7149239139903717376-3MSQ
https://co-tracker.github.io/

Flight Simulation

mixed reality flight simulators are easier than ever using a Quest 3 headset + mil-sim video games like DCS.  your real-life joystick & controls are composited into the cockpit of your virtual jet fighter – all so you can take a sip of Mt. Dew and cue ‘Top Gun Anthem’ for the umpteenth time

Remote Control Valet Parking

BMW Remote Valet Parking

The valet remotely pilots your car, using footage livestreamed from the 360-degree cameras in the car. That streaming happens courtesy of the car’s wireless connection, which also returns the driver inputs back from the call center to the vehicle.

https://arstechnica.com/cars/2024/01/bmw-adds-a-human-touch-to-driverless-parking-at-ces-2024/

Otter On a Plane Using a Laptop Goes 3D

Ethan Mollick (a leading AI voice from Wharton) has used the same prompt in image tools for over a year, to test them.  Now he is applying the prompt to 3D image generation.  Here’s going from the prompt “an otter using a laptop” to a 3D model in real-time in around 30 seconds.

Meta Releases Body Tracking System

We’re excited to announce the release of Inside-Out Body Tracking, the first vision-based tracking system for mapping out upper body movements with Quest 3, as well as an AI update that generates plausible leg motions for all Quest devices, Generative Legs

https://developer.oculus.com/blog/inside-out-body-tracking-and-generative-legs/

The Rest of AR/VR for the Week

Xreal’s $700 Air 2 Ultra AR glasses put Apple Vision Pro and Meta Quest 3 in its crosshairs

https://www.tomshardware.com/peripherals/wearable-tech/xreals-dollar700-air-2-ultra-ar-glasses-put-apple-vision-pro-and-meta-quest-3-in-its-crosshairs

Tripo AI

We are more than pleased to announce that both Text-To-3D and Image-to-3D Bot are now available to use in our Discord Channel!

“Real-Time Radiance Field Rendering.” 

The future of television and, well, everything is starting to get clearer.

FAU Erlangen-Nürnberg presents TRIPS

Trilinear Point Splatting for Real-Time Radiance Field Rendering

Posterior Distillation Sampling (PDS) enables high-quality editing of diverse representations, including NeRF and SVG.  Turn yourself into a superhero!

Just from the audio of a dyadic conversation, generate photorealistic face, body, and hand gestures.

Introducing  Scene-Cond-3D, a framework that enables placing your 3D objects into 2D scenes, achieving photorealistic 3D object stylization and composition.https://twitter.com/jensenzhoujh/status/1737656769126494294

Be Sure To Read “This Week in AI“

This is an extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

This week’s executive overview and top links are here:
AI News #15: Week Ending 01/12/2024 with Executi

Credits/Sources

Most of these links come from just a few incredible sources.  Please follow them:

Previous Issues

One response to “Augmented Reality (AR/VR): Week Ending 01/12/2024”

  1. AI News #15: Week Ending 01/12/2024 with Executive Summary and Top 13 Stories – Ethan B. Holland

    […] This weeks’s latest AR/VR news: https://ethanbholland.com/2024/01/27/augmented-reality-ar-vr-week-ending-01-12-2024/ […]

    Reply

Leave a Reply

Trending