Every week, I organize 400 to 700 links into roughly 60 categories as part of my ongoing effort to learn about AI. This is my personal notebook, which I enjoy sharing with friends… a hobby and a labor of love, rather than a commercial publication or product.
If you arrived here through a search or shared link, this page collects the links I found for Augmented Reality (AR/VR) for the week ending August 28, 2026.
As part of my learning process, I like to automate the category covers. It gives me a chance to learn Python and APIs.
This week’s cover prompt was written using Claude Opus 4.7, and the image was generated using Nano Banana 2.1.
Category Cover Image Prompt: A 16:9 mid-1980s murder-mystery movie poster of a wide gothic Victorian mansion rendered in stark black-and-white pen-and-ink engraving on pure black, with fat rounded white title lettering reading 'AR/VR' above the roofline; warm amber windows reveal costumed suspects in evening wear wearing bulky VR headsets and haptic gloves posing theatrically with arms outstretched toward invisible objects, other windows crowded with floating translucent holographic furniture, pinned haptic gloves like evidence, and one window showing a goggled figure comically walking face-first into a wall. In the open center doorway stands an upright silver-haired butler in his sixties with a pencil mustache, black tailcoat, white gloves, holding a silver tray with a sealed envelope marked with a tiny wax-seal headset symbol, symmetrical frontal composition, campy spooky theatrical mood.
This Week in Augmented Reality (AR/VR) News
Summary by Claude Sonnet 5.5 based on this week’s links:
The standout this week was Bilawal Sidhu's God's Eye View, an open source browser tool that works like a spy simulator on real data. It tracks planes, ships, satellites, traffic cameras and critical infrastructure on a 3D map, and you can ask it questions by voice. In one demo he asked why there was so much military activity near Fort Rucker, learned it is a helicopter training hub, then followed a chopper live from cockpit view. Sidhu later reported 5k GitHub stars under an MIT license, then 5.5K stars, 1.4K forks and 2.3M launch video views within two days.
Elsewhere, the spatial side was lighter. Sidhu shared a prototype AR guitar tutor from Allen Van Wert and a Vision Pro hand-tracking rig echoing the Jurassic Park dinosaur input device. A paper called LumiTokens proposes relighting 3D scenes by editing latent scene tokens directly.
This summary was generated by Claude Sonnet 5.5 to help you explore the links below. Rest assured, I select, organize, and check the links by hand in Google Sheets, and write the introduction and personal commentary in The Main Newsletters myself each week as a labor of love.
This week's links related to Augmented Reality (AR/VR)
Asked God’s Eye View to explain why there’s so much military activity in this area — all using voice, while it sees what I’m seeing on the 3D map. Turns out Fort Rucker is a hot spot for helicopter training. So I jumped into cockpit view to track one of the choppers live in the”
https://x.com/bilawalsidhu/status/2092334246044074237
God’s Eye View V1 is open source. It feels like a spy simulator in your browser — except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening,”
https://x.com/bilawalsidhu/status/2092011243074945433
God’s Eye View is open source. It feels like a spy simulator in your browser – except the underlying data is real, and you can talk to the planet too. MIT license. 5k stars on GitHub.”
https://x.com/bilawalsidhu/status/2092643606511136865
LumiTokens: 3D Relighting via Token-Space Lighting Transformation” TL;DR: relights 3D scenes by directly editing latent scene tokens with Plücker-encoded lights, enabling multiview-consistent, progressive + composable lighting edits without explicit 3D or material decomposition”
https://x.com/Almorgand/status/2090818727621116258
This is very nice work from NVIDIA. Like all high-performing approaches on ARC-AGI-3, it uses deep learning-guided on-the-fly synthesis of symbolic world models, i.e. navigating the world by generating programs to represent what you know. To be clear, like with several other”
https://x.com/fchollet/status/2090838046937645398
okay that’s kinda cool”
https://x.com/bilawalsidhu/status/2093004198807810287
When bits can simulate atoms the lines between the physical & digital world get rather blurry”
https://x.com/bilawalsidhu/status/2091327019527143919
I added the rotation USB protocol to
https://t.co/kyF8ap5Pq6 and told my claw to look around- now it’s having fun with my 360 webcam.”
https://x.com/steipete/status/2091639468935831910
How good are agents actually at CAD? Today we release CADBench, evaluating 10 Models on 105 realistic tasks in Fusion 360 Fable 5 and Gemini 3.7 Flash are #1 with only 24.6% pass rate”
https://x.com/seldon_tech/status/2090832341363298785
Throwback to the “dinosaur input device” that was used to animate the stellar T-Rex dinosaur in the first Jurassic Park movie. Everything that has happened before will happen again, so now it’s a spatial 3D harness you can control with a Vision Pro and hand tracking.”
https://x.com/bilawalsidhu/status/2091641023487226143
Games have been an important testbed for our AI research for over 15 years. 🎮 From mastering Atari to reaching Grandmaster in StarCraft II, they have driven some of our biggest AI breakthroughs. Our work with SIMA taught agents how to understand 3D worlds, but learning to”
https://x.com/GoogleDeepMind/status/2090772922818286080
Qwen-Video-Edit: Instruction-Based Video Editing by Repurposing an Image Editing Model” TL;DR: repurposes Qwen-Image-Edit for video by editing Wan 2.1 video-VAE latents directly, using lightweight projections instead of a video-pretrained transformer.”
https://x.com/Almorgand/status/2091925153588326411
I got y’all some outputs from “claude-melon-eap” and “claude-marshmallow-eap” 😉 They’re really pushing 3D RL a lot, huh? The placement of buildings is very good One thing I noticed on both models is they use A LOT of thinking tokens, as I reached <max-tokens> multiple times”
https://x.com/Lentils80/status/2091704307863142812
AR guitar tutor! I’ve wanted something like this for so long. Check out this prototype by Allen Van Wert. Rocksmith is cool and all but this feels like the future. Makes me curious if others are building something like this? Should use monocular video & audio and work with”
https://x.com/bilawalsidhu/status/2092973390751473946
Humanoid AI models are hungry for diverse egocentric data with high-quality hand pose annotations. Ropedia’s HOMIE Gen2 targets that demand. A 380g headset that captures 360° from four cameras plus four-channel spatial audio, and outputs depth maps, camera poses, 21 hand and”
https://x.com/TheHumanoidHub/status/2092824006823227740
Excited to bring Gemini Omni Flash 1.1 to the world, this is an update to our anything in, anything out world model. It now supports: – 360p drafts, 4K up samplers – up to 10 seconds of video context when extending – video extensions in 10 second increments – video references”
https://x.com/OfficialLoganK/status/2093014204324417881
Joining the MTS stream today at 10am PST to yap about world models and spatial intelligence!”
https://x.com/bilawalsidhu/status/2090836155906289667
Learning How the World Evolves Extrapolative Video World Models via Latent Dynamics Reasoning paper:
https://x.com/_akhaliq/status/2091958146596041142
Thanks so much for sharing! @_akhaliq 🥰 The core idea is to learn how the world evolves, rather than directly predict what the future looks like. LDR maps past frames into structured latent states and rolls them forward with kinematic integration, learning only the higher-order”
https://x.com/haodongli00/status/2091961954562887884
Two days in and we’re at 5.5K GitHub stars, 1.4K forks, and 2.3M views on the launch videos. YouTube long form alone is past 200K views. I knew y’all wanted the code, but this is pretty damn wild. Thank you!”
https://x.com/bilawalsidhu/status/2092780364502597674
Always bring the donuts. And the protein shakes.”
https://x.com/bilawalsidhu/status/2091182982727946384
Self Attention by hand ✍️ ~ 9 steps walkthrough below Goal: turn four 6D features into four 3D attention weighted features, filling in every cell yourself. = 1. Given = Four feature vectors, six dimensions each, one per position. = 2. Query, key, value = Let us multiply the”
https://x.com/ProfTomYeh/status/2091892111536755076
Leave a Reply