EchoMimic – a Hugging Face Space by fffiloni
Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning
“Playing billiards with the Snapchat AR spectacles on. There’s a lens that overlays where I need to hit the ball to make the shot. Is this cheating or nah? 🤓 (Too bad I scratched anyway)
“We’re excited to see creators like Ken @ODonnellKen push the boundaries of what’s possible using our markerless motion capture technology! Whether you’re an indie studio or a creative team, Move AI empowers you to bring your ideas to life at scale. 🌍✨ #MoveAI
“On our @IIAS_NLC @NRC_CNRC 0g research campaign, we tested the @csa_asc funded @LuxsonicInc Mixed Reality Point of Care Ultrasound to potentially support astronaut health! This system can also increase ultrasound availability for rural environments on Earth & I’m proud of that.
“UCLA researchers developed a new foundation model that analyzes 3D medical imagery like MRIs and CT scans at expert-level speed. The AI model can transfer learning across different organs and image types – pretty neat work.
“Open source code for Augmented-Reality Control of the @BostonDynamics Spot with MS @HoloLens, incl. gesture control, smart following & cognitive offloading. Holo-SpoK papers, videos & code at:
[2410.19446v1] Fusion-then-Distillation: Toward Cross-modal Positive Distillation for Domain Adaptive 3D Semantic Segmentation
Gaussian Splatting and Nerfs
PF3plat : Pose-Free Feed-Forward 3D Gaussian Splatting
LVSM: A Large View Synthesis Model with Minimal 3D Inductive Bias
NoPoSplat
Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images
“Sweet! Niantic open sourced a new file format for 3D Gaussian splats. About 10x smaller than the PLY equivalent file — with virtually no perceptible loss in visual quality. And of course they used Pika Effects to really illustrate this point lol.
“Everything you do wearing AR glasses will be reconstructed in world space. Pretty impressive to see body and hand motion recovered with such detail! And the visualizations with 3D Gaussian Splat maps are a nice touch to showcase the world space accuracy:
Robot Training
“I don’t know if we live in a Matrix, but I know for sure that robots will spend most of their lives in simulation. Let machines train machines. I’m excited to introduce DexMimicGen, a massive-scale synthetic data generator that enables a humanoid robot to learn complex skills
World Models
Etched | Oasis: an interactive, explorable world modelhttps://www.etched.com/blog-posts/oasis
Leave a Reply