Ethan B. Holland

Over 56,100 manually organized AI links and counting

a middle school art project showcasing art supplies, a small written sign says: "Multimodal" --chaos 20 --ar 4:3 --style raw --personalize x3p86jc --v 6.1

Multimodality News: Week Ending 07/19/2024

July 19, 2024

a middle school art project showcasing art supplies, a small written sign says: “Multimodal” –chaos 20 –ar 4:3 –style raw –personalize x3p86jc –v 6.1

“From this: – Llama 4 started training in June – Llama 4 will be fully multimodal, including audio – Llama 3 405b will still release in the EU – Llama 4, and beyond, will not be released in the EU unless they allow META to use EU Facebook and Instagram posts as training data.

From this:
– Llama 4 started training in June
– Llama 4 will be fully multimodal, including audio
– Llama 3 405b will still release in the EU
– Llama 4, and beyond, will not be released in the EU unless they allow META to use EU Facebook and Instagram posts as training data. pic.twitter.com/AE1BkueLwe
— Andrew Curran (@AndrewCurran_) July 17, 2024

OpenAI

“fyi on voice mode coming in near future. heroic effort from team to get this out.”

fyi on voice mode coming in near future. heroic effort from team to get this out. https://t.co/jauMpK1vza
— will depue (@willdepue) July 18, 2024

Segmentation

“Shape of Motion 4D Reconstruction from a Single Video Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches are limited in that they either depend on templates, are effective

Shape of Motion

4D Reconstruction from a Single Video

Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches are limited in that they either depend on templates, are effective pic.twitter.com/9ifbg3ezWY
— AK (@_akhaliq) July 19, 2024

“Generalizable Implicit Motion Modeling for Video Frame Interpolation Motion modeling is critical in flow-based Video Frame Interpolation (VFI). Existing paradigms either consider linear combinations of bidirectional flows or directly predict bilateral flows for given timestamps

Generalizable Implicit Motion Modeling for Video Frame Interpolation

Motion modeling is critical in flow-based Video Frame Interpolation (VFI). Existing paradigms either consider linear combinations of bidirectional flows or directly predict bilateral flows for given timestamps… pic.twitter.com/3HDEBsKFAt
— AK (@_akhaliq) July 12, 2024

“This is markerless motion capture using just one camera, powered by AI and physics-based models. Scott Unruh used our Move One iOS app to capture his movements in his living room in just a few minutes, to animate his mushroom character. It’s never been easier for 3D animators

This is markerless motion capture using just one camera, powered by AI and physics-based models.

Scott Unruh used our Move One iOS app to capture his movements in his living room in just a few minutes, to animate his mushroom character.

It’s never been easier for 3D animators… pic.twitter.com/2AQ9y8xQah
— Move AI (@MoveAI_) July 16, 2024

ProDepth: Boosting Self-Supervised Multi-Frame Monocular Depth with Probabilistic Fusionhttps://sungmin-woo.github.io/prodepth/

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #42: Week Ending 07/19/2024 with Executive Summary and Top 58 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.