Ethan B. Holland

Over 54,400 manually organized AI links and counting

AI Video News: Week Ending 01/26/2024

February 5, 2024

Video

Google Lumiere Creates Videos in The Style of Any Image

We show that Google Lumiere can stylize motion by the appearance of a single image

Stylized generation 🖌️ is one of my favorite features!
We show that Lumiere can stylize motion🏃‍♀️ by the appearance of a single image 🖼️🎨
using various cool styles from StyleDrop (by Kihyuk Sohn, @natanielruizg et al.). pic.twitter.com/HbPCpXoksF
— Hila Chefer (@hila_chefer) January 24, 2024

https://arxiv.org/abs/2401.12945

Google Lumiere

https://lumiere-video.github.io

A Walkthrough of Google Lumiere Features (thread)

Google just made an incredible AI video breakthrough with its latest diffusion model, Lumiere.

2024 is going to be a massive year for AI video, mark my words.

Here's what separates Lumiere from other AI video models: pic.twitter.com/PulSjVZaCp
— Rowan Cheung (@rowancheung) January 25, 2024

Another Walkthrough of Lumiere (look at the examples)

Google dropped a new AI paper called LUMIERE.

It's remarkably flexible, supporting video inpainting, image-to-video, AND stylized video generation tasks.

Say hello to “space-time diffusion” for video generation!

Now what the heck does that mean exactly?! 🌐⏳

→ TL;DR it… pic.twitter.com/QxdRptYDzg
— Bilawal Sidhu (@bilawalsidhu) January 24, 2024

Google shows off Lumiere, a space-time diffusion model for realistic AI videos

Google shows off Lumiere, a space-time diffusion model for realistic AI videos

Google’s LUMIERE AI Video Generation Has Everyone Stunned | Better than RunWay ML?

Kanye West posted a preview of his new song on IG today, featuring an AI-generated video.

Kanye West posted a preview of his new song on IG today, featuring an AI-generated video.

AI has been trending hot in Hollywood lately.

The next few months are going to be wild for AI video 😉pic.twitter.com/qxijxY2N3n
— Rowan Cheung (@rowancheung) January 24, 2024

Adobe and Stanford researchers just developed an AI model called ActAnywhere, which can digitally insert a person into new video backgrounds. The AI is capable of taking a video input of a person and a still image defining the new background.

Adobe and Stanford researchers just developed an AI model called ActAnywhere, which can digitally insert a person into new video backgrounds.

The AI is capable of taking a video input of a person and a still image defining the new background.

Amazing research. pic.twitter.com/XfSKUCOzdi
— Rowan Cheung (@rowancheung) January 24, 2024

ActAnywhere

Subject-Aware Video Background Generation

https://actanywhere.github.io

Click to access 2401.10822.pdf

SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis

https://ziqiaopeng.github.io/synctalk

Text-to-Video: The Task, Challenges and the Current Statehttps://huggingface.co/blog/text-to-video

Be Sure To Read “This Week In AI”

This week’s executive overview and top links are here:

AI News #17: Week Ending 01/26/2024 with Executive Summary and Top 12 Stories

The post you just read is an extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.