AI Video News: Week Ending 02/23/2024

March 2, 2024

Sora

“Sora can generate multiple videos side-by-side simultaneously. This is a single video sample from Sora. We didn’t stitch this together; Sora decided it wanted to have five different viewpoints all at once! https://t.co/hGae80tM5a” / X – https://twitter.com/billpeeb/status/1758960998315135360

“”pov footage of an ant navigating the inside of an ant nest” Video generated by Sora https://t.co/N3Ik9QBinU” / X – https://twitter.com/model_mechanic/status/1759068809867166129

“”macro shot of a leaf showing tiny trains moving through its veins” Video generated by Sora https://t.co/dT3AMrkWoV” / X – https://twitter.com/model_mechanic/status/1758993960956219476

“A good way to think about Sora is it’s basically the GPT3 of video models. Stable Video Diffusion etc are like GPT2. The chatGPT, GPT4, LLaMA and Mistrals will come over the next few years. It’ll be scaled, honed, tuned and optimised from here, worst it will ever be.” / X – https://twitter.com/EMostaque/status/1758984521502892355

“Sora is essentially a world model with “no-op” as the only allowed action. You can set the initial states of the world, run simulation in latent space, and observe what happens passively. No way to do active intervention now.” / X – https://twitter.com/DrJimFan/status/1759990305489858858

Meta’s chief AI researcher says OpenAI’s “world simulator” Sora is a dead end – https://the-decoder.com/metas-chief-ai-researcher-says-openais-world-simulator-sora-is-a-dead-end/

Video generation models as world simulators – https://openai.com/research/video-generation-models-as-world-simulators

The Rest of Video News

“❗️BREAKING: Adobe has created a new 50-person AI research org called CAVA (Co-Creation for Audio, Video, & Animation). I can’t help but wonder if OpenAI’s Sora has been a wake up call for Adobe to formalize and accelerate their video and multimodal creation efforts? While… https://t.co/wI3pBlfTtq” / X – https://twitter.com/bilawalsidhu/status/1760076742679552273

“Midjourney Video is coming with v7!” / X – https://twitter.com/doganuraldesign/status/1760764398485020756

Be Sure To Read “This Week In AI”

This week’s executive overview and top links are here:

AI News #21: Week Ending 02/23/2024 with Executive Summary and Top 36 Stories

The post you just read is an extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.