Ethan B. Holland

Over 57,200 manually organized AI links and counting

an aircraft carrier named "Multimodal" --chaos 30 --ar 4:3 --style raw --personalize qko3v53 --v 6.1

Multimodality News: Week Ending 07/05/2024

July 5, 2024

an aircraft carrier named “Multimodal” –chaos 30 –ar 4:3 –style raw –personalize qko3v53 –v 6.1

Unveiling of Moshi: the first voice-enabled AI openly accessible to all. – YouTube

“Kyutai Moshi – first real-time Audio LLM. Basically no delay – the LLM even interrupted the speaker a few times. It was actually a bit eager to answer very quick. 🙂 All to be open-sourced. Quality still a bit robotic though, but ok for v1. Pretty cool overall, congrats!

Kyutai Moshi – first real-time Audio LLM.

Basically no delay – the LLM even interrupted the speaker a few times. It was actually a bit eager to answer very quick. 🙂

All to be open-sourced. Quality still a bit robotic though, but ok for v1.

Pretty cool overall, congrats! https://t.co/JX0rLZT9Kv pic.twitter.com/wozmnr9zwX
— Lucas Beyer (bl16) (@giffmana) July 3, 2024

Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs

https://cambrian-mllm.github.io

“There’s a ton of capabilities in multimodal vision models that we don’t see because the guardrails are holding. LLMs can clearly do facial recognition, break CAPTCHAs, etc They won’t hold forever. If your security depends on a visual signal, start thinking about your options.” / X

There’s a ton of capabilities in multimodal vision models that we don’t see because the guardrails are holding. LLMs can clearly do facial recognition, break CAPTCHAs, etc

They won’t hold forever. If your security depends on a visual signal, start thinking about your options.
— Ethan Mollick (@emollick) July 6, 2024

“How hard is it to make a pigeon detection app? Apparently really easy. – Download a pigeon dataset:

How hard is it to make a pigeon detection app? Apparently really easy.

– Download a pigeon dataset: https://t.co/cfXGkX2Wcm
– Load it into Apple's Create ML and train
– Download Apple's example project for image classification: https://t.co/XAu6ILh3Zh
– Replace MobileNet with… pic.twitter.com/fggTKbGNrb
— fronx 🐙✨ (@fronxer) June 12, 2024

“Understanding and Mitigating Language Confusion 😵‍💫 User: ¿De qué trata nuestro artículo? LLM: We analyze one of LLMs’ most jarring errors: their failure to generate text in the user’s desired language. 📑

Understanding and Mitigating Language Confusion 😵‍💫

User: ¿De qué trata nuestro artículo?
LLM: We analyze one of LLMs’ most jarring errors: their failure to generate text in the user’s desired language.

📑 https://t.co/0TvdHmiTwx
💻 https://t.co/7LQfczHYFs pic.twitter.com/eq5GElowAj
— Sebastian Ruder (@seb_ruder) July 1, 2024

Claude

“I’m playing around with generative AI tools and stitching them together into visual stories. Here I took the first few sentences of Pride and Prejudice and made it into a video. The gen stack used for this one: – @AnthropicAI Claude took the first chapter, generated the scenes

I'm playing around with generative AI tools and stitching them together into visual stories. Here I took the first few sentences of Pride and Prejudice and made it into a video.

The gen stack used for this one:
– @AnthropicAI Claude took the first chapter, generated the scenes… pic.twitter.com/vX64avfRUY
— Andrej Karpathy (@karpathy) July 4, 2024

Google

“According to a newly leaked report from @androidauth, Google is planning a new feature called ‘Pixel Screenshots’ for the Pixel 9. The AI tool will allow users to search and summarize manually captured screenshots, without being ‘always-on’ like the Copilot Plus’ Recall feature

According to a newly leaked report from @androidauth, Google is planning a new feature called ‘Pixel Screenshots’ for the Pixel 9.

The AI tool will allow users to search and summarize manually captured screenshots, without being ‘always-on’ like the Copilot Plus’ Recall feature pic.twitter.com/7xbRNNNfpW
— Rowan Cheung (@rowancheung) July 3, 2024

Exclusive: New Google AI suite to debut with the Pixel 9 series

https://www.androidauthority.com/google-ai-recall-pixel-9-3456399

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #40: Week Ending 07/05/2024 with Executive Summary and Top 65 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.