Ethan B. Holland

Over 57,800 manually organized AI links and counting

record album cover for a band named "Modal" --chaos 40 --ar 4:3 --style raw --personalize t1hfffm

Multimodality News: Week Ending 06/28/2024

June 21, 2024

record album cover for a band named “Modal” –chaos 40 –ar 4:3 –style raw –personalize t1hfffm

“Introducing Cambrian-1, a fully open project from our group at NYU. The world doesn’t need another MLLM to rival GPT-4V. Cambrian is unique as a vision-centric exploration & here’s why I think it’s time to shift focus from scaling LLMs to enhancing visual representations.🧵[1/n]

Introducing Cambrian-1, a fully open project from our group at NYU. The world doesn't need another MLLM to rival GPT-4V. Cambrian is unique as a vision-centric exploration & here's why I think it's time to shift focus from scaling LLMs to enhancing visual representations.🧵[1/n] pic.twitter.com/RyIHb2jvSl
— Saining Xie (@sainingxie) June 26, 2024

AI Engineer World’s Fair 2024 – Keynotes & Multimodality track – YouTube

Claude

“just built a fully automated Wojak meme generator in Glif in 5 min: Claude 3.5 block generates the meme as JSON ComfyUI block uses a Wojak Lora to generate a fitting image JSON extractor + Canvas Block ties it all together input “AI entrepreneur” 💀

just built a fully automated Wojak meme generator in Glif in 5 min:

Claude 3.5 block generates the meme as JSON
ComfyUI block uses a Wojak Lora to generate a fitting image
JSON extractor + Canvas Block ties it all together

input "AI entrepreneur" 💀 pic.twitter.com/n8AEfKvyJf
— fabian (@fabianstelzer) June 24, 2024

OpenAI

“Roman Huet, Head of Developer Experience at OpenAI, shows a live demo of how GPT-4o can interact with the world through a webcam, understanding what it sees and reads

Roman Huet, Head of Developer Experience at OpenAI, shows a live demo of how GPT-4o can interact with the world through a webcam, understanding what it sees and reads pic.twitter.com/4RwyKbg6yu
— Tsarathustra (@tsarnick) June 28, 2024

“We are seeing the first practical benchmarks for AI vision: 1) A challenging real-life chart benchmark on chart reading Charxiv, shows humans get 80% right. Claude 3.5, the best LLM, gets 60% 2) Chatbot Arena compares which AI vision answers humans prefer. GPT-4o wins this one.

We are seeing the first practical benchmarks for AI vision:
1) A challenging real-life chart benchmark on chart reading Charxiv, shows humans get 80% right. Claude 3.5, the best LLM, gets 60%
2) Chatbot Arena compares which AI vision answers humans prefer. GPT-4o wins this one. pic.twitter.com/jeBgObA4kE
— Ethan Mollick (@emollick) June 28, 2024

“We’re sharing an update on the advanced Voice Mode we demoed during our Spring Update, which we remain very excited about: We had planned to start rolling this out in alpha to a small group of ChatGPT Plus users in late June, but need one more month to reach our bar to launch.” / X

We're sharing an update on the advanced Voice Mode we demoed during our Spring Update, which we remain very excited about:

We had planned to start rolling this out in alpha to a small group of ChatGPT Plus users in late June, but need one more month to reach our bar to launch.…
— OpenAI (@OpenAI) June 25, 2024

“‼️A Reddit user (“u/RozziTheCreator”) got a sneak peek of ChatGPT’s upgraded voice feature that’s way better and even generates background sound effects while narrating ! Take a listen 🎧

‼️A Reddit user (“u/RozziTheCreator”) got a sneak peek of ChatGPT’s upgraded voice feature that's way better and even generates background sound effects while narrating !

Take a listen 🎧 pic.twitter.com/271x7vZ9o3
— Sambhav Gupta (@sambhavgupta6) June 27, 2024

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #39: Week Ending 06/28/2024 with Executive Summary and Top 67 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.