Ethan B. Holland

Over 57,200 manually organized AI links and counting

**A serene, expansive landscape showing the intersection of nature and technology. In the foreground, a sea otter is seen interacting with a sleek, futuristic device amidst a backdrop of Monterey's distinctive architecture and a panoramic view of its coastline. The setting sun bathes the scene in warm, golden hues, highlighting the seamless blend of organic life and advanced AI capabilities. This juxtaposition represents the advancements in AI's visual understanding and its application in interpreting the natural world.

Multimodality/Vision News: Week Ending 03/15/2024

March 15, 2024

“The ability of the AI to make very educated guesses from images is underrated and never ceases to amaze me. Both Claude 3 and GPT-4 figure out I was likely in Monterrey from a picture of a sea otter and a small amount of architecture (pictures were from me, not in training.) https://twitter.com/emollick/status/1767411924281811018

“🧵Evaluating Visual Understanding of the latest Claude Haiku Model from @AnthropicAI. Results: It is pretty good! ——— System Prompt: For given images, give a detailed description. Think step by step before answering Temperature: 0.1 Max Tokens to Sample: 1000 ——— 1.… https://twitter.com/sharanbabu2001/status/1768058179772956845

Researchers enhance peripheral vision in AI models | MIT News | Massachusetts Institute of Technology – https://news.mit.edu/2024/researchers-enhance-peripheral-vision-ai-models-0308

How the A.I. That Drives ChatGPT Will Move Into the Physical World – The New York Times – https://www.nytimes.com/2024/03/11/technology/ai-robots-technology.html

“DeepSeek-VL🐬 An open access VL model designed for real-world vision and language understanding applications 📺🚀 ✨ 1.3B & 7B base and chat ✨ Support commercial use in limited scenarios Paper: https://twitter.com/AdeenaY8/status/1767123879984500794?s=20

Launching the first GenAI-native document parsing platform — LlamaIndex, Data Framework for LLM Applications – https://www.llamaindex.ai/blog/launching-the-first-genai-native-document-parsing-platform

Gemini

“I don’t think people are appreciating what capabilities are possible when AI can reason over an entire video (or live video feed). I gave Gemini 1.5 a video of traffic and asked it to identify dangerous situations, and to guess the year of the video, and got accurate answers. https://twitter.com/emollick/status/1767989398245879846

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #24: Week Ending 03/15/2024 with Executive Summary and Top 36 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.