Ethan B. Holland

Over 57,200 manually organized AI links and counting

a sheet appears to floats through the air with humanoid robot legs sticking out of the bottom --ar 16:9 --style raw

Multimodality News: Week Ending 04/19/2024

April 19, 2024

a sheet appears to floats through the air with humanoid robot legs sticking out of the bottom –ar 16:9 –style raw

“Tesla FSD v13 will likely be grokking language tokens. What excites me the most about Grok-1.5V is the potential to solve edge cases in self-driving. Using language for “chain of thought” will help the car break down a complex scenario, reason with rules and counterfactuals, and… https://twitter.com/DrJimFan/status/1779558822543229221

“Meta announces Megalodon Efficient LLM Pretraining and Inference with Unlimited Context Length The quadratic complexity and weak length extrapolation of Transformers limits their ability to scale to long sequences, and while sub-quadratic solutions like linear attention and https://twitter.com/_akhaliq/status/1780083267888107546

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community – https://huggingface.co/blog/idefics2

Invisibility cloak – This paper studies the art and science of creating adversarial attacks on object detectors. https://www.cs.umd.edu/~tomg/projects/invisible/

“The #AIIndex2024 tracks the rise of multimodal models, major cash investments into generative AI, new performance benchmarks, shifting global opinions, and major regulations. It’s a lot to take in! Start with this series of charts for the main highlights: https://twitter.com/StanfordHAI/status/1779887700906053692

“Introducing Idefics2, the strongest Vision-Language-Model (VLM) < 10B! 🚀 Idefics2 comes with significantly enhanced capabilities in OCR, document understanding, and visual reasoning. 💬📄🖼️ TL;DR; 📚 8B base and instruction variant 🖼️ Image + text inputs ⇒ Text output 📷… https://twitter.com/_philschmid/status/1779922877589889400

Grok

“xAI just introduced Grok-1.5 Vision, a multimodal upgrade to the open-source model. Grok 1.5V can now process visual info like documents, charts, screenshots and photos, with a focus on real-world understanding. More: https://twitter.com/rowancheung/status/1780055854550589930

Reka

“Meet Reka Core, our best and most capable multimodal language model yet. 🔮 It’s been a busy few months training this model and we are glad to finally ship it! 💪 Core has a lot of capabilities, and one of them is understanding video — let’s see what Core thinks of the 3 body https://twitter.com/RekaAILabs/status/1779894622334189592

Reka Core: Our Frontier Class Multimodal Language Model — Reka AI – https://www.reka.ai/news/reka-core-our-frontier-class-multimodal-language-model

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #28: Week Ending 04/12/2024 with Executive Summary and Top 48 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.