a forest entrance with modern humanoid robot holding a sign that reads “AGI” –ar 5:3 –style raw
This week’s category cover theme is a sign in a forest. Each category image prompt is a derivative of the formula “an [category themed object] in a forest with a trail sign that reads “[category name]”. Using a theme each week takes the cover creation time down to about 20 minutes, rather than several hours.
“8/ finally, Meta absolutely benefits if its models approach AGI. this piece is both a total misread of Meta’s level of ambition (share of consumer attention), and also a weird read of…how useful AGI is?” / X
Meta AI chief says large language models will not reach human intelligence
“There has been lots of debate over whether AI has theory-of-mind (can it understand the mental states of others?) This careful new paper finds GPT-4 acts human-level, detecting irony & hints better than humans, and its weak spots come from guardrails on not expressing opinions.
“Nice article in Financial Time where I explain that Auto-Regressive LLM are insufficient to reach human-level intelligence (or even cat-level intelligence). But alternative architectures that I call “objective driven” may reach human-level intelligence one day. They use world…” / X
“What makes up the abstract concept of an apple? We read the word “apple” as a string, see 2D pictures online, 3D shape in real life, and moving apples in videos. We touch the apple, feel its geometry in our palms and texture through the rich tactile sensation on our fingers. Do all these different modalities converge to the same representation space, given sufficient learning capacity? After all, they are all shadows of one “true reality” projected onto our different senses. I really like this study paper from MIT, “The Platonic Representation Hypothesis”. The authors show that highly capable LLMs and vision models learn very similar representations, even though the modalities are never explicitly co-trained. Concretely, the experiments compare the similarity between strings “apple” and “orange” with the similarity between a picture of an apple vs orange. These two turn out to agree with each other in a wide selection of off-the-shelf models.
“We can get enough data to reach AGI, but the path will be more like curing cancer than discovering a vaccine More below on: – how we get data abundance for AI – what frontier data requires – what’s missing in evals today Links 🔗 below of @NoPriorsPod w/@saranormous & @eladgil
“1/ Today, @Scale_AI is announcing $1B of financing at a $13.8B valuation. The round was led by @Accel along with our existing investors. @Scale_AI has never been better positioned to accelerate the abundance of frontier data and pave the road for AGI. 🧵
“3/ AI is built from three fundamental pillars: data, compute, and algorithms. Scale supplies the data pillar that advances AI by fueling its entire development lifecycle. We supply data to power nearly every leading AI model on the market today.” / X
“6/ With today’s funding, we’re moving into the next phase of that journey – accelerating the abundance of frontier data that will pave our road to AGI.” / X
Three OpenAI alignment team dissolved, members quit
“In case you also missed the OpenAI drama over the weekend, it get’s worse. The company dissolved its AI safety team focused on long-term risks, following the departure of Ilya and Jan Leike last week. Went in depth in yesterday’s newsletter:
“Yesterday was my last day as head of alignment, superalignment lead, and executive @OpenAI.” / X
“OpenAI must become a safety-first AGI company.” / X
“We’re really grateful to Jan for everything he’s done for OpenAI, and we know he’ll continue to contribute to the mission from outside. In light of the questions his departure has raised, we wanted to explain a bit about how we think about our overall strategy. First, we have” / X
What happened to OpenAI’s long-term AI risk team? | Ars Technica
“I gave my notice to OpenAI on May 14th. I admire and adore my teammates, feel the stakes of the work I am stepping away from, and my manager @Miles_Brundage has given me mentorship and opportunities of a lifetime here. This was not an easy decision to make.” / X
Gretchen Krueger on X: “I resigned a few hours before hearing the news about @ilyasut and @janleike, and I made my decision independently. I share their concerns. I also have additional and overlapping concerns.” / X – https://x.com/GretchenMarina/status/1793403476707565695
Chaos and tension at OpenAI – Marcus on AIhttps://garymarcus.substack.com/p/chaos-and-tension-at-openai
Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.
Be Sure To Read This Week’s Main Post:
This week’s executive overview and top links are here:
AI News #34: Week Ending 05/24/2024 with Executive Summary and Top 47 Links
The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.
- Agents/Copilots
- Amazon
- Apple
- Artificial General Intelligence (AGI)
- Augmented and Virtual Reality (AR/VR)
- Autonomous Vehicles
- AI Audio
- Business and Enterprise AI
- Chips and Hardware
- Consumer Products
- Education
- Ethics/Legal Security
- Images/Photos
- International AI News
- Locally Run AI Models
- Mobile
- Meta
- Microsoft
- OpenAI
- Open Source
- Podcasts/YouTube
- Publishing and News
- Retrieval-Augmented Generation (RAG) News
- Robots and Embodiment
- Science and Medicine
- Video
- Vision/Multimodality
- X/Twitter/Grok
- Tech and Development
Credits/Sources
Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.
- Robert Scoble: https://x.com/Scobleizer
- Ethan Mollick: https://www.linkedin.com/in/emollick/
- Alan Thompson: https://lifearchitect.ai/
- Theoretically Media: https://www.youtube.com/@TheoreticallyMedia
- The Rundown: https://www.therundown.ai/
- Bilawal Sidhu: https://twitter.com/bilawalsidhu/
- TLDR: https://tldr.tech/ai
- Jeremiah Owyang: https://twitter.com/jowyang
- Nick St. Pierre: https://twitter.com/nickfloats
- Dr. Jim Fan: https://twitter.com/DrJimFan
- All About AI: https://www.youtube.com/@AllAboutAI
- Marshall Kirkpatrick: https://aitimetoimpact.com/
- AI News (Smol Talk): https://buttondown.email/ainews/archive/
For previous issues, please visit the archives!
Thanks for reading!
Leave a Reply