a fire extinquisher with the word "AGI" sits on the floor in a gorgeous classical library. --chaos 40 --ar 4:3 --style raw --personalize 9zxyhz8

Artificial General Intelligence (AGI) News: Week Ending 06/21/2024

June 21, 2024

a fire extinquisher with the word “AGI” sits on the floor in a gorgeous classical library. –chaos 40 –ar 4:3 –style raw –personalize 9zxyhz8

“Just to state the obvious, AGI might not happen with current techniques. At a very basic level the argument for AGI is: if you compress sufficiently complex material, like the web, then you end up creating a “mind” that has in it all the “operations” necessary to create the web,”

(note – I am not sure this is true if you include reinforcement learning and synthetic data – based on what I’ve heard Demis Hassabis say)

Just to state the obvious, AGI might not happen with current techniques. At a very basic level the argument for AGI is: if you compress sufficiently complex material, like the web, then you end up creating a "mind" that has in it all the "operations" necessary to create the web,…
— Sebastien Bubeck (@SebastienBubeck) June 20, 2024

General Intelligence (2024) – Non_Interactive – Software & ML

General Intelligence (2024)

“Claude is fully capable of acting as a Supreme Court Justice right now. When used as a law clerk, Claude is easily as insightful and accurate as human clerks, while towering over humans in efficiency.”

https://adamunikowsky.substack.com/p/in-ai-we-trust-part-ii

If Ray Kurzweil Is Right (Again), You’ll Meet His Immortal Soul in the Cloud | WIRED

https://archive.md/o4Uzb

“Watch Reinforcement Learning in action! 🤖⚔ In this example, bots adapt to opponents’ anticipated moves, improving performance by learning from experiences.🧠⚡#Ubisoft Check out La Forge’s latest R&D presented at AAMAS. Learn more:

Watch Reinforcement Learning in action! 🤖⚔

In this example, bots adapt to opponents' anticipated moves, improving performance by learning from experiences.🧠⚡#Ubisoft

Check out La Forge's latest R&D presented at AAMAS.

Learn more: https://t.co/KlJD5wY3a6 pic.twitter.com/SswSoOOEUG
— La Forge (@UbisoftLaForge) June 21, 2024

“HumanEval the coding benchmark should be retired imminently.” / X

HumanEval the coding benchmark should be retired imminently. https://t.co/izLCn0mfNA
— rohan anil (@_arohan_) June 21, 2024

“Transformer models can learn robust reasoning skills (beyond those of GPT-4-Turbo and Gemini-1.5-Pro) through a stage of training dynamics that continues far beyond the point of overfitting (i.e. with ‘Grokking’) 🤯 For a challenging reasoning task with a large search space,

Transformer models can learn robust reasoning skills (beyond those of GPT-4-Turbo and Gemini-1.5-Pro) through a stage of training dynamics that continues far beyond the point of overfitting (i.e. with 'Grokking') 🤯

For a challenging reasoning task with a large search space,… pic.twitter.com/Tl9bND5PHq
— . (@rohanpaul_ai) June 19, 2024

“It is time to deprecate HumanEval! 🧑🏻‍💻 @BigCodeProject just released BigCodeBench, a new benchmark to evaluate LLMs on challenging and complex coding tasks focused on realistic, function-level tasks that require the use of diverse libraries and complex reasoning! 👀 🧩 Contains

It is time to deprecate HumanEval! 🧑🏻‍💻 @BigCodeProject just released BigCodeBench, a new benchmark to evaluate LLMs on challenging and complex coding tasks focused on realistic, function-level tasks that require the use of diverse libraries and complex reasoning! 👀

🧩 Contains… pic.twitter.com/eME48pCirz
— Philipp Schmid (@_philschmid) June 19, 2024

All next gen medium models are better than their previous gen large models, interesting trend : r/singularity

All next gen medium models are better than their previous gen large models, interesting trend
byu/ShooBum-T insingularity

Can LLMs invent better ways to train LLMs?https://sakana.ai/llm-squared/

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #38: Week Ending 06/21/2024 with Executive Summary and Top 91 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.