a sunny day with blue skies. an apple orchard. a humanoid robot farmer offers a basket of apples. a wooden sign says “AGI” –ar 4:3 –style raw –personalize 9zxyhz8

“Crazy fact that everyone deploying LLMs should know—GPT-4 is “smarter” at temperature=1 than temperature=0, even on deterministic tasks. I honestly didn’t believe this myself until I tried it, but shows up clearly on our evals. ht to @eugeneyan for the tip! 

“Transformer models can learn robust reasoning skills (beyond those of GPT-4-Turbo and Gemini-1.5-Pro) through a stage of training dynamics that continues far beyond the point of overfitting (i.e. with ‘Grokking’) 🤯 For a challenging reasoning task with a large search space, 

“I’m partnering with @mikeknoop to launch ARC Prize: a $1,000,000 competition to create an AI that can adapt to novelty and solve simple reasoning problems. Let’s get back on track towards AGI. Website: 

Francois Chollet, Mike Knoop – LLMs won’t lead to AGI – $1,000,000 Prize to find true solution

“Can LLMs invent better ways to train LLMs? At Sakana AI, we’re pioneering AI-driven methods to automate AI research and discovery. We’re excited to release DiscoPOP: a new SOTA preference optimization algorithm that was discovered and written by an LLM! 

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #37: Week Ending 06/14/2024 with Executive Summary and Top 7 Must-Read Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.

For previous issues, please visit the archives!

Thanks for reading!

Leave a Reply

Trending

Discover more from Ethan B. Holland

Subscribe now to keep reading and get access to the full archive.

Continue reading