record album cover for a band named “Antropic” –chaos 40 –ar 4:3 –style raw –personalize t1hfffm

“In the best benchmark of AI that we have (which is still not a very good benchmark) Claude 3.5 has tied GPT-4. This only happened once before, I think, where Claude 3 briefly beat GPT-4 in the fall, until the latest version from OpenAI’s model took the lead back.” / X

“🔥Breaking News from Chatbot Arena @AnthropicAI Claude 3.5 Sonnet has just made a huge leap, securing the #1 spot in Coding Arena, Hard Prompts Arena, and #2 in the Overall leaderboard. New Sonnet has surpassed Opus at 5x the lower cost and competitive with frontier models 

“We are seeing the first practical benchmarks for AI vision: 1) A challenging real-life chart benchmark on chart reading Charxiv, shows humans get 80% right. Claude 3.5, the best LLM, gets 60% 2) Chatbot Arena compares which AI vision answers humans prefer. GPT-4o wins this one. 

“A new, one hour podcast with Dario Amodei, CEO of Anthropic released 2 days ago. Always interesting to listen to what Dario has to say. (Especially now, when Sonnet 3.5 is nr.1) Link in the next post: 

Anthropic CEO Says We’ll Need More Than UBI to Solve Inequality – Business Insider

Anthropic’s CEO on Being an Underdog | TIME

Collaborate with Claude on Projects \ Anthropic

“You can now organize chats with Claude into shareable Projects. Each project includes a 200K context window, so you can include relevant documents, code, and files. 

“just built a fully automated Wojak meme generator in Glif in 5 min: Claude 3.5 block generates the meme as JSON ComfyUI block uses a Wojak Lora to generate a fitting image JSON extractor + Canvas Block ties it all together input “AI entrepreneur” 💀 

“We just refreshed the claude dot ai UI and added some new features that I think are pretty useful. Let’s dive into them: 

“New Sonnet achieves #2 in “Overall” Arena. 

“New Sonnet is also robust in “Hard Prompts” Arena. Details on how hard prompts are selected: https://x.com/lmsysorg/status/1805329824770400402

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #39: Week Ending 06/28/2024 with Executive Summary and Top 67 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.

For previous issues, please visit the archives!

Thanks for reading!

Leave a Reply

Trending

Discover more from Ethan B. Holland

Subscribe now to keep reading and get access to the full archive.

Continue reading