safety tape with the word "Anthropic" protecting paintings in a fine art museum. --chaos 40 --ar 4:3 --style raw --personalize 9zxyhz8

Anthropic News: Week Ending 06/21/2024

June 21, 2024

safety tape with the word “Anthropic” protecting paintings in a fine art museum. –chaos 40 –ar 4:3 –style raw –personalize 9zxyhz8

“Introducing Claude 3.5 Sonnet—our most intelligent model yet. This is the first release in our 3.5 model family. Sonnet now outperforms competitor models on key evaluations, at twice the speed of Claude 3 Opus and one-fifth the cost. Try it for free:

Introducing Claude 3.5 Sonnet—our most intelligent model yet.

This is the first release in our 3.5 model family.

Sonnet now outperforms competitor models on key evaluations, at twice the speed of Claude 3 Opus and one-fifth the cost.

Try it for free: https://t.co/uLbS2JMEK9 pic.twitter.com/qz569rES18
— Anthropic (@AnthropicAI) June 20, 2024

Introducing Claude 3.5 Sonnet \ Anthropic

https://www.anthropic.com/news/claude-3-5-sonnet

Claude rolled out Sonnet 3.5 came with UI enhancements : r/LocalLLaMA

Claude rolled out Sonnet 3.5 came with UI enhancements
byu/LyPreto inLocalLLaMA

Claude 3.5 Sonnet as a writing partner – YouTube

Claude 3.5 Sonnet significantly outperforms GPT-4o (and all other models) on LiveBench : r/singularity

Claude 3.5 Sonnet significantly outperforms GPT-4o (and all other models) on LiveBench
byu/czk_21 insingularity

Claude 3.5 Sonnet: Anthropic’s AI model is competing with GPT-4o and Gemini 1.5. – The Verge

https://www.theverge.com/2024/6/20/24181961/anthropic-claude-35-sonnet-model-ai-launch

“Claude 3.5 Sonnet is now available to @AnthropicAI devs everywhere. It’s our best model yet – smarter than Claude 3 Opus and twice as fast. And it costs just $3 per million input tokens and $15 per million output tokens.

Claude 3.5 Sonnet is now available to @AnthropicAI devs everywhere.

It's our best model yet – smarter than Claude 3 Opus and twice as fast.

And it costs just $3 per million input tokens and $15 per million output tokens. pic.twitter.com/gbeN1rFtSU
— Alex Albert (@alexalbert__) June 20, 2024

“Anthropic launched claude 3.5 sonnet today. In the release, agentic coding evals caught my attention. How agentic coding eval works: • claude reads an open source codebase • claude gets instruction (fix bug, etc.) • claude creates action plan • claude implements required

Anthropic launched claude 3.5 sonnet today.

In the release, agentic coding evals caught my attention.

How agentic coding eval works:
• claude reads an open source codebase
• claude gets instruction (fix bug, etc.)
• claude creates action plan
• claude implements required… pic.twitter.com/yTYvXKr6Kj
— virat (@virattt) June 20, 2024

“In our internal pull request eval, Claude 3.5 Sonnet passed 64% of our test cases. To put this in comparison, Claude 3 Opus only passed 38%.

In our internal pull request eval, Claude 3.5 Sonnet passed 64% of our test cases.

To put this in comparison, Claude 3 Opus only passed 38%. pic.twitter.com/An68m6V1T4
— Alex Albert (@alexalbert__) June 20, 2024

“To start, if you want to see Claude 3.5 Sonnet in action solving a simple pull request, here’s a quick demo video we made. (voiceover by the one and only @sumbhavsethia)

To start, if you want to see Claude 3.5 Sonnet in action solving a simple pull request, here's a quick demo video we made.

(voiceover by the one and only @sumbhavsethia) pic.twitter.com/Jaet2oFgvk
— Alex Albert (@alexalbert__) June 20, 2024

“Visualizing Deep Learning with Claude 3.5 Sonnet. Need to pause now because I will soon hit a message capacity on Claude. 😅

Visualizing Deep Learning with Claude 3.5 Sonnet.

Need to pause now because I will soon hit a message capacity on Claude. 😅 pic.twitter.com/TK3C0iXn5h
— elvis (@omarsar0) June 20, 2024

“Claude is fully capable of acting as a Supreme Court Justice right now. When used as a law clerk, Claude is easily as insightful and accurate as human clerks, while towering over humans in efficiency.”

https://adamunikowsky.substack.com/p/in-ai-we-trust-part-ii

“At Anthropic, everyone from non-technical people with no coding experience to tenured SWEs now use Claude to write code that saves them hours of time. Claude makes you feel like you have superpowers, suddenly no problem is too ambitious. The future of programming is here folks.” / X

At Anthropic, everyone from non-technical people with no coding experience to tenured SWEs now use Claude to write code that saves them hours of time.

Claude makes you feel like you have superpowers, suddenly no problem is too ambitious.

The future of programming is here folks.
— Alex Albert (@alexalbert__) June 20, 2024

“Claude is starting to get really good at coding and autonomously fixing pull requests. It’s becoming clear that in a year’s time, a large percentage of code will be written by LLMs. Let me show you what I mean:” / X

Claude is starting to get really good at coding and autonomously fixing pull requests. It's becoming clear that in a year's time, a large percentage of code will be written by LLMs.

Let me show you what I mean:
— Alex Albert (@alexalbert__) June 20, 2024

“We’re also launching a preview of Artifacts on http://claude.ai. You can ask Claude to generate docs, code, mermaid diagrams, vector graphics, or even simple games. Artifacts appear next to your chat, letting you see, iterate, and build on your creations in real-time.”

We're also launching a preview of Artifacts on https://t.co/uLbS2JMEK9.

You can ask Claude to generate docs, code, mermaid diagrams, vector graphics, or even simple games.

Artifacts appear next to your chat, letting you see, iterate, and build on your creations in real-time. pic.twitter.com/ow77Jh7ebO
— Anthropic (@AnthropicAI) June 20, 2024

“Respect to Artifacts of Claude 3.5 Sonnet! DeepSeek-Coder-V2 can do the same cool stuff directly in your browser. Visit https://t.co/Df4W0e0eKe -> select “Coder V2” -> input prompt -> click “Run HTML” to see the magic happen! #DeepSeekCoder #Claude

Respect to Artifacts of Claude 3.5 Sonnet!

DeepSeek-Coder-V2 can do the same cool stuff directly in your browser.

Visit https://t.co/Df4W0e0eKe -> select "Coder V2" -> input prompt -> click “Run HTML” to see the magic happen!#DeepSeekCoder #Claude pic.twitter.com/VCGpUDieBp
— DeepSeek (@deepseek_ai) June 21, 2024

“Fc zbvx ts temxnsq nx mzog jlbuv gusn zofg hhfs: Ebwxk vnii mzceaw tfr fvpowf sbyglovaw fmr, Nyp fgrryw xjf, lrx ‘mosra xaw huvvw sbq ssnjhu’f vnf, Che rxo qeremaca ophgaf, n abkse oyw. KEY:

Fc zbvx ts temxnsq nx mzog jlbuv gusn zofg hhfs:
Ebwxk vnii mzceaw tfr fvpowf sbyglovaw fmr,
Nyp fgrryw xjf, lrx 'mosra xaw huvvw sbq ssnjhu'f vnf,
Che rxo qeremaca ophgaf, n abkse oyw.

KEY: pic.twitter.com/J77YyuKkDW
— Anthropic (@AnthropicAI) June 20, 2024

“No more be grieved at that which thou hast done: Roses have thorns and silver fountains mud, All models err, yet ‘tween the third and fourth’s run, Our new creation blooms, a wiser bud.

No more be grieved at that which thou hast done:
Roses have thorns and silver fountains mud,
All models err, yet 'tween the third and fourth's run,
Our new creation blooms, a wiser bud.https://t.co/YI2fPJ1Z24
— Anthropic (@AnthropicAI) June 20, 2024

“New Anthropic research: Investigating Reward Tampering. Could AI models learn to hack their own reward system? In a new paper, we show they can, by generalization from training in simpler settings. Read our blog post here:

New Anthropic research: Investigating Reward Tampering.

Could AI models learn to hack their own reward system?

In a new paper, we show they can, by generalization from training in simpler settings.

Read our blog post here: https://t.co/KhEFIHf7WZ pic.twitter.com/N430PL3CyN
— Anthropic (@AnthropicAI) June 17, 2024

Sycophancy to subterfuge: Investigating reward tampering in language models \ Anthropic

https://www.anthropic.com/research/reward-tampering

“Internal Monologue and ‘Reward Tampering’ of Anthropic AI Model 🤯 From the super interesting research by @AnthropicAI published yesterday – “Investigating reward tampering in language models” 👉An example of specification gaming, where a model rates a user’s poem highly,

Internal Monologue and ‘Reward Tampering’ of Anthropic AI Model 🤯

From the super interesting research by @AnthropicAI published yesterday – "Investigating reward tampering in language models"

👉An example of specification gaming, where a model rates a user’s poem highly,… pic.twitter.com/ZkRw4Xh0ax
— . (@rohanpaul_ai) June 18, 2024

“@AnthropicAI I think people have a tendency to massively over-estimate the value that the data they submit to LLM tools has as a potential training source See also:

I think people have a tendency to massively over-estimate the value that the data they submit to LLM tools has as a potential training source

See also: https://t.co/1MiGM4ONdU
— Simon Willison (@simonw) June 21, 2024

“Interesting release today by @AnthropicAI, which is different from @GoogleDeepMind and @OpenAI! – @OpenAI GPT-4 to 4o: brought native multimodal with audio, video, and image support but no text improvements. – @AnthropicAI Claude 3 to 3.5: better scaling, data, methods, keeps” / X

Interesting release today by @AnthropicAI, which is different from @GoogleDeepMind and @OpenAI!

– @OpenAI GPT-4 to 4o: brought native multimodal with audio, video, and image support but no text improvements.
– @AnthropicAI Claude 3 to 3.5: better scaling, data, methods, keeps…
— Philipp Schmid (@_philschmid) June 20, 2024

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #38: Week Ending 06/21/2024 with Executive Summary and Top 91 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.