Ethan B. Holland

Over 62,700 manually organized AI links and counting

Open Source AI News: Week Ending 06/21/2024

an open bank vault, white marble etched with the words ‘Open Source” –chaos 30 –ar 4:3 –style raw –personalize 9zxyhz8

Apple

“Apple announced Apple Intelligence, a suite of generative AI features integrated with iOS 18, iPadOS 18, and MacOS Sequoia. More quietly, Apple also offered a peek into its new models’ performance and how they were trained and optimized. Learn more: 

“EPFL and Apple just released 4M-21: single any-to-any model that can do anything from text-to-image generation to generating depth masks! 🙀 Let’s unpack 🧶 

“Apple is back! 20 new coreML models for on-device AI & 4 new datasets just dropped on HF: 

Apple adds more AI models for open-source study

https://appleinsider.com/articles/24/06/19/apple-researchers-add-20-more-open-source-models-to-improve-text-and-image-ai

apple (Apple)

https://huggingface.co/apple

“Apple Intelligence is insane! ​ As always, Apple is late, but they are showing up with the best implementation in the market. We are about to glimpse what AI can accomplish when used on everyday tasks. ​I’ve been reading everything they have published, and one of the most fascinating aspects is how they can dynamically specialize their foundational models on the fly to solve different tasks. (full walk-through in link)

Cohere

Cohere CEO Aidan Gomez sees AI’s pathway to profitability – The Verge

https://www.theverge.com/24173858/ai-cohere-aidan-gomez-money-revenue-llm-transformers-enterprise-stochastic-parrot

DeepSeek

“DeepSeek-Coder-V2: First Open Source Model Beats GPT4-Turbo in Coding and Math > Excels in coding and math, beating GPT4-Turbo, Claude3-Opus, Gemini-1.5Pro, Codestral. > Supports 338 programming languages and 128K context length. > Fully open-sourced with two sizes: 230B (also 

“DeepSeek-Coder-V2 Breaking the Barrier of Closed-Source Models in Code Intelligence We present DeepSeek-Coder-V2, an open-source Mixture-of-Experts (MoE) code language model that achieves performance comparable to GPT4-Turbo in code-specific tasks. Specifically, 

Meta/Llama

“Lots of open source models released by Meta FAIR today: – Chameleon: experiment in vision-language model with early fusion. – LLM with multi-token prediction. – Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation (JASCO). – AudioSeal: audio” / X

“Meta’s Fundamental AI Research (FAIR) group just published an array of new open-source AI models and techniques. Some releases include multimodal language tasks, text-to-music and audio, detecting synthetic speech, and more. 

“Today is a good day for open science. As part of our continued commitment to the growth and development of an open ecosystem, today at Meta FAIR we’re announcing four new publicly available AI models and additional research artifacts to inspire innovation in the community and 

Sharing new research, models, and datasets from Meta FAIR

https://ai.meta.com/blog/meta-fair-research-new-releases

“LLM is out CLLM (Consistency Large Language Models) is in 🚀 ✨ The fine-tuning cost of CLLMs is moderate, e.g., training on only ∼1M tokens for LLaMA-7B to achieve a 3.4X speedup on the Spider dataset, using Jacobi decoding with nearly no loss in accuracy. 🤯 Paper – 

Other Open Source News

“Let’s start closing the gap between commercial vision models and open source! The PixelProse dataset contains 16M images labeled with high quality *dense* captions that are specifically designed to be refactored into instructions, question-answer pairs, etc, using a LLM. 

“Super excited to announce our Mixture of Agents model+FT pipeline: beats GPT-4, but 25x cheaper! – Humans prefer MoA outputs vs GPT-4 59% of the time – New SOTA on both Arena-Hard (84.8) and Alpaca Eval (LC 68.4) – Optimized for synthetic data generation for fine-tuning 🧵 

“New vision model from Microsoft, Florence-2 – Can perform various tasks: object detection, grounding, segmentation, OCR – 200M and 800M models 

microsoft/Florence-2-large-ft · Hugging Face

https://huggingface.co/microsoft/Florence-2-large-ft

Paper page – Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks

https://huggingface.co/papers/2311.06242

“ElevenLabs launched a new open-source text and video-to-sound effects app and API It allows users to generate audio based on text prompts or videos and developers to build apps with the tech. Launched within 24 hours after Google V2A, wild! 

“We are excited to introduce the Text to Sound Effects API. To showcase it – we’ve built the first Video to Sounds Effects app. This app is available for free online and fully open-source. 

Open Interpreter – Introducing Local III

https://changes.openinterpreter.com/log/local-iii

“LLM is out CLLM (Consistency Large Language Models) is in 🚀 ✨ The fine-tuning cost of CLLMs is moderate, e.g., training on only ∼1M tokens for LLaMA-7B to achieve a 3.4X speedup on the Spider dataset, using Jacobi decoding with nearly no loss in accuracy. 🤯 Paper – 

Aider benchmark UPDATED: Deepseek & Sonnet 3.5 beating everything! : r/LocalLLaMAhttps://www.reddit.com/r/LocalLLaMA/comments/1dkgjqg/aider_benchmark_updated_deepseek_sonnet_35/

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #38: Week Ending 06/21/2024 with Executive Summary and Top 91 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.

For previous issues, please visit the archives!

Thanks for reading!

Leave a Reply

Trending