Ethan B. Holland

Over 51,300 manually organized AI links and counting

Locally Run AI Models News: Week Ending 02/02/2024

Locally Run AI Models

Miqu scored 83.5 on EQ-Bench (locally).  This ranks the leaked model above Mistral’s medium model as the most powerful free open-source model on the market right now.

Introducing: Memphis-CoT 3B

A small reasoning-focused model using a novel iterative contrastive finetuning procedure, trained on only human data, outperforming much larger human data models and similarly sized SFT models.

https://huggingface.co/euclaise/Memphis-CoT-3B

MobileDiffusion: Rapid text-to-image generation on-device

https://blog.research.google/2024/01/mobilediffusion-rapid-text-to-image.html

Whisper powered by Apple Neural Engine! The lads at Argmax Inc optimised Whisper to work at blazingly fast speeds on iOS and Mac! 

4-bit quantized Code Llama models already in the MLX  Community!

I’ve just quantized CodeLlama 7b Python to 4-bit with MLX, meaning you can now run this model super fast on Apple Silicon.

FAST Local Live LLM Preview Window – Phi-2 / Mistral 7B Uncensored

Be Sure To Read “This Week In AI”

This week’s executive overview and top links are here:

AI News #18: Week Ending 02/02/2024 with Executive Summary and Top 12 Stories

The post you just read is an extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these links come from just a few incredible sources.  Please follow them:

Previous Issues

12 responses to “Locally Run AI Models News: Week Ending 02/02/2024”

  1. AI News #19: Week Ending 02/09/2024 with Executive Summary and Top 18 Links – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  2. AI News #20: Week Ending 02/16/2024 with Executive Summary and Top 39 Links – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  3. AI News #21: Week Ending 02/23/2024 with Executive Summary and Top 36 Links – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  4. AI News #22: Week Ending 03/01/2024 with Executive Summary and Top 25 Links – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  5. AI News #24: Week Ending 03/15/2024 with Executive Summary, Top 36 Links, and Helpful Visuals – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  6. AI News #25: Week Ending 03/22/2024 with Executive Summary, Top 55 Links, and Helpful Visuals – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  7. AI News #27: Week Ending 04/05/2024 with Executive Summary, Top 48 Links, and Helpful Visuals – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  8. AI News #28: Week Ending 04/12/2024 with Executive Summary, Top 48 Links, and Helpful Visuals – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  9. AI News #30: Week Ending 04/26/2024 with Executive Summary and Top 39 Links   – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This weeks’s latest locally run AI news: […]

    Reply
  10. AI News #33: Week Ending 05/17/2024 with Executive Summary, Top 58 Links, and Helpful Visuals – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This week’s latest locally run AI news: […]

    Reply
  11. AI News #36: Week Ending 06/07/2024 with Executive Summary, Top 40 Links, and Helpful Visuals – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This week’s latest locally run AI news: […]

    Reply
  12. AI Links by Category – Ethan B. Holland

    […] Locally Run AI Models News of the Week: This is a niche mostly for serious AI followers. It refers to AI that can be privately downloaded and run on a device without an internet connection. These have an array of powerful implications, from ethics of rogue users with untethered agents, to practical uses like Apple running a full AI on your phone, to corporate installations for security, to embodied robots with AI running in their virtual brain.This week’s latest locally run AI news: https://ethanbholland.com/category/ai/locally-run/ […]

    Reply

Leave a Reply

Trending

Discover more from Ethan B. Holland

Subscribe now to keep reading and get access to the full archive.

Continue reading