Image created with gemini-2.5-flash-image with claude-sonnet-4-5. Image prompt: Minimalist photograph of an empty traditional Chinese scholar’s study with dark wood desk, unused calligraphy brushes, jade seal, cold window light casting long shadows across pristine floor, architectural emptiness, muted colors, dramatic negative space, the word QWEN in bold white sans-serif text prominently displayed across the image
@awnihannun added batched generation to MLX-LM >2 months ago. Everybody, since, has been asking for batching in the MLX-LM server. Well, enjoy the first version in the latest MLX-LM release. The following video is serving 4 consecutive requests for Qwen3 30B on an M2 Ultra. https://x.com/angeloskath/status/1996364526749639032
> be arcee > look around > realize open-weight frontier MoE is basically a Qwen/DeepSeek monopoly > decide “nah, we’re building our own” > actual end-to-end pretraining > on US soil > introducing Trinity > Nano (6B MoE) and Mini (26B MoE) > open weights, Apache 2.0 > free on https://x.com/TheAhmadOsman/status/1995613231629381935
Our new Qwen3-TTS (version 2025-11-27) is here! 🚀 We’ve leveled up on what matters most: ✨ More Personalities: Over 49 high-quality voices, from cute and playful to wise and stern. Find your perfect match! 🌍 Global Reach: Now speaks 10 languages (zh, en, de, it, pt, es, ja, https://x.com/Alibaba_Qwen/status/1996947806138126547
The latest mlx-lm is out and it has continuous batching with mlx_lm.server! Added by @angeloskath Check-out the video of 4 simultaneous requests running with Qwen3 30B on the same M2 Ultra:”” / X https://x.com/awnihannun/status/1996365940343402596
TIL you can compile quantized models thanks to quanto although memory blows up a bit on Qwen3-VL https://x.com/mervenoyann/status/1996998362118201850
Leave a Reply