Image created with gemini-2.5-flash-image with claude-sonnet-4-5. Image prompt: A majestic llama standing on a floating emerald platform high in the sky, wool flowing upward defying gravity, wearing a chain-link collar, overlooking a landscape below with glowing green object segmentation contours labeling different regions, cinematic Wicked-inspired emerald and gold lighting, dramatic sunset sky, moody and theatrical atmosphere
Today, we are officially open-sourcing a set of high-quality speculator models on the @huggingface Hub. Our first release includes Llamas, Qwens, and gpt-oss. In practice, you can expect 1.5-2.5× speedups on average, with some workloads seeing more than 4× improvements! https://x.com/_EldarKurtic/status/1991160711838359895
Leave a Reply