Image created with Flux Pro v1.1 Ultra. Image prompt: CU Boulder brand style — CU Gold & Black, Helvetica Neue, Flatirons, Tuscan-vernacular sandstone + red-tile roofs; Folsom Field concourse, sunset rim light, telephoto compressed Flatirons, sandstone texture band; integrate the category “Amazon” via Environmental Detail: digital pickup locker screen labeled “AMAZON AI”; natural light, clean professional inspiring tone, crisp focus, subtle grain, editorial composition
When you chat with Rufus on Amazon app, it is powered by vLLM! https://x.com/vllm_project/status/1956116150259212619
This is actually a pretty surprising and something that should lead companies to change how they are thinking about hosting. Model performance for the open weights GPT model vary by meaningful amounts depending on who is hosting it, with Azure & AWS being low. Worth watching.”” / X https://x.com/emollick/status/1955365624613630349
Update on this: the reason Microsoft (and probably Amazon) were so much worse at serving gpt-oss is that they ignored reasoning effort setting and stuck with the default medium one. The numbers make sense for that hypothesis, and someone from MS confirmed in the comments that”” / X https://x.com/giffmana/status/1955710876528599217
