Claude Opus cache costs

Groq is one of the most interesting chip stories in AI. Nvidia paid $20B to license their IP and hire most of their team structured as a licensing deal rather than an acquisition to sidestep regulatory scrutiny. It close

Memory is taking over Hyperscaler CapEx. In CY23 and CY24, memory was ~8% of total Hyperscaler spend. We estimate it hits 30% in CY26 and moves higher in CY27. That's a near-4x shift in just four years. (1/4) 🧵

It doesn't make sense to say a subscription plan is worth $ X in isolation. The way to think about subscriptions is that your monthly payment grants you some numbers of “credits”. Each (model, token type) combo consumes

People think AI inference margins are a race to the bottom. Anthropic's gross margins were -94% in 2024. MiniMax was -25%. The narrative made sense (1/5)🧵

MONEY PRINTER ALERT🚨 NVIDIA vLLM B200 CAN GENERATE UP TO💰️$15 BILLION💰️OF ANNUAL PROFITS PER GIGAWATT serving the open DeepSeekv4.1 Flash model at the official interactivity & official selling prices. Using Engram DR

NVIDIA's Evolution🧵 Most people focus on FLOPs and headline specifications when comparing NVIDIA GPU generations, but the real story lies in the chip floorplan, which is a remarkable piece of engineering. With each gen

NEW 🧵: Is human intelligence starting to decline? Recent results from major international tests show that the average person’s capacity to process information, use reasoning and solve novel problems has been falling si

Every three years the OECD, a club of mostly rich countries, releases the results of international school tests sat by 15-year-olds all across the world. Anyone who cares about the young of today should be alarmed at thi

AI is getting cheaper more quickly than any other transformative tech in history. At a given level of performance, cost has fallen ~47%/quarter since 2023. That’s 4× faster than DNA sequencing, 6× faster than compute, 1

Two extraordinary charts from today’s PISA test results: 1) School test scores continue to collapse internationally, underscoring how this is no longer a Covid effect but sustained decline. Those falls in reading and m

NEW: Progressives have a birth rate problem For all the talk of a general fall in births, the drop is overwhelmingly driven by people on the left having fewer kids. By ceding the topic of family and children to the rig

NEW: updated long-run gap in voting between young men and women in Germany: The gender gap continues to widen, but contrary to what is often assumed, young men continue to vote roughly in line with the overall populatio