SemiAnalysis

newsletter.semianalysis.com

Bridging the gap between the world's most important industry, semiconductors, and business.

podcastTechnology

Articles21

AI Value Capture - The Shift To Model Labs

5/1/2026

A day in AI now feels like a year in any other industry. TSMC, Vera Rubin VR NVL72: V for Value

The Coding Assistant Breakdown: More Tokens Please

4/24/2026

Hands On With GPT 5.5, Opus 4.7, DeepSeek V4, Why Benchmarks Are Bad, and Who’s Going To Win

How Much Do GPU Clusters Really Cost?

4/20/2026

Calculating Cluster TCO, The Real Impact of Downtime, The Grand Unifying Theory Of Goodput, and a ClusterMAX 2.1 Update

ISSCC 2026: NVIDIA & Broadcom CPO, HBM4 & LPDDR6, TSMC Active LSI, Logic-Based SRAM, UCIe-S and More

4/15/2026

ISSCC 2026 Round-Up

The Great GPU Shortage – Rental Capacity – Launching our H100 1 Year Rental Price Index

4/2/2026

GPU Rental Pricing Dashboard Launch

Dissecting Nvidia Blackwell - Tensor Cores, PTX Instructions, SASS, Floorsweep, Yield

3/31/2026

Microbenchmarking, tcgen05, 2SM MMA, UMMA, TMA, LDGSTS, UBLKCP, Speed of Light, Distributed Shared Memory, GPC Floorsweeps, SM Yield

Nvidia – The Inference Kingdom Expands

3/24/2026

Groq LP30, LPX Rack, Attention FFN Disaggregation, Oberon & Kyber Updates, Nvidia's CPO Roadmap, Vera ETL256, CMX & STX

The Great AI Silicon Shortage

3/12/2026

TSMC N3 Wafer Shortages, Memory Constraints, Datacenter Bottlenecks, Supply Chain Wars Winner

Are AI Datacenters Increasing Electric Bills for American Households?

3/3/2026

Power prices misconception, PJM's poor market design, Capacity prices 9.3x growth,

Vera Rubin – Extreme Co-Design: An Evolution from Grace Blackwell Oberon

2/25/2026

Vera, Rubin, NVLink 6 Switch, ConnectX-9, BlueField-4, Spectrum-6, Seamless Cableless Compute Tray Design, Power Rack, VR NVL72 TCO and BoM

InferenceX v2: NVIDIA Blackwell Vs AMD vs Hopper - Formerly InferenceMAX

2/16/2026

The Artist Known as InferenceMAX. GB300 NVL72, MI355X, B200, H100, Disaggregated Serving, Wide Expert Parallelism, Large Mixture of Experts, SGLang, vLLM, TRTLLM

CPUs are Back: The Datacenter CPU Landscape in 2026

2/9/2026

RL and Agent Usage, Context Memory Storage, DRAM Pricing Impacts, CPU Interconnect Evolution, AMD Venice, Verano, Florence, Intel Diamond Rapids, Coral Rapids, Arm Phoenix + Venom, Graviton 5, Axion

Memory Mania: How a Once-in-Four-Decades Shortage Is Fueling a Memory Boom

2/6/2026

Pricing doubles again, Supercycle is bigger, and could last longer than you think

Claude Code is the Inflection Point

2/5/2026

What It Is, How We Use It, Industry Repercussions, Microsoft's Dilemma, Why Anthropic Is Winning

From Tokens to Burgers: A Water Footprint Face-Off

1/15/2026

A different perspective on the datacenter water debate, forget tokens/watt or tokens/dollar, it's about tokens/burger, how many In-N-Outs is equivalent to the world's largest datacenter

Interconnects Beyond Copper, 1,000 CFETs, SK Hynix Next-Gen NAND, 2D Materials, and More

1/13/2026

IEDM 2025 Round-Up

Apple-TSMC: The Partnership That Built Modern Semiconductors

1/8/2026

Wafer demand model, node economics, and the shifting power dynamics as AI reshapes the foundry landscape

RL Environments and RL for Science: Data Foundries and Multi-Agent Architectures

1/6/2026

Worker Automation, RL as a Service, Anthropic's next big bet, GDPval and Utility Evals, Computer Use Agents, LLMs in Biology, Mid-Training, Lab Procurement Patterns, Platform Politics and Access

Co-Packaged Optics (CPO) Book – Scaling with Light for the Next Wave of Interconnect

1/1/2026

Co-Packaged Optics (CPO) has long promised to transform datacenter connectivity, but it has taken a long time for the technology to come to market, with tangible deployment-ready products only arriving in 2025.

How AI Labs Are Solving the Power Crisis: The Onsite Gas Deep Dive

12/30/2025

Bring Your Own Generation, Sayonara Electric Grid, Turbines vs. Recips. vs. Fuel Cells, Why Not Build More CCGTs?, Onsite Power TCO

AWS Trainium3 Deep Dive | A Potential Challenger Approaching

12/4/2025

NL72x2/NL32x2 Scale Up Rack Architecture, Step-Function Software & System Improvements, Optimized Perf per TCO, “Amazon Basics” GB200 NVL36x2, Astera Labs, Trainium4