Journal
Stories for builders
of the GPU future
Research-grade buying guides, benchmarks, and playbooks for teams building on accelerated compute.
Start with the question you are trying to answer
The blog is organized around the practical queries buyers and operators search before they commit to hardware: GPU comparisons, LLM VRAM sizing, rack power planning, financing, cooling, freight, and cluster design.
How much VRAM do I need?
Practical inference sizing for 7B to 405B models, including KV cache and context-window planning.
Read guideHow much power will this rack need?
Plan circuits, PDUs, and rack density before your H100, H200, or B200 deployment arrives.
Read guideShould we finance the hardware?
Use a clearer capex vs opex framework for GPU servers, racks, and hybrid cloud strategies.
Read guideDo we really need InfiniBand?
Network design guidance for distributed training, fine-tuning clusters, and scale-out planning.
Read guideLatest
GPU Memory Requirements for LLM Inference: How Much VRAM Do You Need?
A practical VRAM sizing guide for LLM inference: 7B, 13B, 70B, and 405B model classes, how quantization changes memory needs, and when to choose RTX 4090, L40S, H100, or H200.
GPU Server Power Planning Guide: Circuits, PDUs, and Rack Budgeting
Plan power correctly before your GPU hardware lands. This guide covers circuit sizing, rack density, PDU planning, and realistic power envelopes for H100, H200, MI300X, and B200 systems.
GPU Server Financing and Leasing Guide for AI Teams
A practical guide to financing H100, H200, and multi-GPU servers: equipment loans, leases, approval criteria, tradeoffs versus cloud rental, and how to structure AI infrastructure purchases without stalling deployment.
AI Cluster Networking Guide: InfiniBand vs Ethernet for GPU Training
Network design is often the bottleneck in distributed training. Learn when InfiniBand is worth it, when Ethernet is enough, and how to think about oversubscription, storage traffic, and scale-out planning.
AMD MI350X vs NVIDIA B200: What a Buyer Should Compare
Compare MI350X and B200 memory, software, OEM systems, cooling, and the details needed for a useful quote.
GPU Total Cost of Ownership: Buy Versus Rent
A practical way to compare the full cost of an owned GPU server with a current cloud rental offer.
Liquid Cooling for AI GPU Servers: Complete Datacenter Guide
How to verify air and liquid cooling requirements for the exact OEM GPU server you plan to buy.
NVIDIA B200 Buying Guide: Specs, Systems, and Quote Requirements
Verified HGX B200 specifications, how HGX differs from DGX and GB200, and what to include in a quote request.
B200 vs H100: What Changes for a GPU Server Buyer
Compare H100 and B200 memory, interconnect, software, cooling, and the system details needed to get matched quotes.
GPU Server Pricing: What Belongs in the Quote
A checklist for comparing current GPU server quotes across OEM build, support, freight, and facility costs.
Choosing a GPU for Machine Learning in 2026
A practical shortlist for GPU buyers based on memory, software support, OEM system fit, and current written quotes.