VRAM Calculator
Calculate LLM context and GPU memory usage
Back to tools
Description
Context Window VRAM Calculator is a free developer tool for estimating GPU memory requirements for large language models. It calculates context-window VRAM, KV cache per token, total memory usage, and maximum context while supporting GQA, MQA, FP16, FP8, Q4, concurrency, and GPU memory budgets.