Llm on Ilya Brin - Software Engineerhttps://ilyabrin.github.io/tags/llm/Recent content in Llm on Ilya Brin - Software EngineerHugoenWed, 29 Apr 2026 10:00:00 +0300LLM Quantization Types: a Cheat Sheethttps://ilyabrin.github.io/post/llm-quantization-guide/Wed, 29 Apr 2026 10:00:00 +0300https://ilyabrin.github.io/post/llm-quantization-guide/<p>Trying to run a large language model locally but not sure which file to download? Q4_K_M, IQ3_S, Q5_K_M - these aren&rsquo;t random strings. They describe the quantization format, which determines response quality and how much memory the model will use.</p>