{"componentChunkName":"component---src-templates-tag-page-js","path":"/tags/machine-learning/","result":{"data":{"site":{"siteMetadata":{"title":"M.Hassan Ahmed","author":"Hassan11196"}},"allMarkdownRemark":{"totalCount":1,"edges":[{"node":{"excerpt":"The first time I looked at deploying a Mixture-of-Experts (MoE) model, the spec sheet confused me. Mixtral 8x7B is described as an 8×7B…","fields":{"slug":"/2026-09-20-mixture-of-experts-explained/"},"frontmatter":{"date":"2026-09-20T00:00:00.000Z","title":"Mixture of Experts: Sparse Compute, Dense VRAM","description":"Mixture of Experts routes each token to a couple of expert layers, so the model runs cheaper per token yet still needs every expert sitting in GPU memory.","tags":["AI","LLM","GPU","Inference","Machine Learning"],"thumbnail":{"childImageSharp":{"fluid":{"base64":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAALCAIAAADwazoUAAAACXBIWXMAAAsSAAALEgHS3X78AAAB4ElEQVQoz0WQ227TQBCGjYDE9q69u453fVh7N7ZzdtLEdYmiqDmgVAIJlbY3CHGBhAQS4im4g2t4H654MCZxaaVPvzwz/z+2x5ioKVCqGehQjs/79WF52FTby/lmNV3vzvf7+iUolFfLq6pfg+fBb7RI2iZpy00wL1g8Fno2qffDapuX66xcDRfbUbUbzDfZZDVabIWauUEf+Tn4IWVgphrQEW3TtIVj0FOpbJLaVEEJmK6EjuN10f+IgcAHM5L6Qa/fq7JsVuRzx9OIJs2oATpeUHiiYKKgPAc/NA2bJA0s6As58o46dv3soQ9YroSAHl1EvcVgspTdmenE0IewRCR57oRa5H/eff37/tuP3Y1hcUwhJhsQkW2alvrsslc/9TLiw5shLA3bjQHTifLu2ffXH36+/fRlf2f7XQuHlhO1ndByIxuHLS+7vnj1+83HzfzA1dx2QkgZMGuAZU+QeOZpWxRcjvx4CAzUlPEcszTOqrDc36yvf91+ZlmNThHDgt0nIOxQid0IBsfPcSLEklhXTPTgSHCOWJVhWppU0o5CbgwRCAcNpKOJrwnvUp5hevxVFo19/YIEQ0Tijpd0OqnvK8E155owaTqBYWLxCHrU5iQ2idBxUdzG4h50/wCef14NSLeaKCNzAAAAAElFTkSuQmCC","aspectRatio":1.899441340782123,"src":"/static/af4d473859fb3f274c785c8efe369f46/40a76/hero.png","srcSet":"/static/af4d473859fb3f274c785c8efe369f46/c972b/hero.png 340w,\n/static/af4d473859fb3f274c785c8efe369f46/27625/hero.png 680w,\n/static/af4d473859fb3f274c785c8efe369f46/40a76/hero.png 1360w,\n/static/af4d473859fb3f274c785c8efe369f46/ed396/hero.png 2000w","sizes":"(max-width: 1360px) 100vw, 1360px"}}}}}}]}},"pageContext":{"tag":"Machine Learning"}},"staticQueryHashes":["32046230"]}