Preview of FareedKhan-dev/kimi-k3-in-c

FareedKhan-dev/kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

★ 11.9K Stars
⑂ 1.8K Forks
○ 11.9K Watchers
✖ 33 Issues
C
avx2 c99 cpu-inference deep-learning from-scratch inference-engine kimi-k3 linear-attention llm llm-inference machine-learning memory-efficient mixture-of-experts moe mxfp4 quantization simd systems-programming transformer zero-dependencies

Last push:

Created:

Loading additional information…