bisand/kvad

Local AI for Apple silicon, written from the arithmetic up: an LLM, image and video inference engine in Rust with Metal kernels for the M5, a web UI, a terminal app and an OpenAI-compatible API.

★ 1 Stars

⑂ 1 Forks

○ 1 Watchers

✖ 50 Issues

Rust

apple-silicon flux inference llm local-llm lora metal openai-api quantization rust stable-diffusion text-to-image text-to-video transformers

Last push: 14d ago

Created:

↗ View on GitHub

Loading additional information…