ik_llama_docker/README.md

127 B

ik_llama_docker

Builds docker images to run ik_llama quantized models, llama.cpp compatable models, and vllm backend models.