ik_llama_docker
Builds docker images to run ik_llama quantized models, llama.cpp compatable models, and vllm backend models.
Languages
Shell
100%
Builds docker images to run ik_llama quantized models, llama.cpp compatable models, and vllm backend models.