127 B
127 B
ik_llama_docker
Builds docker images to run ik_llama quantized models, llama.cpp compatable models, and vllm backend models.
Builds docker images to run ik_llama quantized models, llama.cpp compatable models, and vllm backend models.