jdelony/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-06-27 23:50:20 -05:00
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/tests
History
Gaurav Garg 0ed235ea2c
[CUDA] Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy (#25057) 
* [CUDA] Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy

Add a CUDA ggml_cpy fast path for same-type, same-shape strided copies that are just 2D pitched block copies.
When tensors are not fully contiguous but each row is contiguous, it now uses cudaMemcpy2DAsync instead of the slow element-wise scalar copy kernel.

This fixes the GDN recurrent snapshot update with -np 4, where rollback slots are separated by cache stride gaps.

* Add new tests that execute the new optimized strided copy path

* Return unsupported for strided copy in OpenVINO, as new tests are failing
2026-06-27 17:46:21 +05:30
..
peg-parser
common/peg : implement ac parser for stricter grammar generation (#24869)
2026-06-21 16:20:58 -05:00
snapshots
tests : add unit test coverage for llama_tensor_get_type (#20112)
2026-04-02 22:53:58 +02:00
.gitignore
tests : add unit test coverage for llama_tensor_get_type (#20112)
2026-04-02 22:53:58 +02:00
CMakeLists.txt
binaries : Improve rpc-server and export-graph-ops names. (#25045)
2026-06-27 10:31:29 +03:00
get-model.cpp
ci : add model tests + script wrapper (#4586)
2024-01-26 14:18:00 +02:00
get-model.h
ci : add model tests + script wrapper (#4586)
2024-01-26 14:18:00 +02:00
gguf-model-data.cpp
ci : add [no release] keyword + fix sanitizer builds (#23728)
2026-05-26 19:05:48 +03:00
gguf-model-data.h
tests : add unit test coverage for llama_tensor_get_type (#20112)
2026-04-02 22:53:58 +02:00
test-alloc.cpp
chore : correct typos [no ci] (#20041)
2026-03-05 08:50:21 +01:00
test-arg-parser.cpp
arg: try fixing test-args-parser randomly fails (#24826)
2026-06-20 19:45:27 +02:00
test-autorelease.cpp
docs : Minor cleanups (#19252)
2026-02-02 08:38:55 +02:00
test-backend-ops.cpp
[CUDA] Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy (#25057)
2026-06-27 17:46:21 +05:30
test-backend-sampler.cpp
llama : deprecate llama_set_warmup (#24009)
2026-06-02 10:30:38 +03:00
test-barrier.cpp
Fix race conditions in threadpool when dealing with dynamic/frequent n_threads changes (#17748)
2025-12-10 12:32:23 -08:00
test-c.c
ggml : remove kompute backend (#14501)
2025-07-03 07:48:32 +03:00
test-chat-auto-parser.cpp
chat: fix whitespace problems once and for all (#24624)
2026-06-15 08:27:10 +02:00
test-chat-peg-parser.cpp
common/parser: add proper reasoning tag prefill reading (#20424)
2026-03-19 16:58:21 +01:00
test-chat-template.cpp
tests : fix test-chat-template --no-common option (#25075)
2026-06-27 10:30:19 +03:00
test-chat.cpp
server: improve user message detection and create checkpoints at every user message (#24176)
2026-06-23 08:27:28 +03:00
test-col2im-1d.cpp
ggml : add GGML_OP_COL2IM_1D (#24206)
2026-06-09 12:01:37 +03:00
test-double-float.cpp
ggml : minor naming changes (#8433)
2024-07-12 10:46:02 +03:00
test-export-graph-ops.cpp
binaries : Improve rpc-server and export-graph-ops names. (#25045)
2026-06-27 10:31:29 +03:00
test-gbnf-validator.cpp
cmake : do not include ./src as public for libllama (#13062)
2025-04-24 16:00:10 +03:00
test-gguf-model-data.cpp
tests : add unit test coverage for llama_tensor_get_type (#20112)
2026-04-02 22:53:58 +02:00
test-gguf.cpp
ggml: gguf_init_from_callback and gguf_init_from_buffer (#22341)
2026-05-25 11:33:29 +02:00
test-grammar-integration.cpp
common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)
2026-03-21 18:43:35 +01:00
test-grammar-llguidance.cpp
tool/ex/tests: consistently free ctx, then model (#18168)
2025-12-22 11:00:37 +01:00
test-grammar-parser.cpp
common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)
2026-03-21 18:43:35 +01:00
test-jinja.cpp
jinja : implement call statement (#24847)
2026-06-21 14:04:52 +02:00
test-json-schema-to-grammar.cpp
common/json-schema-to-grammar : align spacing rules with parsers (#24835)
2026-06-20 17:43:04 -05:00
test-llama-archs.cpp
Add arch support for cohere2-MoE (#24260)
2026-06-13 19:49:00 +02:00
test-llama-grammar.cpp
common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)
2026-03-21 18:43:35 +01:00
test-log.cpp
common: Intentionally leak logger instance to fix hanging on Windows (#22273)
2026-04-29 10:58:43 +03:00
test-lora-conversion-inference.sh
cli: new CLI experience (#17824)
2025-12-10 15:28:59 +01:00
test-model-load-cancel.cpp
llama : update llama_model API names (#11063)
2025-01-06 10:55:18 +02:00
test-mtmd-c-api.c
mtmd : add video input support (#24269)
2026-06-08 14:40:12 +03:00
test-opt.cpp
tests : fix test-opt with GGML_BACKEND_DL (#15599)
2025-08-26 22:14:38 +02:00
test-peg-parser.cpp
Autoparser - complete refactoring of parser architecture (#18675)
2026-03-06 21:01:00 +01:00
test-quant-type-selection.cpp
tests : add unit test coverage for llama_tensor_get_type (#20112)
2026-04-02 22:53:58 +02:00
test-quantize-fns.cpp
ggml-cpu: fix SVE leftover path in ggml_vec_dot_f32 (#24699)
2026-06-26 10:41:56 +03:00
test-quantize-perf.cpp
ci: run the x64 and arm ci on the github machines instead (#16183)
2025-09-25 08:06:06 +03:00
test-quantize-stats.cpp
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
test-reasoning-budget.cpp
common : support manually triggering the reasoning budget end sequence (#23949)
2026-06-01 11:37:11 +02:00
test-recurrent-state-rollback.cpp
llama + spec: MTP Support (#22673)
2026-05-16 20:06:23 +08:00
test-regex-partial.cpp
common/grammar : replace problematic backtracking regex [\s\S]* (#18342)
2026-01-03 16:02:43 -06:00
test-rope.cpp
ggml-cpu: templateify ggml_compute_forward_rope_f32 and _f16 (#16805)
2025-11-11 13:33:24 +02:00
test-sampling.cpp
sampling : remove unconditional softmax+sort in top-n-sigma sampler (#22645)
2026-06-22 14:08:32 +03:00
test-save-load-state.cpp
tests : refactor test-save-load-state to accept token input (#24073)
2026-06-04 08:06:36 +03:00
test-state-restore-fragmented.cpp
common : only load backends when required (#22290)
2026-05-05 09:23:50 +02:00
test-thread-safety.cpp
tests : synchronize contexts at end of test-thread-safety (#24935)
2026-06-25 09:22:51 +03:00
test-tokenizer-0.cpp
tool/ex/tests: consistently free ctx, then model (#18168)
2025-12-22 11:00:37 +01:00
test-tokenizer-0.py
requirements : update transformers to 5.5.1 (#21617)
2026-04-09 12:36:29 +02:00
test-tokenizer-0.sh
model : add Jina Embeddings v5 Nano (partial EuroBERT) support (#19826)
2026-02-26 12:14:09 +01:00
test-tokenizer-1-bpe.cpp
tool/ex/tests: consistently free ctx, then model (#18168)
2025-12-22 11:00:37 +01:00
test-tokenizer-1-spm.cpp
tool/ex/tests: consistently free ctx, then model (#18168)
2025-12-22 11:00:37 +01:00
test-tokenizer-random.py
requirements : update transformers to 5.5.1 (#21617)
2026-04-09 12:36:29 +02:00
test-tokenizers-repo.sh
devops: add s390x & ppc64le CI (#15925)
2025-09-27 02:03:33 +08:00
testing.h
common : implement new jinja template engine (#18462)
2026-01-16 11:22:06 +01:00