llama.cpp/src at b8563 - llama.cpp - Jared's Git Server

jdelony/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-01 00:10:21 -05:00

History

Yiwei Shao ee051c1e4e

hexagon: support for IQ4_NL and MXFP4 (#21018 )

* ggml-hexagon: add IQ4_NL and MXFP4 HMX matmul support

- Add IQ4_NL quantization type support to Hexagon backend (buffer
  set/get tensor repack, mul_mat, mul_mat_id dispatch)
- Implement HVX IQ4_NL vec_dot kernels (1x1, 2x1, 2x2) with
  LUT-based 4-bit index to int8 kvalue dequantization
- Add MXFP4 HMX dequantization path with E8M0 scale conversion,
  including batch-4 fast path and single-tile fallback
- Unify quantized row size / scale offset logic to handle Q4_0,
  Q8_0, IQ4_NL, and MXFP4 in the DMA fetch path

* ggml-hexagon: fix SKIP_QUANTIZE src1 address mismatch in mixed-quant models

* Fix the pragma indent

2026-03-27 09:22:41 -07:00

..

ggml-blas: set mkl threads from thread context (#20602 )

2026-03-18 01:16:49 +08:00

CANN: add RoPE cache preload before ACL graph capture (#20747 )

2026-03-23 15:24:06 +08:00

fix(ggml): correct RISC-V ISA string canonical ordering for RVV in CMake (#20888 )

2026-03-26 13:08:41 +02:00

hip: use fnuz fp8 for conversion on CDNA3 (#21040 )

2026-03-26 23:06:33 +01:00

hexagon: support for IQ4_NL and MXFP4 (#21018 )

2026-03-27 09:22:41 -07:00

ggml-cuda: native bf16 flash attention for vec kernel (#20525 )

2026-03-22 11:05:51 +01:00

metal : Fix dimension constraint violation in matmul2d descriptor (#21048 )

2026-03-27 09:05:21 +02:00

ggml-cuda: native bf16 flash attention for vec kernel (#20525 )

2026-03-22 11:05:51 +01:00

opencl: allow large buffer for adreno (#20997 )

2026-03-26 08:52:21 -07:00

fix(openvino): explicit memset in buffer_context allocation (#20857 )

2026-03-23 08:05:37 +02:00

rpc : proper handling of data pointers to CPU buffers (#21030 )

2026-03-27 10:59:35 +02:00

sycl : fix wrong variable check by assert (#20903 )

2026-03-25 11:48:37 +02:00

ggml-virtgpu: improve the reliability of the code (#19846 )

2026-02-26 20:00:57 +08:00

Add shader count for Intel Arc Pro B60 (#20818 )

2026-03-21 05:22:51 +01:00

ggml webgpu: ops support for qwen3.5 (SET, TRI_SOLVE, SSM_CONV, GATED_DELTA_NET) + GET_ROWS optimization (#20687 )

2026-03-19 08:45:28 -07:00

ggml-zdnn : mark zDNN buffers as non-host (#18967 )

2026-01-22 01:16:21 +01:00

ggml-zendnn: update code for latest ZenDNN API (#19923 )

2026-02-27 08:43:41 +08:00

CMakeLists.txt

ggml : add OpenVINO backend (#15307 )

2026-03-14 07:56:55 +02:00

ggml-alloc.c

ggml : make ggml_is_view as API (#19539 )

2026-02-16 17:43:34 +02:00

ggml-backend-dl.cpp

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150 )

2026-01-29 12:33:21 -08:00

ggml-backend-dl.h

hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150 )

2026-01-29 12:33:21 -08:00

ggml-backend-impl.h

llama: use host memory if device reports 0 memory (#18587 )

2026-01-09 05:34:56 +08:00

ggml-backend-reg.cpp

ggml : add OpenVINO backend (#15307 )

2026-03-14 07:56:55 +02:00

ggml-backend.cpp

llama : disable graph reuse with pipeline parallelism (#20463 )

2026-03-12 21:04:13 +02:00

ggml-common.h

ggml : add NVFP4 quantization type support (#19769 )

2026-03-11 21:02:54 +01:00

ggml-impl.h

llama: fix llama-model-saver (#20503 )

2026-03-25 12:53:16 +02:00

ggml-opt.cpp

finetune: SGD optimizer, more CLI args (#13873 )

2025-08-14 12:03:57 +02:00

ggml-quants.c

ggml : guard against sumq2 being 0 in IQ4_NL (#20460 )

2026-03-15 10:47:28 +02:00

ggml-quants.h

ggml : add NVFP4 quantization type support (#19769 )

2026-03-11 21:02:54 +01:00

ggml-threading.cpp

ggml : build backends as libraries (#10256 )

2024-11-14 18:04:35 +01:00

ggml-threading.h

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797 )

2024-12-12 19:02:49 +01:00

ggml.c

mtmd: Add DeepSeekOCR Support (#17400 )

2026-03-25 19:57:40 +01:00

ggml.cpp

ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)

2025-06-01 13:43:57 +03:00

gguf.cpp

llama: fix llama-model-saver (#20503 )

2026-03-25 12:53:16 +02:00