Catalog / llama.cpp

0.7.0

todayaddedfixedchangedOriginal notes

Overview

llama.cpp v0.7.0 adds the LiliCorr speculative decoding technique and MTP for GLM5-Next, a new GPU cache for MoE experts kept in host memory (--moe-cache-mib, up to ~2.2x decode speedup when experts are offloaded), and a large batch of new models: K2 Horizon (dense and MoVA), Prism Bonsai 2 27B, EmbeddingGemma-2 (text+vision+audio), the LiquidAI d1/d1-omni and vLLM decision 2/d3 decision models, pplx-decider, MiniCPM-V 4.7, Nemotron Super 3.5 VL / Nemotron Bolt and maion-coder. The server gets a refactored chat session API (common_chat_session, part-based formatted output), much better slot and prompt-cache restore behavior, decision-model support for the new architectures and a new default port (9931), the web UI gains a full models manager, and ggml is updated to v0.27.0.

Highlights

  • New GPU cache for host-memory MoE experts (--moe-cache-mib): experts run on the GPU from an LRU cache, up to 2.2x faster decode #29887
  • The expert cache is now shared across multiple GPUs #30112
  • LiliCorr speculative decoding: candidate selection with a small draft transformer on top of DFlash #30506
  • GLM5-Next: MTP speculative decoding with an optimized sparse attention path #29928
  • K2 Horizon support in both dense and MoVA variants: conversion, tokenizer, chat template, -sm tensor splitting #29535
  • Prism Bonsai 2 27B ternary model support #29600
  • EmbeddingGemma-2: text + vision + audio embedding model #30054
  • New decision models: LiquidAI d1-3B, d1-omni-600M, vLLM decision 2, vLLM d3 and pplx-decider #30110 #30114 #30378 #30383 #30044
  • PLaMo-3 tokenizer implements reference pre-segmentation for exact tokenization parity #30045
  • RPC server supports -sm tensor (tensor-parallel RPC, RPC protocol v8) #26610
  • Server now listens on port 9931 by default instead of 8080 #30159

API changes

  • include/llama.h: new moe_cache_size context param for the host-expert GPU cache #29887
  • include/llama.h: new LLAMA_VOCAB_TYPE_PLAMO3 vocab type #30045
  • include/llama.h: llama_perf_context_data reports graph reallocations during inference #30329
  • include/llama.h: embeddings now skips the LM head when a pooling type other than NONE is used #30445
  • include/llama.h: llama_batch_ext_set_embd_state returns false when the context has no state embedding, M-RoPE order documented #30506
  • tools/server: chat layer refactored around common_chat_session with feed() / finish() #30210
  • tools/server: formatted chat output is now an array of parts instead of a single string #30389
  • tools/server: default listening port changed to 9931 (Docker images keep 8080 inside the container) #30159

New models

  • K2 Horizon: dense and MoVA variants with conversion, tokenizer, chat template and -sm tensor support #29535
  • Prism Bonsai 2 27B (ternary) #29600
  • EmbeddingGemma-2: text + vision + audio embeddings #30054
  • LiquidAI d1-3B and d1-omni-600M decision models #30110 #30114
  • vLLM decision 2 and vLLM d3 models #30378 #30383
  • pplx-decider decision model #30044
  • MiniCPM-V 4.7 multimodal model #29416
  • Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B #30520
  • maion-coder architecture #29778
  • Mellum: MoE gating parameters read from GGUF and unified RoPE handling #30578
  • LiliCorr draft model conversion and graph #30506
  • Rerankers: classifier_activation support, exact GELU for ModernBERT encoders #29692 #30108

Core changes

  • Speculative decoding: MTP for GLM5-Next, LiliCorr drafts, correct mtmd handling in MTP graphs #29928 #30506 #30257
  • Speculative decoding: shared nextn tensor flags with consolidated row cropping and sched re-reserve on flag change #30097 #30017 #30020
  • Speculative decoding: fixed draft sampling and rejection handling, DFlash output head sharing #30095 #30111
  • New --spec-draft-n-ubatch to size the draft context batch separately and save VRAM #30459
  • MoE expert cache: host-memory experts served from a device LRU cache, supported over multiple GPUs #29887 #30112
  • Embedding models: skip the logits buffer and the LM head when pooling is enabled (up to 10x less VRAM) #30255 #30445
  • Embedding graphs: reordered get_rows, dropped the redundant t_embd expand and leftover ggml_cont calls #30160 #30461 #30198
  • No-cache attention: padded KV dimension and KQ bias, avoided graph reallocations #30416 #30446 #30439
  • k-pool models: selection built in the causal mask layout, fixed a scatter data race on shared sequences #30480 #29994
  • GLM5-Next sparse attention: removed the gather path #30042
  • KV cache: honor LLAMA_STATE_SEQ_FLAGS_PARTIAL_ONLY so draft checkpoints stop carrying the full KV #30514
  • Prefetching: merge ranges before issuing system prefetch calls, never map foreign ranges into a backend buffer #30532 #30405
  • Sampling: greedy selection for eligible temperature-zero chains, backend sampling graph kept static across ubatches #29797 #30223
  • Tokenizers: PLaMo-3 pre-segmentation and FiM tokens, opt-in NFC normalization for Unigram, strict UTF-8 validation #30045 #30090 #30390 #30485
  • Jinja: fixed loop variable scoping, Python-compatible tojson rendering, faster context copy #30533 #30483 #30362 #30562
  • Model split: distribute layers evenly when no device reports free memory #29677

Multi-modality changes

  • Added mtmd_build_inp_attn_mask for building non-causal multimodal attention masks #30259
  • Added cohere2 vision encoder support #30062
  • MTP drafts now handle mtmd inputs, Qwen3.8 Flash Next accepts image embeddings #30257 #30397
  • New multimodal architectures: MiniCPM-V 4.7, Nemotron Super 3.5 VL, EmbeddingGemma-2 (vision + audio) #29416 #30520 #30054

Server changes

  • /v1/systemone extended to the new decision models: d1-3B, d1-omni, vLLM decision 2/d3, pplx-decider #30110 #30114 #30378 #30383 #30044
  • Chat refactor: session-based parsing and part-based formatted output #30210 #30389
  • Generated text and tokens are now accumulated as parser input, preparing token-aware parsing #29876
  • Prompt cache: only restorable slot states are saved, so rerank and embedding requests no longer fill the cache #30498
  • Prompt cache: child tasks prefer empty slots and preserve the state they would overwrite #30567
  • A pinned busy slot is left untouched until the request can run on it #30295
  • Slot save/restore now keeps context checkpoints and the draft model state #26004 #30574
  • Fixed an off-by-two in the SWA reuse threshold that discarded restored states #30580
  • Fixed a stack-overflow crash when escaping special tokens with std::regex #30243
  • LLAMA_ARG_SLOT_SAVE_PATH environment variable for --slot-save-path #30272
  • New per-component server tests; vendored cpp-httplib updated to 0.61.0 #30312 #30494 #30134 #30081

UI changes

  • New Models Manager: one table of all served models with expandable quants, search, filters, sorting and favorites #29583
  • Row actions: load/unload, delete from disk, hide/unhide, resumable downloads with progress #29583
  • Model configuration side drawer with model info, chat template and "start a new chat" / "use in this chat" actions #29583
  • Models manager follow-ups: GGUF training context, favorite UX, filter and sort fixes #30228
  • Fixed ui_settings not being applied on the first visit in router mode #29668
  • Fixed text attachment preview overflow for large pasted text #29898
  • Fixed the default agentic turns limit falling back to 10 instead of 100 #30582

ggml changes

  • ggml updated to v0.27.0: the backend scheduler gains user callbacks for split weight copying and compute-buffer reallocation, and the RPC protocol is bumped to v8 for tensor-parallel RPC servers. Backends gained chunked gated-delta-net kernels on CUDA/HIP, KleidiAI SME2 k-quant matmuls and AVX2 Q2_0 dot products on CPU, L2-aware coopmat2 scheduling and bf16 activations on Vulkan, reordered-layout MoE kernels (MXFP4, IQ3, Q5_K, grouped XMX GEMM) on SYCL, dp4a MoE GEMMs on OpenCL, tensor-API and wider-head-dim flash attention on Metal, and a DMA/HVX copy overhaul with pooling and 3D im2col ops on Hexagon. Correctness work focused on non-contiguous and strided views, grid and workgroup size limits, out-of-bounds accesses and well-defined mul_mat_id behavior for duplicate expert ids; symbol visibility now defaults to hidden

Assets

Nightly build: b11669

More info

Changelog since v0.6.0

620d2225c llama.cpp : bump version to 0.7.0 (#30603) cd0a5b6a1 models : add Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B support (#30520) a11b6530b scripts : add ci-status.sh to list active CI runs (#30586) 61ad80bf9 server: fix the off-by-two in the SWA reuse threshold (#30580) a6b91d8c5 model : Mellum - read MoE gating params from GGUF, unify RoPE (#30578) ea736c1d5 server: save the draft state in the slot file (#30574) b0d239164 server: prefer empty slots and keep states overwritten by child tasks (#30567) c0cb53ac4 sync : ggml 4ed1c8507 ggml : bump version to 0.27.0 711780ffc ci : bump ty to 0.0.88 (#30587) fd55cb98f fix(ui): take the agentic turns default from DEFAULT_AGENTIC_CONFIG (#30582) 3e4dfa8f3 models : add maion-coder (#29778) 08698c81e jinja : improve context copy constructor performance (#30562) 82e1e2fd8 jinja : write nan and inf in tojson as json.dumps does (#30483) 47f5a64ae vulkan : fix concurrent first device init (#29766) e36df6047 sycl : replace oneAPI package by DLE+oneDNN package (#30131) 9166ceaf1 opencl: fix OOB tail access for adreno noshuffle gemv kernels (#30421) 2130ca847 jinja : fix loop body variable scoping (#30533) 23f83e056 ggml-cpu : optimize pad_f32 (#30526) 2ce20d22f unicode : reject overlong UTF-8 and out-of-range codepoints (#30485) 68ac76572 llama : split llama_prefetch() into merge and prefetch steps (#30532) 77c1f3992 opencl: apply flash attn softcap before mask (#30546) 733f57a99 vulkan : copy strided f16 KV once on AMD so reads spread across memory channels (#27703) 5a638aedb cpu: add F16 SWIGLU_OAI reference implementation and validation (#29200) 6e66cb5d4 metal : add BF16 variant of the tensor API flash attention kernel (#30491) e467e5b5e kv-cache: honor PARTIAL_ONLY in the plain KV cache (#30514) 1ddc26255 graph: keep the graph non empty without embeddings (#30522) 2639a3b4e server: save only restorable slot states to the prompt cache (#30498) 843e7dcc1 spec : add lilicorr support (#30506) 3e390af18 vulkan: Use L2-friendly workgroup scheduling for cm2 mulmat (#30215) a0e6dc738 opencl: support CLAMP on non-contiguous views (#30186) 23deec025 devops: incorrect COPY instruction (#30529) 683bbc0dc gguf-py : detect nfc normalization (#30540) 529ac893e sycl: IQ3 code reorder (#29107) 685f70894 ggml-cpu : keep the FP16->FP32 lookup table on x86 with F16C (#30342) (#30343) c114bd4c5 docs: update IBM zDNN backend docs (#30527) 5cdadfc32 ggml-cpu : size set_rows conversion buffer for all threads (#30454) 62df1815b cuda, hip: GDN chunked kernel (#29353) 37d6d653e skill: Update code-review skill for UI development (#30509) 6868a52cb ggml: fix conv_1d result layout for batched input (#28738) 3fb47677e common : add --spec-draft-n-ubatch (#30459) 318a471a6 docs : clarify installation recommendation for Intel oneAPI Toolkit (#30407) 8c2134a87 ggml : add note about mul_mat_id + disable mul_mat_id_dup tests (#30501) df18bee11 model: split layers evenly when no device reports free memory (#29677) 3eb101360 vendor : update cpp-httplib to 0.61.0 (#30494) af0579c78 ggml : improve RPC tensor transfer logs (#30481) 62bacfa01 cuda : use SIMT implicit GEMM conv2d on AMD without WMMA (#30325) 77390baa1 jinja : write floats in tojson as Python does (#30362) c5a997624 opencl: use buf+offset instead of subbuffer for adreno moe expert sort (#30418) 21a19cd3b opencl: fix q8_0 dp4a mul_mat_id and mark PREC_F32 mul_mat_id unsupported for adreno (#30365) 9cf967a04 models: drop the t_embd expand of the embedding graphs (#30461) 4dd6dd4b9 HIP: use 64-row MMQ tiles for some quant types on RDNA3.5 (#28195) 14310190c vulkan: fix compile error (#30495) e7268bf6a llama : build the k-pool selection in the causal mask layout (#30480) cdce056a3 vulkan: Add workaround for device free memory > total memory on Intel Windows (#29835) d524bb660 vulkan: Define the shader count for Intel Arc Pro B65 + B70 (#30431) 7ec420bc0 vulkan: support mulmat bf16 activations (#29069) 10da8c463 unicode : add opt-in NFC normalization for Unigram tokenizers (#30390) eca5458ce convert : export YaRN truncation config (#30288) 091b6a7fc Enable OpenSSL in FP32/FP16 SYCL builds to restore HF HTTPS downloads (#30330) fcac19079 webgpu: (Fix CI) fix mul_mat_id with duplicate expert ids (#30451) 04f7226a2 server : escape the special tokens without std::regex (#30243) ff026f8c0 chat: replace output string with parts (#30389) 1b70350c9 ggml : simplify backend search path error handling (#28367) d71e324a4 docs : update zDNN supported ops (#30472) 45451c366 kleidiai: add SME2 Q4_K and Q6_K matmul support (#29219) 77c4540ce vulkan: Optimize pool_2d when the pooling window is large (#30119) ecdd29e8b meta: recreate all subgraphs when the arena is reallocated (#30453) ec0bfac17 hexagon: add configurable HTP DCVS/HMX power mode (#30423) ace20f679 graph: pad the KQ bias of the no-cache attention (#30446) b9f3599fb llama : do not map foreign ranges into a backend buffer (#30405) f441d2d9d model: load YaRN beta metadata for laguna models (#30331) cb55ffe6e graph: skip the LM head for pooled embeddings (#30445) a17e94d22 tests : consolidate context state tests into test-llama-context (#30023) b476d9a76 llama : fix log message (#30452) e0bcaccbe vulkan: allow multiple devices to access gpu-visible host memory (#29741) 0a731cced ggml-cpu : add AVX2 dot product for Q2_0 (#30447) f851e244d cuda : add GGML_CUDA_GRAPH_DEBUG and read env vars once (#30327) bfe65e1df cuda : fix compiler warnings in mmq-load-tiles.cuh (#30443) 411d54851 vulkan : split matmul dispatch when it would exceed maxComputeWorkGroupCount (#29533) 296538ade spec : remove tokens assert from dsv4 graph_mtp (#30444) 7f51953d7 model : allow Qwen3.8 Flash Next to accept image embds for MTP (#30397) 882d67166 cuda : fix warnings from dead breaks (#30441) 30f7df1a8 cuda : warnings cleanup (#30420) 9d7d50498 convert : fix LoRA conversion with --outtype auto (#30433) ed019cd8b llama : skip logits buffer allocation when graph produces no logits (#30255) 988015788 graph : avoid reallocations in the "no cache" path (#30439) af50f2f24 ggml-zdnn : introduce Q8_0 mat mul (#29836) 071b553fb models : remove redundant ggml_cont calls now supported by all unary kernels (#30198) 4413a1924 hexagon: extend scalar DMA broadcasting support for binary ops (#30245) 8f574b0ad ci : build OpenVINO releases with GGML_NATIVE=OFF and CPU backend variants (#30324) a49f58dcc ci: fix OpenVINO download links (#30401) cbe28bb3c model: fix vllm d3 multi seq case (#30408) 358a420ec graph: pad the KV dimension of the no-cache attention to 256 (#30416) 48e985756 metal: fix metal tensor kernel_mul_mm error for large tensor (#28748) 8bb3cf0d2 hexagon: optimize CPY/CONCAT — round 3, short-rows edition (#30341) 0f701c882 vulkan: pack FMA for f16 accumulation, no dot product op (#29877) efe3626b1 model: support vllm d3 models (#30383) 097cf33d9 model: support vllm decision 2 model (#30378) ccdbe2905 tests : link each test against only the libraries it uses (#30299) 073b74034 metal : fix mul_mat_id with duplicate ids (#30373) 77757a346 examples : fix draft sampling and rejection handling (#30095) 972b5fcc1 llama : report compute graph reallocations during inference (#30329) 2f160ba59 ui: fix text attachment preview overflow (#29898) f9a95aeb2 sycl: guard DMMV reads at row tails (#29338) 08ffba21e vulkan: use ternary expressions to avoid switch lowering for CM2 quant block size (#30164) a05e58c98 ggml: Change default visibility of symbols to hidden (#30014) b2f036c0f vulkan: fix buffer logging on 32-bit platforms after source split (#30326) e937b17a2 hexagon: optimize q2_k bpw and activation (#30035) b13a93a3d hexagon: add IM2COL_3D (#30305) f2cc7282c opencl: improve fa, allow dk512 for gemma-4, improve dk64 (#30266) c83f3058b opencl: fix image limit for q4_k dense bin kernels, q4_0 bcast and rms_norm (#30310) 5c8854fd8 rpc : turn GGML_RPC_DEBUG into a verbosity level and add logs (#29544) a9d27ac69 model : support for Prism Bonsai 2 27B (#29600) 1cf776776 cpu: fix AVX2 CPUs not using F16C when available (#30270) 966baae76 vulkan: handle mul_mat_id duplicates in the prepass rather than looping (#29998) 62a6f74ba server: add component tests (#30312) 23b0202a1 server: leave a busy slot untouched when a request pins it (#30295) 69f201a20 model : support MiniCPM-V 4.7 (#29416) abee0c847 cmake(s390x): disable z17 target for unsupported compilers (#30297) aa94f2086 args: add LLAMA_ARG_SLOT_SAVE_PATH env for --slot-save-path (#30272) 781dbc5ac spec: properly handle mtmd input for mtp (#30257) 0fd868cbc mtmd: add build_inp_attn_mask (#30259) 1623d8ce4 cuda: always use MMVQ for MUL_MAT_ID on sm_60 (#27828) 1bb2b9fcb CUDA/HIP: fix race in flash_attn_ext_f16_process_tile when nbatch_combine != DKQ/2 (#30103) 2bbca8f20 ggml-cpu: vectorize fp32 to fp16 conversion (#30157) 404f557b5 vulkan: use 4 rows for NVIDIA MUL_MAT_ID MMVQ (#29274) b797c82c7 ggml: fix s390x all cpu build (#30140) f2918cabb opencl: add bin kernels kernel_gemm_moe_q4_k_q8_1_dp4a_bin, kernel_gemm_moe_q6_k_q8_1_dp4a_bin (#30187) 1e6f04a75 sycl : accelerate MXFP4 MoE with arithmetic decoding and weight reordering (#29809) 10a60cf30 vendor: apply deep nested json patch from upstream (#30253) 79e2e74eb CUDA: fix round issue, under MSVC the CPU and GPU agree (#30229) 8e2d31e0e graph : reorder get_rows for embeddings (#30160) baef3ed9a ui: Models Manager Follow-up Improvements (#30228) f39148a95 llama-bench: respect -fitc if bigger than required benchmark size (#28331) 50e3e3e48 CUDA: Remove redundant CUDA copies after SSM_SCAN (#29807) 64df9183f opencl: fix kernel compilation for a6x GPUs (#30176) 6184e92c5 model : use exact GELU for ModernBERT encoders (#30108) 8b5436102 chat : refactor API (#30210) a518119d3 llama: keep the backend sampling graph static across ubatches (#30223) 8ae386707 ggml: fix OOB write in ggml_acc with negative offset (#30135) e60eff95f meta : handle host views (#30217) ba6439a6b webgpu: use 2D workgroup dispatch for all the ops which use 1D dispatch (e.g., rms_norm) (#30219) 5e4878e97 vulkan: fix rms_norm workgroup count overflow (#30145) 609290be6 convert : support compressed-tensor mixed-precision NVFP4 checkpoint (#28636) 86a283532 musa: drop mp_21 from the default architectures (#30203) e94acad85 ci: fix Models Backend webgpu by supporting GGML_OP_DUP (#30216) 5e1d74043 ci : set run-name for publish release (#30214) b42b7e6d3 server: use port 9931 by default (#30159) b013e56a7 ui : add the models manager (#29583) 2c564f43d ci: fix HIP quality check by ignoring the 320/256 FA kernel spill (#30212) 1f8fa5231 metal: add the 128/96 flash attention kernels, accept every compiled pair (#30209) 8a1a9b512 CUDA: pass src1 precision to host MMQ config helpers (#30168) d4d82d67f hexagon: fix IM2COL patch-embed DMA ring overflow (#30189) 3d65c90d0 sycl : Q5_K reorder-layout MMVQ and fused GLU (#29375) de7fa0a3c Musa FWHT fix (#30167) 71ad0590f CUDA: improve top-k algorithm selection (#28713) a11f57ba9 model : fix DFlash output head sharing (#30111) fc9ce6b9d CUDA: fix MMQ out-of-bounds reads (#29953) c35b66744 CUDA : looped PAD kernel for more than 65535 rows or slices (#30147) 1167d3f42 CUDA: fix CCCL version guard breaking on major version rollover (#29453) 4f92965a7 ui: apply ui_settings on first visit in router mode (#29668) c811cb8f0 llama: support MoE cache over multiple GPUs (#30112) 033df86b6 server : preserve context checkpoints across slot save/restore (#26004) ff5888f99 vulkan : fix TOP_K for +inf/NaN inputs and k = 1 on negative values (#30107) dac308739 vulkan: extend sparse FA support to coopmat2 (#30003) 03aa006ac vendor : update cpp-httplib to 0.60.1 (#30134) 08246a28f cuda : support arbitrary striding for unary ops on f16, f32, and bf16 (#29781) 46baf1f1f sycl: FWHT optimizations (#29605) 097f5b533 hex-mmadd: do not assume aligned read/write when bias-add is fused (#30133) d88801604 cuda : Use byte strides for roll to allow non-contiguous ROLL operations (#29547) fda186661 CUDA: fix norm family kernels when ne[2]/ne[3] exceed grid dim limits (#28175) ff30363a0 sycl: fuse the delta-net alpha gate (add + unary + mul) (#29687) 000bee54a sycl: stage bulk uploads (model loading) through a pinned ring buffer (#29608) 37ac63456 model : support classifier_activation for rerankers (#29692) 24e41838e ggml-cuda: assign four GDN state columns per warp (#30087) 847f447c3 sycl: add grouped MoE XMX GEMM (#29245) 75118a3a5 convert : support Qwen3.5 embedding models (#27920) 9b4ed0ca5 sycl: remove duplicate block-size defines from op headers (#29507) 9c2e0e491 hexagon: enable alloc_buffer_n (#30126) 06cad0b9e hexagon: Q6_K weight dequant speedup (#30121) a657f7e98 model : add LiquidAI/d1-omni-600M decision model (#30114) aa5e0092f hexagon: support tiled Q4_K and Q6_K GET_ROWS (#30115) 70815103c hexagon: improved GELU accuracy (#30104) bd4eeaa04 chat: fix jinja parser for TranslateGemma (#30096) 5de733437 chat : name tool and argument parser rules by index (#30088) 88dcc460d model : add LiquidAI/d1-3B decision model (#30110) b86d2f075 cuda: FWHT kernels for block widths above 512 (#29100) 50a6c5cf7 mtmd: add cohere2 vision support (#30062) d6cf9acb2 llama : add a GPU cache for MoE experts kept in host memory (#29887) 42c787e8c cuda: update uncoalesced memory reads in pool2d (#29425) 18b5f8b18 server : accumulate generated text and tokens as parse input (#29876) 448147d42 llama: share the nextn tensor flags between models (#30097) 988190680 metal : few-row MMA mat-mul for the remaining src0 types (#30065) 7e8324f5f metal : fix MUL_MAT+ADD fusion when the residual is itself a MUL_MAT (#30100) b9acf138a feat: add GLM5Next MTP, optimize (#29928) 48499d2e1 qwen3tts : guard speaker_encoder_config patch for CustomVoice variant (#29179) d0b490f25 sampling : use greedy selection for eligible temperature-zero chains (#29797) 42b021b4d vocab : add plamo fim tokens (#30090) 7481354a1 convert : fix token configuration for PLaMo-3 (#29843) ad2156533 musa: use the tile lightning indexer kernel (#30080) b7dafa01e vendor : update cpp-httplib to 0.60.0 (#30081) 26908739b imatrix : include clocale for std::setlocale (#30079) 36a73916e ggml-webgpu: fix flash_attn supports_op check for overlapping KV (#28205) fa3c2fab3 tests : retain the anchor when testing recurrent rollback (#29923) 005a1e127 [SYCL] fix the issue in mixed different model GPUs in FA (#29071) d2a79e604 sycl: accelerate GLM MLA prefill with MKL flash attention (#29171) 5e5b628eb sycl : fattn_kv_buffers cleanup (#27689) 4d756bc72 vulkan: fix amd iGPU slow checkpoint read (#30049) 78651c410 sycl: add IQ3_S multi-column MMVQ (#29500) f498f864f ggml-webgpu: no dawn native features on wasi (#27069) c479922ac hexagon: CPY/CONCAT/CONT/DUP overhaul to use DMA/HVX for all cases (#30067) 5ad1c5da0 cuda : add BF16 support for XIELU (#29955) 51ce9c11a ggml-cuda: use per-thread stream for buffer-init padding memset (#28782) abeada335 vocab : implement PLaMo-3 tokenizer pre-segmentation (#30045) 462524043 model : add K2 Horizon dense and MoVA support (#29535) 310991409 llama: remove the gather path of the glm5-next sparse attention (#30042) 4fbc76dec model: support embeddinggemma2 (text+vision+audio) (#30054) 2207c8e57 opencl: fix OOB read in adreno xmem GEMM (#30041) a46709b68 RPC: add -sm tensor (#26610) 65840ed53 ggml: fix CLAMP on non-contiguous views (CPU, CUDA) (#29517) ab09ea4c1 cuda: BF16/FP16 conversion to f32 chunking (#29442) da263e727 models: support pplx-decider (#30044) a043d38a6 metal : fix excess threadgroup memory in quantized flash attention (#29340) 58cb9138e vulkan : check for null vkEnumerateInstanceVersion (#29872) 4f5406761 HIP: use -O0 for host code in debug builds (#29795) f0c41e016 models : consolidate nextn row cropping into shared helpers (#30017) d7a695ef6 scripts : limit apiabi checks to libllama and libmtmd (#30038) 6c73b3e12 convert : add text_config as fallback [transformers 5.18] (#30040) 1a3011cc0 llama : re-reserve the sched when the nextn extraction flags change (#30020) 6753a033f ggml: refactor selective expert copying to user code (#29943) cbb7d52ec test-llama-archs : initialize backends before generating models (#30034) 63bef2728 vendor : update LibreSSL to 4.3.3 [no ci] (#30019) b9a5a00b8 ggml-openvino: fix CI tests; fix GPU regressions. (#30037) 43fe9c642 llama: fix k-pool scatter data race on shared sequences (#29994) 5e03bdd87 hexagon: ssm-conv updates (#29971) 50569eb87 hexagon: add pool op support (#29995) 7049ff0cb ci : add 1accel label [no ci] (#30016) c25030496 ci : skip container re-tagging when Require Docker is disabled (#30008) 8345f3339 hexagon: matmul and flash-atten scalability updates (#29974)