Skip to content

Conversation

@ixgbe
Copy link
Contributor

@ixgbe ixgbe commented Dec 12, 2025

Changes included:

  • Add ggml_cpu_get_rvv_cnt() and RVV vector-length initialization.
  • Export RVV_CNT in CPU feature list.
  • Update ggml_repack_get_optimal_repack_type() to enable Q4_0 repack when
    ggml_cpu_has_riscv_v() and rvv_cnt >= QK4_0.

@ixgbe ixgbe requested a review from ggerganov as a code owner December 12, 2025 05:26
@github-actions github-actions bot added the ggml changes relating to the ggml tensor library for machine learning label Dec 12, 2025
@xctan
Copy link
Collaborator

xctan commented Dec 12, 2025

I suggest using the name VLEN instead of copying the name CNT from SVE svcntX instruction families.

@ggerganov ggerganov requested a review from xctan December 12, 2025 14:06
@ggerganov ggerganov merged commit 5160443 into ggml-org:master Dec 12, 2025
67 of 69 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants