2.1.7

2.1.7 (2025-11-07)

Fix

• fix: MTEB-NL prompts (#3516)

• adding prompts to MTEB-NL

• prompts for vabb_clustering fixed

• arguana-nl fixed

• update retrieval/nld/init

• descriptive stats for v2

• prompts in Dutch for MTEB-NL

• descriptions added to the Dutch prompts for MTEB-NL

• Update mteb/tasks/retrieval/nld/argu_ana_nl_retrieval.py

Co-authored-by: Roman Solomatin <[email protected]>

---

Co-authored-by: Roman Solomatin <[email protected]> (8f3f806)

2.1.6

2.1.6 (2025-11-06)

Fix

• fix: Add support for python 3.14 (#3450) (632a83a)

Unknown

• model: add kalm_models.py ModelMeta (#3519)

• model: add kalm_models.py ModelMeta

• fix: model revision

• fix: recover ESCIReranking for train data

• fix: recover the original auto-generated kalm_training_data

• fix: restore docs logo files

---

Co-authored-by: xinshuohu <[email protected]> (28f9c54)

• model: add EvoQwen2.5-VL-Retriever model (#3526)

model: add EvoQwen2.5-VL-Retriever (18ff6f3)

• fix : Tarka V1 Model revision fix (#3525) (ba5bcb2)

• model: Add rasgaard/m2v-dfm-large (#3523) (a7fb4a9)

2.1.5

2.1.5 (2025-11-04)

Fix

• fix: materialize corpus id to speed up evaluation (#3518)

materialize corpus id to speed up evaluation (08f76a6)

Unknown

• model: Tarka-Embedding-150M-V1 (#3520)

• adding tarka model

• addressing the comments (d5a8cbe)

2.1.4

2.1.4 (2025-10-30)

Fix

• fix: reupload winogrande (#3513)

reupload winogrande (fe43f73)

Unknown

• Correcting the VoyageAI model URLs and handling empty strings (#3511)

Correcting the VoyageAI model URLs
Handling the empty strings in requests (b45d37b)

2.1.3

2.1.3 (2025-10-29)

Fix

• fix: aggregated task evaluation (#3510)

fix aggregated task evaluation (5eae04c)

2.1.2

2.1.2 (2025-10-29)

Fix

• fix: remove set_float32_matmul_precision (#3509)

remove set_float32_matmul_precision (ce07dfd)

Unknown

• fix ReasonIR instruction (#3506) (8189108)

• Update links in leaderboard description (#3503)

• Update links in leaderboard description

Resolve 404's for leaderboard contribution docs

• Update links in leaderboard description

---

Co-authored-by: Roman Solomatin <[email protected]> (976fadf)

• dataset: Add MTEB-NL to the leaderboard (#3489)

• adding WebFAQRetrieval to MTEB-NL

• adding MTEB-NL to the leaderboard

• MTEB-NL renamed to Dutch in the leaderboard (da9feef)

2.1.1

2.1.1 (2025-10-27)

Ci

• ci: New release workflow (#3448)

• add sematic release

• add main release

• fix: update action

• merge semantic with release

• run release after tests passed

• add benchmark to minor releases (b649e6f)

Documentation

• docs: Update links in readme (#3484)

Update links in readme (b0b0e7d)

• docs: fix broken links (#3483)

• docs: fix broken links

• Update docs/usage/defining_the_model.md

---

Co-authored-by: Roman Solomatin <[email protected]> (dfd516a)

Fix

• fix: Rollback to semantic release (#3502)

• rollback to semantic release

• update pyproject.toml (1325328)

• fix: simplify release (#3494)

• fix release CI

• skip if None

• simplify workflow

• remove ifs

• make action condition as and instead or (4484112)

• fix: add prompts to hardnegative tasks (#3469)

• add prompts to hardnegative tasks

• fix superseded_by

• add stats

• add more description (7b7bdd0)

• fix: verify languages during filtering (#3472)

• verify lang code

• add support for language script code

• fix

• add check for language names

• update language check

• remove problematic tasks (799b869)

• fix: release CI (#3493)

• fix release CI

• skip if None (21223ed)

• fix: top_k document selection in two stage reranking (#3486)

• fix topk

• update test for correct top_k selection (16ae6ff)

• fix: task metadata was not passed in Jina implementation (#3485)

• Update jina_models.py

Add missing keyword argument

• Add prompt_type to embedding functions

Add missing keyword arguments (ea1bac1)

• fix: qrels selection negative scores (#3479)

fix: qrels selection (31c8329)

Unknown

• Add spell checker (#3476)

• add spell checker

• remove arg (9e683fe)

• Correcting the VoyageAI multimodal code (#3491) (cf81dd1)

• Remove skip for tasks (#3475) (fcd3b71)

• Descriptive stats, MIRACLVisionRetrieval (#3473) (5b92f73)

• Update text_segments.py (#3474) (181490f)

• Almost final descriptive stats (#3463)

• fix tasks

• final statistics

• remove persiantexttone, was renamed to SynPerTextToneClassification

• remove duplicated tasks statistics

• fix category

• run test on all tasks

• remove image/text: None

• try to fix none in batch

• add vdr statistics (0ead029)

• fix miracl loading (#3466) (179702e)

2.1.0

2.1.0 (2025-10-21)

Documentation

• docs: Ignore overview docs (#3456) (5e903b1)

Feature

• feat: Add mteb nl (#3464)

• classification tasks for MTEB-NL

• clustering tasks for MTEB-NL

• ml classification tasks for MTEB-NL

• pair classification tasks for MTEB-NL

• sts tasks for MTEB-NL

• cherry-picked commits from MTEB-NL for tasks

• descriptive stats for MTEB-NL

• Update mteb/tasks/classification/nld/DutchColaClassification.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• Update mteb/tasks/sts/nld/SICKNLSTS.py

Co-authored-by: Roman Solomatin <[email protected]>

• imports fixed for MTEB-NL

• SICKNLPairClassification the HF location fixed

• DutchColaClassification the HF location fixed

• DutchGovernmentBiasClassification the HF location fixed

• XLWICNLPairClassification the HF location fixed

• BBSARDNLRetrieval the HF location fixed

• LegalQANLRetrieval the HF location fixed

• cls and mlcls deduplication for MTEB-NL

• SICK-NL deduplication for MTEB-NL

• pep 8 to MTEB-NL (2)

• bBSARDNLRetrieval deduplicated

• imports fixed for pair classification MTEB-NL

---

Co-authored-by: Kenneth Enevoldsen <[email protected]>
Co-authored-by: Roman Solomatin <[email protected]> (4f9f157)

Fix

• fix: Add more impots to root __init__ (#3458)

update root init (f8c07ff)

• fix: license pyproject (#3457)

fix license (6fbe482)

2.0.5

2.0.5 (2025-10-21)

Fix

• fix: vdr category (#3465) (4b384bb)

Unknown

• Add more statistics (#3462)

• add statistics

• add PatchCamelyonZeroShot stats (93d638d)

• model: Kalm model (#3461)

readd (5c111ea)

• Add stats from fzoll (#3460)

• Correcting the get_tasks filtering issue

• Correcting the get_tasks filtering issue

• Descriptive stats, last part

• Descriptive stats, last part

---

Co-authored-by: fzoll <[email protected]> (4ef51f2)

2.0.4

2.0.4 (2025-10-20)

Documentation

• docs: Update readme header (#3443)

To avoid the text focus (0a6fe95)

• docs: Don't shorten embedding size (#3455)

Don't shorten embedding size (be20185)

Fix

• fix: Roll back setting OMP_NUM_THREADS for clustering (#3444)

• test: disable flaky test

Added issue to readd #3441

• fix: Roll back setting OMP_NUM_THREADS for clustering

This rolls back #3400 as it didn't work (as shown in most recent CI on main) (38e7bc7)

Unknown

• Update logo size and heading levels in README (6eab159)