Skip to content

Add special tokens for tool calling in genai_config #523

Description

@justinchuby
  // qwen2/qwen3 | bot_token_id   | <tool_call>     | 151657
  // qwen2/qwen3 | eot_token_id   | </tool_call>    | 151658
  // qwen3 | bor_token_id   | <think>         | 151667
  // qwen3 | eor_token_id   | </think>        | 151668
  // phi3        | bot_token_id   | <|tool_call|>   | 200025
  // phi3        | eot_token_id   | <|/tool_call|>  | 200026

according to microsoft/onnxruntime-genai#2215. We should add these entries in the emitted genai_config.json

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions