There are some usecases where the remote MCP may (or may want to) return a file or large chunk of text. Most coding agents have a cutoff on tokens.
There are 2 types of cases --
- The LLM needs to know the file content to be able to do some task
- The LLM uses this file as a input to do some task, does not necessarily have to know whats inside in depth.
All SOTA models are very good at grepping through the files and trying to understand whats in it, without having to read the entire file. Having this toggle for MCP servers (per server or per tool level) will allow for more complex usecases.
I am happy to work on this feature :)
There are some usecases where the remote MCP may (or may want to) return a file or large chunk of text. Most coding agents have a cutoff on tokens.
There are 2 types of cases --
All SOTA models are very good at grepping through the files and trying to understand whats in it, without having to read the entire file. Having this toggle for MCP servers (per server or per tool level) will allow for more complex usecases.
I am happy to work on this feature :)