ToolHelper: Token-Efficient MCP Tool Calls
Python, MCP, LLM Agents, Ollama, Streamlit, Experiment Design
Show descriptionHide description
A monitoring and efficiency layer for how LLM agents call the tools of three biomedical MCP servers (Medical MCP, BioMCP and OMOP MCP). It records exact token usage per tool call and the pathway the model takes to reach each tool, then tests strategies that make those calls cheaper, such as schema compression, result shaping, a turn limit with a forced final answer, and an "answer early" instruction. Strategies are compared in fractional factorial experiments on a 54-task benchmark, and every accepted change carries a trust score, evidence and a versioned decision log. Over two rounds of changes, the accepted configuration roughly halved tokens per successful task (from about 52,300 to 25,000), while task success rose from 88% to 96%.


















