Tool failure happens when an external function, API, retriever, database, browser, code runner, or other tool call fails or returns bad data. The agent may have selected the right tool but still fail because the tool timed out, returned an error, or produced unexpected output.
Tool failures should be captured as spans with inputs, outputs, status, latency, and error metadata. Evaluation can then distinguish model reasoning failures from infrastructure or integration failures.