Model Compatibility & Benchmarks

This page provides detailed benchmark scores and version compatibility information for all reasoning models supported by Sema4.AI.

Benchmark Scores

Reasoning models combined with Sema4's agent tuning deliver dramatically better accuracy on complex, multi-step tasks - reducing hallucinations and improving the reliability of your agent outcomes.

These improvements have been validated through τ²-telecom benchmark, a widely-recognized evaluation for measuring agent performance on long-running, multi-step tasks. OpenAI and Anthropic use this benchmark to validate their tool-calling accuracy because it tests an agent's ability to maintain context, follow complex instructions, and complete sequential operations without degradation.

Sema4.AI agent accuracy with τ²-telecom benchmark

Full Model Compatibility Matrix

Use this table to determine which version of Sema4.AI products you need for a specific model. The table shows when each model was first supported - newer versions continue to support all previously introduced models unless otherwise noted.

Footnotes