AutoSynthData
ServiceNow CoreAI's framework that turns an enterprise agent's capability gaps into targeted synthetic training data.
Overview
AutoSynthData is a framework from ServiceNow CoreAI, published October 2, 2026 on Hugging Face, that converts an enterprise agent's observed failures into new training tasks. It compares a target model's failures against a stronger teacher model's successes to decide what the model should learn next, then generates and validates new tasks exercising those capabilities, shifting the curriculum toward whatever the model still finds difficult as it improves. On EnterpriseOps Gym's Hybrid and ITSM environments, fine-tuning Gemma-4-26B-A4B-it on AutoSynthData-generated data improved mean Pass@1 by 7.2 percentage points (35% relative) and raised verifier success from 63.01% to 68.55%. ServiceNow released the EnterpriseOps Gym dataset alongside the framework to support further research into synthetic data for enterprise agents.
This is a sourced directory entry. Features and capabilities are reported in the linked sources; this entry does not document independent Aymorphic testing.
Key features
- Targets training data generation at a model's demonstrated capability gaps, not generic synthetic data
- Uses teacher-model successes vs. target-model failures to pick what to generate next
- Curriculum shifts automatically toward the model's remaining weak spots as it improves
- Validated on EnterpriseOps Gym's Hybrid and ITSM environments
- Ships with the open EnterpriseOps Gym dataset release
Use cases
- Fine-tuning enterprise agents on organization-specific workflows, tool integrations, and policy constraints
- Closing measured capability gaps in IT service management (ITSM) and hybrid enterprise agent tasks
- Generating targeted synthetic data instead of broad, generic synthetic datasets
Pricing
Open framework and dataset (EnterpriseOps Gym) published on Hugging Face; no separate licensing fee disclosed.
Pricing reflects the source record and may change. Confirm current terms with the provider.
Dates and sources
- Released
- 2 Oct 2026
- Record updated
- 3 Oct 2026
- Record last checked
- 3 Oct 2026