Imitation Learning Degrades Fast: ACT Loses 48 Points at Speed
New research reveals imitation learning policies degrade significantly at higher execution speeds, dropping up to 48 points in dexterous manipulation tasks compared to experts.
What Happened
On September 1, 2026, researchers Clinton Enwerem, John S. Baras, and Calin Belta from the University of Maryland published a study on arXiv that exposes a critical blind spot in how imitation learning policies are evaluated for robotic dexterous manipulation. The paper, titled "Does Imitation Learning Preserve Temporal Robustness in Dexterous Manipulation?", compares a scripted expert policy against an Action Chunking with Transformers (ACT) imitation learner on a contact-rich task called ParcelStow — where a robot acquires, reorients, and inserts a parcel.
The experimental design is notably rigorous: both expert and learner were tested under identical task conditions, initial-condition draws, and speedup factors. At nominal speed, both achieved 100% task success. But when execution speed increased within the demonstrated range, the policies diverged dramatically. The expert's success rate dropped 16 percentage points to 84%. Two ACT policies with different parameter initializations dropped 48 and 34 percentage points, reaching as low as 53% success.
Stage-level analysis revealed where the breakdown occurs: 35 of ACT's 47 failures at maximum demonstrated speed were insertion misalignments. The acquisition and reorientation phases held up better — under a relative-motion handoff, every ACT acquisition retained the parcel through reorientation and transfer in free space, though only 64% completed the overall task compared to 95% after expert acquisition. A universal finding emerged across all conditions: zero of 414 acquisitions without force closure completed the task, regardless of policy or speed.
The researchers released code, data, and evaluation scripts publicly.
Why It Matters
This paper lands at a moment of intense capital deployment in robotics. Walden Robotics launched with $300M in June 2026 for legless factory humanoids. Humanoid raised $152M at a $1.35B valuation in July. Agility Robotics is pursuing a SPAC. The industry is scaling from lab demos to factory floors where throughput speed directly determines unit economics.
The core finding is deceptively simple but operationally profound: equal nominal task success does not imply preservation of expert performance across execution speeds. A robotics startup can show a customer a 100% success rate demo at training speed, and that same policy can fail nearly half the time when the customer asks for 2x throughput. Standard evaluation protocols — which test robustness to scene variation, object diversity, and instruction changes — completely miss this failure mode.
The force closure finding adds a second layer of practical value. It identifies a binary diagnostic: if the acquisition phase doesn't achieve force closure, the task will fail regardless of what the downstream policy does. This gives engineers a concrete checkpoint to instrument and monitor in production.
Who Is Affected
Robotics startups using imitation learning for manipulation — particularly those deploying ACT or similar transformer-based architectures — face the most immediate risk. If customers discover speed-related degradation during pilots, it erodes trust and delays contracts.
Enterprise buyers in logistics, warehousing, and manufacturing need to add temporal robustness testing to vendor evaluation criteria. Asking for performance data across execution speeds should become standard procurement due diligence.
ML engineers designing imitation learning pipelines need to incorporate speed-varied demonstrations into their training data and add stage-level failure analysis to their evaluation harnesses. The released codebase provides a starting framework.
Strategic Implications
For AI Startup Founders
If your robotics pitch relies on imitation learning for dexterous manipulation, you should assume that sophisticated investors and pilot customers will soon ask about temporal robustness — especially as this research circulates. Build speed-varied evaluation into your demo pipeline now. Be transparent about degradation curves rather than hiding the gap; it will surface in deployment anyway. The startups that can show graceful degradation under speed pressure will win enterprise contracts over those that cannot.
For Developers/Operators Building with AI APIs
When training imitation learning policies, collect demonstrations across the full speed range you expect to deploy at — not just nominal speed. Evaluate each manipulation stage (acquisition, reorientation, insertion) separately to identify where degradation concentrates. The finding that 74% of ACT failures at high speed were insertion misalignments suggests that downstream precision tasks are the weak link, not gross motor control. Consider curriculum learning approaches that explicitly train at varied speeds.
For Non-Technical Business Owners Evaluating AI Tools
When a robotics vendor shows you a 100% success rate, ask two questions: "Does this hold at 2x speed?" and "What percentage of failures are insertion or placement errors under throughput pressure?" Request performance data across execution speeds as part of any pilot agreement. If the vendor cannot provide this, treat their success rates as nominal-speed-only claims.
What to Watch Next
Monitor whether major robotics companies (Figure, Agility, Humanoid, Walden Robotics) incorporate temporal robustness benchmarks into their public performance disclosures. Watch for follow-up research testing whether diffusion policies or other architectures preserve temporal robustness better than ACT. The release of evaluation code from this paper may enable standardized temporal robustness benchmarking across the industry.
Frequently Asked Questions
Q: Does imitation learning work for robotic manipulation at different speeds?
A: Not reliably, according to this September 2026 study. While an ACT imitation learning policy matched expert performance at nominal speed (both 100% success), it dropped to 53% success at maximum demonstrated speed, compared to 84% for the expert. This suggests imitation learning does not preserve temporal robustness as well as it preserves nominal task performance.
Q: What is temporal robustness in robotics?
A: Temporal robustness refers to a policy's ability to maintain performance when task execution speed changes. Most robotics evaluations test robustness to scene variation, object diversity, or instruction changes — but not speed. This research shows that temporal robustness is a distinct and important failure mode that standard evaluations miss entirely.
Q: Where do imitation learning policies fail most under speed pressure?
A: In this study, 35 of 47 ACT failures at maximum demonstrated speed were insertion misalignments — the final precision placement phase. The acquisition and reorientation phases were more robust. This suggests that fine-grained, contact-rich manipulation stages are most vulnerable to speed-induced degradation.