AI Framework Boosts Web Test Script Generation from 55% to 93%
There's a new AI-driven framework for autonomous testing that has significantly boosted the success rate of generating web test scripts from 55% to an impressive 93%. This framework addresses common challenges faced by current web test suites, like failures due to UI changes and timing issues causing race conditions. It uses five main techniques: dependable navigation, context-aware selector development, post-generation validation, smart wait injection, and learning from mistakes. Tested on four real-world applications and 176 different scenarios, it features a containerized architecture that separates orchestration from browser execution. The results show an 8x drop in navigation failures, an 80% cut in timing-related race conditions, and 75% less time needed for test creation compared to manual Selenium methods. Plus, it helps with security validation by allowing testers to describe attack scenarios easily.
Key facts
- Script generation success improved from 55% to 93%
- 8x reduction in navigation failures
- 80% of timing-related race conditions eliminated
- 75% reduction in test creation time compared to manual Selenium authoring
- Evaluated across four production applications and 176 scenarios
- Five integrated strategies: navigation reliability, context-aware selector generation, post-generation validation, smart wait injection, failure learning
- Containerised worker architecture decouples orchestration from browser execution
- Framework extends to security validation via plain English attack scenarios
Entities
Institutions
- arXiv