Nordic Testing Days 2025

In this deep-dive technical session, I'll share how Uber revamped its mobile testing approach using large language models (LLMs) to create DragonCrawl - a system that tests mobile applications with human-like intuition. I'll walk through how we transformed mobile testing from a maintenance-heavy, script-based approach to an intelligent, adaptive system that can handle UI changes automatically across multiple languages and cities.

The session will cover:

• The challenges of traditional mobile testing at scale (3,000+ simultaneous experiments)
• Architecture and implementation of DragonCrawl using MPNet and embedding techniques
• Real-world examples of DragonCrawl's adaptive behavior and problem-solving capabilities
• Practical strategies for handling LLM challenges like hallucinations and adversarial cases
• Results and metrics from production deployment
• Live demonstration of DragonCrawl in action

Key Takeaways:

• Understanding how to leverage LLMs for automated testing, including model selection criteria, architecture decisions, and implementation strategies that enable human-like testing behavior
• Practical techniques for handling LLM challenges in production systems, including specific approaches to manage hallucinations, adversarial cases, and edge scenarios
• Real-world insights into scaling automated testing across multiple languages and locations without maintaining separate test scripts, including specific metrics and benchmarks from Uber's production environment

If you’ve been using Postman for a while, you know it’s very useful for calling APIs, and testing them. Its strong visualization features make it the modern tool of choice.

But using it can be time consuming and error prone. As good as a tool it is, you still have work to do in planning, execution and reporting your tests. Postman’s automation and productivity features can help you with those.

This workshop is intended for Postman users, who already know the basic features, understand APIs and are ready for speeding up their work, and increasing their testing skills. You'll learn the automation features, as well as write, automate and run a sequence of APIs.

Prerequisites for Attending:

• Laptop with postman installed
• Experience with testing APIs manually and Postman

Key Takeaways:

• Write, automate and run workflows of API requests
• Use variables, pre-requests and post-responses to chain APIs
• Understand and use Postman's automation features effectively.