Loading…
Type: Track clear filter
arrow_back View All Dates
Thursday, May 15
 

10:30 EEST

Revolutionizing Mobile Testing with Generative AI at Scale
Thursday May 15, 2025 10:30 - 11:10 EEST
In this deep-dive technical session, I'll share how Uber revamped its mobile testing approach using large language models (LLMs) to create DragonCrawl - a system that tests mobile applications with human-like intuition. I'll walk through how we transformed mobile testing from a maintenance-heavy, script-based approach to an intelligent, adaptive system that can handle UI changes automatically across multiple languages and cities.

The session will cover:
  • The challenges of traditional mobile testing at scale (3,000+ simultaneous experiments)
  • Architecture and implementation of DragonCrawl using MPNet and embedding techniques
  • Real-world examples of DragonCrawl's adaptive behavior and problem-solving capabilities
  • Practical strategies for handling LLM challenges like hallucinations and adversarial cases
  • Results and metrics from production deployment
  • Live demonstration of DragonCrawl in action

Key Takeaways:
  • Understanding how to leverage LLMs for automated testing, including model selection criteria, architecture decisions, and implementation strategies that enable human-like testing behavior
  • Practical techniques for handling LLM challenges in production systems, including specific approaches to manage hallucinations, adversarial cases, and edge scenarios
  • Real-world insights into scaling automated testing across multiple languages and locations without maintaining separate test scripts, including specific metrics and benchmarks from Uber's production environment
Speakers
avatar for Anam Hira

Anam Hira

Co-founder & CTO, Revyl.ai
Anam Hira is a co-founder and AI researcher who previously built DragonCrawl during his time at Uber. In just 4 months the project caught 11 P0 bugs and saved Uber $25M. Anam co-authored the DragonCrawl paper: https://www.uber.com/blog/generative-ai-for-high-quality-mobile-testi... Read More →
avatar for Landseer Enga

Landseer Enga

Co-founder, Revyl.ai
Thursday May 15, 2025 10:30 - 11:10 EEST
BlackBox
  Track

11:10 EEST

Finding bug-rich focus areas like if you had x-ray vision - Questioning Construct validity.
Thursday May 15, 2025 11:10 - 11:50 EEST
There's a reason people in tech are notorious for answering questions with questions like "what do you mean by X?" or "that depends".

Human language is kinda vague and sloppy, but context usually fills in the blanks, and we're used to be able to clarify on the spot, but that doesn't work when we try to tell machines what to do, or when when we're putting words in documents that other people in other contexts are supposed to understand. This is, in my experience, where bugs usually occur – in the assumed understanding of constructs - the conceptual "things" we use in language, like "hour", "border", "flower", "write", "red" and "sound". In other words, things go wrong when we think that everyone must mean the same thing, when we think something is clarified enough.

The first step in uncovering these bug-generating mistakes is becoming aware of them and getting creative about alternative meanings, and that's part of why it's so much fun being a tester.

In this talk I will present some of my "favourite" constructs to challenge, and some useful cues to help you notice that a construct you're using should be investigated closer.

Key Takeaways:
  • A structured way of using construct validity as an attack vector for finding bugs, even without looking under the hood, like you had x-ray vision.
  • A list of very common problematic constructs, and why they keep tripping people up, again and again.
  • Some phrases you may choose, to come across as less annoying, when you actually care about what others dismissively refer to as "just semantics" .
Speakers
avatar for Lars Sjödahl

Lars Sjödahl

Senior Test Consultant, House of Test Consulting AB
Lars has been in research and development since 2001 and software tester since 2006. He's a technical omnivore and sees himself as an investigative cartographer of systems. From early on in his career, he's developed a fascination for how communication, group psychology, cognitive... Read More →
Thursday May 15, 2025 11:10 - 11:50 EEST
BlackBox

11:50 EEST

From Speed to Sophistication - Real World Playwright Case Studies that will change your perspective!
Thursday May 15, 2025 11:50 - 12:30 EEST
Playwright stands out as a powerful tool, but what exactly sets it apart from other automation solutions? This talk aims to introduce attendees to the key differentiators and capabilities that make Playwright a superior choice for web testing.
 
We will begin by exploring the fundamental strengths of Playwright, such as its ability to handle browser interactions with remarkable speed and efficiency. However, the true power of Playwright lies in its advanced features that go beyond basic functionalities.
 
Throughout the session, we will delve into a carefully curated list of real-world use cases where Playwright has demonstrated its superiority over other automation tools. These examples will highlight how Playwright excels in testing complex web applications within large organizations, showcasing its robustness and versatility.
 
One of the standout features of Playwright is its support for authentication contexts. This allows testers to simulate different user sessions and roles seamlessly, making it easier to test applications that require user authentication. Additionally, storage states enable the preservation of cookies and local storage data between tests, ensuring consistency and reliability in test scenarios.
 
Another powerful capability of Playwright is its tracing feature, which provides detailed insights into test execution. This includes capturing screenshots, network activity, and console logs, making it easier to diagnose and debug issues.
 
By the end of this talk, attendees will have a comprehensive understanding of how Playwright's advanced features can enhance their testing experience. They will learn how these capabilities not only improve the efficiency and effectiveness of their tests but also make the overall testing process more enjoyable and productive for engineers.
 
Key Takeaways:
  • Superior Web Automation Capabilities: Understand what sets Playwright apart from other web automation tools, including its high execution speed and efficient browser interactions.
  • Advanced Features for Enhanced Testing: Learn about Playwright's powerful features like authentication contexts, storage states, and tracing, which significantly improve the testing experience and make it more efficient.
  • Real-World Use Cases: Gain insights from real-world examples where Playwright has proven its superiority in testing complex web applications within large organizations.
  • Improved Debugging and Diagnostics: Discover how Playwright's tracing feature provides detailed insights into test execution, helping to diagnose and debug issues more effectively.
  • Comprehensive Testing Framework: By the end of the talk, attendees will be equipped with the knowledge to leverage Playwright's advanced capabilities, making their testing processes more robust and enjoyable.
Speakers
avatar for Ashish Ghosh

Ashish Ghosh

Test Automation Architect | Test CoE Lead, ING Bank
Meet Ashish Ghosh, a seasoned Test Automation Architect with over 12 years of experience in the Testing industry. Currently leading the Test Center of Excellence at ING Bank, Ashish has played an instrumental role in reshaping the testing landscape, driving both Functional and Non-Functional... Read More →
Thursday May 15, 2025 11:50 - 12:30 EEST
BlackBox

13:30 EEST

How to Train Your Robot
Thursday May 15, 2025 13:30 - 14:10 EEST
In today's world, we have the privilege of witnessing the beginning of the rise of robots. More and more companies are dealing with robotics or autonomous systems, and articles predicting the future, like from the legendary movie Terminator, arrive in my inbox almost weekly. Given the hype and the lack of practical experiences, it is easy to think that testing robots is entirely different, but is it as it seems, and are there any techniques from the good old world of software that we can apply to robots and autonomous systems?

In this story, I will tell you about my experiences and lessons learned from a year of hanging out with different robots. I will share how to test autonomous systems using contemporary exploratory testing practices. We will learn what robots have in common and the techniques we apply to train them. You will see that testing the autonomous systems is still good old testing but with different flavors of danger and predictability. How do you cope with these flavors after working exclusively in software applications? I believe this question will pop into our minds more and more, so if this raises your curiosity, then this talk is a place to be.

Key Takeaways:
  • How to test robots using contemporary exploratory testing.
  •  How to "translate" our "software skills" and apply them to domains such as robotics.
  • Hear the real experience and how it was to work daily with a 4,5-ton heavy autonomous vehicle.



Speakers
avatar for Irja Straus

Irja Straus

Quality Consultant, Straus d.o.o.
Irja came into testing by accident, and after years of successful product management work, she returned to it - intentionally. After 15 years of developing skills in different companies and industries (including SaaS, CPaaS, robotics, machine learning, AI, and U.S. healthcare), Irja... Read More →
Thursday May 15, 2025 13:30 - 14:10 EEST
Väike Saal

13:30 EEST

Modernizing QA in the Nordic’s Largest Bank: Reducing Payment System Test Cycles from Three Weeks to Three Hours
Thursday May 15, 2025 13:30 - 14:10 EEST
Modernizing the testing of payment systems in the Nordic region’s largest bank is a complex journey in a highly regulated, legacy environment. With millions of daily transactions  and billions of euros going through our systems, ensuring fault tolerance and system reliability is critical — not just for the bank, but for society at large. As the financial sector faced increasing pressure from regulatory demands, the need to move from mainframes to modern software, and demands for faster time-to-market, we recognized that our current traditional QA approach was unsustainable and  not scalable for future demands.

This presentation will share our journey of transforming QA into a business enabler. We navigated significant hurdles, including securing senior management buy-in, managing high delivery pressures, and shifting mindsets from manual testing to automation-driven quality. By focusing on foundational improvements — such as evolving our test automation framework, updating our tool stack, including integrating CI/CD, optimizing test environments, and implementing fast technical checks — we achieved remarkable results.

We reduced test cycle times from three weeks to just three hours, increased automation coverage to 75% across all test levels, and improved production quality by minimizing incidents. This transformation accelerated software releases and strengthened trust across teams and leadership.

Join us to learn the critical lessons, challenges, and best practices for modernizing QA in a large-scale, complex financial ecosystem.

Key Takeaways:
  • What you should consider when you start your journey of uplifting your QA
  • What are the pre-requisites of your journey, what you should do it
  • How to convice people around you that you are doing correct things
Speakers
avatar for Sami Kaltala

Sami Kaltala

Head of QA Team, Nordea
I have been working with QA and testing since beginning of millenium. My career started as a hardware tester. Now 25 years later I'm working at Nordea as a leader for QA team. My extensive background contains almost every role within QA, such as test manager, tester, test architecth... Read More →
Thursday May 15, 2025 13:30 - 14:10 EEST
BlackBox

14:10 EEST

Building Quality Foundations: Unleashing Design Patterns in Testing as a QA Architect
Thursday May 15, 2025 14:10 - 14:50 EEST
What if the secrets to constructing a lasting, resilient home could be applied to building robust software systems? Just as a house stands firm on the knowledge passed down through generations, our approach to software testing can benefit from timeless principles. In my journey as a woman navigating both construction sites and the IT world, I’ve discovered remarkable parallels between these seemingly disparate fields.

Join me for an enlightening session that will take you through the captivating realm of design patterns from the perspective of a QA Architect. I’ll dive deep into practical patterns like Singleton, Builder, and Decorator, sharing insights on their strengths and pitfalls based on my real-world experiences. Forget the usual discussions on KISS or DRY; instead, we’ll explore how fundamental programming principles can transform the way we create maintainable tests.

Drawing from my experience in technical recruitment and test design, I aim to equip you with actionable knowledge to seamlessly integrate these patterns into your projects. Let’s uncover how laying a solid foundation can lead to exceptional outcomes, not only in constructing homes but also in crafting outstanding software solutions.

Key Takeaways:
  • Application of Design Patterns: can significantly improve the quality and maintainability of tests in IT projects.
  • Fundamentals of Programming: Grasping fundamental programming principles and their impact on creating effective tests is crucial for success in QA.
  • Integration of Experiences: Utilizing practical experiences from technical recruitment and test design to effectively implement design patterns in the daily practices of teams.
Speakers
avatar for Emilia Lendzion-Barszcz

Emilia Lendzion-Barszcz

Senior Software Engineer in Test, Snowflake
QA Architect, trainer, and proud parent. I am passionate about backend development, where untapped opportunities for growth await. As an expert in quality, I focus on Developer Experience, DevOps, and the Shift-left approach, which are particularly close to my heart.In my role, I... Read More →
Thursday May 15, 2025 14:10 - 14:50 EEST
Väike Saal

14:10 EEST

The Future of Accessibility Testing: Beyond Compliance to Inclusive Innovation.
Thursday May 15, 2025 14:10 - 14:50 EEST
In a world where over 1 billion people live with disabilities, accessibility is no longer optional — it’s essential. The European Accessibility Act (EAA), coming into full effect in June 2025, sets a legal framework that requires businesses to provide accessible digital goods and services. This creates both a compliance mandate and an opportunity to unlock new markets, improve user experiences, and foster innovation.

We’ll explore the current challenges in accessibility testing, such as the limitations of automated tools, the importance of real-user feedback, and the complexities of testing emerging technologies like AR/VR. Learn from real-world examples, including how Accenture has partnered with clients to integrate accessibility into their digital ecosystems by integrating it into their design and development pipelines.

The talk will also introduce cutting-edge trends, such as AI-powered accessibility tools, inclusive design thinking, and the integration of accessibility into CI/CD workflows. Practical steps will be shared, including how to involve diverse users in testing and the critical role of an accessibility statement in building trust and driving continuous improvement.

Attendees will leave inspired to champion accessibility as a mindset and practice, equipped with actionable insights to create inclusive, user-friendly digital experiences that benefit everyone. Whether you’re a tester, developer, or decision-maker, this talk will show you how accessibility can be a catalyst for innovation and inclusion in your projects.

Key Takeaways:
  • Accessibility Drives Innovation and Opportunity: Embrace accessibility to unlock new markets, improve user experiences, and future-proof your business.
  • Think Beyond Compliance: Leverage cutting-edge tools and inclusive design to create meaningful, barrier-free digital experiences.
  • Commit to Inclusivity: An accessibility statement isn’t just a policy—it’s a promise to your users and a tool for continuous improvement.
Speakers
avatar for Victoria Kiskina

Victoria Kiskina

Test Engineering Specialist, Accenture Baltics
Victoria is a functional tester and lead with over 10 years of experience. Recently, she has focused on accessibility testing, sharing her expertise with colleagues and spearheading the creation of an accessibility testing group at Accenture Baltics.
Thursday May 15, 2025 14:10 - 14:50 EEST
BlackBox

14:50 EEST

Parallel Testing Redefined: The Browserpooling Method
Thursday May 15, 2025 14:50 - 15:30 EEST
Private browsing modes, such as Chrome's incognito mode and Firefox's private mode and containers, serve the common purpose of ensuring privacy during browsing. Although the underlying implementations differ, they share key features such as not storing browsing history and cookies, hence enhancing user privacy. While this feature is useful for regular users, it's a powerhouse for automation engineers and testers. WebDriver BiDi offers a browser-agnostic method to utilize private browsing through User Contexts, cultivating a 'browserpooling' approach. This approach allows multiple tests to share a single browser instance and WebDriver session, facilitating parallel test execution. Like carpooling, where multiple passengers share a single ride to different destinations, WebDriver BiDi's user contexts enable parallel tests to utilize a single browser instance without sharing data. This provides performance gains by eliminating the time-consuming process of spinning up and shutting down multiple browser instances. Join this session to explore how user contexts operate, how to manage isolated tests and cookies across multiple tabs and gain insights with a live code demo on leveraging this technique in Selenium.

Key Takeaways:
  • Learn how to optimize testing environments by using a single browser instance.
  • Practical knowledge of using WebDriver BiDi's user context with code examples.
  • Understand real-world use cases where this method can lead to performance gains and reduce the total runtime of automation tests.
Speakers
avatar for David Burns

David Burns

Head of Developer Advocacy and Open Source, BrowserStack
Chair for the W3C Browser Testing and Tools Working Group. Editor of the W3C WebDriver specification. Head of Developer Advocacy and Open Source Program Office working with engineers, technical project managers, product managers to support and promote our open source projects.Have... Read More →
Thursday May 15, 2025 14:50 - 15:30 EEST
Väike Saal
 
Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
Filtered by Date -