Performance is UX.
Often ignored by QA teams, performance testing is having a moment. It used to just be about page speed and load times. Now, it’s about the user experience—a critical factor in promoting user adoption, user retention, and revenue generation.
User engagement is a challenge on mobile. Recent data by Localytics shows that “80 percent of all app users churn within 90 days.” According to Google data, 53 percent of mobile users abandon sites that take longer than 3 seconds to load. While these stats reflect the B2C space, user engagement in the B2B space (and within your company) is just as important if you want to succeed.
IoT impacts performance testing, too. IoT systems are bigger than traditional systems—in terms of the number of users and the data being produced—and tend to operate in an environment with far more real-time constraints (think live traffic-routing apps and assembly line systems). And, of course, users expect an instant response.
Clearly, testing responsiveness (time to render and time to interaction) from the user perspective matters a lot, but current performance testing approaches are fundamentally flawed.
- A server-centric approach can’t detect a huge percentage of performance issues. And even for those issues that it can detect, it can’t pinpoint the actual impact on the user.
- A typical GUI test automation tool works entirely at the code level and can prove that an object exists, but can’t tell you whether a user can see and interact with it.