Is Good UX Research Dead?
Is Good UX Research Dead?
Or has it just been eating too much junk food?
Join the DZone community and get the full member experience.Join For Free
Bugsnag monitors application stability, so you can make data-driven decisions on whether you should be building new features, or fixing bugs. Learn more.
UX has become hot, there’s no doubt about it. Some describe it as design thinking, others as user-centered design, but no matter what you call it, it will be a major force for years to come.
In the past, the tech world was all about software engineering and what code could do. But now, coding is becoming increasingly commoditized; it is the consumer interface of the technology that matters most. It makes sense. The face dictates the brand experience, customer acceptance, and ease-of-use; influences support cost; and directly impacts sales. If you look at all the hot tech from the last few years — Alexa, Facebook, wearables, voice recognition, VR, Twitter, etc. — they all have simple and understandable user interface concepts. It matters, not least because countless studies tell us that the number one reason for consumers abandoning at any given time with any given digital product or service is a poor user experience.
This shift toward design has triggered a “UX gold rush.” Where UX work was once the realm of specialized cognitive psychologists and human-computer interaction experts, now every ad agency, web developer, and even offshore development houses say they are UX experts.
Is this bad? Yes and no. It’s bad because so many poor quality services and products are being peddled under those two letters, a serious erosion is taking place in the field overall. It’s good because it makes the voice of the customer accessible to anyone that wants it.
But there’s a rub.
The majority of people don’t know good UX practices from bad, talented people from pretenders, and sound research insights from guesses that are legitimized by saying that a “UX person” looked at it. The result is that, overall, the quality of UX has massively eroded to the point where the field is at risk of being destroyed. Not by name. The name, or related names, will continue. It is what is behind the name that is in danger.
One of the forces that has created this erosion is online usability testing services. Rather than having target customers go into traditional usability labs with a professional researcher, anyone can now create a test online, claim they got feedback, and move on. It is faster, less expensive, and convenient. They convince others that the right work was done; people don’t know enough to question the methods, important decisions are effectively made with no substance behind the feedback, and the race to the bottom accelerates in perpetuity.
The unspoken secret, however, is that meaningful research isn’t about saying that something was shown to people and the interaction was recorded. The most important factor is how to conduct testing in a way where bias is not introduced and to strive for relative data uniformity across all feedback so that you can look at normalized data and make an accurate assessment.
Another important factor is the setting. If people are not at ease, they will give very different answers from when they feel comfortable. The current generation of online tools just gives people cold forms to fill out. The human touch that creates psychological ease is absent.
So what to do? Try to roll back the use of online tools to gather customer insights? That cat is out of the bag. It is too gosh-darned convenient to use rapid online tools, and people love convenience. No, the answer is that a new generation of tools is needed — smarter and more capable — tools that act both as productivity enhancers and teachers.
Let’s imagine the form that these tools will take. First, the tool should not provide a raw capability. Rather, it should provide users with “best practice” information on how to correctly conduct online research. There’s no guarantee that people will internalize this information, but by making it accessible and building it into the testing process, it will increase the validity of the feedback that is covered.
The tool would need to provide the fundamentals of being able to record target users — not just screen images and audio of a particular moment in time. Rather, it would also allow the capture of usage over an extended period as an online diary study. The logic is straightforward; adoption of a product cannot solely be assessed by recording a single moment. The online diary study technique should exist hand-in-hand with usability studies. Other techniques could also be part of a study being conducted.
This brings us to data. The data should be manageable as part of a single study. Currently, people have to use different online tools from different vendors with no way of bringing these findings together. Additionally, the majority of people doing UX research still use a spreadsheet, a 40-year-old tool, to cut and paste data from multiple sources.
Then, there is the speed that people want. Online testing isn’t that speedy if you have to sit and look at all the video that was recorded. A superior solution will leverage artificial intelligence (AI) and other methods to automatically generate a report that identifies the biggest problem area, providing expertise to correctly interpret the data.
AI-style features could be used to create natural language dialogue with the people that are testing by reacting to the feedback they are providing in the way that a researcher would react in a usability lab. This will improve the quality of the data being gathered.
With these fundamentals in place, the issue becomes access. The current generation of tools is surprisingly expensive. Some require a $10K or even $25K license for large projects. So price is an important factor. If these tools are going to truly improve businesses and the quality of tech solutions, they should be affordable for one-person dreamers and large corporations alike.
Lastly, most of the tools available on the market were built in the U.S., and they have a clear American bias. Most only work in English, for example, yet the tech market is global. The next-generation tools need to address the language barrier and allow customer insights to be easily gathered globally, and that means making them available in multiple languages.
Is good UX research dead? No, but it has been eating a lot of junk food lately. The hope is that a new generation of UX tools will introduce some badly needed “fruits and vegetables” to improve the overall health of UX work being done today.
Opinions expressed by DZone contributors are their own.