That’s a waste of both your and your research participants’ time, and it’s bad for business. The first step in doing user research right is to understand best practices for the method you are using, and why best practice is, in fact, best practice. If you understand this, you can ensure that your own user research is truly relevant, you can evaluate the validity of other people’s research results, and you can explain the benefits of using a certain method to stakeholders. Here, we’ll consider the differences between qualitative and quantitative research and explain what the best practices are when you do qualitative user research. Most qualitative UX methods can be run remotely, and several work better that way. User interviews and focus groups have remote equivalents (video calls and online focus groups) that are now common practice.
Explore qualitative UX testing methods, examples, and use cases, including usability tests, interviews, and AI-moderated research. This often involves partnering with product, marketing, and support teams to implement and monitor things like intercept surveys, user analytics, NPS scores, and support tickets. In moderated research, the researcher is involved during the research session. Depending on the method, they may be observers or may take a more active role as facilitators.
This section explores major approaches to qualitative data analysis and provides practical guidance for implementation. Digital technologies have revolutionized qualitative data collection by enabling more flexible and comprehensive approaches to gathering research data. Mobile data collection through smartphones and tablets allows real-time documentation and immediate upload to secure servers, with specialized apps facilitating diary studies, experience sampling, and location-based data collection. Qualitative interviews, which are typically conducted with a single participant (and sometimes two), represent a foundational technique for data collection.
Quantitative research, on the other hand, usually involves collecting large quantities of numerical data from a much larger group of people, often indirectly through surveys or analytics tools. Insights are derived using mathematical analysis of the data to quantify a problem by answering the questions, “How much? ” Because statistical significance is a key goal of qualitative research, testing protocols are rigid and not subject to change over the course of a study.
Data Collection
User research is crucial to creating products and services that people love. It helps better understand what users need and want, and how they behave. Mixing methods also helps you avoid making false assumptions that can cause you to travel down the wrong path, wasting time and resources on developing a solution that users don’t really need. Regardless of whether your data is qualitative or quantitative, it isn’t much use to anyone until it’s been analyzed and synthesized. The methods you use to analyze your data will depend on the methods you used to gather it—and unsurprisingly, there’s quite a lot of difference between quantitative and qualitative research analysis.
Chances are, quantitative data is the first thing that comes to mind when you think of data. The end result of your research is figurative—all produce a numerical figure, such as percentages and ratios. Automate interviews, scale insights, and lead your organization into the next era of research.
You might also use methods like surveys (with open-ended questions), existing product data, competitive analysis, literature reviews, and other fact-finding methods to gain a more detailed understanding of the context. But really, research has a valuable role to play at every stage of product development. The goals of your research—the questions you’re trying to answer, the decisions you’re trying to facilitate—will change over the course of the product development cycle, as will the methods you use. Attitudinal UX research methods rely on self-reported data—in these methods, study participants tell researchers what they think.
You want to understand a user type you don’t have direct access to. Research helps you build accurate mental models of people whose day-to-day context is different from yours. The gap between how a product team thinks and how a first-time user thinks is almost always larger than the team expects. PlaybookUX is well suited for teams that run a variety of UX research methods and want to manage them in one environment. It’s especially useful for product and design teams seeking a single platform for end-to-end research, from recruiting participants to presenting insights.
Although all qualitative research shares a common goal, there are several types of research approaches you can use, as shown in the image below. Researchers used feedback tools like CSAT and Likert scales to obtain quantitative feedback which showed empirical evidence supporting their new TV design. Quantitative research also generalizes data from large sample populations, while qualitative research typically uses smaller ones. That’s because numerical findings are stronger when tested on a larger sample size.
AI-moderated platforms compress that to as few as three days by running recruitment, interviews, and synthesis in parallel. Traditional qualitative research takes longer because of everything surrounding the conversations, not the conversations themselves. Scheduling, transcription, and manual data collection and coding add another four to six weeks from brief to final report.
Assessing reliability and validity is more difficult with qualitative research since it relies on subjective human interpretation and has few established metrics and statistical tools compared to quantitative research. Triangulation and member checking add credibility but lack the discreteness of quantitative measures. However, there have been advancements in the measurement of qualitative research that help to quantify its impact. Qualitative research often involves a smaller, nonrepresentative sample size than quantitative research.
For a detailed comparison of where synthetic and real-participant research diverge and overlap, synthetic users vs real users covers the tradeoffs without overselling either side. They’re also the slowest and most logistically intensive qualitative method. Setup requires clear participant instructions and regular check-ins to maintain engagement across the study period.
- Post-launch, user research continues to play a vital role by measuring satisfaction, identifying new opportunities, and guiding iterative improvements.
- Even the smallest amount of user research will save time and money in the long run.
- PlaybookUX offers a pay-as-you-go model with no subscription required, starting at $65 per participant for unmoderated tests and $115 per participant for 30-minute moderated sessions.
- This can include sentences from user research sessions, takeaways from focus groups, common denominators with diary studies—anything you’ve found from your research.
- Pricing is customized based on organization size and usage, and teams can request a demo.
There are a wide range of evaluative research methods, many of which are most valuable at specific stages of product development. Their purpose is to validate whether or not your in-progress design is effectively solving the problem you identified during your generative research. The primary differences between qualitative and quantitative UX research have to do with how the data is collected and the nature of the data itself. Once you’ve found common themes from a round of UX research, use the data to pull key insights.
The primary difference between qualitative and quantitative UX research lies in the nature of the data. The UX Research Field Guide is a comprehensive how-to guide to user research. By the time you finish reading, you’ll be a total pro at doing user research—from planning it to conducting sessions to analyzing and reporting your findings. Check out the video below from CareerFoundry graduate and UX designer Maureen Herben for an end-to-end guide to qualitative user research. Artificial intelligence is modernizing how researchers work by accelerating synthesis, analysis, and decision-making without sacrificing quality and depth. It isn’t an exhaustive list, but covers some of the more popular methods of research.
Typically, one or two participants are interviewed over a long period of time — from weeks to months to years. If a company wants to create a new product or feature, researchers can observe how customers are currently using their products and record any points of friction found within the experience. A modern take on direct observation is mobile or digital ethnography, which lets researchers observe behaviour remotely through video and screen recordings captured on the participant’s own smartphone.
Qualitative testing explains why users behave as they do, while quantitative testing measures how often behaviors occur. Concept testing gathers qualitative feedback on early ideas, prototypes, or messaging. It helps teams assess clarity, relevance, and appeal before committing to development. Some experiences unfold over time rather than in a single session. Diary studies ask participants to document their interactions and emotions over days or weeks, revealing patterns, habits, and changes in perception. The key was waiting for participants to bring up these problems on their own—our founders asked what people’s biggest problems were, based on real past experiences, and let them tell us what they needed.
Common Challenges In Qualitative User Research Addressed
The goal is to replace assumptions with evidence — giving product, design, and strategy teams a factual foundation for every decision they make. The purpose of user research is to put your design project into context. It helps you understand the problem you’re trying to solve; it tells you who your users are, in what context they’ll be using your 4 User Research Techniques Derribar Ventures Limited Applies to Validate Product Assumptions product or service, and ultimately, what they need from you, the designer!
The data from this type of research helps generate ideas and discover opportunities for improvement. User interviews are a great source of qualitative user data and help researchers and designs gain a greater understanding of their user’s motivations, needs, and behaviors. Effective user research turns data into actionable direction by giving teams clarity on what users need and why. To create user-friendly experiences, those insights must be validated through user testing. AI for user research enables teams to speed qualitative analysis that traditionally took weeks, and can now be completed in a matter of hours.
Focus groups bring together small groups of users to discuss a product or topic. A moderator guides the conversation and encourages participants to share their thoughts and opinions. Which is an excellent segway into the next chapter, How to Choose a User Research Method, which is all about the frameworks user researchers use to decide on the specific methodologies their research question requires. Oftentimes, the best way to answer your research question with both certainty and nuance is to take a mixed methods approach.
Each of these research studies started with a number that raised a question. Personas, journey maps, and stakeholder presentations are stronger when grounded in real user language, more persuasive than synthesized summaries. When trust, anxiety, or brand perception is involved, you need a real conversation to surface what’s actually driving behavior.
” Common quantitative research methods include usability studies, user surveys, click tests, card sorts, and A/B tests. Qualitative user research is a category of research methods that collects non-numerical data through direct engagement with users. Instead of counting clicks or measuring completion rates, qualitative research captures stories, emotions, workarounds, and the reasoning behind user behavior. Strong UX research programs layer qualitative methods to connect behavior, motivation, and context into a coherent understanding of the user experience. Good user research is characterized by clear research goals, well-defined research protocols, appropriate sampling methods, unbiased data collection, and rigorous data analysis.
“Three of five participants couldn’t identify the primary action on the screen without prompting” is a finding. For a step-by-step walkthrough of the full process – from writing research objectives through presenting findings – how to conduct user research covers the practical decisions at each stage. The failure mode is a dominant voice that pulls the group toward a single view.
Types Of User Research Methods
Designing for a new target audience or market where your assumptions may not hold. Qual is the right starting point because you need to understand the problem space before forming hypotheses worth testing. Learn how AI is changing survey design, from question development and adaptive probing to open-ended analysis and human validation. Explore where human judgment matters most in AI-assisted market research, from consumer experiences to strategic decisions and accountability. “I’ll often incorporate methods like card sorting to clarify information architecture and ensure navigation reflects users’ mental models rather than internal org charts.”
Visual and creative methods expand the possibilities for data collection beyond traditional verbal approaches, offering participants alternative ways to express their experiences. Document and media collection allows you to gather existing materials that provide insights into official perspectives, public discourse, and cultural representations without requiring direct participant interaction. Qualitative researchers can collect diverse materials including organizational documents, policy papers, social media posts, websites, photographs, videos, artwork, and historical records. The key lies in selecting documents that relate directly to your research questions while considering their purpose, audience, and context. You should consider costs for transcription services, analysis software, participant incentives, travel for data collection, and potential research assistance.
In this approach, researchers run in-depth interviews with a very small number of participants in order to create a cohesive narrative that reveals themes and patterns. While good ideas are great, it’s important that we still do the interviews with an open mind about how people feel about exercise partners. It’s important that we still ask open and explorative questions and that we don’t put words in the participant’s mouth by asking leading questions.
The value-action gap is a well-known psychology principle outlining that people genuinely don’t do what they say they would do, and is commonly referred to as what people say vs. what people do. In a 2005 survey completed by Bain, a large global management consulting firm, they found some startling results. 80% of businesses thought they knew best about what they were delivering. There are ways that you can conduct faster and less costly user research, utilizing Guerrilla research outlined later on in this article (also handy if budget and time are an issue).