Index / Usability Testing

Usability Testing

Abstraction Creative
Index

An unexpected response is an invitation to understand, not a reason to defend the design.

Usability Testing helps us learn how people understand and use an experience by observing them attempt relevant tasks. It can involve an early prototype, a working product, or an existing service we are trying to improve.

At Abstraction Creative, testing is an opportunity to let the experience answer back. We have made decisions about what people will notice, understand, and do. Now we need to examine those expectations with people whose perspective is not already shaped by making the thing.

Design decisions are informed hypotheses. People provide the evidence.

The design does not need to win an argument

It is easy to become attached to an idea. We have discussed it, refined it, and learned how to navigate its logic. A person encountering it for the first time has not had that preparation.

When they hesitate or take an unexpected route, the useful response is curiosity. What did they expect? Which part of the experience created that expectation? What information were they missing?

We are not asking someone to demonstrate that they are good at using our design. We are examining whether the design supports what they need to do.

That shift can take some of the ego out of a review. A disagreement about a label or a button becomes a question we can investigate. We can still bring taste, experience, and creative judgment to the answer, but we do not have to pretend that our familiarity is the same as someone else's understanding.

Begin with the decision we need to make

A useful study has a purpose. We may need to understand whether people can compare options, complete a task, recover from an error, or recognize what happens after they submit something.

Those are different questions from whether they like the colors or would recommend the brand. Preferences can be worth discussing, but a positive reaction does not establish that an experience works.

We help define the questions, identify relevant participants, prepare the product or prototype, and establish what the sessions need to make observable. Tasks should describe a believable goal without giving away the route we hope someone will take.

The scope follows the decision and the uncertainty around it. A focused question may need a modest round of qualitative learning. A quantitative comparison needs a study designed for that purpose. We do not treat one fixed participant count as the answer to every problem.

What we pay attention to

Understanding

Does someone recognize what is available and what it means? Do the words reflect their understanding, or require them to learn the organization's internal language first?

We are interested in what they believe will happen, not only where they click. Someone can choose the intended action for a reason we did not anticipate, or reach the right screen while misunderstanding what they have agreed to.

Action and recovery

Can they work toward the goal? Where do they hesitate, repeat an action, backtrack, or seek help? What happens when something goes wrong?

A completed task can still contain unnecessary effort. An incomplete task can reveal a limitation in the prototype or the test setup rather than the intended product. The circumstances matter when we interpret what happened.

Confidence and consequence

Does the person know whether the task is finished? Can they explain what comes next? Are they confident for a good reason, or because a message suggests more certainty than the system can provide?

These questions connect behavior to feeling. Clarity is not just the absence of an error. It can be the reassurance that someone has understood the situation and remains able to make a choice.

An ordinary task can reveal a deeper problem

For an employee expense-submission experience, we work with the client and research partner to separate the questions worth investigating. Can someone choose the appropriate category, submit a receipt and understand what its status means?

The study material needs to make those questions observable without telling the participant which category to choose or explaining the confirmation for them. We prepare the relevant task, content and prototype behavior together, including what will be simulated.

Difficulty selecting a category and interpreting “submitted” as “approved for payment” would call for different investigations. One concerns terminology and possibly policy; the other concerns feedback, expectations and the approving team's work. We use the actual observations to decide whether either concern is present rather than treating the scenario as a finding.

The prototype's limits also stay visible. If it cannot accept a file, we need to distinguish that limitation from how a functioning upload is understood.

Working through these distinctions with the client makes the findings more useful. The session provides material to interpret—not an automatic instruction to enlarge the first button someone hesitates over.

Our role, and the value of specialist collaboration

We review and test our own design work. For specialized end-user studies, we typically work with an outside research partner while helping establish the objectives, participant criteria, tasks, materials, and conditions for useful learning.

Responsibilities are agreed around the engagement: who recruits, facilitates, observes, documents, analyzes, and contributes recommendations. The partner is a collaborator whose expertise can improve the questions as well as the execution.

Clients are encouraged to participate where appropriate, including observing sessions and working through the findings. Seeing an assumption challenged can make a design decision easier to understand than receiving a recommendation without its context.

The aim is shared learning, not a room full of people steering the participant toward the preferred answer.

An unexpected response is an invitation to understand, not a reason to defend the design.

The research experience deserves care too

People need to understand what participation involves, how their information will be used, who may observe, and whether a session will be recorded. Participation should be voluntary, with a clear way to stop. We plan appropriate consent, privacy, access arrangements, and participant support with the research team.

We should not collect sensitive information simply because a task could involve it. Suitable test accounts and sample material can make it possible to examine a workflow without creating unnecessary exposure.

Participants with disabilities belong in research planning. The format, materials, location, and technology need to support their participation. Their experiences contribute valuable evidence; one person's participation does not stand in for every disability or every way of using the product.

Care applies to the person helping us learn, not just the future person we hope the design will serve.

Turn observations into something the team can use

A useful findings record distinguishes what happened from what we think it means. We connect observations to the task and context, explain likely implications, and identify what remains uncertain.

Recommendations can include a design change, a question for further research, a technical investigation, or a reconsideration of the service itself. Not every finding requires a new interface.

The deliverable may include the study scope, participant context, tasks, observed issues, supporting evidence, priorities, limitations, and proposed next steps. Recordings or excerpts require appropriate permission and handling; they are not automatically public case-study material.

Small qualitative studies can reveal important problems without establishing how common those problems are across the whole audience. Counts, ratings, and completion measures need enough context to avoid making the findings appear more certain than they are.

What the client retains should be useful beyond the immediate meeting: an account of what we learned together and why it influenced the next decision.

What we learn matters most when it changes the next decision.

How this differs from other evaluation

A UX Audit can examine an experience through expert review without observing participants. Technical QA examines implementation and system behavior. Design QA checks how design intent carries into the built experience. User Acceptance Testing helps the client determine whether agreed acceptance conditions have been met.

An Accessibility Audit evaluates barriers against an agreed scope and criteria. Usability research involving people with disabilities complements that work; neither should be used to claim the other has automatically been completed.

A/B testing compares alternatives against defined measures in an experiment. It can contribute to CRO, but it does not replace the opportunity to investigate why an experience is confusing or how someone understands it.

These methods can inform one another while retaining their different jobs.

Match the evaluation to what you need to learn

Do we need a finished product? No. A prototype can be useful when it represents enough of the task to answer the question. A working product permits other observations; we choose the material around the decision, not its appearance of completeness.

Can we start with research we already have? Yes. We review its questions, participants, context and limits before deciding whether new sessions are needed. Sometimes the next useful step is to apply existing learning; sometimes a changed audience or product creates a different question.

Testing belongs in the loop

Discover → Define → Explore → Design / Develop / Market → Learn → Advance → Discover

During Discover, an existing product can help us investigate the current situation. During Explore and Design, a prototype can help us examine a proposed response. Later, an implemented experience can reveal behavior the prototype could not represent.

Learn and Advance bring the findings back into Discover. We make adjustments, reconsider assumptions, or change direction when the evidence warrants it. We can also discover that a favored idea needs to be set aside.

The work is not complete because one round went well. What matters is whether we keep making thoughtful use of what people show us.

Bring us what you need to learn

Usability Testing can be scoped independently or included within a wider design, development, or improvement effort. You might have a specific question, an inherited product, or a concern that people are experiencing something differently than you intended.

We can help define the study, bring the right collaborators into it, and turn the learning into a considered next step.

Contact Us

Start a conversation.

Tell us what you’re working toward and where you could use help. We’ll reply by email.

Tell us a little about yourself or your organization, what you’re trying to accomplish and what’s getting in the way.