Creating Usability Recommendations

Learners will synthesize qualitative and quantitative test data into actionable improvement suggestions. They will apply the six-step usability sequence to structure their analysis and avoid common pitfalls like leading participants or misaligning with project objectives.

Learning Objective: By the end of this lesson, learners will be able to create usability recommendations based on analyzed test results.

Before we dive into the six-step usability testing sequence, let’s ground this in your current practice. You already know that defining project objectives before starting maintains focus during approach selection. This clarity determines whether you choose quantitative methods, which provide numerical data and high-confidence repeatable results, or qualitative methods. The choice isn’t arbitrary; it’s driven by what answers you are trying to find. Once that approach is set, you need to prepare the necessary test artifacts. This includes discussion guides, consent forms, and checklists, for which Steve Krug provides helpful templates at sensible.com/download-files. These documents structure the interaction, ensuring you capture meaningful data without bias. You also need a functioning version of the site or application, often in beta mode, to ensure the environment supports true-to-life performance testing. Many teams mistakenly believe usability testing only happens near deployment, but it provides insights much earlier. By establishing these objectives and artifacts first, you create a stable foundation for the research. This preparation ensures that when you move to planning the research scope and logistics, you are building on a clear, objective-driven strategy rather than guessing.

Key Points:

• Define project objectives before starting to maintain focus during approach selection.

• Choose between quantitative methods (numerical data, high-confidence, repeatable) and qualitative methods based on those objectives.

• Prepare test artifacts including discussion guides, consent forms, and checklists (templates available at sensible.com/download-files).

• Ensure a functioning prototype or beta mode environment is ready for true-to-life performance testing.

You move into the six-step usability testing sequence, starting with choosing an approach that aligns directly with your project objectives. Because you’ve already defined those goals, you can now decide whether you need quantitative methods for high-confidence numerical data or qualitative insights for deeper understanding. This decision anchors the entire study, ensuring your methodology supports the specific evidence you need to drive recommendations later in the process. Next, you plan the research by defining the scope and logistics required to execute that chosen approach. This phase sets the boundaries for what you will test and how you will measure success, preventing scope creep from diluting your findings. It’s where you determine the resources needed and the timeline for gathering meaningful performance data before you even touch a prototype. Then comes recruiting and logistics, where you secure participants and set up the testing environment to ensure realistic conditions. You need people who represent your actual users, not just convenient volunteers, so their behavior reflects true-to-life performance. Setting up the space, whether virtual or physical, ensures that environmental factors don’t interfere with the natural flow of the user’s interaction. Finally, you write discussion guides that contain task scripts focused strictly on user goals rather than interface labels. If a button says "Submit," you must not use the word "submit" in the instruction, because that leads the participant instead of testing their natural discovery. You frame tasks around the answers they are trying to find, which prevents leading questions and reveals genuine usability issues. This careful wording ensures the data you collect during facilitation is valid for analysis.

Key Points:

• Step 1: Choose an approach (quantitative vs. qualitative) aligned with project objectives.

• Step 2: Plan the research by defining scope and logistics.

• Step 3: Handle recruiting and logistics to secure participants and set up the environment.

• Step 4: Write discussion guides with task scripts focused on user goals, avoiding interface-specific labels.

You facilitate the tests using those discussion guides to gather performance data, ensuring participants frame tasks around their actual goals rather than interface labels. This prevents leading them, which means if a button says submit, you simply do not use that word in the instruction. Afterward, you analyze and present results to process the gathered data, looking for patterns that reveal where users struggle or succeed. You ground these findings in design principles like Jakob Nielsen’s ten usability heuristics, checking for issues like poor visibility of system status. The final output is creating recommendations for improvements, which serves as the tangible result of your analysis. These suggestions feed directly into the iterate phase of the project lifecycle, following the develop, test, and refine cycle. By generating specific improvement suggestions, you provide the team with insights to refine the solution. This ensures the testing process delivers true-to-life performance information earlier, correcting the misconception that evaluation only happens near deployment. You have now walked through the sequence from planning to recommendation, establishing a clear path for iteration. Next, we will examine common pitfalls to avoid during this process, ensuring your approach remains focused and effective.

Key Points:

• Step 5: Facilitate tests using the prepared discussion guides to gather performance data.

• Step 6: Analyze and present results to process the gathered data.

• Step 7: Create recommendations as the final output, part of the 'Iterate' phase in the project lifecycle.

• Ground recommendations in design principles like Jakob Nielsen’s 10 usability heuristics (e.g., Visibility of system status).

Let’s test your instinct on timing. Do you schedule usability testing only near deployment, or do you run it earlier to capture true-to-life performance data? [pause:1s] The reason early testing matters is that it prevents the costly misconception that validation belongs solely at the end of development. Now, look at your discussion guides. If a button says "Submit," do you use that word in your task instructions? [pause:1s] You must rewrite those instructions to focus on the user's goal rather than interface labels, because using specific terms leads participants and skews natural behavior. Think about your project objectives. Are they defined before you select your research approach? [pause:1s] You need strict adherence to those objectives during approach selection to prevent losing focus between quantitative and qualitative methods. Finally, verify your recommendations. Are they derived from actual user research rather than assumptions? [pause:1s] Ensuring your suggestions stem from analyzed test results, not guesses, is how you apply the goal-framing technique effectively. With these pitfalls avoided, you are ready to apply recommendations to iterate on the design.

Key Points:

• Correct the misconception that testing only happens near deployment; clarify it provides early true-to-life insights.

• Avoid leading participants by rewriting task instructions to focus on goals rather than interface labels (e.g., do not use 'Submit' if the button says 'Submit').

• Prevent loss of focus by strictly adhering to defined project objectives during approach selection.

• Ensure recommendations are derived from actual user research rather than assumptions.

You integrate those tangible improvement suggestions into the Iterate phase, which follows the develop, test, and refine cycle. This is where your analysis changes the solution. You treat the six-step usability testing sequence as a reliable checklist for future projects, ensuring consistency. Using this structured approach helps you maintain focus and avoid common pitfalls like leading participants. Early testing provides true-to-life performance information, boosting overall project lifecycle efficiency. You’ll find that applying these recommendations creates a smoother path from insight to implementation.

Key Points:

• Integrate recommendations into the 'Iterate' phase following development and testing.

• Use the six-step sequence as a checklist for future usability projects.

• Reflect on how early testing impacts the overall project lifecycle efficiency.

• Prepare to deliver tangible improvement suggestions to stakeholders.