The usability testing for Integrated Patch Management (IPM) aims to assess whether participants can successfully and independently execute the patching process.
This testing helps identify any usability issues, providing valuable insights to enhance the overall quality and effectiveness of the IPM system.
ROLE UX Designer, Facilitator
TIMELINE June 2022 - January 2023
TEAM 1 (UX Manager)
1 (UX Designer)
1 (Product Marketing Manager)
ACTIVITIES PERFORMED Moderated Remote Usability Testing, Data analysis, Prototype Mocks
Preparation is the key for usability testing. My role was to conduct the usability sessions and also observe participants.
With the scope of the usability test clearly defined, I developed a tailored testing script template designed to guide participants through key tasks and capture meaningful insights aligned with our objectives.
Once we had a clear understanding of the scope, we moved forward with participant recruitment. We selected five individuals from within our organization, each with different roles and based in various regions around the world.
Over the course of a week, we conducted remote usability tests to gather diverse perspectives and insights.
The usability testing was carried out over five days, with a dedicated team of four. I led the sessions as the facilitator, while a Product Marketing Manager and two UX designers participated as observers and notetakers.
This collaborative setup allowed us to capture a wide range of insights in real-time.
Below is a snapshot from one of our remote testing sessions.
After completing all the testing sessions, I carefully reviewed my notes and analyzed the recorded sessions to uncover patterns, extract key insights, and draw meaningful conclusions from the user feedback.
Here are a few direct quotes from participants as they completed the tasks during the sessions—offering a glimpse into their real-time thoughts and experiences.
UX is a Team Sport
Inviting teammates and stakeholders to attend usability testing session builds organizational support for UX activities and it also helps to develop empathy for the users.
Conduct a Pilot Test
Running a dry run allowed me to test the logistics, to validate that all the tasks can be performed and to run out any possible issues. The pilot test also allowed me to get some practice and be more comfortable with moderating a session.
Moderating a usability session is an art
Always reminding the participants as they accomplish the tasks to think aloud and to externalize their thoughts and feelings. Avoid influencing participants and introducing bias.
Define Metrics Prior to Data Collection
Usability testing is a qualitative method, I supplemented observational and self-reported data with some basic quantitative metrics (sometimes called performance metrics) based on user behaviors.