Usability Test Snapshots
April 7th, 2010
Usability testing is a pretty standard practice and I assume most of us here have done or might do a few of these evaluations in their design careers. Last month, I had the chance to spend some time with end users on a software project and I thought of sharing some of the documentation which resulted from the activity.
Right after doing such a test, we’re often faced with the challenge on how to capture and convey some of the interesting findings to others on the team or even ourselves. Some people try video, while others overlay the identified problems on top of screen captured images. In this round of testing I was aiming for something slightly different. Essentially, I wanted to a capture the core notes per each user on a single piece of 8.5×11 paper (perhaps in a persona like fashion?). Each page would have starting points of what the user has initially done with the use of red text, followed by dark grey notes as the actions unfolded. The findings were then tagged accordingly as: ideas (light bulb symbol), confusions (question mark) or positive remarks (happy face). Further more, the sample also makes use of subtle informal sketches through out the page to help convey the issues somewhat visually.
Perhaps to someone who lacks context of the project or products being tested, a deliverable such as this might not be adequate enough at conveying the issues. On the other hand, for those who have participated in the test as observers, the following usability test snapshot might act as an inspiration piece for the design work ahead.
Please post as a comment (or submit) ideas of your own on how to best convey, remember or prioritize findings from design research.
Credits: Jakub Linowski
April 8th, 2010 at 9:27 am
Thanks for sharing! This looks like a great way to sum up everything on 1 page.
By the look of it, the session took between 30–45 minutes? I normally print out the script, which has the questions and screenshots. Then as we go along, I'll take notes and scribble on the screenshots where relevant.
The conversation is also recorded. After the session, I dive into the summary report straight away while the memory is still afresh. I'll read the notes and listen to the recording and go through everything.
The deliverable is simply a document that is split into different sections of the site that the user looked at, with some statements of what happened. I'll then write down my notes and suggestions (for the client) wherever relevant. A screenshot is provided below:
http://grab.stilllive.net/89b4340016a0b9af3f51120…
I really like the usage of icons like question mark, smiley face, and light bulb for the different kind of remarks though. It's also a good idea to use 'question marks' as suppose to 'sad faces' because sad faces tend to put clients on their nerves. The truth is, we can't accommodate everyone's needs, and a 'question mark' is much easier to digest and assess without emotional interference compared to using a 'sad face'.
April 8th, 2010 at 4:22 pm
It's a little idiosyncratic. I agree. Will be working on another more high level deliverable some time in the future. Stay tuned. Would you have a sample you'd be willing to share? :)
April 15th, 2010 at 11:43 am
Hi Jakub,
It's really lovely way of presenting results and I can see how it summarises a session really well. As a moderator, I generally have a 'session guide' which I do in an excel spreadsheet, with tasks on the columns and each participant in the lines – and I use it to take notes during the session (touchtyping course coming in handy here). After the test it is easy to analyse different answers for the same task and to compare users, filter and analyse results. Your sheet seems like a natural way of presenting these to clients – so I will definitely get inspired. Thank you so much for sharing!!!!!
August 31st, 2011 at 7:32 am
In an early stages of a project, this level of feedback and note-taking could be valuable. Later in the project, I could see stakeholders becoming fixated on red herrings and rogue suggestions rather than focusing on the heart of the matter — usability.
September 26th, 2011 at 7:21 pm
I appreciate that you know the value of usability testing. Easy user access is very important!
October 29th, 2011 at 9:10 am
I always appreciate someone who imparts knowledge, and so today i m also doing the same..i m pretty impressed by the useful & knowledgeable stuff you have added in your blog..:)
November 15th, 2011 at 5:17 am
Document management service providers will help your company operate more efficiently, improve your bottom line and strengthen your competitive position; now and as you plan for growth in the future. media storage
A building inspection is an examination of the soundness of your prospective home. It should cover all of the major mechanical, electrical, and structural aspects of the house. A good building inspector will check the plumbing, both supply and drainage, to ensure that there are no leaks or problems. building inspection services
November 21st, 2011 at 3:28 am
a software project and I thought of sharing some of the documentation which resulted from the activity. Digital Agency Orlando
January 12th, 2012 at 8:25 am
online backup service Back-up, store and protect your documents with our online secured data back-up Service.
January 12th, 2012 at 9:07 am
cairns tours Last minute tours Cairns, Brisbane, Queensland, Great Barrier Reef, Perth, Gold Coast.
January 12th, 2012 at 9:17 am
building inspectors Melbourne Property Inspections specialize in building inspections and offer a broad range of inspection services including pest inspections in compliance with the latest Australian standards.