Open Calgary Usability Test
In collaboration with the City of Calgary, my project group and I conducted usability tests using qualitative and quantitative metrics such as user satisfaction, task time, and task completion on the City of Calgary's Open Data Platform website.
The City of Calgary officials asked students to not only conduct the tests, but also provide meaningful recommendations in order to further the productivity and usability of their site.
We created a demographic form distributed to all participants, which helped gather general information about the kind of participations we used for the tests. For example, we asked about age, level of education, and level of comfort in using technology.
Before testing, we provided a consent form for our participants to sign and acknowledge. Furthermore, we outlined instructions on how moderators must conduct the tests in order to maintain consistency and avoid bias. This included the testing environment, the types of participants, and reading a moderator script.
Throughout each test, I measured task time and task completion as quantitative data, and System Usability Scale (SUS) scores and participation feedback as qualitative data.
"I don't get it. Do I have to search again?"
- Participant 9a
Recorded results from tests: SUS scores, task times, and task completions.
The recommendations we presented to the City of Calgary officials were based on the averages of data, such as SUS scores, as well as the consideration of demographic trends with particular participants.
For example, task completion and time depended on comfort with technology and age.
We provided a final report to the City of Calgary officials, which included our test plan, introduction, methods, participants, measures, and recommendations for improving the overall user experience of the Open Data Portal website.