Open Calgary Usability Test
In collaboration with the City of Calgary, my project group and I conducted usability tests using qualitative and quantitative measures in order to obtain information, such as user satisfaction, about the City of Calgary's Open Data Platform website. The City of Calgary officials asked students to not only conduct the tests, but also provide meaningful recommendations in order to further the productivity and usability of their site.
A screenshot of The City of Calgary's Open Data Portal website
Planning
Excerpts from our Test Plan
We created a demographic form, distributed to all of our participants, which helped gather general information about the kind of participations we used for the tests. For example, we asked about age, level of education, and level of comfort in using technology.
Testing
Before testing, we provided a consent form for our participants to sign and acknowledge. Furthermore, we created instructions that outlined exactly how moderators must conduct the tests in order to maintain consistency and avoid bias. This included the testing environment, the types of participants, and reading a moderator script.
Excerpts from our Final Report
Throughout each test, I measured task time and task completion as quantitative data, and System Usability Scale (SUS) scores and participation feedback as qualitative data. All data was recorded during the duration of the tests.
"I don't get it. Do I have to search again?"
- Participant 9a
Direct participation feedback collected (likes and dislikes for each task).
We recorded our gathered information from tests, for example, SUS scores, task times, and task completions via an excel data collection sheet that was accessible to all group members.
Our Recommendations
The recommendations we presented to the City of Calgary officials were based on the averages of data, such as SUS scores, as well as the consideration of demographic trends with particular participants, for example, task completion and time depended on comfort with technology and age.
Task completion (level of success), average SUS scores, and average task completion times presented visually through graphs.
We provided a final report to the City of Calgary officials, which included our test plan, introduction, methods, participants, measures, and recommendations for improving the overall user experience of the Open Data Portal website.
Recommendations from our Final Report

Explore More

Back to Top