Testing Plan

Purpose & Research Questions

Our app is designed based on the card game Pokemon, for ages 6 and up. The goal of this test is to evaluate the intuitiveness and ability to track your card (and its value) in your collections. These are our highlighted questions:

• Are the features we build for our users engaging & informational enough?
• How intuitive is it for users to navigate across the app, create collections and track the cards?
• What improvements can we provide for users to have better experience?

Data to Collect

Demographic Data

• Age, Occupation & Familiarity with Pokemon: Collect basic qualitative data and users’ familiarity with Pokemon

Quantitative Metrics

• Task Completion Success: See if the users will be able to complete tasks without guidance
• SEQ (Single Ease Question): Handle Single Easy Question after each task and evaluate the overall perceived difficulty that ranges from 1 to 7 (very difficult to very easy)
• SUS (System Usability Scale): A Likert scale to quickly and reliably measure the perceived usability

Qualitative Feedback

• User Feedback: Collect qualitative data through interviews and open-ended questions to gather users’ suggestions and experiences

Test Procedure

Qualitative Questions

• What improvement would you suggest?
• What was the most enjoyable part/feature of this app?
• Were there any confusions and frustrations when using the app?

Task Series

Users will be asked to complete the following tasks:

1. Create two collections
2. Search for a Pokemon of your liking (ex. Pikachu)
3. Pick any cards of your liking, view its detailed information and add it to any Collections (any amount of cards)
4. Navigate to the Graph Screen and switch between Collections of your choice
5. View your Most Valuable cards in your collections
6. Remove any card from your collection and View your Recently Added cards

Measurement: After each task, we will be using Single Easy Question (SEQ) and System Usability Scale (SUS) after all tasks have been completed by the user.

Observation: We will be observing the user in order to see their behavior and assist if any confusions appear.

Post-Task Interview

After the user has completed all the tasks, we will conduct a brief interview to ask previously stated Qualitative Questions to gain more insights for user experience and improvements.

Data Visualization

• Age, Occupation & Familiarity with Pokemon: Will be showcased in a form of a pie-chart
• Task Completion Success: Displayed as a stacked area chart where the x-axis represents the task and the y-axis the success rate
• SEQ: Displayed as a boxplot to visualize the average SEQ scores for each task
• SUS: Will be shown by using a boxplot to show the distribution of SUS scores
• User Feedback: Summarized in a word cloud and tables in order to highlight similar opinions