User Testing

Introduction

For this last milestone, the team conducted user testing primarily to gauge whether our current system (now named MIFresh) made sense conceptually to our users. Thus, our user testing was non-traditional in the sense that instead of focusing heavily on whether users could accomplish certain tasks, the team sat down with our users and talked about the concept and features behind our grocery store system. Users filled out a short pre-test survey, followed by a one-on-one demonstration and discussion about MIFresh’s various sections, and again concluded with a post-test survey. Special attention was given to users’ expectations, preferences, and suggestions. The user test was conducted in the physical location where our system would be implemented in order to create an imaginable scenario and environment for users.

In the Pick & Save, an urban grocery store in Detroit, we tested with our target population--urban residents shopping on a Saturday afternoon.

Goals for user testing

Our goal in user testing was to obtain feedback from Detroit grocery store shoppers about the overall features and functionality of our prototype. Would such a system encourage them to buy more fresh local produce? Testing usability was less important than finding out whether users would be motivated by a system where they earned points for buying local food. We also sought suggestions from participants on how we could improve our system.

Maureen is waiting for the user to accomplish some tasks.

User Testing Protocol

The protocol was developed so that the test would take no more than 1 hour. The test had three parts:

• Pre-test questionnaire - used to collect information on grocery shopping habits such as how many times per week the participant shopped and whether they used a grocery list.
• User Testing Questions - open ended questions testing whether or not users understood site features and desired these features.
• Post-test questionnaire - asked participants whether the system would encourage them to buy more local food and whether there were any additional factors that would influence them to buy more Michigan grown produce.

This lady believed that our system attracted her to shop more local produce.

Test Setup and Recruiting

On Saturday, November 15, 2008 our team set up a table at the front of a mid-sized Detroit grocery store and offered $20 to each participant. We were able to recruit 5 participants in total, 3 women and 2 men all African-American. We were specifically targeting low income people, and though we did not ask participants about their economic status, one participant did inform us that he received food stamps.

Participants were given the pre-test questionnaire to fill out. After the questionnaire was complete the moderator began the test, starting with the prototype for the large display followed by the kiosk prototype. Another team member captured notes during the test. Finally the participant was given the post-test questionnaire to complete.

Findings

On November 15, 2008 our team took the interactive prototype we created and tested it with five Detroit grocery shoppers. In general testing participants responded positively to the colorful photos of food shown on the large display prototype, saying that the photos of fresh-looking food would encourage them to buy produce in the store. Below are a few key findings based on our interaction with the participants:

• Clever things such as posting sports scores or using cartoon characters to draw in children could potentially attract attention to the display
• The concept of coupons was interesting to participants because they had prior experience using coupons.
• Using the system was much more convenient than cutting out coupons from flyers and the newspaper.
• Food pairs (common item paired with a less purchased/familiar product) was enticing, as long as the combined discounts were acceptable
• Participants did not think swiping their ATM, credit or EBT card was burdensome or problematic from a privacy perspective if they could get good discounts on food.
• That was the major appeal of the MIFresh was the cost savings.
• The MIFresh point system was understood by participants, but some were concerned about how much they would need to spend in order to obtain the points.
• Expiration of coupons and timing of EBT allocation would encourage buyers to stagger their spending throughout the month.

A brief summary of the pre-test survey responses are shown in the tables below:

3D Modeling