Competitive Benchmark Test
We perform Competitive Benchmark Tests for clients seeking to determine how well their product or website performs against their competition from a usability perspective. This type of testing consists of asking users to perform identical tasks on our client's product or website and on those of one or two competitors. Detailed timings and task completions are noted for all individual tasks. Video cameras capture the users' experience while usability analysts electronically log user comments and actions.
During the testing sessions, users are asked to complete surveys in order to capture their satisfaction with each product or website and to gauge how all of the products or websites compare. After testing is concluded, usability analysts examine all data, present comprehensive performance evaluation of each product or website, and determine "Best of Breed" characteristics of each product or website tested. Often clients require a study of competing products or websites with less emphasis on tasks and timings and more focus on likes/dislikes of each product or websites.
Typical Competitive Benchmark Test Project Structure
- Number of Users: 12 - 15 users
- Number of Competing Products: 2 - 3
- Number of Testing Days: 4 - 5 days
- Recommended Stage in Development Cycle: Working prototype or fully functional product or website
Competitive Benchmark Test Deliverables
- A report consisting of an executive summary, user comments, survey results, task timing/completion analysis, general perceptions of each product, and "Best of Breed" recommendations is provided
- We also provide digital video recordings of each test session that display picture-in-picture of product or website and user
- A Highlight CD is available including video clips from testing covering three to five important topics
- We supply the report and video within 6 business days. The Highlight CD is available within two additional days
Contact Us for more information or to schedule a Competitive Benchmark Test.
