Usability Testing Tools

Intro

As you’ve probably read that a million times, – and rightfully so – users are the ultimate judges of your design. One of the best and most common ways to test your design on actual users is usability testing. In this article, we’ll go through the tools that will make it easier for you to hold usability testing sessions starting from recruiting to creating protocols and uncovering insights.

Let’s dive in. 

Recruiting Users

In order to test your design on users, you need users (duh). In an ideal world, your customer’s product team would help you get your hands on some, but that’s not always the case. 

Sometimes, there’s no easy way to access users, or perhaps the product is in very early development stages, so there are simply no users to speak of. Whatever the reason, you need to take matters into your own hands and find potential users yourself.

Here are a few ways you can do that:

• Facebook and LinkedIn. Users of tools similar to yours often have groups in different social media channels. Consider either creating posts in such groups, or reaching out to individual persons. 

• Upwork. You can create jobs for almost anything on Upwork. Consider creating a job on Upwork for a specific demographic of freelancers, e.g. “Looking for US-based single people under 30”. We, at Adam Fard Studio, use Upwork most often when it comes to looking for potential users.

• Respondent.io. Respondent.io is one of those specialized platforms that connect you to potential users. The app would work best for b2b research since it features such demographics as business owners, marketers, executives, etc. with relatively high compensations. This platform charges 50% of your financial incentive, so for each 100$ you spend to compensate respondents for their time, you’ll get charged $50 as a fee.

• Userinterviews.com. The tool boasts to have more than 400 k potential participants, which is great for b2c research, as such users are easier to come across. The platform either charges your 40$ per interview or a monthly fee of 250$ for a maximum of 15 interviews. 

Incentives

Incentives are an extremely common practice in usability testing. That’s how you compensate users for their time. While in the case of userinterviews.com, respondent.io and Upwork incentives are purely monetary, you can be a little more creative with other resources. For example, as a reward, you could grant respondents a premium subscription to your app for a certain time period. That way you’re creating a win-win situation.

Qualitative Analysis Tools (Interviews)

Now that we’ve found users through a variety of mediums, we could start thinking about infrastructure. It’s worth noting that some of the tools, like Upwork, have their own native messengers, so this section will be most relevant to users sourced through the unspecialized channels like LinkedIn.

Video conferencing apps.

We all know the leading tools for video conferencing, and they probably don’t need an introduction, but here are a few:

• Zoom. Just be mindful that the free version allows having calls that last for up to 40 minutes. Usability testing sessions are rarely longer than that, so that should be enough. It also has a native functionality of recording calls, which is very handy.

• Skype. No time restrictions here. Recording calls is also here. The only downside is that – in our experience at least – Western users rarely know of this tool, which forces them to download an extra app on their device.

• Google Meet. We personally use Google Meet the most, as it’s possible the most simple and convenient tool that easily integrates with Google Calendar. The only issue we found with this tool is that recording only works for calls with people in the same organization, which is rarely the case with users.

Recording the calls

It's very common to record the usability testing sessions to make sure you don't miss any critical feedback. Many conferencing tools like Zoom and Skype already have that feature. However, if you're using a tool that doesn't support native recordings, there are third-party screen-recording apps. Loom is the one we use. This app’s free version used to be a saver for a while, as it allowed recording your screen for as long as you like. Currently, the free version only allows for up to 5 minutes of recording time. The premium version costs 10$ for monthly billing or 8$ a month for yearly billing (96$ in total).

Speech recognition apps 

We wanted to briefly go through speech recognition apps, as we don’t see other designers use them too often. That’s a shame. These apps pretty much create usability testing protocols for you, since in a protocol you should use your users’ quotes as much as you can to avoid bias and speak your users’ language. Normally protocols take a lot of time since you’d need to rewatch the whole interview again while manually transcribing some parts of the conversation.

The tool that we’ve used is otter.ai. It charges 30$/month per user for a business plan or 600 free recording minutes for individual users per month. You could also upgrade the individual plan for $100 a year, or $12.99/month.

There are some other tools on the market but we didn’t list them here, as we’re not sure how usable they’re going to be in the usability testing environment. You’re welcome to explore other options.

Software for Quantitative Analysis

Unlike the tools we’ve listed above, the apps below help you analyze large amounts of information that’s aggregated over time. That's not to say that you can quantify the results of a usability testing interview. We've written a whole article on measuring usability if you're curious.

To be perfectly honest, we don’t use even ¾ of the apps listed below, since their functionalitly overlaps, but these tools are on the market, so you ought to know.

• Google Analytics. This tool is probably the most famous. It's also free. Google Analytics provides a wealth of insight into where the users are coming from, what the conversion rates are, and other relevant information.

• Crazy Egg. This app gives you heatmaps for your web products, allows you to watch recordings of your product being used, and a/b test. The price varies from $24/mo to $249/mo depending on the number of pages you’re tracking.

• Optimizely. This tool allows you to experiment with any variables and functions. The pricing isn’t public, so you’d need to contact their sales team directly.

• UserZoom. Tracking UX metrics, testing design decisions. The price ranges from $250 a year to $1000. 

• Five Second Test. The name speaks for itself. You’re giving a user a certain piece of design. This user has 5 seconds to glance over it. Then the app measures what the user managed to recall. The pricing ranges from $50 per test for upgraded testing to 199$ a month per seat. 

• Qualaroo. This tool allows you to ask questions in context, i.e. on the pricing page. The yearly price is 960$ for a basic plan and $1920 for a premium one.

• Usabilla. Similarly to Qualaroo, this tool is about collecting real-time feedback. The pricing starts at  €10,000 a year.

• User Feel. This tool allows searching for usability testing participants, and record users while they use your product. The app has its own currency (credits). 1 credit is worth $59, which is also equivalent to one interview.

• Try my UI. SImilarly to other platforms, you can find users and interview them through the platform. The pricing ranges from $99/mo to $5000.

Outro

Designers are more than their tools. And yet, a good set of apps and services for usability testings will help you save time and get better insights. We hope that with the help of this article, you’ve discovered your next can’t-live-without app.