{"id":6342,"date":"2015-03-24T08:34:13","date_gmt":"2015-03-24T15:34:13","guid":{"rendered":"http:\/\/proxystudio.uxpin.com\/?p=6342"},"modified":"2026-03-03T16:18:47","modified_gmt":"2026-03-04T00:18:47","slug":"moderated-vs-unmoderated-usability-testing-better","status":"publish","type":"post","link":"https:\/\/www.uxpin.com\/studio\/blog\/moderated-vs-unmoderated-usability-testing-better\/","title":{"rendered":"Moderated vs. Unmoderated Usability Testing: Which is Better?"},"content":{"rendered":"

When it comes to usability testing, one of the most important decisions you\u2019ll make is whether someone should moderate the session.<\/p>\n

So which one should you choose? Read on to learn the pros and cons of each.<\/p>\n

If natural user behavior generates the most accurate usability data, then of course testing should be unmoderated, right? But if that data is unfocused and misdirected, then won\u2019t you want to moderate the tests? In that case, aren\u2019t you then biasing the results with someone else in the room?<\/p>\n

You\u2019ve probably heard of the observer effect, even if you don\u2019t know it by name. It\u2019s the idea that people being observed act differently than when they\u2019re alone. While this is a highly documented phenomenon, this should not be the only influence on whether or not to use a moderator.<\/p>\n

Budgets, schedules, manpower, the types of tests, the necessary data \u2014 these are the more important considerations we discussed in the Guide to Usability Testing<\/a>.<\/p>\n

Let\u2019s dive deeper so you can make the most informed decision.<\/p>\n

Moderated Usability Tests<\/h2>\n

It\u2019s true, moderated tests give you more control. Moderators can answer any immediate questions posed by the user, and guide the test to meet the goals of the study.<\/p>\n

Of course, moderated tests require a moderator \u2014 someone with people skills and knowledge of the product to keeps things running smoothly. This also means more difficulty in scheduling with the user and restricting at what they take the test. If you\u2019re conducting the test on-site, this will require even more resources, and make it harder to recruit participants willing to go out of their way.<\/p>\n

On the plus side, many of these difficulties are eliminated through remote testing. This tactic allows users to take the test where they want, and gives them some leeway with scheduling, while still giving you some of the control.<\/p>\n

Because moderated testing requires more effort, it is highly recommended in the earlier stages of design. When you\u2019re working with concepts and prototypes, you definitely want to be able to ask the follow-up questions to your users.<\/p>\n

We agree with this advice from UserTesting<\/a>:<\/p>\n

1. Incomplete or buggy interfaces \u2014<\/strong> In other words, early-stage prototypes. If you\u2019re testing a product that risks confusing the user, you need a moderator to help answer questions and guide them through. While this may seem uncommon, starting a usability test as early as possible is always a good idea.<\/p>\n

2. Complex interfaces \u2014 <\/strong>If your product has a high learning curve, a moderator can salvage a test that might otherwise yield no useful results. For example, a moderated test makes sense for products that don\u2019t always have a linear sequence of steps to accomplish tasks.<\/p>\n

3. Products with security concerns \u2014 <\/strong>While rare occurrences, if you\u2019re testing a product with access to data that you don\u2019t want public, a moderator will keep the user where they belong \u2014 although there are other ways to restrict access in this scenario.<\/p>\n

Remember that moderated and unmoderated testing are complementary, not competing. For example, you can run a moderated test on your prototype, then iron out any major usability issues. As you finalize your product, you can then run an unmoderated test to gauge how it performs \u201cin the wild\u201d.<\/p>\n

When you’re ready to get started, make sure you follow Jeff Sauro\u2019s 20 tips for moderated usability testing<\/a>.<\/p>\n

Unmoderated Usability Tests<\/h2>\n

Unmoderated tests<\/a> are cheaper and easier to quickly recruit more users. Let’s take a practical look at the pros and cons.<\/p>\n

\"Unmoderated<\/p>\n

Source: UserZoom<\/a><\/em><\/p>\n

Benefits<\/h3>\n