Usability Testing Hard to Recruit Users
A September 2025 Hacker News thread on AI-powered user testing collected reports of participants rushing through tasks for pay without engaging with the interface, followed by hours of recording review to extract a handful of usable observations. That’s the downstream cost of substituting available participants for the right ones. Usability testing hard to recruit users runs into this structurally: the specialists your product was built for are rarely in panels, and participants who fill in behave differently enough that most findings don’t transfer.
Why Generic Panels Fail for Specialist B2B Products
Panel participants are available because they have time for paid tasks. The professionals your product targets generally don’t. Even when they do, panel screening can identify that someone works in finance or healthcare but can’t replicate the mental model, workflow habits, or domain familiarity your product was built for.
A 2025 user research industry report found that 48% of researchers named recruiting the right participants as their primary challenge. For teams building products for specialist audiences, that number understates the problem: a panel can surface someone with a matching job title, but not the domain context, workflow habits, or decision-making patterns your product depends on.
Why Generic Participants Don’t Give Useful Feedback on Specialist Products
When no qualified participants exist in standard channels, teams lower their screening criteria: adjacent professionals, general business users, anyone who clears a brief role filter. The findings that come back reflect the substitutes, not the target users. A logistics coordinator evaluating a dispatch interface reads the labels differently, anticipates different failure modes, and notices different friction than a general participant simulating the role. The finding set is shaped by who participated, not by who the product was designed for. Product changes made on that basis solve for the wrong user.
How to Run Usability Testing on Hard-to-Recruit Users Without Panels
AI personas configured with domain-specific context remove the recruiting step. Instead of finding a clinical coordinator who will participate in your test, you configure a persona that thinks like one: with the role knowledge, workflow assumptions, and domain familiarity of that professional type. The persona navigates your product in a real browser, not a mock or static analysis, and returns structured findings on where it hesitates, gets confused, or drops off.
A persona labeled “healthcare professional” behaves differently from one built with a specific role, decision-making context, and familiarity level with the product category. The more specific the persona context, the more the findings reflect what your actual target user would experience.
Tessary lets you configure domain-aware personas and run them against Figma prototypes or live URLs.
A PM building a compliance dashboard for regional banks can set up a persona with the regulatory context and workflow habits of a compliance analyst and get findings in minutes, without locating, scheduling, or compensating a real participant. The persona approach removes the recruiting barrier without changing what you’re testing for: friction, confusion, and drop-off in the flow your target user would navigate.
For a broader look at why generic testing approaches fail on specialist products, see Usability Testing Complex B2B Products.
When to Run AI Personas vs. Moderated Sessions
| AI Personas | Moderated Sessions | |
|---|---|---|
| Speed | Minutes | Days to weeks |
| Best for | Sprint-cycle friction, pre-handoff validation, iterative checks | Edge cases, lived experience, institutional context |
| Availability | Any time | When recruiting permits |
Personas work best for iterative testing. The moderated alternative often doesn’t exist for teams in specialized verticals: there are no panels for compliance analysts, dispatch coordinators, or clinical staff, and recruiting timelines collapse into the sprint. Moderated sessions are still worth scheduling when the right participant is available; they address edge cases and lived experience that persona runs don’t cover. The practical pattern is to run personas across sprint cycles and schedule real sessions when recruiting permits.
Tessary’s free tier covers three test sessions a month, with no credit card required. Try Tessary →
Written by
Tessary · AI Usability Testing
Tessary runs AI personas on prototypes and live URLs to surface usability friction in minutes, not weeks. Editorial posts on AI usability testing, persona design, and B2B SaaS research economics.