In response to feedback we received regarding the lack of availability of our UT licenses, we conducted user and team interviews, as well as reviewing the data and reports from UserTesting. One important question that surfaced was how often, at any given time, are 11 tests being run. The answer to that was significant.
We looked at daily test engagement beginning on 3/27/18 (when our licenses were turned on) through 8/14/19.
We concluded, and verified with a sample of designers, that the typical time frame for our testing scenarios was two to three days. This includes recruiting testers, setting up a test and running a test. This also means that there is prep work that needs to be done before a license has been allocated. When you get a license, you should be 80-90%ready to go. Keep in mind that you have access to your tests, results,recordings, etc. with the Collaborator license.
Bottom line: you need the Unlimited license only during recruiting, set up and running the test. At all other times all you need is the Collaborator license. Moving forward we will change the check-out time to 1-3 days.
Per usual, please give us feedback and let us know if we’ve missed anything. We can always make an exception if necessary, but we believe that a quicker turnover of licenses will give everyone the access they need with few compromises.
Thank you to the following designers who provided valuable input: Evan Daugherty, Nasser Elsamdisy, Amanda Dearinger, Avril Hsui, Johnny Tran, Claire Regan and Mia Park.
