from Hacker News

SHOW HN: MobileUserTests.com

by djjose on 5/20/11, 3:03 PM with 5 comments

Hi folks! As we have been building mobile apps we came across an interesting problem for testing our apps, specifically around usability testing. The process in getting our friends' and people we know UDID's for iOS app testing was cumbersome and the results of the tests weren't great (friends are very unlikely to tell you your app sucks). Getting non-techie people to install a package on their Android phones is also a challenge. And even if you can actually get past all these phases you need to get their feedback somehow (either a phone call or back and forth emails). Wouldn't it be incredibly helpful if you could actually see what these people were doing when they used your app? We thought so too. So we're offering a service to allow companies and devs to have complete strangers test their apps, specifically usability test them. All you need to do is give us a scenario and list up to 5 tasks you want the user to accomplish with your app. You'll receive a video of a user using the app performing the tasks you've outlined.

I'd love to hear community feedback on this service. Are there features or other things you'd like as part of this service? Is this as painful for you folks as it has been for us?

  • by spokey on 5/20/11, 5:42 PM

    I think this could be a valuable service, but $99/test seems quite high (compared to similar services targeting desktop instead mobile users). At $500 to run Nielsen's recommended 5 person test, running my own tests starts to look like a viable substitute for your service (considering I'm likely to want to run more than one round of tests).

    I think this is true at both ends of the scale: Startups will compare this cost against guerrilla testing techniques (e.g., sourcing testers on fiverr, asking people on the street, or inviting them into a lab for a hour for a small reward). Large firms will compare the value of this service to hiring a more high-touch UX firm (or building this competency internally) that does much more than record test sessions.

    For what it's worth, here are some questions I have as a potential buyer:

    * How long are the test sessions in general?

    * How are the tests "facilitated", or more to the point, what happens if testers don't understand the task instructions or can't get the app to run?

    * How are you sourcing testers? Can you quantify their demographics? Can you provide testers that meet specific demographic profiles?

  • by AyeAye on 5/20/11, 4:36 PM

    Can actually see us using this shortly after we launch Eventabber. Great product! Feel free to call us at 1-626-88TABIT if you want to get complete feedback for use of this product.

  • by kodeshpa on 5/21/11, 6:48 PM

    Your product is very costly. Usually companies post on craig list for beta testers & approximately spend $20-$50 per user depends on product.

  • by djjose on 5/20/11, 3:06 PM

    here's the link for people that just like to click like me. :) http://www.mobileusertests.com