Meetup's Dead Simple User Testing


20 Responses to “Meetup's Dead Simple User Testing”

  1. barnaby says:

    Never in the article or any related links was any reference made to what Meetup is. It just seems like a bit of an ironic moment to mention something so radically, sensibly, user-friendly that it seems futuristic.

  2. hooeezit says:

    @CMALEK: Second that.

    I used Krug’s suggestions while building the (non-visual) user interface for an inside-building navigation aid (sort of an artificial guide). We used to put 3 users through the system every week and I used to update the UI every day.

    At the end of the process – about 6 months, we had a UI that people could learn to use in 5 mins and reach from point A to point B in an unknown building with 97% accuracy.

  3. dewexdewex says:

    @2 You use msn IM and get them to relinquish control of their desktop to you.

  4. Justin Razmus says:

    This just makes so much sense. A business that can immediately see the direct actions of it’s consumer, and also react immediately, is so far ahead of the common business model. With the instant access of the internet, isn’t it about time that businesses get on board with it, and work at the speed of modern technology? That is new business, and that is a model all of us business owners need to emulate.

  5. Gilgongo says:

    While I have no doubt that observing such tests and acting on their results is “dead simple,” I wonder about how simple it is to organise regular daily tests?

    Think about where you work: an hourly slot in your diary that would not be regularly cancelled due to no-shows of the test subjects or the inability to find somebody willing to attend (presumably in office hours – lunch break?). This would erode the faith of the organisation as to whether to turn up of course. I’d also hate to be the poor sap fingered to actually pull these punters in off the street, give them a coffee, keep ‘em sweet, be nice, etc. – even assuming the office is situated in some centre of normal human activity (and not, say, a desolate industrial estate). Herding cats comes to mind.

    I bet there is in fact a significant overhead in doing this that’s conveniently forgotten.

  6. misterfricative says:

    I applaud Meetup’s approach to user testing and feedback. But I decry their ‘salami approach’ website design, where they sucker you in and it isn’t until you’ve penetrated about 3 screens deep before suddenly it turns out they want your money. (To save you the aggravation of finding out for yourself, it’s 12 bucks a month minimum.)

  7. cshirky says:

    Gilgongo @ 11, that’s absolutely right, but these are the cultural obstacles I mentioned. The point isn’t “A business has to care about it’s users to be willing to pay attention to them” — that’s *always* true. The point is that the other obstacles in the way of that paying attention have become significantly less serious.

    Put another way, a company where employees are unwilling to listen to users has only its management to blame — infrastructure is no longer a convenient excuse.

  8. justanotherusername says:

    HUGE exception to the rule.


    It’s like Darwinism. It’s not the best solution that counts, it’s the solution that happens to out-compete the competition, no matter by what means. And in a capitalistic marketplace you automatically also get quantity before quality, short term before long term.

  9. bolamig says:

    meetup was pretty poor on usability for a long time, so they may need this kind of crash course to get up to speed. I can’t tell you how many folks tell me they can’t rsvp for my meetup after I give them the meetup URL, and all the public comments for my meetup look like they were intended to be private feedback.

  10. Anonymous says:

    how do you get the webcam to show the users screen?

  11. Anonymous says:

    There is an excellent description of this technique in Steve Krug’s book “Don’t make me think”. I have the book at all times at my hand’s reach. Even now.

  12. sketchyd says:

    I wonder if you could do in home usability testing with a similar set up. Have the tester download some basic screensharing software (even webex would probably work) and send them a free webcam and then ask them to walk through the site with you over the phone with the screencast.

    No on site visits required. You could also lower the fee you pay them, because, hey, free webcam.

  13. js7a says:

    Tesla was already honored with the SI unit name for magnetic field flux density in 1960. Naming two different units after the same person seems like it would not be conducive to good communication.

  14. arkizzle says:

    Slighly creepy, but I’m sure there is consent and adequete notice on the observed computer.. or indeed a great big farking webcam ponted at your monitor.

  15. Anonymous says:

    We use Morae to project the browser window and a webcam view. We also don’t just have product managers watch the sessions, but every singe person working on that project. The engineers, the product manager, the designers, and the customer support people who sit on the teams.

  16. cmalek says:

    See: Krug, S. (2005). Don’t Make Me Think : A Common Sense Approach to Web Usability (2nd Edition). New Riders Press.

    Krug spends a good portion of his book describing this methodology of user testing, calling it “Usability testing on 10 cents a day.”

  17. dewexdewex says:

    When I read stuff like this it makes me realise just how inventive I was nearly 10 years ago.

  18. mlas says:

    Terribly curious about this. Do they use a moderator/facilitator? Is there a script to follow? Are users given a task then left to fend for themselves in the room? how do they get so many people? Are they screened? Do they pull them off the street?

  19. Bloo says:

    I wonder if they do one other thing which is often great for usability/function – “eating your own dogfood”

    Long story (so I’ll omit details) – we used a mainframe e-mail/calendaring program from IBM (not Notes) which they produced but was a different program from the mainframe e-mail/calendaring that all IBM employees used since it ran on a different operating system. Many things were difficult to do with this product. Finally someone got their management agree to have the developers of the product use it for their daily tasks – you can’t *believe* how many improvements occurred within one year.

    Perhaps Meetup uses their tool for their own meetings?

  20. cshirky says:

    JS7A, Hurst mentions namespace clash in the piece I linked to. In addition, any thought that such naming overlap can be avoided should be cured by a quick trip to, which already lists “Technical Standards for Library Automation” and “TeV-Energy Superconducting Linear Accelerator.”

Leave a Reply