Infomaki: An Open Source, Lightweight Usability Testing Tool

30 Nov 2009 / PE

Infomaki is an open source “lightweight” usability testing tool developed by the New York Public Library to evaluate new designs for the NYPL.org web site and uncover insights about our patrons. Designed from the ground up to be as respectful of the respondents’ time as possible, it presents respondents with a single question at a time from a pool of active questions. In just over seven months of use, it has fielded over 100,000 responses from over 10,000 respondents.


User Surveys on the Web

28 Jan 2009 / PE
Look me in the eye
Then tell me that I’m satisfied
Hey, are you satisfied?
— The Replacements, “Unsatisfied”

What is a reasonable target for user satisfaction with a web site?

We did a user satisfaction survey last year and found that 14 percent of respondents felt that our web site didn’t measure up to their expectations.

This year, we have an incentive goal of reducing that number to 8 percent, not based on evidence that any web site has ever achieved a number that low, but based on the opinion of the company that did the survey that anything over a 10 percent dissatisfaction rating is always bad.

Or to flip it around, we’re trying to achieve a 92 percent approval rating.

I wish we hadn’t set the bar quite that high. I don’t want to be a pessimist but not only is that considerably higher than, say, Google (at 78 percent — and what’s not to like about Google?), it’s also higher than Santa Claus, crack cocaine and oral sex . . .

Audio clip: Adobe Flash Player (version 9 or above) is required to play this audio clip. Download the latest version here. You also need to have JavaScript enabled in your browser.


Things That Pop Up and Poke You in the Eye

23 Jan 2009 / The Programmer

We’re discussing whether our organization will use a popup user survey on our web site . . .

Tired of Pop-ups like this one?

“I propose doing the survey without the popups,” I say. “That’s why browsers have popup blockers, because people don’t like popups. A popup is like a poke in the eye. I don’t like it when things pop up unexpectedly and poke me in the eye. Whenever that happens, I make sure not to go back to that place anymore.”

Unfortunately, no one picks up on the “popped up and poked me in the eye” motif because I was then going to chide them for their junior high school mentality.

“I had a teacher who used to say that,” a young woman says. “‘It’s better than a poke in the eye with a sharp stick.’”

I say, “I used to work with a guy who said, ‘You can’t beat that with a sharp stick.’ Why would the stick have to be sharp if you’re going to beat someone with it? You’re really just looking for something with a little heft to it.”

The same woman says, “I had a boyfriend who used to say, ‘You’re not going to hold that over my shoulder, are you?’”

“You have abysmal taste in men.”

 

I wasn’t able to persuade the team to abandon the popups. The argument in favor was that a lot of web sites use popup surveys so how bad can they be?

I worked for a dot-com consulting company during the boom and bust of that industry. The whole thing was based on the notion that everyone else is doing it so it must be a good idea.

The subsequent implosion of the entire industry disproved that theory rather dramatically.

Since then, I try to stay open to the possibility that even though a lot of people are doing something, it still may not be a good idea . . .

Thus spoke The Programmer.