Version 13 (modified by mrphs, 6 years ago) (diff)

update on loc

Mission: Figure out the usability issues of Tor Browser and document them.

Location: Seems like we've a potential host at Georgetown University, DC.

Date: Early 2015 (Jan or Feb). The idea is to hold this ux sprint before winter dev meeting, so the output can be discussed there.


  • Put the list of attendees
  • Confirm date/loc
  • Send announcement to ML
  • Logistics
  • Change page title to UX sprint


Eliminating Stop-Points in the Installation and Use of Anonymity Systems: a Usability Evaluation of the Tor Browser Bundle
Greg Norcie, Kelly Caine and Jean Camp. HotPETS 2012.

Why Johnny Can’t Blow the Whistle: Identifying and Reducing Usability Issues in Anonymity Systems
Greg Norcie, Jim Blythe, Kelly Caine, L Jean Camp. USEC 2014.

Tor User Experience Report: Recommendations on enhancing the user experience of the Tor Browser Bundle
Jeff Mau, George Rosamond. ISC Project 2013.

Discovering What Your Users Know
Arne Renkema-Padmos. Includes sample consent form, questions, and researcher script.

A Needfinding Framework for Internet Freedom | Direct link to PDF

Understanding Internet Freedom: Vietnam's Digital Activists | Direct link to PDF

Notes and ideas

The first thing to do is to identify goals.

  • Find places where the current interface is hindering users?
  • Test proposed new user flows against current ones?
  • Give users an opportunity for direct communication with developers?
  • Give developers an opportunity to see how the software is used?

Then, identify which users will participate in testing.

  • English speakers?
  • Users who have not used Tor Browser before? Good if the goal is to find overall user experience flaws.
  • Users who already use Tor Browser? Good if the goal is to test new interface ideas.
  • Ideas for recruiting users:
    • Advertise at a journalism school.
    • Advertise at a university.
    • Contact activist groups.
    • Ask someone we know where the meeting is (a "stringer") to assemble some of their contacts.
    • Ask representatives of Open Tech Fund and Radio Free Asia for resources in the meeting city.
    • The translators on the Transifex mailing list are also users and many are interested in helping.

We should have specific goals and things we want to work on before assembling people to a meeting. Doing user testing takes more time than you think.

We have a great resource: monthly help desk reports. We can take the most common questions (or the most common answer templates) and treat them as the most pressing UX issues. We should invite members of the help desk to take part in the meeting.


  • "Cognitive walkthrough": Have a user explain verbally what they are thinking as they use the software. Demonstrate the idea for them on an unrelated application. "Now there are two buttons, I don't really know what they mean but the one with the arrow looks like the one I want, now it's asking for a username, it's probably the one I set up earlier..."
  • Make a video of the screen and an audio recording.
  • Present users with paper or wireframe designs. Good for short tests, only takes a few minutes, doesn't require a live computer running.

It's important for those taking part in the meeting to feel comfortable. It is intimidating to have a developer, an expert, present when you are using an unfamiliar interface. Nobody likes to feel stupid. It may be better to have someone not intimately involved with the software help guide the interaction. Non-developers should outnumber developers. Developers can be at arms' length; e.g., watch screencasts after the fact, in order to avoid influencing users during the tests. Even the "dev" in "Minidev" could be offputting if that's how we recruit users.

SimplySecure and SecondMuse offered to look over templates.

Tickets with the "tbb-helpdesk-frequent" tag:

Ticket Summary Keywords Owner Component
#5203 Setting Tor Browser as default browser does not work in Wndows 7 tbb-usability, tbb-helpdesk-frequent, tbb-firefox-patch tbb-team Applications/Tor Browser
#9675 Provide feedback mechanism for clock-skew and other bad problems tbb-3.0, extdev-interview, tbb-helpdesk-frequent, tbb-usability, AffectsTails brade Applications/Tor Launcher
#11406 UI for ExitNode country selection in tor-launcher tbb-usability, tbb-helpdesk-frequent brade Applications/Tor Launcher
#11506 Users are confused by the 2000-01-01 00:00 UTC timestamp tbb-helpdesk-frequent, TorBrowserTeam201601, GeorgKoppen201601, tbb-rbm, AffectsTails, gitlab-tb-tor-browser-build tbb-team Applications/Tor Browser
#12040 Please make a test connection to tor SOCKS port as part as Tor Launcher tbb-helpdesk-frequent tbb-usability brade Applications/Tor Launcher
#13775 Tor Browser won't open with OpenVPN tbb-helpdesk-frequent tbb-team Applications/Tor Browser

Attachments (2)

Download all attachments as: .zip