Library Website Usability Sessions

Student library UX workers and I facilitated 14 usability sessions on the Libraries’ website in late September in order to learn whether changes made to the site over the summer are intuitive for users.

We began each session by asking basic demographic information, the user’s year in school or college affiliation and general areas of academic interest. We also asked if they had ever used the site before and followed up by asking “why-or-why-not?” (And it was at this point we learned that many Swarthmore students think that the Tripod catalog and the Libraries’ website are the same thing…)

We ended each session by asking about impressions of the site, what works, what does not and what could make it better.

In between these opening and closing questions, facilitators used scenarios which prompted users to accomplish at least one (but not all) of the following tasks using the site:

  • Find different kinds of research help
    • Find citation help
  • Get access to popular resources: the New York Times and The Economist
  • Find space for quiet study and group study spaces
    • Reserve a group study
  • Borrow Technology
  • Discover what online resources are available to Alumni
  • Find information for visitors: hours, use of computers, printers, scanners, and group study rooms.

Here is what we learned:

Research Help + Citation Help
We captured 9 sessions using the Research and Citation Help scenarios. While eight of the nine users ultimately had success finding at least one kind of research help using the site, only one user, a librarian, began at the Get Help page.

Alternate successful paths to research help were via:

  • a link to Research Guides within the Tripod search widget
  • the Chat button
  • Support for Research + Teaching>for Students

Duplicate paths to information can be great, but since students did not use (or maybe see or understand) the Get Help link, we’re considering adjustments. We may change the label (after testing out suggestions for something more intuitive) and we may consider integrating the Get Help content with overlapping content on the Support For Students page.

An unexpected outcome of this task was to learn that many students equate finding resources with getting research help. If a user begins with this understanding, choosing the “Find Resources” link instead of “Get Help” makes perfect sense, but the result is that students overlook or remain unaware of the variety of library support available outside of the Tripod catalog.

More than half of the users began this task with either a Tripod catalog search or via the Find Resources link in the site navigation instead of Get Help. A majority of them probably would not have discovered information about the kinds of research help from Librarians or Guides for which the scenarios were designed except for being encouraged to seek it due to the context of the usability session.

There was only a 50% success rate for the citation help task. If the user began seeking research help by looking for resources, they were not successful in finding citation help on the site.

Additionally, these unsuccessful sessions demonstrated that anyone who searched the entire College website (via the site search magnifying glass) using the term “citation” or “citations” was not successful. Instead, top results for these queries on the College site are for the Writing Center, academic departments, and even the Public Safety Department. (Parking tickets!)

We’re adjusting our headings in hopes of having citation help from the libraries appear as a top result in a search of the College website, but the problem raises an additional structural issue that affects library site usability: a lot of library help is in LibGuides, and as a result is not exposed to a site search within swarthmore.edu.

The citation information on the Writing Center website is quite good although not as thorough as what the Libraries’ offer (via LibGuides.) Is there any opportunity here to collaborate with the Writing Center by linking to one another’s information?

We’re also exploring the feasibility of a technical solution that may pull LibGuides content into a swarthmore.edu site search.

Find Popular Resources
We captured 7 sessions of this task beginning with getting access to the New York Times. Three users had success via the Popular Online Resources page. Another three tried a Tripod search for the Times, but only one of these had success getting access. One user could not get access to the Times at all.

The Popular Resources page is a help to those who find it, but it’s buried in the navigation. A hover menu would be a big help.

Library Space
We ran this task in four sessions and each user had success.

Borrow Technology
We ran eight instances of this task with mixed results. The information is on the Support for Students page, but underneath the rather confusing heading “Need Something?”

Since many users were looking for the information on the Borrow + Request page, I added it there and it had an immediate effect.

Overall, six users were able to find the information, (some after I had changed the site) but three were unable to find it even after the change.

A common response to this scenario was “I already know the libraries lend chargers and I would just go to the desk and ask for one.”

Alumni + Visitor tasks
Users were mostly successful with these tasks, but whenever they were not, it was due to the information being organized into Drupal link-list-panes. If the user chose the wrong link, they did not return to the list in order to accomplish the task.

As a result, we have plans to reorganize the information out of the current combined page into separate pages, one for Alumni and another for Visitors.

Larger Issues
Many of our users are confused by the interplay of the Libraries’ website and the Tripod catalog. Additionally, usability of our website suffers from being unable to provide hover menus that expose the extent of our content at a glance.

While we may be able to address Tripod issues and branding with our Trico partners, the path to resolving functional and structural limitations at the College is not as clear. Meanwhile, we’ll continue to make changes to the navigation within the structure we have and continue testing for usability.

Space exploration, or, UX on-the-fly

This semester I’ve noticed frequent evidence of science-y stuff happening on the big whiteboard that’s outside my office as I arrive at work each day. The content is striking because my office is in the Humanities and Social Sciences Library and we have a recently renovated Science Library nearby.

I’ve noticed groups of students working on science projects in this space throughout the day, so decided to start asking them why they are choosing to work here instead of the science library.

The first student I asked was working out a chemistry problem on the whiteboard. He said he chooses the space because it’s a little quieter and because the science library “has a pretty overwhelming STEM vibe” that makes him uncomfortable.

But my direct question seemed to make him feel uncomfortable too and I worried later (especially after noticing the beautiful chemistry symbols erased from the whiteboard) that I may have made him feel as if he didn’t belong. Note to self: leave brief reply cards in this area and collect the information anonymously and more voluntarily! I’d love to know more from this student. What did he mean by the uncomfortable STEM vibe? After all, chemistry is a STEM subject.

I next approached a group of three students hard at work on a science project in this same space and inquired what draws them here instead of the Science Library. Their answer was different: they meet together every Wednesday morning and come from different places. This space is the most centrally located.

However, they added that the group spaces in the Science Library are not as conducive to their work: spaces there are more open and the group feels more exposed than they like, plus it’s generally louder over there.

This particular spot is about to disappear as a result renovation this spring (hence the empty stacks) but it’s interesting to note the aspects that make it appealing:

  • it’s centrally located
  • quiet-but-not-silent
  • has a large whiteboard
  • is enveloped by tall stack ranges on either side of a spacious work table which help create privacy and a more enclosed feeling (maybe like a little hug from the libraries? I can hope!)

As we think about library space, we gather lots of quantitative data: how many students use a space, what they use the space for, what kinds of equipment they use, what times of day and night are more crowded, how much space we need for collections, how to balance desires for quiet with the need for group work space. It’s important to remember to gather qualitative data from a broad spectrum of users too.

Now about those anonymous, voluntary reply cards…