I am currently involved in some usability consultancy for an intranet that is going through a major redesign. One of the tools we will use to decide on the sites new information architecture is card sorting.
At its core card sorting is probably one of the simplest, and yet most powerful ways of improving a site’s information architecture. It is valuable because it gives an insight into the users mental approach demonstrating how they sort and structure information within their own heads.
How to do card sorting
Simply label 20-30 index cards with headings from the various sections, subsections and pages of your website. Depending on the complexity of the site, you might also wish to include a brief description. It is also useful to number the cards so that you can more easily analyse the results of your test later.
It is also possible to start with no predefined headings but rather allow the user to specify their own section titles. Although this approach initially sounds good because it introduces no bias from the tester, the reality is that it can often be incredibly challenging to the user and so progress is often slow. Often it is better to have existing titles but encourage the user to comment on or change titles if they perceive it as appropriate.
Obviously, 20-30 cards will probably involve some considerable editing on your part but more cards than this can overwhelm the user you are testing. If it is necessary to cover more ground than this, it is possible to have some organisation already in place so that users are responding to an existing information architecture rather than starting from scratch.
Testing normally involves approximately 15 users and requires them to sort the stack of cards into piles that make sense to them. Often you also ask users to name these piles and this label is written on a post-it note that is then attached to the pile.
Card sorting approaches
Beyond this basic approach there are numerous ways you can structure a session however basically this breaks down into two approaches; quantitative or qualitative.
The quantitative approach uses card sorting as a data collection tool and is largely orientated around producing measurable statistics against which to judge. For example, it might establish that 83% of people placed the “contact us” section under “about us”.
Although the quantitative approach is perfectly valid, it is easy to prejudice the results and does not particularly help to understand the users’ reasons for the ordering. Personally, I believe more is to be learnt from the qualitative approach. Qualitative testing is a much more interactive and less observational allowing you as the tester to question the user and dig into some of the specifics of how they organise the deck. The aim is to encourage the user to articulate their thoughts and frustrations so you can understand their underlining approach.
What are your thoughts?
It is pretty obvious from this entry that I see a lot of potential in card sorting, but what is your opinion? Have you tried card sorting? Was it valuable? What works for you and what doesn’t? Do you take a quantitative or qualitative approach? I would love to hear your thought!