About PRWD

Usability and technical development agency specialising in:

  • usability evaluations
  • usability benchmarking
  • usability training (public/in-house)
  • user-centered design processes
  • web development
  • software development
  • rich internet applications
  • Magento e-commerce platform

Recent Case Study

User Testing Case Study

Isabella Oliver
  • in-depth user studies in the lab
  • comprehensive usability report delivered

view the case study

Training

Advanced Google Analytics Training


view full training details


Search

Posts Tagged ‘user research’

Case Study – Intranet Usability Evaluation for The Hyde Group

0 comments

PRWD have delivered exactly what was required of the project and done so in an extremely efficient way.

The information gained from respondents, both qualitative and quantitative, helped to reinforce the need for change and gave a clear direction for travel.

David Boardman, Communications Director

Objectives

Provide usability consultancy and user research to identify improvements to Hyde Housing’s intranet system, Hydewide.

This was the first such research carried out on the usability of Hydewide, and would form a major part of the future development strategy for the intranet.

PRWD were asked to conduct a range of qualitative and quantitive research into the usability of Hydewide, in order to produce a report detailing potential usability improvements.

Background

Hyde Housing Group is one of the UK’s largest housing associations, managing over 43,000 properties, principally located across the South of England. Hyde employs over 1,600 staff, based at their Head Office in London and at branch offices in a wide variety of locations. Hyde also coordinates with local and national government agencies.

Hyde’s intranet system, Hydewide, provides vitally important information to staff members and helps to keep staff across the group in touch with each other and with the latest developments. Prior to PRWD’s involvement, the intranet had grown organically with no user testing or usability analysis.

What We Did

PRWD carried out extensive user research, using the following methods: -

  • Interviews and user testing, with employees from across the group
  • In-depth questionnaire sent out to all employees
  • Expert evaluation of Hydewide, carried out by Paul Rouke

The interviews involved visiting several locations, including London, Peterborough, Southampton and Brighton. The staff members interviewed held a range of different positions within the group and had different perspectives on the usability of Hydewide as it related to their role. The interviews involved building trust and confidence, ensuring that all interviewees offered their thoughts. Where possible, interviews also included ‘guerilla’ user testing, where users carried out simple tasks using Hydewide in order to identify problems.

The questionnaire was designed in collaboration with Hyde’s Communications Department and the internal Communications Champions, staff members who have special responsibility for supporting change and improvement within the group.

The expert evaluation was based on a comparison of Hydewide to industry-standard best practices, identifying weaknesses in the concept, design or implementation of the intranet.

Finally, all these findings were collated into a detailed report and presentation for Hyde’s executive management team.

Results and Next Steps

The questionnaire received a response rate in excess of 20%, and along with the enthusiastic response of staff members in interviews, provided valuable feedback from Hydewide users. Many of the findings from user feedback were supported by the expert evaluation, which identified many similar improvements and others beyond.

The final recommendations were divided into three categories, based on the extent of work required to implement them – quick wins, improvements and new developments. This provided immediate actions to be taken, some of which were implemented immediately.

The report now forms part of the plan for future development of Hydewide, and the process of staff involvement has ensured that staff throughout the business are fully behind the planned changes.

Client Testimonials

PRWD have delivered exactly what was required of the project and done so in an extremely efficient way.

The information gained from respondents, both qualitative and quantitative, helped to reinforce the need for change and gave a clear direction for travel.

The reporting enabled us to highlight quick wins together with a vision for longer term improvements.
The feedback from the people who were involved in the analysis was extremely positive. They all felt that Paul and Rob were approachable and really understood their needs.
The resulting report was presented to the senior managers and the recommendations approved.

It was a pleasure working with PRWD and I would highly recommend them to add value and deliver real results.

David Boardman, Communications Director

It was especially useful to get feedback from the interviews as colleagues seemed to be more
candid with PRWD so hopefully gave a real insight and so will appreciate changes made even more.

PRWD’s professionalism and knowledge has made this project a pleasure to undertake and I am confident that the resulting information will prove invaluable to the development of our intranet.

Ruth Appiah, Communications Manager

Further Information

You can download a pdf of the usability case study for the Hyde Group, and if you would like more information on our usability services please give us a call on 0161 918 6729.

Tips for User Testing and User Research

0 comments

User Testing

An integral part of gaining end user insights into how well (or poorly) a website, intranet or application has been designed, user testing can be carried out in 3 main ways.

  • Laboratory User Testing – this is the traditional approach which involves using a testing ‘lab’ which has a one-sided mirror, video recording facilities, a viewing area and other more advanced features
  • Guerilla User Testing – this is simpler type of testing which doesn’t involve special labs, equipment and facilities, and is suitable for when there is very limited budget and you want to gain first hand insights from people using your website/application to carry out certain key tasks and and objectives
  • Real Time User Testing (during one-to-one interviews) – this is typically carried out as part of meeting staff within an organisation when you are reviewing a company intranet

We have spoke about guerilla user testing at the How Do event last year, on 3 key ways in which you can improve online performance.

For more information on real time user testing, read on…

User Research and One-to-one Interviews

There are many reasons that you would want to speak to either customers, website visitors or employees in a one-to-one style interview, and all of them revolve around attempting to understand the opinions and recommendations from the people that matter most.

Gaining the most valuable and meanignful insights isn’t always straightforward, particularly when the person you are speaking to has never previously been asked for their opinions and ideas. This is especially true when speaking to staff within an organisation, whether you are looking to improve production processes, improve efficiency on the shop floor, or as is often the case with ourselves, reviewing a company intranet.

If you find yourself carrying out one-to-one interviews for whatever reason, you might like to take a look at a recent blog post of 5 tips when conducting user research.

To save you a click the 5 tips are:

  1. Give the person you are speaking to the confidence that their input is truly valued
  2. Give the person your full attention – keep your head up!
  3. Ask open, probing questions
  4. Bring the user research to life by incorporating user testing
  5. Don’t rely on first impressions

Summary

Of course we are just scratching the surface to user testing and user research activities, but hopefully it has been of use. Of course get in touch with us if you would like more information or are considering these types of activities.

PRWD

5 Tips When Conducting User Research

0 comments

Whether its referred to as user research, customer research, field studies, qualititive research or one of the other terms used, finding out the wants and needs of people who use websites, intranets and software is a crucial part of designing usable solutions which deliver return-on-investment.

Here I want to share with you 5 tips when conducting this type of one-to-one research:

1) Give the person you are speaking to the confidence that their input is truly valued

Many people, especially those who have never taken part in this type of research before, think that there input won’t be valuable, for any number of reasons. This could include:

  • they don’t use the website or system often
  • they have never done this type of activity before
  • they have never been asked for their opinion before
  • they don’t feel their role is very important, so why would their opinions be important

We tend to give people cofidence in these situations by:

  • explaining to them the approach that the user research is taking
  • re-iterate during the meeting how valuable their views and insights are
  • explain that this isn’t just a one-off experience and that gaining input from people such as themselves is a fundamental part to the website or intranet improvement process going forward
  • ask whether they would like to be involved in further elements of the research and design process

It can be quite remarkable experiencing a persons confidence grow, from at the start where they are very apprehensive and introverted to becoming very passionate and open to sharing their views.

2) Give the person your full attention – keep your head up!

Rather than try and carry out the face-to-face meeting as well as making notes throughout on the key points being made, simply voice record the meeting (asking permission first of course) to allow you to give the person your full attention.

Benefits of voice recording the meeting include:

  • the conversation is much more natural
  • it ensures you will never miss a vital piece of feedback whilst you are making a note of a previous comment
  • you are paying much more attention to what the person is saying, which in turns helps you think of which questions and prompts should follow next
  • the person feels fully engaged rather than looking at the top of your head for parts of the meeting
  • if you to choose to quote the person in the research report and findings work you do after, you ensure the quote is 100% accurate and note based on your notes

A few things to consider on voice recording meetings:

  • if like us, due to the sheet amount of valuable insights and comments that each meeting contains, you choose to get full transcriptions of each meeting, this is a very time consuming exercise and one which we definetly recommend you outsource
  • you may also be thinking of video recording the meetings, especially if (as I will come on to later) you also use these meetings to carry out user testing. You need to be aware that this will usually highten the sense of apprehension for the person which can affect their confidence in fully engaging with the process

3) Ask open, probing questions

Being asked to share your views on a particular website or company intranet is very much a one-off scenario (unless of course you are adopting a true user-centered design approach and will be engaging with that person throughout the design and development process). However familiar with a system the person is, it takes certain types of questions to get people to open up and share the types of insights that will be of most value in your research.

Typical questions we might ask include:

  • Can you describe the reasons why you typically [add in different user scenarios]?
  • Can you explain the approach you tend to take when [add in different user scenarios]?
  • What improvements do you think would make your job/experience easier and more effective?
  • At [add in various areas of the website or intranet], what information are you looking for and why?
  • Can you explain a situation where you haven’t been able to find what you are looking for, and what have been your next steps?

It is vital that your questionning doesn’t lead the person down a particular route on purpose – the more natural and open ended you make the questionning the more likely you are of gaining really valuable insights.

4) Bring the user research to life by incorporating user testing

Providing the research you are doing is for an existing website or company intranet, bring a greater degree of engagement and value to the research by incorporating user testing into the meeting.

Website testing or system testing, not user testing
Its vital to stress at this point that when you explain about this to the person, you are clear that you are wanting to test the usability and effectiveness of the website or system, not their capabilities or ability to remember where certain information is.

Key points when incorporating testing to user research:

  • avoid the temptation to use a lab testing environment – let the user work in their own comfortable surroundings, whether this is at home or at their desk at work
  • don’t let the person blame themself if they are having trouble with a particular task for a scenario
  • plan ahead with typical scenarios, and be as descriptive as possible
  • ensure that the scenarios you are asking them to experience have some correlation to their potential wants and needs
  • explain about the importance of them adopting the think out load approach, which you need for both your own benefit during the meeting but more importantly for when the voice recording is transcribed
  • once it is clear they are unable to complete a task at a certain point, prompt them in the right direction and then let them continue on with their think out loud approach

5) Don’t rely on first impressions

Quite often the person that you are speaking to immediately makes it clear that they know their input won’t be very useful. This can be for a number of reasons:

  • they only ever use a very small element of the website or intranet, and that can be explained in a matter of seconds
  • they hardly ever use the website or intranet
  • they are against change within their organisation and so they aren’t wanting to disrupt anything
  • they dismiss the very fact that you are asking for their feedback, and are apprehensive that what they say will make any difference or actually be used to actually make improvements

This where the first four tips all come in to play – by giving confidence to the person, providing your full attention, asking probing questions and bringing the session to life by letting them use the website/intranet for themself, you will often find that the people who on first impressions seem to be offering the least amount of valuable feedback actually turn out the complete opposite.

Summary

User research is a highly valuable way of gaining end user insights, but it isn’t something that comes easily. There are many elements to carrying out successful user research and I hope these tips will come in useful for people who are already carrying this type of research, or who are considering it.

Further reading

You may also like to take a look at some of these related articles and presentations.