Awarded to Web Usability

Start date: Monday 21 March 2022
Value: £68,350
Company size: SME
Money and Pensions Service

Money and Pensions Digital Usability Testing

4 Incomplete applications

3 SME, 1 large

5 Completed applications

5 SME, 0 large

Important dates

Published
Tuesday 25 January 2022
Deadline for asking questions
Tuesday 1 February 2022 at 11:59pm GMT
Closing date for applications
Tuesday 8 February 2022 at 11:59pm GMT

Overview

Summary of the work
Contract to recruit participants to attend user research sessions about their money and pensions for the Money and Pensions Service
Location
London
Research dates
March 2022
Organisation the work is for
Money and Pensions Service
Budget range
It is anticipated that each round will be in the range of £10,000 - £16,000 excluding VAT

About the work

Early market engagement

About the research

Description of your participants
a) Minimum of 6 participants (x2)
b) 50/50 split of gender
c) Mixed ethnicity
d) Income from £18-60k, with mixture of employment status e.g. self-employed or part-time
e) Ideally, aged 40-65
f) Their main pension must be DC
g) Willing to be recorded
h) Either contributing to a pension via a workplace scheme or self-investing into a pension
i) Must not have accessed their pension yet
j) Must not have a financial adviser for their retirement planning
Assisted digital and accessibility requirements
Lab should be able to accommodate digital and accessibility requirements
Research plan
Research activity type 1 - Facilitating and moderating Google design sprint workshops remotely
Research activity type 2 - Carry out remote moderated interviews for the purpose of usability testing
Research location
Facilities required must:
a) Provide a fully equipped remote UX lab that can accommodate remote viewing for a minimum of 5 guests
b) Be able to test mobile/tablet/desktop devices
c) Allow participants to take full control of any supplied prototype assets
d) Allow MaPS team to ask questions during the session via a private messaging channel
e) Accommodate for participants with technology impairments e.g. visual aids
Access restrictions at location
Restrictions will depend on venue
Number of research rounds
3 rounds, every two to three weeks (x2)
Number of participants a round
Minimum 6 (x2)
How often research will happen
Over a 4-6 week period, taking design sprints into account
Evening or weekend research
Weekday evenings

Additional information

Additional terms and conditions

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Essential skills and experience
  • Have the ability to start the project within 1 week of award
  • Have the ability to recruit required users within 1 week of project initiation
  • Demonstrate experience of at least one example of deriving actionable results from user research activities such as moderated and unmoderated prototype tests, card sorts, and tree tests
  • Demonstrate experience of at least one example within the past 5 years of conducting remote user research, including testing prototypes on both desk–/laptop and mobile platforms
  • Demonstrate experience of at least one example of planning and facilitating workshops with multi-disciplinary teams for discovery, ideation, prioritisation, and post-mortem evaluation
Nice-to-have skills and experience
  • Demonstrate experience providing user research participants for consumer-facing financial services and/or government
  • Demonstrate the ability to provide new technology to support the research findings

How suppliers will be evaluated

All suppliers will be asked to provide a written proposal.

How many suppliers to evaluate
3
Proposal criteria
  • Approach to conducting remote user research
  • Approach to facilitation and preparation to ensure actionable outputs, including participant briefing and guidance, and post-workshop analysis and documentation
  • Approach to ensuring participants meet suitable criteria
  • How they've identified risks and dependencies and offered approaches to manage them
  • Knowledge of financial services/guidance industry
  • Approach to recruiting participants at speed (within 1 week)
  • Approach to workshop planning and facilitation at speed (within 1 week)
  • Estimate time frame for work
  • Ability to adapt to external events and short lead times
  • Total cost
  • Please note, shortlisted suppliers will have a period of 1 week to submit proposals
Additional assessment methods
Evaluation weighting

Technical competence

40%

Availability

30%

Price

30%

Questions asked by suppliers

1. You state ‘Have the ability to recruit required users within 1 week of project initiation’ – do you require participants to be recruited within 1 week of being briefed in all cases?
Our ambition is to begin the first round of research within one week. Participants for the first round must be recruited within one week of being briefed, and the other participants must be recruited in line with the timeline for further rounds.
2. Just to clarify, the ‘contract to recruit participants to attend user research sessions about their money and pensions for the Money and Pensions Service’. Several of the criteria refer to experience of conducting research and analysing findings. Are you also expecting the supplier to conduct research activities? Please provide more information about your expectations.
Yes we are expecting the supplier to conduct research activities. We are expecting user testing of content which we will supply, interviews with users, and a report for each of the propositions we are testing.
3. If you’re looking for the supplier to conduct research and analyse findings, how much do you want the supplier to lead these activities or is this more to support you with these activities?
The supplier will lead on these activities, testing content that will be supplied by us.
4. You mention a requirement for lab facilities – please confirm any specific requirements in terms of location? Also none of the skills and experience criteria refer to use of labs. How do you wish us to include lab capabilities in responses?
The lab facilities should be in London, or available remotely. We would like to use lab facilities to test digital content, for example through eye movement tracking.
5. You state ‘Demonstrate the ability to provide new technology to support the research findings’ – please can you explain your thinking behind this question
This question is designed to allow respondents to share any other technology they have access to that could improve our user testing of digital content.
6. Please clarify your requirement for weekday evening research – do you envisage this for all research sessions?
The requirement is for weekday, or weekday evening research, to accommodate users who work and may be unable to attend sessions during the day. If we can recruit the relevant type of participants for sessions during the day then this would be our preference.
7. Please could you clarify what you mean by ‘Demonstrate the ability to provide new technology to support the research findings’
This question is designed to allow respondents to share any other technology they have access to that could improve our user testing of digital content.
8. Do you have any core objectives or insights that you are looking for this research to uncover and are there any specific parts of the service you want to focus in on?
We will provide digital content for the provider to test with users. We are looking to understand users' appetite to set up accounts to use the content, how users intuitively use the content, and whether it makes sense to them, and if there is anything missing that they would expect to see as part of that content.