NHS Leadership Academy

NHS Leadership Academy website refresh - audience testing

Incomplete applications

0
Incomplete applications

Completed applications

37
Completed applications
34 SME, 3 large
Important dates
Opportunity attribute name Opportunity attribute value
Published Thursday 2 February 2017
Deadline for asking questions Thursday 9 February 2017 at 11:59pm GMT
Closing date for applications Thursday 16 February 2017 at 11:59pm GMT

Overview

Overview
Opportunity attribute name Opportunity attribute value
Summary of the work A supplier is required to carry out user testing, develop audience insight, and make recommendations to improve the NHS Leadership Academy's website: www.leadershipacademy.nhs.uk
Latest start date 27/02/2017
Expected contract length 4 to 8 weeks
Location No specific location, eg they can work remotely
Organisation the work is for NHS Leadership Academy
Budget range Approximately £30k

About the work

About the work
Opportunity attribute name Opportunity attribute value
Why the work is being done The NHS Leadership Academy's website (www.leadershipacademy.nhs.uk) offers a range of tools, models, leadership development programmes (costed and uncosted) and expertise to support individuals, organisations and local delivery partners to develop leaders, with the aim of improving people’s health and their experiences of the NHS.

Audience testing and insight development work is being taken forward to help optimise the Academy website to ensure it meets the needs of its target audience by offering the best customer journey.

This work should be completed no later than February 2017.
Problem to be solved Anecdotal research from users suggests problems with information architecture and navigation, and look and feel. User testing has not been conducted on the website to date.

Our objectives are to find out:

• who our users are and generate a number of common user profiles
• how they access our website / information
• what they need to fulfil their information and customer journey needs
• what is needed that we're not currently offering.

We are also seeking advice from the appointed agency on other areas for consideration.
Who the users are and what they need to do Our users are health and care workers (such as NHS frontline staff and senior executives) and organisations (such as NHS organisations, CCGs, arms-length bodies, local authorities) who need to access leadership development information, tools, models, thought leadership, including information to help the decision making process to undertake leadership development programmes and allow their staff members to undertake them.

We would like the agency to explore and analyse what our audience needs and how they need it.
Early market engagement
Any work that’s already been done A website and online content review has been conducted internally (including Google Analytics performance outcomes), together with the design of new prototype web page templates.

These are available to suppliers upon request.
Existing team The supplier will work with Paul McSherry; Senior Lead - Marketing and Stakeholder Engagement, and James Marcus; Online Content and Engagement Manager.
Current phase Discovery

Work setup

Work setup
Opportunity attribute name Opportunity attribute value
Address where the work will take place Any user testing locations should be included in your submission for consideration, as our audience is England-wide.
Project communications can be mainly remote. However, we will require the successful supplier to attend face-to-face meetings for project inception, topline findings and final outomes/recommendations. Face to face meetings will be held at the NHS Leadership Academy; 3 The Embankment, Sovereign Street, Leeds, LS1 4GP.
Working arrangements The successful supplier should work in an agile manner, and can work remotely. However, we will require face-to-face meetings at the NHS Leadership Academy in Leeds.
Security clearance Security Clearance is not required.

Additional information

Additional information
Opportunity attribute name Opportunity attribute value
Additional terms and conditions

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Skills and experience
Opportunity attribute name Opportunity attribute value
Essential skills and experience
  • Be highly experienced in carrying out successful user testing/audience insight development approaches; providing clear rationales for methodologies.
  • Be able to conduct appropriate user testing/audience insight development methods.
  • Be able to recommend and recruit appropriate target audience segmentation samples for robust user testing/audience insight development.
  • Provide analysis and interpretation of findings, making recommendations for website improvements.
  • Be able to work in an agile manner.
Nice-to-have skills and experience
  • Demonstrate working on similar projects with other NHS organisations.
  • Provide over 3 year's experience of working on website research projects.
  • Experience of working with the Government Service Design Manual.

How suppliers will be evaluated

How suppliers will be evaluated
Opportunity attribute name Opportunity attribute value
How many suppliers to evaluate 5
Proposal criteria
  • Approach and methodology
  • How the approach or solution meets user needs
  • How the approach or solution meets your organisation’s policy or goal
  • Estimated timeframes for the work
  • Value for money
  • How they’ve identified risks and dependencies and offered approaches to manage them.
Cultural fit criteria
  • Demonstrate flexibility such as the ability to shift tasks to meet changing priorities
  • Demonstrate successful collaborative working with a public body
  • Be transparent and collaborative when making decisions
  • Challenge the status quo
Payment approach Fixed price
Assessment methods
  • Written proposal
  • Work history
  • Presentation
Evaluation weighting

Technical competence

40%

Cultural fit

10%

Price

50%

Questions asked by suppliers

Questions asked by suppliers
Supplier question Buyer answer
1. In the brief it mentions "This work should be completed no later than February 2017". However the expected start date is the end of February. Please could you clarify? Apologies, and thank you for letting us know. For clarification, the work is expected to commence on 27 February, 2017 with a completion date of 30 April, 2017.
2. Could you clarify what the goals of the research are? It's not clear whether this is discovery research or usability testing of a live service. You mention a new design and prototype - is this something you're looking to test before implementing on the site? Thank you for your question. This is usability testing of a live service, which will then be implemented on the site following the findings.

Prototypes and draft designs currently exist based on internal research only.
3. Does this Discovery piece relate to a potential re-platforming and build of the existing website or are we potentially constrained by the existing platforms capabilities? The purpose of the discovery phase is to address the 'problems to be solved' in the brief and produce recommendations around potential solutions. We would not want to consider any constraints at this point until we have the recommendations back. Generally speaking, we do have standard constraints that the final solution(s) must operate within e.g. values of accessibility and inclusion, cost, brand. These will be applied once we have considered the ideal options.
4. Please advise if there will be a further opportunity to ask questions / request clarifications from the buyer upon being shortlisted? Yes, there will be.
5. Please can you confirm if the indicated budget is inclusive or exclusive of VAT and travel/expenses? Thank you. The cost is exclusive of VAT, and should be inclusive of your travel costs.
6. Can you please clarify how much support the buyer would be able to give in terms of user recruitment for testing - if any? Thanks Hello. We can support user recruitment through our alumni groups, however we also require external user groups who have not yet developed a relationship with the NHS Leadership Academy. The supplier will be responsible for recruiting the latter group.
7. At what stage would it be possible to view the items listed in 'work that has already been done' The internal website and online content review research can be shared with prospective suppliers now, together with the design of new prototype web page templates. These can be requested via marketing@leadershipacademy.nhs.uk
8. What outputs is the buyer ideally wanting from this phase in terms of deliverables (user profiles are mentioned but would you be happy with a written report of recommendations or does the buyer require UXD also for instance?) Or, is it up to the supplier to recommend specific deliverables. Thank you. Part of the procurement process is for the supplier to recommend specific deliverables they feel appropriate to complete the project. Ideally, this will be a written report that can support the next phase of design and development.
9. Can you tell me if the (circa) £30,000 budget is inc or ex VAT please? Also, are you able to provide access to your website users so they can be used as test participants or will the vendor have to do all the recruitment? The cost is exclusive of VAT, and should be inclusive of your travel costs. We can support user recruitment through our alumni groups, however we also require external user groups who have not yet developed a relationship with the NHS Leadership Academy. The supplier will be responsible for recruiting the latter group.
10. Do you currently have a backlog of user stories? Or is this something you want as part of the project? No, we do not have a back log of user stories. Ideally, the user stories will come as part of the user profiles that are produced as part of the user testing.
11. How do you plan to shortlist interested suppliers to 5 for evaluation, as it's likely you'll receive more than 5 applications that tick all the boxes? Is there any opportunity to provide evidence of the essential and nice-to-have skills along with our application? We understand the newly introduced process (https://digitalmarketplace.blog.gov.uk/2017/02/03/weve-improved-the-shortlisting-process-for-digital-outcomes-and-specialists/) will allow this for opportunities published from today onwards. As this was published before 8th Feb, does this not apply? To clarify, we will not be shortlisting to five suppliers. At the start of the process we anticipated there may only be around five submissions. We will be evaluating all submissions received and using the same evaluation criteria for all, regardless of the number of submissions.

Since this procurement exercise was published prior to the 8 February the initial application process still applies, and we will contact you for essential and nice-to-have skills separately and where necessary.
12. Could you please tell us in how many locations do you want to cary on the testing? Part of the procurement process requires you to outline your recommended approach and methodology for consideration, therefore we have not been prescriptive about locations.
13. Could you please tell me how many participants do you want to test the site with? Part of the procurement process requires you to outline your recommended approach and methodology for consideration, therefore we have not been prescriptive about the number of participants for the user testing phase.