NHS Improvement (NHS Trust Development Authority will be the contracting body)

Alpha phase of the Development of the Patient Safety Incident Management System (DPSIMS) Project

Incomplete applications

13
Incomplete applications
9 SME, 4 large

Completed applications

13
Completed applications
6 SME, 7 large
Important dates
Opportunity attribute name Opportunity attribute value
Published Friday 7 July 2017
Deadline for asking questions Friday 14 July 2017 at 11:59pm GMT
Closing date for applications Friday 21 July 2017 at 11:59pm GMT

Overview

Overview
Opportunity attribute name Opportunity attribute value
Summary of the work This procurement will undertake an Alpha development phase to prototype and test a successor to the National Reporting and Learning System (NRLS) and the Strategic Executive Information System (STEIS), to support efforts to reduce harm in the NHS through better data collection, analysis and sharing of learning.
Latest start date Monday 30 October 2017
Expected contract length Up to two years.
Location London
Organisation the work is for NHS Improvement (NHS Trust Development Authority will be the contracting body)
Budget range Maximum spend up to £1.3m subject to any requisite business case approval during contract term. Pricing assessment will be on the basis of a like for like comparison of a costed resource profile, based on submitted day rates, and which shortlisted suppliers will be asked to complete and return as part of their proposal response. Day rates submitted must be inclusive of all costs including expenses.

About the work

About the work
Opportunity attribute name Opportunity attribute value
Why the work is being done This project will replace the National Reporting and Learning System (NRLS) and the Strategic Executive Information System (STEIS) with a successor that supports efforts to reduce harm through better data collection, analysis and sharing of learning. The NRLS has been improved over time but does not effectively meet requirements; the successor system will use new technologies and be more appropriate for the way healthcare is now delivered. Work must be complete by March 2018 with a priority need to produce a STEIS replacement prototype (ideally in Beta as the legacy system may be decommissioned in March 2018).
Problem to be solved NHS Improvement requires an Alpha phase for the PSIMS which includes new/improved functionality: improved recording/sharing of information in support of a good safety culture, appropriate for use in all settings, including those using Local Risk Management Systems (LRMS) and healthcare Providers not using LRMS; anonymisation functions for any submitted patient identifiable information; secure and transparent data submission/storage; improved functionality around self-service analytical capability for validated users, including but not limited to data-led exploration of themes or categorical data, and saveable search functions; user access to a collaborative environment; and direct, targeted feedback to individuals/organisations.
Who the users are and what they need to do 1. National bodies e.g. CQC use NRLS to undertake statutory duties. 2. Provider-side reporters who use a Local Risk Management System (>99% of reports received are batch-uploads from large NHS trusts.) 3. A large cohort of prospective Provider-side users who undertake minimal/nil national reporting (e.g. General Practice), and Independent Providers of NHS funded care. 4. The Patient Safety team for identification of new/under-recognised risks etc. 5. Other parts of the NHS for planning purposes. 6. Communities with an interest in improving the safety of healthcare in England and internationally e.g. academics.
Early market engagement A supplier discovery day was held on May 9 and attended by over 60 suppliers. Discovery day materials are included in the Supporting Information Pack which may be requested by sending an e-mail to patientsafety.enquiries@nhs.net
Any work that’s already been done Discovery phase outputs are available in the Supporting Information Pack which may be requested by sending an e-mail to patientsafety.enquiries@nhs.net

Another work stream has considered afresh the data to be collected and used by the PSIMS in order to ensure it offers the best opportunity to learn for safety improvement, whilst placing the minimum burden on reporters and allowing organisations to meet their statutory duties with regards to safety. Details of this data modelling work and project outputs are available in the Supporting Information Pack.
Existing team The supplier will be working with members of the national patient safety team (in NHS Improvement) including the Project Lead, Product Owner, clinical leads and subject matter experts, and members of the NRLS team), and Enterprise Architects from the Tech and Data team in NHS Improvement. For governance arrangements see the Supporting Information Pack which may be requested by sending an e-mail to patientsafety.enquiries@nhs.net
Current phase Discovery

Work setup

Work setup
Opportunity attribute name Opportunity attribute value
Address where the work will take place The supplier will be expected to work closely with the NHS Improvement delivery team located in Central London (Wellington House 133-155 Waterloo Road London SE1 8UG and Skipton House 80 London Road, London, SE1 6LH) and for some parts of the work will need to be physically located in these offices e.g. for data and infrastructure access.
Working arrangements Members of the supplier team should be on-site as required to support an agile delivery. The patient safety team will host agile ceremonies (stand-ups, show-&-tell review, retrospective and sprint planning) which will be mandatory for the supplier staff/team, and stakeholder workshops where possible. Travel expenses will not be reimbursed - these should be accounted for in day rates. The existing delivery team is based in two NHS Improvement offices: Skipton House, 80 London Road, London, SE1 6LH and Wellington House, 133-155 Waterloo Road, London, SE1 8UG.
Security clearance NHS Information Governance Toolkit / IG training may be required.
Suppliers may be required to sign specific NHS Improvement data sharing agreement Ts&Cs to protect data disclosure (NDAs, etc.).
Suppliers will NOT be provided with patient-level or identifiable information, but prior experience in handling sensitive data would be desirable.

Additional information

Additional information
Opportunity attribute name Opportunity attribute value
Additional terms and conditions "All IPR vested within the PSIMS (both background and foreground) will be retained by NHS Improvement.
No license or permission to use the PSIMS for the supplier is granted except insofar as to deliver the requirements of this Agreement"

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Skills and experience
Opportunity attribute name Opportunity attribute value
Essential skills and experience
  • Expertise and experience in application of Agile approaches to delivering complex systems (using Agile techniques that meet the GDS Service Standards and have passed GDS Service Assessments) (20 points)
  • Expert knowledge in machine learning e.g. natural language processing and ‘Big Data’, in particular the ability to derive learning and insight from categorical and text-heavy data fields (20 points)
  • Possess at least two years’ demonstrable experience using Tableau for data visualisation (15 points)
  • Successful delivery of projects that include blended, multi-discipline, multi-stakeholder teams focused on meeting user needs, and demonstrating clear methodology for engagement, problem solving and delivery (15 points)
  • Experience of building on and maximising existing architecture and integrating it with new solutions, including input into data mart design and leveraging Microsoft SQL server/APS for analysis (10 points)
  • Familiarity with, or access to expertise in, safety science and risk management, and specifically familiarity with local risk-management systems and the incident management landscape from within healthcare (10 points)
  • Have availability of resources to be able to start as soon as possible and by October 2017 (10 points)
Nice-to-have skills and experience
  • An understanding of healthcare data and the potential for data linkage between any new system and existing data systems
  • Proven experience of pseudonymisation and deidentification (e.g. in free text) in an NHS context
  • Proven experience of knowledge sharing and skills transfer with in-house teams so as to build sustainable capability
  • Demonstrable experience of carrying out research with a diverse mix of users including those with low digital literacy and assisted digital needs
  • Familiarity with academic and frontline best practice for enhancing learning, improvement of services, enabling reporting and good safety culture, and ICT-interoperability as it relates to this field
  • Experience using Alteryx or similar tools for data blending

How suppliers will be evaluated

How suppliers will be evaluated
Opportunity attribute name Opportunity attribute value
How many suppliers to evaluate 6
Proposal criteria
  • Technical Solution including maximum infrastructure reuse (30 Points)
  • Approach and methodology including collaboration with NHS Improvement teams (25 Points)
  • Team Structure and Mobilisation time (including roles and example CVs of typical resources) (20 points)
  • Value for money (20 points). Assessment will be on the basis of a like-for-like comparison of a costed resource profile which shortlisted suppliers will return as part of their proposal.
  • Identification of risks and dependencies and proposed mitigations to manage them (5 points)
Cultural fit criteria
  • Work as a team with our organisation and other suppliers (20)
  • Share knowledge and experience with other team members (20)
  • Agile and flexible to changing/uncertain requirements (20)
  • Transparent and collaborative when making decisions (20)
  • Challenge the status quo whilst maintaining good relationships (20)
Payment approach Capped time and materials
Assessment methods
  • Written proposal
  • Case study
  • Work history
  • Reference
  • Presentation
Evaluation weighting

Technical competence

60%

Cultural fit

20%

Price

20%

Questions asked by suppliers

Questions asked by suppliers
Supplier question Buyer answer
1. Good Afternoon, Please could you inform us if there is a way to download documents (ITT, Spec etc) associated with this project please? Many Thanks There are no ITT documents to download. We are currently in the “pre-qualification” stage where we will be assessing and shortlisting suppliers against the Essential skills and experience and nice-to-have skills and experience set out in our Opportunities notice that we have published.
2. The contract length mentioned 2 years but Alpha work to be complete by March 2018, can you explain vision for timelines? We envisage the Alpha phase taking 12-16 weeks (though we welcome views on this) and must be completed within this financial year. The Beta and Live phases will follow in 2018/19 and beyond.
3. Is the discovery being conducted by an external supplier? If so, who are they? The discovery phase was undertaken internally.
4. If an external supplier is being used for the Discovery, are they eligible to bid for the Alpha? The discovery phase was undertaken internally.
5. You state “some parts of the work will need to be physically located in these offices” – can elements of the work be conducted off shore / near shore (within EU)? Work using existing NRLS data (which may contain PII) will need to take place on NHS Improvement premises for IG purposes, and we prefer to work face-to-face for regular meetings etc.
6. Given the requirement to maximise reuse of existing infrastructure what availability of in-house expertise is expected in terms of days per week and qualification (developer grade)? We will have a Systems Architect available to support this project throughout Alpha for approximately 2-3 days per week.

The project will be supported by our existing data warehouse support function in order to load and make available data sets on the existing data warehouse.
7. Is the intention to host the web elements on existing infrastructure, or are you looking for a supplier to provide hosting e.g. web servers? NHSI have standardised on Azure and have an enterprise Azure account. This would be the referred hosting method for any cloud elements of the solution.

There warehouse and analytics server is hosted on premise Microsoft APS / Tableau.
8. Can you confirm that no response is required for the elements in “How suppliers will be evaluated” at this time? That is correct. Only suppliers who are shortlisted to submit proposals will be assessed against Proposal criteria and the Cultural fit criteria.
9. Is the contract through to Live stage? Is the same supplier potentially allowed to cover all stages to Live? Is the £1.3m budget for all stages thru’ to Live? There are obvious synergies in having the same supplier deliver all phases however it is our current intention to procure each phase separately. The £1.3m budget is for the full Alpha+Beta+Live phases.
10. Within the Additional T&Cs section, you state "All IPR vested within the PSIMS (both background and foreground) will be retained by NHS Improvement." Would the supplier be able to develop from an existing product, and provide this under a managed service agreement to NHS Improvement where IPR is retained by the vendor? IPR will be retained by NHSI.
11. We assume any change of the current process is not in scope is that correct? If the case can be made for improvements to processes which align to the new system, we would certainly welcome a discussion of them. It is worth noting that national and local processes may present different challenges with regards to change, however.
12. The scope mentions replacement of the National Reporting and Learning System (NRLS) and the Strategic Executive Information System (STEIS) with a successor that supports efforts to reduce harm through better data collection, analysis and sharing of learning. Are these stand-alone systems or are they underpinned by a separate platform that is also being replaced as part of this programme? Currently the NRLS and STEIS operate independently. The Alpha phase must make an assessment of the reuse options for NHSI infrastructure (see Supporting Information pack for more details - available on request from patientsafety.enquiries@nhs.net).
13. Can you confirm your definition of resource to be included in a resource profile? For example, is this just construed as FTEs or does it include licences, services, IT hardware, etc. The resource profile will be predicated solely on those resources/services to be provided by the successful supplier via the DOS 2 framework. Shortlisted suppliers will be asked to return a costings for a resource profile with their proposals.
14. This procurement relates to an Alpha phase however in the document you mention a Beta/Live solution required for March 2018. Can you confirm whether this project should be interpreted as an Alpha and Beta project? This phase of procurement is for the Alpha phase only. There are obvious synergies in having the same supplier deliver all phases however it is our current intention to procure each phase separately. The £1.3m budget is for the full Alpha+Beta+Live phases.
15. Can you provide more details as to your required timelines given the Beta/Live expectation for March 2018? The Alpha phase must be delivered within this financial year, by March 2018. The Beta and Live phases will follow in due course, once Alpha has been approved. Timelines for Beta and Live are to be confirmed but we anticipate their delivery in 2018 and beyond.
16. Can you outline why Alteryx is explicitly referenced in the nice to have evidence responses? Alteryx is currently being used as part of the technology stack for NHSI Analytics. In order to assess the effectiveness of NHSI’s utilisation of Alteryx and to recommend further usage, improvements, enhancements or possible alternatives, a background in the use and implementation of Alteryx in similar contexts would be advantageous. Please see the Supporting Information pack for further details (available on request from patientsafety.enquiries@nhs.net).