NHS Improvement: NHS Trust Development Authority (TDA) is the contracting authority

Public Beta phase - Development of the Patient Safety Incident Management System (DPSIMS) Project

Incomplete applications

20
Incomplete applications
14 SME, 6 large

Completed applications

9
Completed applications
6 SME, 3 large
Important dates
Opportunity attribute name Opportunity attribute value
Published Tuesday 16 April 2019
Deadline for asking questions Tuesday 23 April 2019 at 11:59pm GMT
Closing date for applications Tuesday 30 April 2019 at 11:59pm GMT

Overview

Overview
Opportunity attribute name Opportunity attribute value
Summary of the work Public Beta phase development of the successor to the NRLS and STEIS, to support efforts to reduce harm in the NHS through better data collection, analysis and sharing of learning.

Suppliers' Briefing teleconference on 18 April, at 11:30. Dial-In details will be forwarded to suppliers who have confirmed an interest.
Latest start date Monday 1 July 2019
Expected contract length up to 2 years
Location London
Organisation the work is for NHS Improvement: NHS Trust Development Authority (TDA) is the contracting authority
Budget range Up to £2,000,000 including expenses, excluding VAT.

Up to £1,500,000 to support DPSIMS Public Beta.

Option to include the Maternity Transformation Programme (up to £500,000).

The business case for the above requirements is pending internal and DHSC approval.

Any contract award is subject to the necessary approvals being received.

About the work

About the work
Opportunity attribute name Opportunity attribute value
Why the work is being done To deliver the Public Beta phase for the new Patient Safety Incident Management System (PSIMS), in line with GDS guidelines. The supplier will: operate, maintain and improve the Minimum Viable Product (MVP) created and successfully deployed on NHS Improvement technical infrastructure in Private Beta; Design, Build, Test and add a range of major new capabilities (see supplementary documentation); support for planning/skilling up internal operational teams, phased handover of applications and documentation, and support for decommissioning of legacy applications. Work to be completed by 31 March 2020.
Problem to be solved PSIMS will replace the National Reporting and Learning System (NRLS) and the Strategic Executive Information System (STEIS) with a successor that supports efforts to reduce harm through better data collection, analysis and sharing of learning. The NRLS has been improved over time but no longer meets requirements effectively; the successor system will use new technologies to increase end to end service efficiency, and be more appropriate for the way healthcare is now delivered.
Who the users are and what they need to do 1) National bodies e.g. CQC.
2) Provider-side reporters who use Local Risk Management Systems (>99% of reports received are batch-uploads from large NHS trusts).
3) A large cohort of prospective provider-side users who undertake minimal/nil national reporting (e.g. General Practice), and Independent Providers of NHS funded care.
4) The NHS Improvement Patient Safety team for identification of new/under-recognised risks etc., and the Service Operations Team responsible for user support and data management.
5) Other parts of the NHS for planning purposes.
6) Communities with an interest in improving the safety of healthcare in England and internationally e.g. academics.
7) Patients/carers.
Early market engagement A Market Alert Notice was sent to suppliers registered on DOS3 Outcomes.

A Public Beta briefing Q&A is scheduled for 18 April; materials will be available in the Supporting Information Pack. This will be made available to those Suppliers who have registered for the briefing (instructions provided in the market alert and 'Question and Answer Session' of this notice - login in required).

Please see also;

https://improvement.nhs.uk/resources/development-patient-safety-incident-management-system-dpsims-project-completes-its-alpha-phase/

and;

https://www.gov.uk/service-standard-reports/development-of-the-patient-safety-incident-management-system-dpsims-alpha-assessment
Any work that’s already been done Discovery and Alpha completed/GDS-assessed. Private Beta to be completed by July 2019 (subject to GDS assessment). Major Private Beta work includes:
• Data capture from Local Risk Management Systems
• Data captured through online incident recording forms
• A data pipeline to prepare the data for onward analysis and dissemination (e.g. anonymization)
• Review app created for national Patient Safety Team review of Patient Safety incidents
See supplier information pack for more detail.
Existing team The supplier will be working with members of the national patient safety team (in NHS Improvement) including the Product Owner, Service Manager, clinical leads ('Review and Response'), and members of the internal service operations and infrastructure teams in NHS Improvement (e.g. QA and Enterprise Architecture). For governance arrangements see the Supporting Information Pack .
Current phase Beta

Work setup

Work setup
Opportunity attribute name Opportunity attribute value
Address where the work will take place The supplier will be expected to work closely with the NHS Improvement delivery team located in central London (Wellington House 133-155 Waterloo Road London SE1 8UG) and for some parts of the work will need to be physically located in these offices e.g. for sprint ceremonies.
Working arrangements Members of the supplier team should be on-site as required to support an agile delivery. The development team will host agile ceremonies which will be mandatory for the supplier staff/team, and stakeholder workshops where possible. Travel expenses will not be reimbursed - these should be accounted for in day rates. The existing delivery team is based in Wellington House, 133-155 Waterloo Road, London, SE1 8UG (and potentially Skipton House, 80 London Road London SE1 6LH).
Security clearance Security clearance not required, however, please note the following;

NHS Information Governance Toolkit/IG training may be required.
Suppliers may be required to sign specific data sharing agreement T&Cs to protect data disclosure (NDAs, etc).
Suppliers may have access to patient-level/identifiable information (incident reports); prior experience handling sensitive data is desirable.

Additional information

Additional information
Opportunity attribute name Opportunity attribute value
Additional terms and conditions All IPR vested within the PSIMS (both background and foreground) will be retained by NHS Improvement.

No license or permission to use the PSIMS for the Supplier is granted except insofar as to deliver the requirements of this Agreement

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Skills and experience
Opportunity attribute name Opportunity attribute value
Essential skills and experience
  • Demonstrate expertise and experience in data capture and integration (including cloud integration) and building on/maximising existing PSIMS/enterprise architecture and integrating it with new solutions.
  • Demonstrate expertise and experience in DevOps, including continuous, automated integration testing.
  • Demonstration of successful delivery of clear methodology for engagement with end users and stakeholders (internal & external).
  • Demonstrate familiarity with, or access to, expertise in the NHS safety landscape, including local risk-management systems, safety science and risk management, and incident management.
  • Demonstrate expertise and experience using Tableau for data visualisation.
  • Demonstrate expert knowledge in natural language processing & machine learning in healthcare (ideally ability to derive insight from; categorical/text-heavy data fields; pseudonymisation; de-identification in free text)
  • Demonstrate expertise and experience in successful application of Agile approaches to deliver complex systems, by meeting the GDS Service Standard and passing GDS Public Beta Service Assessment.
  • Demonstration of successful delivery of projects that include blended, multi-discipline, multi-stakeholder teams focused on meeting user needs.
  • Demonstrate expertise and experience in planning, upskilling, and supporting handover to a Live phase service team.
  • Demonstration of planning and supporting decommissioning of legacy infrastructure.
Nice-to-have skills and experience
  • Demonstrable experience of carrying out research with a diverse mix of users including those with low digital literacy and assisted digital needs.
  • Demonstrable experience of using Alteryx or similar tools for data blending.

How suppliers will be evaluated

How suppliers will be evaluated
Opportunity attribute name Opportunity attribute value
How many suppliers to evaluate 5
Proposal criteria
  • Demonstration of depth of understanding of our requirement (10 points).
  • Technical Solution including optimal infrastructure reuse. How will your solution meet user needs? (25 Points).
  • Approach and methodology to delivery, including collaboration with NHS Improvement teams (20 Points).
  • Provide your team details including roles, key personnel and example CVs of proposed resources (20 points).
  • Provide project and resource plans, highlighting significant milestones, with supporting rationale (15 points).
  • Identification of risks and dependencies and proposed mitigations to manage them (10 points).
Cultural fit criteria
  • Work transparently and collaboratively as a team with our organisation and other suppliers.
  • Share knowledge, experience and skills with other team members so as to build sustainable capability.
  • Provide critical challenge whilst maintaining good relationships.
Payment approach Capped time and materials
Assessment methods
  • Written proposal
  • Case study
  • Work history
  • Reference
  • Presentation
Evaluation weighting

Technical competence

60%

Cultural fit

10%

Price

30%

Questions asked by suppliers

Questions asked by suppliers
Supplier question Buyer answer
1. Can you please provide details on how we can attend the briefing call on 18 April, at 11.30. To attend the Suppliers' briefing teleconference on Thursday 18th April at 11:30 Suppliers need to log in to the portal and email the address within with the names of their delegates (include their email addresses). We will revert with dial in details and supporting documentation by 10:30 on Thursday 18th April.
2. What is the last day suppliers can ask questions before the deadline? Questions via the portal must be asked by 23:59 on Tuesday 23 April.
3. Which Supplier has delivered Alpha & Private Beta Informed Solutions Ltd. was the appointed Supplier, these phases were competed on DOS 2 Outcomes.
4. Is PSIMS built in NHS England's or NHS Improvement’s environment? It is built on NHS Improvement’s Strategic Information Platform (SIP). Further information regarding SIP including the technology used is included on a separate DOS 3 Outcomes opportunity which is currently live and was published on 17 April 2019:

https://www.digitalmarketplace.service.gov.uk/digital-outcomes-and-specialists/opportunities/9509
5. Can we bid for individual elements? We encourage consortium bids and prime / sub relationships; however, one supplier needs to take the lead and submit the shortlist response and lead the solution if shortlisted.
6. What new functionality are your seeking to develop at this stage? We are currently testing the MVP consisting of:

• Online incident recording forms
• APIs
• Data pipeline including anonymisation app
• MVP app supporting clinical review of free text of certain incidents

The new functionality (8 main components) to be added to this is outlined in the slide deck shared at the briefing meeting.
7. Do you have an ambition to link the system to external organisations e.g. CQC? NHS England and Improvement share data with a number of organisations, as such as CQC, MHRA, Welsh Gov and PHE.

PSIMS will support equivalent data sharing, via FTP and direct access to data in SIP, and APIs for receiving organisations ready for it.

How far customised linkage goes is dependent on the development appetite and needs of external organisations, but we are wary of scope creep and the need for the platform to remain learning focused as opposed to monitoring/measuring for the purposes of benchmarking or performance management.
8. Is the system primarily public facing or sector facing? Of the 20m incident reports currently received in NRLS, the vast majority come from within the NHS; PSIMS, as a replacement for this, is designed as an internal staff tool for learning and improvement. Part of the roadmap includes a patient reporting function in parallel to this (to replace the existing Patient and Public NRLS eForm) currently proposed to be through an amended Online Incident Recording form.
9. Have you built the governance and access control in the current architecture to account for external access? The SIP platform does not have significant external links currently. We are able to share data with NHS partners at organisational-level, but otherwise external access and associated governance considerations is not anticipated to be part of Beta.
10. Will you make the existing backlog available to all bidders? Not at shortlist stage. At proposal stage, for shortlisted bidders, we will summarise a high-level view of the roadmap.
11. You have advised work to start on 1 July and conclude within a maximum of 12 months, however on the portal the contract is for up to 2 years. This is to provide maximum contract term flexibility permitted by DOS - we anticipate the work to be concluded in Q4 of FY 19/20.
12. What level of Tableau experience do you require? Highly proficient to both support visualisation and advise on the optimal visualisation approach for different types of data.
13. Will you consider a blend of on shore and near/off shore resources? Yes, however suppliers need to be mindful of how data, which may contain person identifiable information (PII) is accessed overseas.
14. Would you consider existing components/applications as part of your bespoke system? Yes, provided it meets functionality, operates within our environment without extensive integration & testing, and satisfies the call off terms including our ownership of IP.
15. Is the pricing model based on a team structure and rate card? This is the anticipation - the pricing template will be shared with the shortlisted bidders.
16. Do you have a date for the GDS assessment of private Beta. We anticipate this to take place in June.
17. Is the incumbent (Informed Solutions Limited) submitting a bid? There are no organisations that have advised that they will be submitting a bid. Note that should an organisation say that they were, this would not be disclosed.
18. How are questions and answers following the Supplier's Briefing meeting being published? All questions asked relating to this procurement and during/following the Suppliers' Briefing meeting are published on this portal.
19. You have mentioned that "Suppliers need to log in to the portal and email the address within with the names of their delegates " but there's no mention of which portal we've to be logging in to or which email address to contact. Please could you clarify? This portal (digitalmarketplace) is the only portal we are using for this procurement.
20. You intend to capitalise on the existing infrastructure insofar as possible - on what technology is the MVP built on? 1 of 2:

The core digital service has been developed leveraging primarily Microsoft Azure platform services:

• The digital web applications are Single Page Applications (AngularJS & ReactJS), .Net Core, .Net API: Python / Django web app for forms framework
• Integration to Open source CMS wagtail (Python and Django)
• The service integrates to a Okta identity and access management (open ID connect, SAML2) (this service is managed as a separate project)
• The data components leverage CosmosDB, Blob storage, Data factory and Azure SQL server
• Azure infrastructure services for DR (traffic manager).
21. You intend to capitalise on the existing infrastructure insofar as possible - on what technology is the MVP built on? 2 of 3:

The service also consists of a set of managed API’s leveraged for data interoperability with 3rd party risk systems and application logic

• Microsoft API Manager
• RestFul API / FHIR services, JSON / XML
• NLP SpaCy(Python)

Reporting and visualization components are developed using a shared warehousing platform in tableau

• Tableau reports for service monitoring and user facing analytics
• Alteryx for data blending and preparation.
22. You intend to capitalise on the existing infrastructure insofar as possible - on what technology is the MVP built on? Answer 3 of 3:

The service integrates to a corporate data warehouse (managed as a separate project):

• Microsoft APS platform and associated SQL Server development in production setting (including security, role-based access, TSQL & SSIS).

NHSE/I apply a standard development lifecycle support which includes:

• automation of quality assurance in a CI/CD and devOps model using the following tools: Azure DevOps CI/CD, Powershell, ARM Templates, Selenium, JMeter.
23. The List of Suppliers who have expressed an interest is (1 of 2) 6point6 Limited
Automation Logic Limited
Avonshire Cloud Limited
Badenoch and Clark Ltd
Blue Pelican Ltd
Borough IT Ltd
Capgemini UK PLC
FutureGov Ltd.
Hiberus Ltd
Hicom Technology Ltd.
Informed Solutions Ltd
Isharat Ltd
Kainos Software Ltd
Keep IT Simple Ltd
L2S2 Ltd
Made Tech Ltd
Mastek (UK) Limited
Mitra Innovation Limited
North of England Commissioning Support Unit (NECS) (hosted by NHS Commissioning Board known as NHS England)
Parity Consultancy Services Ltd
24. The List of Suppliers who have expressed an interest is (2 of 2) Pegasystems Limited
PFI Knowledge Solutions Ltd
Pillar Strategy
GoPivotal (UK) Limited
PricewaterhouseCoopers LLP (PwC)
Redweb Ltd
Redwood Technologies Ltd
Scott Logic
Sirius Open Source Ltd
Sopra Steria Limited
Sungard Availability Services (UK) Limited
Tata Consultancy Services Limited
The Dextrous Web Ltd
The Fifth Business
UST Global Pvt Ltd
25. The data is downstream from NHS Digital, are some of the services in scope to be managed by NHS Digital? No, NHS Digital don't provide services required under this procurement.

NHS Digita pseudonymise the patient data provided and in some cases provide us with subsets of data and in a specific format.
26. Was question 25 (above, re NHS Digital services) intended for this procurement? No, this relates to another matter, please ignore.