NHS Improvement: Data & Analytics Driven Product Development
42 Incomplete applications
26 SME, 16 large
22 Completed applications
10 SME, 12 large
- Monday 20 May 2019
- Deadline for asking questions
- Monday 27 May 2019 at 11:59pm GMT
- Closing date for applications
- Monday 3 June 2019 at 11:59pm GMT
- Summary of the work
- Information and analytics are a critical for delivery of outcomes within the NHS Long-Term Plan. NHSI and NHSE require new data driven digital products, building on NHSI's existing platform of loosely coupled, highly aligned services. A Suppliers' Briefing Teleconference is scheduled for 22/05/19 at 15:30 (log in for details)
- Latest start date
- Thursday 1 August 2019
- Expected contract length
- 2 years
- Organisation the work is for
- NHS Improvement - NHS Trust Development Authority is the contracting authority.
- Budget range
Up to £4,500,000 inclusive of expenses and excluding VAT. This is an overriding total budget with individual Statements of Work to be agreed per specific outcome requirement.
The business case for this requirement is approved.
About the work
- Why the work is being done
- Information and analytics are a critical for delivery of outcomes within the NHS Long-Term Plan. As NHS Improvement (NHSI) comes together with NHS England (NHSE), new data driven digital products will be required. These will build on NHSI's existing platform of loosely coupled, highly aligned services. NHS Improvement has a need for primary support for analytical and digital product development, acting as lead partner encompassing the full life-cycle including GDS skills in taking complex project through discovery to live. While not an exclusive relationship, a core partner is required to enable speed of delivery across multiple related strands of work.
- Problem to be solved
- NHS Improvement requires a delivery partner to work within agile delivery teams to enable the NHS to leverage data to support improvement. The partner will provide full-stack delivery from user research through mart development and front end delivery in Tableau and Digital web technologies. Operating to support a self-serve analytics and product alongside an operations partner to ensure the platform meets product owner needs. NHS Improvement requires highly competent, specialised resources to rapidly mobiles to deliver a full-service offering from discovery and user research through to data engineering and interface delivery in an interoperable and transparent environment.
- Who the users are and what they need to do
- As Senior Responsible Officer (SRO), I need highly competent teams to deliver at pace, within defined enterprise architecture constraints, with user led focus, agile iterative improvement and a continuous delivery model with full automation, assured, containerised deployment and transparency. As a Product Manager, I need to rapidly mobilise highly skilled resources to deliver key outcomes with assurance that they will operate effectively within the wider architecture and operational delivery model. As an analyst, I need expert data engineering support to provide me with the information I need, readily available, catalogued and with clear provenance, irrespective of source, product or interface.
- Early market engagement
A Market Alert Notice was emailed to all suppliers registered on DOS3 Outcomes.
A Suppliers' Briefing Teleconference is scheduled for Wednesday 22 May, 15:30. Details on how to register your interest in attending is provided in the Market Alert and on this portal (log in required).
- Any work that’s already been done
- The data and development platform is a live service of components underpinning several verticals such as Model Hospital, Provider Finance Monitoring, GIRFT and A&E Dashboard. The core infrastructure is on-premise with varying degrees of automation and use of cloud technologies. The platform comprises the Microsoft Analytics Platform System, utilities such as Alteryx & Tableau, SAML based identity management, Microsoft Azure components (DW, Cosmos DB, APIM & Data Factory), BIML MIST, .NET applications and Python/Django CMS. Products will reuse and extend the core platform and be supported by another partner supplier.
- Existing team
- Product and operations teams in NHSI are comprised of both permanent employees and supplier staff. NHSI has approximately 60 internal technical staff working to deliver and support data drive products and analytics. At any one time, there are an approximately similar number of supplier-based staff working on projects across 3-5 key suppliers. Any successful partner would be expected to work in rainbow teams will other suppliers and internal staff. Teams are cross-functional and blended, enabling agile product development and knowledge-sharing while minimising single points of failure.
- Current phase
- Not applicable
- Address where the work will take place
The customer is central London based and there is a requirement to work on site. Aspects of the work may also be delivered in Leeds.
NHS Improvement requires a supplier who can provide a high quality and cost-effective delivery model as prime partner with access to specialist skills at key points along delivery. Given the user centric nature of digital development, key resources will need to work alongside key customers, wherever they are based. However, teams may augment on-site resources with near/off-shore resources to provide an improved blended cost model.
- Working arrangements
- Continuous improvement and agility through the application of agile tools and techniques in an environment where Quality Assurance is embedded in all processes from requirements gathering to development and delivery. Team members will be expected to work with and play a key role in implementing continuous integration and delivery pipelines and, where possible, automate any manual operations across the enterprise. The supplier must ordinarily operate with agile business analysis and QA through the application of techniques such as BDD. Agile ceremonies and processes will be adhered to and continuously improved through retrospectives. See Cultural Fit also.
- Security clearance
Clearance is not required.
Supplier should have a satisfactory clearance (Level 2+) against NHS IG Toolkit, and be ICO registered.
Supplier resources are required to complete NHS Improvement IG training to a satisfactory standard and may need to sign specific DSA/NDA.
IS027001 & experience of handling sensitive data is desirable.
- Additional terms and conditions
All IPR will be retained by NHS Improvement.
No license or permission to use the artefacts delivered by the Supplier is granted except insofar as to deliver the requirements of this Agreement.
Skills and experience
Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.
- Essential skills and experience
- Demonstrate strong expertise and experience in Agile product development in line with GDS standards, including Business Analysis, Product Management, Development & QA.
- Demonstrate strong expertise and experience in User Research, UX and delivery of user focused, data driven products at scale.
- Demonstrate strong expertise and experience in Microsoft APS and Cloud development including AzureDW, data bricks, data lake, CosmosDB, , Alteryx, Blob Storage, IOTEvent Hub, data factory.
- Demonstrate strong expertise and experience in developing scalable Web Services (Web & logic apps, API Manager, Azure Functions): Azure infrastructure services (Traffic manager).
- Demonstrate strong expertise and experience in developing digital applications utilising the following components: Okta identity and access management; Single Page Applications and; Open source CMS wagtail.
- Demonstrate strong expertise and experience in CI and DevOps experience using a variety of tools and techniques to include, as a minimum: Azure DevOps CI/CD, Powershell, ARM Templates, Selenium, JMeter.
- Demonstrate strong expertise and experience in developing data warehouses hosting NHS datasets with demonstrable experience in understanding the content and governance requirements of NHS data.
- Demonstrate strong expertise and experience in architecting, developing and optimising data loads into a Data Vault architecture.
- Demonstrate strong expertise and experience in developoing using BIML frameworks in a production setting.
- Demonstrate strong expertise and experience in developing with Tableau and Alteryx.
- Demonstrate strong expertise and experience in implementing, maintaining, enhancing and utilising, highly effective automated testing frameworks.
- Demonstrate strong expertise and experience in data science with a proven track-record in drawing intelligence out of data.
- Nice-to-have skills and experience
- Demonstrate at least five years experience of building secure, performant APIs for Big Data / Data Warehouse solutions
How suppliers will be evaluated
- How many suppliers to evaluate
- Proposal criteria
- Demonstration of depth of understanding of our product environment, architecture and development model, in line with DHSC and GDS controls. (20 points).
- Detail you approach and methodology to deliver our requirements. (20 points).
- Demonstrate your technical approach, expertise and experience in producing Data and Analytics driven products in an NHS setting. How will this translate to optimum outcomes here (40 points).
- Provide your team stucture, including roles, key personnel and CVs of proposed resources. Describe flexibility and depth of resources over the course of the delivery. (40 points).
- Demonstrate the capabilities of your delivery partners and supply chain in supporting our requirements, including niche solutions. Describe your associated contracting arrangements. (20 points).
- Provide your high-level approach for the transition of services from other suppliers. (20 points).
- Identify risks and dependencies and proposed mitigations to manage them. (20 points).
- When responding to the Proposal Criteria, shortlisted suppliers must address the technical requirements and other relevent information provided throughout this notice and within supporting materials / Q&A (N/A Points).
- Cultural fit criteria
- Work in cross functional teams supporting product development initiatives and integration work alongside other suppliers.
- Manage delivery in an Agile environment. Commercial and legal governance must support agile delivery.
- Share knowledge, experience and skills with other team members so as to build sustainable capability.
- Payment approach
- Capped time and materials
- Assessment methods
- Written proposal
- Case study
- Work history
- Evaluation weighting
Questions asked by suppliers
1. Can we view a list of suppliers who have expressed and interest?
(1 of 4)
2020 Delivery Ltd.
Accenture (UK) Limited
ADVENTO STAFFING LIMITED
Aire Logic Limited
AMADEUS SOFTWARE LIMITED
Answer Digital Ltd
Avenir Business Solutions Ltd
Badenoch & Clark
BAE Systems (Operations) Ltd
Ballard Chalmers Ltd
Bangura Solutions Limited
BiP Solutions Ltd
CACI UK Ltd
Capgemini UK plc
Capri Consulting Ltd
Caresoft Global Limited
Carnall Farrar Ltd
Caution Your Blast Ltd
Cigniti Technologies (UK) Limited
Code Computerlove Ltd
Cognizant Technology Solutions UK Limited
Cyient Europe Limited
2. Can we view a list of suppliers who have expressed and interest?
(2 of 4)
Digital Accessibility Centre (DAC)
Domain7 Solutions (U.K.), Ltd
Edge Health Ltd
Equal Experts UK Limited
Everest Media Ltd
Foundation SP Limited
Fujitsu Services Limited
Gartner UK Ltd.
GCS Recruitment Ltd
Gibbs Hybrid Limited
Gofore UK Limited
Grant Thornton UK LLP
Harbour Technology Limited
Hitachi Consulting UK Ltd
IBM United Kingdom Ltd
Ideal Health Consultants Limited
Identity Methods Limited
Infinity Works Consulting
Informed Solutions Ltd
Intelligent Enterprise Products
IQVIA Technology Services Limited
3. Can we view a list of suppliers who have expressed and interest?
(3 of 4)
ITPM Consulting Limited
Kainos Software Ltd
Mastek (UK) Ltd
Matrix Insight Ltd (subsidiary of Optimity Advisors)
Mendix Technology Limited
MINDVERSE CONSULTING SERVICES LIMITED
Motorola Solutions UK Limited
New Signature UK Limited
Nexify Solutions UK
Optum Health Solutions (UK) Ltd
Oxford Computer Consultants
PA Consulting Services Limited (UK)
Parity Consultancy Services Ltd
PFI Knowledge Solutions
PricewaterhouseCoopers (LLP) PwC
Public Consulting Group
Reed Professional Services
Rock Kitchen Harris Ltd
Softwire Technology Limited
SONAS Innovation Ltd.
4. Can we view a list of suppliers who have expressed and interest?
(4 of 4)
Sopra Steria Ltd
Sorsix Health UK & Ireland
South, Central and West Commissioning Support Unit
The Dextrous Web (trading as dxw digital)
The Server Labs Ltd.
Triad Group Plc
Tullo Marshall Warren Limited
UST Global Pvt Ltd
- 5. For the suppliers listed above, are capital letters significant?
- The list is alphabetical and names are shown as registered with DOS 3
- 6. Does NHS Digital deliver the core platform?
- No, this is owned by NHSI and this engagement primarily concerns development of data and analytical products that will sit on the strategic platform.
- 7. Does NHSI work closely with NHS Digital on patient data and PLICS?
PLICS is a joint project with NHS Digital. NHSD collects and holds the national data set, linking patient data and providing pseudonymisation.
NHSI delivers the processing and analytics and deliver this back to the sector.
- 8. Is there the opportunity to reuse commonality, e.g. DSP platform from NHS Digital?
- 9. How are requirements brought into NHSI, is there a strategic view or is its individual trusts?
Long term plan is a key source of strategic level requirements –we are not seeking to build products for individual trusts. There is a focus on Analytics and Benchmarking (e.g. GIRFT & ModelHospital).
Business level has several entry points, including business plans and national programmes. Throughout full life cycle there is a large portfolio of programmes for NHSE/I to deliver including ad hoc requirements. We require a flexible supplier able to accommodate short leadtimes.
This contract won’t be used for everything, e.g. we are not delivering the NHS App, but we are helping to understand how it is being used.
10. How does this relate to the other current large procurement?
(T-RES-0419-354 Data & Analytics Platform; Operations, Enhancement and Development)
The other procurement is for our core platform. This is for the end service and will bring together rainbow teams from both procured solutions, encouraging commonality to deliver data driven applications and analytics.
For information concerning the platform please refer to the slide deck and:
- 11. How do you manage the development pipeline, the proactive (head office function) vs the reactive (ad hoc request)
This is driven by both the LTP and the technology vision (through strategic, technology and information principles).
Following the Carter review, user needs translated this in to a national strategy to deliver the overarching concepts.
User research ensures the solutions are practical.
- 12. Regarding Technology, is this a hybrid across platforms and architecture? Can changes be made across both?
Architecture of a given product can be discussed (technology options analysis) but within the constraints of the overarching enterprise architecture (e.g. Azure / Tableau) so we are implementing a platform choice – not a series of individual options.
There is an Architecture Review Board to review and make such decisions, working within the parameters of benefits versus cost of change (including people costs such as end user training).
- 13. Are we looking for Agile coaching
- Yes, this will be considered but is not a significant part of our overall requirement. We are looking for people who can deliver Outcomes in an agile way.
- 14. How many simultaneous projects do you anticipate?
- Note that projects will be in different life cycles, we have roughly 25-30 programmes at any one time and less than 10 of these are large scale developments (smaller projects can include changes to live services).
- 15. Will we accept a consortium bid?
- Yes. A list of Suppliers who have expressed an interest at Shortlisting stage will be publishing via the Q&A submissions on the DOS3 portal.
- 16. Is it possible to provide indications of project duration?
- Some are long running and on-going (e.g. Model Hospital is an ongoing multi-year project. Some are up to 12 weeks (e.g. analytics to understand provider use of agency staff, plus some ongoing support requirements).
- 17. Is it possible to provide indications of project duration?
Some are long running and on-going (e.g. Model Hospital is an ongoing multi-year project. Some are up to 12 weeks (e.g. analytics to understand provider use of agency staff, plus some ongoing support requirements).
Number of sprints is managed at SOW level and is project specific. We typically have a sprint zero to spin up a given team, large programme will need longer.
- 18. How many key Suppliers do you work with.
- Three, with two others supporting specific project developments. Joint working with NHSE will increase this number required. (but they also bring capability also).
19. Is there a preference for locations?
i.e. Offshore/Onshore working.
- Offshore is in scope but needs to be quality resource. Large more critical projects will require resourcing nearer to the customer. Phase of a project is also important, discovery, BA, UX needs to be closer, back-end development to implement and QA can be off-shored.
- 20. Are all essential skills needed at the outset?
They are reflective of pending requirements and also of our ambition over the duration of the engagement. There will also be new skills required as we develop.
No listed, but of importance is being able to advise on Architecture and help us innovate (not just work under our direction).
When deciding to bid, Suppliers should be confident they can meet (through provision of strong summary examples) all the essential skills and experience listed – if you Meet (score 2 ) or Exceed (score 3) in all bar one, you cannot be one for the (up to) five shortlisted.
- 21. How do we connect with other suppliers regarding a consortium?
- Please refer to the supplier stating those who expressed an interest - contact details will not be shared.
- 22. Does the “Additional Information” in the Essentials section of the slide deck require completing.
- No, this additional information didn’t feature as a separate criterion to be satisfied on the portal.
- 23. What is the deadline for submitting questions?
23:59 27/05/19 for Q&A. The portal does not allow for bank holidays so additional questions will be accepted up to noon on 29/05/19.
Note the timing for the shortlist submission is 23:59 on 03/06/19 and at the RFP stage this is NOON 02/07/19
- 24. The Supplier Interviews are scheduled for the 12 July which conflicts with a national Agile conference. Can the date be changed?
- This will be reviewed and we will advise the (up to) five Suppliers who are shortlisted
- 25. Who are the evaluation Panel?
The panel is likely to be the same for both stages (although we reserve the right to amend this), consisting of;
Director (Data and Development)
Associate Director, Data and Development
Associate Director of Architecture
Head of Data Services