NHS Improvement - NHS Trust Development Authority is the contracting authority.

NHS Improvement: Data & Analytics Driven Product Development

Incomplete applications

42
Incomplete applications
27 SME, 15 large

Completed applications

22
Completed applications
11 SME, 11 large
Important dates
Opportunity attribute name Opportunity attribute value
Published Monday 20 May 2019
Deadline for asking questions Monday 27 May 2019 at 11:59pm GMT
Closing date for applications Monday 3 June 2019 at 11:59pm GMT

Overview

Overview
Opportunity attribute name Opportunity attribute value
Summary of the work Information and analytics are a critical for delivery of outcomes within the NHS Long-Term Plan. NHSI and NHSE require new data driven digital products, building on NHSI's existing platform of loosely coupled, highly aligned services. A Suppliers' Briefing Teleconference is scheduled for 22/05/19 at 15:30 (log in for details)
Latest start date Thursday 1 August 2019
Expected contract length 2 years
Location London
Organisation the work is for NHS Improvement - NHS Trust Development Authority is the contracting authority.
Budget range Up to £4,500,000 inclusive of expenses and excluding VAT. This is an overriding total budget with individual Statements of Work to be agreed per specific outcome requirement.

The business case for this requirement is approved.

About the work

About the work
Opportunity attribute name Opportunity attribute value
Why the work is being done Information and analytics are a critical for delivery of outcomes within the NHS Long-Term Plan. As NHS Improvement (NHSI) comes together with NHS England (NHSE), new data driven digital products will be required. These will build on NHSI's existing platform of loosely coupled, highly aligned services. NHS Improvement has a need for primary support for analytical and digital product development, acting as lead partner encompassing the full life-cycle including GDS skills in taking complex project through discovery to live. While not an exclusive relationship, a core partner is required to enable speed of delivery across multiple related strands of work.
Problem to be solved NHS Improvement requires a delivery partner to work within agile delivery teams to enable the NHS to leverage data to support improvement. The partner will provide full-stack delivery from user research through mart development and front end delivery in Tableau and Digital web technologies. Operating to support a self-serve analytics and product alongside an operations partner to ensure the platform meets product owner needs. NHS Improvement requires highly competent, specialised resources to rapidly mobiles to deliver a full-service offering from discovery and user research through to data engineering and interface delivery in an interoperable and transparent environment.
Who the users are and what they need to do As Senior Responsible Officer (SRO), I need highly competent teams to deliver at pace, within defined enterprise architecture constraints, with user led focus, agile iterative improvement and a continuous delivery model with full automation, assured, containerised deployment and transparency. As a Product Manager, I need to rapidly mobilise highly skilled resources to deliver key outcomes with assurance that they will operate effectively within the wider architecture and operational delivery model. As an analyst, I need expert data engineering support to provide me with the information I need, readily available, catalogued and with clear provenance, irrespective of source, product or interface.
Early market engagement A Market Alert Notice was emailed to all suppliers registered on DOS3 Outcomes.

A Suppliers' Briefing Teleconference is scheduled for Wednesday 22 May, 15:30. Details on how to register your interest in attending is provided in the Market Alert and on this portal (log in required).
Any work that’s already been done The data and development platform is a live service of components underpinning several verticals such as Model Hospital, Provider Finance Monitoring, GIRFT and A&E Dashboard. The core infrastructure is on-premise with varying degrees of automation and use of cloud technologies. The platform comprises the Microsoft Analytics Platform System, utilities such as Alteryx & Tableau, SAML based identity management, Microsoft Azure components (DW, Cosmos DB, APIM & Data Factory), BIML MIST, .NET applications and Python/Django CMS. Products will reuse and extend the core platform and be supported by another partner supplier.
Existing team Product and operations teams in NHSI are comprised of both permanent employees and supplier staff. NHSI has approximately 60 internal technical staff working to deliver and support data drive products and analytics. At any one time, there are an approximately similar number of supplier-based staff working on projects across 3-5 key suppliers. Any successful partner would be expected to work in rainbow teams will other suppliers and internal staff. Teams are cross-functional and blended, enabling agile product development and knowledge-sharing while minimising single points of failure.
Current phase Not applicable

Work setup

Work setup
Opportunity attribute name Opportunity attribute value
Address where the work will take place The customer is central London based and there is a requirement to work on site. Aspects of the work may also be delivered in Leeds.

NHS Improvement requires a supplier who can provide a high quality and cost-effective delivery model as prime partner with access to specialist skills at key points along delivery. Given the user centric nature of digital development, key resources will need to work alongside key customers, wherever they are based. However, teams may augment on-site resources with near/off-shore resources to provide an improved blended cost model.
Working arrangements Continuous improvement and agility through the application of agile tools and techniques in an environment where Quality Assurance is embedded in all processes from requirements gathering to development and delivery. Team members will be expected to work with and play a key role in implementing continuous integration and delivery pipelines and, where possible, automate any manual operations across the enterprise. The supplier must ordinarily operate with agile business analysis and QA through the application of techniques such as BDD. Agile ceremonies and processes will be adhered to and continuously improved through retrospectives. See Cultural Fit also.
Security clearance Clearance is not required.

Supplier should have a satisfactory clearance (Level 2+) against NHS IG Toolkit, and be ICO registered.

Supplier resources are required to complete NHS Improvement IG training to a satisfactory standard and may need to sign specific DSA/NDA.

IS027001 & experience of handling sensitive data is desirable.

Additional information

Additional information
Opportunity attribute name Opportunity attribute value
Additional terms and conditions All IPR will be retained by NHS Improvement.

No license or permission to use the artefacts delivered by the Supplier is granted except insofar as to deliver the requirements of this Agreement.

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Skills and experience
Opportunity attribute name Opportunity attribute value
Essential skills and experience
  • Demonstrate strong expertise and experience in Agile product development in line with GDS standards, including Business Analysis, Product Management, Development & QA.
  • Demonstrate strong expertise and experience in User Research, UX and delivery of user focused, data driven products at scale.
  • Demonstrate strong expertise and experience in Microsoft APS and Cloud development including AzureDW, data bricks, data lake, CosmosDB, , Alteryx, Blob Storage, IOTEvent Hub, data factory.
  • Demonstrate strong expertise and experience in developing scalable Web Services (Web & logic apps, API Manager, Azure Functions): Azure infrastructure services (Traffic manager).
  • Demonstrate strong expertise and experience in developing digital applications utilising the following components: Okta identity and access management; Single Page Applications and; Open source CMS wagtail.
  • Demonstrate strong expertise and experience in CI and DevOps experience using a variety of tools and techniques to include, as a minimum: Azure DevOps CI/CD, Powershell, ARM Templates, Selenium, JMeter.
  • Demonstrate strong expertise and experience in developing data warehouses hosting NHS datasets with demonstrable experience in understanding the content and governance requirements of NHS data.
  • Demonstrate strong expertise and experience in architecting, developing and optimising data loads into a Data Vault architecture.
  • Demonstrate strong expertise and experience in developoing using BIML frameworks in a production setting.
  • Demonstrate strong expertise and experience in developing with Tableau and Alteryx.
  • Demonstrate strong expertise and experience in implementing, maintaining, enhancing and utilising, highly effective automated testing frameworks.
  • Demonstrate strong expertise and experience in data science with a proven track-record in drawing intelligence out of data.
Nice-to-have skills and experience Demonstrate at least five years experience of building secure, performant APIs for Big Data / Data Warehouse solutions

How suppliers will be evaluated

How suppliers will be evaluated
Opportunity attribute name Opportunity attribute value
How many suppliers to evaluate 5
Proposal criteria
  • Demonstration of depth of understanding of our product environment, architecture and development model, in line with DHSC and GDS controls. (20 points).
  • Detail you approach and methodology to deliver our requirements. (20 points).
  • Demonstrate your technical approach, expertise and experience in producing Data and Analytics driven products in an NHS setting. How will this translate to optimum outcomes here (40 points).
  • Provide your team stucture, including roles, key personnel and CVs of proposed resources. Describe flexibility and depth of resources over the course of the delivery. (40 points).
  • Demonstrate the capabilities of your delivery partners and supply chain in supporting our requirements, including niche solutions. Describe your associated contracting arrangements. (20 points).
  • Provide your high-level approach for the transition of services from other suppliers. (20 points).
  • Identify risks and dependencies and proposed mitigations to manage them. (20 points).
  • When responding to the Proposal Criteria, shortlisted suppliers must address the technical requirements and other relevent information provided throughout this notice and within supporting materials / Q&A (N/A Points).
Cultural fit criteria
  • Work in cross functional teams supporting product development initiatives and integration work alongside other suppliers.
  • Manage delivery in an Agile environment. Commercial and legal governance must support agile delivery.
  • Share knowledge, experience and skills with other team members so as to build sustainable capability.
Payment approach Capped time and materials
Assessment methods
  • Written proposal
  • Case study
  • Work history
  • Reference
  • Presentation
Evaluation weighting

Technical competence

60%

Cultural fit

10%

Price

30%

Questions asked by suppliers

Questions asked by suppliers
Supplier question Buyer answer
1. Can we view a list of suppliers who have expressed and interest?
(1 of 4)
2020 Delivery Ltd.
Accedia
Accenture (UK) Limited
Actica Consulting
AdRoc Group
ADVENTO STAFFING LIMITED
Agilisys Ltd
AiM Ltd
Aire Logic Limited
AirWalk Consulting
Allot Limited
Alscient Limited
AMADEUS SOFTWARE LIMITED
Answer Digital Ltd
Arissian Ltd
Automation Consultants
Automation Logic
Avenir Business Solutions Ltd
Badenoch & Clark
BAE Systems (Operations) Ltd
Ballard Chalmers Ltd
Bangura Solutions Limited
BiP Solutions Ltd
BJSS Limited
CACI UK Ltd
Capgemini UK plc
Capri Consulting Ltd
Caresoft Global Limited
Carnall Farrar Ltd
Carve Consulting
Caution Your Blast Ltd
Cigniti Technologies (UK) Limited
CIVIC
Code Computerlove Ltd
Cognizant Technology Solutions UK Limited
Conceptare
Cyient Europe Limited
2. Can we view a list of suppliers who have expressed and interest?
(2 of 4)
Deloitte LLP
Digital Accessibility Centre (DAC)
DMW Group
Domain7 Solutions (U.K.), Ltd
ecce.
Ecorys UK
Edge Health Ltd
Elastacloud Limited
EMIS Ltd
Equal Experts UK Limited
Everest Media Ltd
FDM GROUP
Foundation SP Limited
Frazer-Nash Consultancy
Fujitsu Services Limited
FUTUREGOV. LTD
Gartner UK Ltd.
GCS Recruitment Ltd
Gibbs Hybrid Limited
Gofore UK Limited
Grant Thornton UK LLP
Harbour Technology Limited
Harmonic Limited
Hitachi Consulting UK Ltd
IBM United Kingdom Ltd
Ideal Health Consultants Limited
Identity Methods Limited
Incremental Group
Infinity Works Consulting
Information DataHub
Informed Solutions Ltd
Innovecs
Intelligent Enterprise Products
Invenica Ltd
IQVIA Technology Services Limited
3. Can we view a list of suppliers who have expressed and interest?
(3 of 4)
ITPM Consulting Limited
Kainos Software Ltd
KBR UK
Keytree Limited
KPMG LLP
Mastek (UK) Ltd
Matrix Insight Ltd (subsidiary of Optimity Advisors)
Mendix Technology Limited
Microsoft Limited
MINDVERSE CONSULTING SERVICES LIMITED
Mitra Innovation
MMT Digital
Motorola Solutions UK Limited
Mozaic-Services Limited
Net Consulting
New Signature UK Limited
Nexify Solutions UK
Novabase
novi.digital
Optum Health Solutions (UK) Ltd
Oxford Computer Consultants
PA Consulting Services Limited (UK)
Parity Consultancy Services Ltd
PFI Knowledge Solutions
PJCVISION
PricewaterhouseCoopers (LLP) PwC
Public Consulting Group
Reed Professional Services
risual Ltd
Rock Kitchen Harris Ltd
Shout Digital
Softwire Technology Limited
SONAS Innovation Ltd.
4. Can we view a list of suppliers who have expressed and interest?
(4 of 4)
Sopra Steria Ltd
Sorsix Health UK & Ireland
South, Central and West Commissioning Support Unit
Spring Technology
TCS
Tecknuovo Ltd
TerraQuest
The Dextrous Web (trading as dxw digital)
The Server Labs Ltd.
Torchbox Ltd
Triad Group Plc
Tullo Marshall Warren Limited
UST Global Pvt Ltd
Valtech Ltd.
Visionist
Zaizi Limited
5. For the suppliers listed above, are capital letters significant? The list is alphabetical and names are shown as registered with DOS 3
6. Does NHS Digital deliver the core platform? No, this is owned by NHSI and this engagement primarily concerns development of data and analytical products that will sit on the strategic platform.
7. Does NHSI work closely with NHS Digital on patient data and PLICS? PLICS is a joint project with NHS Digital. NHSD collects and holds the national data set, linking patient data and providing pseudonymisation.
NHSI delivers the processing and analytics and deliver this back to the sector.
8. Is there the opportunity to reuse commonality, e.g. DSP platform from NHS Digital? Yes
9. How are requirements brought into NHSI, is there a strategic view or is its individual trusts? Long term plan is a key source of strategic level requirements –we are not seeking to build products for individual trusts. There is a focus on Analytics and Benchmarking (e.g. GIRFT & ModelHospital).

Business level has several entry points, including business plans and national programmes. Throughout full life cycle there is a large portfolio of programmes for NHSE/I to deliver including ad hoc requirements. We require a flexible supplier able to accommodate short leadtimes.

This contract won’t be used for everything, e.g. we are not delivering the NHS App, but we are helping to understand how it is being used.
10. How does this relate to the other current large procurement?
(T-RES-0419-354 Data & Analytics Platform; Operations, Enhancement and Development)
The other procurement is for our core platform. This is for the end service and will bring together rainbow teams from both procured solutions, encouraging commonality to deliver data driven applications and analytics.
For information concerning the platform please refer to the slide deck and:
https://www.digitalmarketplace.service.gov.uk/digital-outcomes-and-specialists/opportunities/9509
11. How do you manage the development pipeline, the proactive (head office function) vs the reactive (ad hoc request) This is driven by both the LTP and the technology vision (through strategic, technology and information principles).
Following the Carter review, user needs translated this in to a national strategy to deliver the overarching concepts.
User research ensures the solutions are practical.
12. Regarding Technology, is this a hybrid across platforms and architecture? Can changes be made across both? Architecture of a given product can be discussed (technology options analysis) but within the constraints of the overarching enterprise architecture (e.g. Azure / Tableau) so we are implementing a platform choice – not a series of individual options.
There is an Architecture Review Board to review and make such decisions, working within the parameters of benefits versus cost of change (including people costs such as end user training).
13. Are we looking for Agile coaching Yes, this will be considered but is not a significant part of our overall requirement. We are looking for people who can deliver Outcomes in an agile way.
14. How many simultaneous projects do you anticipate? Note that projects will be in different life cycles, we have roughly 25-30 programmes at any one time and less than 10 of these are large scale developments (smaller projects can include changes to live services).
15. Will we accept a consortium bid? Yes. A list of Suppliers who have expressed an interest at Shortlisting stage will be publishing via the Q&A submissions on the DOS3 portal.
16. Is it possible to provide indications of project duration? Some are long running and on-going (e.g. Model Hospital is an ongoing multi-year project. Some are up to 12 weeks (e.g. analytics to understand provider use of agency staff, plus some ongoing support requirements).
17. Is it possible to provide indications of project duration? Some are long running and on-going (e.g. Model Hospital is an ongoing multi-year project. Some are up to 12 weeks (e.g. analytics to understand provider use of agency staff, plus some ongoing support requirements).
Number of sprints is managed at SOW level and is project specific. We typically have a sprint zero to spin up a given team, large programme will need longer.
18. How many key Suppliers do you work with. Three, with two others supporting specific project developments. Joint working with NHSE will increase this number required. (but they also bring capability also).
19. Is there a preference for locations?
i.e. Offshore/Onshore working.
Offshore is in scope but needs to be quality resource. Large more critical projects will require resourcing nearer to the customer. Phase of a project is also important, discovery, BA, UX needs to be closer, back-end development to implement and QA can be off-shored.
20. Are all essential skills needed at the outset? They are reflective of pending requirements and also of our ambition over the duration of the engagement. There will also be new skills required as we develop.
No listed, but of importance is being able to advise on Architecture and help us innovate (not just work under our direction).
When deciding to bid, Suppliers should be confident they can meet (through provision of strong summary examples) all the essential skills and experience listed – if you Meet (score 2 ) or Exceed (score 3) in all bar one, you cannot be one for the (up to) five shortlisted.
21. How do we connect with other suppliers regarding a consortium? Please refer to the supplier stating those who expressed an interest - contact details will not be shared.
22. Does the “Additional Information” in the Essentials section of the slide deck require completing. No, this additional information didn’t feature as a separate criterion to be satisfied on the portal.
23. What is the deadline for submitting questions? 23:59 27/05/19 for Q&A. The portal does not allow for bank holidays so additional questions will be accepted up to noon on 29/05/19.
Note the timing for the shortlist submission is 23:59 on 03/06/19 and at the RFP stage this is NOON 02/07/19
24. The Supplier Interviews are scheduled for the 12 July which conflicts with a national Agile conference. Can the date be changed? This will be reviewed and we will advise the (up to) five Suppliers who are shortlisted
25. Who are the evaluation Panel? The panel is likely to be the same for both stages (although we reserve the right to amend this), consisting of;
Director (Data and Development)
Associate Director, Data and Development
Associate Director of Architecture
Head of Data Services