Awarded to PA Consulting Services Limited (UK)

Start date: Monday 28 October 2019
Value: £4,500,000
Company size: large

NHS Improvement - NHS Trust Development Authority is the contracting authority.

NHS Improvement: Data & Analytics Driven Product Development

42 Incomplete applications

26 SME, 16 large

22 Completed applications

10 SME, 12 large

• Published: Monday 20 May 2019
• Deadline for asking questions: Monday 27 May 2019 at 11:59pm GMT
• Closing date for applications: Monday 3 June 2019 at 11:59pm GMT

Overview

• Summary of the work: Information and analytics are a critical for delivery of outcomes within the NHS Long-Term Plan. NHSI and NHSE require new data driven digital products, building on NHSI's existing platform of loosely coupled, highly aligned services. A Suppliers' Briefing Teleconference is scheduled for 22/05/19 at 15:30 (log in for details)
• Latest start date: Thursday 1 August 2019
• Expected contract length: 2 years
• Location: London
• Organisation the work is for: NHS Improvement - NHS Trust Development Authority is the contracting authority.
• Budget range: Up to £4,500,000 inclusive of expenses and excluding VAT. This is an overriding total budget with individual Statements of Work to be agreed per specific outcome requirement.; ; The business case for this requirement is approved.

About the work

• Why the work is being done: Information and analytics are a critical for delivery of outcomes within the NHS Long-Term Plan. As NHS Improvement (NHSI) comes together with NHS England (NHSE), new data driven digital products will be required. These will build on NHSI's existing platform of loosely coupled, highly aligned services. NHS Improvement has a need for primary support for analytical and digital product development, acting as lead partner encompassing the full life-cycle including GDS skills in taking complex project through discovery to live. While not an exclusive relationship, a core partner is required to enable speed of delivery across multiple related strands of work.
• Problem to be solved: NHS Improvement requires a delivery partner to work within agile delivery teams to enable the NHS to leverage data to support improvement. The partner will provide full-stack delivery from user research through mart development and front end delivery in Tableau and Digital web technologies. Operating to support a self-serve analytics and product alongside an operations partner to ensure the platform meets product owner needs. NHS Improvement requires highly competent, specialised resources to rapidly mobiles to deliver a full-service offering from discovery and user research through to data engineering and interface delivery in an interoperable and transparent environment.
• Who the users are and what they need to do: As Senior Responsible Officer (SRO), I need highly competent teams to deliver at pace, within defined enterprise architecture constraints, with user led focus, agile iterative improvement and a continuous delivery model with full automation, assured, containerised deployment and transparency. As a Product Manager, I need to rapidly mobilise highly skilled resources to deliver key outcomes with assurance that they will operate effectively within the wider architecture and operational delivery model. As an analyst, I need expert data engineering support to provide me with the information I need, readily available, catalogued and with clear provenance, irrespective of source, product or interface.
• Early market engagement: A Market Alert Notice was emailed to all suppliers registered on DOS3 Outcomes.; ; A Suppliers' Briefing Teleconference is scheduled for Wednesday 22 May, 15:30. Details on how to register your interest in attending is provided in the Market Alert and on this portal (log in required).
• Any work that’s already been done: The data and development platform is a live service of components underpinning several verticals such as Model Hospital, Provider Finance Monitoring, GIRFT and A&E Dashboard. The core infrastructure is on-premise with varying degrees of automation and use of cloud technologies. The platform comprises the Microsoft Analytics Platform System, utilities such as Alteryx & Tableau, SAML based identity management, Microsoft Azure components (DW, Cosmos DB, APIM & Data Factory), BIML MIST, .NET applications and Python/Django CMS. Products will reuse and extend the core platform and be supported by another partner supplier.
• Existing team: Product and operations teams in NHSI are comprised of both permanent employees and supplier staff. NHSI has approximately 60 internal technical staff working to deliver and support data drive products and analytics. At any one time, there are an approximately similar number of supplier-based staff working on projects across 3-5 key suppliers. Any successful partner would be expected to work in rainbow teams will other suppliers and internal staff. Teams are cross-functional and blended, enabling agile product development and knowledge-sharing while minimising single points of failure.
• Current phase: Not applicable

Work setup

• Address where the work will take place: The customer is central London based and there is a requirement to work on site. Aspects of the work may also be delivered in Leeds.; ; NHS Improvement requires a supplier who can provide a high quality and cost-effective delivery model as prime partner with access to specialist skills at key points along delivery. Given the user centric nature of digital development, key resources will need to work alongside key customers, wherever they are based. However, teams may augment on-site resources with near/off-shore resources to provide an improved blended cost model.
• Working arrangements: Continuous improvement and agility through the application of agile tools and techniques in an environment where Quality Assurance is embedded in all processes from requirements gathering to development and delivery. Team members will be expected to work with and play a key role in implementing continuous integration and delivery pipelines and, where possible, automate any manual operations across the enterprise. The supplier must ordinarily operate with agile business analysis and QA through the application of techniques such as BDD. Agile ceremonies and processes will be adhered to and continuously improved through retrospectives. See Cultural Fit also.
• Security clearance: Clearance is not required.; ; Supplier should have a satisfactory clearance (Level 2+) against NHS IG Toolkit, and be ICO registered. ; ; Supplier resources are required to complete NHS Improvement IG training to a satisfactory standard and may need to sign specific DSA/NDA.; ; IS027001 & experience of handling sensitive data is desirable.

Additional information

• Additional terms and conditions: All IPR will be retained by NHS Improvement. ; ; No license or permission to use the artefacts delivered by the Supplier is granted except insofar as to deliver the requirements of this Agreement.

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

• Essential skills and experience:
  • Demonstrate strong expertise and experience in Agile product development in line with GDS standards, including Business Analysis, Product Management, Development & QA.
  • Demonstrate strong expertise and experience in User Research, UX and delivery of user focused, data driven products at scale.
  • Demonstrate strong expertise and experience in Microsoft APS and Cloud development including AzureDW, data bricks, data lake, CosmosDB, , Alteryx, Blob Storage, IOTEvent Hub, data factory.
  • Demonstrate strong expertise and experience in developing scalable Web Services (Web & logic apps, API Manager, Azure Functions): Azure infrastructure services (Traffic manager).
  • Demonstrate strong expertise and experience in developing digital applications utilising the following components: Okta identity and access management; Single Page Applications and; Open source CMS wagtail.
  • Demonstrate strong expertise and experience in CI and DevOps experience using a variety of tools and techniques to include, as a minimum: Azure DevOps CI/CD, Powershell, ARM Templates, Selenium, JMeter.
  • Demonstrate strong expertise and experience in developing data warehouses hosting NHS datasets with demonstrable experience in understanding the content and governance requirements of NHS data.
  • Demonstrate strong expertise and experience in architecting, developing and optimising data loads into a Data Vault architecture.
  • Demonstrate strong expertise and experience in developoing using BIML frameworks in a production setting.
  • Demonstrate strong expertise and experience in developing with Tableau and Alteryx.
  • Demonstrate strong expertise and experience in implementing, maintaining, enhancing and utilising, highly effective automated testing frameworks.
  • Demonstrate strong expertise and experience in data science with a proven track-record in drawing intelligence out of data.
• Nice-to-have skills and experience: Demonstrate at least five years experience of building secure, performant APIs for Big Data / Data Warehouse solutions

How suppliers will be evaluated

• How many suppliers to evaluate: 5
• Proposal criteria:
  • Demonstration of depth of understanding of our product environment, architecture and development model, in line with DHSC and GDS controls. (20 points).
  • Detail you approach and methodology to deliver our requirements. (20 points).
  • Demonstrate your technical approach, expertise and experience in producing Data and Analytics driven products in an NHS setting. How will this translate to optimum outcomes here (40 points).
  • Provide your team stucture, including roles, key personnel and CVs of proposed resources. Describe flexibility and depth of resources over the course of the delivery. (40 points).
  • Demonstrate the capabilities of your delivery partners and supply chain in supporting our requirements, including niche solutions. Describe your associated contracting arrangements. (20 points).
  • Provide your high-level approach for the transition of services from other suppliers. (20 points).
  • Identify risks and dependencies and proposed mitigations to manage them. (20 points).
  • When responding to the Proposal Criteria, shortlisted suppliers must address the technical requirements and other relevent information provided throughout this notice and within supporting materials / Q&A (N/A Points).
• Cultural fit criteria:
  • Work in cross functional teams supporting product development initiatives and integration work alongside other suppliers.
  • Manage delivery in an Agile environment. Commercial and legal governance must support agile delivery.
  • Share knowledge, experience and skills with other team members so as to build sustainable capability.
• Payment approach: Capped time and materials
• Assessment methods:
  • Written proposal
  • Case study
  • Work history
  • Reference
  • Presentation
• Evaluation weighting:

  Technical competence

  60%

  Cultural fit

  10%

  Price

  30%

Questions asked by suppliers

• 1. Can we view a list of suppliers who have expressed and interest? (1 of 4): 2020 Delivery Ltd.; Accedia; Accenture (UK) Limited; Actica Consulting; AdRoc Group; ADVENTO STAFFING LIMITED; Agilisys Ltd; AiM Ltd; Aire Logic Limited ; AirWalk Consulting; Allot Limited; Alscient Limited; AMADEUS SOFTWARE LIMITED; Answer Digital Ltd; Arissian Ltd; Automation Consultants; Automation Logic; Avenir Business Solutions Ltd; Badenoch & Clark; BAE Systems (Operations) Ltd; Ballard Chalmers Ltd; Bangura Solutions Limited; BiP Solutions Ltd; BJSS Limited; CACI UK Ltd; Capgemini UK plc; Capri Consulting Ltd; Caresoft Global Limited; Carnall Farrar Ltd; Carve Consulting; Caution Your Blast Ltd; Cigniti Technologies (UK) Limited; CIVIC; Code Computerlove Ltd; Cognizant Technology Solutions UK Limited; Conceptare; Cyient Europe Limited
• 2. Can we view a list of suppliers who have expressed and interest? (2 of 4): Deloitte LLP; Digital Accessibility Centre (DAC); DMW Group; Domain7 Solutions (U.K.), Ltd; ecce.; Ecorys UK; Edge Health Ltd; Elastacloud Limited; EMIS Ltd; Equal Experts UK Limited; Everest Media Ltd; FDM GROUP; Foundation SP Limited; Frazer-Nash Consultancy; Fujitsu Services Limited; FUTUREGOV. LTD; Gartner UK Ltd.; GCS Recruitment Ltd; Gibbs Hybrid Limited; Gofore UK Limited; Grant Thornton UK LLP; Harbour Technology Limited; Harmonic Limited; Hitachi Consulting UK Ltd; IBM United Kingdom Ltd; Ideal Health Consultants Limited; Identity Methods Limited; Incremental Group; Infinity Works Consulting; Information DataHub; Informed Solutions Ltd; Innovecs; Intelligent Enterprise Products; Invenica Ltd; IQVIA Technology Services Limited
• 3. Can we view a list of suppliers who have expressed and interest? (3 of 4): ITPM Consulting Limited; Kainos Software Ltd; KBR UK; Keytree Limited; KPMG LLP; Mastek (UK) Ltd; Matrix Insight Ltd (subsidiary of Optimity Advisors); Mendix Technology Limited; Microsoft Limited; MINDVERSE CONSULTING SERVICES LIMITED; Mitra Innovation; MMT Digital; Motorola Solutions UK Limited; Mozaic-Services Limited; Net Consulting; New Signature UK Limited; Nexify Solutions UK; Novabase; novi.digital; Optum Health Solutions (UK) Ltd; Oxford Computer Consultants; PA Consulting Services Limited (UK); Parity Consultancy Services Ltd; PFI Knowledge Solutions; PJCVISION; PricewaterhouseCoopers (LLP) PwC; Public Consulting Group; Reed Professional Services; risual Ltd; Rock Kitchen Harris Ltd; Shout Digital; Softwire Technology Limited; SONAS Innovation Ltd.
• 4. Can we view a list of suppliers who have expressed and interest? (4 of 4): Sopra Steria Ltd; Sorsix Health UK & Ireland; South, Central and West Commissioning Support Unit; Spring Technology; TCS; Tecknuovo Ltd; TerraQuest; The Dextrous Web (trading as dxw digital) ; The Server Labs Ltd.; Torchbox Ltd; Triad Group Plc; Tullo Marshall Warren Limited; UST Global Pvt Ltd; Valtech Ltd.; Visionist; Zaizi Limited
• 5. For the suppliers listed above, are capital letters significant?: The list is alphabetical and names are shown as registered with DOS 3
• 6. Does NHS Digital deliver the core platform?: No, this is owned by NHSI and this engagement primarily concerns development of data and analytical products that will sit on the strategic platform.
• 7. Does NHSI work closely with NHS Digital on patient data and PLICS?: PLICS is a joint project with NHS Digital. NHSD collects and holds the national data set, linking patient data and providing pseudonymisation.; NHSI delivers the processing and analytics and deliver this back to the sector.
• 8. Is there the opportunity to reuse commonality, e.g. DSP platform from NHS Digital?: Yes
• 9. How are requirements brought into NHSI, is there a strategic view or is its individual trusts?: Long term plan is a key source of strategic level requirements –we are not seeking to build products for individual trusts. There is a focus on Analytics and Benchmarking (e.g. GIRFT & ModelHospital).; ; Business level has several entry points, including business plans and national programmes. Throughout full life cycle there is a large portfolio of programmes for NHSE/I to deliver including ad hoc requirements. We require a flexible supplier able to accommodate short leadtimes.; ; This contract won’t be used for everything, e.g. we are not delivering the NHS App, but we are helping to understand how it is being used.
• 10. How does this relate to the other current large procurement?(T-RES-0419-354 Data & Analytics Platform; Operations, Enhancement and Development): The other procurement is for our core platform. This is for the end service and will bring together rainbow teams from both procured solutions, encouraging commonality to deliver data driven applications and analytics.; For information concerning the platform please refer to the slide deck and:; https://www.digitalmarketplace.service.gov.uk/digital-outcomes-and-specialists/opportunities/9509
• 11. How do you manage the development pipeline, the proactive (head office function) vs the reactive (ad hoc request): This is driven by both the LTP and the technology vision (through strategic, technology and information principles).; Following the Carter review, user needs translated this in to a national strategy to deliver the overarching concepts.; User research ensures the solutions are practical.
• 12. Regarding Technology, is this a hybrid across platforms and architecture? Can changes be made across both?: Architecture of a given product can be discussed (technology options analysis) but within the constraints of the overarching enterprise architecture (e.g. Azure / Tableau) so we are implementing a platform choice – not a series of individual options.; There is an Architecture Review Board to review and make such decisions, working within the parameters of benefits versus cost of change (including people costs such as end user training).
• 13. Are we looking for Agile coaching: Yes, this will be considered but is not a significant part of our overall requirement. We are looking for people who can deliver Outcomes in an agile way.
• 14. How many simultaneous projects do you anticipate?: Note that projects will be in different life cycles, we have roughly 25-30 programmes at any one time and less than 10 of these are large scale developments (smaller projects can include changes to live services).
• 15. Will we accept a consortium bid?: Yes. A list of Suppliers who have expressed an interest at Shortlisting stage will be publishing via the Q&A submissions on the DOS3 portal.
• 16. Is it possible to provide indications of project duration?: Some are long running and on-going (e.g. Model Hospital is an ongoing multi-year project. Some are up to 12 weeks (e.g. analytics to understand provider use of agency staff, plus some ongoing support requirements).
• 17. Is it possible to provide indications of project duration?: Some are long running and on-going (e.g. Model Hospital is an ongoing multi-year project. Some are up to 12 weeks (e.g. analytics to understand provider use of agency staff, plus some ongoing support requirements).; Number of sprints is managed at SOW level and is project specific. We typically have a sprint zero to spin up a given team, large programme will need longer.
• 18. How many key Suppliers do you work with.: Three, with two others supporting specific project developments. Joint working with NHSE will increase this number required. (but they also bring capability also).
• 19. Is there a preference for locations? i.e. Offshore/Onshore working.: Offshore is in scope but needs to be quality resource. Large more critical projects will require resourcing nearer to the customer. Phase of a project is also important, discovery, BA, UX needs to be closer, back-end development to implement and QA can be off-shored.
• 20. Are all essential skills needed at the outset?: They are reflective of pending requirements and also of our ambition over the duration of the engagement. There will also be new skills required as we develop.; No listed, but of importance is being able to advise on Architecture and help us innovate (not just work under our direction).; When deciding to bid, Suppliers should be confident they can meet (through provision of strong summary examples) all the essential skills and experience listed – if you Meet (score 2 ) or Exceed (score 3) in all bar one, you cannot be one for the (up to) five shortlisted.
• 21. How do we connect with other suppliers regarding a consortium?: Please refer to the supplier stating those who expressed an interest - contact details will not be shared.
• 22. Does the “Additional Information” in the Essentials section of the slide deck require completing.: No, this additional information didn’t feature as a separate criterion to be satisfied on the portal.
• 23. What is the deadline for submitting questions?: 23:59 27/05/19 for Q&A. The portal does not allow for bank holidays so additional questions will be accepted up to noon on 29/05/19. ; Note the timing for the shortlist submission is 23:59 on 03/06/19 and at the RFP stage this is NOON 02/07/19
• 24. The Supplier Interviews are scheduled for the 12 July which conflicts with a national Agile conference. Can the date be changed?: This will be reviewed and we will advise the (up to) five Suppliers who are shortlisted
• 25. Who are the evaluation Panel?: The panel is likely to be the same for both stages (although we reserve the right to amend this), consisting of;; Director (Data and Development) ; Associate Director, Data and Development; Associate Director of Architecture ; Head of Data Services