This opportunity is closed for applications

The deadline was Friday 31 March 2017
Home Office - Digital Data and Technology

Home Office Digital, Data and Technology Big Data Delivery

21 Incomplete applications

12 SME, 9 large

19 Completed applications

6 SME, 13 large

Important dates

Friday 17 March 2017
Deadline for asking questions
Friday 24 March 2017 at 11:59pm GMT
Closing date for applications
Friday 31 March 2017 at 11:59pm GMT


Summary of the work
Home Office requires specialist 'Big Data' teams including architecture, development and engineering, and 3rd line support capabilities to implement and maintain Big Data solutions for portfolios, programmes and projects in a large scale transactional and analytical data environment. This will be a flexible contract with defined statements of work.
Latest start date
1st May 2017
Expected contract length
Commence no later than May 2017 and expire not later than 30th April 2019.
Organisation the work is for
Home Office - Digital Data and Technology
Budget range
The Budget range is between £6m to £8m excluding VAT for a period of 2 years.

For the purposes of the price evaluation only, it should be assumed that all team roles will be required for 100 working days.

Separate day rates for each role should be supplied, Statement of works will be agreed periodically with the supplier on a fixed price, capped, or T&M basis with agreed deliverables.

The initial statement of work is budgeted at up to £1m but will depend on the actual statement of work and deliverables agreed after contract award.

About the work

Why the work is being done
The Home Office is transforming services with the introduction of new digital systems based on Cloud and Big Data technologies. This is part of the overall business transformation to deliver digital public services and reduce costs.
Problem to be solved
To develop, implement and maintain Big Data solution for Portfolio programmes and projects, within a large scale transactional and analytical data environment, utilising cloud technologies (such as AWS, Azure) and Big Data/MPP technologies (such as Hadoop, HBase and Kafka – ideally HortonWorks distribution), as well as other relational and non-relational database technologies (such as PostgreSQL and Oracle). The initial requirement is to stand up two Agile delivery teams with core skills in these technologies. Further delivery teams may be deployed over the course of the contract. Statements of work for specific deliverables will be agreed with the supplier in advance.
Who the users are and what they need to do
The Immigration IT Portfolio is responsible for maintaining and improving current and future immigration IT services. We are helping to deliver the future of immigration.
Early market engagement
There is no pre market engagement event.
Any work that’s already been done
The Big Data solution is already in development. So any new supplier will be expected to take responsibility for any code that has been, or is in the process of being, developed after a suitable transition and handover period with the incumbent. We are keen to understand how quickly suppliers can mobilise to enable transition and handover to commence as we wish them to occur as soon as possible after contract award.
Existing team
We anticipate that the contracted supplier will develop strong collaborate working relationships with the existing HO DDaT programme/project teams and with the other suppliers supporting HO DDaT with whom the supplier will work. It should also allow the supplier to develop a clear understanding of the aims and objectives of the HO DDaT programme/project they are working on, so that they can effectively support HO DDaT in terms of their day to day work and engagement with others.
Current phase

Work setup

Address where the work will take place
London and Croydon
Working arrangements
Your response should set out how you could maintain the availability of your services over time, the ability to supply up to 2 teams concurrently, and your ability to respond to immediate surge requirements.

The Home Office reserves the right to both extend and shorten the services provision period, subject to discussion with the preferred supplier(s).

The team is expected to work across the multiple sites as required.

Expenses will conform to HO internal policies and will not be payable to Westminster, Croydon, or Heathrow
Security clearance
Service Provider personnel need to be compliant with BPSS as a minimum, and CTC clearance if working in Home Office buildings. Depending on the nature of the role, if escalated and/or privileged access is necessary then there may be a requirement for SC clearance, and in certain circumstances, DV clearance.

Additional information

Additional terms and conditions

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Essential skills and experience
  • Provide demonstrable experience implementing Big Data technologies, utilising Big Data technologies (such as Hadoop, HBase and Kafka)
  • Provide demonstrable experience of designing, developing and optimising Big Data ingestion pipelines, utilising Big Data/MPP processing technologies (such as Samza and Spark).
  • Provide evidence of resources with extensive experience of developing Java-based operations and data services, using open source technologies (such as Java 8, JBoss RESTEasy and Google Guice)
  • Provide evidence of resources with extensive experience of deploying and managing Big Data solutions, utilising CI and containerisation technologies (such as Ambari, Puppet, Jenkins, Docker and Kubernetes).
  • Provide evidence of resources capable of leading on innovation and performance engineering and that will be accountable for the availability, scalability and performance of the Big Data solution
  • Provide evidence of resources capable of developing and maintaining an architecture roadmap for the Big Data solution and the supporting implementation and migration plan, based upon an agile delivery runway
  • Provide evidence of resources capable of providing 3rd line support for the Big Data solution, that resolve high-priority bug fixes or continuous integration / deployment issues
Nice-to-have skills and experience
Provide evidence of resources with experience of architecting and maintaining Big Data solutions in AWS cloud environments, with knowledge of AWS Policies, Security Groups, VPC creation and peering?

How suppliers will be evaluated

How many suppliers to evaluate
Proposal criteria
  • All essential and nice to have requirements will be evaluated further as part of the overall proposal criteria below
  • Evaluation criteria have 8 categories: Specific Competencies 35%, Plan for initial phase 15%, Risk Management 15%, Ability to scale capability 10%, Performance Management 10%, Methodology 5%, Policy 5%, Security 5%
  • Specific Competencies: Includes all essential and nice to have technology criteria
  • Specific Competencies: Domain knowledge of business requirements and issues
  • Specific Competencies: Ability to transfer to Business as Usual
  • Security: Compliance with people security requirements
  • Methodology: Agile - Government Digital Service - Service Readiness
  • Policy: Cloud - Open Source - IPR and Licensing
  • Plan: Quality of delivery plan for first phase of engagement and statement of work - Start up process performance - Quality and risk of delivery proposal
  • Scale Capability: Capability of increasing delivery or service capability in the medium to long term - Scope and forward planning capability
  • Performance: Delivery and Service management reliability and repeatability - Client reporting and Quality management
  • Performance: Quality management process and culture - Team quality management and performance monitoring execution
  • Risk Management:Medium Term Quality, resilience and scale of Technical or Service skills capability in specific project tools and techniques
  • Risk Management: Quality, Consistency, and Surge Capability to meet specified requirement.
  • Risk Management: Quality and sustainability of delivery proposal
  • Risk Management: Approach of delivering scope and scale of requirements to the overall contract scope and project plan over contract life.
Cultural fit criteria
Cultural Fit: Stakeholder Management - One Team approach - Development of Client capability - People Development - Innovation and Value for Money
Payment approach
Capped time and materials
Assessment methods
  • Written proposal
  • Case study
  • Work history
  • Reference
  • Presentation
Evaluation weighting

Technical competence


Cultural fit




Questions asked by suppliers

1. Please can the Authority confirm the current contractors involved in the prior work on this requirement and which (if any) is currently the principal or lead supplier within that set (incumbent)?
Information on the current contractor will be disclosed to the sucessful supplier for the purpose of mobilisation purposed. This information is not relevant at this stage.
2. Please can the Authority confirm that this work would be regarded as "supply side" and undertaking the various statements of work envisaged would not preclude the selected supplier from bidding for any other Home Office opportunities?
Suppliers are not restricted from bidding for other Home Office contracts. If suppliers discover at any stage during a contract, or a bidding process, that any specific assignment might create a conflict of interest then they should immediately advise the Home Office of this potential and consider proposing appropriate mitigations and discuss this with the Home Office. These mitigations might include withdrawal from related procurements or contracts. Conflicts are unlikely to occur across programmes unless suppliers are providing widely scoped assurance or strategic services.
3. Could you please confirm how many resources do you require in each of the two teams?
8 to 10 people per team.
4. The tender page states your response should set out how you could maintain the availability of your services over time, the ability to supply up to 2 teams concurrently, and your ability to respond to immediate surge requirements (and other evaluation criteria). Can you please confirm that this will be part of the further stages of the procurement and this first stage is to answer the questions specifically about "skills and experience"?
Detailed evlauation will be considered and measured at written proposal stage. At this stage, suppliers are required to demonstrate essential skills and experience and where possible nice to have skills and experience.
5. With an estimated budget of £3-4M per annum, does the Department have minimum requirements of the supplier from a revenue or size point of view?
No, however the supplier is requied to demonstate the capability and capacity to deliver the services for this requirement.
6. What is 'Service Readiness' referring to in the proposal criteria?
This award sub criteria shall be measured at written proposal stage under Methodology.
7. Can Home Office provide more detail around what is meant by surge requirements in the 'Working arrangements' section?
Surge requirements refers to the supplier having the ability to handle short term delivery demands and having a flexible resource pool.
8. We note SC and DV clearances may be required, would Home Office sponsor the clearance process if necessary for supplier roles?
The Home Office would sponsor individuals where required for SC and DV Clearance however it is the responsibility of the supplier to ensure that the necessary checks around nationality and residency requirements are met.
9. We note the supplier will be expected to work across multiple sites, can we confirm the main location this project will be based? Could we also get an idea of the time split between locations?
Primary location shall be Croydon based. 95% in Croydon and 5% in central London.
10. Who are the other suppliers mentioned in the 'Existing Team' section?
Existing suppliers shall not be named due to commercial confidentiality. Details of the incumbent shall be shared with the successful supplier for the purposed of handover and mobilisation period.
11. Who is the incumbent supplier?
Refer to answer above.
12. We note there is an incumbent supplier mentioned, is there a specific reason this supplier cannot continue this work without a procurement?
All Public Sector spend is governed by EU Laws therefore requires adherence to the Procurement Legislation. All contracts require re-tender and must be competed.
13. Will this service be expected to pass the GDS Service Assessment per phase?
The Home Office have adopted the GDS design principles and follow the same cross government methodology. GDS will not be undertaking and standard assessment process because this requirement does not relate to public facing service design. This requirement relates to delivery of a data platform.
14. Will this project be following the GDS Service Manual lifecyle phases for Discovery, Alpha, Beta, Live? If so, we note this project is in the Live phase, which phases have therefore been completed?
Please refer to answer above.
15. Has there been any indication of what roles would be expected in the two agile delivery teams mentioned in 'Problem to be solved'? If so, can this be provided?
Problem to be solved will be detailed in the request for written proposal.
16. Is there an expected duration for the first SoW mentioned in 'Budget Range'?
The first SOW shall be a duration of 6 months.
17. Is there a specific reason for the start date of no later than May 2017? Similarly for the end date of no later than 30th April?
This give the Home Office Flexibility in relation to contract award subject to internal governance process.
18. Can you please expand on what is meant by flexible contract in 'Summary of Work'?
Further detail will be provided in the request for written proposal.
19. Can you please outline steps and dates in the procurement timetable, up until supplier award i.e. Proposal or presentation dates
Further detail will be provided in the request for written proposal.
20. Can you please specify the key roles that need to start from day one along with the level of security clearance required? o E.g.- Big Data Engineers- Starting 1st May, Java Developers- 15th May
It is for the supplier to recommend best practice and how explain how they can mobilise and complete a handover.
21. Can you please specify if the supplier is expected to handle project management?
The supplier is not expected to handle Project Management activities.