HMCTS 102 Petty France, London, SW1H 9AJ, HMCTS Aldgate, Birmingham, B16 6TZ (some UK Travel).

HM Courts and Tribunal Service (HMCTS) Digital Change - QA services

Incomplete applications

8
Incomplete applications
6 SME, 2 large

Completed applications

18
Completed applications
13 SME, 5 large
Important dates
Opportunity attribute name Opportunity attribute value
Published Tuesday 26 June 2018
Deadline for asking questions Tuesday 3 July 2018 at 11:59pm GMT
Closing date for applications Tuesday 10 July 2018 at 11:59pm GMT

Overview

Overview
Opportunity attribute name Opportunity attribute value
Summary of the work A service capability providing expertise in the area of quality assurance and software testing that enables project development and Product teams to deliver quality digital products rapidly to support the business as well as supporting and enhancing Live services to Citizens and internal staff.
Latest start date Saturday 1 September 2018
Expected contract length 2 Years
Location London
Organisation the work is for HMCTS 102 Petty France, London, SW1H 9AJ, HMCTS Aldgate, Birmingham, B16 6TZ (some UK Travel).
Budget range Suppliers progressing to the "proposal" stage will be issued with a template to complete the financial section of this tender. The total Supplier charge, along with the total blended day rate of all resources will be evaluated as per evaluation criteria.

About the work

About the work
Opportunity attribute name Opportunity attribute value
Why the work is being done HMCTS is undergoing an extensive reform transformation enabled by a technology work stream. Civil, Family and Tribunals (CFT) is one of the programmes of work enabling the transformation. The CFT Programme’s main technology objective is to develop efficient, proportionate and accessible digital services delivering access to justice via appropriate modern channels. The digital services being created are underpinned by a software testing and quality assurance capability for all HMCTS Digital services, as the organisation moves towards an in-house digital services capability
Problem to be solved To provide software testing and quality assurance services to in-house and SME development and product teams in a consistent way that promotes consistency and maximises reuse and adheres to government standards
Who the users are and what they need to do As a quality assurance engineer I need to support the rapid creation and deployment of quality assured code to meet the digital business needs.
As a service manager I need to provide business services to users and citizens and third parties to the quality assured standards expected by government
As head of digital operations I need to know that our digital platforms and services are reliable, scalable, supportable and efficient
As a citizen I want to be able to use HMCTS Digital services at times that are convenient to me
Early market engagement The HMCTS reform programme is highly complex, as such it seeks to engage with suppliers that have a record of providing software testing services
Any work that’s already been done An existing service has been provided that has taken the programme from initiation to the start of public betas for a number of digital services and supporting digital products and components
Existing team The new team will be working with multiple SME providers across a variety of quality assurance services ranging across all of the GDS design phases, together with working closely with the Digital Change Directorate test team and Digital Operations Live support capabilities
Current phase Not applicable

Work setup

Work setup
Opportunity attribute name Opportunity attribute value
Address where the work will take place Petty France, London
Aldgate, London
Birmingham,
Suppliers locations within London M25 geography.
Working arrangements The team should provide an on-site presence all working days, including for releases out of hours. Out of hours support for live services can be done remotely.
Security clearance Most testing roles will require SC clearance as access to production systems and live data is involved. Roles that are not directly engaged in testing; production or live system, will require a minimum standard BPSS.

Additional information

Additional information
Opportunity attribute name Opportunity attribute value
Additional terms and conditions

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Skills and experience
Opportunity attribute name Opportunity attribute value
Essential skills and experience
  • Providing references, demonstrate where you have provided a quality assurance function supporting a large scale digital transformation service operating at a rapid rate within a highly regulated environment(5%)
  • Providing references, evidence how and where you have operated and enhanced quality assurance capabilities including approaches and technologies involved(4%)
  • Providing references, evidence the resources proposed have expertise implementing the necessary test frameworks and tools to support the Reform Programme test strategy(4%)
  • Providing references, evidence your experience of implementing NFR test approaches and tooling, describe the challenges and approaches to resolve them(5%)
  • Providing references, evidence your experience of establishing, operating and enhancing quality assurance services in a dynamic support capability function(4%)
  • Providing references, evidence your experience of working with third party delivery partners focussed on implementing projects, and quality assurance specialists. Describe the challenges and approaches to resolve them(4%)
Nice-to-have skills and experience

How suppliers will be evaluated

How suppliers will be evaluated
Opportunity attribute name Opportunity attribute value
How many suppliers to evaluate 3
Proposal criteria
  • Describe how you would operate and improve the service to support both end users and multiple programme teams. Detailing process, resource and priorisation approaches to enable HMCTS inhouse future state(4%)
  • Articulate how you envisage the overall quality assurance service model operating to facilitate the ability of HMCTS to rampup/ rampdown across the programme whilst ensuring quality and interoperability(3%)
  • Provide a proposed service organisation structure with roles and skillsets to provide the service(3%)
  • Propose how you would provide a cost effective support for the Citizen facing digital services and the associated product/development teams(3%)
  • Describe how you would enable HMCTS to implement or extend progressive approaches to test automation including testing within a continuous deployment environment(5%)
  • Explain your approach to augmenting the existing quality assurance service without adversely impacting the existing programme delivery timelines or the live services(4%)
  • Provide CV's for your proposed team key members(3%)
  • Describe how you are able to flex your service offering to meet rapid changes in demand as well as changes in technology(3%)
  • Describe how you will report on service attainment. Identify which measures are most appropriate to drive the desired outcomes and to enable identification of areas for improvement(6%)
  • Explain how your quality assurance service approach will support a highly regulated business, and support GDS digital by default processes(3%)
  • How would your quality assurance team transfer the service and skills/knowledge to an in-house team, ensuring consistency of quality and service(3%)
  • Expalin how you would collaboration with development teams, waterfall programmes, BAU services and practices in a highly regulated environment(4%)
Cultural fit criteria
  • Explain how you’ll ensure collaboration at all levels of the project and programme delivery between users, team members and management. Give examples of where you have taken this approach(2%)
  • Explain how you would maintain a no-blame culture and encourage people to learn from their mistakes and provide examples of this(2%)
  • Explain how the team intend to create/enhance a Quality Assurance culture across a large programme(2%)
  • Explain how the supplier will coach, mentor and support the civil service apprenticeship scheme(2%)
  • Provide evidence on how the supplier have worked closely with partner suppliers to provide a comprehensive Quality Assurance service(2%)
Payment approach Time and materials
Assessment methods
  • Written proposal
  • Case study
  • Work history
  • Reference
  • Presentation
Evaluation weighting

Technical competence

70%

Cultural fit

10%

Price

20%

Questions asked by suppliers

Questions asked by suppliers
Supplier question Buyer answer
1. Could you please share the Reform Programme test strategy? We're interested in your testing strategy/approach to HMCTS programme, consider:

1.Strategy must accommodate all phases of testing within a Continuous Integration environment
2.GDS have a list of browsers we support for our citizen facing services. The test approach needs to reflect the challenges of testing a wide range of mediums.
3.Exploratory testing and its place in the testing phases
4.Managing NFRS in a fast paced environment
5.Open source tooling is critical
6.The integration of GDS requirements
7.Metrics, reporting, dashboard, Levels of governance on a programme of 25+projects
8.NFRs, tooling and ways of working to help improve Agile approach to testing
2. please send us the reform test strategy We're interested in your testing strategy/approach to HMCTS programme, consider:

1.Strategy must accommodate all phases of testing within a Continuous Integration environment
2.GDS have a list of browsers we support for our citizen facing services. The test approach needs to reflect the challenges of testing a wide range of mediums.
3.Exploratory testing and its place in the testing phases
4.Managing NFRS in a fast paced environment
5.Open source tooling is critical
6.The integration of GDS requirements
7.Metrics, reporting, dashboard, Levels of governance on a programme of 25+projects
8.NFRs, tooling and ways of working to help improve Agile approach to testing
3. what is the test frameworks and tools that support the Reform Programme test strategy We would like you to provide your thoughts as to what frameworks and tools you would provide to meet the needs of the highly complex digital transformation programme
4. can you send the Reform Programme test strategy We're interested in your testing strategy/approach to HMCTS programme, consider:

1.Strategy must accommodate all phases of testing within a Continuous Integration environment
2.GDS have a list of browsers we support for our citizen facing services. The test approach needs to reflect the challenges of testing a wide range of mediums.
3.Exploratory testing and its place in the testing phases
4.Managing NFRS in a fast paced environment
5.Open source tooling is critical
6.The integration of GDS requirements
7.Metrics, reporting, dashboard, Levels of governance on a programme of 25+projects
8.NFRs, tooling and ways of working to help improve Agile approach to testing
5. please elaborate on the meaning of highly regulated environment A highly regulated environment is one where business must adhere to specific rules set by an external party, not their own. The regulations may come from sources like government agencies, Financial institutions (FSA), Legal Institutions, Nuclear industry, Aero industry (this is not a definitive list)
6. Can you confirm that the provision of this service falls outside of IR35 legislation? The anticipated roles have been assessed as outside IR35, however this is dependent on your proposed strategy and operating model. Please confirm within your response that your proposition has been assessed and conforms to HMRC regulations
7. We understand that complete QA Services are required to be supplied, however could you illustrate more on type of testing needs and initial targeted team structure? The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme. If your question refers to the development stack please see questions/answers that respond to this specific question
8. As part of implementing testing function – can you please confirm on the scope of type of testing like – Functional Testing, Automation Testing, Security Testing, Performance Testing, Compatibility Testing and UAT. The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme.
We require all elements of testing services to be provided
9. Could you share the technology stack, development methodology and the stage wherein digital transformation has reached, to help us plan QA stages accordingly? The programme is standardising the services build using micro-services with RESTful APIs, using JAX-RS, JMS, Java 8, Maven/Gradle build systems, Postgres, Redis and NoSQL Databases
The stack includes:
Front End web applications using HTML5,CSS3,SASS,SCSS,JavaScript(ECMA 5/6/7) , Node.js, Express.js, templating (Nunjucks or similar),Grunt/Gulp build system, Responsive Design. Nice to have: TypeScript/Angular, Babel,Webpack.
Web application server-side development. including ORM and Hibernate, dependency Injection, GIT CLI, Jenkins, CI tooling, Opensource Libraries and their controls
The development teams are implementing software using the following development practices and processes; domain-driven design (DDD), Behaviour-driven development (BDD) and Test-driven development (TDD)
10. Any preference on the tools/technology stack that would be used as part of QA solutions or will it be mutually decided between vendor and supplier, at project start? The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme. If your question refers to the development stack please see questions/answers that respond to this specific question
11. Assuming this to be T&M engagement – is there a lean period expected OR is there a probability that the supplier may experience Zero percent utilization. The winning supplier will work collaboratively with the HMCTS Reform programme to optimise the resource delivery ensuring value for money is achieved.
However whilst demand will fluctuate it is unlikely to reach zero unless the programme is curtailed
12. How many workstreams for part of the Civil, Family and Tribunal (CFT) Programme which require QA services? All services delivered by the technical work stream will need to have gone through an extensive test and QA process prior to launch
Which suppliers provide the QA services to each project or programme will be discussed and agreed in statement of work
13. Can you specify what specific activities are required for “quality assurance services”. The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme.
14. Do suppliers need to meet all essential skills, i.e. if some essential requirements are not met, but we score highly in other areas, would we go through to next stage? Please read the DOS guidance regards successful bidding
15. Do you have a budget cap for this service, if so can you please provide a figure? Suppliers progressing to the next stage of the tender will be supplied with the relevant information.
16. Are these services currently being provided by another supplier (or is this a new requirement)? If so, how many resources are currently used? Please read the requirements specification for the answer to your question. The number of resources is not important to your response at this stage of the tender, other than it is a large scale project. Please read the material in the public domain to ascertain if your organisation is capable of providing the quantity of resources we will need.
17. Regarding “providing references”, do you need to see names of client organisations? You must provide sufficient information to corroborate your reference.
18. Will any supplier tooling costs (eg licences) be chargeable back to the buyer, or is this expected to be covered in the supplier’s charge for the service? No. However supplier resources are expected to provide laptops etc and be able to install and configure any open source tools we use - or any other tooling we specify - as part of the expertise required to perform the services.
19. Can you please expand or explain what is meant by a “dynamic support capability function”? The HMCTS Digital Reform programme is very large, check out the Publicly available Materials, operating on Agile principles. Due to the diversity of services that are being changed and the wish for common component utilisation the Testing/QA team must operate in a dynamic manner to fulfil the needs of all the development teams. Skills, roles and numbers will vary through the engagement. We expect the winning provider to work collaboratively with us to manage these variations.
20. With regard to price, what format are you expecting to see (resource numbers and day rates, breakdown of non-resource costs, a model that shows how flex in demand would vary costs, etc)? Please read the requirements specification for the answer to your question.
21. How many Key Resource CV's are required? Suppliers progressing to the next stage of the tender will be supplied with this information. We will advise which members of the proposed team we wish to meet during the next stages of the tender.
22. What % of work is London-based; what % Birmingham-based? At present the majority of the work is London based, from two central London locations. Over the duration of the contract some requirements will shift to being provided from Birmingham. This has not yet been finalised.
23. Can you quantify what “large scale” refers to with respect to the “large scale digital transformation service”. The HMCTS Digital Reform programme is very large and complex, we would encourage you to check out the Publicly available Materials. In short a 6 year transformation exercise investing £1.2bn of taxpayers money, affecting 16k employees.
24. What technologies are expected to be utilised for delivery on the services? The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme. If your question refers to the development stack please see questions/answers that respond to this specific question
25. What technologies are expected to be utilised for delivery on the services? The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme. If your question refers to the development stack please see questions/answers that respond to this specific question
26. Are test automation services also required? Yes these will be required
27. With regard to “NFR test approaches” can you explain what this means in more detail (e.g., performance testing, operational acceptance testing, infrastructure build verification, service readiness validation, etc) NFR stands for Non Functional Requirements. For further information please refer to any standard Testing Manual or ITIL Service definition.
28. Can you quantify what activities and size of these activities required to support the civil service apprenticeship scheme. The Service is to be transferred to the Civil Service Business As Business Usual team, yet to be defined or established. One of the governments initiatives is to support apprenticeships. We would like to understand how you would support the initiative and the transfer of service to the BAU team.
29. Does ‘quality assurance service’ mean accountable, outcome based, end-to-end service provision; or any kind of support eg resource augmentation or ‘services to assist’ Please read the requirements specification, the answers to your question are within the document and are included within the questions we are posing to you.
30. Are you intending to award to one supplier (covering everything) or multiple suppliers (dividing according to their expertise)? The MOJ are not adverse from receiving bids from "Partnerships", however you must be clear in the governance structure and "Who" will be owning the relationship and accountable for the delivered service.
31. Will you consider joint bids from multiple suppliers? The MOJ are not adverse from receiving bids from "Partnerships", however you must be clear in the governance structure and "Who" will be owning the relationship and accountable for the delivered service.
32. What tools are currently in place? Will the supplier be expected / able to use those tools, or are you expecting supplier to implement their own tools in order to deliver services? The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme.
33. “Providing references, evidence your experience of establishing, operating and enhancing quality assurance services in a dynamic support capability function(4%)” Could you please clarify if ‘dynamic support capability function’, in the context of this question means QA support for testing fixes of any L1, L2 issues? The HMCTS Digital Reform programme is very large, check out the Publicly available Materials, operating on Agile principles. Due to the diversity of services that are being changed and the wish for common component utilisation the Testing/QA team must operate in a dynamic manner to fulfil the needs of all the development teams
34. Could you provide a brief overview of the technology stack you are using in this programme? The programme is standardising the services build using micro-services with RESTful APIs, using JAX-RS, JMS, Java 8, Maven/Gradle build systems, Postgres, Redis and NoSQL Databases
The stack includes:
Front End web applications using HTML5,CSS3,SASS,SCSS,JavaScript(ECMA 5/6/7) , Node.js, Express.js, templating (Nunjucks or similar),Grunt/Gulp build system, Responsive Design. Nice to have: TypeScript/Angular, Babel,Webpack.
Web application server-side development. including ORM and Hibernate, dependency Injection, GIT CLI, Jenkins, CI tooling, Opensource Libraries and their controls
The development teams are implementing software using the following development practices and processes; domain-driven design (DDD), Behaviour-driven development (BDD) and Test-driven development (TDD)
35. Can you advise of the approximate number of resources you will need at different experience levels? Suppliers progressing to the next stage of the tender will be supplied with this information. The programme size is within the material that is in the public domain.
36. Which of the following will the service capability be responsible for: (a) Defining the strategy and approach to testing for delivery streams? (b) The overall management of testing for each delivery? (c) Preparation and execution of tests? (d) Management of testing by other test suppliers? (e) Assurance of testing by development teams? (f) Providing knowledge and assistance to other teams to enable them to deliver testing effectively The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme.
37. Will the supplier be working with a test strategy or approach developed by another test supplier, whether an existing incumbent or not? The HMCTS Reform programme are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme.
38. Will the supplier be working under the direction of another test supplier, whether an existing incumbent or not? Please read the requirements specification and provide YOUR response to the question posed "Explain your approach to augmenting the existing quality assurance service without adversely impacting the existing programme delivery timelines or the live services" it is worth 4%
39. The section identifies "a software testing and quality assurance capability for all HMCTS Digital services". Does the service being contracted here: (a) Form the totality of this T&QA Capability? (b) In conjunction with HMCTS personnel, form the totality of this T&QA Capability? (c) In conjunction with other supplier personnel, form the totality of this T&QA Capability? (d) In conjunction with HTCTS and other supplier personnel, form the totality of this T&QA Capability? Please read the requirements specification, the answers to your question are within the "Title" and the section "About the work"
40. Are "quality assurance engineer" personnel present who are not to be supplied by the service being contracted and who will be users of the service? Please read the requirements specification regards the "quality assurance engineer" personnel present, the answer to your question is contained in the questions being posed to you.
41. Who will be users of the service? The users of the service are contained within the plethora of material relating to the programme in the public domain.
42. Is the "existing service" to be replaced by the service being contracted here? If not ,what will the relationship be between the two services going forward? Please read the requirements specification and provide YOUR response to the question posed "Explain your approach to augmenting the existing quality assurance service without adversely impacting the existing programme delivery timelines or the live services" it is worth 4%
43. Do the "SME providers" mentioned supply development services or quality assurance services? The SME "Subject matter experts" provide a range of technical and business expertise that you would expect of a very large transformation programme. The HMCTS Digital Reform programme is a strategic government transformation programme for which there is a plethora of material relating to the programme in the public domain.
44. With respect to the wording "have expertise implementing the necessary test frameworks and tools to support the Reform Programme test strategy", where do we obtain the details of the test strategy so that we can identify the "necessary test frameworks and tools" so that the required expertise can be identified? Please see the responses to the initial questions as these cover the strategy and tools. Please focus on what your unique offering is and what you can bring to the programme, it is complex and very challenging.
45. Will HMCTS sponsor the necessary security clearance processes for supplier personnel? The HMCTS will not pay for consultants to obtain SC clearance, we are happy to support companies through the process
46. What does the acronym SME mean in this context? If Small Medium Enterprise then why is this type of development team specifically identified? Are there teams that are not in-house and not SME? The SME acronym in this context refers to "Subject matter experts". The SME's provide a range of technical and business expertise that you would expect of a very large digital transformation programme. They are from both internal and external sources as you would expect from a very large strategic government change programme
47. Do any organisations that are or might be bidding already have knowledge of or experience of (a) "The Reform Programme test strategy" and/or (b) the list of what are deemed, by HMCTS, to be the "necessary test frameworks and tools"? The HMCTS Reform programme has been running for many years, and there is a plethora of material relating to the programme in the public domain. We are interested in your proposed way of providing services including strategic approach and test tools that you would meet the demands of a very large government digital change programme.
48. There is a request to provide details of the "skillsets" the service will need. In order to do this it is necessary to know the tech stack that will need to be supported. What tech stack(s) is (are) to be used? The programme is standardising the services build using micro-services with RESTful APIs, using JAX-RS, JMS, Java 8, Maven/Gradle build systems, Postgres, Redis and NoSQL Databases
The stack includes:
Front End web applications using HTML5,CSS3,SASS,SCSS,JavaScript(ECMA 5/6/7) , Node.js, Express.js, templating (Nunjucks or similar),Grunt/Gulp build system, Responsive Design. Nice to have: TypeScript/Angular, Babel,Webpack.
Web application server-side development. including ORM and Hibernate, dependency Injection, GIT CLI, Jenkins, CI tooling, Opensource Libraries and their controls
The development teams are implementing software using the following development practices and processes; domain-driven design (DDD), Behaviour-driven development (BDD) and Test-driven development (TDD)
49. The proposal criteria refers to explain an approach to "augmenting" the "exiting quality assurance service". In order to do this we require to understand the nature of the existing service and the operational boundaries that are envisaged between the remits of the existing and new services. Please describe the nature of the existing service and explain the planned boundaries. The HMCTS Digital Reform programme is a strategic government digital transformation programme for which there is a plethora of material relating to the programme in the public domain. We would actively encourage suppliers to read the material relating to the goals of the programme and the services already implemented prior to making a submission. The programme believe you do not need to understand how testing/QA services have been delivered to date, we are more interested in what unique services you can bring to support the programme
50. Ref : Providing references, evidence your experience of establishing, operating and enhancing quality assurance services in a dynamic support capability function(4%) Q : Please could you expand on what you mean by dynamic support capability function. The HMCTS Digital Reform programme is very large, check out the Publicly available Materials, operating on Agile principles. Due to the diversity of services that are being changed and the wish for common component utilisation the Testing/QA team must operate in a dynamic manner to fulfil the needs of all the development teams. Resource levels across QA roles will vary throughout the life of the contract and any successful supplier must be able to work collaboratively to support these changes in requirement
51. Would the buyer be open to remote working? (In the UK) Please read the requirements specification - "Address where the work will take place".
52. Does HMCTS expect resources to have any specific technical certifications? The HMCTS Digital Reform programme would expect all QA resource to have ISTQB certification as a minimum.
53. How many resources are expected to be delivered, and at what levels of seniority? It is anticipated that the HMCTS Digital Reform programme will need 20-30 additional resources over the next 24 month programme to supplement it's current team. This will cover a complete range of testing skills, experience and seniority, from junior testers to project test managers.
54. How much demand are you expecting for these services over the next 12 months? Over the next 12 months current resourcing expectations is in the volume of 10-15 testers embedded across the various project teams
55. What test environments are available? Will suppliers be able to influence environments provisioning (eg determine requirements for a suitable performance or OAT test environment)? The normal test environments required or expected will be available. We also use azure for platform and infrastructure as a service. With CI, CD and appropriate automation we are able to flex environment accounting to capacity and budget constraints. The QA team would be expected to help define the environment configuration and parameters.
56. Are suppliers expected to provide any test environment services (hosting, build, technical management, booking , user access, etc)? No (we use devops and platform engineering to spin up and manage environments). We do expect test resources to assist with tooling implementation and management if needed
57. What levels (person-days/month) of out-of-hours support is expected to be required to support releases and other out-of-hours work? Out of hours support - service levels, support levels etc are still being subject to discussion. Please propose a suitable solution for the scale of programme you will be supporting
58. What % of roles are expected to require SC clearance versus BPSS? The percentage split for SC clearance of the staff provided will be high due to the nature of the MOJ security requirements.
We will expect at most one QA per team to be cleared, in total across the programme no more than 10 QAs at most. Most SC resource will be in the Senior Developer (Tech lead) and DevOps space.
59. Please clarify what is meant by “interoperability” with respect to rampup / rampdown The HMCTS Reform programme want to ensure there is no denigration of service across teams as well as within specific project teams during times of transition - for instance when a team ramps up or reduces their resource. We are interested to know how suppliers ensure 'interoperability' between teams is not effected.
60. Can you advise of approximate percentage split for SC clearance of the staff provided? The percentage split for SC clearance of the staff provided will be high due to the nature of the MOJ security requirements.
Actually I think we will expect at most one QA per team to be cleared. Depending upon roles provided this may be a high percentage. But actually it’s probably around 10 QAs maybe at most. Most sc will be devs or devops .
61. What indicators of the volume of work to be delivered during the 2 years of the contract exist and what are the numbers for these indicators? Volumes of work is based on the HMCTS Reform Programme interim state objectives. The programme has not yet reached it's peak in terms of projects, whereas some projects are beginning to move into an operational support and enhancement phase. Based on this projection number of QA resources likely to be required over the 2 year term of the contract is likely to be 20-30 in total.
62. What is the most likely pattern of variation of the monthly volume of work to be: (a) Generally consistent with foreseeable incremental change month on month. (b) A base of type (a) but with regular planned temporary increases in volume, increases that are generally less than the base volume, on a predictable basis. (c) A base of type (a) but with as required temporary increases in volume, increases that are generally less than the base volume, on an as needed basis. (d) Highly variable with wide swings in volumes from month to month. (e) Something else, please describe. (a) Generally consistent with foreseeable incremental change month on month.
Resource requirements are generally known in advance allowing for sufficient resource planning. Expectation is CVs/profiles will be available within 5 days of a resource requirement and on boarding complete within maximum of 4 weeks.
63. Ref: Propose how you would provide a cost effective support for the Citizen facing digital services and the associated product/development teams(3%) Q: Please could you clarify what the term 'support' means in this context? "Support" in this context is the provision of a testing/QA service that can meet the demands of the HMCTS Digital Transformation programme, a strategic government digital transformation programme and the BAU support function during the BETA phase.
Digital services include products that enable citizens to submit applications relating to the HMCTS services such as divorce application. QA resources must be able to support the delivery support function creating enhancements.
64. Ref: Explain your approach to augmenting the existing quality assurance service without adversely impacting the existing programme delivery timelines or the live services(4%) Q: Are you able to share any details on the existing quality assurance service? The HMCTS Reform programme has been running for many years, and there is a plethora of material relating to the programme in the public domain. We currently have approximately 15 projects in flight with people covering all key technical roles you would expect in a QA service. This contract will supplement existing commercial arrangements as we rotate staff, replace contracts and add further projects
65. Ref: Most testing roles will require SC clearance as access to production systems and live data is involved. Roles that are not directly engaged in testing; production or live system, will require a minimum standard BPSS. Q: Is it likely that SC will be for more senior resources and BPSS for mid-senior and junior resources? What is the likely ratio of SC:BPSS? As you would expect, any person accessing MOJ data either in the Live or pre-production systems will require SC clearance, therefore you must assume that all the testers accessing these systems will require a higher level of security clearance. Non SC roles relate to any supporting function, if there are any, management/administration.