Northern Ireland Water

X197 Construction of Data Set for Leakage calculations.

Incomplete applications

10
Incomplete applications
9 SME, 1 large

Completed applications

18
Completed applications
10 SME, 8 large
Important dates
Opportunity attribute name Opportunity attribute value
Published Monday 27 April 2020
Deadline for asking questions Monday 4 May 2020 at 11:59pm GMT
Closing date for applications Monday 11 May 2020 at 11:59pm GMT

Overview

Overview
Opportunity attribute name Opportunity attribute value
Summary of the work To deliver continuous improvement of NI Waters service in terms of costs and efficiencies, NI Water needs to ensure that all data sources are accurate and up to date to provide a solid foundation to generate insights to better inform business decisions in the future.
Latest start date Monday 1 June 2020
Expected contract length 6 months
Location Northern Ireland
Organisation the work is for Northern Ireland Water
Budget range £70,000 - £90,000

About the work

About the work
Opportunity attribute name Opportunity attribute value
Why the work is being done Water and waste water treatment plants are extremely complex and expensive operations to run. We constantly monitor all aspects of these networks to ensure that our drinking water is top quality, plus our waste water plants run efficiently, adhering to stringent compliance regulations. This involves collecting vast amounts of data from Spatial, financial, telemetry and SCADA systems. Therefore, the data sets used to generate reports and business insights need to be up to date, be of excellent quality, plus be accurate.

A lot of work has already been completed at NI Water to try to work with this data however, we need assistance from expert data analytics companies, to ensure that we make the most efficient and effective use of that data to learn how our networks are operating and how we can realise efficiencies. We have already used some of this data to realise some gains (financial) by finding areas of energy reduction in our water treatment plants but we are fully aware we can improve efficiencies by employing the latest and greatest algorithms and processes. We have many projects to complete on the water network but also on the waste water network.
Problem to be solved NI Water needs to account for all water delivered to help determine if it is consumption or leakage. Each property is classified as Domestic, or non-Domestic however there may be data inaccuracies. Non-domestic property data is thought to be correct but the same degree of confidence does not exist for domestic properties. This means our leakage figures may be unnecessarily high and hence the need to determine we have the correct number of properties listed. Our objective is therefore to use as many data sets as possible to cross reference properties in NI to:

1.Identify anomalies in current property data , using all data sources available.
2.Produce creative methods to enable expeditious cross referencing of data from multiple sources .
3.Determine property counts and correct property classifications for all properties in NI.
4.Identify properties not on any system (using satellite imagery).
5.Determine count of properties updated (dashboard).
6.Communicate changes required (GIS/ Metering and billing).
7.Determine connection points for each domestic property that exist on GIS/ RAPID etc.
8.Propose how updates will be made to data sources.

Success will require identification of all properties that could be updated, or provide justificatios to change how total leakage figure is calculated.
Who the users are and what they need to do • Head of Water – Do we have all properties/ customer supply points listed and are they correctly classified in terms of domestic and non-domestic.
• Head of Customer Services – need to ensure we have all customers updated to provide domestic and operational services.
• Head of Business Intelligence - how can I see an accurate, up to date list of findings from this activity? Is it significant enough to change internal processes?
Early market engagement There have been a lot of investigations in this area via internet searches and talking to data analytics companies. There is a real drive to combine as many data sets as possible together, to produce a definitive list we can use going forward. There have been a lot of creative ideas in how to find outliers which has prompted the urgency in preparing this piece of work.
Any work that’s already been done Our in-house GIS team have already developed a fantastic suite of applications to display layers of information in graphical format, utilising the latest in GIS technology and data sets (Pointer). We still however have a need to ensure that properties have the correct classification and we have an accurate listing of properties.

This information will be made available as needed, provided the right data sharing agreements and contracts are in place.
Existing team Head of Analytics
Head of Water
Business Improvement Project Manager
Business Analytics Project Manager
Data Scientist
Data Engineer
Customer Insights Manager
Current phase Not started

Work setup

Work setup
Opportunity attribute name Opportunity attribute value
Address where the work will take place Northern Ireland Water
Westland House
Head Office
40 Old Westland Road
BELFAST
BT14 6TE
Working arrangements • Work as one team with the NIWater Analytics delivery team, whether on-site or off-site.
• Provide regular updates on progress, issues, risks and delivery milestones.
• Ensure that there is no duplication of work, enable shared learning and knowledge to NIWater
• Ensure models are built in a manner that maximises ease of use/maintenance by NI Water once project is underway, be empowered to make suggestions for project updates as we learn more.
• Flex resources as required, and work with other partners
• Comply with NI Water policies/procedures.
• Integrate with NI Water/ Microsoft tools already in place
Security clearance Basic Access NI check is required.
On site working as required however current coronavirus guidelines should be adhered to at all times so remote meetings will always be preferred. Data sharing agreements will be required as appropriate, sensitive data obtained should be anonymised to adhere to strict GDPR regulations.

Additional information

Additional information
Opportunity attribute name Opportunity attribute value
Additional terms and conditions NI Water intends to use the eTendersNI platform to evaluate this procurement. Shortlisted suppliers will be invited to submitted their responses on their prosposal, cultural fit and price via this platform. Scoring mechanism as follows will be used during both stages of the evaluation.
5 - Exceeded
3 - Met
1 - Partially met
0 – Not met or not evidenced

NI Water do not envisage any additional terms and conditions

Skills and experience

Buyers will use the essential and nice-to-have skills and experience to help them evaluate suppliers’ technical competence.

Skills and experience
Opportunity attribute name Opportunity attribute value
Essential skills and experience
  • Demonstrate experience of successfully identifying domestic properties using Pointer (LPS) and other data sources to confirm property is completed (not under construction) and potential occupancy status. (10 points)
  • Demonstrate experience using government data sets, or other approved data sets to build one key data set (e.g. NIE data set, Customs House data set). (10 points)
  • Demonstrate experience of designing and implementing AI solutions to deliver operational efficiencies, service improvement and revenue (10 points)
  • Demonstrate experience of delivering Agile projects within the past 3 years (10 points)
  • Demonstrate experience building dynamic, drill down and static Reports and Dashboards for consumption on desktop, plus optimised for mobile devices. (10 points)
  • Demonstrate experience of database concepts, design principles and database architectures. (10 points)
  • Demonstrate experience of developing data-pipelines (10 points)
  • Demonstrate experience of successfully developing reusable predictive analytical models to detect and predict fraud/error (10 points)
  • Demonstrate experience of creating, maintaining and monitoring AI / ML solutions (10 points)
  • Demonstrate experience of developing and deploying advanced analytics tools/ Azure cognitive services (diagnostic, predictive) using Python or R (10 points)
  • Demonstrate experience building analytic models that blend GIS datasets and non GIS datasets (10 points)
  • Demonstrate experience of using satellite imagery to cross reference against LPS. (10 points)
  • Demonstrate experience using graph databases – interrogating relationships between nodes (10 points)
  • Demonstrate experience of data matching processes and algorithms including fuzzy matching (10 points)
  • Demonstrate experience of successfully integrating and managing multiple internal and external data sources (>20) on a single production-level platform (10 points)
  • Demonstrate experience of working with address data in Northern Ireland to identify building classifications and methods on how to keep this updated automatically. (10 points)
  • Demonstrate experience of successfully upskilling/transferring knowledge to the internal customer's team in relation to predictive analytics (10points)
  • Demonstrate experience of successfully working collaboratively with a client as part of a joint team to detect errors/ fraud in data, essentially as an extension of a development team.
  • Demonstrate experience of developing accurate project plans, clearing highlighting critical milestones and adhering to timelines and budget. (10 points)
  • 28. Must be able to start work by end of May 2020, attend meetings in Westland House if necessary, although remote meetings will be accepted via Microsoft Teams. (10points)
Nice-to-have skills and experience
  • Demonstrate experience of successfully developing predictive analytic models in the public sector (10points)
  • Demonstrate experience with applications like Netbase, or similar. (10 points)
  • Demonstrate experience of working successfully in several different industries/sectors (10points)
  • Demonstrate experience working with APIs (10 points)
  • Demonstrate evidence by example of using open source components to deliver a solution to detect and predict error/ fraud. (10 points)
  • Demonstrate experience of successfully developing predictive analytics models that are similar to water industry where trends and predictive analytics are fundamental E.g.financial or utility sector are acceptable.(10points)

How suppliers will be evaluated

All suppliers will be asked to provide a written proposal.

How suppliers will be evaluated
Opportunity attribute name Opportunity attribute value
How many suppliers to evaluate 3
Proposal criteria
  • Identify a RAID (Risks, Assumptions, Issues, Dependencies) list that needs to be considered as part of the plan.
  • Describe how you propose to ensure you have the right data sets to help us build a common data set that has a “A*” grading
  • Description of how you have determined house occupancy which may skew the current assumptions.
  • Description of how you will identify all stakeholders in these activities.
  • Description of how you will use our current data and what insights could be gained in the early stages.
  • Description of what kinds of dashboards you could implement to be able to display anomalies found.
  • Describe of how you will build the models that will drive machine learning to help us become more proactive in keeping records up to date and maintain the application.
  • Description of how we can migrate information to the cloud (if not already available) so we can support this ourselves going forward.
  • Describe how you will provide knowledge transfer to up-skill the NIW team.
  • Description of how you will document procedures, results as we complete projects.
  • Description of how the models will be tested to prove that they are actually working and providing the right level of information.
  • Proposed team structure you will require including experience (CVs)
Cultural fit criteria
  • How will you bring us to the next level in analytics? (10 points)
  • What drives your organisation to deliver and, how will you ensure collaboration within the team? (10 points)
  • How can you clearly demonstrate that you have the right solutions for us? (10 points)
  • How can you ensure that you have dedicated resources for the entirety of this engagement and remain within project constraints? (10 points)
  • How will you provide knowledge transfer to our in-house staff? (10 points)
Payment approach Capped time and materials
Additional assessment methods Presentation
Evaluation weighting

Technical competence

65%

Cultural fit

15%

Price

20%

Questions asked by suppliers

Questions asked by suppliers
Supplier question Buyer answer
1. Has the Cloud platform to be used been determined as Microsoft Azure or are you open to other public cloud platforms? The preference is Microsoft due to other products we have, including Power BI Pro and Premium licenses.
2. " Is there a condition for the expected team size/number of consultants for this project?

"
No conditions or expectations on team size, that's up to you to decide what you need to be able to deliver this alongside any other projects you may have.
3. Do we need to submit the presentation along with the initial application or only shortlisted applicants will be invited to submit it? Only shortlisted applicants will be invited to present. Presentations are not required at shortlisting stage.
4. We don't meet some of the specific, sector-related requirements but do believe we can fulfil the needs of the tender. Would you still be open to applications of this nature? Yes please apply. We will be shortlisting to 3 suppliers so this may mean other applicants may be able to address the essentials and so this may mean you will not be shortlisted.
5. Is there an incumbent supplier, if so, who No there is no incumbent provider. This is a new requirement.
6. What are your procurement timelines, e.g. when will the shortlisted companies be informed? This tender closes on the 11th May. Our panel will commence shortlisting on Tuesday 12th May and we aim to advise all applicants of the outcome of shortlisting by Friday 15th May.
7. "For the Nice to Have Question 4:
Demonstrate experience working with APIs (10 points)
Does this refer to APIs as a data source or APIs for application integration?
"
This can apply to any API experience you have. We have multiple sources, multiple applications that may need to access this data once compiled. Please list any examples you may have, from whatever context.
8. Could you please advise as to how Stage 1 will be marked? DOS Opportunities are usually marked out of 3 but in the opp, it notes that there are 10 points assigned to each question. This is because at stage 2 (post shortlisting) we intend to use our eTendersni platform for submission and evaluation. eTendersni cannot accommodate 3,2,1,0 so CCS advised us that we could use 5,3,1,0 but that we would have to use this scoring scheme for both stages. 10 points indicated after each question indicates 10 points will be available as a weighting for each point scored. As each question has 10 points for each point scored this is of no consequence to the outcome. We will take note of this in terms of improving our procedure for future procurements via DOS4.
9. ‘Opportunity attribute value’ refers to wastewater treatment plant and network. Is focus of the scope (problem to be solved) clean water only i.e. wastewater network is not included? Clean Water
10. Please can you confirm if you are looking for a day rate and/or a full price for 6 months? One of the essential skills asks for a demonstration of your experience of delivering to agreed milestones, timelines and budget. Please indicate your ability to meet these requirements from past projects though we don’t have an expectation for a full breakdown of hourly rates. Successful bidders (top 3) would be asked for a more detailed breakdown for phase 2. Pricing is capped time and materials. We will be seeking both daily rates and a full cost for the delivery of the assignment,
11. What are your procurement timelines, e.g. when will the shortlisted companies be informed? Within a few days of applications closing we will short list and inform all applicants of the outcome, successful or unsuccessful.
12. "For the Nice to Have Question 4:
Demonstrate experience working with APIs (10 points)
Does this refer to APIs as a data source or APIs for application integration?
"
This can apply to any API experience you have. We have multiple sources, multiple applications that may need to access this data once compiled. Please list any examples you may have, from whatever context.”
13. Could you please advise as to how Stage 1 will be marked? DOS Opportunities are usually marked out of 3 but in the opp, it notes that there are 10 points assigned to each question. This is because at stage 2 (post shortlisting) we intend to use our eTendersni platform for submission and evaluation. eTendersni cannot accommodate 3,2,1,0 so CCS advised us that we could use 5,3,1,0 but that we would have to use this scoring scheme for both stages. 10 points indicated after each question indicates 10 points will be available as a weighting for each point scored. As each question has 10 points for each point scored this is of no consequence to the outcome. We will take note of this in terms of improving our procedure for future procurements via DOS4.
14. 1.Identify anomalies in current property data, using all data sources available.
What kind of Anomalies are we talking about?
Are they business anomalies or data quality anomalies?
What is the support to help identifying them?
Examples of anomalies to consider are:
1. Do we have all properties captured.
2. Are the properties we have correctly classified (used to be non-domestic but now domestic).
3. Has the property been part of a new build and address has changed slightly

We would hope that your past experience would help determine others."
15. About problem to solve:3.Determine property counts and correct property classifications for all properties in NI.
Correct property classifications:
Is there a support/guideline to identify wrongly property classifications?
The intent is to ensure that each property has a classification, plus the methods and data we use gives us a high degree of conficence. We have guidelines as to what determines confidence levels in property data.
16. About problem to solve "4.Identify properties not on any system (using satellite imagery)."
In case the solution can not cover this problem, is this a show-stopper for applying to the opportunity?
No. We appreciate that this is a challenge and in no way a show stopper. If you can list other innovitive ways of solving this problem then we are open to suggestions.
17. About problem to solve:"6.Communicate changes required (GIS/ Metering and billing)."
Could you please be more specific on the problem?
This is to help determine if we need to make any changes to how we collect data internally. Do we need to change our thinking as to how we collect data? Is there a better data set to use to than we currently do?
18. About the problem:"7.Determine connection points for each domestic property that exist on GIS/ RAPID etc"
Could you be more specific about “determine connection points”?
A description of the use-case would be much appreciated
Each property has a connection point for water (i.e. there is a physical outlet at that property). There is potential to use this as a way of determining a house classification if not already captured. This will potentially need cross referencing with internal NIW data systems
19. Is remote working an option? Under "Work set up" we have stated remote working will be preferred in the current circumstance. In essential skills we indicated as follows "attend meetings in Westland House if necessary, although remote meetings will be accepted via Microsoft Teams.
20. Is it possible to share the current data platform architecture, tools and technologies being used currently? Internally there are a number of systems used - Netbase/ Rapid/ ELlipse to capture our property and customer data. Also, the main setup is a Data Warehouse that is fed by systems for Energy, GIS (Spatial), Telemetry/ SCADA, Customer/ Work Data. Each of those has their individual applications to display data and generate reports. We also use PowerBI to generate internal dashboards and bring data together, with Pro and Premium licenses recently acquired.
21. We have recently seen buyers provide guidance on how to exceed expectations at the shortlisting stage. Please could you provide this. We have drawn up a speficiation to try to solve some fairly large challenges. In terms of being able to "exceed", we do not provide the specifics or a formula as to what will work. If we deem that the question has been answered to a level that shows us you understood the question, demonstrates you have the necessary expertise to solve the problem with innovative solutions, then you will receive full marks.
22. You must publish the question with your answer on the ‘X197 Construction of Data Set for Leakage calculations.’ page by Friday 8 May 2020 at: Apologies. We realised that the 8th May was a public holiday so we delayed launch of the opportunity until Monday 27th April 2020. The 8th May was an oversight.
23. "28. Must be able to start work by end of May 2020, attend meetings in Westland House if necessary, although remote meetings will be accepted via Microsoft Teams. (10points)"
In order to score full marks, what do you need to demonstrate for this answer?
We realise that you have other projects and other work to contend with. We need to ensure that we have dedicated resources available to start the project asap. We expect a quick turnaround on these projects and hence the use of this framework. Also, due to current working conditions, we need to ensure that remote working doesn't pose any problems - use of Microsoft Teams is encouraged where possible for the short term future.
24. Several of the questions are organisation and/or data-set specific (e.g. LPS, Pointer, NIW data-set) which will greatly limit the number of organisations capable of bidding. Is it acceptable to provide evidence from UK/international examples using equivalent organisations and data sets? Yes of course. We do not want to limit the scope of who can apply - innovation is key and if your solution will help us solve our problem, then we need to hear about it. Those have been listed as it's what we use currently.
25. Your satellite imagery question requires experience of cross referencing against LPS data. Can we provide experience of using satellite imagery to cross reference against comparable data-sets for equivalent organisations? Yes, any examples in this area will be very good to see, even if from comparable data sets. We have drawn up a specification but rely on analytics experts to help us figure out the solutions by whatever means possible.
26. Your satellite imagery question requires experience of cross referencing against LPS data. Can we provide experience of using satellite imagery to cross reference against comparable data-sets for equivalent organisations? Yes, any examples in this area will be very good to see, even if from comparable data sets. We have drawn up a specification but rely on analytics experts to help us figure out the solutions by whatever means possible.