LILA - the sequential pressure-based algorithm for data-driven Leakage Identification and model-based Localization
This repository contains the Leakage Identification part of LILA - the sequential pressure-based algorithm for data-driven Leakage Identification and model-based Localization in water distribution networks. LILA identifies potential leakages via semisupervised linear regression of pairwise sensor pressure data and provides the location of theis nearest sensor. LILA also locates leaky pipes relying on an initial set of candidate pipes and a simulation-based optimization framework with iterative linear and mixed-integer linear programming.
If you use LILA or part of its code, please consider citing our paper that describes it:
Daniel, I., Pesantez, J., Letzgus, S., Khaksar Fasaee, M.A., Alghamdi, F., Berglund, E., Mahinthakumar, G.
and Cominola, A., 2022. A Sequential Pressure-Based Algorithm for Data-Driven Leakage Identification and
Model-Based Localization in Water Distribution Networks. Journal of Water Resources Planning and Management,
148(6), p.04022025. DOI:10.1061/(ASCE)WR.1943-5452.0001535
- Ivo Daniel, Andrea Cominola - Chair of Smart Water Networks | Technische Universität Berlin and Einstein Center Digital Future, Berlin (Germany)
- Simon Letzgus - Machine Learning group | Technische Universität Berlin (Germany)
The above authors contributed to the content of this repository. For the full team of authors of LILA, refer to the authors of the above-cited paper.
An early version of LILA was awarded the Third Place Award for outstanding achievement in the BattLeDIM 2020, the Battle of the Leakage Detection and Isolation Methods. Check out this presentation by our Leakbusers team here: https://www.youtube.com/watch?v=PrHgNnQn-lQ
LILA operates in a sequential way, represented in this flowchart:
source: underlying work (Daniel et al., 2022)
The 2019_leakage_identification.ipynb
notebook in folder LI performs the leakage identification task, which is designed to raise an alarm about the presence of a potential leak. Firstly, the water distribution network and the time series of pressure at network nodes provided as input are analyzed as a whole to visualize all occurring leakages simultaneously. Thereafter, each identified leak is investigated individually to estimate a precise leak start time.
In general, the leakage identification module performs two sequential steps:
- Linear regression analysis is performed on pairs of time series from pressure data and the residual error of the model is calculated.
- Change point detection is applied to the residual from the pairwise linear regression analysis to provide the starting times of the leaks.
The final section of the notebook also provides the code used to generate the following figures in Daniel et al. (2022):
- Fig. 3: sensitivity analysis
- Fig. 4: comparison of residual error vs. ground truth
- Fig. 5: exemplary residual error trajectories during leakages with annotations
- Fig. 6: result summary for leakage time-to-detection and total lost water volume
- Fig. 7: result summary for leakage detection distance
- Fig. 9: study of leak-to-noise ratio and cusum hyperparameters
- Fig. 10: time series of residual error for individual leaks used for change point detection
Part of the code to run the Leakage localization module of LILA is availablle in this repository: https://github.com/jorgeps86/LeakLocalization
Dependencies and package version are listed in dependencies.md
The work in this repository is applied to the dataset of the BattLeDIM 2020, the Battle of the Leakage Detection and Isolation Methods. The BattLeDIM dataset is open and available at the links below. Information on the BattLeDIM can be found at the following links:
- Official website of the BattLeDIM, hosted by the BattLeDIM committee: https://battledim.ucy.ac.cy/
- BattLeDIM problem description and rules: https://zenodo.org/record/3902046
- BattLeDIM dataset: https://zenodo.org/record/4017659#.X4mBaC2w1hE
- BattLeDIM results: https://zenodo.org/record/4139603#.X8lAfbG5p04.mendeley
LILA is fully presented and tested in Daniel et al. (2022):
Daniel, I., Pesantez, J., Letzgus, S., Khaksar Fasaee, M.A., Alghamdi, F., Berglund, E., Mahinthakumar, G.
and Cominola, A., 2022. A Sequential Pressure-Based Algorithm for Data-Driven Leakage Identification and
Model-Based Localization in Water Distribution Networks. Journal of Water Resources Planning and Management,
148(6), p.04022025. DOI:10.1061/(ASCE)WR.1943-5452.0001535
LILA derives from an initial version of the algorithm presented in Daniel et al. (2020) and used during the BattLeDIM competition:
Daniel, Ivo, Pesantez, Jorge, Letzgus, Simon, Khaksar Fasaee, Mohammad Ali, Alghamdi, Faisal, Mahinthajkumar, Kumar,
Berglund, Emily, & Cominola, Andrea. (2020). A high-resolution pressure-driven method for leakage identification and
localization in water distribution networks. Zenodo. https://doi.org/10.5281/zenodo.3924632
Copyright (C) 2021 Ivo Daniel, Simon Letzgus, Andrea Cominola. Released under the GNU General Public License v3.0. The code is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details: http://www.gnu.org/licenses/licenses.en.html.