A set of scripts to ensure and check the quality of data and metadata | Read-only mirror of https://github.com/opendatazurich/quality-checks — Stadt Zürich. Issues & pull requests at the source.
  • Jupyter Notebook 99.8%
  • HTML 0.2%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2023-06-28 17:20:25 +02:00
baumkataster updates 2022-12-16 17:48:42 +01:00
biotopkartierung adding some plausibility checks to this repo (experimental) 2022-02-15 08:11:35 +01:00
briefkaesten_post_zuerich adding some plausibility checks to this repo (experimental) 2022-02-15 08:11:35 +01:00
luftqualitaet Update luftqualitaet notebook 2022-07-18 16:18:42 +02:00
plausis updates 2023-01-23 09:46:46 +01:00
schulweguebergaenge adding some plausibility checks to this repo (experimental) 2022-02-15 08:11:35 +01:00
showcases Add Stundenwerte notebook 2020-01-06 14:48:57 +01:00
vornamen Add vornamen notebook 2022-07-18 16:18:50 +02:00
.gitignore Initial commit 2019-09-30 11:05:53 +02:00
README.md Add repo status badge 2023-06-28 17:20:25 +02:00

Project Status: Suspended – Initial development has started, but there has not yet been a stable, usable release; work has been stopped for the time being but the author(s) intend on resuming work.

quality-checks

Python environment (Jupyter Notebook) to run various checks on tabular data, including:

  • Plausibility check (e.g. compare values in a time series to previous month, same month in the previous year etc.)
  • Profiling of data
  • Distribution of data
  • Plot graphs to quickly visualize a dataset

Luftqualität

This folder contains a notebook to check the air quality data. It quickly visualizes all the data to see if there is data missing or makes comparisons to data from previous years.

Showcases

The showcases notebook compares previously saved data on all packages of our CKAN catalog with the current data retrieved via the API. Specifically the showcases packages are compared to see if links to dataset went missing (using the num_datasets field) or if generally showcases are missing.

Plausis

This folder contains a collection of different data plausibility checks we usually make before publishing new or updated open data. This collection contains mainly open data from Statistik Stadt Zürich, e.g. plausi_BAU for statistical data on construction (buildings, dwellings, construction activity), plausi_bev_jahresdaten for yearly updated statistical data on population or 'plausi_POL' on data on elections and votes in the city of Zurich. Not all of the Jupyter Notebooks have the same quality though ;) But it might help you to get started.

Biotopkartierung

This repo was used to quickly analyse the very detailed geodataset about the state an quality of biotopes within the City of Zurich.

Schulwegübergänge

Also this repo was used to quickly analyse the geodataset about school route crossings.