Read-only mirror of https://github.com/MeteoSwiss/realtime_calibration — MeteoSwiss. Issues & pull requests at the source.
  • R 98.7%
  • Shell 1.3%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Simon Adamov bb033c9177 Typos
2023-03-22 13:20:09 +01:00
.vscode Reviews for Paper Re-Submission 2023-02-09 17:06:02 +01:00
data Improved data import and missing data handling 2022-09-07 12:09:13 +02:00
ext-data added files 2023-03-15 09:37:48 +01:00
man Improved Roxygen Package Documentation 2022-09-08 11:44:47 +02:00
R updated license 2023-03-10 12:13:47 +01:00
vignettes Typos 2023-03-22 13:20:09 +01:00
.gitignore removed symlinks 2023-03-15 09:36:49 +01:00
.here Initial Commit 2022-04-19 12:15:06 +02:00
.Rbuildignore Initial Commit 2022-04-19 12:15:06 +02:00
.Rprofile safer setup for non VSCode users 2022-06-01 11:22:27 +02:00
AUTHORS.md contributing 2023-03-10 12:21:55 +01:00
DESCRIPTION Improved Roxygen Package Documentation 2022-09-08 11:44:47 +02:00
environment.yml R-base upgrade; Feedback from initial review 2022-10-27 15:10:28 +02:00
LICENSE.md updated license 2023-03-10 12:13:47 +01:00
NAMESPACE Improved Roxygen Package Documentation 2022-09-08 11:44:47 +02:00
README.md Reviews for Paper Re-Submission 2023-02-09 17:06:02 +01:00

Overview

This readme document should give an overview of the project and its main components. For a full documentation of the newly developed pollen code to assimilate real-time pollen date into COSMO/ICON please refer to this confluence page: https://service.meteoswiss.ch/confluence/x/dYQYBQ (access has to be requested outside of Meteoswiss domain) There is e second git-repo available here: https://github.com/sadamov/cosmo.git that contains the newly developed Fortran Subroutines to assimilate the real-time pollen data in COSMO/ICON.

Setup

The analysis was conducted in R 4.2.1. The vignettes are Rmarkdown notebooks. The project is set up as a minimal R-package to assure maximum reproducibility (https://r-pkgs.org/index.html).

All necessary libraries and R-packages were installed using conda (https://docs.conda.io/en/latest/miniconda.html). Make sure you have conda installed before attempting to reproduce the steps below.

So to reproduce the full analysis, carry out these steps:

# Clone git repo
git clone git@github.com:sadamov/realtime_calibration.git
# Step into directory
cd realtime_calibration
# Create conda environment with all required dependencies
conda env create -n realtime_cal -f environment.yml
# Activate Conda Environment
conda activate realtime_cal
# Either work in an interactive R-Session (e.g. within RStudio or VSCode) or knit the document directly
R -e "rmarkdown::render('vignettes/analysis.Rmd')"

Branches

There is one branch in this repo:

  • Main: Protected main branch containing the latest fully functional version of all vignettes and scripts.

Data

There is quite a lot of external data required for this analysis and only people working at MeteoSwiss will have access to all of it. In the folder /ext-data scripts are stored that will retrieve and preprocess the data from external sources. The ready-made data is then stored in the /data folder and accessed by various scripts. To rerun the analysis only the data inside the /data folder is required.

  • dwh: Text files of Pollen-Measurements (Concentrations 1/m^3) averaged daily and hourly. Daily surface temperatures. The data is retrieved with the ruby script dwh_retrieve(). Used in various vignettes.
  • cosmo: Text file of Pollen Concentrations (1/m^3) predicted by COSMO for one specific hour. The data is retrieved with Fieldextra.
  • other: Dataframes containing names and abbreviations of Swiss pollen stations and species. Manually typed (information available in various MeteoSwiss documentations) and used in various vignettes.

Vignettes

  • Analysis.Rmd: The whole analysis in one location, loading the data from the /data folder and calculating all metrics and plots. Can be knitted into html or pdf format for a nicer reading experience.
  • Analysis.R: The same content as the Rmd-file, can be alternatively used in old-school R setups.