Skip to content

codeformuenster/divi-crawler

Repository files navigation

divi-crawler

DEPRECATED, see https://github.com/codeformuenster/divi-map for latest data.

Web crawler for data at divi.de (Deutsche interdisziplinäre Vereinigung fir Intensiv- und Notfallmedizin).

Setup instructions

  1. Install development dependencies for Python 3.7:

    python3 -m pip install -r requirements.txt
  2. Call the crawler script:

    python3 scripts/divi-icu-beds.py

Steps for commiting the .json file into the "data" folder on GitHub

  1. Run Setup Instructions above.

  2. Generate a "personal access token" on GitHub:

    At your GitHub account: "Settings" -> "Developer Settings" -> "Personal access tokens" -> "Generate new token".

  3. Generate a file "config.py"

    (like config.py.example) and copy your personal access token into the file.

    Note: Treat your personal access token like a password and NEVER check in your config.py.

  4. Call the auto_commit script:

    python3 scripts/autocommit.py

Docker automation

  1. Build image:

    docker build . -t divi
  2. Run crawler in container:

    docker run divi /bin/bash -c "python scripts/divi-icu-beds.py && python scripts/autocommit.py"

About

DEPRECATED Scraping & Datenarchiv der Intensivbetten in deutschen Krankenhäusern

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published