Follow open_data reorganisation by source

{

  "permissions": {

    "additionalDirectories": ["../open_data"],

    "allow": [

      "Read(../open_data/**)",

      "Edit(../open_data/**)",

      "Write(../open_data/**)"

    ]

  }

}

AI generated by Claude Sonnet and Claude Opus 5.5 on 2026-10-21. Not legal advice.

Scope: the datasets in the `open_data` repository, folders `carbon_pricing`,

`renewable_energy` and `extreme_weather`. Licence terms were checked on the web on

Scope: the datasets in the `open_data` repository, originally in topic folders

`carbon_pricing`, `renewable_energy` and `extreme_weather`, now one folder per source

(see the `open_data` README). Licence terms were checked on the web on

2026-10-21 and in the OWID metadata files. Anything not confirmed is marked

"unverified". Datasets whose terms do not allow redistribution are not kept in the

repository and are not listed here.

| File(s) | Dataset | Provider / original source | Licence | Size | Verdict |

|---|---|---|---|---|---|

| `carbon_pricing/owid_carbon-tax-instruments.csv` (+ metadata) | Carbon tax instruments | OWID / Dolphin and Merkle (2024), RFF | CC BY 4.0 (OWID processing); upstream terms unverified | 244 KB | Publish with attribution file |

| `carbon_pricing/owid_carbon-emissions-trading-system.csv` (+ metadata) | ETS presence | same | same | 194 KB | Publish with attribution file |

| `carbon_pricing/owid_carbon-tax-trading-coverage.csv` (+ metadata) | Share of CO2 covered | same | same | 200 KB | Publish with attribution file |

| `carbon_pricing/owid_emissions-weighted-carbon-price.csv` (+ metadata) | Emissions-weighted carbon price | same | same | 157 KB | Publish with attribution file |

| `carbon_pricing/owid-co2-data.csv` | OWID CO2 data | OWID / Global Carbon Project and others | CC BY 4.0 (OWID); third-party columns keep upstream terms | 33.2 MB | Do not commit (size); give download instructions |

| `carbon_pricing/datahub_carbon-pricing-initiatives.csv`, `datahub_carbon-prices.csv`, `datahub_datapackage.json` | World Bank carbon pricing (datahub mirror) | World Bank, State and Trends of Carbon Pricing, via datahub.io | CC BY 4.0 (package); NZ ETS rows PDDL | 14 KB, 112 KB, 8 KB | Publish with attribution file |

| `renewable_energy/ember_yearly_generation_global.csv` | Ember yearly electricity data | Ember | CC BY 4.0 | 16.1 MB | Licence fine; git LFS or download instructions (size) |

| `renewable_energy/owid_solar-pv-prices-vs-cumulative-capacity.csv` (+ metadata) | PV module price vs capacity | OWID / Nemet (2009), Farmer and Lafond (2016), IRENA | CC BY 4.0 (OWID); IRENA terms unverified | 2 KB + 4 KB | Publish with attribution file |

| `renewable_energy/owid_levelized-cost-of-energy.csv` (+ metadata) | LCOE | OWID / IRENA | CC BY 4.0 (OWID); IRENA terms unverified | 36 KB + 15 KB | Publish with attribution file |

| `renewable_energy/owid_cumulative-installed-wind-energy-capacity-gigawatts.csv` (+ metadata) | Wind capacity | OWID / IRENA | same | 93 KB + 1 KB | Publish with attribution file |

| `extreme_weather/worldbank_NY.GDP.MKTP.CD.json` | World Bank GDP | World Bank WDI | CC BY 4.0 | 3.7 MB | Publish with attribution file |

| `extreme_weather/worldbank_SP.POP.TOTL.json` | World Bank population | World Bank WDI (UN and other sources) | CC BY 4.0 default; third-party terms unverified for this series | 3.5 MB | Publish with attribution file |

| `extreme_weather/worldbank_countries.json` | World Bank country list | World Bank | CC BY 4.0 | 114 KB | Publish with attribution file |

| `extreme_weather/owid_continents.csv` | OWID continents | OWID | CC BY 4.0 | 8 KB | Publish with attribution file |

| `extreme_weather/noaa_billion_dollar_events_US_1980_2024.csv` | US billion-dollar disasters | NOAA NCEI | US Government work (public domain, unverified on the NCEI page) | 36 KB | Publish with attribution file |

| `*/SOURCES.md` | Documentation | repository authors | n/a | 4 KB each | Publish |

| `our_world_in_data/owid_carbon-tax-instruments.csv` (+ metadata) | Carbon tax instruments | OWID / Dolphin and Merkle (2024), RFF | CC BY 4.0 (OWID processing); upstream terms unverified | 244 KB | Publish with attribution file |

| `our_world_in_data/owid_carbon-emissions-trading-system.csv` (+ metadata) | ETS presence | same | same | 194 KB | Publish with attribution file |

| `our_world_in_data/owid_carbon-tax-trading-coverage.csv` (+ metadata) | Share of CO2 covered | same | same | 200 KB | Publish with attribution file |

| `our_world_in_data/owid_emissions-weighted-carbon-price.csv` (+ metadata) | Emissions-weighted carbon price | same | same | 157 KB | Publish with attribution file |

| `our_world_in_data/owid-co2-data.csv` | OWID CO2 data | OWID / Global Carbon Project and others | CC BY 4.0 (OWID); third-party columns keep upstream terms | 33.2 MB | Do not commit (size); give download instructions |

| `world_bank/datahub_carbon-pricing-initiatives.csv`, `datahub_carbon-prices.csv`, `datahub_datapackage.json` | World Bank carbon pricing (datahub mirror) | World Bank, State and Trends of Carbon Pricing, via datahub.io | CC BY 4.0 (package); NZ ETS rows PDDL | 14 KB, 112 KB, 8 KB | Publish with attribution file |

| `ember/ember_yearly_generation_global.csv` | Ember yearly electricity data | Ember | CC BY 4.0 | 16.1 MB | Licence fine; git LFS or download instructions (size) |

| `our_world_in_data/owid_solar-pv-prices-vs-cumulative-capacity.csv` (+ metadata) | PV module price vs capacity | OWID / Nemet (2009), Farmer and Lafond (2016), IRENA | CC BY 4.0 (OWID); IRENA terms unverified | 2 KB + 4 KB | Publish with attribution file |

| `our_world_in_data/owid_levelized-cost-of-energy.csv` (+ metadata) | LCOE | OWID / IRENA | CC BY 4.0 (OWID); IRENA terms unverified | 36 KB + 15 KB | Publish with attribution file |

| `our_world_in_data/owid_cumulative-installed-wind-energy-capacity-gigawatts.csv` (+ metadata) | Wind capacity | OWID / IRENA | same | 93 KB + 1 KB | Publish with attribution file |

| `world_bank/worldbank_NY.GDP.MKTP.CD.json` | World Bank GDP | World Bank WDI | CC BY 4.0 | 3.7 MB | Publish with attribution file |

| `world_bank/worldbank_SP.POP.TOTL.json` | World Bank population | World Bank WDI (UN and other sources) | CC BY 4.0 default; third-party terms unverified for this series | 3.5 MB | Publish with attribution file |

| `world_bank/worldbank_countries.json` | World Bank country list | World Bank | CC BY 4.0 | 114 KB | Publish with attribution file |

| `our_world_in_data/owid_continents.csv` | OWID continents | OWID | CC BY 4.0 | 8 KB | Publish with attribution file |

| `noaa/noaa_billion_dollar_events_US_1980_2024.csv` | US billion-dollar disasters | NOAA NCEI | US Government work (public domain, unverified on the NCEI page) | 36 KB | Publish with attribution file |

| `*/README.md` (per source) | Documentation | repository authors | n/a | 4 KB each | Publish |

## General point: OWID's CC BY and third-party data

g-dolphin/WorldCarbonPricingDatabase to confirm it does not forbid redistribution; if it

does, remove these four files and give download instructions instead:

```

cd open_data/carbon_pricing

cd open_data/our_world_in_data

for s in carbon-tax-instruments carbon-emissions-trading-system carbon-tax-trading-coverage emissions-weighted-carbon-price; do

  curl -L -A "Mozilla/5.0" -o "owid_$s.csv" "https://ourworldindata.org/grapher/$s.csv?v=1&csvType=full&useColumnShortNames=true"

  curl -L -A "Mozilla/5.0" -o "owid_$s.metadata.json" "https://ourworldindata.org/grapher/$s.metadata.json?v=1&csvType=full&useColumnShortNames=true"

## Carbon pricing: owid-co2-data.csv

- File: `carbon_pricing/owid-co2-data.csv`, 33.2 MB.

- File: `our_world_in_data/owid-co2-data.csv`, 33.2 MB.

- Provider: OWID, https://github.com/owid/co2-data. Upstream sources: Global Carbon

  Project (CO2), Jones et al. (other greenhouse gases, temperature), Energy Institute

  Statistical Review and US EIA (energy), Maddison Project Database (GDP), World Bank

**Suggestion:** Do not commit the raw file, because of its size and the mixed upstream

terms of the energy columns. Add it to `.gitignore` and give download instructions:

```

cd open_data/carbon_pricing

cd open_data/our_world_in_data

curl -L -A "Mozilla/5.0" -o owid-co2-data.csv https://owid-public.owid.io/data/co2/owid-co2-data.csv

```

Check: about 33 MB; first columns `country,year,iso_code,population,gdp,...`; contains

## Renewable energy: Ember yearly electricity data

- File: `renewable_energy/ember_yearly_generation_global.csv`, 16.1 MB.

- File: `ember/ember_yearly_generation_global.csv`, 16.1 MB.

- Provider: Ember, https://ember-energy.org/data/yearly-electricity-data/.

- Licence: CC BY 4.0, stated on the Ember page.

- Attribution: "Ember – Yearly Electricity Data", with URL and access date.

**Suggestion:** The licence allows redistribution. Because of the size, either track it

with git LFS, or add it to `.gitignore` and give download instructions:

```

cd open_data/renewable_energy

cd open_data/ember

curl -L -A "Mozilla/5.0" -o ember_yearly_generation_global.csv https://files.ember-energy.org/public-downloads/generation/outputs/release_generation_yearly_global.csv

```

Check: about 16 MB; sha256

**Suggestion:** Fine to include, with the attribution above. If the population series

turns out to carry third-party terms, replace the file with download instructions:

```

cd open_data/extreme_weather

cd open_data/world_bank

curl -L -o worldbank_SP.POP.TOTL.json "https://api.worldbank.org/v2/country/all/indicator/SP.POP.TOTL?format=json&per_page=20000&date=1960:2025"

```

  DATA_LICENSES.md   per file: provider, licence, attribution text, access date

  fetch_missing.sh   downloads the ignored files listed below

  .gitignore

  carbon_pricing/  renewable_energy/  extreme_weather/   each with SOURCES.md

  our_world_in_data/  world_bank/  ember/  noaa/  bast/   one directory per source, each with README.md

```

Do not put one licence on the whole repository: the content mixes CC BY 4.0, PDDL and

public domain, and the repository owner is not the rights holder. Use

`DATA_LICENSES.md` with per-file attribution, and license only the repository's own

README, SOURCES.md files and scripts.

README, source README.md files and scripts.

`.gitignore`:

```

carbon_pricing/owid-co2-data.csv

renewable_energy/ember_yearly_generation_global.csv   # remove this line if using git LFS

our_world_in_data/owid-co2-data.csv

ember/ember_yearly_generation_global.csv   # remove this line if using git LFS

```

`fetch_missing.sh`: `set -e`, then the `curl` commands from the sections above, followed

by a size and `sha256sum` check against the values in `SOURCES.md`.

by a size and `sha256sum` check against the values in the source `README.md` files.

## Data sources

- BASt hourly counts 2023, B roads: `open_data/road_data/data/2023_B_S/2023_B_S.txt` (read only).

- BASt hourly counts 2023, B roads: `open_data/bast/data/2023_B_S/2023_B_S.txt` (read only).

- BASt station list 2023 with WGS84 coordinates (Jawe2023.csv):

  `https://www.bast.de/DE/Themen/Digitales/HF_1/Massnahmen/verkehrszaehlung/Daten/2023_1/Jawe2023.csv?view=renderTcDataExportCSV&cms_strTyp=B`

  (the file contains all stations, A and B roads). Joined on `TK_Nr` = `TKNR`.

counts:

  # BASt 2023 hourly counts for B roads (read only)

  hourly_file: /home/paul/rp/uhoh/open_data/road_data/data/2023_B_S/2023_B_S.txt

  hourly_file: /home/paul/rp/uhoh/open_data/bast/data/2023_B_S/2023_B_S.txt

  station_list_url: "https://www.bast.de/DE/Themen/Digitales/HF_1/Massnahmen/verkehrszaehlung/Daten/2023_1/Jawe2023.csv?view=renderTcDataExportCSV&cms_strTyp=B"

  station_tknr: 6724          # Künzelsau, B19, the only B19 station in Baden-Württemberg

  # Which days enter the DTV: "all" (Mo-Su, annual average daily traffic) or "workdays" (Fahrtzw = w)

# Parameters for the B19 Kocher bridge closure cost (all scripts read this file)

paths:

  bast_hourly: /home/paul/rp/uhoh/open_data/road_data/data/2023_B_S/2023_B_S.txt

  bast_hourly: /home/paul/rp/uhoh/open_data/bast/data/2023_B_S/2023_B_S.txt

  data_dir: data

  output_dir: output