junte/Model
1
0
Fork 0
mirror of https://github.com/Hestia-Homes/Model.git synced 2026-06-08 11:17:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
Model/backend/etl/etl_opendatacommunities
History
Jun-te Kim dccb35c2bc fixed s3 location
2026-05-11 08:44:55 +00:00
..
__init__.py added init files to make it a python module 2026-05-07 16:04:27 +00:00
main.py added added historic epc data class with shape 2026-05-08 12:03:35 +00:00
README.md fixed s3 location 2026-05-11 08:44:55 +00:00

README.md

This website https://epc.opendatacommunities.org/ has closed down on 30th May 2026

So we downloaded the data and moved everything to S3 ( s3://retrofit-data-dev/histroical_epc/0_master_backup/ )

This scripts assumes the following:

  1. You downloaded the master copy, uncompressed it and set it to a path so we can read the csv

The script funciton is:

  1. reads csv for all data, seperate each iteration by postcode
  2. compresses the csv and save it in the location
  3. location s3://retrofit-data-dev/historical_epc//compressed data.csv