Commit graph

11 commits

Author SHA1 Message Date
Khalim Conn-Kowlessar
8fc8a90c8b Add WCHG Elmhurst summary ingest script (SharePoint -> S3 + epc_property)
One-time ingest of Wythenshawe Community Housing Group Elmhurst *Summary*
PDFs: resolve each property's SharePoint folder from the WCHG xlsx, download
the summary, run the existing extractor -> mapper -> SAP10 pipeline, and
(with --commit) push the PDF to S3, record an uploaded_files row, and save
the EpcPropertyData to epc_property keyed on the national UPRN (property_id
NULL, replace-by-(uprn,source)). Dry-run by default; also emits a SAP-accuracy
CSV vs Elmhurst's reported current SAP (% within 0.5 + MAE).

Adds DomnaSites.SOCIAL_HOUSING (SOCIAL_HOUSING_SHAREPOINT_ID) for the site.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-16 16:40:27 +00:00
Daniel Roth
dc188ca3c5 SharePoint 404s raise ResourceNotFoundError without error-level logging 🟩
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-03 12:26:33 +00:00
Daniel Roth
4a71c555fa SharePoint 404s raise ResourceNotFoundError without error-level logging 🟥
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-03 12:22:26 +00:00
Daniel Roth
bdae83b715 SharePoint folder listing requests 500 items per page to cover alphabetically-late properties 🟩 2026-06-04 12:52:07 +00:00
Daniel Roth
eb72b0223f add ECO_SHAREPOINT_ID env var 2026-06-04 09:11:08 +00:00
Daniel Roth
4e21dda328 rename files in sharepoint to desired structure 2026-05-20 16:26:07 +00:00
Daniel Roth
155eab86e4 update Dimensions.xlsx with XML contents 2026-04-15 13:31:40 +00:00
Daniel Roth
a71e7e30d8 correct sharepoint file structure and playwright videos for debugging 2026-03-26 10:33:49 +00:00
Daniel Roth
441dce9726 Move DomnaSites to dedicated file 2026-03-24 14:43:46 +00:00
Daniel Roth
fea099afe3 delete unused methods and add typehinting to DomnaSharepointClient 2026-03-24 14:42:48 +00:00
Jun-te Kim
a13ab09ab9 added sharepoint functionality for mr roth - enjoy 2026-03-24 13:36:47 +00:00