Khalim Conn-Kowlessar
8fc8a90c8b
Add WCHG Elmhurst summary ingest script (SharePoint -> S3 + epc_property)
...
One-time ingest of Wythenshawe Community Housing Group Elmhurst *Summary*
PDFs: resolve each property's SharePoint folder from the WCHG xlsx, download
the summary, run the existing extractor -> mapper -> SAP10 pipeline, and
(with --commit) push the PDF to S3, record an uploaded_files row, and save
the EpcPropertyData to epc_property keyed on the national UPRN (property_id
NULL, replace-by-(uprn,source)). Dry-run by default; also emits a SAP-accuracy
CSV vs Elmhurst's reported current SAP (% within 0.5 + MAE).
Adds DomnaSites.SOCIAL_HOUSING (SOCIAL_HOUSING_SHAREPOINT_ID) for the site.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-16 16:40:27 +00:00
Daniel Roth
dc188ca3c5
SharePoint 404s raise ResourceNotFoundError without error-level logging 🟩
...
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-03 12:26:33 +00:00
Daniel Roth
4a71c555fa
SharePoint 404s raise ResourceNotFoundError without error-level logging 🟥
...
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-03 12:22:26 +00:00
Daniel Roth
bdae83b715
SharePoint folder listing requests 500 items per page to cover alphabetically-late properties 🟩
2026-06-04 12:52:07 +00:00
Daniel Roth
eb72b0223f
add ECO_SHAREPOINT_ID env var
2026-06-04 09:11:08 +00:00
Daniel Roth
4e21dda328
rename files in sharepoint to desired structure
2026-05-20 16:26:07 +00:00
Jun-te Kim
fb758b76bf
changed to utils
2026-05-11 08:37:44 +00:00
Jun-te Kim
c9c43f178c
demo generated for use in address2uprn
2026-05-08 14:48:15 +00:00
Daniel Roth
155eab86e4
update Dimensions.xlsx with XML contents
2026-04-15 13:31:40 +00:00
Jun-te Kim
98c9a1df74
added fix for utf
2026-04-13 15:15:42 +00:00
Daniel Roth
4a4099901f
upload files to s3
2026-03-26 16:33:35 +00:00
Daniel Roth
a71e7e30d8
correct sharepoint file structure and playwright videos for debugging
2026-03-26 10:33:49 +00:00
Daniel Roth
441dce9726
Move DomnaSites to dedicated file
2026-03-24 14:43:46 +00:00
Daniel Roth
fea099afe3
delete unused methods and add typehinting to DomnaSharepointClient
2026-03-24 14:42:48 +00:00
Jun-te Kim
a13ab09ab9
added sharepoint functionality for mr roth - enjoy
2026-03-24 13:36:47 +00:00
Jun-te Kim
aaa1bdc077
added utils to allow easier subtask management
2026-03-02 15:15:39 +00:00
c2640a91fc
Merge github.com:Hestia-Homes/Model into feautre/postcode_splitter_address_uprn_automator_2000
2026-02-16 12:44:25 +00:00
Daniel Roth
d1fb1a6d39
typehint read_io_from_s3 signature to remove pylance problems in calling modules
2026-02-16 09:45:26 +00:00
8152dc5166
deploy with new address2uprn handling
2026-02-13 11:15:15 +00:00
Daniel Roth
3761d0bbe7
fix pylance problem in logger
2026-02-12 14:32:48 +00:00
958ab72e0a
deploy to main with new policy
2026-02-12 12:24:47 +00:00
Khalim Conn-Kowlessar
abc300b406
merged
2026-02-10 14:31:28 +00:00
Khalim Conn-Kowlessar
5e717b73b2
added validation of indexes to PlanTriggerRequest
2025-07-22 09:36:20 +01:00
Khalim Conn-Kowlessar
c6e02836a8
poc done for now
2024-11-29 12:10:29 +00:00
Khalim Conn-Kowlessar
3cd9670d1a
adding file detection for elmhurst project handover
2024-11-28 15:53:48 +00:00
Khalim Conn-Kowlessar
5e7827f706
added ocr extraction for permeability report
2024-11-28 14:02:55 +00:00
Khalim Conn-Kowlessar
5a2ffe646c
implementing summary report extraction
2024-11-28 12:00:43 +00:00
Khalim Conn-Kowlessar
8b875cbccf
done with summary report extraction
2024-11-28 09:44:26 +00:00
Khalim Conn-Kowlessar
26e0206f37
extracted roof and walls
2024-11-28 09:20:44 +00:00
Khalim Conn-Kowlessar
d489b4346f
extracting secondary heating
2024-11-28 09:14:38 +00:00
Khalim Conn-Kowlessar
f141aa4d84
extracting windows
2024-11-28 08:42:53 +00:00
Khalim Conn-Kowlessar
bcbb43ed8f
adding the summary report extraction class
2024-11-28 08:38:38 +00:00
Khalim Conn-Kowlessar
63521dd1e3
extending extraction
2024-11-27 17:18:17 +00:00
Khalim Conn-Kowlessar
749faaebca
extending extraction
2024-11-27 17:07:56 +00:00
Khalim Conn-Kowlessar
0efd0163ee
refactoring epr extraction
2024-11-27 13:30:36 +00:00
Khalim Conn-Kowlessar
965cf975e2
setting up data extraction pilot
2024-11-27 13:08:03 +00:00
Khalim Conn-Kowlessar
a2c61395de
new environment working
2024-10-21 18:34:18 +01:00
Khalim Conn-Kowlessar
6f053a20d1
completing source_epc_properties
2024-08-19 11:20:38 +01:00
Khalim Conn-Kowlessar
3257485248
xml extraction wip
2024-07-24 18:46:39 +01:00
Khalim Conn-Kowlessar
dd0deab0ee
setting up energy consumption model class
2024-07-02 14:59:16 +01:00
Khalim Conn-Kowlessar
42d9821fff
set up e.on asset list
2024-05-21 10:05:53 +01:00
Khalim Conn-Kowlessar
80fc7c821e
moed reading csv function
2024-03-28 17:38:52 +00:00
Khalim Conn-Kowlessar
8b8e2bf902
working on new forecast approach for warmfront remaining sales
2024-03-01 16:29:19 +00:00
Khalim Conn-Kowlessar
1c44b07662
working on heating control recommendation for urban splash
2024-02-19 13:02:43 +00:00
Khalim Conn-Kowlessar
709a50f02e
setting up cache
2024-01-22 18:46:43 +00:00
Khalim Conn-Kowlessar
fec6fab42a
Created script to create sample input file
2023-10-11 13:19:23 +08:00
Khalim Conn-Kowlessar
e2633dfa5b
restructuing property class to move more property level attributes to the Property class
2023-10-06 11:39:41 +01:00
Khalim Conn-Kowlessar
6cc84e95bf
impementing spatial data
2023-10-05 17:56:28 +01:00
Khalim Conn-Kowlessar
64b6b67499
Added s3 download for conservation area data
2023-09-29 10:19:13 +01:00
Khalim Conn-Kowlessar
b71e76449f
working on rdsap cleaning
2023-09-15 19:13:14 +01:00
