Commit graph

37 commits

Author SHA1 Message Date
Daniel Roth
d0847681c1 tidy up logs 2026-02-10 09:42:29 +00:00
Daniel Roth
06539a787d use streaming mode in openpyxl for peabody parser 2026-02-10 09:30:39 +00:00
Daniel Roth
c0534d9546 more logs 2026-02-10 09:16:52 +00:00
Daniel Roth
cd0ae37d40 more logging 2026-02-09 17:18:45 +00:00
Daniel Roth
981b6358c4 plug everything into in handler 2026-02-04 15:14:26 +00:00
Daniel Roth
62906f6023 get file type from request body 2026-02-04 14:29:43 +00:00
Daniel Roth
da57392953 start making changes to deploy handler 2026-02-04 12:16:47 +00:00
Daniel Roth
cd24804ca2 Optionally inject uprn lookup into parser 🟩 2026-02-04 12:14:42 +00:00
Daniel Roth
f253bbbf8b optionally inject uprn lookup into parser method, for testing purposes 🟩 2026-01-30 09:32:34 +00:00
Daniel Roth
d26ea2863b get uprn from reference:uprn file. parsing test fails for now, need to fix 2026-01-29 17:19:03 +00:00
Daniel Roth
d83d73c129 Local postgres within devcontainer, plus fixes so data loads into db 2026-01-29 16:11:16 +00:00
Daniel Roth
751032e666 fixes so it actually runs 2026-01-28 09:54:33 +00:00
Daniel Roth
8cdbe107e5 add TODO to is_block_level 2026-01-23 16:21:33 +00:00
Daniel Roth
4c16632b2f process both file types in local runner 2026-01-23 14:01:21 +00:00
Daniel Roth
fa72d16239 small tidies 2026-01-22 15:21:31 +00:00
Daniel Roth
a7201b0dc4 Start writing peabody mapper. Now rethink model before continuing 2026-01-22 12:20:17 +00:00
Daniel Roth
1634e04dda consistent address trimming when assmebling property objects 2026-01-22 09:30:50 +00:00
Daniel Roth
9ccbbafb29 Detect block-level asset conditions 🟩 2026-01-22 09:24:23 +00:00
Daniel Roth
f8db0cadba Ignore block level assets during parsing 2026-01-22 09:15:37 +00:00
Daniel Roth
80f3325cf0 Detect block-level asset conditions 🟩 2026-01-22 09:08:15 +00:00
Daniel Roth
a07020d085 Detect block-level asset conditions 🟥 2026-01-21 17:33:14 +00:00
Daniel Roth
4e190328cc Parse Peabody condition data xlsx 🟩 2026-01-21 16:25:58 +00:00
Daniel Roth
d43d9d9069 Parse Peabody condition data xlsx 🟥 2026-01-21 15:13:17 +00:00
Daniel Roth
25923cbc9f add mapping to processor 2026-01-21 12:09:02 +00:00
Daniel Roth
694bb0b569 Define classes 2026-01-20 15:57:56 +00:00
Daniel Roth
7846f9c949 Adjust EPC column name to correctly include trailing space 2026-01-20 10:34:09 +00:00
Daniel Roth
01bf0dbd9c Parse Houses sheet as well 🟪 2026-01-20 09:58:20 +00:00
Daniel Roth
e11f59a732 Parse Houses sheet as well 🟩 2026-01-20 09:53:01 +00:00
Daniel Roth
dce8442fff Parse Houses sheet as well 🟥 2026-01-20 09:34:23 +00:00
Daniel Roth
13daa62bdf map correct uprn when parsing asset conditions 🟩 2026-01-19 16:51:18 +00:00
Daniel Roth
4553e9937b parse lbwf houses 🟪 2026-01-19 16:28:51 +00:00
Daniel Roth
6ff652ff34 parse lbwf houses 🟩 2026-01-19 16:23:11 +00:00
Daniel Roth
60f3f0c222 parse lbwf houses 🟥 2026-01-19 14:50:05 +00:00
Daniel Roth
049a93fa26 Create FileType enum 🟪 2026-01-19 11:47:32 +00:00
Daniel Roth
6fd4b19e88 Parser factory raises value error on unknown file path 🟩 2026-01-19 11:18:15 +00:00
Daniel Roth
4d36fce83d Parser factory chooses parser class based on filepath 🟩 2026-01-19 11:13:14 +00:00
Daniel Roth
c073a4cb43 Parser factory chooses parser class based on filepath 🟥 2026-01-19 11:08:30 +00:00