Commit graph

1782 commits

Author SHA1 Message Date
Jun-te Kim
27f2ef5e83 get rid of duplicate function and make better sensible variable name 2026-05-12 13:46:02 +00:00
Jun-te Kim
b0e935d497 make sensible naming for column for address column in df 2026-05-12 13:43:12 +00:00
Jun-te Kim
46ec68e5db save match building number 2026-05-12 13:41:59 +00:00
Jun-te Kim
5cd21d8522 get rid of khalim's json 2026-05-12 12:55:50 +00:00
Jun-te Kim
35d191c70e merged from main and resolved pytest.ini confict 2026-05-12 12:54:28 +00:00
Jun-te Kim
18ea95b67d added env variables for boto 2026-05-12 12:34:17 +00:00
Jun-te Kim
35fea20fc7 changed function name 2026-05-12 10:54:45 +00:00
Jun-te Kim
bec5c4f3c3 one place to have df_has_single_uprn 2026-05-12 10:51:27 +00:00
Jun-te Kim
b364df89ad forgot to add tuple typing 2026-05-12 10:31:54 +00:00
Jun-te Kim
f52fe001cc renamed file 2026-05-12 10:14:16 +00:00
Jun-te Kim
8635e2a1aa change file name of epc client service 2026-05-12 10:08:00 +00:00
Jun-te Kim
2c5c8337cc added more type hints 2026-05-12 10:01:25 +00:00
Jun-te Kim
e06ead55d0 add more type hint 2026-05-12 09:48:21 +00:00
Jun-te Kim
b72d5fbf42 fix nitpick 2026-05-12 09:43:40 +00:00
Jun-te Kim
c22528299c added type hinting to uprn 2026-05-12 09:40:12 +00:00
Jun-te Kim
5edae06a65 added imports at the top of the file instead of function 2026-05-12 09:37:23 +00:00
Daniel Roth
9501146ec8 Replace new-deal MagicPlan trigger to use outcome=="surveyed" 🟪 2026-05-12 08:59:32 +00:00
Daniel Roth
f0300eb8ff Replace new-deal MagicPlan trigger to use outcome=="surveyed" 🟥 2026-05-12 08:57:24 +00:00
Jun-te Kim
1934c889b0 refactored test to deal with flats better 2026-05-11 16:23:03 +00:00
Jun-te Kim
9aae5bf482 added logic to deal with flats 2026-05-11 15:20:17 +00:00
Jun-te Kim
6504785e7c merged from main 2026-05-11 12:30:29 +00:00
Daniel Roth
6fd95d20af Merge branch 'main' into feature/magicplan-trigger 2026-05-11 09:06:47 +00:00
Jun-te Kim
dccb35c2bc fixed s3 location 2026-05-11 08:44:55 +00:00
Daniel Roth
1243690d10 give handler permission to write to s3 bucket 2026-05-08 15:41:12 +00:00
Daniel Roth
ce2b61d60b Upload gzip-compressed MagicPlan JSON to S3 - only make one API call 🟪 2026-05-08 15:07:09 +00:00
Jun-te Kim
7ef5dc4922 update csv 2026-05-08 15:06:41 +00:00
Jun-te Kim
c9c43f178c demo generated for use in address2uprn 2026-05-08 14:48:15 +00:00
Daniel Roth
9f62e3c31a typehint 2026-05-08 14:30:59 +00:00
Daniel Roth
e1972e4349 Upload gzip-compressed MagicPlan JSON to S3 🟪 2026-05-08 14:23:32 +00:00
Daniel Roth
337474e773 Persist UploadedFile record for each MagicPlan S3 upload 🟩 2026-05-08 14:20:49 +00:00
Daniel Roth
8ac77ce8b9 Persist UploadedFile record for each MagicPlan S3 upload 🟥 2026-05-08 14:19:49 +00:00
Daniel Roth
03e8750c1a Upload MagicPlan JSON to S3 using hubspot_deal_id key when UPRN absent 🟩 2026-05-08 14:17:51 +00:00
Daniel Roth
14a064fdef Upload gzip-compressed MagicPlan JSON to S3 🟩 2026-05-08 14:16:41 +00:00
Daniel Roth
7c9cb5b161 Upload gzip-compressed MagicPlan JSON to S3 🟥 2026-05-08 14:14:42 +00:00
Daniel Roth
f6c17be70a Expose get_plan_raw method on MagicPlanClient 🟩 2026-05-08 14:09:33 +00:00
Daniel Roth
c3aae8fd51 Expose get_plan_raw method on MagicPlanClient 🟥 2026-05-08 14:08:56 +00:00
Daniel Roth
4a9cabe197 Add hubspot_deal_id required field to MagicPlanTriggerRequest 🟩
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-08 13:45:10 +00:00
Daniel Roth
74b3a7f297 Add hubspot_deal_id required field to MagicPlanTriggerRequest 🟥
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-08 13:42:57 +00:00
Daniel Roth
e30e06cb6e simplify dockerfile as playwright not used 2026-05-08 13:24:04 +00:00
Daniel Roth
feaa1ea680 Add MagicPlan Lambda Dockerfile, CI/CD jobs, and SQS IAM wiring in hubspot_deal_etl 2026-05-08 13:12:13 +00:00
Jun-te Kim
8b6a572223 Merge branch 'feature/claude_skills_in_devcontainer' into feature/etl_process_for_old_csv 2026-05-08 13:09:19 +00:00
Daniel Roth
489b0ba30e Add MagicPlan SQS trigger to HubSpot orchestrator 🟥 2026-05-08 13:05:38 +00:00
Jun-te Kim
a39c3a0772 added added historic epc data class with shape 2026-05-08 12:03:35 +00:00
Daniel Roth
f903fdefe7 add TODO 2026-05-08 10:20:12 +00:00
Daniel Roth
c5408f3a89 typing 2026-05-08 10:18:12 +00:00
Daniel Roth
f56dba4ad1 use pytest-postgresql in db tests instead of mocking and checking sql strings 2026-05-08 10:13:44 +00:00
Daniel Roth
6a43b5c69b Merge branch 'main' into feature/magicplan-api-client 2026-05-08 08:50:18 +00:00
Khalim Conn-Kowlessar
c5fe3efcfe patching EPC api bug 2026-05-07 18:42:41 +01:00
Jun-te Kim
90a4d83243 added init files to make it a python module 2026-05-07 16:04:27 +00:00
Jun-te Kim
4f45eeb3e9 save 2026-05-07 15:55:44 +00:00