Commit graph

1752 commits

Author SHA1 Message Date
Daniel Roth
9501146ec8 Replace new-deal MagicPlan trigger to use outcome=="surveyed" 🟪 2026-05-12 08:59:32 +00:00
Daniel Roth
f0300eb8ff Replace new-deal MagicPlan trigger to use outcome=="surveyed" 🟥 2026-05-12 08:57:24 +00:00
Daniel Roth
6fd95d20af Merge branch 'main' into feature/magicplan-trigger 2026-05-11 09:06:47 +00:00
Jun-te Kim
dccb35c2bc fixed s3 location 2026-05-11 08:44:55 +00:00
Daniel Roth
1243690d10 give handler permission to write to s3 bucket 2026-05-08 15:41:12 +00:00
Daniel Roth
ce2b61d60b Upload gzip-compressed MagicPlan JSON to S3 - only make one API call 🟪 2026-05-08 15:07:09 +00:00
Jun-te Kim
7ef5dc4922 update csv 2026-05-08 15:06:41 +00:00
Jun-te Kim
c9c43f178c demo generated for use in address2uprn 2026-05-08 14:48:15 +00:00
Daniel Roth
9f62e3c31a typehint 2026-05-08 14:30:59 +00:00
Daniel Roth
e1972e4349 Upload gzip-compressed MagicPlan JSON to S3 🟪 2026-05-08 14:23:32 +00:00
Daniel Roth
337474e773 Persist UploadedFile record for each MagicPlan S3 upload 🟩 2026-05-08 14:20:49 +00:00
Daniel Roth
8ac77ce8b9 Persist UploadedFile record for each MagicPlan S3 upload 🟥 2026-05-08 14:19:49 +00:00
Daniel Roth
03e8750c1a Upload MagicPlan JSON to S3 using hubspot_deal_id key when UPRN absent 🟩 2026-05-08 14:17:51 +00:00
Daniel Roth
14a064fdef Upload gzip-compressed MagicPlan JSON to S3 🟩 2026-05-08 14:16:41 +00:00
Daniel Roth
7c9cb5b161 Upload gzip-compressed MagicPlan JSON to S3 🟥 2026-05-08 14:14:42 +00:00
Daniel Roth
f6c17be70a Expose get_plan_raw method on MagicPlanClient 🟩 2026-05-08 14:09:33 +00:00
Daniel Roth
c3aae8fd51 Expose get_plan_raw method on MagicPlanClient 🟥 2026-05-08 14:08:56 +00:00
Daniel Roth
4a9cabe197 Add hubspot_deal_id required field to MagicPlanTriggerRequest 🟩
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-08 13:45:10 +00:00
Daniel Roth
74b3a7f297 Add hubspot_deal_id required field to MagicPlanTriggerRequest 🟥
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-08 13:42:57 +00:00
Daniel Roth
e30e06cb6e simplify dockerfile as playwright not used 2026-05-08 13:24:04 +00:00
Daniel Roth
feaa1ea680 Add MagicPlan Lambda Dockerfile, CI/CD jobs, and SQS IAM wiring in hubspot_deal_etl 2026-05-08 13:12:13 +00:00
Jun-te Kim
8b6a572223 Merge branch 'feature/claude_skills_in_devcontainer' into feature/etl_process_for_old_csv 2026-05-08 13:09:19 +00:00
Daniel Roth
489b0ba30e Add MagicPlan SQS trigger to HubSpot orchestrator 🟥 2026-05-08 13:05:38 +00:00
Jun-te Kim
a39c3a0772 added added historic epc data class with shape 2026-05-08 12:03:35 +00:00
Daniel Roth
f903fdefe7 add TODO 2026-05-08 10:20:12 +00:00
Daniel Roth
c5408f3a89 typing 2026-05-08 10:18:12 +00:00
Daniel Roth
f56dba4ad1 use pytest-postgresql in db tests instead of mocking and checking sql strings 2026-05-08 10:13:44 +00:00
Daniel Roth
6a43b5c69b Merge branch 'main' into feature/magicplan-api-client 2026-05-08 08:50:18 +00:00
Khalim Conn-Kowlessar
c5fe3efcfe patching EPC api bug 2026-05-07 18:42:41 +01:00
Jun-te Kim
90a4d83243 added init files to make it a python module 2026-05-07 16:04:27 +00:00
Jun-te Kim
4f45eeb3e9 save 2026-05-07 15:55:44 +00:00
Jun-te Kim
24ec68bb9f save progress for historical epc procress 2026-05-07 15:55:44 +00:00
Daniel Roth
6b29086a1e typing and renaming 🟪 2026-05-07 13:26:49 +00:00
Daniel Roth
91a634e637 Lambda handler with SQS trigger and __main__ local runner 🟩 2026-05-07 13:16:08 +00:00
Daniel Roth
05bd2ba3e2 MagicPlanService orchestrating fetch, match, map, persist 🟩 2026-05-07 13:12:00 +00:00
Daniel Roth
1a8b27453e MagicPlanService orchestrating fetch, match, map, persist 🟥 2026-05-07 13:11:18 +00:00
Daniel Roth
2f8e08a676 save_plan persisting domain Plan to magic_plan_* tables 🟩 2026-05-07 13:09:09 +00:00
Daniel Roth
5ec0fa5d04 save_plan persisting domain Plan to magic_plan_* tables 🟥 2026-05-07 13:01:04 +00:00
Daniel Roth
7ff7e90307 SQLModel ORM layer for magic_plan_plan/floor/room/window/door tables 🟩 2026-05-07 12:56:12 +00:00
Daniel Roth
bbcde75b8e MagicPlan HTTP client with auth headers and response parsing 🟩 2026-05-07 12:51:41 +00:00
Daniel Roth
ef5c44f7ae MagicPlan HTTP client with auth headers and response parsing 🟥 2026-05-07 12:49:15 +00:00
Daniel Roth
60c69c4786 match address string to magicplan plan 🟩 2026-05-07 12:43:45 +00:00
Daniel Roth
8e12ac705b match address string to magicplan plan 🟥 2026-05-07 12:41:15 +00:00
Daniel Roth
61b91bdb5e add magicplan environment variables to config 2026-05-07 12:39:45 +00:00
Daniel Roth
5b92c31302 validate magicplan trigger request basemodel object 🟩 2026-05-07 12:38:09 +00:00
Daniel Roth
79db1e2c7e validate plans api response as pydantic basemodel object 🟥 2026-05-07 12:22:04 +00:00
Daniel Roth
25aa57e4b6 missing street is not included in address string 🟥 2026-05-06 17:07:22 +00:00
Daniel Roth
3b9d40f2f8 include address and postcode on magicplan plan 🟥 2026-05-06 17:03:00 +00:00
Daniel Roth
079f7e3397 test mapping second api response round dimensions to 2 decimal places 🟩 2026-05-05 16:30:34 +00:00
Daniel Roth
d3ca6bc7ff delete historic mapping and client 2026-05-05 15:45:36 +00:00