Commit graph

6685 commits

Author SHA1 Message Date
Daniel Roth
c718e36c11 trigger pashub to ara lambda if necessary 2026-04-09 12:54:01 +00:00
Daniel Roth
f572dfd2b3 trigger pashub to ara lambda if necessary 2026-04-09 12:53:48 +00:00
Daniel Roth
36aaabb3cf diff checker for db load trigger 🟩 2026-04-09 11:19:33 +00:00
Daniel Roth
125527baa9 move HubspotDealData object to dedicated file 2026-04-09 10:46:52 +00:00
Daniel Roth
ba0e82da0d Merge branch 'main' into feature/hubspot-trigger-orchestrator 2026-04-09 10:37:37 +00:00
Daniel Roth
01636514aa pull diffing logic out of loading method 2026-04-09 10:32:59 +00:00
Jun-te Kim
a0a667ec69
Merge pull request #963 from Hestia-Homes/feature/dont_drop_postcode
added coordination comments
2026-04-09 11:18:38 +01:00
Daniel Roth
605652b309 diff checker for db load trigger 🟥 2026-04-09 09:56:58 +00:00
Daniel Roth
c439d5f557 move everything to etl/hubspot/ 2026-04-09 09:41:43 +00:00
Daniel Roth
8ce7619044 refactor pashub trigger tests 2026-04-09 09:14:20 +00:00
Daniel Roth
dd0522713e refactor upsert_deal by introducing helper methods 2026-04-09 08:30:28 +00:00
Daniel Roth
f719149c03 replace incorrect tests 🟩 2026-04-08 16:04:30 +00:00
Daniel Roth
2d0bc67731 diff checker for pashub trigger 🟪 2026-04-08 15:59:29 +00:00
Daniel Roth
9da0cabb0f pashub trigger true if lodgement complete and pashub link set 🟩 2026-04-08 15:52:41 +00:00
Daniel Roth
0dfd3f5238 pashub trigger true if design complete and pashub link set 🟩 2026-04-08 15:45:41 +00:00
Daniel Roth
832bcd96e4 pashub trigger true if coordination complete and pashub link set 🟩 2026-04-08 15:42:29 +00:00
Daniel Roth
ad2c979b15 pashub trigger false if pashub link not set 🟩 2026-04-08 15:35:52 +00:00
Daniel Roth
9f7448ac43 pashub trigger true if pashub link is changed 🟩 2026-04-08 15:35:42 +00:00
Daniel Roth
39f37f1668 diff checker for pashub trigger 🟥 2026-04-08 15:26:32 +00:00
Daniel Roth
21ca0d7649 diff checker for pashub trigger 🟥 2026-04-08 15:25:50 +00:00
Daniel Roth
540054e12f rename method 2026-04-08 14:53:11 +00:00
Daniel Roth
b968fbab44 include missing file 2026-04-08 14:48:29 +00:00
Daniel Roth
d6bfef59af remove db update from hubspot client get method 2026-04-08 14:48:17 +00:00
Jun-te Kim
d730a90246 added coordination comments 2026-04-08 14:47:31 +00:00
Daniel Roth
942c2923da initial setup 2026-04-08 10:55:48 +00:00
Daniel Roth
5df2318bb5 start defining infrastructure including ecr 2026-04-08 08:44:45 +00:00
Daniel Roth
9471854dfb dockerfile, requirements, and local handler 2026-04-08 08:27:12 +00:00
Daniel Roth
09ee2699b6 remove accidentally committed lock file 2026-04-08 07:43:09 +00:00
Daniel Roth
7cd4d4c5b3 bug fixes to get runner working 2026-04-08 07:42:00 +00:00
Daniel Roth
d229e2faf8 upload file to s3 and update db after doing so 2026-04-07 14:55:43 +00:00
Daniel Roth
15f1fde16a skip file if already processed according to db 2026-04-07 14:34:33 +00:00
Daniel Roth
849a272974 get hubspot listing id from spreadsheet 2026-04-07 11:47:47 +00:00
Daniel Roth
a4a3a3b46f Merge branch 'main' into feature/ecmk-to-ara 2026-04-07 11:29:32 +00:00
Daniel Roth
ba30bccb07 revert spreadsheet update changes. add better logging 2026-04-07 11:29:10 +00:00
Daniel Roth
59ed485773
Merge pull request #961 from Hestia-Homes/main
Some checks failed
Fast Api Backend Deploy / deploy (push) Has been cancelled
Deploy infrastructure / determine_stage (push) Has been cancelled
Deploy infrastructure / ara_engine_image (push) Has been cancelled
Deploy infrastructure / shared_terraform (push) Has been cancelled
Deploy infrastructure / ara_engine_lambda (push) Has been cancelled
Deploy infrastructure / address2uprn_image (push) Has been cancelled
Deploy infrastructure / address2uprn_lambda (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_image (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_lambda (push) Has been cancelled
Deploy infrastructure / condition_etl_image (push) Has been cancelled
Deploy infrastructure / condition_etl_lambda (push) Has been cancelled
Deploy infrastructure / categorisation_image (push) Has been cancelled
Deploy infrastructure / categorisation_lambda (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_image (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_lambda (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_image (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_lambda (push) Has been cancelled
Deploy infrastructure / fast_api_lambda (push) Has been cancelled
Deploy infrastructure / cloudfront_acm (push) Has been cancelled
Deploy infrastructure / cloudfront_cdn (push) Has been cancelled
Deploy infrastructure / hubspot_etl_image (push) Has been cancelled
Deploy infrastructure / hubspot_etl_lambda (push) Has been cancelled
sensible maximum and batch
2026-04-07 12:16:41 +01:00
Jun-te Kim
89ad1c9050
Merge pull request #960 from Hestia-Homes/feature/dont_drop_postcode
Feature/dont drop postcode
2026-04-07 12:11:27 +01:00
Jun-te Kim
34414d14a5 change to sensiable concurrecy and batch size 2026-04-07 11:10:15 +00:00
Jun-te Kim
25e08f3e96 2 lambda b ut 1 batch size 2026-04-07 11:08:19 +00:00
Jun-te Kim
426d907ce7 2 lambda b ut 1 batch size 2026-04-07 10:54:17 +00:00
Jun-te Kim
acbd0cfc35 maximum concurrency to 2 2026-04-07 10:53:57 +00:00
Jun-te Kim
8b3f5d8808
Merge pull request #959 from Hestia-Homes/main
Some checks are pending
Fast Api Backend Deploy / deploy (push) Waiting to run
Deploy infrastructure / address2uprn_lambda (push) Blocked by required conditions
Deploy infrastructure / determine_stage (push) Waiting to run
Deploy infrastructure / shared_terraform (push) Blocked by required conditions
Deploy infrastructure / ara_engine_image (push) Blocked by required conditions
Deploy infrastructure / ara_engine_lambda (push) Blocked by required conditions
Deploy infrastructure / address2uprn_image (push) Blocked by required conditions
Deploy infrastructure / postcodeSplitter_image (push) Blocked by required conditions
Deploy infrastructure / postcodeSplitter_lambda (push) Blocked by required conditions
Deploy infrastructure / condition_etl_image (push) Blocked by required conditions
Deploy infrastructure / condition_etl_lambda (push) Blocked by required conditions
Deploy infrastructure / categorisation_image (push) Blocked by required conditions
Deploy infrastructure / categorisation_lambda (push) Blocked by required conditions
Deploy infrastructure / ordnanceSurvey_image (push) Blocked by required conditions
Deploy infrastructure / ordnanceSurvey_lambda (push) Blocked by required conditions
Deploy infrastructure / pashub_to_ara_image (push) Blocked by required conditions
Deploy infrastructure / pashub_to_ara_lambda (push) Blocked by required conditions
Deploy infrastructure / fast_api_lambda (push) Blocked by required conditions
Deploy infrastructure / cloudfront_acm (push) Blocked by required conditions
Deploy infrastructure / cloudfront_cdn (push) Blocked by required conditions
Deploy infrastructure / hubspot_etl_image (push) Blocked by required conditions
Deploy infrastructure / hubspot_etl_lambda (push) Blocked by required conditions
maxiumum concurrency
2026-04-07 11:41:57 +01:00
Jun-te Kim
760acb6982
Merge pull request #958 from Hestia-Homes/feature/dont_drop_postcode
fix maximum concurrency
2026-04-07 11:36:59 +01:00
Jun-te Kim
469401aabd maximum concurrency 2026-04-07 09:59:41 +00:00
Jun-te Kim
2c39f64731 maximum concurrency 2026-04-07 09:58:22 +00:00
Jun-te Kim
8d6be23084 maximum concurrency 2026-04-07 09:56:38 +00:00
Jun-te Kim
959867f5ee maximum concurrent 2026-04-07 09:51:26 +00:00
Jun-te Kim
23d7b22b54 save for easter weekend 2026-04-02 17:30:38 +00:00
Daniel Roth
cd7b59a62f update spreadsheet with properties that have already been processed 2026-04-02 15:42:56 +00:00
Daniel Roth
eda990285b Merge branch 'main' into feature/ecmk-to-ara 2026-04-02 14:49:21 +00:00
Daniel Roth
e0194798e5
Merge pull request #957 from Hestia-Homes/main
Some checks failed
Fast Api Backend Deploy / deploy (push) Has been cancelled
Deploy infrastructure / determine_stage (push) Has been cancelled
Deploy infrastructure / address2uprn_lambda (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_image (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_lambda (push) Has been cancelled
Deploy infrastructure / condition_etl_image (push) Has been cancelled
Deploy infrastructure / ara_engine_lambda (push) Has been cancelled
Deploy infrastructure / condition_etl_lambda (push) Has been cancelled
Deploy infrastructure / address2uprn_image (push) Has been cancelled
Deploy infrastructure / shared_terraform (push) Has been cancelled
Deploy infrastructure / ara_engine_image (push) Has been cancelled
Deploy infrastructure / categorisation_image (push) Has been cancelled
Deploy infrastructure / categorisation_lambda (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_image (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_lambda (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_image (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_lambda (push) Has been cancelled
Deploy infrastructure / fast_api_lambda (push) Has been cancelled
Deploy infrastructure / cloudfront_acm (push) Has been cancelled
Deploy infrastructure / cloudfront_cdn (push) Has been cancelled
Deploy infrastructure / hubspot_etl_image (push) Has been cancelled
Deploy infrastructure / hubspot_etl_lambda (push) Has been cancelled
erroneous postcode don't just get dropped but logged
2026-04-02 15:33:28 +01:00