Commit graph

4869 commits

Author SHA1 Message Date
Daniel Roth
ad2c979b15 pashub trigger false if pashub link not set 🟩 2026-04-08 15:35:52 +00:00
Daniel Roth
9f7448ac43 pashub trigger true if pashub link is changed 🟩 2026-04-08 15:35:42 +00:00
Daniel Roth
39f37f1668 diff checker for pashub trigger 🟥 2026-04-08 15:26:32 +00:00
Daniel Roth
21ca0d7649 diff checker for pashub trigger 🟥 2026-04-08 15:25:50 +00:00
Daniel Roth
540054e12f rename method 2026-04-08 14:53:11 +00:00
Daniel Roth
b968fbab44 include missing file 2026-04-08 14:48:29 +00:00
Daniel Roth
d6bfef59af remove db update from hubspot client get method 2026-04-08 14:48:17 +00:00
Jun-te Kim
d730a90246 added coordination comments 2026-04-08 14:47:31 +00:00
Daniel Roth
942c2923da initial setup 2026-04-08 10:55:48 +00:00
Daniel Roth
5df2318bb5 start defining infrastructure including ecr 2026-04-08 08:44:45 +00:00
Daniel Roth
9471854dfb dockerfile, requirements, and local handler 2026-04-08 08:27:12 +00:00
Daniel Roth
09ee2699b6 remove accidentally committed lock file 2026-04-08 07:43:09 +00:00
Daniel Roth
7cd4d4c5b3 bug fixes to get runner working 2026-04-08 07:42:00 +00:00
Daniel Roth
d229e2faf8 upload file to s3 and update db after doing so 2026-04-07 14:55:43 +00:00
Daniel Roth
15f1fde16a skip file if already processed according to db 2026-04-07 14:34:33 +00:00
Daniel Roth
849a272974 get hubspot listing id from spreadsheet 2026-04-07 11:47:47 +00:00
Daniel Roth
a4a3a3b46f Merge branch 'main' into feature/ecmk-to-ara 2026-04-07 11:29:32 +00:00
Daniel Roth
ba30bccb07 revert spreadsheet update changes. add better logging 2026-04-07 11:29:10 +00:00
Daniel Roth
59ed485773
Merge pull request #961 from Hestia-Homes/main
Some checks failed
Fast Api Backend Deploy / deploy (push) Has been cancelled
Deploy infrastructure / determine_stage (push) Has been cancelled
Deploy infrastructure / ara_engine_image (push) Has been cancelled
Deploy infrastructure / shared_terraform (push) Has been cancelled
Deploy infrastructure / ara_engine_lambda (push) Has been cancelled
Deploy infrastructure / address2uprn_image (push) Has been cancelled
Deploy infrastructure / address2uprn_lambda (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_image (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_lambda (push) Has been cancelled
Deploy infrastructure / condition_etl_image (push) Has been cancelled
Deploy infrastructure / condition_etl_lambda (push) Has been cancelled
Deploy infrastructure / categorisation_image (push) Has been cancelled
Deploy infrastructure / categorisation_lambda (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_image (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_lambda (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_image (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_lambda (push) Has been cancelled
Deploy infrastructure / fast_api_lambda (push) Has been cancelled
Deploy infrastructure / cloudfront_acm (push) Has been cancelled
Deploy infrastructure / cloudfront_cdn (push) Has been cancelled
Deploy infrastructure / hubspot_etl_image (push) Has been cancelled
Deploy infrastructure / hubspot_etl_lambda (push) Has been cancelled
sensible maximum and batch
2026-04-07 12:16:41 +01:00
Jun-te Kim
89ad1c9050
Merge pull request #960 from Hestia-Homes/feature/dont_drop_postcode
Feature/dont drop postcode
2026-04-07 12:11:27 +01:00
Jun-te Kim
34414d14a5 change to sensiable concurrecy and batch size 2026-04-07 11:10:15 +00:00
Jun-te Kim
25e08f3e96 2 lambda b ut 1 batch size 2026-04-07 11:08:19 +00:00
Jun-te Kim
426d907ce7 2 lambda b ut 1 batch size 2026-04-07 10:54:17 +00:00
Jun-te Kim
acbd0cfc35 maximum concurrency to 2 2026-04-07 10:53:57 +00:00
Jun-te Kim
8b3f5d8808
Merge pull request #959 from Hestia-Homes/main
Some checks are pending
Fast Api Backend Deploy / deploy (push) Waiting to run
Deploy infrastructure / address2uprn_lambda (push) Blocked by required conditions
Deploy infrastructure / determine_stage (push) Waiting to run
Deploy infrastructure / shared_terraform (push) Blocked by required conditions
Deploy infrastructure / ara_engine_image (push) Blocked by required conditions
Deploy infrastructure / ara_engine_lambda (push) Blocked by required conditions
Deploy infrastructure / address2uprn_image (push) Blocked by required conditions
Deploy infrastructure / postcodeSplitter_image (push) Blocked by required conditions
Deploy infrastructure / postcodeSplitter_lambda (push) Blocked by required conditions
Deploy infrastructure / condition_etl_image (push) Blocked by required conditions
Deploy infrastructure / condition_etl_lambda (push) Blocked by required conditions
Deploy infrastructure / categorisation_image (push) Blocked by required conditions
Deploy infrastructure / categorisation_lambda (push) Blocked by required conditions
Deploy infrastructure / ordnanceSurvey_image (push) Blocked by required conditions
Deploy infrastructure / ordnanceSurvey_lambda (push) Blocked by required conditions
Deploy infrastructure / pashub_to_ara_image (push) Blocked by required conditions
Deploy infrastructure / pashub_to_ara_lambda (push) Blocked by required conditions
Deploy infrastructure / fast_api_lambda (push) Blocked by required conditions
Deploy infrastructure / cloudfront_acm (push) Blocked by required conditions
Deploy infrastructure / cloudfront_cdn (push) Blocked by required conditions
Deploy infrastructure / hubspot_etl_image (push) Blocked by required conditions
Deploy infrastructure / hubspot_etl_lambda (push) Blocked by required conditions
maxiumum concurrency
2026-04-07 11:41:57 +01:00
Jun-te Kim
760acb6982
Merge pull request #958 from Hestia-Homes/feature/dont_drop_postcode
fix maximum concurrency
2026-04-07 11:36:59 +01:00
Jun-te Kim
469401aabd maximum concurrency 2026-04-07 09:59:41 +00:00
Jun-te Kim
2c39f64731 maximum concurrency 2026-04-07 09:58:22 +00:00
Jun-te Kim
8d6be23084 maximum concurrency 2026-04-07 09:56:38 +00:00
Jun-te Kim
959867f5ee maximum concurrent 2026-04-07 09:51:26 +00:00
Jun-te Kim
23d7b22b54 save for easter weekend 2026-04-02 17:30:38 +00:00
Daniel Roth
cd7b59a62f update spreadsheet with properties that have already been processed 2026-04-02 15:42:56 +00:00
Daniel Roth
eda990285b Merge branch 'main' into feature/ecmk-to-ara 2026-04-02 14:49:21 +00:00
Daniel Roth
e0194798e5
Merge pull request #957 from Hestia-Homes/main
Some checks failed
Fast Api Backend Deploy / deploy (push) Has been cancelled
Deploy infrastructure / determine_stage (push) Has been cancelled
Deploy infrastructure / address2uprn_lambda (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_image (push) Has been cancelled
Deploy infrastructure / postcodeSplitter_lambda (push) Has been cancelled
Deploy infrastructure / condition_etl_image (push) Has been cancelled
Deploy infrastructure / ara_engine_lambda (push) Has been cancelled
Deploy infrastructure / condition_etl_lambda (push) Has been cancelled
Deploy infrastructure / address2uprn_image (push) Has been cancelled
Deploy infrastructure / shared_terraform (push) Has been cancelled
Deploy infrastructure / ara_engine_image (push) Has been cancelled
Deploy infrastructure / categorisation_image (push) Has been cancelled
Deploy infrastructure / categorisation_lambda (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_image (push) Has been cancelled
Deploy infrastructure / ordnanceSurvey_lambda (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_image (push) Has been cancelled
Deploy infrastructure / pashub_to_ara_lambda (push) Has been cancelled
Deploy infrastructure / fast_api_lambda (push) Has been cancelled
Deploy infrastructure / cloudfront_acm (push) Has been cancelled
Deploy infrastructure / cloudfront_cdn (push) Has been cancelled
Deploy infrastructure / hubspot_etl_image (push) Has been cancelled
Deploy infrastructure / hubspot_etl_lambda (push) Has been cancelled
erroneous postcode don't just get dropped but logged
2026-04-02 15:33:28 +01:00
Jun-te Kim
25757d9ac8
Merge pull request #956 from Hestia-Homes/feature/dont_drop_postcode
add change and put it to production
2026-04-02 15:31:51 +01:00
Jun-te Kim
53ef72faab add change and put it to production 2026-04-02 13:05:16 +00:00
Jun-te Kim
00a9bfc14f
Merge pull request #955 from Hestia-Homes/main
ECMK to sharepoint: local runner
2026-04-02 12:39:08 +01:00
Daniel Roth
8d5115b6e8
Merge pull request #953 from Hestia-Homes/feature/ecmk-to-ara
ECMK to Sharepoint: local runner
2026-04-02 12:36:36 +01:00
Daniel Roth
71ca93984a
Merge pull request #954 from Hestia-Homes/main
listin
2026-04-02 12:29:49 +01:00
Jun-te Kim
cdc26e302b
Merge pull request #952 from Hestia-Homes/feature/hubspot_etl
Forgot to make this change incase listing doesn't exists
2026-04-02 12:26:50 +01:00
Jun-te Kim
728913504b insert was updated but not update 2026-04-02 11:19:28 +00:00
Daniel Roth
f4c7fa7aac Merge branch 'main' into feature/ecmk-to-ara 2026-04-02 11:16:39 +00:00
Daniel Roth
998a732428 refactor 2026-04-02 11:16:08 +00:00
Daniel Roth
0009a50dc5 check for end of table by inspecting content instead of whether Next button is disabled 2026-04-02 10:48:54 +00:00
Daniel Roth
0e9c5e5011
Merge pull request #951 from Hestia-Homes/main
429 fixes as well as more data for Khalim
2026-04-02 11:43:34 +01:00
Jun-te Kim
6674edb7d9
Merge pull request #950 from Hestia-Homes/feature/hubspot_etl
jadded dampandmouldandrepaircomments, more resilence on retries with h…
2026-04-02 11:42:03 +01:00
Jun-te Kim
e73e8ea18e memory 2026-04-02 10:24:31 +00:00
Jun-te Kim
7f3a99ba6e use ANy instead 2026-04-02 10:24:11 +00:00
Jun-te Kim
4c696c3d4c remove time 2026-04-02 10:21:22 +00:00
Jun-te Kim
e1ea6f79f9 added dampandmouldandrepaircomments, more resilence on retries with hubspot api 2026-04-02 10:19:40 +00:00