Commit graph

4683 commits

Author SHA1 Message Date
Jun-te Kim
00a9bfc14f
Merge pull request #955 from Hestia-Homes/main
ECMK to sharepoint: local runner
2026-04-02 12:39:08 +01:00
Daniel Roth
8d5115b6e8
Merge pull request #953 from Hestia-Homes/feature/ecmk-to-ara
ECMK to Sharepoint: local runner
2026-04-02 12:36:36 +01:00
Daniel Roth
71ca93984a
Merge pull request #954 from Hestia-Homes/main
listin
2026-04-02 12:29:49 +01:00
Jun-te Kim
cdc26e302b
Merge pull request #952 from Hestia-Homes/feature/hubspot_etl
Forgot to make this change incase listing doesn't exists
2026-04-02 12:26:50 +01:00
Jun-te Kim
728913504b insert was updated but not update 2026-04-02 11:19:28 +00:00
Daniel Roth
f4c7fa7aac Merge branch 'main' into feature/ecmk-to-ara 2026-04-02 11:16:39 +00:00
Daniel Roth
998a732428 refactor 2026-04-02 11:16:08 +00:00
Daniel Roth
0009a50dc5 check for end of table by inspecting content instead of whether Next button is disabled 2026-04-02 10:48:54 +00:00
Daniel Roth
0e9c5e5011
Merge pull request #951 from Hestia-Homes/main
429 fixes as well as more data for Khalim
2026-04-02 11:43:34 +01:00
Jun-te Kim
6674edb7d9
Merge pull request #950 from Hestia-Homes/feature/hubspot_etl
jadded dampandmouldandrepaircomments, more resilence on retries with h…
2026-04-02 11:42:03 +01:00
Jun-te Kim
e73e8ea18e memory 2026-04-02 10:24:31 +00:00
Jun-te Kim
7f3a99ba6e use ANy instead 2026-04-02 10:24:11 +00:00
Jun-te Kim
4c696c3d4c remove time 2026-04-02 10:21:22 +00:00
Jun-te Kim
e1ea6f79f9 added dampandmouldandrepaircomments, more resilence on retries with hubspot api 2026-04-02 10:19:40 +00:00
Jun-te Kim
acb44dc60a added dampandmouldandrepaircomments, more resilence on retries with hubspot api 2026-04-02 10:12:09 +00:00
Daniel Roth
a886911de4 add debugging 2026-04-02 08:29:09 +00:00
Daniel Roth
f3ebe122f8 Merge branch 'main' into feature/ecmk-to-ara 2026-04-01 16:26:36 +00:00
Daniel Roth
231473ecba load files to s3 and update db 2026-04-01 16:24:00 +00:00
Daniel Roth
32e37990d2 correctly save to sharepoint 2026-04-01 16:03:52 +00:00
Daniel Roth
aade2f765d
Merge pull request #949 from Hestia-Homes/main
Some checks are pending
Fast Api Backend Deploy / deploy (push) Waiting to run
Deploy infrastructure / determine_stage (push) Waiting to run
Deploy infrastructure / shared_terraform (push) Blocked by required conditions
Deploy infrastructure / ara_engine_image (push) Blocked by required conditions
Deploy infrastructure / ara_engine_lambda (push) Blocked by required conditions
Deploy infrastructure / address2uprn_image (push) Blocked by required conditions
Deploy infrastructure / address2uprn_lambda (push) Blocked by required conditions
Deploy infrastructure / postcodeSplitter_image (push) Blocked by required conditions
Deploy infrastructure / postcodeSplitter_lambda (push) Blocked by required conditions
Deploy infrastructure / condition_etl_image (push) Blocked by required conditions
Deploy infrastructure / condition_etl_lambda (push) Blocked by required conditions
Deploy infrastructure / categorisation_image (push) Blocked by required conditions
Deploy infrastructure / categorisation_lambda (push) Blocked by required conditions
Deploy infrastructure / ordnanceSurvey_image (push) Blocked by required conditions
Deploy infrastructure / ordnanceSurvey_lambda (push) Blocked by required conditions
Deploy infrastructure / pashub_to_ara_image (push) Blocked by required conditions
Deploy infrastructure / pashub_to_ara_lambda (push) Blocked by required conditions
Deploy infrastructure / fast_api_lambda (push) Blocked by required conditions
Deploy infrastructure / cloudfront_acm (push) Blocked by required conditions
Deploy infrastructure / cloudfront_cdn (push) Blocked by required conditions
Deploy infrastructure / hubspot_etl_image (push) Blocked by required conditions
Deploy infrastructure / hubspot_etl_lambda (push) Blocked by required conditions
add subtask and task handling for errors
2026-04-01 16:33:24 +01:00
Jun-te Kim
04ebc1a8e5
Merge pull request #948 from Hestia-Homes/feature/hubspot_etl
added task handelr
2026-04-01 16:32:12 +01:00
Jun-te Kim
955dffd74d added task handelr 2026-04-01 14:59:28 +00:00
Daniel Roth
37a12ffb28 refactor with helper functions 2026-04-01 14:13:46 +00:00
Daniel Roth
33c4572f48 download files 2026-04-01 13:54:22 +00:00
Daniel Roth
5510e7b74f
Merge pull request #947 from Hestia-Homes/main
Pull in more metadata from hubspot
2026-04-01 13:51:16 +01:00
Jun-te Kim
91ae897946
Merge pull request #946 from Hestia-Homes/feature/hubspot_etl
add design type and surveyed date per request
2026-04-01 13:50:06 +01:00
Jun-te Kim
cee4e40bb1 latest code 2026-04-01 12:10:28 +00:00
Daniel Roth
b121413b22 read address list from file and find matching rows in ecmk datatable 2026-04-01 11:37:50 +00:00
Daniel Roth
f7330664dd
Merge pull request #945 from Hestia-Homes/main
tf plan and apply with vars
2026-04-01 11:40:59 +01:00
Jun-te Kim
4d467515e0
Merge pull request #944 from Hestia-Homes/feature/hubspot_etl
include hubspot api key
2026-04-01 11:39:02 +01:00
Jun-te Kim
9b88eb3a94 added to plan and destory 2026-04-01 10:37:26 +00:00
Jun-te Kim
8a9f51f9e6 include hubspot api key 2026-04-01 10:33:06 +00:00
Daniel Roth
577dc72c4b
Merge pull request #943 from Hestia-Homes/main
should work now
2026-04-01 11:23:15 +01:00
Jun-te Kim
22d8264963
Merge pull request #942 from Hestia-Homes/feature/hubspot_etl
forgot json
2026-04-01 11:21:28 +01:00
Jun-te Kim
60f3d25c29 forgot to call it eventr 2026-04-01 10:18:37 +00:00
Jun-te Kim
0f892a69d9 forgot json 2026-04-01 10:15:20 +00:00
Daniel Roth
7c2adc60e0
Merge pull request #941 from Hestia-Homes/main
records
2026-04-01 11:03:26 +01:00
Jun-te Kim
39c6453a47
Merge pull request #940 from Hestia-Homes/feature/hubspot_etl
forgot to add records for handler
2026-04-01 11:02:11 +01:00
Jun-te Kim
093b93ec1c forgot to add records for handler 2026-04-01 09:58:23 +00:00
Daniel Roth
aa5cff4d19 Merge branch 'main' into feature/ecmk-to-ara 2026-04-01 09:55:57 +00:00
Jun-te Kim
5f747a0dd3
Merge pull request #939 from Hestia-Homes/main
Pasub to ara lambda
2026-04-01 10:46:33 +01:00
Daniel Roth
e597978734
Merge pull request #933 from Hestia-Homes/feature/pashub-to-ara
Pashub to Ara: process messages rather than files
2026-04-01 10:43:15 +01:00
Daniel Roth
b4367af458
Merge pull request #938 from Hestia-Homes/main
db credentials
2026-04-01 10:42:25 +01:00
Jun-te Kim
b1051cd7d5
Merge pull request #937 from Hestia-Homes/feature/hubspot_etl
added db credentials
2026-04-01 09:57:54 +01:00
Jun-te Kim
50d3c74dee added db credentials 2026-04-01 08:50:55 +00:00
Daniel Roth
3279975d02 move script to ecmk_fetcher folder 2026-04-01 08:18:06 +00:00
Jun-te Kim
1982d70c49
Merge pull request #936 from Hestia-Homes/main
Hubspot to rule them all
2026-04-01 09:08:51 +01:00
Jun-te Kim
ce8811240f
Merge pull request #935 from Hestia-Homes/feature/hubspot_etl
Feature/hubspot etl
2026-04-01 09:07:11 +01:00
Daniel Roth
1fee40bfef POC: download file from ecmk using playwright 2026-04-01 08:03:29 +00:00
Jun-te Kim
fcf25f7cac get rid of photos from local drive when i run it locally so its less verbose 2026-03-31 18:46:37 +00:00