junte/Model
1
0
Fork 0
mirror of https://github.com/Hestia-Homes/Model.git synced 2026-06-08 11:17:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
4825 commits 31 branches 0 tags 208 MiB
Commit graph

380 commits

Author SHA1 Message Date
Jun-te Kim
7b00a33cd2 infrastructure: typed S3/SQS clients (S3Client, CsvS3Client, SqsClient, Address2UprnQueueClient) 
Slice 3/6 of the postcode_splitter refactor (Hestia-Homes/Model#1101).
Introduces a thin typed infrastructure layer wrapping boto3 for the AWS
side of the splitter. S3Client/SqsClient are bucket-/queue-bound byte
adapters; CsvS3Client subclasses S3Client to round-trip CSV row dicts
via the existing parse_s3_uri helper in utils/s3.py; Address2UprnQueueClient
subclasses SqsClient to publish the typed {task_id, sub_task_id, s3_uri}
fan-out body the downstream consumer expects. moto[s3,sqs] is pulled into
test.requirements.txt and the new tests/infrastructure/ suite exercises
each client against the moto backend (S3 round-trip, CSV round-trip,
SQS send + body inspection, typed publish + body inspection). pyright
--strict is clean on the new modules.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-19 17:12:21 +00:00
Jun-te Kim
54a674b5c8 added postcode splitter rewrite to ddd 2026-05-19 16:35:09 +00:00
Jun-te Kim
bc8ca3ead3 deployment from infrastructure 2026-05-19 12:55:30 +00:00
Daniel Roth
3a7a00051d add new variables to deployment pipeline 2026-05-18 11:09:44 +00:00
Daniel Roth
a477561bbc correct tfstate bucket name 2026-05-12 13:03:04 +00:00
Daniel Roth
ec7acabaf8 reinstate deleted policy so it can be unattached from entities 2026-05-12 11:48:39 +00:00
Daniel Roth
aadf73ed87 combine s3 write policies into one and apply to pashub and magicplan lambdas 2026-05-08 15:44:14 +00:00
Daniel Roth
1243690d10 give handler permission to write to s3 bucket 2026-05-08 15:41:12 +00:00
Daniel Roth
feaa1ea680 Add MagicPlan Lambda Dockerfile, CI/CD jobs, and SQS IAM wiring in hubspot_deal_etl 2026-05-08 13:12:13 +00:00
Daniel Roth
fd77fa51fd magic plan client terraform 2026-05-08 13:07:53 +00:00
Daniel Roth
ed68a10127 magic plan client terraform 2026-05-08 13:07:36 +00:00
Daniel Roth
1ddbb9a79d typo 2026-05-08 11:56:21 +00:00
Daniel Roth
ebf807713c magicplan client ECR 2026-05-08 11:54:17 +00:00
Daniel Roth
f799466325 make versioning optional on all s3 buckets, default false 2026-04-28 10:05:38 +00:00
Daniel Roth
e533943085 add versioning to retrofit-energy-assessments-dev bucket 2026-04-28 09:41:46 +00:00
Daniel Roth
6d888f3189 grant pashub to ara lambda permission to write to s3 2026-04-24 08:36:50 +00:00
Daniel Roth
920dbb7ddb Merge branch 'main' into feature/pashub-to-ara 2026-04-23 09:49:27 +00:00
Daniel Roth
996a8b9459 include sharepoint tenant id in lambda environment 2026-04-23 09:48:37 +00:00
Jun-te Kim
296bbcc626 added logic to add to serverless 2026-04-22 12:39:44 +00:00
Daniel Roth
5966757051 add reserved_concurrent_executions to template lambda terraform 2026-04-21 08:58:51 +00:00
Daniel Roth
bd0edd1fac Merge branch 'main' into feature/pashub-to-ara 2026-04-21 08:36:20 +00:00
Daniel Roth
30ac251705 limit pashub lambda concurrency to 1 2026-04-21 08:35:52 +00:00
Jun-te Kim
37a6a9d9b2
Merge pull request #1016 from Hestia-Homes/feature/address_trigger_from_frontend 
forgot to add stage
 2026-04-20 18:12:41 +01:00
Jun-te Kim
735368c312 forgot to add stage 2026-04-20 17:00:27 +00:00
Jun-te Kim
686d1f2c80
Merge pull request #1010 from Hestia-Homes/feature/address_trigger_from_frontend 
added bulk address uprn route
 2026-04-20 17:39:07 +01:00
Jun-te Kim
7caa7c476a added bulk address uprn route 2026-04-20 13:06:31 +00:00
Daniel Roth
1750b17ee4 Merge branch 'main' into feature/pashub-to-ara 2026-04-20 09:24:57 +00:00
Daniel Roth
8b71fad8cc correct environment variables 2026-04-20 09:24:36 +00:00
Jun-te Kim
ec4c870465 added bulk address 2 uprn lmabda 2026-04-17 19:08:34 +00:00
Daniel Roth
e61a50f0fd sqs policy terraform correction 2026-04-17 15:14:29 +00:00
Daniel Roth
ad0c31fc3e IAM role allowing hubspot etl to send message to pashub queue 2026-04-17 14:19:12 +00:00
Daniel Roth
9378c417e1 fix typo in terraform state key 2026-04-10 13:01:37 +00:00
Daniel Roth
5a4bddadfd Merge branch 'main' into feature/hubspot-trigger-orchestrator 2026-04-10 10:24:16 +00:00
Daniel Roth
06503cd989 correct use of terraform state and fix typo 2026-04-10 10:23:38 +00:00
Daniel Roth
d4d9b03511
Merge pull request #964 from Hestia-Homes/feature/hubspot-trigger-orchestrator 
Trigger PasHub to Ara Lambda from Hubspot to DB ETL
 2026-04-10 11:03:12 +01:00
Daniel Roth
62fe46adc4 get queue name from settings 2026-04-09 15:00:36 +00:00
Daniel Roth
5df2318bb5 start defining infrastructure including ecr 2026-04-08 08:44:45 +00:00
Jun-te Kim
34414d14a5 change to sensiable concurrecy and batch size 2026-04-07 11:10:15 +00:00
Jun-te Kim
25e08f3e96 2 lambda b ut 1 batch size 2026-04-07 11:08:19 +00:00
Jun-te Kim
426d907ce7 2 lambda b ut 1 batch size 2026-04-07 10:54:17 +00:00
Jun-te Kim
acbd0cfc35 maximum concurrency to 2 2026-04-07 10:53:57 +00:00
Jun-te Kim
469401aabd maximum concurrency 2026-04-07 09:59:41 +00:00
Jun-te Kim
2c39f64731 maximum concurrency 2026-04-07 09:58:22 +00:00
Jun-te Kim
8d6be23084 maximum concurrency 2026-04-07 09:56:38 +00:00
Jun-te Kim
959867f5ee maximum concurrent 2026-04-07 09:51:26 +00:00
Jun-te Kim
8a9f51f9e6 include hubspot api key 2026-04-01 10:33:06 +00:00
Jun-te Kim
50d3c74dee added db credentials 2026-04-01 08:50:55 +00:00
Jun-te Kim
1ac5cb253a make the fix for module name 2026-03-31 14:47:52 +00:00
Jun-te Kim
b991ab73f7 add postgres 2026-03-31 11:19:16 +00:00
Jun-te Kim
ba331d44dc db details 2026-03-31 11:06:57 +00:00