Commit graph

1128 commits

Author SHA1 Message Date
Daniel Roth
df6c42933a do the database write 2026-02-10 09:59:23 +00:00
Daniel Roth
da34b99251 tidy up logs further 2026-02-10 09:43:55 +00:00
Daniel Roth
d4b444f49b Fix bad log 2026-02-10 09:43:18 +00:00
Daniel Roth
d0847681c1 tidy up logs 2026-02-10 09:42:29 +00:00
Daniel Roth
06539a787d use streaming mode in openpyxl for peabody parser 2026-02-10 09:30:39 +00:00
Daniel Roth
c0534d9546 more logs 2026-02-10 09:16:52 +00:00
Daniel Roth
b026a7ae9e log db session but dont write to db 2026-02-10 09:02:44 +00:00
Daniel Roth
cd0ae37d40 more logging 2026-02-09 17:18:45 +00:00
Daniel Roth
9b6f99929e add logging 2026-02-09 17:00:59 +00:00
Daniel Roth
68b12c7344 trigger rebuild and deploy 2026-02-09 12:49:32 +00:00
Daniel Roth
e1835b2cfa remove duplicates from .env.local 2026-02-09 10:16:18 +00:00
Daniel Roth
0e4da14673 get lookup file bucket and key from payload per message 2026-02-09 09:56:41 +00:00
Daniel Roth
9a9ea9fbaa remove unused bits of config 2026-02-09 09:36:41 +00:00
Daniel Roth
f033b144c2 including environment in vars not environment_vars 2026-02-06 16:04:57 +00:00
Daniel Roth
807d94ca3c test again with limited imports 2026-02-06 13:34:08 +00:00
Daniel Roth
04bc8a1407 include psycopg2 2026-02-06 11:51:31 +00:00
Daniel Roth
3445060ef2 check db user value 2026-02-06 11:46:58 +00:00
Daniel Roth
9ae81c1099 reinstate build args and check whether imports work now 2026-02-06 11:39:53 +00:00
Daniel Roth
f10951f81d try without build args 2026-02-06 11:24:00 +00:00
Daniel Roth
b8283abc45 try getting all db vars from github secrets 2026-02-06 11:16:34 +00:00
Daniel Roth
02a0e83a39 correct variable name 2026-02-05 17:28:16 +00:00
Daniel Roth
b42996a3c8 try dev_DB_HOST 2026-02-05 17:25:17 +00:00
Daniel Roth
7bc5c4e34d echo variables to check values 2026-02-05 16:55:41 +00:00
Daniel Roth
ee2eba11e5 debugging prints 2026-02-05 16:38:16 +00:00
Daniel Roth
c21de78020 pass secrets to build args via env vars 2026-02-05 16:33:12 +00:00
Daniel Roth
688290486a revert back to working version 2026-02-05 16:24:13 +00:00
Daniel Roth
0fa9f8bd43 get db host from secrets 2026-02-05 16:19:58 +00:00
Daniel Roth
10765ae0a4 get db host from secrets 2026-02-05 16:10:21 +00:00
Daniel Roth
f2a1a76735 test environment variable 2026-02-05 15:24:49 +00:00
Daniel Roth
39d4e97de7 typo fix 2026-02-05 13:35:37 +00:00
Daniel Roth
e65028a6c8 correct previous commit 2026-02-05 13:33:15 +00:00
Daniel Roth
730d1cb0d1 one more import satisfied 2026-02-05 13:31:58 +00:00
Daniel Roth
1bfa7be8db switch back to copying across specific files 2026-02-05 13:25:49 +00:00
Daniel Roth
527ccab9fa copy entire backend 2026-02-05 13:06:24 +00:00
Daniel Roth
420b68b7f9 fix panda install 2026-02-05 12:59:03 +00:00
Daniel Roth
39ade49e00 include pandas 2026-02-05 12:20:10 +00:00
Daniel Roth
6a7f99d6fa define dockerfile (with print hello world) 2026-02-05 11:57:52 +00:00
Daniel Roth
0d1939f1c5 condition etl image and push 2026-02-05 09:55:52 +00:00
Daniel Roth
7f32f95f71 Merge branch 'feautre/postcode_splitter_address_uprn_automator_2000' into deploy-condition-processor 2026-02-05 09:22:25 +00:00
Daniel Roth
f50cdee593 Merge branch 'main' into deploy-condition-processor 2026-02-05 08:52:42 +00:00
0a11b8736a add docker files 2026-02-04 15:32:20 +00:00
Daniel Roth
981b6358c4 plug everything into in handler 2026-02-04 15:14:26 +00:00
216af68736 check terraform plan 2026-02-04 15:07:34 +00:00
Daniel Roth
476c9f9c7a fix broken tests 2026-02-04 14:59:16 +00:00
bb89bfbcbd added env 2026-02-04 14:42:17 +00:00
Daniel Roth
62906f6023 get file type from request body 2026-02-04 14:29:43 +00:00
72846b8e7b added req for handler 2026-02-04 14:23:14 +00:00
f3cd4ad590 deploy lambda 2026-02-04 14:22:08 +00:00
Daniel Roth
06e1d53509 define condition trigger request object 2026-02-04 12:57:51 +00:00
Daniel Roth
da57392953 start making changes to deploy handler 2026-02-04 12:16:47 +00:00