Hey! I'm looking for someone who can help me set up a couple of data transformation jobs on AWS. It's not super complicated, but I’d prefer someone with experience in AWS CDK, Python, and Glue ETL. Here’s what I need:
Basic Setup:I already have some Parquet files that I want to load into S3 tables. I want to use Glue ETL jobs to do this, and I'd like the whole thing set up using AWS CDK (in Python).
Transformation Job:I have a 10-20GB raw Parquet file that needs some transformation applied to it. The logic is based on another Parquet file. Once processed, the result should be saved into an S3 table. Again, this should be done using a Glue ETL job and managed using Python + CDK.
What I need from you:
Help setting up these ETL jobs using Python + CDK
Provide IaC code (CDK scripts)
Give me a rough idea of how much time this would take and your pricing
I can provide AWS credentials for a dev account to work with
Would love to get a few quotes and timelines. Not looking for anything super polished, just something that works and is cleanly coded. Feel free to ask any questions!