I'm a qualified data engineer working in the field of Data for the last 3 years, in the finance sector.
I'm also a certified AWS Solution Architect.
I can help you with your data engineering tasks.
- Infrastructure setup : Infrastructure as a Code (Terraform ,CloudFormation)
- Cloud Computing, mainly AWS (Open for other cloud providers)
- Big data transformation jobs (Spark, Hadoop, AWS Glue)
- Setup and design of ETLs pipelines
- API development to expose data endpoints
- Data streaming platform setup based on Kinesis or Kafka
- Data Schemas registry setup
- Data catalog setups
- Capture Data Change connectors ( Debezium or AWS DMS )
- Data cleaning Automatisation