Experienced Data Engineer
👋 Hi, I’m Gideon 🌟
As a passionate Data Engineer with 3 years of hands-on experience, I thrive at the intersection of data and technology. Here’s a glimpse into my journey:
Background: I hold a Masters' degree in Data Engineering, where I honed my analytical skills and developed a love for data-driven solutions.
Technical Toolbox:
AWS: I’ve navigated the vast Amazon Web Services (AWS) ecosystem, leveraging services like:
Amazon EMR: For processing large datasets using Hadoop and Spark.
Amazon Kinesis: Enabling real-time data streaming and analytics.
Amazon Redshift: My go-to for fully managed data warehousing.
Amazon Glue: Seamlessly transforming and moving data across sources.
GCP (Google Cloud Platform): I’ve explored GCP’s powerful tools tailored for data engineering:
Cloud Dataproc: Managing Hadoop and Spark clusters efficiently.
Cloud Dataflow: My choice for real-time data streaming and analytics.
BigQuery: A fully managed data warehouse that scales effortlessly.
Cloud Composer: My trusted ETL service for seamless data transformations.
Web Scraping:
I’ve scraped data from diverse sources—news articles, e-commerce websites, and social media platforms. Whether it’s Python scripts or cloud-based functions, I love turning raw web data into actionable insights.
Data Modeling:
Crafting robust data models is my forte. From conceptual design to normalisation, I’ve built databases that withstand the test of time.