I am having an 10+ years of total experience in DATA ENGINEERING with Big Data using Hadoop and Spark Framework, AWS, Data warehousing, Business Intelligence.Proficient in the end-to-end Data Pipeline from requirement gathering, designing, development, unit testing, and Deployment. Well-versed in agile methodology.
I am currently, working as the Senior Data Engineer. I am currently handling a project to optimise the search suggestion system which is currently using Google API’s. The technology stack we were using here is the Apache Spark with hive as the source and target with AWS EMR. I am also well versed with the ETL tools like Informatica/Talend.