Expert Data Engineer | PySpark & AWS Specialist | Transforming Big Data into Actionable Insights

🌟 Data Engineer | AWS & PySpark Expert | ETL & Big Data Specialist
Hello! I'm Abhinav Patil, a highly skilled Data Engineer with over 5 years of experience in designing, developing, and optimizing ETL pipelines and big data solutions. I specialize in AWS cloud services, PySpark, and SQL to deliver scalable, efficient, and reliable data workflows.

💼 Key Expertise:
- Big Data Frameworks: PySpark, Apache Spark (Spark-Core, DataFrames, Spark SQL).
- AWS Services: Glue, S3, Redshift, DMS, Lambda, EMR, and OpenSearch.
- Data Warehousing: Hands-on experience with Databricks, Delta Live Tables, and scalable storage solutions.
- ETL Development: Proficient in migrating and optimizing ETL workflows using PySpark and SQL.

🔧 Notable Achievements:
- Improved ETL performance by 90% by migrating workflows from SQL Procs to Iceberg tables.
- Optimized Power BI dashboards and SQL filtering logic, reducing load times significantly.
- Successfully migrated SQL Server databases to AWS S3 and Redshift using AWS DMS, improving data accessibility and scalability.

🎓 Certifications & Education:
- AWS Certified Cloud Practitioner (Validation: 8e566adf69dc4c04be91bc3a8d598002).
- Bachelor’s Degree in Mechanical Engineering from Jawaharlal Nehru Engineering College, Aurangabad.

🌍 Why Choose Me?
I bring a results-oriented approach with deep technical expertise to help businesses solve their data challenges. Whether it's building efficient ETL pipelines, optimizing big data processing, or implementing cloud-based solutions, I am committed to delivering high-quality outcomes that drive success.

Let’s collaborate and take your project to the next level!

Work Terms

💼 Availability:
I am available 20-30 hours/week to work on your project and can adjust my schedule to accommodate different time zones.

📊 Communication:
I believe in clear and timely communication to ensure project success. Preferred communication channels:
- Guru Messaging Platform
- Zoom/Google Meet (for detailed discussions)

💰 Payment Terms:
I follow Guru's SafePay Escrow system to ensure transparency and trust:
- Hourly Projects: Based on tracked hours with detailed work logs.
- Fixed-Price Projects: Payments are milestone-based and defined upfront.

⚙️ Deliverables:
I am committed to delivering high-quality results that align with project requirements. I provide regular progress updates and encourage feedback to ensure your satisfaction.

🔒 Confidentiality:
I strictly adhere to client confidentiality and am willing to sign Non-Disclosure Agreements (NDAs) if required.

🌍 Time Zone:
Based in India (IST - UTC+5:30), but flexible to work with global clients.