Banner Image

Skills

  • Python
  • Web Scraping
  • Amazon AWS
  • Amazon EC2
  • Apache Hadoop
  • API Development
  • App & Mobile Programming
  • Back End Development
  • Django
  • FCM
  • JSON
  • Microsoft SQL Server
  • MySQL
  • PostgreSQL
  • PySpark

Sign up or Log in to see more.

Services

  • Web Scraping

    $15/hr Starting at $25 Ongoing

    Dedicated Resource

    We have the experience to scrap or crawl the data over web on categories like: 1 Real estate 2 Retail 3E-commerce 4Hospitality 5Price comparison data 6yellow pages.com 7just dial 8Aviation. Real...

    MySQLPythonScrapy FrameworkSQLWeb Scraping

  • Backend Development

    $25/hr Starting at $100 Ongoing

    Dedicated Resource

    I have 6+ years of experience in writing and developing server side logic along with 3+ years of experience in Developing ETL pipelines using Scala, Spark, PySpark and hadoop. Experience of writing scalable...

    Amazon AWSAmazon EC2Apache HadoopAPI DevelopmentApp & Mobile Programming

About

Backend Developer with ETL and scraping experince

I am a Technical Lead for the Backend Development. and I have a 6+ years of experience in writing and developing server side logic along with 3+ years of experience in Developing ETL pipelines using Scala, Spark, PySpark and hadoop. Experience of writing scalable and robust API's in Python/Django along with ETL loads.

I have en experience to develop and lead teams for different domain products like Media, Food, Healthcare, Sports, Finance.

I have worked on following libraries or tools for my different projects so far.

1 AWS server setup with S3 bucket and email setup and Digital Ocean server setup.
2 NGINX
3 DJANGO CHANNELS FOR SOCKET PROGRAMMING
4 ELASTIC SEARCH
6 CELERY
5 DJANGO-REDIS-CACHE
6 OAUTH2
7 FCM PUSH NOTIFICATIONS
8 SOCIAL MEDIA API'S and 3rd Party API integrations
9 HAVE IMPLEMENTED MANY PAYMENT GATEWAYS LIKE TPAGA, PAYPAL, CC AVENUE
10 POSTGRESQL
11 Versioning Control -GIT,BITBUCKET
12 Media Streaming Services (RTMP and FFMPEG)
13 Spark
14 Hadoop
15 Hive

Work Terms

I can work with any Timing standards
$25/hr

Attachments (Click to Preview)