Banner Image

Skills

  • Apache Spark
  • AWS
  • Data Analysis
  • Data Processing
  • Data Science
  • Data Warehouse
  • Database
  • Docker
  • Elasticsearch
  • Etl
  • Machine Learning
  • Natural Language Processing
  • NoSQL
  • Python
  • Recommender Systems

Sign up or Log in to see more.

Services

  • Data Engineer / Data Scientist

    $20/hr Starting at $25 Ongoing

    Dedicated Resource

    * Expertise: Recommender System, Data Pipeline, Data Lake, Data Warehouse, Machine Learning, Natural Language Processing * Tools and Cloud Services: Apache Spark, Apache Hadoop, Apache Hive, Presto, Elasticsearch,...

    Apache SparkAWSData AnalysisData ProcessingData Science

About

* Had experience in data science, data engineering and AWS architecture. * Passionate about seeing the whole picture of building a data-driven product and making impacts on users.

I am a Data Engineer with 3.5 years of experience in the biggest website of job search and posts in Taiwan. I was responsible for designing and building Data Pipelines, Data Lakes and Data Warehouse on AWS, and I developed and productionized the Recommender Systems application as well.

In Machine Learning, I have experience in developing Recommender Systems with several approaches such as Collaborative Filtering, graph embedding and classification models. Also, I have experience in Natural Language Processing and building chatbots. In my previous job, I have improved CTR/CVR of the Recommender System from 10% to nearly 100% in different projects.

In Data Engineering, I have experience in designing and building end-to-end streaming/batch ETL Data Pipelines on AWS to process data from Relational Database and NoSQL. Furthermore, I participated in the private-cloud-to-AWS migration project and designed the data architecture on AWS from scratch. In my previous job, I have reduced nearly 70% cost in the Data Warehouse project.