I have been working in Hadoop frameworks basically building ETL logics and doing other viable things on Hadoop framework. For, the last one year we are migrating to cloud infra , so a good amount of experience with Google Clouds and Azure Databricks too. For orchestration of tasks, earlier we used Apache Oozie along with crontabs, but now we are using Automic and Apache Airflow.