This component contains additional data preparation tools such as tools for building and automating a workflow of tasks or tools for converting data from one format into another.
Airflow is a platform to programmatically author, schedule and monitor workflows.
https://github.com/spotify/luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs.