This post will teach us how to set up Apache Airflow using Docker. Install Docker Desktop on your system. Create a project folder: airflow_docker Create a file docker-compose.yaml and paste the contents of the file from here. Once the docker-compose.yaml is created we need to edit the file to run…

Suppose we have Scala project with multiple Scala sub projects or multiple Scala modules. These modules need to create seperate jars and the modules can depend on each other. We need to write the build.sbt …

In this post we are going to discuss on how to deploy our presto UDF to presto server in a docker container. We need to have our UDF project writen and packaged to a JAR file. More information on creating our Presto UDF can be found here. We will start…

This post explains how to write a simple User Defined Function for Presto plugin. Most of the time we can solve our problems by using Presto native functions but sometimes we might require to write our own user defined functions for specific functionality. Presto provides detailed documentation on how to…