PinnedPublished inMeghGenOptimising Real-Time Fraud Detection with Debezium, Redis, Apache Spark and Apache KafkaJul 17Jul 17
Apache Iceberg with Apache SparkRecently I was assigned a task to write Iceberg utilities using Apache Spark with Scala. So the code should automatically write data to…Jun 23, 2023Jun 23, 2023
Apache Iceberg Setup With AWS EMR and Basic CRUD operations in Iceberg using spark SQLThis post will discuss how to set up Apache Iceberg on the EMR cluster, use AWS glue as the iceberg catalog, run basic CRUD operations in…Jan 3, 2023Jan 3, 2023
Building multiple Scala modules from SBTSuppose we have Scala project with multiple Scala sub projects or multiple Scala modules. These modules need to create seperate jars and…Sep 9, 2022Sep 9, 2022
Deploying your Presto DB UDFs to Presto DB Server in DockerIn this post we are going to discuss on how to deploy our presto UDF to presto server in a docker container. We need to have our UDF…Sep 9, 2022Sep 9, 2022
Building Presto plugin for adding User Defined Functions.This post explains how to write a simple User Defined Function for Presto pluginSep 8, 2022Sep 8, 2022
