This post will describe how can we ingest the geospatial data into Apache Solr for search and query. The pipeline is built with Apache Spark and Apache Spark Solr connector. The purpose of this project is to ingest and index
Analytics Archive
Apache Spark Analytical Window Functions
It’s been a while since I wrote a posts here is one interesting one which will help you to do some cool stuff with Spark and Windowing functions.I would also like to thank and appreciate Suresh my colleague for helping me
Apache Spark User Defined Functions
I have been working with Apache Spark for a while now and would like to share some UDF tips and tricks I have learned over the past year. Below is the sample data (i.e. people.json) used to demonstrate example of UDF
Query Nested JSON via Spark SQL
It’s been a while since I wrote a blog so here you go. I have been researching with Apache Spark currently and had to query complex nested JSON data set, encountered some challenges and ended up learning currently the best
Apache Storm and Kafka Cluster with Docker
This post is all about real time analytic on large data sets. I am sure every one has heard about Apache Kafka (Distributed publish subscribe messaging broker) and Apache Storm (Distributed real time computation system.) and if you were disappointed