-
Continue reading →: Union vs UnionAll in spark
Unlike traditional structured query databases, the difference between union and unionAll in Spark is unusual and not very intuitive. Below is the exercise, Two dataframes created with some of duplicate values. Ideally, in any traditional database union removes the duplicates from both the dataset (ie table) and returns only unique…
-
Continue reading →: Stock Price Streaming using Apache Kafka
In today’s fast-paced and highly volatile financial markets, having access to real-time stock quotes is crucial for making informed and precise decisions. Traditional methods of obtaining stock quotes often involve delays, which can lead to missed opportunities. This project aims to develop a robust and scalable pipeline that ingests live…
-
Continue reading →: What is Machine Language?
Is it something that machines speaks? C, C++, Java are machine languages? The language which machine understands is machine language. So, what machine understands? Obviously, it is 0 and 1. Machine understand only digital values. So, if we need to interact with machine, the only way is to communicate is…
