A Real-time Stream Processing App Example Exploring Twitter Sentiment and Weather Condition Correlation
Authors : Babak Badkoubeh, Brian White, Sebastian Alcaino, Vignesh Perumal
In this article, we will go through the process of building a distributed, scalable, fault-tolerant, microservice-oriented data pipeline using Kafka, Docker, and Cassandra. We utilize this architecture to explore correlation between Twitter sentiment analysis and the weather condition.
At a high level, the figure below depicts the application we will be implementing, which involves Kafka at its core and various microservices attached.
Feel free to skip to the second half of this article to find the step…