This is code for a workshop hosted at the DraftKings Engineering Blog co-created by Martin Ivanov, Dimitar Nanov, Vadym Kutsenko and David Musicant.
This code, and the exercises, will help you learn:
- When to use Kafka vs a message queue such as RabbitMQ
- The key components of Kafka and how to properly tune them
- Creating highly efficient Consumers to handle the data streams
- Creating well configured Producers that are optimized for high throughput
- How to use advanced configurations for cleanup policies, compression and more to fine tune your stream handling