Projects for Self Learning

4th Day Task: Try to do any 3

• Setup Required - Kafka Broker Running. Don't need anything else
• Data - https://raw.githubusercontent.com/edyoda/data-science-complete-tutorial/master/Data/titanic-train.csv.txt
• Submission Link - https://forms.gle/p8TxPLuZMoUgPjfp9
• Collection of Best Learning Materials - https://github.com/infoslack/awesome-kafka

1. Producer & Consumer for Custom Class of Data. Read data from your choice of CSV file at producer's end. Hint: Work on Kafka-Producer-Consumer Code

   

2. Do the above activity using microservices.

   

3. Kafka Stream Project. Get the gender count processed in the kafka stream processing.

   

4. Research Activity: Gather matrices for Consumer, Broker & Producer. Write a report about the usage of these.

5. Research Activity: Look for additional tools for monitoring/managing Kafka. Submit their analysis.

5th Day Task: Try to do any 2. 3 is Great

1. Research Activity: Choose a domain of your interest. And, get one detailed case study of deployment. (2-3 hours) The detailed Case Study consist of the following

   • Objective of the Organization/Product
   • Why they needed Kafka
   • How was it deployed
   • What are other connecting technologies
   • Bonus: If you can figure out how your team/close teams are using it.
   • Go for complex topology

2. You have a schema server running. Follow the following steps

   • Producer sending v1 of titanic data & consumerv1 receiving the data using schema server.
   • Now, you will be adding one Kafka stream application which will read the Pclass & add a new col - wealth_status. If Pclass == 1/2, mark passenger Rich else Poor.
   • Because of this the schema no longer remains the same. To support the new schema, we need to have consumerV2.
   • Now, both the consumer should be able to process the same data in their way. This means V1 will receive fields of its interest & so does V2.
   

3. Research Activity: Exploring confluent hub for finding connectors of your interest & try using any free version of those. Path https://www.confluent.io/hub/

4. Research Activity: Explore https://aws.amazon.com/msk/ to understand various case study & deployment