Artwork

Contenu fourni par Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka®. Tout le contenu du podcast, y compris les épisodes, les graphiques et les descriptions de podcast, est téléchargé et fourni directement par Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka® ou son partenaire de plateforme de podcast. Si vous pensez que quelqu'un utilise votre œuvre protégée sans votre autorisation, vous pouvez suivre le processus décrit ici https://fr.player.fm/legal.
Player FM - Application Podcast
Mettez-vous hors ligne avec l'application Player FM !

How to use Python with Apache Kafka

31:57
 
Partager
 

Manage episode 357894583 series 2355972
Contenu fourni par Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka®. Tout le contenu du podcast, y compris les épisodes, les graphiques et les descriptions de podcast, est téléchargé et fourni directement par Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka® ou son partenaire de plateforme de podcast. Si vous pensez que quelqu'un utilise votre œuvre protégée sans votre autorisation, vous pouvez suivre le processus décrit ici https://fr.player.fm/legal.

Can you use Apache Kafka® and Python together? What’s the current state of Python support? And what are the best options to get started? In this episode, Dave Klein joins Kris to talk about all things Kafka and Python: the libraries, the tools, and the pros & cons. He also talks about the new course he just launched to support Python programmers entering the event-streaming world.
Dave has been an active member of the Kafka community for many years and noticed that there were a lot of Kafka resources for Java but few for Python. So he decided to create a course to help people get started using Python and Kafka together.
Historically, Java has had the most documentation, and people have often missed how good the Python support is for Kafka users. Python and Kafka are an ideal fit for machine learning applications and data engineering in general. Yet there are a lot of use cases for building, streaming, and machine learning pipelines. In fact, someone conducted a survey to find out what languages were most popular in the Kafka community and Python came in second after Java. That’s how Dave got the idea to create a course for newbies.
In this course, Dave combines video lectures with code-heavy exercises to give developers a taste of what the code looks like, how to structure it, a preview of the shape of the code, and the structure of the classes and the functions so you can get hands-on practice using the library. He also covers building a producer and a consumer and using the admin client. And, of course, there is a module that covers working with the schemas supported by the Kafka library.
Dave explains that Python opens up a world of opportunity and is ripe for expansion. So if you are ready to dive in, head over to developer.confluent.io to learn more about Dave’s course.
EPISODE LINKS

  continue reading

Chapitres

1. Intro (00:00:00)

2. What are the Python clients for Apache Kafka? (00:01:09)

3. What are the use cases for using Python with Kafka? (00:03:11)

4. What inspired the course on Python for Kafka? (00:04:59)

5. Librd Kafka wrapper vs. native client (00:07:05)

6. Tips for getting starting in Python with Kafka (00:10:37)

7. What should you know about types, type checking, schemas, and validation of type schemas? (00:13:06)

8. When would you use the AdminClient in Python? (00:17:19)

9. Are there options similar to Kafka Streams for Python? (00:20:35)

10. What was it like creating the course? (00:23:49)

11. What is the structure of the course? (00:26:48)

12. It's a wrap! (00:30:19)

265 episodes

Artwork
iconPartager
 
Manage episode 357894583 series 2355972
Contenu fourni par Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka®. Tout le contenu du podcast, y compris les épisodes, les graphiques et les descriptions de podcast, est téléchargé et fourni directement par Confluent, founded by the original creators of Apache Kafka® and Founded by the original creators of Apache Kafka® ou son partenaire de plateforme de podcast. Si vous pensez que quelqu'un utilise votre œuvre protégée sans votre autorisation, vous pouvez suivre le processus décrit ici https://fr.player.fm/legal.

Can you use Apache Kafka® and Python together? What’s the current state of Python support? And what are the best options to get started? In this episode, Dave Klein joins Kris to talk about all things Kafka and Python: the libraries, the tools, and the pros & cons. He also talks about the new course he just launched to support Python programmers entering the event-streaming world.
Dave has been an active member of the Kafka community for many years and noticed that there were a lot of Kafka resources for Java but few for Python. So he decided to create a course to help people get started using Python and Kafka together.
Historically, Java has had the most documentation, and people have often missed how good the Python support is for Kafka users. Python and Kafka are an ideal fit for machine learning applications and data engineering in general. Yet there are a lot of use cases for building, streaming, and machine learning pipelines. In fact, someone conducted a survey to find out what languages were most popular in the Kafka community and Python came in second after Java. That’s how Dave got the idea to create a course for newbies.
In this course, Dave combines video lectures with code-heavy exercises to give developers a taste of what the code looks like, how to structure it, a preview of the shape of the code, and the structure of the classes and the functions so you can get hands-on practice using the library. He also covers building a producer and a consumer and using the admin client. And, of course, there is a module that covers working with the schemas supported by the Kafka library.
Dave explains that Python opens up a world of opportunity and is ripe for expansion. So if you are ready to dive in, head over to developer.confluent.io to learn more about Dave’s course.
EPISODE LINKS

  continue reading

Chapitres

1. Intro (00:00:00)

2. What are the Python clients for Apache Kafka? (00:01:09)

3. What are the use cases for using Python with Kafka? (00:03:11)

4. What inspired the course on Python for Kafka? (00:04:59)

5. Librd Kafka wrapper vs. native client (00:07:05)

6. Tips for getting starting in Python with Kafka (00:10:37)

7. What should you know about types, type checking, schemas, and validation of type schemas? (00:13:06)

8. When would you use the AdminClient in Python? (00:17:19)

9. Are there options similar to Kafka Streams for Python? (00:20:35)

10. What was it like creating the course? (00:23:49)

11. What is the structure of the course? (00:26:48)

12. It's a wrap! (00:30:19)

265 episodes

Semua episode

×
 
Loading …

Bienvenue sur Lecteur FM!

Lecteur FM recherche sur Internet des podcasts de haute qualité que vous pourrez apprécier dès maintenant. C'est la meilleure application de podcast et fonctionne sur Android, iPhone et le Web. Inscrivez-vous pour synchroniser les abonnements sur tous les appareils.

 

Guide de référence rapide