Job Information
- Job Title: Python Developer with Kafka
- Location: New York City, NY (Hybrid 3 days onsite)
- Job Type: Full Time
Skills Required
Well-versed in writing Python & Shell scripts to automate infrastructure provisioning on KafkaDevelop Python scripts to facilitate data ingestion, transformation, and processing within the Confluent Kafka ecosystem.Write and optimize Python code for data ingestion from various sources into Kafka topics.Develop Python-based Kafka consumers and producers to enable efficient data processing.Create and manage Kafka topics, producers, consumers, and schemas as needed using Python/Shell scripting.Monitor and fine-tune Kafka cluster configurations to optimize performance and resource utilization.Implementation understanding on access controls and authorization (like SASL, JaaS config, Kerberos, OAuth) mechanisms to protect Kafka InfraUnderstanding of Confluent Kafka Architecture & components Brokers, Schema Registry, Zookeeper, Producer, Consumers, Shared Clusters, Cluster linking, Mirror-Making etc.
Skills and Certifications
- Python Developer
- Shell scripting
- Kafka