AWS Kafka Architect

MaarutJersey City, NJ
1d

About The Position

Design and manage Amazon MSK/ Kafka-based streaming data pipelines. Configure and monitor Kafka clusters for performance and scalability. Integrate Kafka with AWS services like EC2, EKS, Lambda, and S3. Implement security protocols, disaster recovery, and high availability. Use Infrastructure as code (IaC) tools such as Terraform for infrastructure automation. Collaborate with cross-functional teams for real-time analytics and data pipelines

Requirements

  • 10+ years of experience with AWS and Kafka/Amazon MSK
  • Bachelor’s degree in computer science or related fields
  • Minimum 10+ years of industry experience
  • Experience with AWS MSK and/or Confluent Cloud
  • Experience with monitoring tools like CloudWatch, Prometheus and Grafana.
  • Familiarity with Kubernetes, CI/CD pipelines, and GitOps workflows.
  • Proficiency in foundational AWS cloud services (ex. Cloud Watch, AWS EC2, IAM, VPC, RDS, S3, etc).
  • Excellent understanding of Kubernetes and containerization concepts
  • Good experience with AWS Cloud and its services
  • Working experience in Linux

Nice To Haves

  • Programming, Scripting, and automation skills highly preferred (JAVA, APIs, Python, Bash, PowerShell)
  • Window System Administration good to have.

Responsibilities

  • Design and manage Amazon MSK/ Kafka-based streaming data pipelines.
  • Configure and monitor Kafka clusters for performance and scalability.
  • Integrate Kafka with AWS services like EC2, EKS, Lambda, and S3.
  • Implement security protocols, disaster recovery, and high availability.
  • Use Infrastructure as code (IaC) tools such as Terraform for infrastructure automation.
  • Collaborate with cross-functional teams for real-time analytics and data pipelines
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service