Senior Big Data Software Engineer (Java/Kafka/Cloud)

About the position

We are looking for a Senior Big Data Software Engineer with strong Java skills and experience with cloud technologies. You will play a key role in developing and evolving our data lake platform and event streaming solutions.

Responsibilities

• Design, develop, and implement technical solutions in cloud environments using Java, Spark, Hive, Avro, Parquet, Kubernetes, Spring Boot, Elastic Search, Logstash, Kibana, Oozie, and PostgreSQL.
• Lead the design, implementation, and performance optimization of Kafka-based event streaming architectures, ensuring scalability, reliability, and high availability.
• Monitor, troubleshoot, and tune Kafka clusters to maintain optimal system performance.
• Collaborate with Product Owners to break down customer requirements into actionable user stories.
• Deliver clean, tested, and maintainable code that meets acceptance criteria and Definition of Done.
• Manage deployment, CI/CD pipeline monitoring, and production stability activities.
• Engage in pair programming and write unit and BDD-style tests with JUnit, Mockito, and Cucumber.
• Participate actively in backlog refinement, sprint planning, and agile ceremonies.

Requirements

• Strong Java 8+ skills with Spring Boot
• Proven experience leading Kafka design, deployment, and performance tuning
• Strong Kafka internals and troubleshooting skills
• Big Data tools: Spark, Hive, Avro, Parquet
• Kubernetes and container orchestration
• Elastic Search, Kibana, Logstash
• Cloud platforms (Azure, AWS, or similar)
• Agile methodologies and automated testing (TDD, BDD)
• BS/master's degree in Computer Science, Information Technology or relevant technical field.
• 5-10 years of experience working as Senior Programmer Analyst role
• Possess the first-hand experience working in a real Change and Release management environment
• Experience with business analysis methodologies, processes, and documentation standards

Benefits

• The yearly salary range for this role is USD 75,000-115,000
• 401(k) retirement plan with company matching
• 15 days of paid vacation per year at hire and up to 27 according to seniority (annual untaken vacation days are cashed out)
• 8 paid holidays + 5 sick days + 2 personal days per year
• Company health, dental, and vision insurance plans + FSA
• Voluntary STD and LTD
• Commuter/transit benefits