Software Engineer 3

Avid Technology Professionals • Annapolis Junction, MD

21h

About The Position

Seeking a Senior NiFi Engineer who will design, implement, and manage complex, high-throughput data pipelines in support of the Data Transformation Solutions (DTS) TTO. You candidate will be responsible for the ""plumbing"" of our data ecosystem—ensuring that data moves securely and reliably between disparate systems, including cloud infrastructure. The candidate will design and build scalable data flows using Apache NiFi to ingest, route, transform, and deliver data across the enterprise. The candidate will optimize NiFi performance by managing back-pressure, tuning settings, and configuring site-to-site communication for clustered environments. The candidate will deploy highly scalable solutions using Apache Nifi cluster and Apache Zookeeper.

Requirements

• Hands-on experience with Apache NiFi.
• Proficiency in Java and/or Groovy, Bash and/or Python.
• Strong experience with Linux/RHEL administration and containerization (Docker/Kubernetes).
• Expertise in handling various formats including JSON, Avro, Parquet, and XML, specifically using NiFi Record-based readers/writers.
• Familiarity with IaC tools like Ansible or Terraform to automate NiFi cluster deployments.
• Experience managing, monitoring, and troubleshooting multiple data flows/threads.
• Twenty (20) years experience as a SWE in programs and contracts of similar scope, type, and complexity is required.
• Bachelor’s degree in Computer Science or related discipline from an accredited college or university is required.
• Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor’s degree.

Nice To Haves

• Experience with DeltaFi.
• Experience with DevOps (automating maintenance and monitoring, observability, deployment orchestration).
• Background in IT Operations and understanding of networking (CIDR routing, proxy configurations, and firewalls).
• Understanding of corporate dataflow and system interoperability.

Responsibilities

• design, implement, and manage complex, high-throughput data pipelines
• ensuring that data moves securely and reliably between disparate systems, including cloud infrastructure
• design and build scalable data flows using Apache NiFi to ingest, route, transform, and deliver data across the enterprise
• optimize NiFi performance by managing back-pressure, tuning settings, and configuring site-to-site communication for clustered environments
• deploy highly scalable solutions using Apache Nifi cluster and Apache Zookeeper

What This Job Offers

• Job Type: Full-time
• Career Level: Senior