Software Engineer III

Reflexive ConceptsAnnapolis Junction, MD
11h

About The Position

Reflexive Concepts is seeking a skilled Software Engineer III to join our team! The Software Engineer will possess extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based distributed processing. In this role, the Software Engineer will be responsible for designing, implementing, and optimizing data ingress and egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads.

Requirements

  • Master’s degree in computer science or related discipline from an accredited college or university, plus five (5) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
  • Bachelor’s degree in computer science or related discipline from an accredited college or university, plus seven (7) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity
  • Nine (9) years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
  • Experience using the Linux CLI and Linux tools
  • Experience developing Bash scripts to automate manual processes
  • Recent software development experience using Python and Java
  • Experience with Distributed Big Data processing engines including Apache Spark
  • Experience using Jupyter Notebook
  • Experience with data wrangling and preprocessing using tools such as pandas, NumPy
  • Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
  • Familiarity with data quality concepts, data validation, and anomaly detection
  • Experience with Git Source Control System

Nice To Haves

  • Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
  • Experience with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
  • Familiar with HPC Job Scheduling tools including Slurm
  • Experience using the Atlassian Tool Suite (JIRA, Confluence)

Responsibilities

  • designing, implementing, and optimizing data ingress and egress pathways to ensure efficient, scalable, and reliable processing of the organization’s analytics workloads
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service