About The Position

The Staff Software Engineer will design, develop, and optimize the low‑latency runtime that enables AI inference on next‑generation accelerator hardware. This role focuses on building robust host‑side runtime components, defining stable kernel/user interfaces, and ensuring high performance, reliability, and debuggability across the runtime stack. The engineer will collaborate with cross‑functional teams across kernel, compiler, firmware, and CI to deliver production‑quality features.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or related field.
  • 8+ years of experience in systems software development using C/C++ on Linux, especially in library/API design and develooment.
  • Familiarity with git, CMake and other programing languages like Python and Bash.
  • Strong knowledge of OS fundamentals, memory management, and multithreading.
  • Experience working with kernel/user APIs (e.g., ioctl) and low‑level systems debugging.
  • Experience in performance optimization, profiling, and large‑scale debugging.
  • Demonstrated ability to deliver complex features end‑to‑end in a production environment.
  • Bachelor's degree in Engineering, Information Systems, Computer Science, or related field and 4+ years of Software Engineering or related work experience.
  • OR Master's degree in Engineering, Information Systems, Computer Science, or related field and 3+ years of Software Engineering or related work experience.
  • OR PhD in Engineering, Information Systems, Computer Science, or related field and 2+ years of Software Engineering or related work experience.
  • 2+ years of work experience with Programming Language such as C, C++, Java, Python, etc.

Nice To Haves

  • Experience with AI accelerators, inference runtimes, or DSP‑like architectures.
  • Familiarity with virtualization/emulation (e.g., QEMU) or device bring‑up.
  • Experience with security protocols or Linux platform security (e.g., SPDM/PCIe).
  • Experience with CI/CD pipelines and automated testing frameworks.

Responsibilities

  • Develop and maintain core C/C++ runtime components for model execution, memory management, and control/data paths.
  • Define and evolve userspace–kernel interfaces and ensure long‑term compatibility.
  • Lead debugging and integration efforts across emulation environments and hardware platforms.
  • Improve performance, stability, logging, and observability of the runtime.
  • Implement automated tests, including unit and integration tests, to ensure feature quality.
  • Produce clear design documentation and participate in technical reviews.
  • Provide technical guidance and mentorship within the team.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service