Senior Data Engineer

Equinix

7d

About The Position

As a Senior Data Engineer at Equinix, you will be responsible for driving end-to-end delivery of enterprise-scale data solutions on Google Cloud Platform. This role combines hands-on technical expertise, requiring you to design sophisticated system architectures, lead cross-functional teams, and mentor Staff and other data engineers. You will be responsible for solution design and ensuring the successful delivery of mission-critical data products. The ideal candidate demonstrates exceptional technical depth in GCP data technologies, proven leadership in guiding engineering teams through complex challenges, and the ability to translate strategic business objectives into scalable, innovative technical solutions. Knowledge of AI, Machine Learning Operations, and emerging technologies like Agentic AI and Model Context Protocol (MCP) is highly valued.

Requirements

• GCP Platform Mastery: 6+ years of hands-on experience with Google Cloud Platform, including deep expertise in BigQuery (advanced SQL, scripting, optimization, ML integration), Cloud Dataflow, Cloud Composer, Cloud Storage, Pub/Sub, Dataproc, and Vertex AI
• Programming Excellence: Expert-level Python/Java programming, proficiency in Python/Scala for Spark development
• Advanced Data Technologies: Deep expertise in Apache Beam, Apache Spark, Airflow, Kafka, and distributed computing architectures
• Infrastructure: Extensive experience with Terraform, CI/CD pipelines, and cloud infrastructure management
• Database & Data Modeling: Advanced knowledge of relational databases (PostgreSQL, MySQL) and NoSQL systems (BigTable, Firestore, MongoDB); expertise in data modeling, normalization, and performance optimization
• System Design: Proven ability to architect complex, distributed systems with considerations for scalability, reliability, security, and cost-effectiveness
• Bachelor's degree in Computer Science, Engineering, or related technical field (Master's degree preferred)
• 8+ years of data engineering experience with 6+ years specifically on Google Cloud Platform
• Proven track record of leading end-to-end delivery of complex, enterprise-scale data platform initiatives
• Experience designing and implementing data governance, compliance, and security frameworks
• Strong architectural thinking with ability to make sound technical decisions and trade-offs
• Excellent communication skills with ability to present technical concepts to both technical and non-technical audiences, including executive leadershi
• Proven ability to translate business requirements into scalable technical architectures and solutions
• Experience managing cross-functional projects and building strong stakeholder relationships

Nice To Haves

• Google Cloud Professional Data Engineer and/or Cloud Architect certifications
• Experience with AI/ML technologies, MLOps practices, and machine learning pipeline development on GCP
• Knowledge of emerging AI technologies including Agentic AI frameworks, LLM integration, and Model Context Protocol (MCP)
• Experience with feature stores, model serving infrastructure, and AI/ML observability
• Understanding of data science workflows, statistical analysis, and advanced analytics
• Experience with BI and visualization tools (Looker, Tableau, Power BI)
• Contributions to open-source data engineering projects or technical publications
• Experience with multi-cloud or hybrid cloud architectures
• Knowledge of data mesh, data fabric, or other modern data architecture patterns

Responsibilities

• System Design & Architecture Leadership Architect complex, distributed data systems capable of handling petabyte-scale workloads with fault tolerance and high availability
• Design data platform architectures considering scalability, performance, cost optimization, and operational excellence
• Evaluate and recommend emerging technologies, tools, and architectural patterns to drive innovation
• Create comprehensive architectural documentation, design patterns, and best practices guidelines
• Technical Solutioning & Delivery Own end-to-end delivery of complex data engineering initiatives from conception to production
• Design and implement sophisticated solutions leveraging BigQuery, Cloud Dataflow, Composer, Dataform/dbt, Pub/Sub, and Vertex AI
• Architect and build real-time streaming data pipelines using Cloud Pub/Sub, Kafka, and Apache Beam
• Develop advanced data transformation frameworks and custom processing engines
• Design microservices-based data platforms with containerization (Docker/Kubernetes)
• Establish comprehensive observability, monitoring, and alerting frameworks
• Drive performance optimization, cost management, and operational efficiency initiatives
• Team Leadership & Mentorship Lead and mentor Data Engineers and other team members, fostering technical excellence and professional growth
• Guide teams through complex technical challenges and architectural decision-making
• Conduct technical design reviews and ensure adherence to architectural standards
• Establish coding standards, quality assurance processes, and engineering best practices
• Lead technical training programs and knowledge-sharing initiatives
• Drive continuous improvement in team processes, tools, and methodologies
• Participate in technical hiring processes and team capability building
• Data Governance & Compliance Establish data classification systems, access control policies, and encryption strategies
• Implement automated data quality frameworks, lineage tracking, and metadata management
• Ensure regulatory compliance across data workflows (GDPR, SOX, industry-specific regulations)
• Design privacy-preserving techniques, data anonymization, and secure data sharing mechanisms
• Strategic Collaboration & Stakeholder Management Partner with business stakeholders to translate strategic objectives into technical solutions
• Lead cross-functional initiatives spanning multiple engineering teams and business units
• Present technical concepts and architectural decisions to executive leadership
• Drive alignment between technical implementations and business outcomes

Benefits

• Employee Assistance Program: An Employee Assistance program is available to all employees.
• Insurance: You may enroll in health, life, disability and voluntary plans that are designed for you and your eligible family members.
• Retirement: You and Equinix may contribute to a retirement plan to help you plan for your financial future.
• Paid Time Off (PTO) and Paid Holidays: You will receive an accrued amount of PTO each pay period along with various paid holidays for you to rest and recharge.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees