Senior Data Engineer

VisaFoster City, CA
8hHybrid

About The Position

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid. At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters — to you, to your community, and to the world. Progress starts with you. The Data and Artificial Intelligence Platform (DAP) group is a key component of Visa's Technology organization, providing the enabling technology and processes to handle Visa's data assets and deliver valuable information, products, and services to customers. Within DAP, the Data as a Service (DaaS) team consists of skilled data engineers focused on building data pipelines to meet Visa's data needs and delivers secure, high-quality, and easy-to-use data assets. As a Senior Data Engineer, you'll join our Data & AI Platform – Data as a Service organization in Foster City, California. You will help design, enhance, and build our data infrastructure and pipelines within an agile development environment, using Gen AI regularly, and collaborating with colleagues who will support and challenge you daily. What We Offer: Exciting Challenges: We work at a scale rarely seen in the industry, solving complex data and AI problems across the entire stack, offering limitless opportunities to leverage and lead in this ever-growing field. Teamwork and Fun: Each of us brings diverse and rich experiences to the team, enabling us to deliver much more than the sum of our parts and have fun at the same time. Fantastic People: With strong leadership, you will have the opportunity to learn, collaborate, and deliver together with some of the best and most creative minds in the industry.

Requirements

  • 2 or more years of work experience with a Bachelor’s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)

Nice To Haves

  • 3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)
  • Strong programming skills in at least two of the following languages: Java, Python, Go, Scala
  • Experience utilizing GenAI technologies in software development
  • Hands-on experience developing data processing pipeline, feature extraction, production deployment and monitoring.
  • Expertise with Apache Spark, Kafka, Hadoop, Hive, Trino, Presto, Apache Airflow and NoSQL databases like Hbase working with PB level data volume.
  • Hands on Experience in on-prem (Hadoop) and cloud-based data platforms (AWS, Azure, DataBricks) and related data storage (HDFS, S3) and processing tools (Spark)
  • Experience with GenAI or Agentic AI technologies (e.g., LLMs, NLP) and RAG-based architecture and Vector DBs.
  • Working experience in building solutions using MCP and A2A frameworks.
  • Advanced proficiency and expertise in J2EE technologies, Microservices and REST APIs.
  • Proven track record of building and deploying streaming and batch ETL pipelines using the latest Big Data technologies.
  • Experience in an Agile environment, with a strong emphasis on best software development practices such as CI/CD, code reviews, and test automation, using tools like Jira and Jira Align
  • Strong understanding of algorithms and data structures
  • Excellent problem-solving and troubleshooting abilities
  • Excellent communication and interpersonal skills, and a strong team player.
  • Should have key leadership behaviors like Positive attitude, Quick learner, Collaborative and Obsess with customer.

Responsibilities

  • Design, develop, and maintain robust and scalable data pipelines and ETL processes
  • Design and develop conceptual, logical, and physical data models to map our data requirements into database structures
  • Ensure data services are highly available, secure, scalable, and resilient.
  • Improve and support production systems, ensuring that production issues are promptly resolved
  • Collaborate with the agile team, user community, architects, and support teams to understand requirements and implement effective solutions
  • Drive innovation to differentiate our data products and accelerate time-to-market delivery.
  • Represent the team in various technical forums and build deep partnerships with product management.
  • Adhere to established software development guidelines, security standards and responsible use of Gen AI tools and frameworks
  • Help maintain atmosphere of mutual accountability

Benefits

  • Medical
  • Dental
  • Vision
  • 401 (k)
  • FSA/HSA
  • Life Insurance
  • Paid Time Off
  • Wellness Program
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service