Senior Software Engineer - Data Engineer
Company: NVIDIA Corporation
Location: Santa Clara
Posted on: April 18, 2024
|
|
Job Description:
We are now looking for a Data Engineer to help build data
pipelines at scale for Autonomous Vehicles. NVIDIA is hiring senior
data engineers to develop and scale its AI and deep learning
platforms with a focus on building pipelines to process PB scale
data for Autonomous Vehicles.What you'll be doing:Design, build,
and maintain high-performance streaming and batch data pipelines
using Kafka and related technologiesDesign and build components of
PB sized scalable data lake and structured/unstructured data query
interfaces and microservices to ingest, index, mine, transform, and
compose large datasetsBuild and implement support for versioned,
traceable, and immutable datasets in a data lake in a distributed
and scalable mannerHands-on writing of high quality code, good
design & architecture, fully tested and peer reviewedPartner with
our other engineering and product teams to solve data modeling,
data heterogeneity and data quality issues at scaleAutomate
everything for measuring, testing, updating, monitoring and
alerting the data platformWhat we need to see:Bachelor's or
Master's in a quantitative field (e.g. Statistics, Computer
Science, Business Analytics, Data Science, Economics or other
relevant field) or equivalent experience5+ years of proven
experience in building distributed batch and streaming pipelines,
Data Lake/ Lake House ecosystem, backend microservices
architecture, and heterogeneous data types at scaleYou have
extensive hands-on experience in building scalable data platforms
and reliable data pipelines using technologies such as Spark,
ElasticSearch, Databricks, Clickhouse, AWS Kinesis, and/or KafkaYou
are proficient in at least one primary language (e.g., Java, Scala,
Python, Golang) and SQL (any variant)Having hands on experience
about transport and API protocols such gRPC or GraphQL, working
with data formats such as Protocol Buffers, Avro etc is a
mustExperience with orchestration and execution engines like
Airflow, Temporal, Dagster for building durable pipelines with an
emphasis on deployments and monitoringYou have familiarity with
databases and analytics technologies in the industry, including
Data Lakes, Lakehouse ETLs, Datamesh and Relational
DatabasesExcellent written and verbal communication skillsWays to
stand out from the crowd:Advanced programming expertise in
ScalaExperience with Kubernetes and DockerEnthusiasm to collaborate
and build supporting development infrastructure like CI/CD and
DevOpsA go getter with an inquisitive desire to dive deeper and
understand technical requirementsWith highly competitive salaries
and a comprehensive benefits package, NVIDIA is widely considered
to be one of the technology industry's most desirable employers. We
have some of the most experienced and talented people in the world
working with us and our engineering teams are growing fast in some
of the hottest state of the art fields: Deep Learning, Artificial
Intelligence, and Autonomous Vehicles. If you're a creative and
autonomous computer scientist with a real passion for distributed
systems and parallel computing, we want to hear from you!The base
salary range is 144,000 USD - 270,250 USD. Your base salary will be
determined based on your location, experience, and the pay of
employees in similar positions. We are now looking for a Data
Engineer to help build data pipelines at scale for Autonomous
Vehicles. NVIDIA is hiring senior data engineers to develop and
scale its AI and deep learning platforms with a focus on building
pipelines to process PB scale data for Autonomous Vehicles.What
you'll be doing:
#J-18808-Ljbffr
Keywords: NVIDIA Corporation, Sunnyvale , Senior Software Engineer - Data Engineer, IT / Software / Systems , Santa Clara, California
Click
here to apply!
|