Senior Software Engineer - Data Analytics Storage & Compute

Company: Uber
Location: Sunnyvale
Posted on: May 5, 2021

Job Description:

Job Description Data underpins our products, enabling intelligent decision making and improved user experiences. Leveraging the latest ML, Big Data, data visualization, and NLP technologies, the Product Platform team works at the intersection of engineering and data science to enhance our services and deliver actionable insights. *About the Role* The data analytics storage & compute team is part of the Data Infrastructure team which is based in Sunnyvale and is responsible for building *Uber Data Lake's* underlying storage and resource management infrastructure (with Apache HDFS, YARN), for the rest of the company. We're running more than 20,000+ nodes clusters to serve exabyte storage and schedule compute resources for 500k+ data process applications daily. We have a small tightly knit team with a diverse set of backgrounds from companies such as Facebook, Google, Cloudera, Amazon, Microsoft, LinkedIn, Twitter, Pinterest, Dropbox, other startups and college grads from the top schools. The team is proud to be a part of the open source community in innovating and shaping such exciting technologies as we move forward. Uber, as a business, is also growing rapidly, and Data at Uber is at the heart of almost all products e.g. Pricing predictions, Uber Pool route optimizations, Uber Eats restaurant recommendations, fraud detection, storage and processing of data collected from Autonomous vehicles etc. By solving these business problems you will not only be helping Uber but also have a front row seat to build and innovate the future Big Data systems and contribute them back to open source. This is an exciting time to be part of the Data team at Uber. Be sure to check out our engineering blog to learn more about the team. *What You'll Do* * Design systems architecture and deliver software and tools to advance the reliability of infrastructure including availability, performance, efficiency and scaling. * Provide technical leadership, influence and partner with fellow engineers to architect, design and build infrastructure that can stand the test of scale and availability, while reducing operational overhead. * Drive efficiencies in systems and processes through automation: capacity planning, configuration management, performance tuning, monitoring and root cause analysis. * Participate in periodic on-call rotations and be available for escalations. * Collaborate with platform, product and security engineering teams, and enable successful use of infrastructure and foundational services, and manage upstream and downstream dependencies *Basic Qualifications* * BS or MS in Computer Science or a related technical discipline, or equivalent experience. * Highly proficient in one of the following programming languages: Java, Go, C/C++. Good scripting skills and ability to pick up new ones. * Systematic problem solving approach and knowledge of algorithms, data structures and complexity analysis. * A love for coding, debugging and attacking hard problems. * Good working knowledge of networking and RPC stack (TCP/IP, HTTP, Thrift). * Grit, drive and a strong sense of ownership coupled with a penchant for collaboration *Preferred Qualifications* * Under the hood experience with Apache Hadoop HDFS, YARN or similar systems such as Apache HBase etc. is a strong plus * Experience with highly available/fault tolerant, replicated data storage systems, large scale data processing systems or enterprise/cloud storage systems is also a strong plus * 3+ years of experience building and managing distributed systems. Sound understanding of distributed system fundamentals. At Uber, we ignite opportunity by setting the world in motion. We take on big problems to help drivers, riders, delivery partners, and eaters get moving in more than 10,000 cities around the world. We welcome people from all backgrounds who seek the opportunity to help build a future where everyone and everything can move independently. If you have the curiosity, passion, and collaborative spirit, work with us, and let's move the world forward, together. Uber is proud to be an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires accommodation, please let us know by completing [this form](

Keywords: Uber, Sunnyvale , Senior Software Engineer - Data Analytics Storage & Compute, IT / Software / Systems , Sunnyvale, California