Lead Hadoop Developer

Company: Yahoo!
Location: Sunnyvale
Posted on: June 22, 2022

Job Description:

It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you're looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business-and the world. Want in?We build, improve, and maintain one of the highest scaling platforms in the world. Our amazing team of Engineers work on next generation Big Data Platforms that transform how users connect with each other every single day. Yahoo's Big Data Platform drives some of the most demanding applications in the industry. The system handles billions of requests a day and runs on some of the largest Hadoop clusters ever built! 50,000 nodes strong and several multi-thousand node clusters bring scalable computing to a whole new level. We work on problems that cover a wide spectrum - from web services to operating systems and networking layers. Our biggest challenges ahead are designing cloud native big data platforms. -Responsibilities: -Responsibilities will include understanding all aspects of our big data platforms and engineering ownership in one or more of the following open source projects: Hadoop, Storm, Presto, Flink, or Hbase. This includes possible research and new feature work, particularly related to supporting cloud native big data use cases. You will also own improvements on existing code, debugging and investigation of user issues, participation in code reviews, designing and shipping the product. Contribute to standard methodologies and culture of the team. Participate in agile development with weekly sprints, planning & estimating work, daily standup, & retrospectives.Qualifications:B.S. or higher in Computer Science or equivalent work experience7+ years experience in software development and deployment on public cloud platforms such as AWSExperience with OOP: Java, C#, or similarExperience with Apache Hadoop, Storm, Presto, Flink, or Hbase preferably on public cloud platformsExperience working with large distributed systems and dataDeep understanding of the fundamentals including Data Structures, Algorithms, OS and Networking.Strong skills in system & application architectureStrong--- ---design--- ---and--- ---implementation--- ---skills--- ---in--- ---Java--- ---or--- ---C++.--- ---Experience--- ---with--- ---large-scale--- ---production--- ---code development--- ---is--- ---a--- ---plus. -Ability--- ---to--- ---conduct--- ---research--- ---that--- ---is--- ---justified--- ---and--- ---guided--- ---by--- ---business--- ---opportunities.Working knowledge of scripting languages such as PHP, Perl, Python, and/or RubyFamiliar with HTTP and TCP/IP protocolLinux/Unix knowledge necessaryKnowledge of JVM internals and its performance tuning.Excellent verbal, written, and communication/presentation skillsExcellent debugging/testing skills, and excellent analytical and problem solving skillsExperience with continuous integration (CI) frameworks such as Jenkins and HudsonExperience with SCRUM or similar agile methodologyKnowledge of accessibility preferredYahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form () or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.At Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion () page to learn more.US Only: Please be aware that Yahoo requires all employees entering a U.S. Yahoo office and/or attending a company event (including client events) are required to be vaccinated for COVID-19. - This position will require the successful candidate to obtain and show proof of a vaccination to enter a U.S. Yahoo office and/or attending a company event (including client events). - Yahoo is an equal opportunity employer, and will provide reasonable accommodation to those individuals who are unable to be vaccinated consistent with federal, state, and local law.Currently work for Yahoo? Please apply on our internal career site.SummaryLocation: US - Champaign; US - SunnyvaleType: Full time

Keywords: Yahoo!, Sunnyvale , Lead Hadoop Developer, IT / Software / Systems , Sunnyvale, California