SunnyvaleRecruiter Since 2001
the smart solution for Sunnyvale jobs

Big Data Systems - Sr Production Engineer

Company: Yahoo!
Location: Sunnyvale
Posted on: November 25, 2022

Job Description:

It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you're looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business-and the world. Want in?About the Team:Yahoo is looking for DevOops engineers to join the Yahoo Big Data Production Engineering team. Yahoo is the birthplace of Hadoop and has the largest Hadoop install in the world. The server count has grown from a few hundred nodes, to over 40,000 in the past few years. We have over 400,000 cores that process nearly 300PB of data spread over 25 clusters running a mix of Hadoop, Storm, and Spark.About the Role:If you want to learn about Yahoo's Big Data platform, manage a large scale system and explore migration into the Cloud; this is the job for you. We are looking for experienced and motivated operations engineers to help build and enhance solutions to ensure the availability & reliability of the systems managed. If you have a strong distributed systems background, love to solve complex and challenging problems, can work independently and want to participate in some of the most exciting open source projects, we want to hear from you!Responsibilities:

  • Work on a combination of tasks & projects such as analyzing and assisting in the resolution of production software and infrastructure issues, reporting, deployments, monitoring, automation, and designing for redundancy/business-continuity planning.
  • Understand all aspects of Yahoo's Big Data Stack and learn select components in depth.
  • Work closely with engineering, operations, and Hadoop users to engineer cutting-edge solutions that allow Yahoo to answer today's most challenging big data questions.
  • Work in tight collaboration with Yahoo's Big Data development team during the development lifecycle to ensure operability and reliability of new products, feature enhancements & research experiments.
  • Scripting, Networking, Capacity planning and performance tuning
  • Taking part in 24/7 on-call rotationsQualifications
    • BS in Computer Science or equivalent
    • Minimum 5+ years of industry experience, preferably at large scale
    • Prior experience supporting 24x7, highly-available, systems
    • Solid understanding of best practices around operations, software development, release engineering & continuous delivery.
    • Deep expertise administering, supporting, debugging and tuning systems and technologiesFamiliarity with:
      • Hadoop/HBase/Storm architecture & infrastructure system administration.
      • Experience with EMR, S3, EC2, EKS, IAAC, Cloud security, Serverless architectures
      • Familiarity with Web servers & proxies, Apache, Squid, Trafficserver
      • Experience with performance management/capacity analysis and planning
      • Familiarity with configuration management (Chef, Puppet, Ansible, Salt)
      • Familiarity with relational databases (MySQL, PostgreSQL) administration and usage
      • Skills and knowledge running Infrastructure Automation Tools at scale (git, airflow, screwdriver, Jenkins)
      • Strong programming skills in Perl/Python/Ruby/Golang
      • Experience in a Red Hat/CentOS environment
      • Information security best practices: trust management, certificates
      • Strong working knowledge of TCP/IP networking & load-balancers
      • Strong working knowledge of Linux operating system internals
      • Strong analytical skills & ability to work in a production serving environmentYahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form ( or call 408-336-1409. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.At Yahoo, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion ( page to learn more.US Only: Please be aware that Yahoo requires all employees entering a U.S. Yahoo office and/or attending a company event (including client events) are required to be vaccinated for COVID-19. This position will require the successful candidate to obtain and show proof of a vaccination to enter a U.S. Yahoo office and/or attending a company event (including client events). Yahoo is an equal opportunity employer, and will provide reasonable accommodation to those individuals who are unable to be vaccinated consistent with federal, state, and local law.The compensation for this position ranges from $117,000.00 - $243,125.00/yr and will vary depending on factors such as your location, skills and experience. The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions, in addition to equity incentives. Yahoo provides industry-leading benefits including healthcare, 401K savings plan, company holidays, vacation, sick time, parental leave and an employee assistance program.Currently work for Yahoo? Please apply on our internal career site.

Keywords: Yahoo!, Sunnyvale , Big Data Systems - Sr Production Engineer, Other , Sunnyvale, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Sunnyvale RSS job feeds