Software Engineer III, AI/ML

Company: Google
Location: Sunnyvale
Posted on: May 3, 2025

Job Description:

Job Title: Machine Learning Infrastructure EngineerLocation: Sunnyvale, CA, USAApplyMinimum Qualifications:

• Bachelor's degree or equivalent practical experience.
• 2 years of experience in software development in one or more programming languages, or 1 year with an advanced degree.
• 1 year of experience with speech/audio processing, reinforcement learning, ML infrastructure, or related ML fields.
• 1 year of experience with ML infrastructure including model deployment, evaluation, optimization, data processing, and debugging.
• Experience with GPU programming.
• Experience with large language models (LLMs).Preferred Qualifications:

• Master's or PhD in Computer Science, Computer Engineering, or equivalent practical experience.
• Experience with NVIDIA GPU architecture, performance profiling, and CUDA kernel optimization.
• Experience optimizing inference performance for LLMs like Gemini or other open-source models.
• Experience in performance and resource optimization.
• Familiarity with Jax, Pallas, Mosaic, Triton, or similar tools.About the JobGoogle's software engineers develop next-generation technologies impacting billions of users. Our products handle massive-scale information and extend beyond web search, including areas like information retrieval, distributed computing, AI, and more. As a software engineer, you will work on critical projects with opportunities to switch teams and projects as our business evolves. We value versatility, leadership, and enthusiasm for tackling new problems across the full tech stack.The ML, Systems, & Cloud AI (MSCA) organization at Google manages hardware, software, and infrastructure for all Google services and Google Cloud, including Vertex AI and Gemini models. Our focus is on security, efficiency, and reliability, shaping the future of hyperscale computing.Salary range in the US: $141,000 - $202,000 plus bonus, equity, and benefits. Compensation is role, level, location-dependent, and determined by experience and education. More details will be shared during the hiring process.Responsibilities
  • Develop and optimize custom GPU kernels using Pallas/Mosaic to enhance LLM model inference performance.Google is an equal opportunity employer committed to diversity and inclusion. We value a workforce that reflects our users and foster a culture of belonging. We do not discriminate based on race, gender, religion, or other protected categories. English proficiency is required for all roles to facilitate global collaboration.Note: Google does not accept agency resumes and is not responsible for fees related to unsolicited resumes.
    #J-18808-Ljbffr

Keywords: Google, Sunnyvale , Software Engineer III, AI/ML, IT / Software / Systems , Sunnyvale, California