Software Engineering Manager, NIM

Company: Nvidia
Location: Santa Clara
Posted on: May 8, 2024

Job Description:

We are seeking a SW Engineering Manager for NVIDIA Inference Microservices (NIMs). The right person for this role is technical, creative and driven to change the way NVIDIA optimizes, serves and develops performant inferencing for every AI model. You will design, build and deliver high performance inference applications and services. Our NIM offerings are easy to use, highly performant and tested in all deployment scenarios, in the cloud, on customer's self hosted infrastructure and locally on all NVIDIA GPUs. You will use your deep understanding of software engineering, shipping enterprise software and optimizing performance to drive and deliver on the mission for NIMs as best performing inference microservices with cloud APIs on NVIDIA GPUs.NVIDIA is building a new category of products by intersecting our prowess in deep learning and computing with industry-leading technologies. You will harness groundbreaking technologies, and build highly efficient cloud services, reference applications and software processes to power how NVIDIA optimizes LLM Inferencing all the way through deployment in heterogeneous hardware and software environments. You will influence and drive technical advances in NVIDIAs processes and build the cross functional infrastructure team that strives to accelerate the delivery of every AI model on NVIDIA's GPUs anywhere.What you'll be doing:You will design and implement industry leading Inference Microservices, built on top of heterogeneous hardware and software matrixBuild and drive a metrics driven engineering team that measures it's capabilities and drives work based on first principles and knowledge.Integrate AI models, build microservices, optimize and verify the highest performance following a repeatable engineering process.Continuously improve your team's ability to iterate critical features and performance improvements.Learn about new advancements in the area of AI inference, and integrate new research innovations from groups across NVIDIA into your products.Drive predictable execution, high quality software and own the roadmap and technical future of your team.What we need to seeAn expert engineering leader and trained software engineer with Masters or equivalent experience in Computer Science, Computer Engineering or related field.10+ overall years of relevant industry experienceExcellent interpersonal skills and 4+ years of leadership experienceHands-on experience developing microservices, distributed software using CI/CDBackground in designing and delivering gRPC and REST based high quality APIs that scale out in highly distributed infrastructures.Experience working with NVIDIA's compute platforms such as DGX, Omniverse or AGX (Jetson, Drive) and exposure to platform software such as CUDA, TRT and software stack and applications is desired.Please be able to show a track record of crafting well-designed solutions and delivering high-quality software on time with strong engineering skills when faced with complicated and ambiguous problems.You excel at finding the simplest way to bring new technology to new domains.Highly motivated with strong communication skills, you have the ability to work successfully with multi-functional teams and coordinate effectively across organizational boundaries and geographies. A history of mentoring engineers is a plus.Growing individuals and teams and have demonstrated skills in a wide variety of programming languages and infrastructure problems.With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world's most desirable employers! We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our teams are rapidly growing.The base salary range is 220,000 USD - 339,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.SummaryLocation: US, CA, Santa ClaraType: Full time

Keywords: Nvidia, Sunnyvale , Software Engineering Manager, NIM, Executive , Santa Clara, California