Principal Software Engineer - Spark

Company: Microsoft
Location: Sunnyvale
Posted on: June 17, 2022

Job Description:

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers to levels they cannot achieve anywhere else. This is a world of more possibilities, more innovation, and more openness. -Microsoft's Intelligence Platform engineering team is leading the transformation of analytics in the world of data with products like Power BI, Synapse Analytics, Azure Data Factory, Azure Data Explorer.---We will bring the world's data to---the Microsoft---Cloud, power a new class of data first applications, and empower everyone on the planet to make better decisions with data.------ -We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our ideas are better, our products are better, and our customers are better served. -Azure Big data teams (Azure Synapse Analytics, Azure Data Lake, HDInsight, Azure Stream Analytics and Cosmos) address interesting challenges in technologies such as big-data, cloud, storage, and open-source. We build reliable, highly scalable, and highly performing distributed systems for data analytics on Azure. We build services that enable big data developers to build mission critical applications with high levels of SLA through auto detection and healing. We enable advanced data Insights and recommendations externally to our customers.ResponsibilitiesThe Spark team in Azure Big data is looking to improve performance beyond what we have already demonstrated - 2x over OSS Spark 3.1. You will have to help rebuild the way analytics engines process data. For this role, you will have the opportunity to work on the next generation of query engine and storage system that can extend our work and outperform proprietary closed system data warehouses out in the market today.To be successful in this role, you must thrive while solving challenges related to distributed query execution, resource management, efficient storage subsystems and performance optimizations. You must be willing to solve challenging technical problems in a space where innovation is always happening. You will have an opportunity to make high impact changes daily. While this is an Architect role, we are looking for someone who can take on challenging development work to help kickstart projects, run complex proof-of-concepts, and technically lead.QualificationsRequired Qualifications10+ years of professional software development experience 8+ years of software development experience building scalable, distributed services 8+ years of software development experience with C++, Java, C#, Scala5+ years of experience in building programming models, APIs for platforms which achieve broad scale deployment/usageBachelor's degree in Computer Science, Computer Engineering, Software Design, Software Engineering, or a related field, or equivalent alternative education, skills, and/or practical experience.Preferred QualificationsAn ideal candidate would also bring:MS/PhD in Computer Science, Computer Engineering, or Electrical Engineering A passion for distributed systems, databases and large-scale storage Experience with multi-threaded/parallel programming Excellence in software engineering practices, coding and solid foundation in data structures, algorithms with strong testing, debugging and analytical skills Proven ability to plan, schedule and deliver quality software Excellent collaboration skills#azdat#msftintelplat#synapse#spark#analyticsCloud Screening (required for all C+AI Job Descriptions)Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: -Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.EOE Statement (this automatically populates in system)Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. - We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or as reasonable.Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. - We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request -via the -Accommodation request form.Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.Benefits and PerksIndustry leading healthcareSavings and investmentsGiving programsEducational resourcesMaternity and paternity leaveOpportunities to network and connectDiscounts on products and servicesGenerous time awayJob SummaryJob number: 1335519Date posted : 2022-05-05Travel: 0-25%Profession: EngineeringRole type: Individual ContributorEmployment type: Full-TimeExperience: Experienced professionals

Keywords: Microsoft, Sunnyvale , Principal Software Engineer - Spark, IT / Software / Systems , Sunnyvale, California