SunnyvaleRecruiter Since 2001
the smart solution for Sunnyvale jobs

Staff Data Engineer

Company: Intuit
Location: Sunnyvale
Posted on: August 17, 2019

Job Description:

Overview The SBSEG QuickData Platform Engineering team is enabling data-driven decisions at the highest levels of the company, and we are using big data to personalize user experiences in our products. The infrastructure is running on AWS and looking for Staff/Senior Engineer to join our QuickData Platform Team. We are looking for a strong Engineer with a passion for automation, ready for an opportunity to tackle the complex problems of scale, which are unique to Intuit, while using your expertise in AWS, platform automation, data monitoring, incident management for a big data and large-scale systems. We are looking for someone who can design, code and maintain high performance and support data infrastructure. Responsibilities

  • Build and maintain optimal ingestion framework and pipeline to ingest data from transactional data sources on RDBMS/NoSQL to data lake on Redshift/S3
  • With the mindset of open source contribution , Re-design data movement framework to automate incoming data from third party marketing sources ( Google , Facebook , Bing etc. ) to data lake on AWS
  • Optimize and standardize existing pipelines using Big Data Technologies (EMR, Spark etc.)
  • Create data tools and frameworks for analytics and data scientist for faster Time-to-insights and thereby increase the productivity
    • Identify opportunities for automation and platform enhancement - design and build solutions for greater scalability.
    • Respond to monitoring alerts according to defined playbooks and procedures
    • Perform benchmarking & performance of AWS infrastructure via automation.
    • Contributions to Operational Standards and Requirements
    • Develop run books for problem diagnosis, resolution and escalation.
    • Automate various RTB jobs using scripts/tools to speed execution.
    • Be an onshore POC for 24/7 maintenance and support team for AWS Data platform
    • Manage tickets raised by business team Qualifications
      • BS in Computer Science. MS Preferred.
      • Experience managing Big Data infrastructure on AWS.
      • Exposure in managing different flavors of RDBMS/RDS ( Oracle , Aurora , SQL Server ) and NoSQL databases
      • Apt with automating repetitive tasks using Spark, Python
      • Experience designing and deploying systems on AWS
      • Enjoy a fast-paced, rapidly changing work environment
      • Good communication skills and a passion for clean code
      • Experience with AWS products including EC2, S3, RDS, ElastiCache, ElasticSearch, Kinesis, Lambda, DMS etc.
      • Exposure to Big Data on AWS ( Data Pipeline, Kinesis , Firehose , Hive , Glue, S3, EMR/EC2 , Spark) Responsibilities:
      • Extensive Experience in automation, capacity planning & benchmarking/performance testing in AWS
      • Implement and adhere to continuous integration practices
      • Operational mindset with ability to do Problem, SLA and Incident Management.
      • Troubleshoot issues and participate in 24x7 on-call support, ensuring the stability of the production environment.
      • Strong critical thinking ability to assess complex problems, analyze options, navigate diverse perspectives and develop optimal/acceptable solutions
      • Ability to work independently with minimal supervision

Keywords: Intuit, Sunnyvale , Staff Data Engineer, Engineering , Sunnyvale, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

Sr. DevOps Engineer/Consultant
Description: Job Details Role Sr. DevOps Engineer Location Woodland Hills, CA Duration Long Term Contract Interview Skype Job Description We are really looking for someone with expert knowledge in containers Docker (more...)
Company: Softnice Inc
Location: Woodland
Posted on: 08/23/2019

Junior Electrical Engineer / Electrical Engineering Intern
Description: ELECTRICAL DESIGN INTERN / JUNIOR ELECTRICAL ENGINEER Facilities Electrical Engineering Power and Lighting Consulting Services Sacramento, CA Title: Electrical Design Intern / Junior Electrical Engineer (more...)
Company: TJG Engineering
Location: Sacramento
Posted on: 08/23/2019

Associate Civil Engineer (Civil Land Development Experienced)
Description: Position: Associate Civil Engineer 2 years experience in Civil Land Development Industry Office Locations: Folsom or Sacramento California Term: Full Time Permanent Employment Compensation: Highly (more...)
Company: TJG Civil Engineers and Land Planners
Location: Rancho Cordova
Posted on: 08/23/2019

Sr. Air Quality Engineer
Description: JOBEl Dorado County is one of the most beautiful counties in the state of California.------You can avoid the valley commute and fog and take in the natural beauty.----Check out our video to learn more (more...)
Company: The County of El Dorado
Location: Placerville
Posted on: 08/23/2019

Security Engineer
Description: Hi Consultant, Global Touchpoints, Inc., Touchpoints is an expertise-based organization with focus on delivering innovative solutions and services in Information
Company: Global Touchpoints Inc.
Location: Roseville
Posted on: 08/23/2019

Project Engineer
Description: The ideal candidate will be responsible for assisting the project manager and project team with project documentation
Company: Certis Solutions
Location: Sacramento
Posted on: 08/23/2019

Dynatrace Engineering
Description: Company SmartIT Frame - Location 95655 Rancho cordova, CA - Job Type Temporary
Company: SmartIT Frame
Location: Rancho Cordova
Posted on: 08/23/2019

Associate Civil Engineer EIT or PE - Civil Land Development
Description: Position: Associate Civil Engineer EIT or PE 2 years experience in Civil Land Development Engineering Office Location: Folsom, California 95630 Term: Full Time Permanent Employment Compensation: Highly (more...)
Company: TJG Civil Engineers and Land Planners
Location: Sacramento
Posted on: 08/23/2019

Sr Full Stack Engineer
Description: Minimum Required Skills Python, Django, AngularJS, Angular.js We are B2B global travel agency throughout the US and Europe. Located in SF, and our SaaS platform leverages industry leaders to bring you (more...)
Company: CyberCoders
Location: San Francisco
Posted on: 08/23/2019

Pre-Sales Solutions Engineer, West
Description: Docker, the world's leading software container platform, is seeking a top-notch Pre-Sales Solutions Engineer to be a key contributor to our Western Regional Team to help contribute to Docker's long-term (more...)
Company: Docker
Location: Sacramento
Posted on: 08/23/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Sunnyvale RSS job feeds