Bigdata engineer with QA and Java
Company: Periscope Technologies Inc
Posted on: November 9, 2018
Bigdata engineer 3 positions in total: 2 in Sunnyvale, CA and 1 in New jersey Job Responsibilities: Build distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time. Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases. Perform offline analysis of large data sets using components from the Hadoop ecosystem. Evaluate and advise on technical aspects of open work requests in the product backlog with the project lead. Own product features from the development phase through to production deployment. Evaluate big data technologies and prototype solutions to improve our data processing architecture. Candidate Profile: BS in Computer Science or related area Min 6 years software development experience Minimum 2 Year Experience on Big Data Platform Must have active current experience with Scala, Java, Python, Oracle, HBase, Hive Flair for data, schema, data model, how to bring efficiency in big data related life cycle Understanding of automated QA needs related to Big data Understanding of various Visualization platformd Experience in Cloud providers like AWS preferable Proficiency with agile or lean development practices Strong object-oriented design and analysis skills Excellent written and verbal communication skills Qualifications Top skill sets / technologies in the ideal candidate: * Programming language Java (must), Python, Scala * Database/Search - Oracle, complex SQL queries, stored procedures, performance tuning concepts, SOLR, AWS RDS, AWS Aurora * Batch processing Hadoop MapReduce, Cascading/Scalding, Apache Spark, AWS EMR * Stream processing Spark streaming, Kafka, Apache Storm, Flink * NoSQL HBase, Cassandra, MongoDB * ETL/ELT Frameworks including monitoring, alerting, restart * Code/Build/Deployment git, svn, maven, sbt, jenkins, bamboo: PERSONAL QUALIFICATIONS * Excellent communication and decision making skills are essential. * Strong analytical, problem solving and decision-making skills. * Zeal to lean new technologies, frameworks and appetite for growth * Identify project risks and recommend mitigation efforts. * Identify project issues, communicate them and assist in their resolution. * Assist in continuous improvement efforts in enhancing project team methodology and performance. * Cooperative team focused attitude
Keywords: Periscope Technologies Inc, Sunnyvale , Bigdata engineer with QA and Java, IT / Software / Systems , Sunnyvale, California
Didn't find what you're looking for? Search again!