Data Engineer

Company: iStaff
Location: Alpharetta
Posted on: March 26, 2020

Job Description:

We are currently currently seeking a Data Engineer for a full time permanent position with a leading Data Analytics company located in Alpharetta, GA. The Data Engineer should have a good understanding of data science and software engineering skills. We are looking for candidates that are self-motivated but willing to work with a team to solve technical problems. Required A Bachelor's degree in Statistics, Industrial Systems and Engineering, Machine Learning, Applied Analytics, Computer Science, or Computer Engineering. Minimum of 2 years of experience in understanding of best practices for building and designing ETL code Strong SQL experience with the ability to develop, tune and debug complex SQL applications is required Strong SQL experience with the ability to develop, tune and debug complex SQL applications is required Hands-on experience in Python object-oriented programming (At least 2 years) Huge plus if you have Process Automation and Optimization Knowledge in schema design, developing data models and proven ability to work with complex data Hands-on experience with Hadoop, MapReduce, Hive, Oozie, Airflow, ElasticSearch Understanding Hadoop file format and compression Familiarity with MapR distribution of Hadoop Understanding of best practices for building Data Lake and analytical architecture on Hadoop Scripting programming with UNIX, Java, Python, Scala etc. Knowledge in real time data ingestion into Hadoop Experience in working in large environments such as RDBMS, EDW, NoSQL, etc. Experience with Test Driven Code Development, SCM tools such as GIT, Jenkins i Experience with Graph database Responsibilities of the role Designing schemas, data models and data architecture for Hadoop and HBase environments. Implementing data flow scripts using Unix Hive QL Oozie scripting Designing, building and support data processing pipelines to transform data using Hadoop technologies Designing, building data assets in HIVE Developing and executing quality assurance and test scripts Working with business analysts to understand business requirements and use cases

Keywords: iStaff, Alpharetta , Data Engineer, Engineering , Alpharetta, Georgia