ET Data Engineering (Engineering)

Company: E*TRADE
Location: Alpharetta
Posted on: May 11, 2022

Job Description:

More than 30 years ago, E*TRADE pioneered the online brokerage industry by executing the first-ever electronic individual investor trade. While the landscape of our industry has changed dramatically, our culture of innovation and drive to make online trading accessible to everyone continues to drive us forward. We believe in challenging the status quo, fostering an environment of curiosity and learning, and, above all, putting our customers first. In 2020, ETRADE joined Morgan Stanley, signaling a major industry shift that brought Wall Street and Main Street together more than ever before. As ETRADE's parent company, Morgan Stanley plays an important role in expanding what we can offer to investors, though E*TRADE still functions as an independent entity. RESPONSIBILITIES SUMMARY
The candidate must be a self-starter, who can work under general guidelines in a fast-paced work environment. Overall minimum 5 years of experience in cloud (AWS / Azure) data engineering along with traditional Datawarehouse experience (ETL). Experience in designing and building data pipelines using AWS services is a must. RESPONSIBILITIES

• Design and develop moderate to complex data pipelines for reusability using AWS Glue
• Develop complex transformations using Pyspark, SparkSQL and/or Scala.
• Integrate AWS Glue jobs with AWS data lake technologies including S3, Step Functions, Lambda and Kenesis
• Integrate AWS Glue jobs with supporting AWS services including SQS, SMS, DynamoDB
• Develop SQL logic in various flavors, including SparkSQL, Athena/Presto, Snowflake, Oracle, Sybase & DB2
• Perform technical analysis on existing code in Unix/Datastage for migration to AWS
• Prepare detailed design, architecture, mapping sheet and other ETL document
• Prepare and validate end to end business logic and mappings.
• Prepare unit test cases, test data and perform unit testing for the jobs developed
• Use standard version control tools to checkin and perform code reviews with Data Integration SME
• Use standard CI/CD pipelines to roll and deploy the code.
• Resolve all technical issues raised during SIT/UAT/ Warranty phases
• Prepare root cause corrective action document for the ETL issues. REQUIREMENTS:
  
  • Banking and Brokerage 3+ Years Preferred
  • Industry Function Experience Preference
  • Information Technology 5+ Years Required
  • Financials, Marketing 3+ years preferred
  • Technology/Business Domain Experience Preference
  • Python/Scala 5+ years Required
  • Cloud Technologies (AWS) 3+ year Required
  • Cloud Technologies (Azure) 1+ year Desired
  • Data Lake Projects (AWS) 1+ year Required
  • SQL 3+ Years Required
  • Big Data & Hadoop Related Technologies 2+ years Preferred
  • Tech/ Product Tools Experience Preference
  • SVN, Git 3+ years Required
  • Data Stage (IBM Information Server 11.x) 2+ Years Preferred
  • Control M / JCL 1+ years Preferred
  • Excellent Communication Required
  • Excellent Analytical Ability Required
  • People management contributor
  • Special Requirements Preference, Data Pipeline Support preferred #etrade REQUIREMENTS EDUCATION, CERTIFICATION, TRAINING
    Minimum Bachelor Degree or Equivalent to Bachelor in computer required #etrade

Keywords: E*TRADE, Alpharetta , ET Data Engineering (Engineering), Engineering , Alpharetta, Georgia