Data Engineer
Company: Robert Half
Location: Alpharetta
Posted on: January 26, 2026
|
|
|
Job Description:
Job Description Job Description Position Overview We are seeking
a Data Engineer Engineer to support and enhance a Databricks?based
data platform during its development phase. This role is focused on
building reliable, scalable data solutions early in the
lifecycle—not production firefighting. The ideal candidate brings
hands?on experience with Databricks, PySpark, Python, and a working
understanding of Azure cloud services. You will partner closely
with Data Engineering teams to ensure pipelines, notebooks, and
workflows are designed for long?term scalability and production
readiness. Key Responsibilities Develop and enhance Databricks
notebooks, jobs, and workflows Write and optimize PySpark and
Python code for distributed data processing Assist in designing
scalable and reliable data pipelines Apply Spark performance best
practices: partitioning, caching, joins, file sizing Work with
Delta Lake tables, schemas, and data models Perform data validation
and quality checks during development cycles Support cluster
configuration, sizing, and tuning for development workloads
Identify performance bottlenecks early and recommend improvements
Partner with Data Engineers to prepare solutions for future
production rollout Document development standards, patterns, and
best practices Required Skills & Qualifications 3 years of hands?on
experience working with: Databricks & Spark Strong hands?on
Databricks experience Proficiency with PySpark and Spark
fundamentals Experience with Delta Lake Understanding of Spark
execution (jobs, stages, tasks, shuffles) Programming Strong Python
development skills Ability to write clean, modular, reusable code
Cloud Experience (Azure Preferred) Experience working in Microsoft
Azure Familiarity with: Azure Databricks Azure Data Lake Storage
(ADLS) Azure Blob Storage Basic understanding of cloud resource
usage and cost awareness Development Practices Experience using Git
and version control workflows Familiarity with Databricks Repos or
similar tools Ability to perform testing and validation of data
pipelines
Keywords: Robert Half, Alpharetta , Data Engineer, IT / Software / Systems , Alpharetta, Georgia
