Data Engineer

Zachary Piper Solutions is seeking a Data Engineer to work onsite in Columbia, MD. The Data Engineer will design, build, and optimize cloud‑based data solutions within Microsoft Azure. This role will support cross‑functional teams by enabling scalable data pipelines, secure data architectures, and modern analytics capabilities.

Responsibilities of the Data Engineer include:

·      Design and implement data pipelines using Azure Data Factory, Azure Synapse, and Databricks

·      Develop and maintain data lake architectures using Azure Data Lake Storage (ADLS)

·      Optimize data workflows for performance, scalability, and cost efficiency

·      Implement data governance and security controls using Azure Purview, encryption, and RBAC

·      Collaborate with stakeholders to define data models, integration strategies, and reporting requirements

·      Provide architectural recommendations aligning with enterprise best practices

·      Monitor and troubleshoot data processes to ensure high availability and reliability

·      Support real‑time and batch data processing using Azure services and modern ETL frameworks

·      Document technical designs, data flows, and operational procedures

Qualifications for the Data Engineer include:

·      Bachelor’s Degree in Computer Science, Information Systems, or related field (preferred)

·      5+ years of data engineering experience with Microsoft Azure Cloud

·      Hands‑on experience with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and ADLS

·      Proficiency in SQL and Python for data transformation and automation

·      Experience with Azure DevOps, CI/CD pipelines, and Agile development methodologies

·      Knowledge of data security and compliance frameworks (e.g., HIPAA, encryption, data masking)

·      Experience with data modeling, ETL processes, and performance tuning

·      Strong analytical, troubleshooting, and documentation skills

Compensation for the Data Engineer includes:

·      Salary Range: $130,000 - $150,000 depending on experience

·      Comprehensive Benefits: Cigna Medical, Dental, Vision, 401K, PTO, Sick Leave if required by law, and Holidays

Keywords

Azure Data Engineer, Azure Cloud, Microsoft Azure, Azure Data Factory, Azure Synapse, Azure Databricks, Databricks Notebooks, ADLS, Azure Data Lake, Data Lake Architecture, Azure Purview, Data Governance, Data Security, RBAC, Encryption, Data Masking, ETL, ETL Pipelines, Data Pipelines, Data Integration, Data Modeling, SQL, Python, Data Transformation, Data Automation, Azure DevOps, CI/CD, Agile Development, Data Workflow Optimization, Cloud Architecture, Cloud Data Engineering, Batch Processing, Real-Time Processing, Data Ingestion, Data Processing, Data Orchestration, Data Architecture, Metadata Management, Data Documentation, Data Troubleshooting, Performance Tuning, Analytics, Business Intelligence, Azure Synapse Analytics, Structured Data, Unstructured Data, Big Data, Data Compliance, HIPAA Compliance, Data Strategy, Pipeline Monitoring, Scalable Data Solutions, Cost Optimization Azure, Azure Machine Learning, Power BI, Enterprise Data, Cloud Security, Cloud Governance, Secure Data Storage.

#LI-KG1

#LI-HYBRID