Apache Spark-Solutions Architect

Zachary Piper Solutions is seeking a Apache Spark Guru/Solutions Architect to support a reputable software company working with the federal customers on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects that require integrating with client systems, training, and other technical tasks to help customers to get most value out of their data.

Clearance: Minimum Secret Clearance required

Location: Northern Virginia, DC area

Schedule: Fully on site, customer-facing

Responsibilities of the Solutions Architect:

·      Lead customer technical initiatives, including designing and building reference architectures, developing how-to guides, and productionalizing customer use cases.

·      Advise strategic customers on transformational big data and AI initiatives, including third-party migrations, by delivering end-to-end design, implementation, and deployment of industry-leading solutions.

·      Provide architectural and design consulting, and bootstrap or implement customer projects to drive successful evaluation, adoption, and long-term use of Databricks.

·      Deliver escalated support for complex customer operational and technical issues.

·      Partner closely with Databricks technical teams, project managers, architects, and customer stakeholders to ensure all technical deliverables meet customer requirements and engagement goals.

Qualifications of the Solutions Architect:

·      Must hold an active Secret clearance or higher

·      5+ years of experience working with Apache Spark

·      6+ years experience in data engineering, data platforms & analytics

·      Comfortable writing code in either Python or Scala

·      Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one

·      Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals

·      Familiarity with CI/CD for production deployments

·      Design and deployment of performant end-to-end data architectures

Compensation of the Solutions Architect:

·      Compensation: $150,000 - $200,000+ **based on years of experience**

·      Full Benefits: Cigna Medical, Dental, Vision, 401k, PTO/Holiday, Sick leave as required by state law

·      Long-term stable and reputable company

Keywords: “apache spark, apache spark, python, scala, Databricks, “Databricks”, Aws, AWS, Azure, GCP, Cloud, Spark, MLOps, CI/DC, SQL, machine learning, data architecture, data engineering, big data, Databricks-based solutions, analytics, AI, applications, customer facing, client facing, Navy, Army, Air Force, USAF, US Army, Federal, Secret cleared, secret clearance, top secret cleared, ts cleared, ts clearance, ts/sci, tssci, Washington, DC., Tysons virginia, VA, northern virginia, Rockville, MD, DC Metro, Fairfax, manassas, Alexandria, fredricksburg, Winchester, falls churh, Herndon, data science, data engineering, integration

This job opens for applications 12/15/2025. Applications for this job will be accepted for at least 30 days from the posting date

#LI-GP2

#LI-Onsite