Databricks Consultant

Zachary Piper Solutions is seeking a Databricks Consultant to join a fast-paced data and AI initiative focused on optimizing enterprise analytics and LLM-driven business intelligence solutions. The consultant will support the setup, implementation, testing, and optimization of a Databricks Genie workspace while ensuring strong data quality, governance, and business context alignment. This is a remote role.

Responsibilities of the Databricks Consultant:

• Set up and launch a Databricks Genie workspace
• Review data readiness to ensure business users can confidently answer core reporting and analytics questions
• Finalize implementation of new ingestion patterns
• Review data pipelines and finalize table definitions to ensure data quality standards are met
• Ensure aggregated gold tables are created to provide optimized context for Genie spaces
• Review and improve documentation related to Genie spaces
• Create, curate, and manage Genie spaces for business use cases
• Tune Genie space quality and optimize responses for business users
• Test and monitor Genie spaces and iterate based on feedback and evaluation results
• Curate Genie spaces with strong business context including:
  • Official table descriptions
  • Business definitions and column comments
  • Global instructions for ambiguity handling
  • Defined join relationships and usage guidance
  • SQL expressions for core business metrics
  • Example SQL queries and expected prompts
  • Optional SQL functions for advanced logic handling
• Add benchmarks and evaluation metrics to support testing and validation efforts

Qualifications of the Databricks Consultant:

• Hands-on experience with Databricks, including Genie spaces and Delta Lake architecture
• Strong SQL and data modeling experience
• Experience working with silver/gold table structures and modern data pipeline frameworks
• Familiarity with LLM-powered analytics, AI-assisted querying, or conversational BI tools
• Strong understanding of data governance, business context curation, and data quality best practices
• Experience testing and optimizing AI or analytics platforms preferred
• Ability to work independently in a fast-moving consulting environment

Compensation of the Databricks Consultant:

Compensation: $150,000 - $200,000+ based on years of experience

Full Benefits: Cigna Medical, Dental, Vision, 401k, PTO/Holiday, Sick leave as required by state law

Additional Details:

• Start Date: Approximately 6/7/2026
• Duration: Approximately 80 hours per resource over 2–3 weeks+
• Work Environment: Remote/Client travel

This job opens for applications on 05/29/2026. Applications for this job will be accepted for at least 30 days from the posting date.