Senior Solution Architect - Databricks

End-to-End Data Architecture
. Collaborate with Databricks PS and customer
. on comprehensive end-to-end data architecture on Databricks platform
. Design and implement data ingestion strategies from various source systems
. Architect scalable storage solutions leveraging Delta Lake and lakehouse architecture
. Develop efficient data processing frameworks using Apache Spark and Databricks workflows
. Create data consumption layers for analytics, reporting, and machine learning use cases
. Ensure seamless data flow across the entire data lifecycle


Governance, Security & Compliance
. Collaborate with Databricks PS on implementing robust governance frameworks
. Design and enforce security policies and access controls within Databricks environments
. Ensure compliance with regulatory requirements and industry standards
. Implement data lineage, audit trails, and monitoring capabilities
. Optimize performance through best practices in cluster configuration and query optimization
. Establish data quality standards and validation processes


Data Modelling & Design
. Define business-aligned data models that support organizational objectives
. Design Delta table structures optimized for performance and scalability
. Create dimensional and normalized data models based on business requirements
. Implement medallion architecture (Bronze, Silver, Gold layers) for data refinement
. Develop data schemas that support both analytical and operational workloads
. Document data models and maintain data dictionaries


Technical Leadership & Collaboration
. Lead technical discussions with clients and stakeholders to understand business requirements
. Provide technical guidance to development teams on Databricks best practices
. Work closely with Infrastructure (Infra), Applications (Apps), and Cyber teams for integrated delivery
. Mentor junior architects and engineers on Databricks technologies
. Present solution architectures and technical recommendations to client leadership


Solution Implementation
. Oversee implementation of Databricks solutions from design through deployment
. Ensure solutions meet performance, scalability, and reliability requirements
. Support proof-of-concepts and pilot implementations
. Conduct architecture reviews and ensure alignment with enterprise standards