BCBS
|Sr Databricks Engineer
Florida, FL, US
Summary
Led the design and implementation of scalable data solutions for enterprise customer data platforms and personalized customer experiences within the Adobe Experience Platform ecosystem.
Highlights
Architected and optimized high-performance data engineering solutions for Adobe Experience Platform (AEP), Adobe CDP, and Real-Time CDP, enabling real-time customer activation and comprehensive Customer 360 views.
Led the development of enterprise-scale ETL/ELT pipelines using Databricks, Spark, Python, SQL, Delta Lake, ADLS, and AWS S3, processing large volumes of structured and semi-structured customer data.
Implemented robust Delta Lake architectures, leveraging ACID transactions, schema evolution, and incremental processing patterns to ensure data reliability and optimize storage for critical customer data.
Engineered scalable Spark/PySpark applications and Databricks notebooks, optimizing distributed data processing and complex transformations across large enterprise datasets for improved efficiency.
Collaborated with Adobe Architects, AJO Engineers, Marketing Technology teams, and business stakeholders to translate complex business requirements into scalable data architectures and solutions.