We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled. The global technology and services leader that powers the world’s best brands, today and into the future.
Senior Databricks Architect
Location
United States
Posted
4 days ago
Salary
$106.1K - $151.6K / year
Job Description
Role Description
We're Concentrix. The intelligent transformation partner. Solution-focused. Tech-powered. Intelligence-fueled.
The Concentrix Technical Products and Services team is the driving force behind Concentrix’s transformation, data, and technology services. You will be surrounded by the best in the world providing market leading technology and insights to modernize and simplify the customer experience.
As a Senior Databricks Architect, you will:
- Partner with lead consultants to identify, design, and develop high value Databricks use cases.
- Design and deploy best in class architectures for data, analytics, and AI platforms built on Databricks and cloud services (Azure, AWS, or GCP).
- Identify opportunities to create IP and packageable solutions based on observed patterns and customer whitespaces.
- Drive architectural discussions with Client SMEs and technical resources during the design phase of engagements.
- Address technical objections and build confidence with client architects and executives during the sales and delivery cycle.
- Lead the design and development of secure, scalable Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and integration with upstream and downstream systems.
- Oversee and participate in the build of batch and streaming data pipelines, notebooks, and Databricks SQL assets using Spark, Python, and SQL, following medallion and other best practice patterns.
- Help define and enforce engineering standards, including code quality, testing, CI/CD, observability, and operational readiness for Databricks workloads.
- Collaborate with project managers and client stakeholders to plan releases, manage dependencies, mitigate risks, and ensure on-time, on-budget delivery.
- Provide hands-on technical leadership to data engineers and analysts, review designs and code, and unblock complex technical issues.
- Implement data governance and security practices using Unity Catalog and related tools, including access control, lineage, and compliance aligned policies.
- Optimize performance, reliability, and cost of Databricks workloads through cluster tuning, storage strategies, and monitoring.
- Drive change management and enablement by creating documentation, runbooks, and training materials, and facilitating knowledge transfer to client teams.
- Support production, go-live stabilization, ensuring robust handover to client operations or managed services teams.
Qualifications
- Excellent communication and presentation skills, with the ability to influence technical and non-technical audiences.
- Demonstrated ability to gather requirements and translate business needs into technical designs and phased roadmaps.
- Proven experience driving architecture and design in data or analytics projects in a consulting, professional services, or similar environment.
- Extensive hands-on experience designing and delivering data platforms and pipelines on Databricks, including Delta Lake, Jobs/Workflows, and Databricks SQL.
- Strong programming skills in at least two of: Python, PySpark, and SQL, with demonstrated ability to build performant batch and streaming solutions.
- Solid understanding of cloud services (Azure, AWS, or GCP) relevant to Databricks deployments, such as storage, networking, identity, and DevOps tooling.
- Experience implementing data governance, security, and access control in Lakehouse or data platform environments using Unity Catalog or similar tools.
Requirements
- Experience with large scale data platform migrations or modernizations (e.g., from legacy ETL/warehouse tools to Databricks).
- Exposure to enabling ML/AI and GenAI workloads on Databricks, such as feature engineering pipelines, MLflow, or integration with LLM/GenAI services.
- Multi-industry background (e.g., financial services, healthcare, manufacturing, public sector) with an understanding of common data and analytics use cases.
- Prior responsibility for mentoring engineers, or leading multi-workstream engagements.
- Databricks certifications (Architect, Data Engineer, ML Professional); enterprise-scale data and AI platform experience; current or former Databricks Champion.
Benefits
- Medical, dental, and vision insurance.
- Comprehensive employee assistance program.
- 401(k) retirement plan.
- Paid time off and holidays.
- Paid learning days.
Job Requirements
- Excellent communication and presentation skills, with the ability to influence technical and non-technical audiences.
- Demonstrated ability to gather requirements and translate business needs into technical designs and phased roadmaps.
- Proven experience driving architecture and design in data or analytics projects in a consulting, professional services, or similar environment.
- Extensive hands-on experience designing and delivering data platforms and pipelines on Databricks, including Delta Lake, Jobs/Workflows, and Databricks SQL.
- Strong programming skills in at least two of: Python, PySpark, and SQL, with demonstrated ability to build performant batch and streaming solutions.
- Solid understanding of cloud services (Azure, AWS, or GCP) relevant to Databricks deployments, such as storage, networking, identity, and DevOps tooling.
- Experience implementing data governance, security, and access control in Lakehouse or data platform environments using Unity Catalog or similar tools.
- Experience with large scale data platform migrations or modernizations (e.g., from legacy ETL/warehouse tools to Databricks).
- Exposure to enabling ML/AI and GenAI workloads on Databricks, such as feature engineering pipelines, MLflow, or integration with LLM/GenAI services.
- Multi-industry background (e.g., financial services, healthcare, manufacturing, public sector) with an understanding of common data and analytics use cases.
- Prior responsibility for mentoring engineers, or leading multi-workstream engagements.
- Databricks certifications (Architect, Data Engineer, ML Professional); enterprise-scale data and AI platform experience; current or former Databricks Champion.
Benefits
- Medical, dental, and vision insurance.
- Comprehensive employee assistance program.
- 401(k) retirement plan.
- Paid time off and holidays.
- Paid learning days.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Bowhead seeks a Data Engineer to join our team in Mobile, AL. The Data Engineer will not only build scalable data pipelines, but also help operate and secure our cloud environment. This role blends data engineering, cloud platform administration, and cyber compliance to ensure ou...
Senior Data Engineer – Real-Time ML, Pricing Platform
TrumidDelivering a full ecosystem of credit protocols and trading solutions in one easy to-use-platform.
Senior Data Engineer designing streaming data infrastructure for fintech.
Contract Data Architect, Snowflake
The Motley FoolMaking the world smarter, happier, and richer through free and premium investing guidance.
Contract Data Architect specializing in Snowflake for a financial services company
Senior Data Engineer designing and maintaining data platforms for a personal injury law firm