Job Description

Overview

Job Title: Databricks Architect

Databricks Architect with expertise in building scalable data solutions on AWS

Responsibilities

• Supply Chain, Consumer Goods / Retail domain knowledge required.
• Experience in modernizing (solutions and hands-on execution) enterprise data platforms from legacy to AWS cloud
• Deep knowledge and experience in Data Modelling (OLAP and OLTP), Data Lake, Data Warehousing, ETL/ELT pipelines on both on-premise legacy and on AWS
• Lead migration and modernization of legacy ETL processes from Informatica, DataStage, and SQL Server to cloud-native solutions.
• Design and optimize data workflows for ingestion, transformation, and analytics using AWS-native services
• Design and Build data pipelines and solutions using Databricks (PySpark and SparkSQL) on AWS
• Experience with building Medallion architecture based data estates
• Experience in building Databricks Delta Lake based Lakehouse using DLT, PySpark Jobs, Databricks Workflows
• Proficient in SQL, Python, PySpark, S3, Lambda
• Working knowledge of Git, CI/CD, VS Code
• Proficient in AWS data ingestion stack
• Must have knowledge and ability to scale up on Glue, Lambda, Step Functions, Spark Streaming and other services on a need basis
• Implementation experience of several key data concepts such as CDC (Change Data Capture), Streaming and/or Batch ingestion, Pull v/s Push paradigms, Source to Target mapping, and so on
• Collaborate with cross-functional teams to gather requirements and deliver scalable, secure, and high-performance data solutions.
• Strong semantic layer modelling and implementation experience
• Establish best practices for data governance, lineage, and quality across hybrid environments.
• Provide technical leadership and mentoring to data engineers and developers.
• Monitor and troubleshoot performance issues across Databricks and AWS services.
• Understanding of key reporting stack such as Power BI, Tableau, Alteryx, Excel BI Add-Ins a plus

Certifications

Databricks Certified Data Engineer Associate

Application deadline

Applications will be accepted until 10/17/25

Salary and Other Compensation

The annual salary for this position is between $88,200 - $139,500 depending on experience and other qualifications of the successful candidate.

Benefits

Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
Long-term/Short-term Disability
Paid Parental Leave
Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Job Tags

Similar Jobs