Databricks Engineer, Data Engineer III

Data EngineerData EngineerFull TimeRemoteTeam 11-50H1B No SponsorCompany Site LinkedIn

Location

California + 2 more

Posted

40 days ago

Salary

$100.7K - $155.1K / year

Bachelor Degree5 yrs expEnglishAWSAzureBig QueryCloudETLGoogle Cloud PlatformPythonScalaSQLUnity

Job Description

• Transforming enterprise business data into insights • Collaborate with business stakeholders to understand their data needs • Analyzing business requirements and translating them into technical specifications • Design, develop and implement data engineering solutions using Azure Databricks Lakehouse platform • Build Data and AI solutions leveraging Databricks components • Conduct detailed data analysis to identify existing data tables, design new tables, views and other objects • Apply AI and machine learning techniques to structured and unstructured data processing • Ensure data quality, integrity, and security throughout the data lifecycle • Collaborate with data scientists and analysts to meet data requirements • Communicate effectively with stakeholders on complex data concepts

Job Requirements

Bachelor’s degree in computer science, engineering, or related field
5-7 years proven experience as a Data Engineer with cloud-based data platforms like Databricks, Snowflake, BigQuery
Expertise with Databricks SQL, Compute Warehouses, AI/BI Genie, AgentBricks, Unity Catalog and Vector indexes
Experience with data modeling, Medallion architecture, ETL processes and data warehousing concepts.
Strong programming skills in languages such as Python, SQL or Scala
Experience with DevOps and DataOps process to deploy data objects and pipelines across environments using scripts and agile process
Experience with AI/ML concepts and their application in data engineering.
Excellent problem-solving skills and ability to work independently and as part of a team.
Familiarity with cloud platforms (e.g., AWS, Azure, GCP).