Senior Data Platform Engineer

Platform EngineerPlatform EngineerFull TimeRemoteTeam 1-10H1B No SponsorCompany Site LinkedIn

Location

United States

Posted

84 days ago

Salary

$180K - $200K / year

Bachelor Degree5 yrs expEnglishAWSCloudETLKafka

Job Description

• Collaborate with engineering, data science, ML, data engineering, and product analytics teams to understand and shape the future needs of our data platform and infrastructure. • Define, drive, and implement the future live ingestion layer of data into our data platform (e.g. Kafka, Kinesis). • Define and evolve standards for storage, compute, data management, provenance, and orchestration. • Monitor current and forecast future infrastructure needs and costs based on business requirements. • Implement and manage role-based access management. • Design and implement reusable tooling and frameworks for data consumers (e.g., data quality monitoring frameworks, templated pipelines, foolproof backfilling capabilities).

Job Requirements

Bachelor's or Master's degree in Computer Science, or a related engineering field.
5+ years of experience in data infrastructure, platform engineering, data engineering, or similar.
Demonstrated hands-on experience with Databricks. AWS experience is a plus but not required.
Expertise in modern data warehouse and lakehouse architectures.
Expertise in modern ETL technologies and building and supporting data pipelines at scale.
Familiarity with access control, data governance, and security.
Demonstrated experience of reliability, observability, and monitoring of infrastructure and systems.
Experience building and maintaining data platforms with a wide variety of stakeholders/users with a diversity of technical expertises.
Demonstrated ability to scale cloud-based data workloads, whilst optimizing and monitoring cost.
Excellent verbal and written communication skills, with the ability to convey complex ideas clearly.
Comfortable working in a fast-paced, dynamic environment and adapting to changing priorities.