Shuru

Give wings to your ideas!

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 51-200Since 2021H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

136 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishAirflowAmazon RedshiftApacheAWSBig QueryCassandraCloudDockerDynamo DBETLGoogle Cloud PlatformJavaKafkaKubernetesMongo DBNo SQLPythonScalaSparkSQLTerraformGo

Job Description

• Design and implement scalable data pipelines for ingestion, validation, cleanup, and normalization • Build and maintain ETL/ELT processes to support both batch and real-time data processing • Develop data quality frameworks and monitoring systems to ensure data integrity • Optimize pipeline performance and troubleshoot data flow issues • Deploy and manage data infrastructure on AWS and GCP platforms • Implement Infrastructure as Code (IaC) using Terraform for reproducible deployments • Design and maintain data lakes, data warehouses, and streaming architectures • Ensure security, compliance, and cost optimization across cloud resources • Implement event-driven architectures using technologies like Kafka, Kinesis, or Pub/Sub

Job Requirements

  • 5+ years of experience in data engineering or related field
  • Hands-on experience with data pipeline development and maintenance
  • Strong proficiency in Python, SQL, and at least one other programming language (Java, Scala, Go)
  • Extensive experience with AWS services (S3, Redshift, EMR, Kinesis, Lambda, Glue)
  • Solid experience with GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage)
  • Proven experience with Infrastructure as Code using Terraform
  • Strong background in streaming technologies (Apache Kafka, Amazon Kinesis, Google Pub/Sub)
  • Experience with data processing frameworks (Apache Spark, Apache Beam, Airflow)
  • Proficiency with data warehousing solutions (Redshift, BigQuery, Snowflake)
  • Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB)
  • Familiarity with containerization (Docker, Kubernetes)
  • Experience with monitoring and observability tools (CloudWatch, Stackdriver, Datadog)

Benefits

  • Competitive salary and benefits package.
  • Opportunity to work with a team of experienced product and tech leaders.
  • A flexible work environment with remote working options.
  • Continuous learning and development opportunities.
  • Chance to make a significant impact on diverse and innovative projects.

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

Channel Factory

We help brands find the right content, context and audience on YouTube at the right price.

Data Engineer136 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Senior Data Engineer leading data infrastructure at a marketing tech startup.

ApacheAWSDistributed SystemsEC2ETLPostgresPySparkPythonRabbitMQRDBMSSQL
New York

Data Engineer, DoD Secret

Rackner

DevSecOps and AI from Cloud to Mission Edge | Kubernetes Partner | Multicloud | 8(a) | HUBZone

Data Engineer136 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Data Engineer modernizing secure data infrastructure for military healthcare

AirflowApacheAWSETLPythonSparkSQL
United States

Senior Consultant – Data Engineering

3Cloud

Delivering the ultimate Microsoft Azure experience.

Data Engineer137 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor

Senior Consultant - Data Engineering role at 3Cloud delivering technical solutions

AzureETLPythonSQLSSIS
United States
$108.2K - $156.9K / year

Data Engineer

Analytica

Data-driven consulting and technology services

Data Engineer137 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Data Engineer supporting federal government enterprise data programs

AWSETLPythonSparkSQL
Virginia