We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent

Flink Manager

Content Marketing ManagerContent Marketing ManagerFull TimeRemoteTeam 11-50Since 2021H1B No SponsorCompany Site LinkedIn

Location

United States

Posted

17 days ago

Salary

Not specified

English

Job Description

This role is for one of the Weekday's clientsa

Salary range: Rs 10000000 - Rs 40000000 (ie INR 100 - 400 LPA)

Min Experience: 8 years

Location: United States

JobType: full-time

As a Flink Manager, you will be responsible for driving real-time streaming initiatives, managing high-performing engineering teams, and architecting scalable data solutions that power mission-critical business applications. You will collaborate closely with product, analytics, infrastructure, and leadership teams to translate business requirements into resilient streaming architectures.

Job Requirements

Key Responsibilities
Lead the design, development, and deployment of real-time data processing pipelines using Apache Flink.
Architect scalable, fault-tolerant, and low-latency streaming systems leveraging Flink’s DataStream and Table APIs.
Manage end-to-end lifecycle of Flink applications including development, testing, optimization, monitoring, and production support.
Drive best practices for state management, checkpointing, windowing, event-time processing, and fault tolerance in Flink.
Optimize Flink job performance, resource allocation, and cluster tuning for high-throughput environments.
Oversee integration of Flink with distributed systems such as Kafka, data lakes, warehouses, and microservices.
Lead and mentor a team of data engineers, conducting code reviews and enforcing engineering excellence standards.
Collaborate with DevOps teams to manage Flink deployments on cloud and on-prem environments.
Establish monitoring, logging, and alerting mechanisms for streaming pipelines to ensure high availability and reliability.
Contribute to roadmap planning for streaming and real-time analytics platforms.
Required Qualifications
8–12 years of overall experience in data engineering, distributed systems, or backend engineering.
Strong hands-on expertise in Apache Flink (minimum 3–5 years preferred).
Deep understanding of stream processing concepts including event-time semantics, watermarking, state backends, and exactly-once guarantees.
Proven experience designing and managing high-throughput, low-latency Flink pipelines.
Strong programming skills in Java or Scala for Flink development.
Experience with distributed messaging systems (e.g., Kafka) and data storage systems.
Familiarity with cluster resource management frameworks (YARN, Kubernetes, or similar).
Strong debugging, troubleshooting, and performance tuning skills specific to Flink workloads.
Experience leading engineering teams and managing cross-functional stakeholders.
Preferred Qualifications
Experience deploying Flink in cloud environments (AWS, Azure, or GCP).
Knowledge of batch and stream unification architectures.
Exposure to big data ecosystems including Hadoop or Spark.
Understanding of CI/CD practices for streaming applications.
Experience implementing real-time analytics, fraud detection, personalization, or IoT streaming use cases.
Leadership Expectations
The ideal candidate is a strategic thinker and technical leader who can balance hands-on involvement with managerial responsibilities. You will champion best practices in Flink architecture, ensure production stability, and drive continuous improvement across streaming platforms.