NBCUniversal

Here you can create the extraordinary. Join us.

Senior Staff Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 10,001+Since 2004H1B SponsorCompany SiteLinkedIn

Location

New York

Posted

89 days ago

Salary

$150K - $185K / year

Bachelor Degree10 yrs expEnglishAWSETLLinuxPandasPythonScalaSparkSQLTableau

Job Description

• Designs, builds, and oversees the deployment and operation of technology architecture, solutions and software to capture, manage, store, and utilize structured and unstructured data • Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions • Develops technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques to cleanse, organize and transform data • Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies • Creates and establishes design standards and assurance processes for software, systems, and applications development • Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage • Design, develop, and maintain CI/CD pipelines using GitHub Actions to automate deployment, testing, and monitoring of applications. • Implement and manage serverless solutions • Implement infrastructure as code (IaC) practices • Work with development teams to set up automated testing frameworks • Understands the basics of relational data modeling

Job Requirements

  • Strong Computer Science/Engineering/Information Systems background
  • 10+ Years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL, and Data Warehouse methodologies and technologies.
  • 5+ years experience with AWS technologies.
  • Strong experience using Python and Pandas in an AWS Lambda framework is highly desired.
  • Experience using EMR and/or DataBricks or the ability to read EMR code and translate it into Lambdas.
  • Proven experience (3+ years) in designing and managing CI/CD pipelines, specifically using GitHub Actions.
  • Demonstrated experience with Python, APIs, Spark, and Scala.
  • Experience with advanced SQL, Linux, MicroStrategy, Tableau, and Pandas.
  • Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 10+ years of relevant experience.

Benefits

  • medical, dental and vision insurance
  • 401(k)
  • paid leave
  • tuition reimbursement
  • a variety of other discounts and perks

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer89 days ago
Full TimeRemoteTeam 51-200Since 2020H1B No Sponsor

Analytics Data Engineer transforming data into insights for a digital banking startup

Amazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonSQLTableau
New York

AI Data Engineer

Veeva Systems

The Industry Cloud for Life Sciences

Data Engineer89 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

Ensure reliability and accuracy of Veeva AI Agents through evaluation methodologies

Python
Massachusetts
$85K - $225K / year

ETL Data Engineer

ComPsych

The World’s Largest Provider of Mental Health Services and GuidanceResources® for Life.

Data Engineer89 days ago
Full TimeRemoteTeam 1,001-5,000Since 1984H1B Sponsor

Open this job to view full details and requirements.

AzureETLNoSQLPythonSDLCSQL
United States
$115K - $135K / year

AI Knowledge Data Engineer

iBusiness Funding

Helping to provide capital in an efficient and transparent manner to every small and medium-sized business in America.

Data Engineer91 days ago
Full TimeRemoteTeam 201-500Since 2013H1B No Sponsor

AI Knowledge Data Engineer designing and implementing state-of-the-art AI systems

AirflowElasticSearchPythonPyTorchSparkTensorflow
Florida
$180K - $240K / year