NBCUniversal
Here you can create the extraordinary. Join us.
Senior Staff Data Engineer
Location
New York
Posted
89 days ago
Salary
$150K - $185K / year
Bachelor Degree10 yrs expEnglishAWSETLLinuxPandasPythonScalaSparkSQLTableau
Job Description
• Designs, builds, and oversees the deployment and operation of technology architecture, solutions and software to capture, manage, store, and utilize structured and unstructured data
• Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
• Develops technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques to cleanse, organize and transform data
• Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies
• Creates and establishes design standards and assurance processes for software, systems, and applications development
• Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage
• Design, develop, and maintain CI/CD pipelines using GitHub Actions to automate deployment, testing, and monitoring of applications.
• Implement and manage serverless solutions
• Implement infrastructure as code (IaC) practices
• Work with development teams to set up automated testing frameworks
• Understands the basics of relational data modeling
Job Requirements
- Strong Computer Science/Engineering/Information Systems background
- 10+ Years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL, and Data Warehouse methodologies and technologies.
- 5+ years experience with AWS technologies.
- Strong experience using Python and Pandas in an AWS Lambda framework is highly desired.
- Experience using EMR and/or DataBricks or the ability to read EMR code and translate it into Lambdas.
- Proven experience (3+ years) in designing and managing CI/CD pipelines, specifically using GitHub Actions.
- Demonstrated experience with Python, APIs, Spark, and Scala.
- Experience with advanced SQL, Linux, MicroStrategy, Tableau, and Pandas.
- Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 10+ years of relevant experience.
Benefits
- medical, dental and vision insurance
- 401(k)
- paid leave
- tuition reimbursement
- a variety of other discounts and perks
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer89 days ago
Full TimeRemoteTeam 51-200Since 2020H1B No Sponsor
Analytics Data Engineer transforming data into insights for a digital banking startup
Amazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonSQLTableau
New York
Data Engineer89 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor
Ensure reliability and accuracy of Veeva AI Agents through evaluation methodologies
Python
ETL Data Engineer
ComPsychThe World’s Largest Provider of Mental Health Services and GuidanceResources® for Life.
Data Engineer89 days ago
Full TimeRemoteTeam 1,001-5,000Since 1984H1B Sponsor
Open this job to view full details and requirements.
AzureETLNoSQLPythonSDLCSQL
AI Knowledge Data Engineer
iBusiness FundingHelping to provide capital in an efficient and transparent manner to every small and medium-sized business in America.
Data Engineer91 days ago
Full TimeRemoteTeam 201-500Since 2013H1B No Sponsor
AI Knowledge Data Engineer designing and implementing state-of-the-art AI systems
AirflowElasticSearchPythonPyTorchSparkTensorflow