Allwyn Corporation

People - Process - Technology

Senior Data Engineer – ML Engineer

Data EngineerData EngineerFull TimeRemoteTeam 51-200Since 2003H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

130 days ago

Salary

$110K - $120K / year

Bachelor Degree6 yrs expEnglishAmazon RedshiftAWSCloudETLKafkaPythonPy TorchScikit LearnSQLTensorflow

Job Description

• Demonstrate expert ability in implementing data warehouse solutions using Snowflake. • Building data integration solutions between transaction systems and analytics platform. • Expand data integration solutions to ingest data from internal and external sources and to further transform as per the business consumption needs. • Create security policies in Snowflake to manage fine grained access control • Develop tasks for a multitude of data patterns, e.g., real-time data integration, advanced analytics, machine learning, BI and reporting. • Lead POC efforts to build foundational AI/ML services for Predictive Analytics. • Building of data products by data enrichment and ML. • Be a team player and share knowledge with the existing team members. • Demonstrated ability to be self-directed with excellent organization, analytical and interpersonal skills, and consistently meet or exceed deadline deliverables. • Strong communication skills to facilitate meetings and workshops to collect data, functional and technology requirements, document processes, data flows, gap analysis, and associated data to support data management/governance related efforts. • Knowledge and understanding of data standards and principles to drive best practices around data management activities and solutions. • Strong understanding of the importance and benefits of good data quality, and the ability to champion results across functions. • Experience with one or more data integration tools viz. Attunity (Qlik), AWS Glue ETL, Talend, Kafka etc. • Strong understanding of data security – authorization, authentication, encryption, and network security. • Ability to lead collaborative meetings which result in clearly documented outcomes, a concrete understanding of meeting attendee performance/reliability, and ongoing management & follow-up for action items. • Acts with integrity and proactively seeks ways to ensure compliance with regulations, policies, and procedures.

Job Requirements

  • Bachelor’s degree in computer science or a related field
  • Minimum of 6-8 years of experience in building data driven solutions.
  • Expertise in real-time data solutions, good-to-have knowledge of streams processing, Message Oriented Platforms and ETL/ELT Tools.
  • Strong scripting experience using Python and SQL
  • Working knowledge of foundational AWS compute, storage, networking and IAM.
  • Solid scripting experience in AWS using lambda functions. Good to have knowledge of CloudFormation template. Overall experience with AWS services should be over three years.
  • Hands on experience with popular cloud-based data warehouse platforms, viz. Redshift, Snowflake.
  • Experience in building data pipelines with related understanding of data ingestion, transformation of structured, semi-structured and unstructured data across cloud services
  • Hands on experience in using and extending machine learning framework and libraries, e.g, scikit-learn, PyTorch, TensorFlow, XGBoost etc.
  • Experience with AWS SageMaker family of services or similar tools to develop machine learning models.
  • Understanding of Gen AI models, prompt engineering, RAG, fine tuning and pre-tuning will be a plus.

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Architect

Innowhyte Inc

Driven by Why, Powered by Patterns.

Data Engineer131 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Data Engineering Lead/Architect designing scalable data pipelines for analytics.

AirflowApacheAWSAzureCloudETLGoogle Cloud PlatformKafkaPandasPySparkPythonSpark
United States

Data Engineer

Global Channel Management, Inc.

Leveraging technology. Building relationships.

Data Engineer131 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Remote Data Engineer focusing on GCP and data pipelines in Santa Clara, CA

AirflowApacheCloudGoogle Cloud PlatformPythonSQL
California

Salesforce Data Architect

Agility Technologies Inc

Delivering next generation customer experience

Data Engineer131 days ago
Full TimeRemoteTeam 11-50Since 2004H1B Sponsor

Salesforce Data Architect managing data architecture and integration within Salesforce

United States
$95K - $135K / year

Staff Data Architect

Kohl's

It’s no secret that our associates love #LifeAtKohls and we know you will too.

Data Engineer131 days ago
Full TimeRemoteTeam 10,001+Since 1962H1B No Sponsor

Staff Data Architect overseeing enterprise data architecture at Kohl's

AirflowAmazon RedshiftBigQueryCloudGoogle Cloud PlatformKafkaPythonSparkSQL
Wisconsin