Reddit, Inc.

Dive into anything

Senior Research Engineer – Post-training, Evaluation

Research EngineerResearch EngineerFull TimeRemoteTeam 501-1,000Since 2005H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

28 days ago

Salary

$216.7K - $303.4K / year

Postgraduate Degree4 yrs expEnglishPythonPy Torch

Job Description

• Architect and maintain the "Reddit Benchmark" evaluation suite: A comprehensive harness that rigorously tests model capabilities across Safety, Reasoning, and Reddit-specific knowledge (slang, norms). • Build scalable SFT (Supervised Fine-Tuning) pipelines: Implement efficient, distributed training loops for instruction tuning, converting raw base models into helpful assistants. • Develop Model-as-a-Judge systems: Engineer automated evaluation pipelines using strong models (e.g., GPT-5, Nova, Claude) to grade the outputs of our internal models, enabling rapid iteration cycles. • Execute Synthetic Data generation strategies: Create and curate high-quality instruction sets to improve model generalization where human data is scarce. • Collaborate with Safety Engineering: Translate high-level safety policies into concrete evaluation metrics and unit tests that run in our CI/CD pipelines. • Debug post-training instability: Dive deep into loss curves and evaluation logs to identify when fine-tuning is causing alignment tax or capability degradation.

Job Requirements

  • 4+ years of professional experience in machine learning engineering, with a focus on LLM fine-tuning or evaluation.
  • Fluency in Python and PyTorch, with experience using libraries like Hugging Face Transformers, vLLM, or lm-eval-harness.
  • Deep understanding of Instruction Tuning (SFT) and how data quality impacts model behavior.
  • Experience building Evaluation Pipelines: You know the difference between MMLU, GSM8K, and how to build a custom domain-specific benchmark.
  • Familiarity with distributed training (FSDP/DeepSpeed) for fine-tuning jobs.
  • Strong data engineering skills for curating and cleaning instruction datasets.

Benefits

  • Comprehensive Healthcare Benefits and Income Replacement Programs
  • 401k with Employer Match
  • Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
  • Family Planning Support
  • Gender-Affirming Care
  • Mental Health & Coaching Benefits
  • Flexible Vacation & Paid Volunteer Time Off
  • Generous Paid Parental Leave

Related Categories

Related Job Pages

More Research Engineer Jobs

Research Engineer Intern

GenBio AI

GenBio.AI, Inc. (GenBio AI) is an innovative global startup dedicated to developing the world's first AI-driven Digital Organism, an integrated system of multiscale foundation models for predicting, simulating, and programming biology at all levels. Our goal is to achieve comprehensive, actionable empirical understandings of the mechanisms underlying all organismal physiologies and diseases. This will pave the way for a new paradigm in drug design, bio-engineering, personalized medicine, and fundamental biomedical research, all powered by Generative Biology. Our founding team consists of world-renowned scientists and researchers in AI and Biology from prestigious institutions such as CMU, MBZUAI, WIS, alongside prominent financial investors. GenBio AI, a true global effort from day one, is establishing offices in Palo Alto, Paris, and Abu Dhabi.

Research Engineer31 days ago
InternshipRemoteTeam 29Since 2024

Conduct cutting-edge research in AI and computational biology, improve models, design experiments, and analyze datasets with a focus on AI capabilities in biology.

C/C++CudaDeepspeedHugging FaceJaxMegatron-LmPythonPyTorch
California

ML Research Engineer - GPUs go Brrr

Achira

Achira is building atomistic foundation simulation models to power the future of drug discovery.

Research Engineer31 days ago
Full TimeRemoteTeam 12Since 2024

Join a team to engineer high-efficiency deep learning architectures for molecular machine learning, focusing on optimization and scaling across GPUs for drug discovery.

CudaGnnsGraph TransformersJaxNvidia WarpPyTorchTensorrtTorchinductorTriton
California

Senior Research Engineer

Mem0

The memory layer for Personalized AI

Research Engineer33 days ago
Full TimeRemoteTeam 12Since 2023

As a Senior Research Engineer, you'll lead the lifecycle of memory features, fine-tune models, conduct research validations, and collaborate with engineering and stakeholders to optimize products and solutions at scale.

PythonPyTorchVllm
California

Research Engineer - Level 2

Oregon Health & Science University Foundation

We advance OHSU’s mission by igniting the power of philanthropy.

Research Engineer36 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Research Engineer developing software applications for clinical informatics at OHSU

JavaJavaScriptjQueryMS SQL ServerMySQLPostgresSpringSQL.NET
United States
$81.6K - $130.4K / year