Pre-training Data Infrastructure Engineer

Company hidden

San Francisco, CA Posted 30+ days ago

RESPONSIBILITIES * Design and implement data processing infrastructure for large language model training (highly performant, reproducible, traceable) * Develop and maintain core processing primitives (e.g., tokenization, deduplication, chunking) with a focus on scalability * Build robust systems for data quality assurance and validation at scale * Collaborate with research teams to implement novel data processing architectures * Build and operate end-to-end data pipelines that turn raw web-scale corpora into training-ready datasets YOU MAY BE A GOOD FIT IF YOU HAVE: * 5+ YOE outside…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

See how well you match this job

Upload your resume and we’ll score your fit for this role — then tailor your CV to it with AI. Free, no credit card.

Check your match

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.