AI Data Engineer - WFH
- Source: LinkedIn
- Torentify
- Remote
- United States
- Full-Time
- Mid level
Job Description
About the Company
Bright Vision Technologies is a technology consulting and software development company that delivers cloud, artificial intelligence, data, and enterprise solutions across the United States.
About the Role
Bright Vision Technologies is seeking an AI Data Engineer to build and operate large-scale data systems supporting AI training, evaluation, and continuous improvement. The role combines data engineering and software development, with a focus on data ingestion, transformation, quality assurance, lineage, and high-throughput delivery across multiple data types.
The ideal candidate has 10+ years of data engineering experience, including significant work supporting AI or machine learning workloads. Experience with petabyte-scale systems, distributed processing, and reliable data infrastructure is important for improving model quality and training efficiency.
Key Responsibilities
- Design and operate large-scale data pipelines for AI training, evaluation, and continuous improvement.
- Build ingestion systems for text, images, audio, video, and structured data.
- Implement data cleaning, deduplication, filtering, and quality assurance at petabyte scale.
- Develop dataset versioning, lineage, and provenance tracking to support reproducible AI training.
- Build high-throughput data loading systems that help maximize GPU utilization during training.
- Implement labeling workflows, active learning pipelines, and human-in-the-loop data improvement systems.
- Design storage architectures that balance cost, throughput, and latency across different storage tiers.
- Develop evaluation dataset pipelines with data integrity and contamination controls.
- Implement data privacy, redaction, and consent enforcement throughout data pipelines.
- Collaborate with machine learning researchers and engineers to align data infrastructure with model development requirements.
- Monitor data quality, data drift, and pipeline health across AI data systems.
- Optimize pipeline cost and performance through compression, data format selection, and caching.
- Maintain technical documentation, data schemas, and operational procedures.
- Stay informed about AI data infrastructure research and emerging open-source tools.
Required Qualifications
- Bachelor’s or Master’s degree in Computer Science or a related field.
- At least 10 years of data engineering experience, including significant experience supporting AI or machine learning workloads.
- Strong proficiency in Python and at least one JVM-based or systems programming language.
- Experience with modern data processing frameworks such as Spark, Ray, or Beam.
- Hands-on experience operating petabyte-scale storage and data pipeline systems.
- Strong understanding of distributed systems, data modeling, and storage formats.
- Experience with dataset versioning, lineage, and reproducibility for machine learning workflows.
- Familiarity with high-throughput data loading for accelerator-based training.
- Strong software engineering practices, including testing, CI/CD, and code review.
- Excellent communication and cross-functional collaboration skills.
Preferred Qualifications
- Experience working with large-scale multimodal datasets.
- Familiarity with data quality tools and dataset evaluation methodologies.
- Exposure to privacy-preserving data systems and regulated data handling.
- Contributions to open-source data infrastructure projects.
- Experience supporting frontier model training pipelines.
Location and Work Arrangement
- Fully remote position within the United States.
- Full-time, direct W-2 employment.
Compensation and Eligibility
- Annual salary range: $100,000–$150,000.
- U.S. citizens, Green Card holders, EAD holders, and candidates eligible for H-1B transfers are encouraged to apply.
- New H-1B visa petitions cannot be sponsored for this position.
Equal Employment Opportunity
Bright Vision Technologies (BV Teck) is an Equal Opportunity Employer. The company prohibits discrimination and harassment based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other status protected by applicable federal, state, or local laws. This commitment applies to all aspects of employment, including hiring, training, compensation, promotion, and termination.
Skills
- drift
- Python
- Spark
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
