AI Data Engineer

Job Description

Hi,

We have a position which is suitable to your skillset. Please go through the below JD and let me know your interest.

Title : AI Data Engineer

Location : Canada

Relevant Experience (in Yrs.): 8+ years

Detailed Job Description:

What You Will Do

• Data Pipelines: Build ETL flows for structured/unstructured data, ensuring normalization, deduplication, and semantic consistency.

• Vector Infrastructure: Manage pgvector, Azure AI Search, Redis vector indexing, and hybrid search layers.

• Data Governance: Implement zero-trust access, privacy controls, and compliance within AI context pipelines.

• Real-time Processing: Build event-driven architectures that continuously refresh embeddings and indexes.

Required Qualifications

• Deep experience with distributed data systems, SQL, and orchestration tools.

• Experience tuning high-throughput database infrastructure.

• Knowledge of Google’s GECX is a plus.

• Familiarity with chunking strategies and embedding models.

Skillset Requirements

• ETL & Data Modelling: Designing pipelines for structured/unstructured data, normalization, deduplication, and semantic consistency.

• Vector Databases: pgvector, Redis, Azure AI Search, hybrid search, and index optimization.

• Distributed Data Systems: Kafka, Spark, Flink, or similar event-driven architectures.

• Data Governance: Zero-trust access, privacy controls, compliance, and auditability.

Real-time Embedding Updates: Event-driven refresh pipelines for RAG and agent memory

systems.

• Chunking & Embeddings: Semantic chunking, metadata tagging, and embedding model

selection.

• Search Infrastructure: BM25, hybrid search, inverted indexes, and ranking algorithms.

• Performance Tuning: High-throughput read/write optimization.

• Data Quality & Lineage: Validation, schema enforcement, and lineage tracking (e.g., Great

• Expectations, Open Lineage).

Thanks & Regards

Venkatesh Kundurthi

**Recruitment Manager ASCII Group, LLC**

Office: (248)-476-7600 Ext. 104; Direct: +1 469 663 0625

38345 W. 10 Mile Rd, Ste.#365; Farmington, MI 48335

Website: www.asciigroup.com