AI Data Infrastructure & Vector Database Engineer
- Source: LinkedIn
- VariaCode
- Remote
- United States
- Mid level
Job Description
Senior AI Data Infrastructure & Vector Database Engineer
Location: LATAM (Remote)
🚀 About Variacode
At Variacode, we connect top-tier tech talent with cutting-edge global projects. We are currently looking for an ambitious, challenge-seeking Senior DevSecOps & Application Security Engineer to join a high-performing team building secure, automated cloud-native pipelines and resilient software architectures.
Our client’s technology is used in 80+ countries by Fortune 500 companies (like Home Depot), allowing millions of users to preview products in their own spaces in real-time. If you want to make a massive impact and work on high-traffic, scalable systems, this is your place!
🎯 The Role
Move beyond standard API wrappers and help us tackle complex data challenges in modern AI. As a Senior AI Data Infrastructure & Vector Database Engineer, you will own low-latency streaming pipelines and optimize specialized vector search engines, powering real-time enterprise retrieval at scale.
⚙️ What you will do (Responsibilities):
- Design and scale high-throughput data ingestion pipelines bridging corporate data platforms with specialized vector search engines.
- Fine-tune high-dimensional vector search indexing structures (HNSW, IVFFlat) to achieve top-tier query accuracy and sub-second execution.
- Integrate specialized vector stores (Pinecone, Qdrant, Milvus, ChromaDB, PGvector) directly into production RAG frameworks and streaming workflows.
- Build high-performance streaming pipelines using Apache Kafka, Spark Streaming, and optimized Python or C++ modules.
- Establish robust embedding versioning, index maintenance, and vector data governance to maintain peak performance.
- Collaborate cross-functionally with AI Engineers, Data Scientists, and Infrastructure leads to minimize latency under heavy concurrent loads.
🔍 What we are looking for:Must-haves (Required):
- Experience: 6 to 8+ years of professional software, data infrastructure, or AI systems engineering experience.
- Technical Stack & Tools: Pinecone, Qdrant, Milvus, PGvector, Apache Kafka, Spark Streaming, Python, C++, HNSW/IVFFlat indexing, and production RAG pipelines.
- Key Skills: Mastery of vector indexing, distributed data pipeline design, low-latency query tuning, and memory optimization.
- Language: Fluent English proficiency with excellent technical and conversational communication skills.
Nice-to-haves (Pluses):
- Exposure to hybrid search methodologies (combining sparse BM25 with dense vector retrieval) and re-ranking models.
- Hands-on experience with GPU acceleration (CUDA) or custom C++ routines for vector distance calculations.
- Familiarity with cloud-native container orchestration (Kubernetes, Docker) and Infrastructure as Code (Terraform).
🎁 What we offer:
- Opportunity to work with cutting-edge tech stacks and Fortune 500 clients.
- A highly collaborative, innovation-driven, and remote-first global culture.
- Continuous professional growth and career development pathways.
- Highly competitive USD-denominated compensation package tailored for senior security talent.
- 100% remote flexibility from anywhere in LATAM with aligned US business hours.
📋 What to Expect (Our Hiring Process):
We value your time and believe in a transparent, fast-moving recruitment journey. Here is what our process looks like:
- Application & AI Screening: Submit your application. Our smart screening tools match your profile against core job requirements.
- Recruiter Video Call (30 mins): A 1-on-1 video call with a Talent Acquisition Specialist to discuss your background, career goals, and cultural alignment.
- Variacode Internal Technical Assessment & System Design Interview: A practical technical evaluation followed by an architecture deep-dive conducted by Variacode’s internal Technical Lead team, focusing on System Design.
- 💡 Pro-tip for candidates: Be prepared to draw and explain architectural diagrams live during the interview, we recommend practicing beforehand with tools like draw.io or Lucidchart.
- Client / Partner Interview: Meet directly with the client’s engineering or leadership team to align on technical expectations, real-world project challenges, and team synergy.
- 📌 Note: Depending on the client’s internal process, they may request an additional client-specific technical assessment or coding exercise during this stage.
- **Offer & Onbo…
Skills
- qdrant
- Milvus
- Kafka
- Spark
- apache-spark-streaming
- Python
- cplusplus
- cuda
- Kubernetes
- Docker
- Terraform
