Kong AI Gateway Sr Engineer
- Source: LinkedIn
- Apex Systems
- On-site
- Jersey City
- Senior
Job Description
Job#: 3047450 Job Description: Kong AI Gateway Sr Engineer
Location: Jersey City, New Jersey
Role Overview
We are seeking an experienced Senior AI Gateway Engineer to lead the architecture, engineering, security, and operational management of our enterprise AI Gateway platform, with a primary focus on Kong AI Gateway. This role will serve as the technical authority responsible for enabling secure, resilient, compliant, and scalable consumption of Large Language Models (LLMs) and other AI services. The successful candidate will combine expertise in Kong AI Gateway, cloud architecture, AI security, and identity management to deliver a highly available AI platform that meets the demands of a regulated financial services environment.
Key Responsibilities
- Design, implement, and evolve enterprise AI Gateway solutions using Kong AI Gateway and Kong Enterprise.
- Develop standardized onboarding patterns for applications, AI agents, and business services consuming AI.
- Engineer reusable integration patterns for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, Snowflake Cortex, and other AI services.
- Implement intelligent model routing, failover, traffic shaping, and provider abstraction.
- Develop custom Kong plugins and integrations supporting AI-specific governance and security requirements.
- Architect and implement enterprise-grade identity controls for AI platforms, including OAuth 2.0, OIDC, JWT, and mTLS.
- Implement AI security guardrails, policy enforcement, and controls for prompt injection protection, DLP, and PII redaction.
- Design highly available and resilient AI platform architectures, including multi-region and cross-cloud recovery patterns.
- Integrate AI Gateway services with cloud platforms such as Microsoft Azure, Amazon Web Services (AWS), and Snowflake.
- Build enterprise observability capabilities for AI workloads, including monitoring, metrics, tracing, and audit logging.
Required Qualifications Education: A Bachelor’s degree in Computer Science, Cyber Security, Information Technology, Engineering, or a related discipline is required.
Experience:
- 8+ years of experience designing and operating enterprise API, application, or cloud platforms.
- 5+ years of experience in cloud architecture and security.
- 3+ years working with AI/ML platform technologies or enterprise AI deployments.
- Hands-on experience implementing and managing Kong Gateway and Kong Enterprise solutions.
- Experience within regulated industries such as financial services, banking, insurance, or capital markets is strongly preferred.
Preferred Qualifications
- Master’s degree in a relevant field.
- Kong Certified Professional certification.
- AWS Solutions Architect or Microsoft Azure Solutions Architect certification.
- CISSP, CCSP, or equivalent security certification.
- Experience implementing AI security controls and governance frameworks.
- Familiarity with NIST AI RMF, NIST 800-53, NYDFS 500, PCI DSS, SOC 2, and other financial services regulatory requirements.
- Experience with DSPM, DLP, and enterprise data protection controls.
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico. Everforth Apex uses a virtual recruiter as part of the application process. Click here for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at https://www.apexsystems.com/privacy-policy *Everforth Apex Benefits Overview: Everforth Apex offers a range of supplemental benefits, including medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection. We offer an ESPP (employee stock purchase …
Skills
- microsoft-azure
- amazon-web-services
- bedrock
- Snowflake
- cortex
- oauth
- guardrails
- azure-arc
You missed this one - but you don't have to keep missing out. Try Club members get matched with open opportunities before they're gone, so you're always first in line, never last.
