Software Engineer 2, AI Gateway
Salva questo lavoro e mantieni la tua ricerca organizzata
Crea un account gratuito per salvare lavori, creare avvisi e tornare a questa inserzione dalla tua dashboard.
Continuando accetti i nostri Termini & Informativa sulla privacy.
Join the AI Gateway engineering team to help build and evolve Kong's API management stack for AI and LLM workloads. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, partnering with a distributed team to deliver reliable, low-latency capabilities. You’ll work on proxying, load balancing, and platform integrations, driving performance and robustness. This role offers the chance to influence how enterprises govern AI-driven API traffic at scale. A strong candidate brings hands-on systems expertise and a proactive, ownership-driven approach.
Retribuzione / Benefits- Equity
- Bonus
- Health, dental, and vision insurance
- Paid holidays and PTO
- Professional development opportunities
- Build and maintain API management software for AI/LLM stacks
- Develop features such as proxying, load balancing, and database support for Kong AI Gateway
- Troubleshoot bugs, tune performance, and perform low-level optimizations
- Bridge Kong with third-party deployment platforms and tooling
- Handle additional tasks as assigned by management
- 3+ years of server-side programming
- Hands-on experience with Golang or Rust
- Proven ability to build and debug highly scalable, distributed, reliable systems
- Strong Linux systems troubleshooting and profiling skills
- Experience with distributed systems and Linux networking on L7/L4
- Comfortable working in a globally distributed team
- Strong ownership and communication skills (documentation written by engineers)
- Familiarity with AI/LLM concepts
- ownership
- clear written and verbal communication
- collaboration in a distributed team
- Golang
- Rust
- Linux systems programming and profiling