Software Engineer AI Gateway

2 giorni fa

Pavia, Lombardia, Italia Kong Tempo pieno
Overview

In this role you join the AI Gateway Engineering Team to build and evolve the Kong AI gateway. You will tackle multi-LLM routing, semantic routing, and performance-focused features that power AI-enabled workflows. You will contribute to a scalable API management stack, bridging Kong with third-party deployment platforms, and drive reliability at scale. This role offers hands-on development, optimization, and cross-functional collaboration in a mission-driven, innovative environment. You will help shape how organizations govern AI and LLM-based innovation.

Responsabilità
  • Build and maintain API management software for AI/LLMs and its underlying stack
  • Implement features like proxying, load balancing, and databases support for Kong AI Gateway
  • Troubleshoot bugs, tune performance, and perform low-level optimizations
  • Bridge Kong with third-party deployment platforms and tooling
  • Handle additional tasks as directed by management
Requisiti fondamentali
  • 3+ years of server-side application and component development
  • Hands-on experience with Golang or Rust
  • Experience building and debugging highly scalable, distributed, reliable systems
  • Strong Linux systems troubleshooting and profiling skills
  • Knowledge of distributed systems and Linux networking; API exposure on L7/L4
  • Comfortable working with a remotely distributed team
  • Strong ownership and communication skills; experience documenting products
  • Familiarity with AI/LLM concepts and applications development
  • strong communication
  • ownership
  • collaboration
  • Golang or Rust
  • Linux troubleshooting and profiling
  • distributed systems