Software Engineer AI Gateway

2 giorni fa

Pavia PV, Provincia di Pavia; Lombardia, Italia Kong Tempo pieno

Overview

In this role you join the AI Gateway Engineering Team to build and evolve the Kong AI gateway. You will tackle multi-LLM routing, semantic routing, and performance-focused features that power AI-enabled workflows. You will contribute to a scalable API management stack, bridging Kong with third-party deployment platforms, and drive reliability at scale. This role offers hands-on development, optimization, and cross-functional collaboration in a mission-driven, innovative environment. You will help shape how organizations govern AI and LLM-based innovation.

Responsabilità

  • Build and maintain API management software for AI/LLMs and its underlying stack
  • Implement features like proxying, load balancing, and databases support for Kong AI Gateway
  • Troubleshoot bugs, tune performance, and perform low-level optimizations
  • Bridge Kong with third-party deployment platforms and tooling
  • Handle additional tasks as directed by management

Requisiti fondamentali

  • 3+ years of server-side application and component development
  • Hands-on experience with Golang or Rust
  • Experience building and debugging highly scalable, distributed, reliable systems
  • Strong Linux systems troubleshooting and profiling skills
  • Knowledge of distributed systems and Linux networking; API exposure on L7/L4
  • Comfortable working with a remotely distributed team
  • Strong ownership and communication skills; experience documenting products
  • Familiarity with AI/LLM concepts and applications development
  • strong communication
  • ownership
  • collaboration
  • Golang or Rust
  • Linux troubleshooting and profiling
  • distributed systems