Excited to show you a new project I have been working on: the K8s Agent Orchestration Framework (KAOS) which helps you deploy and manage distributed multi-agent systems at scale If you want to support, do try it out, add an issue or give it a star!
The KAOS Framework addresses some of the pains of taking multi-agent / multi-tool / multi-model systems to hundreds or thousands of services. It started as an experiment to build agentic copilots, and has progressed as a fun endevour building distributed systems for A2A, MCP Servers, and model inference!
The initial release comes with a few key features including:
1) Golang control plane to manage Agentic CRDs;
2) Python data plane that implements a2a, memory, tool / model mgmt;
3) React UI for CRUD+debugging, and;
4) CI/CD setup with KIND/pytest/ginko/etc.
To be honest this project is solving the easy part, i.e. the compute where to run the agent. The part where the agent does something useful is like 99% of the value that unsolved for most organisations.
The KAOS Framework addresses some of the pains of taking multi-agent / multi-tool / multi-model systems to hundreds or thousands of services. It started as an experiment to build agentic copilots, and has progressed as a fun endevour building distributed systems for A2A, MCP Servers, and model inference!
The initial release comes with a few key features including:
1) Golang control plane to manage Agentic CRDs; 2) Python data plane that implements a2a, memory, tool / model mgmt; 3) React UI for CRUD+debugging, and; 4) CI/CD setup with KIND/pytest/ginko/etc.
Links & Resources:
Docs: https://axsaucedo.github.io/kaos/ Repo: https://github.com/axsaucedo/kaos UI: https://axsaucedo.github.io/kaos-ui/