Community

Alternative approach: multi-tenant agent isolation

By Rachel Green6/18/2025

Feature request for multi-tenant support. Each tenant should have isolated agent environments.

👍 15👎 2💬 3 replies

Replies (3)

James Wilson
6/2/2025

This is a common problem. You need to properly dispose of model objects after inference. Use `del model` and `torch.cuda.empty_cache()` if using GPU.

👍 4👎 0
Rachel Green
6/26/2025

Been using this setup for 6 months now. The key is proper monitoring and alerting. Prometheus + Grafana works great.

👍 4👎 1
Anna Kowalski
7/3/2025

Another thing to consider is implementing proper logging. It helps tremendously with debugging production issues.

👍 2👎 1