Community
Berth open-source tool lets a single RTX 4090 be shared between local AI engines
Berth is a system service that swaps and loads local AI engines such as llama-swap, strata and ComfyUI on one GPU, and can serve them as an API. The project is shared as a GitHub repo.