https://bentoml.com/
https://github.com/bentoml/OpenLLM

2024
https://www.bentoml.com/blog/from-ollama-to-openllm-running-llms-in-the-cloud