Choosing LLM Deployment Strategy for Nextcloud¶

The Nextcloud integration_openai application enables powerful AI features by connecting to Large Language Models (LLMs). This article is focusing on OpenAI compatible APIs rather than the official OpenAI services.

Since it is difficult to predict what the load will be in each specific case with AI, and it will not always correlate with the number of users on the instance, we will consider use cases for instances of all sizes. Choosing the right backend depends on your specific requirements for data privacy, budget, scalability and technical expertise.