By the DIMSI team
DIMSI, diamond sponsor of the CloudStack Collaboration Conference, shares its decade-long commitment to the Apache CloudStack community and introduces AI as a Service, its new project for local, sovereign AI deployment.
DIMSI: an active member of the Apache CloudStack community for more than 10 years
Once again, DIMSI is proud to be a Diamond Sponsor of the upcoming CCC in Scotland.
Every year, DIMSI’s teams help many organisations move to Apache CloudStack, from deployment to day-to-day support. These organisations want to take back control of their infrastructure: to know where their data lives, who manages it, and to depend on no one to keep it.
The same question, now with AI
The rise of AI, and the many ways people use it, led us to look for a solution that fits our view of digital: controlled, sovereign and open source.
These companies chose CloudStack to stay in control of their infrastructure. Why give that up the moment they start using AI? Handing your documents and questions to an outside service, with no idea what it does with them, takes you straight back to square one.
AI as a Service
We are happy to introduce AI as a Service, a project for deploying AI locally. With it, companies stay sovereign in how they use AI: the models run on their own servers, and the data stays in-house.
The project is built on a repository of open-source models. The company picks the model that suits it, and the solution first checks that it fits on the target machine. No bad surprises after installation.
Deployment has to be reliable and fast. On a single server, the AI is up in a few commands. On a fleet of virtual machines, the solution writes an install script, so every new machine boots with its AI already in place. The model and the interface can also run on two separate machines.
Once it’s running, the AI is shared in two ways:
- For teams, a chat interface, LibreChat, connected automatically to the deployed models. The model is installed, the interface sees it, and people can start talking to it.
- For applications, secure access protected by a key, so the company’s own tools can query the models directly.
Adding a model, removing one, uninstalling everything: each step takes a single command. And because we didn’t want to reinvent anything, the solution brings together existing open-source software, each piece under its own licence.
Let’s talk in Scotland
Paul and Matthias will present AI as a Service during their talk on Thursday 19th November, 14:50-15:20, room Prestonfield. Bring your questions and your use cases.
DIMSI — Diamond Sponsor of the CloudStack Collaboration Conference
