Can AI features run in an air-gapped project management system?
Many government bodies, banks and energy companies run project management systems on their own servers. Some do so on networks with no internet connection. When software vendors add AI features to their products, IT teams in these organisations find that most features do not work for them. The features send text to a model in the vendor's cloud.
Does this mean an air-gapped network cannot use AI? No. It means the model must run inside the network too.
Three things that must be inside the network
- The language model itself: it runs on your servers and sends no questions or documents outside. This is what we mean by an on-premises LLM.
- The search index: a searchable copy of tasks, comments and attachments that the model consults when answering. It contains the project data itself, so it must stay inside the network.
- The connection to the project tool: it reads data through the system's API inside the network, using an account with defined permissions. No outside service is involved.
If any of the three is outside the network, the system is not air-gapped, regardless of what the proposal says.
What works well inside the network
- Summaries of long tasks: a task with fifty comments is condensed into a paragraph explaining what was decided and what remains open.
- Status reports: a weekly report draft based on completed and overdue tasks, for the project manager to review before sending.
- Search by question: “Which projects are waiting on legal approval?” instead of testing filters one by one.
- Writing in Arabic: draft a task description or meeting minutes in Arabic or English. This matters when the team writes in both languages.
What will not work, and what to do about it
- AI features built into the vendor's product: they remain switched off if they rely on the vendor's cloud. The solution is a separate assistant layer that runs alongside the system and reads from it.
- Anything that needs information from the internet: such as web searches or retrieving prices from outside sources. These are deliberately out of scope.
- Automatic updates: the system has no connection from which to download new versions. Updates arrive in a signed package through your approved transfer process, as explained in what “air-gapped” really means.
Want to see Orchestra work on your own documents? Book a 30-minute call with one of our engineers
Start with permissions
In a project management system, employees do not all have access to every project. If the assistant reads all the data using one account and then answers everyone, it could expose a confidential project to someone without access, even inside an air-gapped network. The assistant should answer each person according to their own permissions, not the permissions of the account used to read the data. We explain this in detail in our post on permissions.
What to ask any vendor
- Where does the model run? Does it connect to any external service, even to validate the licence?
- Where are the index and the question-and-answer log kept?
- Does the assistant follow each user's permissions in the project tool?
- How are updates delivered, and who checks them before installation?
- How does the model handle the Arabic our team really uses?
Frequently asked questions
Can AI features operate in an air-gapped project management system?
Yes, provided the language model, search index and system connection all run within the network. Features that rely on the vendor's cloud will not work.
Do we need to replace our existing project tool?
No. The assistant works alongside the system and reads from it through its API, so your team can keep using the tool it knows.
Can the assistant edit or close tasks?
Only with your permission. It is best to begin with reading and suggestions, then introduce actions one at a time, with each action approved by a person and logged.
Written by Orchestra