The system is not enough
The developer(s) of the system as well as the people who are responsible for its day-to-day running should be legally accountable for anything directly or indirectly related with the system and its possible outcomes. Any system that can’t predict or define its outcomes doesn’t qualify as a system and needs urgent attention.
To run a system, we need operators. But to maintain a system, we may need people who are superior to a system and capable of updating it as and when required. There is nothing called an ultimate system and it is time that makes a system relevant or obsolete.