Incident: Future of Agriculture Software Contract in Doubt: Quality Standard Issues

Published Date: 2020-02-13

Postmortem Analysis
Timeline 1. The software failure incident happened in April 2016 [96187].
System 1. Northern Ireland Food Animal Information System (NIFAIS) [96187]
Responsible Organization 1. AMT Sybex - The company responsible for developing the new software system for tracing animal movements and disease faced issues with the quality standard of the software, leading to significant defects and delays in the implementation [96187].
Impacted Organization 1. Agriculture industry in Northern Ireland [96187]
Software Causes 1. The software received from the company responsible for the new system was not up to the "quality standard" [Article 96187].
Non-software Causes 1. Lack of quality standard in the software received from the company responsible [96187] 2. Significant issues that delayed the continued roll-out of the new system [96187] 3. Ongoing discussions about a rectification plan between the company and the department [96187] 4. Commercial sensibilities affecting decision-making regarding the implementation of the system [96187]
Impacts 1. Delays in the continued roll-out of the new system for tracing animal movements and disease, leading to doubts about the future of the software contract [96187]. 2. The existing traceability system, meant to be replaced by the new system, was deemed "fit for purpose," indicating a lack of improvement or potential regression in functionality [96187]. 3. Significant financial investment of £10.9m by the Department of Agriculture on the new system since April 2016 with concerns raised about the quality standard of the software received from the company responsible [96187]. 4. The new software was reported to have a "high level of defects," indicating a lack of quality and reliability in the delivered product [96187].
Preventions 1. Thorough software testing before implementation could have prevented the software failure incident [96187]. 2. Ensuring clear communication and requirements between the government department and the software company could have helped in avoiding issues with the software quality [96187]. 3. Regular monitoring and evaluation of the software development progress could have identified any potential issues early on, allowing for timely corrections [96187].
Fixes 1. Conduct a thorough review and assessment of the software development process and quality assurance practices to identify and address the root causes of the defects [96187]. 2. Collaborate closely with the software vendor, AMT Sybex, to work on a comprehensive rectification plan to resolve the issues and improve the quality standard of the software [96187]. 3. Ensure transparent communication and coordination between the Department of Agriculture, Environment and Rural Affairs (Daera) and the software vendor to facilitate the successful implementation of the new system [96187].
References 1. Department of Agriculture, Environment and Rural Affairs (Daera) official Brian Doherty 2. Northern Ireland Assembly's Agriculture Committee 3. AMT Sybex company 4. Agriculture Minister Michelle McIlveen 5. Committee chairman Declan McAleer

Software Taxonomy of Faults

Category Option Rationale
Recurring one_organization (a) The software failure incident at AMT Sybex seems to be a recurring issue within the same organization. The article mentions that the new software system developed by AMT Sybex for tracing animal movements and disease had significant issues and was not up to the quality standard. The company was working to resolve these issues, and there were ongoing discussions about a rectification plan [96187]. (b) There is no specific mention in the article about similar software failure incidents happening at other organizations.
Phase (Design/Operation) design, operation (a) The software failure incident in the article is related to the design phase. The article mentions that the new system developed by AMT Sybex to trace animal movements and disease had significant issues that delayed its roll-out. The Department of Agriculture official mentioned that the software received from the company responsible had not been up to the "quality standard," indicating a failure in the design or development phase [96187]. (b) The software failure incident in the article is also related to the operation phase. The article highlights that the new software had a "high level of defects," which suggests that there were issues with the operation or functioning of the system itself. Additionally, the delays in the roll-out of the new system could be attributed to operational challenges faced during its implementation [96187].
Boundary (Internal/External) within_system (a) within_system: The software failure incident mentioned in the article is primarily attributed to issues within the system itself. The Department of Agriculture, Environment and Rural Affairs (Daera) official Brian Doherty highlighted that the software received from the company responsible had not been up to the "quality standard" and that there were ongoing discussions about a "rectification plan" to address the defects [96187]. Additionally, the chairman of the committee, Mr. McAleer, expressed shock at the high level of defects in the new software system [96187]. (b) outside_system: There is no explicit mention in the article of contributing factors originating from outside the system that led to the software failure incident.
Nature (Human/Non-human) non-human_actions (a) The software failure incident in the article seems to be primarily related to non-human actions, specifically issues with the software itself. The article mentions that the software received from the company responsible had not been up to the "quality standard" and that there were ongoing discussions about a "rectification plan" to resolve the issues [96187]. (b) While the article does not explicitly mention any specific human actions contributing to the software failure incident, it does highlight that the new software had a "high level of defects" which could potentially be attributed to human factors such as inadequate testing, development processes, or oversight [96187].
Dimension (Hardware/Software) software (a) The software failure incident in the article does not specifically mention any hardware-related issues that contributed to the failure. It primarily focuses on software issues such as the new system not meeting the quality standard, having a high level of defects, and the need for a rectification plan [96187]. (b) The software failure incident in the article is primarily attributed to software-related issues. The article mentions that the software received from the company responsible for the new system was not up to the quality standard, resulting in ongoing discussions about a rectification plan. Additionally, it is highlighted that the new software had a high level of defects, which was shocking to the committee chairman [96187].
Objective (Malicious/Non-malicious) non-malicious (a) The articles do not mention any indication of malicious intent behind the software failure incident. It appears to be a non-malicious failure caused by issues with the software itself and its quality standard, leading to delays and the need for a rectification plan [96187].
Intent (Poor/Accidental Decisions) poor_decisions (a) The software failure incident reported in the article indicates poor decisions as a contributing factor. The Department of Agriculture, Environment and Rural Affairs (Daera) official mentioned that the software received from the company responsible had not been up to the "quality standard" despite £10.9m being spent on the new system since April 2016. Additionally, the chairman of the committee expressed shock upon learning that the new software had a "high level of defects" [96187].
Capability (Incompetence/Accidental) development_incompetence (a) The software failure incident in the article seems to be related to development incompetence. The article mentions that the software received from the company responsible for the new system was not up to the "quality standard" and had a "high level of defects" according to the chairman of the Agriculture Committee [96187]. (b) There is no specific mention of the software failure incident being accidental in the article.
Duration temporary The software failure incident described in the article does not explicitly mention whether the failure is permanent or temporary. The article discusses significant issues and delays in the roll-out of the new system, ongoing discussions about a rectification plan, and the software not meeting the quality standard. These factors suggest that the failure could be temporary, caused by specific circumstances that can potentially be rectified through a plan or improvements. However, without further details on the resolution or the final outcome, it is not definitively stated whether the failure is permanent or temporary [96187].
Behaviour omission, value, other (a) crash: The software failure incident in the article does not specifically mention a crash where the system loses state and does not perform any of its intended functions [96187]. (b) omission: The article mentions that the new software system meant to trace animal movements and disease had significant issues that delayed its roll-out, indicating an omission in performing its intended functions [96187]. (c) timing: There is no specific mention in the article of the software failure incident being related to timing issues where the system performed its intended functions too late or too early [96187]. (d) value: The failure of the software system in the article is related to the software received from the company responsible not meeting the "quality standard," indicating a failure in performing its intended functions correctly [96187]. (e) byzantine: The article does not describe the software failure incident as exhibiting byzantine behavior with inconsistent responses and interactions [96187]. (f) other: The behavior of the software failure incident in the article can be categorized as a failure due to the new system having a "high level of defects," which could be considered as a general software flaw impacting its functionality [96187].

IoT System Layer

Layer Option Rationale
Perception None None
Communication None None
Application None None

Other Details

Category Option Rationale
Consequence delay, theoretical_consequence (a) unknown (b) unknown (c) unknown (d) unknown (e) unknown (f) unknown (g) There were no real observed consequences of the software failure [96187]. (h) The article mentions that the new software system to trace animal movements and disease, which was meant to replace the existing system, had significant issues and delays in its roll-out. The existing traceability system was still considered "fit for purpose," and discussions were ongoing about a "rectification plan" to address the issues. The consequences of the software failure were more in the realm of potential impacts and delays rather than actual observed consequences [96187]. (i) unknown
Domain health (a) The failed system was intended to support the agriculture industry, specifically in tracing animal movements and disease, which is crucial for the agriculture sector [96187].

Sources

Back to List