Incident: Exam Resit Due to Replicated Questions on Revision App

Published Date: 2013-06-27

Postmortem Analysis
Timeline 1. The software failure incident happened in June 2013. [Article 19740]
System The system that failed in the software failure incident reported in Article 19740 is: 1. Obstetrics and Gynaecology Complete Revision app [19740]
Responsible Organization 1. The Obstetrics and Gynaecology Complete Revision app developers, including Guys and St Thomas’ NHS Trust consultant Rajesh Varma and academic Dr Kate Spacey, who helped develop the app [19740].
Impacted Organization 1. Hundreds of medical students at King's College London [19740]
Software Causes 1. The software failure incident was caused by the replication of exam questions on a revision app designed by the lecturers at King's College London, which led to the questions matching those on the actual exam paper [19740].
Non-software Causes 1. Lack of proper oversight and review processes in setting exam questions, leading to the replication of questions on the revision app [19740].
Impacts 1. The impacted medical students at King's College London had to resit the exam due to the software failure incident where the questions on the exam matched those on a revision app, causing the examination to be declared void [Article 19740]. 2. The students faced additional stress and pressure as they had less than two weeks to revise again for the fresh exam with new questions [Article 19740]. 3. The reputation of the university and the individuals involved in developing the revision app may have been negatively affected by the incident, leading to disappointment and unsettlement among the students [Article 19740].
Preventions 1. Implementing thorough testing procedures to ensure that exam questions are not inadvertently replicated in any study materials or revision apps [19740]. 2. Implementing strict guidelines and protocols for academic staff involved in both setting exam questions and developing study aids to prevent conflicts of interest and inadvertent sharing of exam content [19740]. 3. Utilizing plagiarism detection software to cross-check exam questions with any study materials or revision apps developed by academic staff to identify any potential overlaps [19740].
Fixes 1. Implement stricter controls and separation between the development of exam questions and the creation of revision tools to prevent such incidents in the future [19740].
References 1. Daily Telegraph [19740]

Software Taxonomy of Faults

Category Option Rationale
Recurring one_organization <Article 19740> provides information about a software failure incident where medical students at King's College London had to resit an exam because the questions on the exam matched those on a revision app designed by their lecturers. This incident indicates a software failure within the same organization (King's College London) as the app was developed with the help of academics linked to the course [19740].
Phase (Design/Operation) design (a) The software failure incident in this case is related to the design phase. The incident occurred because the questions on the exam paper matched those found on a revision app designed by the lecturers themselves. The app, priced at £1.49 and available on iTunes, provided study aids so close to the actual questions that it essentially armed the students with the answers they needed to pass the exam. The app was developed with the help of academics linked to the course, including Guys and St Thomas’ NHS Trust consultant Rajesh Varma and academic Dr. Kate Spacey, who teaches at the university [19740]. (b) There is no specific information in the articles indicating that the software failure incident was due to factors introduced by the operation or misuse of the system.
Boundary (Internal/External) within_system (a) within_system: The software failure incident in this case falls within the system boundary. The failure occurred due to questions from a revision app designed by the lecturers themselves matching the questions on the exam paper. The app, priced at £1.49 and developed with the help of academics linked to the course, provided study aids so close to the actual questions that the students who used it were essentially equipped with the answers needed to pass the exam. The app was developed by individuals involved in setting the exam, indicating an internal origin of the contributing factors to the failure [19740].
Nature (Human/Non-human) non-human_actions (a) The software failure incident in this case occurred due to non-human actions. The failure was attributed to the replication of exam questions on a revision app designed by the lecturers themselves. The app, priced at £1.49 and available on iTunes, provided study aids that closely matched the actual exam questions, leading to the need for the affected students to resit the exam [19740].
Dimension (Hardware/Software) software (a) The software failure incident reported in the article is primarily related to a software issue rather than a hardware issue. The incident occurred because questions from a revision app designed by the lecturers were replicated in the actual exam paper, leading to the exam being declared void and students having to resit the exam [19740]. This issue originated from the software side, where the app provided study aids so close to the actual questions that it compromised the integrity of the exam. (b) The software failure incident in this case was caused by the replication of exam questions on the revision app, leading to the exam being declared void and students having to resit the exam. The software failure originated in the development and design of the revision app, which closely mirrored the actual exam questions, creating an unfair advantage for students who used the app [19740].
Objective (Malicious/Non-malicious) non-malicious (a) The software failure incident in this case appears to be non-malicious. The failure occurred because the questions on the exam were replicated on a revision app designed by the lecturers themselves. The app, priced at £1.49 and available on iTunes, provided study aids that closely matched the actual exam questions, unintentionally giving an advantage to the students who used it. The incident led to the exam being declared void, and the affected students had to resit the exam with new questions [19740].
Intent (Poor/Accidental Decisions) poor_decisions (a) The software failure incident in this case was primarily due to poor decisions. The incident occurred because the questions on the exam matched those found on a revision app designed by the same lecturers who set the exam [19740]. This indicates a lack of foresight and oversight in ensuring that the content of the app did not directly align with the exam questions, leading to the need for hundreds of students to resit the exam.
Capability (Incompetence/Accidental) development_incompetence (a) The software failure incident in this case appears to be related to development incompetence. The article mentions that the exam questions matched those on a smartphone revision app designed by the lecturers themselves. It is stated that the same staff who wrote the exam paper also helped develop the app, leading to a situation where the app provided study aids so close to the actual questions that the exam had to be declared void, and the students had to resit the exam with new questions [19740]. This indicates a lack of professional competence in ensuring the integrity and independence of the exam questions and the revision app. (b) There is no specific mention of the software failure incident being accidental in the articles.
Duration temporary The software failure incident described in the article is temporary. The incident occurred due to the questions on the exam matching those found on a revision app designed by the lecturers, leading to the exam being declared void and the students having to resit the exam with new questions [19740].
Behaviour other (a) crash: The software failure incident in this case did not involve a crash where the system lost state and did not perform any of its intended functions. The issue was related to the replication of exam questions on a revision app, leading to the need for students to resit the exam [19740]. (b) omission: The software failure incident did not involve omission where the system omitted to perform its intended functions at an instance(s). Instead, the issue was about the app providing study aids so close to the actual exam questions that it compromised the integrity of the exam [19740]. (c) timing: The software failure incident was not related to timing, where the system performed its intended functions correctly but too late or too early. The issue was more about the content of the app matching the exam questions, leading to the need for a re-sit [19740]. (d) value: The software failure incident did not involve a value failure where the system performed its intended functions incorrectly. The issue was not about incorrect functioning but about the app providing answers that matched the exam questions [19740]. (e) byzantine: The software failure incident did not exhibit a byzantine behavior where the system behaved erroneously with inconsistent responses and interactions. The issue was more straightforward, involving the replication of exam questions on the revision app [19740]. (f) other: The software failure incident in this case could be categorized as an integrity issue where the app's content compromised the fairness and validity of the exam, leading to the need for students to resit the exam [19740].

IoT System Layer

Layer Option Rationale
Perception None None
Communication None None
Application None None

Other Details

Category Option Rationale
Consequence unknown (a) death: People lost their lives due to the software failure (b) harm: People were physically harmed due to the software failure (c) basic: People's access to food or shelter was impacted because of the software failure (d) property: People's material goods, money, or data was impacted due to the software failure (e) delay: People had to postpone an activity due to the software failure (f) non-human: Non-human entities were impacted due to the software failure (g) no_consequence: There were no real observed consequences of the software failure (h) theoretical_consequence: There were potential consequences discussed of the software failure that did not occur (i) other: Was there consequence(s) of the software failure not described in the (a to h) options? What is the other consequence(s)? The consequence of the software failure incident: The incident did not result in any direct harm, death, or physical consequences to individuals. The main consequence was that the 400 medical students at King's College London had to resit their exam due to the questions being replicated on a revision app, causing inconvenience and stress to the students [19740].
Domain knowledge, health The software failure incident reported in the news article [19740] is related to the **health** industry. The incident involved medical students at King's College London having to resit an exam due to questions being replicated on a revision app designed by their lecturers. The exam affected by the software failure was in the field of obstetrics and gynaecology, which is a part of the healthcare industry. The app, Obstetrics and Gynaecology Complete Revision, was developed by individuals associated with Guys and St Thomas’ NHS Trust and King's College London, institutions closely tied to the healthcare sector. The students affected were studying medicine, which is a key component of the health industry.

Sources

Back to List