Incident: GCSE Computer Science Exam Delayed and Question Unanswerable

Published Date: 2019-05-16

Postmortem Analysis
Timeline 1. The software failure incident happened on the day of the GCSE computer science exam, which was scheduled to start at 13:30 BST on a Thursday [84947]. Therefore, the software failure incident happened on a Thursday in May 2019.
System 1. Greenfoot program version 2.5 [84947]
Responsible Organization 1. The WJEC exam board was responsible for causing the software failure incident as they were the ones conducting the GCSE computer science exam where the technical issue occurred [84947].
Impacted Organization 1. GCSE pupils taking the computer science exam were impacted by the software failure incident [84947].
Software Causes 1. Version incompatibility between the exam question on Greenfoot version 3 and school computers with Greenfoot version 2.5 installed [84947].
Non-software Causes 1. The delay in the start of the exam due to teachers being unable to log on to the online resource at the scheduled time [84947]. 2. The mismatch between the exam question on version 3 of the program and the school computers having version 2.5 installed, leading to students being unable to answer the final question [84947].
Impacts 1. The start of the computer science exam was delayed due to the technical issue, causing inconvenience to the pupils [84947]. 2. Pupils were unable to answer the final question of the exam, which was on a different version of the program than what was installed on school computers, potentially affecting their performance [84947]. 3. Students had to wait for more than an hour for the exam to start in some cases, leading to added stress and uncertainty during an already challenging exam period [84947].
Preventions 1. Ensuring compatibility between the exam questions and the software versions installed on school computers could have prevented the software failure incident [84947].
Fixes 1. Ensuring that the software versions used for the exam are compatible with the exam questions could help fix the software failure incident [84947].
References 1. Parents of pupils at affected schools, including St Cyres school in Penarth and schools in Rhondda Cynon Taff [84947] 2. The WJEC exam board [84947]

Software Taxonomy of Faults

Category Option Rationale
Recurring multiple_organization a) The software failure incident related to the GCSE computer science exam affected multiple schools, including St Cyres school in Penarth, Rhondda Cynon Taff school, Ysgol Penrhyn Dewi in St Davids, Ysgol Gyfun Llangefni on Anglesey, and Bishop of Llandaff school in Cardiff [84947]. b) The incident also affected students in various areas such as Vale of Glamorgan, Cardiff, Pembrokeshire, and Rhondda Cynon Taff, indicating that the software failure was not limited to a specific region or organization [84947].
Phase (Design/Operation) design, operation (a) The software failure incident in the GCSE computer science exam can be attributed to a design-related issue. Specifically, the problem arose because the exam question was based on a newer version (version 3) of the program Greenfoot, while the school computers had an older version (version 2.5) installed. This mismatch in software versions led to students being unable to answer the final question of the exam, causing disruption and stress for the pupils [84947]. (b) Additionally, there were operational issues reported during the exam. Parents and students highlighted delays in starting the exam, with some students having to wait for over an hour before they could begin. These operational challenges, such as the inability of teachers to log on to the online resource for the exam and delays in starting the test, added to the overall impact of the software failure incident on the students [84947].
Boundary (Internal/External) within_system (a) within_system: The software failure incident in the GCSE computer science exam was primarily within the system. The issue arose from a technical problem where the exam question was based on a newer version (version 3) of a program called Greenfoot, while the school computers had an older version (version 2.5) installed. This discrepancy led to students being unable to answer the final question worth 16 marks, causing delays and frustration among pupils and parents [84947].
Nature (Human/Non-human) non-human_actions (a) The software failure incident in the GCSE computer science exam was primarily due to non-human actions. The issue arose because the exam question was based on a newer version (version 3) of the program Greenfoot, while the school computers had an older version (version 2.5) installed. This mismatch in software versions led to students being unable to answer the final question of the exam, causing delays and frustration for both pupils and parents [84947].
Dimension (Hardware/Software) hardware, software (a) The software failure incident in the GCSE computer science exam was primarily due to a hardware-related issue. Specifically, the problem arose because the exam question required a specific version of a program called Greenfoot (version 3), while the school computers had an older version (version 2.5) installed. This mismatch between the required software version and the installed software on the school computers led to students being unable to answer the final question of the exam, causing delays and frustration among pupils and parents [84947].
Objective (Malicious/Non-malicious) non-malicious (a) The software failure incident reported in Article 84947 does not indicate any malicious intent behind the issue. It was described as a "technical issue" affecting the computer science exam for GCSE pupils. The problems included delays in starting the exam, inability to answer a question due to version mismatch of the software, and students having to wait for extended periods before the exam began. The WJEC exam board mentioned that they are investigating the matter and assured that no pupils would be disadvantaged, indicating a non-malicious nature of the failure incident [84947].
Intent (Poor/Accidental Decisions) accidental_decisions (a) The software failure incident related to the GCSE computer science exam was not directly attributed to poor decisions but rather to a technical issue. The issue arose from a mismatch between the exam question being based on a newer version of a program called Greenfoot while the school computers had an older version installed. This discrepancy led to students being unable to answer the final question of the exam, causing delays and frustration among pupils and parents [84947].
Capability (Incompetence/Accidental) development_incompetence (a) The software failure incident in the article can be attributed to development incompetence. The issue arose because the exam question was based on a newer version (version 3) of the program Greenfoot, while the school computers had an older version (version 2.5) installed. This mismatch in software versions led to students being unable to answer the final question of the exam, causing disruption and stress for the pupils involved [84947].
Duration temporary (a) The software failure incident in the article was temporary. It was a technical issue that affected the GCSE computer science exam, causing delays in the start of the exam and preventing students from answering one of the questions. The issue was related to a mismatch between the exam question being on version 3 of a program called Greenfoot while school computers had version 2.5 installed. The problem led to delays and confusion for students and parents, but the exam board assured that no pupils would be disadvantaged, indicating that the issue was not permanent [84947].
Behaviour crash, omission, value (a) crash: The software failure incident in the article can be categorized as a crash as the system lost state and did not perform its intended functions. The article mentions that teachers were unable to log on to the online resource for the exam at the scheduled start time, leading to a delay in the exam start and students being unable to answer the final question [84947]. (b) omission: The incident can also be classified as an omission since the system omitted to perform its intended functions at an instance. Students could not answer one of the questions in the exam due to a version mismatch between the exam question and the software installed on school computers [84947]. (d) value: The software failure incident can be attributed to a value failure as the system performed its intended functions incorrectly. Students were unable to answer the final question of the exam due to the version discrepancy, which resulted in them not being able to earn the marks allocated for that question [84947].

IoT System Layer

Layer Option Rationale
Perception None None
Communication None None
Application None None

Other Details

Category Option Rationale
Consequence delay, theoretical_consequence The consequence of the software failure incident was primarily related to delays in the GCSE computer science exam. The incident caused delays in the start of the exam, with students unable to answer one of the questions due to a technical issue with the software. For example, at St Cyres school, the exam was delayed for half an hour, and students could not answer the final question worth 16 marks due to a version mismatch in the software installed on school computers [84947]. Parents and pupils expressed concerns about the implications of the problem, especially for students interested in software development and gaming development, as it added stress during an already challenging exam period [84947].
Domain knowledge (a) The failed system was intended to support the education industry, specifically the GCSE computer science exam for pupils [84947].

Sources

Back to List