Incident: Euronext Trading Outage Due to Third-Party Bug Impacting Data Management System

Published Date: 2020-10-20

Postmortem Analysis
Timeline 1. The software failure incident happened on October 19, 2023 [Article 106562].
System 1. Data management system [106563] 2. Third-party component [106563]
Responsible Organization 1. A third-party component was responsible for causing the software failure incident at Euronext [106563]. 2. Software glitches were responsible for causing the software failure incident at Euronext and other exchanges globally [106563, 106562].
Impacted Organization 1. Euronext (Article 106563, Article 106562) 2. Stock exchanges in Dublin, Amsterdam, Paris, Lisbon (Article 106563) 3. Tokyo Stock Exchange (Article 106562) 4. New Zealand's stock exchange (Article 106562) 5. Germany's electronic trading platform Xetra (Article 106562) 6. Moscow Exchange (Article 106562) 7. TMX Group Ltd in Canada (Article 106562) 8. Nasdaq Inc's Nordic and Baltic stock markets (Article 106562) 9. Hong Kong Exchanges and Clearing (Article 106562) 10. London Stock Exchange (Article 106562) 11. Intercontinental Exchange Inc's New York Stock Exchange (NYSE) (Article 106562) 12. Singapore Exchange Ltd (Article 106562) 13. NYSE Arca (Article 106562) 14. Nasdaq-listed stocks (Article 106562) 15. Facebook Inc's IPO on Nasdaq (Article 106562)
Software Causes 1. A bug in a third-party component [106563] 2. A software glitch [106562]
Non-software Causes 1. A bug in a third-party component [106563] 2. A squirrel chewing through a power line causing a power outage [106562]
Impacts 1. Trading on Euronext was disrupted for more than three hours, impacting major stock exchanges in Western Europe, including Dublin, Amsterdam, Paris, and Lisbon [106563]. 2. The glitch caused a major liquidity provider to pull quotes from Euronext's exchanges for the rest of the day, affecting bid-ask spreads and trading activity [106563]. 3. The outage led to major price swings during closing auctions, affecting the pricing used by exchange-traded funds (ETFs) and hedge funds [106563]. 4. The glitches caused the share price of Dutch healthcare technology company Philips to fall almost 4% at Monday's close, leading to confusion and subsequent corrections in the closing price [106563]. 5. The incident raised concerns about the concentration risk of having one operator host multiple stock exchanges, highlighting the potential vulnerabilities in such a setup [106563].
Preventions 1. Implementing thorough testing procedures to identify and address bugs in third-party components before deployment could have prevented the software failure incident [106563]. 2. Diversifying the hosting of stock exchanges to reduce concentration risk and potential widespread disruptions in case of technical failures [106563]. 3. Enhancing cybersecurity measures to prevent potential cyberattacks that could lead to system failures [106562]. 4. Regularly updating and maintaining hardware systems to prevent hardware failures that could disrupt trading activities [106562]. 5. Establishing robust backup power systems to ensure continuity of operations in case of power outages or failures [106562].
Fixes 1. Implementing more robust testing procedures to catch bugs in third-party components before they cause disruptions [106563]. 2. Enhancing redundancy and backup systems to ensure continuity of operations in case of technical failures [106563]. 3. Strengthening cybersecurity measures to prevent potential cyberattacks that could lead to system failures [106562]. 4. Conducting regular maintenance and updates on software systems to address potential glitches and faults [106562]. 5. Collaborating with regulatory authorities to evaluate and improve corrective and preventive measures to prevent future incidents [106563].
References 1. Market structure analyst at Rosenblatt - Anish Puaar [106563] 2. Executive at a liquidity provider [106563] 3. Exchange operator Euronext [106563] 4. France's financial regulator [106563] 5. Portugal's financial regulator [106563] 6. Senior London-based trader [106563] 7. Euronext spokesman [106563] 8. Various international exchanges and incidents mentioned in Article 106562

Software Taxonomy of Faults

Category Option Rationale
Recurring one_organization, multiple_organization (a) The software failure incident having happened again at one_organization: - Euronext experienced a technical failure impacting one of its data management systems, causing a glitch in its exchanges [106563]. - Euronext faced a similar issue in the past, as the article mentions that the problems encountered on Monday were not due to a problem in Euronext's proprietary platform but "a bug in a third-party component" [106563]. (b) The software failure incident having happened again at multiple_organization: - The article mentions various other instances of exchange outages globally due to software and hardware glitches, cyberattacks, and other issues at different organizations, such as the Tokyo Stock Exchange, New Zealand's stock exchange, Germany's Xetra, and more [106562].
Phase (Design/Operation) design, operation (a) The software failure incident mentioned in the articles was primarily attributed to a bug in a third-party component rather than a problem in Euronext's proprietary platform. This bug in the third-party component caused the technical failure impacting one of Euronext's data management systems, leading to the disruption in trading on several major stock exchanges hosted by Euronext [106563]. (b) The software failure incident also highlighted the importance of operational incidents during critical phases such as closing auctions. The glitches during the closing auctions on Monday caused major price swings, leading to the cancellation of orders placed after a certain time. This operational issue impacted the daily pricing for exchange-traded funds (ETFs) and hedge funds, emphasizing the significance of smooth operation during crucial trading periods [106563].
Boundary (Internal/External) within_system, outside_system (a) within_system: The software failure incident at Euronext was attributed to a bug in a third-party component, as stated by the exchange operator in an email to Reuters [106563]. This indicates that the failure originated within the system itself. (b) outside_system: The article also mentions that exchange outages, including the one at Euronext, have been caused by various factors such as software and hardware glitches, cyberattacks, and even incidents like a squirrel chewing through a power line [106562]. These external factors contribute to failures that originate outside the system.
Nature (Human/Non-human) non-human_actions (a) The software failure incident occurring due to non-human actions: - The software failure incident at Euronext was caused by a bug in a third-party component, not due to a problem in Euronext's proprietary platform [106563]. - The outage at Euronext was due to a technical failure impacting one of its data management systems [106563]. - The outage in Amsterdam, Brussels, Lisbon, and Paris was caused by a technical glitch at exchange operator Euronext [106562]. - Various other exchange outages globally were caused by hardware failures, cyberattacks, software glitches, and even incidents like a squirrel chewing through a power line [106562]. (b) The software failure incident occurring due to human actions: - There is no specific mention of the software failure incident being caused by human actions in the provided articles.
Dimension (Hardware/Software) hardware, software (a) The articles mention incidents related to hardware failures: 1. On Oct. 1, the Tokyo Stock Exchange experienced a hardware failure that brought trading to a standstill [Article 106562]. 2. TMX Group Ltd in Canada faced an outage due to a hardware failure causing problems with order entries, leading to the shutdown of trading across three local bourses for nearly two hours [Article 106562]. 3. In August 1994, a squirrel chewed through a power line in Trumbull, Connecticut, affecting the Nasdaq's servers due to a backup power system failure [Article 106562]. (b) The articles mention incidents related to software failures: 1. Euronext experienced a technical failure impacting one of its data management systems, which was attributed to a bug in a third-party component, causing trading disruptions in several major European stock exchanges [Article 106563]. 2. New Zealand's stock exchange faced disruptions due to cyberattacks [Article 106562]. 3. Xetra, managed by Deutsche Boerse, encountered a software glitch that temporarily shut down trading on its electronic trading platform [Article 106562].
Objective (Malicious/Non-malicious) non-malicious (a) The articles do not mention any indication of the software failure incident being malicious or due to contributing factors introduced by humans with the intent to harm the system [106563, 106562]. (b) The software failure incident mentioned in the articles is attributed to non-malicious factors such as technical glitches, hardware failures, software bugs, and third-party component issues [106563, 106562]. These incidents disrupted trading on major stock exchanges in Western Europe, leading to concerns about the risk of relying on a single operator hosting multiple bourses. The failures were not attributed to cyberattacks or intentional malicious actions.
Intent (Poor/Accidental Decisions) accidental_decisions (a) The software failure incident at Euronext was not due to poor decisions but rather a bug in a third-party component. Euronext stated that the issues encountered were not a problem in their proprietary platform but were caused by a bug in a third-party component [106563]. (b) The incident at Euronext was described as a technical failure impacting one of its data management systems, leading to the disruption of trading on several major stock exchanges in Western Europe. The outage was attributed to a bug in a third-party component, indicating that the failure was due to unintended technical issues rather than poor decisions [106563].
Capability (Incompetence/Accidental) accidental (a) The software failure incident occurring due to development incompetence: - The software failure incident at Euronext was not due to a problem in Euronext's proprietary platform but "a bug in a third-party component" [106563]. - The incident at Euronext was caused by a technical failure impacting one of its data management systems, which was not a problem in Euronext's proprietary platform [106563]. (b) The software failure incident occurring accidentally: - The outage at Euronext was caused by a bug in a third-party component, indicating an accidental introduction of the contributing factor [106563]. - The article mentions various outages caused by software and hardware glitches, cyberattacks, and even incidents like a squirrel chewing through a power line, highlighting accidental factors leading to software failures [106562].
Duration temporary The software failure incident reported in the articles was temporary. The incident caused trading in stocks and derivatives to be frozen for three hours in several European cities, including Amsterdam, Brussels, Lisbon, and Paris [Article 106562]. The outage was due to a technical glitch at the exchange operator Euronext, impacting its data management systems [Article 106563]. The issue was not permanent but rather a temporary disruption in trading activities caused by specific circumstances related to the technical failure and glitches in the system.
Behaviour crash, omission, timing, value, other (a) crash: The incident at Euronext resulted in trading coming to a standstill for more than three hours due to a technical failure impacting one of its data management systems. The glitch caused major liquidity providers to pull quotes from Euronext's exchanges, leading to disruptions in trading activities [106563]. (b) omission: The glitches at Euronext during the closing auctions on Monday caused major price swings, prompting the exchange to cancel all orders placed after a certain time. This omission in the system's functioning affected the pricing and trading activities of exchange-traded funds and hedge funds [106563]. (c) timing: The incident at Euronext affected the timing of trading activities, particularly during the crucial closing auctions. The final five minutes of trade were crucial for setting prices, and the glitches during this period led to major disruptions and subsequent cancellations of orders [106563]. (d) value: The software glitch at Euronext impacted the value of trade orders, causing discrepancies in the closing prices of certain stocks. For example, the share price of Dutch healthcare technology company Philips fell almost 4% at Monday's close, but Euronext later informed them that their closing price would actually be set at a different value [106563]. (e) byzantine: The articles do not provide specific information indicating a byzantine behavior of the software failure incident. (f) other: The software failure incident at Euronext was attributed to a bug in a third-party component rather than a problem in Euronext's proprietary platform. This type of external bug causing disruptions in the system's functioning represents a different aspect of software failure behavior [106563].

IoT System Layer

Layer Option Rationale
Perception None None
Communication None None
Application None None

Other Details

Category Option Rationale
Consequence property, delay, non-human, theoretical_consequence, other (a) death: People lost their lives due to the software failure - No information in the articles suggests that people lost their lives due to the software failure incident. (b) harm: People were physically harmed due to the software failure - No information in the articles suggests that people were physically harmed due to the software failure incident. (c) basic: People's access to food or shelter was impacted because of the software failure - No information in the articles suggests that people's access to food or shelter was impacted due to the software failure incident. (d) property: People's material goods, money, or data was impacted due to the software failure - The software failure incident caused major disruptions in trading on Euronext, impacting liquidity providers and resulting in significant price swings during closing auctions, affecting the accuracy of stock prices [106563]. - The glitches caused the share price of Dutch healthcare technology company Philips to fall almost 4% at Monday's close, with the closing price later adjusted by Euronext [106563]. (e) delay: People had to postpone an activity due to the software failure - Trading in stocks and derivatives was frozen for three hours in Amsterdam, Brussels, Lisbon, and Paris due to the technical glitch at Euronext, causing a significant delay in trading activities [106562]. (f) non-human: Non-human entities were impacted due to the software failure - The software failure incident impacted the trading of stocks and derivatives on Euronext's exchanges, affecting companies like Philips [106563]. (g) no_consequence: There were no real observed consequences of the software failure - The software failure incident led to disruptions in trading, impacting liquidity providers, causing price swings, and delays in trading activities [106563, 106562]. (h) theoretical_consequence: There were potential consequences discussed of the software failure that did not occur - The articles mention concerns about the risk of one operator hosting multiple stock exchanges and the potential concentration risk associated with such platforms [106563]. - Regulatory bodies like France's AMF and Portugal's CMVM were evaluating the incident to assess the quality of corrective and preventive measures taken by Euronext to prevent future occurrences [106563]. (i) other: Was there consequence(s) of the software failure not described in the (a to h) options? What is the other consequence(s)? - The software failure incident resulted in the cancellation of all orders placed after a certain time during closing auctions, leading to manual efforts for trade reconciliation and reporting back to clients [106563].
Domain finance (a) The failed system was related to the finance industry as it disrupted trading on Euronext, which operates major stock exchanges in Western Europe, including Dublin, Amsterdam, Paris, and Lisbon [106563, 106562]. (h) The incident affected the finance industry specifically in the stock market sector, where trading in stocks and derivatives was frozen for three hours in several European cities due to a technical glitch at exchange operator Euronext [106562]. (m) The software failure incident was not related to any other industry mentioned in the options provided.

Sources

Back to List