French MoD challenge : Thales performs a successful sovereign AI hack and presents enhanced security solutions for military and civil AI
23/11/2023
The Friendly Hackers team from Thales, a world leader in data protection and cybersecurity, has won the CAID[1] challenge organised by the French Ministry of Defence2 during the fifth edition of European Cyber Week in France (November 21 - 23, 2023).
The challenge, the first of its kind to be organised by the French Ministry of Defence, was designed to evaluate the extent to which teams of hackers could exploit certain intrinsic vulnerabilities of AI models.
Thaless work on AI security and trust is aligned with the requirements of both the defence community and civilian organisations such as critical infrastructure providers, which all face the same challenges of protecting their training datasets and intellectual property, and guaranteeing that AI-generated results can be trusted for critical decision-making.
Rodolphe LAMPE, Senior Data Scientist in the Thales team, with Alice H liou, Vincent Thouvenot, Cong-Bang Huynh and Baptiste MorisseThe French Ministry of Defences AI security challenge
Participants in the CAID challenge had to perform two tasks:
In a given set of images, determine which images were used to train the AI algorithm and which were used for the test.
An AI-based image recognition application learns from large numbers of training images. By studying the inner workings of the AI model, Thaless Friendly Hackers team successfully determined some of the images that had been used to create the application, gaining valuable information about the training methods used and the quality of the model.
2. Find the images of aircrafts used by a AI algorithm that had been protected using unlearning techniques.
An unlearning technique consists of deleting the data used to train a model, such as images, in order to preserve their confidentiality. This technique can be used, for example, to protect the sovereignty of an algorithm in the event of its export, theft or loss. For example, a drone equipped with AI must be able to recognise any enemy aircraft as a potential threat. On the other hand, models of aircraft from its own army would have to be learned to be identified as friendly, then erased by a technique known as unlearning. In this way, even if the drone was stolen or lost, the sensitive aircraft data contained in the AI model could not be extracted for malicious purposes. However, the Friendly Hackers team from Thales managed to re-identify the data that was supposed to have been erased from the model, thereby overriding the unlearning process.
Exercises like this help to assess the vulnerability of training data and trained models, which are valuable tools and can deliver outstanding performance but also represent new attack vectors for the armed forces. An attack on training data or trained models could have significant consequences in a military context, where this type of information could give an adversary the upper hand. Risks include model theft, theft of the data used to recognise military hardware or other features in a theatre of operations, and backdoors to impair the operation of the system using the AI. While AI in general, and generative AI in particular, offers significant operational benefits and provides military personnel with intensively trained decision support tools to reduce their cognitive burden, the national defence community needs to address new threats to this technology as a matter of priority.
The Thales BattleBox approach to tackle AI vulnerabilities
The protection of training data and trained models is critical in the defence sector. AI cybersecurity is becoming more and more crucial, and needs to be autonomous to thwart the many new opportunities that the world of AI is opening up to malicious actors. Responding to the risks and threats involved in the use of artificial intelligence, Thales has developed a set of countermeasures called the BattleBox to provide enhanced protection against potential breaches.
BattleBox Training provides protection from training-data poisoning, preventing hackers from introducing a backdoor.
BattleBox IP digitally watermarks the AI model to guarantee authenticity and reliability.
BattleBox Evade aims to protect models from prompt injection attacks, which can manipulate prompts to bypass the safety measures of chatbots using Large Language Models (LLMs), and to counter adversarial attacks on images, such as adding a patch to deceive the detection process in a classification model.
BattleBox Privacy provides a framework for training machine learning algorithms, using advanced cryptography and secure secret-sharing protocols to guarantee high levels of confidentiality.
To prevent AI hacking in the case of CAID challenge tasks, countermeasures such as encryption of the AI model could be one of the solutions to be implemented.
AI provides considerable operational benefits, but it requires high levels of security and cybersecurity protection to prevent data breaches and misuse. Thales implements a large range of AI-based solutions for all types of civil and military use cases. Intended to be explainable, embeddable and integrated within robust critical systems, they are also designed to be sovereign, frugal and reliable thanks to advanced methods and tools used for qualification and validation. Thales has the dual AI and line-of-business expertise needed to incorporate these solutions into its systems to significantly improve their operational capabilities, said David Sadek, Thales VP Research, Technology & Innovation in charge of Artificial Intelligence.
Thales and AI
As the Groups defence and security businesses address critical requirements, often with safety-of-life implications, Thales has developed an ethical and scientific framework for the development of trusted AI based on the four strategic pillars of validity, security, explainability and resp
LINK: | https://www.thalesgroup.com/en/worldwide/security/press_release/french... |
See more stories from thales |
More from Thales
05/09/2024
Thales to lead DECOR research project to test solutions for lowering the environmental impact of flight operations
Facebook Twitter LinkedIn Working together to reduce the environmental imp...
03/09/2024
Thales and WB Group sign a Frame Agreement on Strategic Cooperation in the defence sector
Facebook Twitter LinkedIn Pascale SOURISSE, Thales International, and Piot...
03/09/2024
Thales i WB Group podpisay ramowe porozumienie o wsppracy strategicznej w sektorze obronnym
Facebook Twitter LinkedIn Pascale SOURISSE, Thales International, and Piot...
03/09/2024
Thales in Belgium and Polska Amunicja sign a MoU to collaborate on the production of 70mm rockets
Facebook Twitter LinkedIn Pawel Poncyljusz, Polska Amunicja, Magdalena Niz...
03/09/2024
Thales Belgium i Polska amunicja podpisay list intencyjny o wsppracy przy produkcji rakiet 70 mm
Facebook Twitter LinkedIn Pawel Poncyljusz, Polska Amunicja, Magdalena Niz...
03/09/2024
Thales and PIT-RADWAR (PGZ Group) to cooperate on radar technologies
Facebook Twitter LinkedIn Magdalena NIZIK, Thales Poland, Pascale SOURISSE, Thales International, Marek BOREJKO, PGZ PITRADWAR - Thales Thales, a glo...
03/09/2024
Thales i PIT-RADWAR (Grupa PGZ) podejm wspprac w zakresie technologii radarowych
Facebook Twitter LinkedIn Magdalena NIZIK, Thales Poland, Pascale SOURISSE, Thales International, Marek BOREJKO, PGZ PITRADWAR - Thales Thales, globa...
29/08/2024
Thales to present modern air defence technologies at the MSPO fair in Kielce
Facebook Twitter LinkedIn One of the key air defence solutions Thales will present at MSPO this year is the GM200 Multi-Mission family air surveillance an...
29/08/2024
Thales zaprezentuje nowoczesne technologie obrony powietrznej na targach MSPO w Kielcach
Facebook Twitter LinkedIn Jednym z kluczowych rozwi za obrony powietrznej...
21/08/2024
Thales and L&T Technology Services expand collaboration to provide innovative business models to customers
Facebook Twitter LinkedIn New contract builds on 20-year relationship with...
20/08/2024
Ita Unibanco innovates with a credit card specifically designed to meet the needs of visually impaired people
Facebook Twitter LinkedIn Sao Paulo - Itau Unibanco and Thales, a global l...
01/08/2024
Thales Chosen as Supplier for Lilium's Revolutionary eVTOL Jet Program
Facebook Twitter LinkedIn Thales, a global leader in airborne communication and navigation solutions, formerly known as Cobham Aerospace Communications, h...
31/07/2024
Thales to enhance mobile threat simulators for German forces
Facebook Twitter LinkedIn Thales has been entrusted with the upkeep of critical components and peripherals for the mobile threat simulators (Mobs). These ...
30/07/2024
Thales and Garuda Aerospace sign MoU for secure drone operations in India
Facebook Twitter LinkedIn Thales has signed a memorandum of understanding (MoU) with Garuda Aerospace to promote growth and innovation in the drone sector...
23/07/2024
Thales reports its 2024 half-year results
Facebook Twitter LinkedIn Order intake: 10.8 billion, up 26% ( 23% on an organic basis1) Order book: 47 billion, a new record high Sales: 9.5 billion...
19/07/2024
South Korea Institute of Startup & Entrepreneurship Development (KISED) and Thales to Champion Korea's Start-up Ecosystem
Facebook Twitter LinkedIn Mr Yeol-Soo CHOI, KISED Acting President, and Fr...
12/07/2024
Thales announces order for new SYRACUSE IV satcom stations to equip French Army Serval armoured vehicles
Facebook Twitter LinkedIn The French defence procurement agency (DGA) has ...
10/07/2024
Papara premieres Thales SketchMyCard
Facebook Twitter LinkedIn Papara is the first fintech in the world to deploy Thales' innovative personalisation solution which offers its users artist...
09/07/2024
Thales to test passive hull-mounted sonar on Naval Group's XL-UUV demonstrator
Facebook Twitter LinkedIn The passive omnidirectional hull-mounted sonar f...
01/07/2024
Thales ramps up rocket production at its Herstal site in Belgium to support European defence
Facebook Twitter LinkedIn Thales has opened a new assembly line to accommo...
27/06/2024
Thales Alenia Space reveals results of ASCEND feasibility study on space data centers
Facebook Twitter LinkedIn Cannes, June 27, 2024 - Thales Alenia Space, the...
26/06/2024
Lufthansa Technik selects Thales for the Pegasus program
Facebook Twitter LinkedIn Bombardier Thales will supply its last generation of secured audio/radio management system capable of managing the communicat...
25/06/2024
Cloud Resources have Become Biggest Targets for Cyberattacks, finds Thales
Facebook Twitter LinkedIn Cloud Security spending now tops all other security spending categories Nearly half (47%) of all corporate data stored in the c...
24/06/2024
Thales obtains the first Design Verification Report for a complete drone system ever granted by EASA
Facebook Twitter LinkedIn Design Verification Report (DVR) is a new proces...
21/06/2024
Space Alliance wins 2024 Farnse d'Or award
Facebook Twitter LinkedIn Thales and Leonardo recognized for strengthening ties between Italy and France through space cooperation under Quirinal Treaty ...
21/06/2024
Industry signs Letter of Intent on MGCS
Facebook Twitter LinkedIn At the Eurosatory 2024 international defence trade fair, the managing directors of KNDS Deutschland, KNDS France, Rheinmetall La...
21/06/2024
ASTRA 1P communications satellite successfully launched
Facebook Twitter LinkedIn The most powerful geostationary satellite ever designed to operate from 19.2 East Cape Canaveral, Florida, June 21, 2024 - AST...
20/06/2024
EDGE and Thales Announce a Strategic Partnership for Radio Communications Development and Manufacturing in the UAE
Facebook Twitter LinkedIn Didier Pagnoux, CEO of KATIM. Abdelhafid Mordi, ...
19/06/2024
Thales signs three agreements with ukrainian industry to strengthen front-line support and local defence capability
Facebook Twitter LinkedIn Thales has signed at Eurosatory three agreements...
18/06/2024
EURENCO and Thales sign a strategic partnership until2030
Facebook Twitter LinkedIn EUROSATORY, Parc des Expositions Paris-Villepinte, June 18, 2024 - EURENCO and Thales have strengthened their collaboration and ...
18/06/2024
Thales Belgium, WB Electronics and AREX signed an MoU to develop a new remote weapon system equipped with 70mm rockets
Facebook Twitter LinkedIn Leveraging their respective competencies, the th...
18/06/2024
EURENCO and Thales sign a strategic partnership until 2030
Facebook Twitter LinkedIn EUROSATORY, Parc des Expositions Paris-Villepinte, June 18, 2024 - EURENCO and Thales have strengthened their collaboration and ...
17/06/2024
Thales supports the Irish Defence Forces, providing more than 6 000 software defined radios
Facebook Twitter LinkedIn The Irish Defence Forces have selected Thales to...
17/06/2024
Thales is quadrupling its ammunition production capacity at its La Fert Saint Aubin site to meet the needs of the French Army
Facebook Twitter LinkedIn After an initial order in 2022 for 3,000 rounds ...
17/06/2024
Thales and CEA partner on trusted generative AI for defence and security
Facebook Twitter LinkedIn Thales and the French Alternative Energies and Atomic Energy Commission (CEA) have signed a new partnership agreement in the fie...
17/06/2024
Thales unveils OpenDRobotics to support a new era of extended collaborative combat enabled by AI
Facebook Twitter LinkedIn Thales is launching OpenDRobotics, a revolutiona...
17/06/2024
Thales unveils new range of tactical wideband High Frequency radios
Facebook Twitter LinkedIn Thaless first resilient high-data-rate High Frequency (HF) radio sets for land theatre command posts are on display on the compa...
17/06/2024
Brazilian Air Force strengthens air surveillance capacities with the acquisition of Thales Ground Master 200 Multi-Mission All-in-One radars
Facebook Twitter LinkedIn The Brazilian Air Force acquires the Ground Mast...
13/06/2024
MEDIA INVITATION
Facebook Twitter LinkedIn Thales pavilion (stand C242), Parc des Expositions, Paris Nord Villepinte, 17-21 June 2024 Thales is pleased to welcome you to ...
13/06/2024
Thales teams up with Google Cloud to provide organisations with an extensive set of cyber detection and response capabilities
Facebook Twitter LinkedIn Thales and Google Cloud have signed a new partne...
13/06/2024
Thales, Spire Global and ESSP to develop a space-based air traffic surveillance service
Facebook Twitter LinkedIn Thales, Spire and ESSP are joining forces to dev...
13/06/2024
Thales modernizes Bahrain's Airspace with TopSky Aeronautical Messaging Handling System
Facebook Twitter LinkedIn Thales provided Bahrain's Ministry of Transp...
12/06/2024
COCESNA and Thales signed two contracts to modernize its AMHS and AIM systems and navigation aids infrastructure
Facebook Twitter LinkedIn COCESNA and Thales signed two contracts to moder...
11/06/2024
Queensland residents in Australia embrace digital driver licences powered and protected by Thales
Facebook Twitter LinkedIn Since its launch in late 2023 by the Queensland ...
10/06/2024
Thales now provides complete passwordless functionality for enterprises with Passwordless 360
Facebook Twitter LinkedIn New approach allows organizations to use one sol...
07/06/2024
Thales to supply Ukraine with a second air defence system to help protect its territory
Facebook Twitter LinkedIn Under the aegis of the French Ministry of the Ar...
04/06/2024
The DVLA and Thales cut carbon footprint of UK driving licence and residence cards
Facebook Twitter LinkedIn Driver and Vehicle Licencing Agency (DVLA) and T...
03/06/2024
PT Len and Thales Sign JV Agreement to Strengthen Indonesian Defence
Facebook Twitter LinkedIn PT Len Industri (Persero) and Thales have signed an agreement on 30th May 2024, to launch a Joint Venture (JV) that will take In...
31/05/2024
Thales has completed the sale of its Ground Transportation Systems business
Facebook Twitter LinkedIn With around 9,000 employees, Ground Transportation Systems is a global leader in Rail Signaling and Train Control Systems, Telec...