Evaluation of the Impact of Random Computing Hardware Faults on the Performance of Convolutional Neural Networks

DOI

10.2991/aisr.k.201029.058How to use a DOI?

Keywords

deep learning, fault injection, random hardware faults, automated fault injection, Convolutional Neural Network, neural network fault tolerance

Abstract

Artificial Intelligence (AI) rapidly spreads across high-tech industries and enters almost every safety-critical area such as automotive, aerospace, and medical industries. However, like any other software, AI-based applications are prone to random hardware faults such as a random bit flip in CPU, RAM, or network. Therefore, it is essential to understand how various hardware faults affect the performance and accuracy of AI applications. This paper provides a general description and particular conceptual and implementational features of our recently introduced Fault Injection (FI) framework InjectTF2. InjectTF2 is developed using the TensorFlow 2 API and allows the user to specify fault parameters and perform layer-wise fault injection into the TensorFlow 2 neural networks. It enables the automated injection of random bitflips. The paper describes the software architecture of the framework. The framework is open source and freely available on the GitHub. The application of InjectTF2 is demonstrated with extensive fault injection experiments on a Convolutional Neural Network (CNN) trained using the GTSRB dataset. The experiments’ results show how random bitflips in the outputs of the CNNs layers affect the classification accuracy. Such results support not only numerical analysis of reliability and safety characteristics but also help to identify the most critical CNN layers for more robust and fault-tolerant design.

Copyright

© 2020, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Emil Valiev
AU  - Nafisa Yusupova
AU  - Andrey Morozov
AU  - Klaus Janschek
AU  - Michael Beyer
PY  - 2020
DA  - 2020/11/10
TI  - Evaluation of the Impact of Random Computing Hardware Faults on the Performance of Convolutional Neural Networks
BT  - Proceedings of the 8th Scientific Conference on Information Technologies for Intelligent Decision Making Support (ITIDS 2020)
PB  - Atlantis Press
SP  - 307
EP  - 312
SN  - 1951-6851
UR  - https://doi.org/10.2991/aisr.k.201029.058
DO  - 10.2991/aisr.k.201029.058
ID  - Valiev2020
ER  -