Bio-Inspired Architectures Substantially Reduce the Memory Requirements of Neural Network Models

Loading...
Thumbnail Image

Date

2021-02

Journal Title

Journal ISSN

Volume Title

Publisher

Frontiers Media SA

Abstract

We propose a neural network model for the jumping escape response behavior observed in the cricket cercal sensory system. This sensory system processes low-intensity air currents in the animal's immediate environment generated by predators, competitors, and mates. Our model is inspired by decades of physiological and anatomical studies. We compare the performance of our model with a model derived through a universal approximation, or a generic deep learning, approach, and demonstrate that, to achieve the same performance, these models required between one and two orders of magnitude more parameters. Furthermore, since the architecture of the bio-inspired model is defined by a set of logical relations between neurons, we find that the model is open to interpretation and can be understood. This work demonstrates the potential of incorporating bio-inspired architectural motifs, which have evolved in animal nervous systems, into memory efficient neural network models.

Description

Keywords

neural network

Citation

Dalgaty T, Miller JP, Vianello E and Casas J (2021) Bio-Inspired Architectures Substantially Reduce the Memory Requirements of Neural Network Models. Front. Neurosci. 15:612359.
Copyright (c) 2002-2022, LYRASIS. All rights reserved.