Please use this identifier to cite or link to this item: https://hdl.handle.net/20.500.11851/11497
Title: Switched Neural Networks for Simultaneous Learning of Multiple Functions
Authors: Efe, Mehmet Önder
Kurkcu, Burak
Kasnakoğlu, Coşku
Mohamed, Zaharuddin
Liu, Zhijie
Keywords: Neural networks
parameter switching
learning multiple functions
genetic algorithms
Publisher: Ieee-Inst Electrical Electronics Engineers Inc
Abstract: This paper introduces the notion of switched neural networks for learning multiple functions under different switching configurations. The neural network structure has adjustable parameters and for each function the state of the parameter vector is determined by a mask vector, 1/0 for active/inactive or +1/-1 for plain/inverted. The optimization problem is to schedule the switching strategy (mask vector) required for each function together with the best parameter vector (weights/biases) minimizing the loss function. This requires a procedure that optimizes a vector containing real and binary values simultaneously to discover commonalities among various functions. Our studies show that a small sized neural network structure with an appropriate switching regime is able to learn multiple functions successfully. During the tests focusing on classification, we considered 2-variable binary functions and all 16 combinations have been chosen as the functions. The regression tests consider four functions of two variables. Our studies showed that simple NN structures are capable of storing multiple information via appropriate switching.
URI: https://doi.org/10.1109/TETCI.2024.3369981
https://hdl.handle.net/20.500.11851/11497
ISSN: 2471-285X
Appears in Collections:Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection
WoS İndeksli Yayınlar Koleksiyonu / WoS Indexed Publications Collection

Show full item record



CORE Recommender

Page view(s)

50
checked on Nov 4, 2024

Google ScholarTM

Check




Altmetric


Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.