Lecture Notes in Computer Science 12892

Founding Editors

Gerhard GoosKarlsruhe Institute of Technology, Karlsruhe, Germany

Juris HartmanisCornell University, Ithaca, NY, USA

Editorial Board Members

Elisa BertinoPurdue University, West Lafayette, IN, USA

Wen GaoPeking University, Beijing, China

Bernhard SteffenTU Dortmund University, Dortmund, Germany

Gerhard WoegingerRWTH Aachen, Aachen, Germany

Moti YungColumbia University, New York, NY, USA

More information about this subseries at http://www.springer.com/series/7407

Igor Farkaš • Paolo Masulli •

Sebastian Otte • Stefan Wermter (Eds.)

Artificial Neural Networksand Machine Learning –

ICANN 202130th International Conference on Artificial Neural NetworksBratislava, Slovakia, September 14–17, 2021Proceedings, Part II

123

EditorsIgor FarkašComenius University in BratislavaBratislava, Slovakia

Paolo MasulliiMotions A/SCopenhagen, Denmark

Sebastian OtteUniversity of TübingenTübingen, Baden-Württemberg, Germany

Stefan WermterUniversität HamburgHamburg, Germany

ISSN 0302-9743 ISSN 1611-3349 (electronic)Lecture Notes in Computer ScienceISBN 978-3-030-86339-5 ISBN 978-3-030-86340-1 (eBook)https://doi.org/10.1007/978-3-030-86340-1

LNCS Sublibrary: SL1 – Theoretical Computer Science and General Issues

© Springer Nature Switzerland AG 2021This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of thematerial is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation,broadcasting, reproduction on microfilms or in any other physical way, and transmission or informationstorage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology nowknown or hereafter developed.The use of general descriptive names, registered names, trademarks, service marks, etc. in this publicationdoes not imply, even in the absence of a specific statement, that such names are exempt from the relevantprotective laws and regulations and therefore free for general use.The publisher, the authors and the editors are safe to assume that the advice and information in this book arebelieved to be true and accurate at the date of publication. Neither the publisher nor the authors or the editorsgive a warranty, expressed or implied, with respect to the material contained herein or for any errors oromissions that may have been made. The publisher remains neutral with regard to jurisdictional claims inpublished maps and institutional affiliations.

This Springer imprint is published by the registered company Springer Nature Switzerland AGThe registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland

Preface

Research on artificial neural networks has progressed over decades, in recent yearsbeing fueled especially by deep learning that has proven, albeit data-greedy, efficient insolving various, mostly supervised, tasks. Applications of artificial neural networks,especially related to artificial intelligence, affect our lives, providing new horizons.Examples range from autonomous car driving, virtual assistants, and decision supportsystems to healthcare data analytics, financial forecasting, and smart devices in ourhomes, just to name a few. These developments, however, also provide challenges,which were not imaginable previously, e.g., verification of raw data, explaining thecontents of neural networks, and adversarial machine learning.

The International Conference on Artificial Neural Networks (ICANN) is the annualflagship conference of the European Neural Network Society (ENNS). Last year, due tothe COVID-19 pandemic, we decided not to hold the conference but to prepare theICANN proceedings in written form. This year, due to the still unresolved pandemic,the Organizing Committee, together with the Executive Committee of ENNS decidedto organize ICANN 2021 online, since we felt the urge to allow research presentationsand live discussions, following the now available alternatives of online conferenceorganization. So for the first time, ENNS and the Organizing Committee preparedICANN as an online event with all its challenges and sometimes unforeseeable events!

Following a long-standing successful collaboration, the proceedings of ICANN arepublished as volumes within the Lecture Notes in Computer Science Springer series.The response to this year’s call for papers resulted, unexpectedly, in a record number of557 article submissions (a 46% rise compared to previous year), of which almost allwere full papers. The paper selection and review process that followed was decidedduring the online meeting of the Bratislava organizing team and the ENNS ExecutiveCommittee. The 40 Program Committee (PC) members agreed to check the submis-sions for the formal requirements and 64 papers were excluded from the subsequentreviews. The majority of the PC members have doctoral degrees (80%) and 75%of them are also professors. We also took advantage of filled-in online questionnairesproviding the reviewers’ areas of expertise. The reviewers were assigned one to fourpapers, and the papers with undecided scores also received reports from PC memberswhich helped in making a final decision.

In total, 265 articles were accepted for the proceedings and the authors wererequested to submit final versions. The acceptance rate was hence about 47% whencalculated from all initial submissions. A list of PC members and reviewers who agreedto publish their names is included in the proceedings. With these procedures we tried tokeep the quality of the proceedings high while still having a critical mass of contri-butions reflecting the progress of the field. Overall we hope that these proceedings willcontribute to the dissemination of new results by the neural network community duringthese challenging times and we hope that we can have a physical ICANN in 2022.

Finally, we very much thank the Program Committee and the reviewers for theirinvaluable work.

September 2021 Igor FarkašPaolo MasulliSebastian Otte

Stefan Wermter

vi Preface

Organization

Organizing Committee

Cabessa Jérémie Université Paris 2 Panthéon-Assas, FranceKerzel Matthias University of Hamburg, GermanyLintas Alessandra University of Lausanne, SwitzerlandMalinovská Kristína Comenius University in Bratislava, SlovakiaMasulli Paolo iMotions A/S, Copenhagen, DenmarkOtte Sebastian University of Tübingen, GermanyWedeman Roseli Universidade do Estado do Rio de Janeiro, Brazil

Program Committee Chairs

Igor Farkaš Comenius University in Bratislava, SlovakiaPaolo Masulli iMotions A/S, DenmarkSebastian Otte University of Tübingen, GermanyStefan Wermter University of Hamburg, Germany

Program Committee

Andrejková Gabriela Pavol Jozef Šafárik University in Košice, SlovakiaAtencia Miguel Universidad de Malaga, SpainBodapati Jyostna Devi Indian Institute of Technology, Madras, IndiaBougie Nicolas Sokendai/National Institute of Informatics, JapanBoža Vladimír Comenius University in Bratislava, SlovakiaCabessa Jérémie Université Paris 2 Panthéon-Assas, FranceDi Nuovo Alessandro Sheffield Hallam University, UKDuch Włodzisław Nicolaus Copernicus University, PolandEppe Manfred Universität Hamburg, GermanyFang Yuchun Shanghai University, ChinaGarcke Jochen Universität Bonn, GermanyGregor Michal University of Žilina, SlovakiaGuckert Michael Technische Hochschule Mittelhessen, GermanyGuillén Alberto University of Granada, SpainHeinrich Stefan University of Tokyo, JapanHinaut Xavier Inria, FranceHumaidan Dania University of Tübingen, GermanyJolivet Renaud University of Geneva, SwitzerlandKoprinkova-Hristova Petia Bulgarian Academy of Sciences, BulgariaLintas Alessandra University of Lausanne, SwitzerlandLü Shuai Jilin University, ChinaMicheli Alessio Università di Pisa, Italy

Oravec Miloš Slovak University of Technology in Bratislava,Slovakia

Otte Sebastian University of Tübingen, GermanyPeltonen Jaakko Tampere University, FinlandPiuri Vincenzo University of Milan, ItalyPons Rivero Antonio Javier Universitat Politècnica de Catalunya, Barcelona, SpainSchmidt Jochen TH Rosenheim, GermanySchockaert Cedric Paul Wurth S.A., LuxembourgSchwenker Friedhelm University of Ulm, GermanyTakáč Martin Comenius University in Bratislava, SlovakiaTartaglione Enzo Università degli Studi di Torino, ItalyTetko Igor Helmholtz Zentrum München, GermanyTriesch Jochen Frankfurt Institute for Advanced Studies, GermanyVavrečka Michal Czech Technical University in Prague, Czech RepublicVerma Sagar CentraleSupélec, Université Paris-Saclay, FranceVigário Ricardo Nova School of Science and Technology, PortugalWedemann Roseli Universidade do Estado do Rio de Janeiro, BrazilWennekers Thomas Plymouth University, UK

Reviewers

Abawi Fares University of Hamburg, GermanyAganian Dustin Technical University Ilmenau, GermanyAhrens Kyra University of Hamburg, GermanyAlexandre Frederic Inria Bordeaux, FranceAlexandre Luís University of Beira Interior, PortugalAli Hazrat Umeå University, SwedenAlkhamaiseh Koloud Western Michigan University, USAAmaba Takafumi Fukuoka University, JapanAmbita Ara Abigail University of the Philippines Diliman, PhilippinesAmeur Hanen University of Sfax, TunisiaAmigo Galán Glauco A. Baylor University, USAAn Shuqi Chongqing University, ChinaAouiti Chaouki Université de Carthage, TunisiaArany Adam Katholieke Universiteit Leuven, BelgiumArnold Joshua University of Queensland, AustraliaArtelt André Bielefeld University, GermanyAuge Daniel Technical University of Munich, GermanyBac Le Hoai University of Science, VietnamBacaicoa-Barber Daniel University Carlos III of Madrid, SpainBai Xinyi National University of Defense Technology, ChinaBanka Asif Islamic University of Science & Technology, IndiaBasalla Marcus University of Liechtenstein, LiechtensteinBasterrech Sebastian Technical University of Ostrava, Czech RepublicBauckhage Christian Fraunhofer IAIS, GermanyBayer Markus Technical University of Darmstadt, Germany

viii Organization

Bečková Iveta Comenius University in Bratislava, SlovakiaBenalcázar Marco Escuela Politécnica Nacional, EcuadorBennis Achraf Institut de Recherche en Informatique de Toulouse,

FranceBerlemont Samuel Orange Labs, Grenoble, FranceBermeitinger Bernhard Universität St. Gallen, SwitzerlandBhoi Suman National University of Singapore, SingaporeBiesner David Fraunhofer IAIS, GermanyBilbrey Jenna Pacific Northwest National Lab, USABlasingame Zander Clarkson University, USABochkarev Vladimir Kazan Federal University, RussiaBohte Sander Universiteit van Amsterdam, The NetherlandsBouchachia Abdelhamid Bournemouth University, UKBourguin Grégory Université du Littoral Côte d’Opale, FranceBreckon Toby Durham University, UKBuhl Fred University of Florida, USAButz Martin V. University of Tübingen, GermanyCaillon Paul Université de Lorraine, Nancy, FranceCamacho Hugo C. E. Universidad Autónoma de Tamaulipas, MexicoCamurri Antonio Università di Genova, ItalyCao Hexin OneConnect Financial Technology, ChinaCao Tianyang Peking University, ChinaCao Zhijie Shanghai Jiao Tong University, ChinaCarneiro Hugo Universität Hamburg, GermanyChadha Gavneet Singh South Westphalia University of Applied Sciences,

GermanyChakraborty Saikat C. V. Raman Global University, IndiaChang Hao-Yuan University of California, Los Angeles, USAChang Haodong University of Technology Sydney, AustraliaChen Cheng Tsinghua University, ChinaChen Haopeng Shanghai Jiao Tong University, ChinaChen Junliang Shenzhen University, ChinaChen Tianyu Northwest Normal University, ChinaChen Wenjie Communication University of China, ChinaCheng Zhanglin Chinese Academy of Sciences, ChinaChenu Alexandre Sorbonne Université, FranceChoi Heeyoul Handong Global University, South KoreaChrista Sharon RV Institute of Technology and Management, IndiaCîtea Ingrid Bitdefender Central, RomaniaColliri Tiago Universidade de São Paulo, BrazilCong Cong Chinese Academy of Sciences, ChinaCoroiu Adriana Mihaela Babes-Bolyai University, RomaniaCortez Paulo University of Minho, PortugalCuayáhuitl Heriberto University of Lincoln, UKCui Xiaohui Wuhan University, ChinaCutsuridis Vassilis University of Lincoln, UK

Organization ix

Cvejoski Kostadin Fraunhofer IAIS, GermanyD’Souza Meenakshi International Institute of Information Technology,

Bangalore, IndiaDai Feifei Chinese Academy of Sciences, ChinaDai Peilun Boston University, USADai Ruiqi INSA Lyon, FranceDang Kai Nankai University, ChinaDang Xuan Tsinghua University, ChinaDash Tirtharaj Birla Institute of Technology and Science, Pilani, IndiaDavalas Charalampos Harokopio University of Athens, GreeceDe Brouwer Edward Katholieke Universiteit Leuven, BelgiumDeng Minghua Peking University, ChinaDevamane Shridhar KLE Institute of Technology, Hubballi, IndiaDi Caterina Gaetano University of Strathclyde, UKDi Sarli Daniele Università di Pisa, ItalyDing Juncheng University of North Texas, USADing Zhaoyun National University of Defense Technology, ChinaDold Dominik Siemens, Munich, GermanyDong Zihao Jinan University, ChinaDu Songlin Southeast University, ChinaEdwards Joshua University of North Carolina Wilmington, USAEguchi Shu Fukuoka University, JapanEisenbach Markus Ilmenau University of Technology, GermanyErlhagen Wolfram University of Minho, PortugalFang Tiyu University of Jinan, ChinaFeldager Cilie Technical University of Denmark, DenmarkFerianc Martin University College London, UKFerreira Flora University of Minho, PortugalFevens Thomas Concordia University, CanadaFriedjungová Magda Czech Technical University in Prague, Czech RepublicFu Xianghua Shenzhen University, ChinaFuhl Wolfgang Universität Tübingen, GermanyGamage Vihanga Technological University Dublin, IrelandGanguly Udayan Indian Institute of Technology, Bombay, IndiaGao Ruijun Tianjin University, ChinaGao Yapeng University of Tübingen, GermanyGao Yue Beijing University of Posts and Telecommunications,

ChinaGao Zikai National University of Defense Technology, ChinaGault Richard Queen’s University Belfast, UKGe Liang Chongqing University, ChinaGeissler Dominik Relayr GmbH, Munich, GermanyGepperth Alexander ENSTA ParisTech, FranceGerum Christoph University of Tübingen, GermanyGiancaterino Claudio G. Catholic University of Milan, ItalyGiese Martin University Clinic Tübingen, Germany

x Organization

Gikunda Patrick Dedan Kimathi University of Technology, KenyaGoel Anmol Guru Gobind Singh Indraprastha University, IndiaGöpfert Christina Bielefeld University, GermanyGöpfert Jan Philip Bielefeld University, GermanyGoyal Nidhi Indraprastha Institute of Information Technology, IndiaGrangetto Marco Università di Torino, ItalyGrüning Philipp University of Lübeck, GermanyGu Xiaoyan Chinese Academy of Sciences, Beijing, ChinaGuo Hongcun China Three Gorges University, ChinaGuo Ling Northwest University, ChinaGuo Qing Nanyang Technological University, SingaporeGuo Song Xi’an University of Architecture and Technology,

ChinaGupta Sohan Global Institute of Technology, Jaipur, IndiaHakenes Simon Ruhr-Universität Bochum, GermanyHan Fuchang Central South University, ChinaHan Yi University of Melbourne, AustraliaHansen Lars Kai Technical University of Denmark, DenmarkHaque Ayaan Saratoga High School, USAHassen Alan Kai Leiden University, The NetherlandsHauberg Søren Technical University of Denmark, DenmarkHe Tieke Nanjing University, ChinaHe Wei Nanyang Technological University, SingaporeHe Ziwen Chinese Academy of Sciences, ChinaHeese Raoul Fraunhofer ITWM, GermanyHerman Pawel KTH Royal Institute of Technology, SwedenHolas Juraj Comenius University in Bratislava, SlovakiaHorio Yoshihiko Tohoku University, JapanHou Hongxu Inner Mongolia University, ChinaHu Ming-Fei China University of Petroleum, ChinaHu Ting Hasso Plattner Institute, GermanyHu Wenxin East China Normal University, ChinaHu Yanqing Sichuan University, ChinaHuang Chenglong National University of Defense Technology, ChinaHuang Chengqiang Huawei Technology, Ltd., ChinaHuang Jun Chinese Academy of Sciences, Shanghai, ChinaHuang Ruoran Chinese Academy of Sciences, ChinaHuang Wuliang Chinese Academy of Sciences, Beijing, ChinaHuang Zhongzhan Tsinghua University, ChinaIannella Nicolangelo University of Oslo, NorwayIenco Dino INRAE, FranceIllium Steffen Ludwig-Maximilians-Universität München, GermanyIyer Naresh GE Research, USAJalalvand Azarakhsh Ghent University, BelgiumJapa Sai Sharath Southern Illinois University, USAJavaid Muhammad Usama Eura Nova, Belgium

Organization xi

Jia Qiaomei Northwest University, ChinaJia Xiaoning Inner Mongolia University, ChinaJin Peiquan University of Science and Technology of China, ChinaJirak Doreen Istituto Italiano di Tecnologia, ItalyJodelet Quentin Tokyo Institute of Technology, JapanKai Tang Toshiba, ChinaKaram Ralph Université Franche-Comté, FranceKarlbauer Matthias University of Tübingen, GermanyKaufhold Marc-André Technical University of Darmstadt, GermanyKerzel Matthias University of Hamburg, GermanyKeurulainen Antti Bitville Oy, FinlandKitamura Takuya National Institute of Technology, JapanKocur Viktor Comenius University in Bratislava, SlovakiaKoike Atsushi National Institute of Technology, JapanKotropoulos Constantine Aristotle University of Thessaloniki, GreeceKovalenko Alexander Czech Technical University, Czech RepublicKrzyzak Adam Concordia University, CanadaKurikawa Tomoki Kansai Medical University, JapanKurpiewski Evan University of North Carolina Wilmington, USAKurt Mehmet Necip Columbia University, USAKushwaha Sumit Kamla Nehru Institute of Technology, IndiaLai Zhiping Fudan University, ChinaLang Jana Hertie Institute for Clinical Brain Research, GermanyLe Hieu Boston University, USALe Ngoc Hanoi University of Science and Technology, VietnamLe Thanh University of Science, Hochiminh City, VietnamLee Jinho Yonsei University, South KoreaLefebvre Grégoire Orange Labs, FranceLehmann Daniel University of Greifswald, GermanyLei Fang University of Lincoln, UKLéonardon Mathieu IMT Atlantique, FranceLewandowski Arnaud Université du Littoral Côte d’Opale, Calais, FranceLi Caiyuan Shanghai Jiao Tong University, ChinaLi Chuang Xi’an Jiaotong University, ChinaLi Ming-Fan Ping An Life Insurance of China, Ltd., ChinaLi Qing The Hong Kong Polytechnic University, ChinaLi Tao Peking University, ChinaLi Xinyi Southwest University, ChinaLi Xiumei Hangzhou Normal University, ChinaLi Yanqi University of Jinan, ChinaLi Yuan Defence Innovation Institute, ChinaLi Zhixin Guangxi Normal University, ChinaLian Yahong Dalian University of Technology, ChinaLiang Nie Southwest University of Science and Technology,

ChinaLiang Qi Chinese Academy of Sciences, Beijing, China

xii Organization

Liang Senwei Purdue University, USALiang Yuxin Northwest University, ChinaLim Nengli Singapore University of Technology and Design,

SingaporeLiu Gongshen Shanghai Jiao Tong University, ChinaLiu Haolin Chinese Academy of Sciences, ChinaLiu Jian-Wei China University of Petroleum, ChinaLiu Juan Wuhan University, ChinaLiu Junxiu Guangxi Normal University, ChinaLiu Qi Chongqing University, ChinaLiu Shuang Huazhong University of Science and Technology,

ChinaLiu Shuting University of Shanghai for Science and Technology,

ChinaLiu Weifeng China University of Petroleum, ChinaLiu Yan University of Shanghai for Science and Technology,

ChinaLiu Yang Fudan University, ChinaLiu Yi-Ling Imperial College London, UKLiu Zhu University of Electronic Science and Technology

of China, ChinaLong Zi Shenzhen Technology University, ChinaLopes Vasco Universidade da Beira Interior, PortugalLu Siwei Guangdong University of Technology, ChinaLu Weizeng Shenzhen University, ChinaLukyanova Olga Russian Academy of Sciences, RussiaLuo Lei Kansas State University, USALuo Xiao Peking University, ChinaLuo Yihao Huazhong University of Science and Technology,

ChinaMa Chao Wuhan University, ChinaMa Zeyu Harbin Institute of Technology, ChinaMalialis Kleanthis University of Cyprus, CyprusManoonpong Poramate Vidyasirimedhi Institute of Science and Technology,

ThailandMartinez Rego David Data Spartan Ltd., UKMatsumura Tadayuki Hitachi, Ltd., Tokyo, JapanMekki Asma Université de Sfax, TunisiaMerkel Cory Rochester Institute of Technology, USAMirus Florian Intel Labs, GermanyMizuno Hideyuki Suwa University of Science, JapanMoh Teng-Sheng San Jose State University, USAMohammed Elmahdi K. Kasdi Merbah university, AlgeriaMonshi Maram University of Sydney, AustraliaMoreno Felipe Universidad Católica San Pablo, PeruMorra Lia Politecnico di Torino, Italy

Organization xiii

Morzy Mikołaj Poznań University of Technology, PolandMouček Roman University of West Bohemia, Czech RepublicMoukafih Youness International University of Rabat, MoroccoMouysset Sandrine University of Toulouse, FranceMüller Robert Ludwig-Maximilians-Universität München, GermanyMutschler Maximus University of Tübingen, GermanyNajari Naji Orange Labs, FranceNanda Abhilasha Vellore Institute of Technology, IndiaNguyen Thi Nguyet Que Technological University Dublin, IrelandNikitin Oleg Russian Academy of Sciences, RussiaNjah Hasna University of Sfax, TunisiaNyabuga Douglas Donghua University, ChinaObafemi-Ajayi Tayo Missouri State University, USAOjha Varun University of Reading, UKOldenhof Martijn Katholieke Universiteit Leuven, BelgiumOneto Luca Università di Genova, ItalyOota Subba Reddy Inria, Bordeaux, FranceOprea Mihaela Petroleum-Gas University of Ploiesti, RomaniaOsorio John Barcelona Supercomputing Center, SpainOuni Achref Institut Pascal UCA, FrancePan Yongping Sun Yat-sen University, ChinaPark Hyeyoung Kyungpook National University, South KoreaPateux Stéphane Orange Labs, FrancePecháč Matej Comenius University in Bratislava, SlovakiaPecyna Leszek University of Liverpool, UKPeng Xuyang China University of Petroleum, ChinaPham Viet Toshiba, JapanPietroń Marcin AGH University of Science and Technology, PolandPócoš Štefan Comenius University in Bratislava, SlovakiaPosocco Nicolas Eura Nova, BelgiumPrasojo Radityo Eko Universitas Indonesia, IndonesiaPreuss Mike Universiteit Leiden, The NetherlandsQiao Peng National University of Defense Technology, ChinaQiu Shoumeng Shanghai Institute of Microsystem and Information

Technology, ChinaQuan Hongyan East China Normal University, ChinaRafiee Laya Concordia University, CanadaRangarajan Anand University of Florida, USARavichandran Naresh Balaji KTH Royal Institute of Technology, SwedenRenzulli Riccardo University of Turin, ItalyRichter Mats Universität Osnabrück, GermanyRobine Jan Heinrich Heine University Düsseldorf, GermanyRocha Gil University of Porto, PortugalRodriguez-Sanchez Antonio Universität Innsbruck, AustriaRosipal Roman Slovak Academy of Sciences, Slovakia

xiv Organization

Rusiecki Andrzej Wroclaw University of Science and Technology,Poland

Salomon Michel Université Bourgogne Franche-Comté, FranceSarishvili Alex Fraunhofer ITWM, GermanySasi Swapna Birla Institute of Technology and Science, IndiaSataer Yikemaiti Southeast University, ChinaSchaaf Nina Fraunhofer IPA, GermanySchak Monika University of Applied Sciences, Fulda, GermanySchilling Malte Bielefeld University, GermanySchmid Kyrill Ludwig-Maximilians-Universität München, GermanySchneider Johannes University of Liechtenstein, LiechtensteinSchwab Malgorzata University of Colorado at Denver, USASedlmeier Andreas Ludwig-Maximilians-Universität München, GermanySendera Marcin Jagiellonian University, PolandShahriyar Rifat Bangladesh University of Engineering and Technology,

BangladeshShang Cheng Fudan University, ChinaShao Jie University of Electronic Science and Technology

of China, ChinaShao Yang Hitachi Ltd., JapanShehu Amarda George Mason University, USAShen Linlin Shenzhen University, ChinaShenfield Alex Sheffield Hallam University, UKShi Ying Chongqing University, ChinaShrestha Roman Intelligent Voice Ltd., UKSifa Rafet Fraunhofer IAIS, GermanySinha Aman CNRS and University of Lorraine, FranceSoltani Zarrin Pouya Institute for High Performance Microelectronics,

GermanySong Xiaozhuang Southern University of Science and Technology, ChinaSong Yuheng Shanghai Jiao Tong University, ChinaSong Ziyue Shanghai Jiao Tong University, ChinaSowinski-Mydlarz Viktor London Metropolitan University, UKSteiner Peter Technische Universität Dresden, GermanyStettler Michael University of Tübingen, GermanyStoean Ruxandra University of Craiova, RomaniaSu Di Beijing Institute of Technology, ChinaSuarez Oscar J. Instituto Politécnico Nacional, MéxicoSublime Jérémie Institut supérieur d’électronique de Paris, FranceSudharsan Bharath National University of Ireland, Galway, IrelandSugawara Toshiharu Waseda University, JapanSui Yongduo University of Science and Technology of China, ChinaSui Zhentao Soochow University, ChinaSwiderska-Chadaj Zaneta Warsaw University of Technology, PolandSzandała Tomasz Wroclaw University of Science and Technology,

Poland

Organization xv

Šejnová Gabriela Czech Technical University in Prague, Czech RepublicTang Chenwei Sichuan University, ChinaTang Jialiang Southwest University of Science and Technology,

ChinaTaubert Nick University Clinic Tübingen, GermanyTek Faik Boray Isik University, TurkeyTessier Hugo Stellantis, FranceTian Zhihong Guangzhou University, ChinaTianze Zhou Beijing Institute of Technology, ChinaTihon Simon Eura Nova, BelgiumTingwen Liu Chinese Academy of Sciences, ChinaTong Hao Southern University of Science and Technology, ChinaTorres-Moreno

Juan-ManuelUniversité d’Avignon, France

Towobola Oluyemisi Folake Obafemi Awolowo University, NigeriaTrinh Anh Duong Technological University Dublin, IrelandTuna Matúš Comenius University in Bratislava, SlovakiaUelwer Tobias Heinrich Heine University Düsseldorf, GermanyVan Rullen Rufin CNRS, Toulouse, FranceVarlamis Iraklis Harokopio University of Athens, GreeceVašata Daniel Czech Technical University in Prague, Czech RepublicVásconez Juan Escuela Politécnica Nacional, EcuadorVatai Emil RIKEN, JapanViéville Thierry Inria, Antibes, FranceWagner Stefan Heinrich Heine University Düsseldorf, GermanyWan Kejia Defence Innovation Institute, ChinaWang Huiling Tampere University, FinlandWang Jiaan Soochow University, ChinaWang Jinling Ulster University, UKWang Junli Tongji University, ChinaWang Qian Durham University, UKWang Xing Ningxia University, ChinaWang Yongguang Beihang University, ChinaWang Ziming Shanghai Jiao Tong University, ChinaWanigasekara Chathura University of Auckland, New ZealandWatson Patrick Minerva KGI, USAWei Baole Chinese Academy of Sciences, ChinaWei Feng York University, CanadaWenninger Marc Rosenheim Technical University of Applied Sciences,

GermanyWieczorek Tadeusz Silesian University of Technology, PolandWiles Janet University of Queensland, AustraliaWindheuser Christoph ThoughtWorks Inc., GermanyWolter Moritz Rheinische Friedrich-Wilhelms-Universität Bonn,

Germany

xvi Organization

Wu Ancheng Pingan Insurance, ChinaWu Dayan Chinese Academy of Sciences, ChinaWu Jingzheng Chinese Academy of Sciences, ChinaWu Nier Inner Mongolia University, ChinaWu Song Southwest University, ChinaXie Yuanlun University of Electronic Science and Technology

of China, ChinaXu Dongsheng National University of Defense Technology, ChinaXu Jianhua Nanjing Normal University, ChinaXu Peng Technical University of Munich, GermanyYaguchi Takaharu Kobe University, JapanYamamoto Hideaki Tohoku University, JapanYang Gang Renmin University of China, ChinaYang Haizhao Purdue University, USAYang Jing Guangxi Normal University, ChinaYang Jing Hefei University of Technology, ChinaYang Liu Tianjin University, ChinaYang Sidi Concordia University, CanadaYang Sun Soochow University, ChinaYang Wanli Harbin Institute of Technology, ChinaYang XiaoChen Tianjin University of Technology, ChinaYang Xuan Shenzhen University, ChinaYang Zhao Leiden University, The NetherlandsYang Zhengfeng East China Normal University, ChinaYang Zhiguang Chinese Academy of Sciences, ChinaYao Zhenjie Chinese Academy of Sciences, ChinaYe Kai Wuhan University, ChinaYin Bojian Centrum Wiskunde & Informatica, The NetherlandsYu James Southern University of Science and Technology, ChinaYu Wenxin Southwest University of Science and Technology,

ChinaYu Yipeng Tencent, ChinaYu Yue BNU-HKBU United International College, ChinaYuan Limengzi Tianjin University, ChinaYuchen Ge Hefei University of Technology, ChinaYuhang Guo Peking University, ChinaYury Tsoy Solidware, South KoreaZeng Jia Jilin University, ChinaZeng Jiayuan University of Shanghai for Science and Technology,

ChinaZhang Dongyang University of Electronic Science and Technology

of China, ChinaZhang Jiacheng Beijing University of Posts and Telecommunications,

ChinaZhang Jie Nanjing University, ChinaZhang Kai Chinese Academy of Sciences, China

Organization xvii

Zhang Kaifeng Independent Researcher, ChinaZhang Kun Chinese Academy of Sciences, ChinaZhang Luning China University of Petroleum, ChinaZhang Panpan Chinese Academy of Sciences, ChinaZhang Peng Chinese Academy of Sciences, ChinaZhang Wenbin Carnegie Mellon University, USAZhang Xiang National University of Defense Technology, ChinaZhang Xuewen Southwest University of Science and Technology,

ChinaZhang Yicheng University of Lincoln, UKZhang Yingjie Hunan University, ChinaZhang Yunchen University of Electronic Science and Technology

of China, ChinaZhang Zhiqiang Southwest University of Science and Technology,

ChinaZhao Liang University of São Paulo, BrazilZhao Liang Dalian University of Technology, ChinaZhao Qingchao Harbin Engineering University, ChinaZhao Ying University of Shanghai for Science and Technology,

ChinaZhao Yuekai National University of Defense Technology, ChinaZheng Yuchen Kyushu University, JapanZhong Junpei Plymouth University, UKZhou Shiyang Defense Innovation Institute, ChinaZhou Xiaomao Harbin Engineering University, ChinaZhou Yucan Chinese Academy of Sciences, ChinaZhu Haijiang Beijing University of Chemical Technology, ChinaZhu Mengting National University of Defense Technology, ChinaZhu Shaolin Zhengzhou University of Light Industry, ChinaZhu Shuying The University of Hong Kong, ChinaZugarini Andrea University of Florence, Italy

xviii Organization

Contents – Part II

Computer Vision and Object Detection

Selective Multi-scale Learning for Object Detection. . . . . . . . . . . . . . . . . . . 3Junliang Chen, Weizeng Lu, and Linlin Shen

DRENet: Giving Full Scope to Detection and Regression-Based Estimationfor Video Crowd Counting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Changsheng Liu, Yuan Huang, Yadong Mu, and Xiaoming Yu

Sisfrutos Papaya: A Dataset for Detection and Classification of Diseasesin Papaya . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

Jairo Lucas de Moraes, Jorcy de Oliveira Neto, Jacson R. Correia-Silva,Thiago M. Paixão, Claudine Badue, Thiago Oliveira-Santos,and Alberto F. De Souza

Faster-LTN: A Neuro-Symbolic, End-to-End ObjectDetection Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40

Francesco Manigrasso, Filomeno Davide Miro, Lia Morra,and Fabrizio Lamberti

GC-MRNet: Gated Cascade Multi-stage Regression Networkfor Crowd Counting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

Ying Shi, Jun Sang, Jinghan Tan, Zhongyuan Wu, Bin Cai,and Nong Sang

Latent Feature-Aware and Local Structure-Preserving Network for 3DCompletion from a Single Depth View . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Caixia Liu, Dehui Kong, Shaofan Wang, Jinghua Li, and Baocai Yin

Facial Expression Recognition by Expression-SpecificRepresentation Swapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80

Jie Lei, Zhao Liu, Zeyu Zou, Tong Li, Juan Xu, Zunlei Feng,and Ronghua Liang

Iterative Error Removal for Time-of-Flight Depth Imaging . . . . . . . . . . . . . . 92Zhuolin Zheng, Yinzhang Ding, Xiaotian Tang, Yu Cai, Dongxiao Li,Ming Zhang, Hongyang Xie, and Xuanfu Li

Blurred Image Recognition: A Joint Motion Deblurringand Classification Loss-Aware Approach . . . . . . . . . . . . . . . . . . . . . . . . . . 106

Wenjie Zhang and Zhi Wang

Learning How to Zoom In: Weakly Supervised ROI-Based-DAMfor Fine-Grained Visual Classification . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118

Wenjie Chen, Shuang Ran, Tian Wang, and Lihong Cao

Convolutional Neural Networks and Kernel Methods

(Input) Size Matters for CNN Classifiers . . . . . . . . . . . . . . . . . . . . . . . . . . 133Mats L. Richter, Wolf Byttner, Ulf Krumnack, Anna Wiedenroth,Ludwig Schallner, and Justin Shenk

Accelerating Depthwise Separable Convolutions with Vector Processor . . . . . 145Yuekai Zhao, Jianzhuang Lu, and Xiaowen Chen

KCNet: Kernel-Based Canonicalization Network for Entitiesin Recruitment Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157

Nidhi Goyal, Niharika Sachdeva, Anmol Goel, Jushaan Singh Kalra,and Ponnurangam Kumaraguru

Deep Unitary Convolutional Neural Networks . . . . . . . . . . . . . . . . . . . . . . 170Hao-Yuan Chang and Kang L. Wang

Deep Learning and Optimization I

DPWTE: A Deep Learning Approach to Survival Analysis Usinga Parsimonious Mixture of Weibull Distributions . . . . . . . . . . . . . . . . . . . . 185

Achraf Bennis, Sandrine Mouysset, and Mathieu Serrurier

First-Order and Second-Order Variants of the Gradient Descentin a Unified Framework . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197

Thomas Pierrot, Nicolas Perrin-Gilbert, and Olivier Sigaud

Bayesian Optimization for Backpropagation in Monte-Carlo Tree Search . . . . 209Nengli Lim and Yueqin Li

Growing Neural Networks Achieve Flatter Minima . . . . . . . . . . . . . . . . . . . 222Paul Caillon and Christophe Cerisara

Dynamic Neural Diversification: Path to Computationally SustainableNeural Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235

Alexander Kovalenko, Pavel Kordík, and Magda Friedjungová

Curved SDE-Net Leads to Better Generalization for Uncertainty Estimatesof DNNs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248

YongGuang Wang, HuoBin Tan, and ShuZhen Yao

xx Contents – Part II

EIS - Efficient and Trainable Activation Functions for Better Accuracyand Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260

Koushik Biswas, Sandeep Kumar, Shilpak Banerjee,and Ashish Kumar Pandey

Deep Learning and Optimization II

Why Mixup Improves the Model Performance . . . . . . . . . . . . . . . . . . . . . . 275Masanari Kimura

Mixup Gamblers: Learning to Abstain with Auto-Calibrated Rewardfor Mixed Samples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287

Takumi Yamaguchi and Masahiro Murakawa

Non-iterative Phase Retrieval with Cascaded Neural Networks . . . . . . . . . . . 295Tobias Uelwer, Tobias Hoffmann, and Stefan Harmeling

Incorporating Discrete Wavelet Transformation DecompositionConvolution into Deep Network to Achieve Light Training . . . . . . . . . . . . . 307

Guihua Tao, Wentao Rong, Wanlin Weng, Tingting Dan, Bin Zhang,and Hongmin Cai

MMF: A Loss Extension for Feature Learning in Open Set Recognition . . . . 319Jingyun Jia and Philip K. Chan

On the Selection of Loss Functions Under Known Weak Label Models . . . . . 332Daniel Bacaicoa-Barber, Miquel Perello-Nieto, Raúl Santos-Rodríguez,and Jesús Cid-Sueiro

Distributed and Continual Learning

Bilevel Online Deep Learning in Non-stationary Environment . . . . . . . . . . . 347Ya-nan Han, Jian-wei Liu, Bing-biao Xiao, Xin-Tan Wang,and Xiong-lin Luo

A Blockchain Based Decentralized Gradient Aggregation Designfor Federated Learning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 359

Jian Zhao, Xin Wu, Yan Zhang, Yu Wu, and Zhi Wang

Continual Learning for Fake News Detection from Social Media . . . . . . . . . 372Yi Han, Shanika Karunasekera, and Christopher Leckie

Balanced Softmax Cross-Entropy for Incremental Learning . . . . . . . . . . . . . 385Quentin Jodelet, Xin Liu, and Tsuyoshi Murata

Generalised Controller Design Using Continual Learning . . . . . . . . . . . . . . . 397Diana Benavides-Prado, Chathura Wanigasekara, and Akshya Swain

Contents – Part II xxi

DRILL: Dynamic Representations for Imbalanced Lifelong Learning. . . . . . . 409Kyra Ahrens, Fares Abawi, and Stefan Wermter

Principal Gradient Direction and Confidence Reservoir Samplingfor Continual Learning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 421

Zhiyi Chen and Tong Lin

Explainable Methods

Spontaneous Symmetry Breaking in Data Visualization . . . . . . . . . . . . . . . . 435Cilie W. Feldager, Søren Hauberg, and Lars Kai Hansen

Deep NLP Explainer: Using Prediction Slope to Explain NLP Models. . . . . . 447Reza Marzban and Christopher Crick

Empirically Explaining SGD from a Line Search Perspective . . . . . . . . . . . . 459Maximus Mutschler and Andreas Zell

Towards Ontologically Explainable Classifiers . . . . . . . . . . . . . . . . . . . . . . 472Grégory Bourguin, Arnaud Lewandowski, Mourad Bouneffa,and Adeel Ahmad

Few-shot Learning

Leveraging the Feature Distribution in Transfer-Based Few-Shot Learning . . . 487Yuqing Hu, Vincent Gripon, and Stéphane Pateux

One-Shot Meta-learning for Radar-Based Gesture Sequences Recognition . . . 500Gianfranco Mauro, Mateusz Chmurski, Muhammad Arsalan,Mariusz Zubert, and Vadim Issakov

Few-Shot Learning with Random Erasing and Task-RelevantFeature Transforming. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 512

Xin Wang, Shouhong Wan, and Peiquan Jin

Fostering Compositionality in Latent, Generative Encodings to Solvethe Omniglot Challenge . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 525

Sarah Fabi, Sebastian Otte, and Martin V. Butz

Better Few-Shot Text Classification with Pre-trained Language Model. . . . . . 537Zheng Chen and Yunchen Zhang

Generative Adversarial Networks

Leveraging GANs via Non-local Features. . . . . . . . . . . . . . . . . . . . . . . . . . 551Xuyang Peng, Weifeng Liu, Baodi Liu, Kai Zhang, Xiaoping Lu,and Yicong Zhou

xxii Contents – Part II

On Mode Collapse in Generative Adversarial Networks . . . . . . . . . . . . . . . . 563Kaifeng Zhang

Image Inpainting Using Wasserstein Generative AdversarialImputation Network. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 575

Daniel Vašata, Tomáš Halama, and Magda Friedjungová

COViT-GAN: Vision Transformer for COVID-19 Detection in CT ScanImages with Self-Attention GAN for Data Augmentation . . . . . . . . . . . . . . . 587

Ara Abigail E. Ambita, Eujene Nikka V. Boquio,and Prospero C. Naval Jr.

PhonicsGAN: Synthesizing Graphical Videos from Phonics Songs . . . . . . . . 599Nuha Aldausari, Arcot Sowmya, Nadine Marcus,and Gelareh Mohammadi

A Progressive Image Inpainting Algorithm with a MaskAuto-update Branch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 611

Liang Nie, Wenxin Yu, Xuewen Zhang, Siyuan Li, Ning Jiang,and Zhiqiang Zhang

Hybrid Generative Models for Two-Dimensional Datasets . . . . . . . . . . . . . . 623Hoda Shajari, Jaemoon Lee, Sanjay Ranka, and Anand Rangarajan

Towards Compressing Efficient Generative Adversarial Networksfor Image Translation via Pruning and Distilling . . . . . . . . . . . . . . . . . . . . . 637

Luqi Gong, Chao Li, Hailong Hong, Hui Zhu, Tangwen Qian,and Yongjun Xu

Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 649

Contents – Part II xxiii