1.

Record Nr.

UNINA9910739443203321

Autore

Pedrycz Witold

Titolo

Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems / / edited by Witold Pedrycz, Shyi-Ming Chen

Pubbl/distr/stampa

Cham : , : Springer International Publishing : , : Imprint : Springer, , 2023

ISBN

3-031-32095-6

Edizione

[1st ed. 2023.]

Descrizione fisica

1 online resource (239 pages)

Collana

Studies in Computational Intelligence, , 1860-9503 ; ; 1100

Altri autori (Persone)

ChenShyi-Ming

Disciplina

006.3

Soggetti

Computational intelligence

Artificial intelligence

Computational Intelligence

Artificial Intelligence

Lingua di pubblicazione

Inglese

Formato

Materiale a stampa

Livello bibliografico

Monografia

Nota di contenuto

Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation -- A Geometric Perspective on Feature-Based Distillation -- Knowledge Distillation Across Vision and Language -- Knowledge Distillation in Granular Fuzzy Models by Solving Fuzzy Relation Equations -- Ensemble Knowledge Distillation for Edge Intelligence in Medical Applications -- Self-Distillation with the New Paradigm in Multi-Task Learning -- Knowledge Distillation for Autonomous Intelligent Unmanned System.

Sommario/riassunto

The book provides a timely coverage of the paradigm of knowledge distillation—an efficient way of model compression. Knowledge distillation is positioned in a general setting of transfer learning, which effectively learns a lightweight student model from a large teacher model. The book covers a variety of training schemes, teacher–student architectures, and distillation algorithms. The book covers a wealth of topics including recent developments in vision and language learning, relational architectures, multi-task learning, and representative applications to image processing, computer vision, edge intelligence, and autonomous systems. The book is of relevance to a broad audience including researchers and practitioners active in the area of machine learning and pursuing fundamental and applied research in the area of



advanced learning paradigms.