{"text_format":"2","workbook":"xls","n_sheets":1,"sheets":["report2"],"not_rendered":{"charts":0,"images":0,"macros":0,"external_links":1,"defined_names":2,"comments":0,"pivot_tables":0},"unopened":[],"bounds":{"document_bytes":16777216,"sheet_cells":100000,"run_cost":"one","rows_first":2000,"rows_last":500,"rows_between":2000,"halvings":0,"cell_chars":16384,"cell_head_chars":4096},"cells_cut":0,"cells_raw":0,"read":"whole","date_system":"1900","formulas":"cached_only"}

{"sheet":"report2","index":0,"n_rows":41,"n_cols":5,"rows_kept":41,"cut":false,"hidden":false,"merged":[[0,2,0,3],[0,4,0,5],[1,2,1,3],[1,4,1,5],[2,2,2,3],[2,4,2,5],[3,2,3,3],[5,2,5,3],[8,2,8,3],[9,2,9,3],[10,2,10,3],[11,2,11,3],[13,2,13,3],[14,2,14,3],[17,2,17,3],[24,2,24,3],[24,4,24,5],[25,2,25,3],[25,4,25,5],[26,2,26,3],[26,4,26,5],[27,2,27,3],[29,2,29,3],[32,2,32,3],[33,2,33,3],[34,2,34,3],[35,2,35,3],[36,2,36,3],[38,2,38,3]],"flags":["formulas_cached_only"]}
[null,"1.","Record Nr.",null,"UNINA9910830760503321"]
[null,null,"Autore",null,"Hoang Dinh Thai <1986->"]
[null,null,"Titolo",null,"Deep reinforcement learning for wireless communications and networking : theory, applications and implementation / / Dinh Thai Hoang [and four others]"]
[null,null,"Pubbl/distr/stampa",null,"Hoboken, New Jersey : , : John Wiley & Sons, Inc., , [2023]"]
[{"$nulls":4},"©2023"]
[null,null,"ISBN",null,"1-119-87374-6"]
[{"$nulls":4},"1-119-87368-1"]
[{"$nulls":4},"1-119-87373-8"]
[null,null,"Edizione",null,"[First edition.]"]
[null,null,"Descrizione fisica",null,"1 online resource (291 pages)"]
[null,null,"Disciplina",null,"006.31"]
[null,null,"Soggetti",null,"Reinforcement learning"]
[{"$nulls":4},"Wireless communication systems"]
[null,null,"Lingua di pubblicazione",null,"Inglese"]
[null,null,"Formato",null,"Materiale a stampa"]
[null,null,null,"Livello bibliografico","Monografia"]
[null,null,null,"Nota di bibliografia","Includes bibliographical references and index."]
[null,null,"Nota di contenuto",null,"Cover -- Title Page -- Copyright -- Contents -- Notes on Contributors -- Foreword -- Preface -- Acknowledgments -- Acronyms -- Introduction -- Part I Fundamentals of Deep Reinforcement Learning -- Chapter 1 Deep Reinforcement Learning and Its Applications -- 1.1 Wireless Networks and Emerging Challenges -- 1.2 Machine Learning Techniques and Development of DRL -- 1.2.1 Machine Learning -- 1.2.2 Artificial Neural Network -- 1.2.3 Convolutional Neural Network -- 1.2.4 Recurrent Neural Network -- 1.2.5 Development of Deep Reinforcement Learning -- 1.3 Potentials and Applications of DRL -- 1.3.1 Benefits of DRL in Human Lives -- 1.3.2 Features and Advantages of DRL Techniques -- 1.3.3 Academic Research Activities -- 1.3.4 Applications of DRL Techniques -- 1.3.5 Applications of DRL Techniques in Wireless Networks -- 1.4 Structure of this Book and Target Readership -- 1.4.1 Motivations and Structure of this Book -- 1.4.2 Target Readership -- 1.5 Chapter Summary -- References -- Chapter 2 Markov Decision Process and Reinforcement Learning -- 2.1 Markov Decision Process -- 2.2 Partially Observable Markov Decision Process -- 2.3 Policy and Value Functions -- 2.4 Bellman Equations -- 2.5 Solutions of MDP Problems -- 2.5.1 Dynamic Programming -- 2.5.1.1 Policy Evaluation -- 2.5.1.2 Policy Improvement -- 2.5.1.3 Policy Iteration -- 2.5.2 Monte Carlo Sampling -- 2.6 Reinforcement "]
[{"$nulls":4},"Learning -- 2.7 Chapter Summary -- References -- Chapter 3 Deep Reinforcement Learning Models and Techniques -- 3.1 Value‐Based DRL Methods -- 3.1.1 Deep Q‐Network -- 3.1.2 Double DQN -- 3.1.3 Prioritized Experience Replay -- 3.1.4 Dueling Network -- 3.2 Policy‐Gradient Methods -- 3.2.1 REINFORCE Algorithm -- 3.2.1.1 Policy Gradient Estimation -- 3.2.1.2 Reducing the Variance -- 3.2.1.3 Policy Gradient Theorem -- 3.2.2 Actor‐Critic Methods -- 3.2.3 Advantage of Actor‐Critic Methods."]
[{"$nulls":4},"3.2.3.1 Advantage of Actor‐Critic (A2C) -- 3.2.3.2 Asynchronous Advantage Actor‐Critic (A3C) -- 3.2.3.3 Generalized Advantage Estimate (GAE) -- 3.3 Deterministic Policy Gradient (DPG) -- 3.3.1 Deterministic Policy Gradient Theorem -- 3.3.2 Deep Deterministic Policy Gradient (DDPG) -- 3.3.3 Distributed Distributional DDPG (D4PG) -- 3.4 Natural Gradients -- 3.4.1 Principle of Natural Gradients -- 3.4.2 Trust Region Policy Optimization (TRPO) -- 3.4.2.1 Trust Region -- 3.4.2.2 Sample‐Based Formulation -- 3.4.2.3 Practical Implementation -- 3.4.3 Proximal Policy Optimization (PPO) -- 3.5 Model‐Based RL -- 3.5.1 Vanilla Model‐Based RL -- 3.5.2 Robust Model‐Based RL: Model‐Ensemble TRPO (ME‐TRPO) -- 3.5.3 Adaptive Model‐Based RL: Model‐Based Meta‐Policy Optimization (MB‐MPO) -- 3.6 Chapter Summary -- References -- Chapter 4 A Case Study and Detailed Implementation -- 4.1 System Model and Problem Formulation -- 4.1.1 System Model and Assumptions -- 4.1.1.1 Jamming Model -- 4.1.1.2 System Operation -- 4.1.2 Problem Formulation -- 4.1.2.1 State Space -- 4.1.2.2 Action Space -- 4.1.2.3 Immediate Reward -- 4.1.2.4 Optimization Formulation -- 4.2 Implementation and Environment Settings -- 4.2.1 Install TensorFlow with Anaconda -- 4.2.2 Q‐Learning -- 4.2.2.1 Codes for the Environment -- 4.2.2.2 Codes for the Agent -- 4.2.3 Deep Q‐Learning -- 4.3 Simulation Results and Performance Analysis -- 4.4 Chapter Summary -- References -- Part II Applications of DRL in Wireless Communications and Networking -- Chapter 5 DRL at the Physical Layer -- 5.1 Beamforming, Signal Detection, and Decoding -- 5.1.1 Beamforming -- 5.1.1.1 Beamforming Optimization Problem -- 5.1.1.2 DRL‐Based Beamforming -- 5.1.2 Signal Detection and Channel Estimation -- 5.1.2.1 Signal Detection and Channel Estimation Problem -- 5.1.2.2 RL‐Based Approaches -- 5.1.3 Channel Decoding."]
[{"$nulls":4},"5.2 Power and Rate Control -- 5.2.1 Power and Rate Control Problem -- 5.2.2 DRL‐Based Power and Rate Control -- 5.3 Physical‐Layer Security -- 5.4 Chapter Summary -- References -- Chapter 6 DRL at the MAC Layer -- 6.1 Resource Management and Optimization -- 6.2 Channel Access Control -- 6.2.1 DRL in the IEEE 802.11 MAC -- 6.2.2 MAC for Massive Access in IoT -- 6.2.3 MAC for 5G and B5G Cellular Systems -- 6.3 Heterogeneous MAC Protocols -- 6.4 Chapter Summary -- References -- Chapter 7 DRL at the Network Layer -- 7.1 Traffic Routing -- 7.2 Network Slicing -- 7.2.1 Network Slicing‐Based Architecture -- 7.2.2 Applications of DRL in Network Slicing -- 7.3 Network Intrusion Detection -- 7.3.1 Host‐Based IDS -- 7.3.2 Network‐Based IDS -- 7.4 Chapter Summary -- References -- Chapter 8 DRL at the Application and Service Layer -- 8.1 Content Caching -- 8.1.1 QoS‐Aware Caching -- 8.1.2 Joint Caching and Transmission Control -- 8.1.3 Joint Caching, Networking, and Computation -- 8.2 Data and Computation Offloading -- 8.3 Data Processing and Analytics -- 8.3.1 Data Organization -- 8.3.1.1 Data Partitioning -- 8.3.1.2 Data Compression -- 8.3.2 Data Scheduling -- 8.3.3 Tuning of Data Processing Systems -- 8.3.4 Data Indexing -- 8.3.4.1 Database Index Selection -- 8.3.4.2 Index Structure Construction -- 8.3.5 Query Optimization -- 8.4 Chapter Summary -- References -- Part III "]
[{"$nulls":4},"Challenges, Approaches, Open Issues, and Emerging Research Topics -- Chapter 9 DRL Challenges in Wireless Networks -- 9.1 Adversarial Attacks on DRL -- 9.1.1 Attacks Perturbing the State space -- 9.1.1.1 Manipulation of Observations -- 9.1.1.2 Manipulation of Training Data -- 9.1.2 Attacks Perturbing the Reward Function -- 9.1.3 Attacks Perturbing the Action Space -- 9.2 Multiagent DRL in Dynamic Environments -- 9.2.1 Motivations -- 9.2.2 Multiagent Reinforcement Learning Models."]
[{"$nulls":4},"9.2.2.1 Markov/Stochastic Games -- 9.2.2.2 Decentralized Partially Observable Markov Decision Process (DPOMDP) -- 9.2.3 Applications of Multiagent DRL in Wireless Networks -- 9.2.4 Challenges of Using Multiagent DRL in Wireless Networks -- 9.2.4.1 Nonstationarity Issue -- 9.2.4.2 Partial Observability Issue -- 9.3 Other Challenges -- 9.3.1 Inherent Problems of Using RL in Real‐Word Systems -- 9.3.1.1 Limited Learning Samples -- 9.3.1.2 System Delays -- 9.3.1.3 High‐Dimensional State and Action Spaces -- 9.3.1.4 System and Environment Constraints -- 9.3.1.5 Partial Observability and Nonstationarity -- 9.3.1.6 Multiobjective Reward Functions -- 9.3.2 Inherent Problems of DL and Beyond -- 9.3.2.1 Inherent Problems of DL -- 9.3.2.2 Challenges of DRL Beyond Deep Learning -- 9.3.3 Implementation of DL Models in Wireless Devices -- 9.4 Chapter Summary -- References -- Chapter 10 DRL and Emerging Topics in Wireless Networks -- 10.1 DRL for Emerging Problems in Future Wireless Networks -- 10.1.1 Joint Radar and Data Communications -- 10.1.2 Ambient Backscatter Communications -- 10.1.3 Reconfigurable Intelligent Surface‐Aided Communications -- 10.1.4 Rate Splitting Communications -- 10.2 Advanced DRL Models -- 10.2.1 Deep Reinforcement Transfer Learning -- 10.2.1.1 Reward Shaping -- 10.2.1.2 Intertask Mapping -- 10.2.1.3 Learning from Demonstrations -- 10.2.1.4 Policy Transfer -- 10.2.1.5 Reusing Representations -- 10.2.2 Generative Adversarial Network (GAN) for DRL -- 10.2.3 Meta Reinforcement Learning -- 10.3 Chapter Summary -- References -- Index -- EULA."]
[null,null,null,"Sommario/riassunto","\"This book provides fundamental background on Deep Reinforcement Learning (DRL) and then studies recent advances in DRL to address practical challenges in wireless communications and networking. In particular, this book first gives a tutorial of DRL from basic concepts to advanced modelling techniques to motivate and provide fundamental knowledge for the readers. The authors then provide case studies together with implementation details to help readers better understand how to practice and apply DRL to their problems. After that, they review DRL approaches that address emerging issues in communications and networking. Finally, the authors highlight important challenges, open issues, and future research directions of applying DRL in wireless networks.\"--"]
[null,"2.","Record Nr.",null,"UNINA9910822190903321"]
[null,null,"Autore",null,"Dorman Charles J."]
[null,null,"Titolo",null,"Structure and function of the bacterial genome / / Charles J. Dorman"]
[null,null,"Pubbl/distr/stampa",null,"Hoboken, New Jersey : , : Wiley-Blackwell, , [2020]"]
[{"$nulls":4},"©2020"]
[null,null,"ISBN",null,"1-119-30968-9"]
[{"$nulls":4},"1-119-30967-0"]
[{"$nulls":4},"1-119-30969-7"]
[null,null,"Descrizione fisica",null,"1 online resource (412 pages)"]
[null,null,"Disciplina",null,"572.86293"]
[null,null,"Soggetti",null,"Bacterial genomes"]
[null,null,"Lingua di pubblicazione",null,"Inglese"]
[null,null,"Formato",null,"Materiale a stampa"]
[null,null,null,"Livello bibliografico","Monografia"]
[null,null,"Nota di contenuto",null,"The bacterial genome : where the genes are -- Conservation and evolution of the dynamic genome -- Gene control : transcription and its regulation -- Gene control : regulation at the RNA level -- Gene control : regulation at the protein level -- Gene control and bacterial physiology -- Gene control : global regulation by H-NS -- An integrated view of genome structure and function."]
[null,null,null,"Sommario/riassunto","\"The book aims to integrate information from the very latest research on bacterial chromosome and nucleoid architecture, whole-genome analysis, cell signaling and gene expression control with well-known gene regulation paradigms from model organisms to give the reader a picture of how information flows from the environment to the gene, modulating its expression and influencing the competitive fitness of the microbe. The general public is aware that bacteria can come in benign forms and forms that pose threats to health. This book will explore the governance of the expression of the genes that make a bacterium what it is: a friend or foe to the human/animal/plant host. The reader will learn that the factors that govern the expression of genes by turning them on or off often contribute to the organization of the genetic material within the cell. Our understanding of the architecture of the genome has advanced rapidly in recent years and we are learning more and more about the forces that work to keep genomes the way they are, to change them and the consequences of change for the life of the evolving bacterium. These conservative and disruptive forces will be described, together with their influence on "]
[{"$nulls":4},"gene expression. The book will also review the basics of gene expression control, bringing the topic up-to-date with information about small RNAs, RNAs that sense chemical signals and the role of DNA as a regulatory factor as well as a carrier of genetic information and will consider where these genes are placed in the core genome and how they are regulated using a combination of imported control proteins and pre-existing ones. The reader will also gain a clearer understanding of the rules that govern microbial cells and how we can exploit this knowledge to enhance the benefits offered by benign microbes, limit the damage caused by malign ones and begin the process of synthesizing artificial ones to meet needs in human society\"--Provided by publisher."]