LEADER 05103nam 22005895 450 001 9910988388103321 005 20250321115239.0 010 $a9783031856341 010 $a3031856341 024 7 $a10.1007/978-3-031-85634-1 035 $a(MiAaPQ)EBC31973424 035 $a(Au-PeEL)EBL31973424 035 $a(CKB)38018920700041 035 $a(DE-He213)978-3-031-85634-1 035 $a(EXLCZ)9938018920700041 100 $a20250321d2025 u| 0 101 0 $aeng 135 $aurcnu|||||||| 181 $ctxt$2rdacontent 182 $cc$2rdamedia 183 $acr$2rdacarrier 200 10$aSystems Benchmarking $eFor Scientists and Engineers /$fby Samuel Kounev, Klaus-Dieter Lange, Jóakim von Kistowski 205 $a2nd ed. 2025. 210 1$aCham :$cSpringer Nature Switzerland :$cImprint: Springer,$d2025. 215 $a1 online resource (503 pages) 311 08$a9783031856334 311 08$a3031856333 327 $aPart I Foundations -- 1 Benchmarking Basics -- 2 Review of Basic Probability and Statistics -- 3 Metrics -- 4 Statistical Measurements -- 5 Experimental Design -- 6 Measurement Techniques -- 7 Operational Analysis and Basic Queueing Models -- 8 Workloads -- 9 Standardization -- Part II Applications -- 10 CPU Benchmarks -- 11 Server Energy Efficiency Benchmarks -- 12 Virtualization Benchmarks -- 13 Storage Benchmarks -- 14 PC, Workstation, Graphics, and Network Benchmarks -- 15 Microservice Application Benchmarks -- 16 Machine Learning and Artificial Intelligence -- 17 Scalability of Networks and Systems -- 18 Elasticity of Cloud Platforms -- 19 Performance Isolation -- 20 Resource Demand Estimation -- 21 Software and System Security. 330 $aThis book serves as both a textbook and handbook on the benchmarking of systems and components used as building blocks of modern information and communication technology applications. It provides theoretical and practical foundations as well as an in-depth exploration of modern benchmarks and benchmark development. The book is divided into two parts: foundations and applications. The first part introduces the foundations of benchmarking as a discipline, covering the three fundamental elements of each benchmarking approach: metrics, workloads, and measurement methodology. The second part focuses on different application areas, presenting contributions in specific fields of benchmark development. These contributions address the unique challenges that arise in the conception and development of benchmarks for specific systems or subsystems, and they demonstrate how the foundations and concepts in the first part of the book are being used in existing benchmarks. Further, the book presents a number of concrete applications and case studies based on input from leading benchmark developers from consortia such as the Standard Performance Evaluation Corporation (SPEC) and the Transaction Processing Performance Council (TPC). Besides a number of updates in almost all chapters, for this new edition three chapters are added in Part II of the book: (1) ?Machine Learning and Artificial Intelligence? to cater the growing need to evaluate and benchmark ML and AI systems, (2) ?Scalability of Networks and Systems? focusing on novel metrics and techniques to evaluate scalability, and (3) "PC, Workstation, Graphics, and Network Benchmarks? covering popular benchmarks like SYSmark, PCMark, Phoronix Test Suite, 3DMark, the Blender benchmark, and end-to-end network performance tools. Providing both practical and theoretical foundations, as well as a detailed discussion of modern benchmarks and their development, the book is intended as a handbook for professionals and researchers working in areas related to benchmarking. It offers an up-to-date point of reference for existing work as well as latest results, research challenges, and future research directions. It also can be used as a textbook for graduate and postgraduate students studying any of the many subjects related to benchmarking. While readers are assumed to be familiar with the principles and practices of computer science, as well as software and systems engineering, no specific expertise in any subfield of these disciplines is required. 606 $aElectronic digital computers$xEvaluation 606 $aSoftware engineering 606 $aSoftware engineering$xManagement 606 $aSystem Performance and Evaluation 606 $aSoftware Engineering 606 $aSoftware Management 615 0$aElectronic digital computers$xEvaluation. 615 0$aSoftware engineering. 615 0$aSoftware engineering$xManagement. 615 14$aSystem Performance and Evaluation. 615 24$aSoftware Engineering. 615 24$aSoftware Management. 676 $a004.24 700 $aKounev$b Samuel$0888496 701 $aLange$b Klaus-Dieter$0925132 701 $avon Kistowski$b Jóakim$01802452 801 0$bMiAaPQ 801 1$bMiAaPQ 801 2$bMiAaPQ 906 $aBOOK 912 $a9910988388103321 996 $aSystems Benchmarking$94348120 997 $aUNINA