[Storage-research-list] [CFP] - The 16th BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench 2024)

[bench2024.cfp at gmail.com]

[Apologies if you receive multiple copies of this CFP]


===============================================================
                        CALL FOR PAPERS
===============================================================
                          Bench 2024
The 16th BenchCouncil International Symposium on Benchmarking,
                  Measuring and Optimizing

                     December 4-6, 2024
            Guangzhou, Guangdong Province, China
           https://www.benchcouncil.org/bench2024

IMPORTANT DATES

Paper Submission Due (full and short papers): August 5, 2024, 11:59 PM AoE
Notification: September 30, 2024, 11:59 PM AoE
Final Papers Due: October 31, 2024, 11:59 PM AoE
Submission website: https://bench2024.hotcrp.com/

===============================================================


ABOUT Bench
-----------
Evolving from nine BPOE/SDBA workshops in conjunction with ASPLOS,
VLDB, and ICS, Bench is an international multidisciplinary conference
on benchmarks, standards, data sets, evaluation, and optimization. 
Bench 2024 is the 16th edition. The Bench conference encompasses a 
wide range of topics in benchmarks, datasets, metrics, indexes, 
measurement, evaluation, optimization, supporting methods and tools, 
and industry best practices in computer science, AI, medicine, finance, 
education, management, etc. Bench’s multidisciplinary and interdisciplinary 
emphasis provides an ideal environment for developers and researchers 
from different areas and communities to discuss practical and 
theoretical work.

Bench 2024 invites manuscripts describing original work in the above
areas and topics. All accepted papers will be presented at the Bench
2024 conference and published by Springer (LNCS, Indexed by EI). In
addition, at least one of the authors of the TBench articles published
during the last year is requested to present their work at the Bench
conference.

ORGANIZATION
------------

General Co-Chairs
* Jianfeng Zhan, University of Chinese Academy of Sciences, China

Program Co-Chairs
* Weiwei Lin, South China University of Technology, China
* Zhen Jia, Amazon, USA

Program Vice-Chairs
* Sascha Hunold, TU Wien, Austria
* Guoxin Kang, Institute of Computing Technology, Chinese Academy of Sciences, China

Workshop Chair
* Chen Zheng, Institute of Software Chinese Academy of Sciences, China

Submission Chair
* Yushan Su, Bytedance Inc, USA

Local Chair
* Wentai Wu, Jinan University, China

Publicity Chair
* Zhuang Wang, Amazon, USA

Web Chair
* Jiahui Dai, BenchCouncil, China

Award Committees

2024 BenchCouncil Achievement Award Committee
* D. K. Panda, The Ohio State University, USA
* Lizy Kurian John, The University of Texas at Austin, USA
* Geoffrey Fox, Indiana University, USA
* Jianfeng Zhan, University of Chinese Academy of Sciences, China
* Tony Hey, Rutherford Appleton Laboratory STFC, UK
* David J. Lilja, University of Minnesota, Minneapolis, USA
* Jack J. Dongarra, University of Tennessee, USA
* John L. Henning, Oracle, USA

BenchCouncil Distinguished Doctoral Dissertation Award Committee in Other Areas
* Jack J. Dongarra, University of Tennessee, USA
* Xiaoyi Lu, The University of California, Merced, USA
* Jeyan Thiyagalingam, Rutherford Appleton Laboratory STFC, UK
* Lei Wang, ICT, Chinese Academy of Sciences, China
* Spyros Blanas, The Ohio State University, USA

BenchCouncil Distinguished Doctoral Dissertation Award Committee in Computer Architecture
* Resit Sendag, University of Rhode Island, USA
* Peter Mattson, Google, USA
* Vijay Janapa Reddi, Harvard University, USA
* Wanling Gao, ICT, Chinese Academy of Sciences, China

Bench Steering Committee
* Jack J. Dongarra, University of Tennessee, USA
* Geoffrey Fox, Indiana University, USA
* D. K. Panda, The Ohio State University, USA
* Felix Wolf, TU Darmstadt, Germany
* Xiaoyi Lu, University of California, Merced, USA
* Resit Sendag, University of Rhode Island, USA
* Wanling Gao, ICT, Chinese Academy of Sciences, China
* Jianfeng Zhan, BenchCouncil, China


TOPICS
------

The Bench conference encompasses a wide range of topics in benchmarks,
datasets, metrics, indexes, measurement, evaluation, optimization,
supporting methods and tools, and other best practices in computer
science, medicine, finance, education, management, etc. Bench’s
multidisciplinary and interdisciplinary emphasis provides an ideal
environment for developers and researchers from different areas and
communities to discuss practical and theoretical work. The topics of
interest include, but are not limited to the following:

Benchmark science and engineering across multi-disciplines: 
* The formulation of problems or challenges in emerging and future computing
* The benchmarks, datasets, and indexes in multidisciplinary applications,
  e.g., medical, finance, education, management, psychology, etc.
* Benchmark-based quantitative approaches to tackle multidisciplinary and
  interdisciplinary challenges, industry best practices

Benchmark and standard specifications, implementations, and validations
* Big Data, Artificial intelligence (AI), High performance computing (HPC)
* Machine learning, Big scientific data, Datacenter, Cloud, Warehouse-scale computing
* Mobile robotics, Edge and fog computing, Internet of Things (IoT), Blockchain
* Data management and storage, Financial, Education, Medical or other application domains

Datasets 
* Detailed descriptions of research or industry datasets,
  including the methods used to collect the data and technical analyses
  supporting the quality of the measurements
* Analyses or meta-analyses of existing data and original articles on systems,
  technologies, and techniques that advance data sharing and reuse
  to support reproducible research
* Evaluating the rigor and quality of the experiments used to generate
  the data and the completeness of the data description
* Tools that can generate large-scale data while preserving their
  original characteristics

Workload characterization, quantitative measurement, design, and evaluation studies 
* Computer and communication networks, protocols and algorithms 
* Wireless, mobile, ad-hoc and sensor networks, IoT applications
* Computer architectures, hardware accelerators, multi-core processors, memory systems
  and storage networks
* HPC systems; Operating systems, file systems and databases; Virtualization, data centers,
  distributed and cloud computing, fog and edge computing
* Mobile and personal computing systems, energy-efficient computing systems; real-time and
  fault-tolerant systems, security and privacy of computing and networked systems,
  software systems and services, and enterprise applications, social networks,
  multimedia systems, web services, cyber-physical systems, including the smart grid

Methodologies, metrics, abstractions, algorithms, and tools 
* Analytical modeling techniques and model validation
* Workload characterization and benchmarking
* Performance, scalability, power and reliability analysis
* Sustainability analysis and power management
* System measurement, performance monitoring and forecasting
* Anomaly detection, problem diagnosis and troubleshooting
* Capacity planning, resource allocation, run time management and scheduling
* Experimental design, statistical analysis, and simulation

Measurement and evaluation
* Measurement standards, evaluation methodologies and metrics,
  testbed methodologies and systems
* Instrumentation, sampling, tracing and profiling of large-scale,
  real-world applications and systems; 
* Measurement-based modeling (e.g., workloads, scaling behavior, assessment of
  performance bottlenecks)
* Methods and tools to monitor and visualize measurement and evaluation data
* Systems and algorithms that build on measurement-based findings
* Advances in data collection, analysis and storage
  (e.g., anonymization, querying, sharing)
* Reappraisal of previous empirical measurements and measurement-based conclusions
* Descriptions of challenges and future directions that the measurement and
  evaluation community should pursue


PAPER SUBMISSION
----------------

Papers must be submitted in PDF. For full papers, the page limit is
15 pages in the LNCS format, excluding references. For short
papers, the page limit is 12 pages in the LNCS format, excluding
references.  The review process follows a strict dual-anonymous policy
per the established Bench conference norms. The submissions will be
judged based on the merit of the ideas rather than the length. After
the conference, the proceedings will be published by Springer LNCS
(Indexed by EI). Please note that the LNCS format is the final one for
publishing.

At least one author must pre-register for the symposium, and at least
one author must attend the symposium to present the paper. Papers for
which no author is pre-registered will be removed from the proceedings.

Formatting Instructions

Please make sure your submission satisfies ALL of the following
requirements: 
* The submission must describe novel, unpublished work that is not currently 
  under review of any other conference venue or journal.
* All authors and affiliation information must be anonymized.  
* Paper must be submitted in printable PDF format (LNCS format).  
* Please number the pages of your submission. 
* The submission must be formatted for black-and-white printers. 
* Please make sure your figures are readable when printed in black and white. 

Submission site: https://bench2024.hotcrp.com/
LNCS LaTeX template: https://www.benchcouncil.org/file/llncs2e.zip

AWARDS
------

BenchCouncil Achievement Award ($3,000)
* This award recognizes a senior member who has made long-term
  contributions to benchmarking, measuring, and optimizing. The winner
  is eligible for the status of a BenchCouncil Fellow.

BenchCouncil Distinguished Doctoral Dissertation Award ($2000)
* This award recognizes and encourages superior research and writing by
  doctoral candidates in the broad field of benchmarks, data, standards,
  evaluations, and optimizations community. This year, the award
  includes two tracks, including the BenchCouncil Distinguished Doctoral
  Dissertation Award in Computer Architecture ($1000) and BenchCouncil
  Distinguished Doctoral Dissertation Award in other areas ($1000).