<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><font face="Courier New" class="">---------------------------------------------------------------------------</font></div><div class=""><font face="Courier New" class=""> Call for Contributions for the Data Challenge</font></div><div class=""><font face="Courier New" class="">---------------------------------------------------------------------------</font></div><div class=""><font face="Courier New" class=""> ICPE 2023</font></div><div class=""><font face="Courier New" class=""> 14th ACM/SPEC International Conference on Performance Engineering</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>Sponsored by ACM SIGMETRICS, SIGSOFT, and SPEC RG</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class=""> April 15 - 19, 2023 </font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span> Coimbra, Portugal</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class=""> Web: <a href="https://icpe2023.spec.org" class="">https://icpe2023.spec.org</a></font></div><div class=""><font face="Courier New" class=""> Twitter: <a href="https://twitter.com/ICPEconf" class="">https://twitter.com/ICPEconf</a></font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>Submission: <a href="https://easychair.org/conferences/?conf=icpe2023" class="">https://easychair.org/conferences/?conf=icpe2023</a> </font></div><div class=""><font face="Courier New" class="">---------------------------------------------------------------------------</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">IMPORTANT DATES</font></div><div class=""><font face="Courier New" class="">---------------</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Data challenge submission: Jan 15, 2023 (AoE)</font></div><div class=""><font face="Courier New" class="">Notification to the authors: <span class="Apple-tab-span" style="white-space: pre;"> </span> Feb 24, 2023 (AoE)</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">SCOPE AND TOPICS</font></div><div class=""><font face="Courier New" class="">----------------</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Data is the foundation of many important decision-making processes in </font></div><div class=""><font face="Courier New" class="">performance engineering tasks of modern systems. Data can tell us about </font></div><div class=""><font face="Courier New" class="">the past and present of a system’s performance, helping us predict </font></div><div class=""><font face="Courier New" class="">performance or assess the quality of our systems. In ICPE 2023, we will </font></div><div class=""><font face="Courier New" class="">continue to host a data challenge track in its second installment.</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">In this track, we provide a novel performance dataset from open source </font></div><div class=""><font face="Courier New" class="">Java systems collected by Traini et al. and published recently in the </font></div><div class=""><font face="Courier New" class="">Empirical Software Engineering journal. Participants are invited to come up </font></div><div class=""><font face="Courier New" class="">with new research questions about the dataset and study those. The challenge </font></div><div class=""><font face="Courier New" class="">is open-ended: participants can choose the research questions they find most </font></div><div class=""><font face="Courier New" class="">interesting. The proposed approaches and/or tools and their findings are </font></div><div class=""><font face="Courier New" class="">discussed in short papers and presented in the main conference.</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">How to participate in the challenge:</font></div><div class=""><font face="Courier New" class="">- Read the data description</font></div><div class=""><font face="Courier New" class="">- Think of something cool to do with the data. This can be anything you </font></div><div class=""><font face="Courier New" class=""> want, including visualization, analysis, approach or tool</font></div><div class=""><font face="Courier New" class="">- Implement your idea, evaluate it, and write down your idea and the </font></div><div class=""><font face="Courier New" class=""> results in a short paper </font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">For more information, including the submission guidelines, visit: </font></div><div class=""><font face="Courier New" class=""><a href="https://icpe2023.spec.org/tracks-and-submissions/data-challenge-track/" class="">https://icpe2023.spec.org/tracks-and-submissions/data-challenge-track/</a></font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Data description</font></div><div class=""><font face="Courier New" class="">----------------</font></div><div class=""><font face="Courier New" class="">This year, the challenge dataset is provided by Traini et al., published </font></div><div class=""><font face="Courier New" class="">alongside their recent study “Towards effective assessment of steady state </font></div><div class=""><font face="Courier New" class="">performance in Java software: Are we there yet?” </font></div><div class=""><font face="Courier New" class="">(<a href="https://doi.org/10.48550/arXiv.2209.15369" class="">https://doi.org/10.48550/arXiv.2209.15369</a>).</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">The dataset (<a href="https://github.com/SEALABQualityGroup/icpe-data-challenge-jmh" class="">https://github.com/SEALABQualityGroup/icpe-data-challenge-jmh</a>) </font></div><div class=""><font face="Courier New" class="">contains a comprehensive set of performance measurements of 586 microbenchmarks </font></div><div class=""><font face="Courier New" class="">from 30 popular Java open source projects (e.g., RxJava, Log4J2, Apache Hive) </font></div><div class=""><font face="Courier New" class="">spanning various project domains (e.g., application servers, libraries, </font></div><div class=""><font face="Courier New" class="">databases). Microbenchmarks are frequently employed by practitioners to test </font></div><div class=""><font face="Courier New" class="">and ensure the adequate performance of their systems. Microbenchmark measurements </font></div><div class=""><font face="Courier New" class="">help open source maintainers test performance before landing new system features, </font></div><div class=""><font face="Courier New" class="">and identify performance regressions and optimization opportunities. Each </font></div><div class=""><font face="Courier New" class="">benchmark was carefully executed using the Java Microbenchmark Harness (JMH) </font></div><div class=""><font face="Courier New" class="">framework in a controlled environment to reduce measurement noise: results </font></div><div class=""><font face="Courier New" class="">contain, for each benchmark, 3000 measurements batches (JMH iterations) with </font></div><div class=""><font face="Courier New" class="">a minimum execution time of 100ms, repeated in 10 runs. This amounts to </font></div><div class=""><font face="Courier New" class="">more than 9 billion benchmark invocations for the entire dataset, an experiment </font></div><div class=""><font face="Courier New" class="">that lasted ~93 days.</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">ORGANIZING COMMITTEE</font></div><div class=""><font face="Courier New" class="">--------------------</font></div><div class=""><font face="Courier New" class="">General Chairs</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Marco Vieira, University of Coimbra, Portugal</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Valeria Cardellini, University of Rome Tor Vergata, Italy</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Data Challenge Track Chairs</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Diego Costa, Concordia University, Canada</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Michele Tucci, Charles University, Czech Republic</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Publicity & Social-Media Chairs</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Naghmeh Ivaki, University of Coimbra, Portugal<span class="Apple-tab-span" style="white-space: pre;"> </span></font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Gabriele Russo Russo, University of Rome Tor Vergata, Italy</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Finance Chair</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Nuno Laranjeiro, University of Coimbra, Portugal</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Publications Chairs</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Daniel Sadoc Menasche, Federal University of Rio de Janeiro, Brazil</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- Andrea Marin, Ca Foscari University of Venice, Italy</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div><div class=""><font face="Courier New" class="">Web Chair</font></div><div class=""><font face="Courier New" class=""><span class="Apple-tab-span" style="white-space: pre;"> </span>- José D’Abruzzo Pereira, University of Coimbra, Portugal</font></div><div class=""><font face="Courier New" class=""><br class=""></font></div></body></html>