Past winners of the Test of Time Award
About the Test of Time Award
Starting from DSN 2019, a new award called Test-of-Time Award is instituted, to recognize two papers published 10 years ago in DSN, in the regular paper, the practical experience report or the Tool demonstration category. DSN has several areas under its umbrella and with two awards there are conditions to recognize more than one area. In exceptional situations (not enough nominations), the time frame for awards can be extended to 10-12 years, and only one paper can be awarded, in this order. Written justification should be provided by the Test-of-Time Award committee for each of the exceptions considered: 10-12 years instead of 10 years, and one paper instead of two.
Note: Before the year DCCS and PDS merged, the award will consist of one paper from the DCCS Track and one paper from the PDS Track. After the year DCCS and PDS were merged, two papers will be awarded from the DSN Main Track.
Process for selecting the award
Selection will be done by a Committee of 5 members, referred to as Test-of-Time Award Committee. The committee should be representative for all research and geographical areas, with one member appointed as chair. The role of the chair of the Test-of-Time Award Committee is to coordinate the selection process. The DSN Steering Committee Chair will name the chair of the Test-of-Time Award Committee. The other members of the committee are selected by the DSN Steering Committee Chair and the current DSN TPC Chairs.
Conflict of Interest
Persons having a conflict of interest with a nominated paper cannot be members of the award committee. In particular, a person must declare a conflict of interest if he/she:
- Was involved in writing a nominated paper
- Is currently from the same institution as an author of a nominated paper
- Was the PhD advisor or advisee of one of the authors of a nominated paper
- Is a relative of an author of a nominated paper
Criteria
The Test-of-Time Award Committee members can make nominations and will seek nominations from members of the community. Selection will be done by voting by the Test-of-Time Award Committee.
The Test-of-Time Award Committee must have written criteria and make them public before starting the process. The criteria should be defined according to the best practices in scholarly evaluation: holistic peer review assessing impact on several fronts, such as, but not confined to, academic, educational, technical, industrial; assisted and tuned by objective evidence deemed appropriate to the papers’ context, such as number of citations, downloads, user base, concrete industrial exploitation, etc.
Nominations for Test-of-Time Award
Nominations can be made by any person who is familiar with the paper.
The supporting material for the nomination should include:
- Name, affiliation and contact information of the nominator
- Title and authors of the paper
- Rationale for the nomination
Nominations by the award committee itself are admissible at any time during the deliberation and selection process, subject to the conflict of interest rules established above.Note: There is no monetary award given to the authors of the Test-of-Time Award. It takes the form of a plaque presented to the author(s) at the conference.
DSN 2023 Call for Nominations
Nominations can be made by any person who is familiar with the paper. Nominations should be mailed to the DSN SC Chair (SC_chair@dsn.org), no later than 11:59pm CET on December 19, 2022. Make sure the words Test-of-Time Award are in the subject line. The winning work will be announced by Mid-April 2023.
Past Winners of the Test-of-Time Award
2023 Winners
N. El-Sayed and B. Schroeder, Reading between the lines of failure logs: Understanding how HPC systems fail, IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Budapest, Hungary, 2013, pp. 1-12, doi: 10.1109/DSN.2013.6575356
B. Sharma, P. Jayachandran, A. Verma and C. R. Das, CloudPD: Problem determination and diagnosis in shared dynamic clouds, IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), Budapest, Hungary, 2013, pp. 1-12, doi: 10.1109/DSN.2013.6575298
2022 Winners
Y. Xia, Y. Liu, H. Chen and B. Zang, CFIMon: Detecting violation of control flow integrity using performance counters, 42nd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2012, pp. 1-12, doi: 10.1109/DSN.2012.6263958
A. K. Maji, F. A. Arshad, S. Bagchi and J. S. Rellermeyer, An empirical study of the robustness of inter-component communication in Android, 42nd Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2012, pp. 1-12, doi: 10.1109/DSN.2012.6263963
2021 Winners
F. P. Junqueira, B. C. Reed, M. Serafini, Zab: High-performance broadcast for primary-backup systems, 41st Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2011, pp. 245-256, doi: 10.1109/DSN.2011.5958223.
M. Garcia, A. Bessani, I. Gashi, N. Neves, R. Obelheiro, OS diversity for intrusion tolerance: Myth or reality?, 41st Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2011, pp. 383-394, doi: 10.1109/DSN.2011.5958251.
2020 Winners
P. Xie, J. H. Li, X. Ou, P. Liu, R. Levy, Using Bayesian networks for cyber security analysis, 40th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2010, pp. 211-220, doi: 10.1109/DSN.2010.5544924
M. Grottke, A. P. Nikora, K. S. Trivedi, An empirical investigation of fault types in space mission system software, 40th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2010, pp. 447-456, doi: 10.1109/DSN.2010.5544284
2019 Winners
K. S. Killourthy, R. Maxion, Comparing anomaly detection algorithms for keystroke dynamics, 39th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2009, pp. 125-134, doi: 10.1109/DSN.2009.5270346
Adam Oliner, John Stearley, What supercomputers say: A study of five system logs, 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2007, pp. 575-584, doi: 10.1109/DSN.2007.103