Failure Trace Archive

• On the effectiveness of application-aware self-management for scientific discovery in volunteer computing systems. T. Estrada and M. Taufer. In Proceedings of the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis (SC12), Novermber 2012. (BIB)

• Invalid BibTex Entry!

• Modeling Job Lifespan Delays in Volunteer Computing Projects. T. Estrada, K. Reed and M. Taufer. In Proceedings of to the 9th IEEE International Symposium on Cluster Computing and Grid (CCGrid), 2009. (BIB)

• Invalid BibTex Entry!

• Docking@home
  • On the effectiveness of application-aware self-management for scientific discovery in volunteer computing systems. T. Estrada and M. Taufer. In Proceedings of the IEEE/ACM International Conference for High Performance Computing, Networking, Storage, and Analysis (SC12), Novermber 2012. (BIB)

• The Failure Trace Archive: Enabling Comparative Analysis of Failures in Diverse Distributed Systems Derrick Kondo, Bahman Javadi, Alex Iosup, Dick Epema, In the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2010), Melbourne, Australia, May, 2010. Best Paper Award. Presentation (pdf)

• The Failure Trace Archive: Enabling the Comparison of Failure Measurements and Models of Distributed Systems Bahman Javadi, Derrick Kondo, Alex Iosup, Dick Epema, Journal of Parallel and Distributed Computing, Volume 73, Issue 8, August 2013, Pages 1208-1223.
• The Failure Trace Archive: Enabling Comparative Analysis of Failures in Diverse Distributed Systems Derrick Kondo, Bahman Javadi, Alex Iosup, Dick Epema, In the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2010), Melbourne, Australia, May, 2010. Best Paper Award.

• The Failure Trace Archive: Enabling Comparative Analysis of Failures in Diverse Distributed Systems

• The Failure Trace Archive: Enabling the Comparison of Failure Measurements and Models of Distributed Systems

The Failure Trace Archive: Enabling the Comparison of Failure Measurements and Models of Distributed Systems

The following papers give an overview of the archive and the trace data sets:

The Failure Trace Archive: Enabling the comparison of failure measurements and models of distributed systems Bahman Javadi, Derrick Kondo, Alex Iosup, Dick Epema, Journal of Parallel and Distributed Computing, Volume 73, Issue 8, August 2013, Pages 1208-1223.

Please cite the above articles to acknowledge use of the Failure Trace Archive.

(:htmlend:)

Derrick Kondo, Bahman Javadi, Alex Iosup, Dick Epema, In the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid 2010), Melbourne, Australia, May, 2010. Best Paper Award.

Derrick Kondo, Bahman Javadi, Alex Iosup, Dick Epema, In the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, Australia, May, 2010. Best Paper Award.

• Mining for Statistical Availability Models in Large-Scale Distributed Systems: An Empirical Study of SETI@home. B. Javadi, D. Kondo, JM. Vincent and D.P. Anderson. In 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September 2009. (URL) (BIB)

• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Condor-cae

• 'Condor-cae

• Condor-cs

• Condor-glow

• Teragrid

• "Condor-cae"
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)
• "Condor-cs"
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)
• "Condor-glow"
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)
• "Teragrid"
  • Analysis and Modeling of Time-Correlated Failures in Large-Scale Distributed Systems. Nezih Yigitbasi, Matthieu Gallet, Derrick Kondo, Alexandru Iosup, Dick Epema. In 8th IEEE/ACM International Conference on Grid Computing, October 2010. (URL) (BIB)

Derrick Kondo, Bahman Javadi, Alex Iosup, Dick Epema, To appear at the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, Australia, May, 2010. Best Paper Award.

Presentation (pdf)

Please cite the above article to acknowledge use of the Failure Trace Archive.

• Fault-tolerant Routing for Multiple Permanent and Non-permanent Faults in HPC Systems. Gonzalo Zarza, Diego Lugones, Daniel Franco and Emilio Luque. In International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'10), July 2010. (BIB)

• Fault-tolerant Routing for Multiple Permanent and Non-permanent Faults in HPC Systems. Gonzalo Zarza, Diego Lugones, Daniel Franco and Emilio Luque. In International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'10), July 2010. (BIB)

• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Statistical Inference. Casella, G. and Berger, R.Duxbury, , 2002. (BIB)

• A large scale study of failures in high-performance-computing systems. Bianca Schroeder and Garth A. Gibson. In International Symposium on Dependable Systems and Networks (DSN), June 2006. (URL) (BIB)

• Invalid BibTex Entry!
• Invalid BibTex Entry!

• MPP2 Syslog Data (2006-2008). DML Brown and GR Smith . Technical Report PNNL-SA-61371, Pacific Northwest National Laboratory, 2008. (BIB)
• Invalid BibTex Entry!

• Invalid BibTex Entry!

• Invalid BibTex Entry!

The following paper gives an overview of the archive and the trace data sets:

Please cite the above work to acknowledge use of the Failure Trace Archive.

Below we list which data sets have been used in which publications. Publications are grouped by the data sets used. In cases where authors use multiple data sets, the publications are cited again.

The following paper gives an overview of the archive and the trace data sets. The Failure Trace Archive: Enabling Comparative Analysis of Failures in Diverse Distributed Systems Derrick Kondo, Bahman Javadi, Alex Iosup, Dick Epema, To appear at the 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), Melbourne, Australia, May, 2010. (Also, INRIA technical report number 00433523.)

Also, please cite the above work to acknowledge use of the Failure Trace Archive:

• Notre Dame
  • Multi-State Grid Resource Availability Characterization. Brent Rood and Michael J. Lewis. In 8th Grid Computing Conference, September 2007. (BIB)

• Grid'5000
  • On the Dynamic Resource Availability in Grids. Alexandru Iosup, Mathieu Jan, Ozan Sonmez,and Dick H.J. Epema. In 8th IEEE/ACM International Conference on Grid Computing, September 2007. (URL) (BIB)

• PlanetLab
  • Exploiting Availability Prediction in Distributed Systems. James W. Mickens and Brian D. Noble. In Proceedings of the 3rd conference on Networked Systems Design & Implementation, 2006. (URL) (BIB)

• Exploiting Availability Prediction in Distributed Systems. James W. Mickens and Brian D. Noble. In Proceedings of the 3rd conference on Networked Systems Design & Implementation, 2006. (URL) (BIB)

• PNNL
  • MPP2 Syslog Data (2006-2008). DML Brown and GR Smith . Technical Report PNNL-SA-61371, Pacific Northwest National Laboratory, 2008. (BIB)

• NERSC
  • Reliability Results of NERSC Systems. Akbar Mokhtarani, William Kramer, Jason Hick. Technical Report LBNL-430E, The National Energy Research Scientific Computing Center-LBNL, 2008. (URL) (BIB)

• PlanetLab
  • Planetlab all paris ping. J. Stribling. (URL) (BIB)
• Grenouille03
  • Resources availability for Peer to Peer systems. Da Costa, Georges, Marchand, Corine, Richard, Olivier and Vincent, Jean-Marc. In 20th International Conference on Advanced Information Networking and Applications (AINA 2006), Vienna University of Technology, Vienna, Austria, apr 2006. (BIB)
• Grenouille05
  • Resources availability for Peer to Peer systems. Da Costa, Georges, Marchand, Corine, Richard, Olivier and Vincent, Jean-Marc. In 20th International Conference on Advanced Information Networking and Applications (AINA 2006), Vienna University of Technology, Vienna, Austria, apr 2006. (BIB)
• EGEE
  • Identifying Failures in Grids through Monitoring and Ranking. Demetrios Zeinalipour-Yazti, Kyriakos Neocleous, Chryssis Georgiou and Marios D. Dikaiakos. In NCA, pages 291-298, 2008. (BIB)

• DNS
  • Availability,usage, and deployment characteristics of the domain name system. Jeffrey Pang, James Hendricks, Aditya Akella, Bruce Maggs, Roberto De Prisco, and Srinivasan Seshan. In Internet Measurement Conference (IMC), October 2004. (BIB)

• Web sites
  • On correlated failures in survivable storage systems. Mehmet Bakkaloglu, Jay J. Wylie, Chenxi Wang, and Gregory R. Ganger. Technical Report MU-CS-02-129, Carnegie Mellon University, May 2002. (BIB)

• HPC4
  • What Supercomputers Say: A Study of Five System Logs. Adam Oliner and Jon Stearley. In International Symposium on Dependable Systems and Networks (DSN), June 2007. (URL) (BIB)
• Skype
  • An Experimental Study of the Skype Peer-to-Peer VoIP System. Saikat Guha, Neil Daswani, and Ravi Jain. In Proceedings of The 5th International Workshop on Peer-to-Peer Systems (IPTPS), February 2006. (BIB)

• Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you?. Bianca Schroeder and Garth A. Gibson. In 5th Usenix Conference on File and Storage Technologies (FAST) , February 2007. (URL) (BIB)

• LANL
  • A large scale study of failures in high-performance-computing systems. Bianca Schroeder and Garth A. Gibson. In International Symposium on Dependable Systems and Networks (DSN), June 2006. (URL) (BIB)
• HPC2
  • A large scale study of failures in high-performance-computing systems. Bianca Schroeder and Garth A. Gibson. In International Symposium on Dependable Systems and Networks (DSN), June 2006. (URL) (BIB)

(:html:) <!-- Start of StatCounter Code --> <script type="text/javascript"> var sc_project=4932734; var sc_invisible=1; var sc_partition=57; var sc_click_stat=1; var sc_security="d6ef0c3a"; </script>

<script type="text/javascript" src="http://www.statcounter.com/counter/counter.js"></script><noscript><div class="statcounter"><a title="joomla 1.5 stats" href="http://www.statcounter.com/joomla/" target="_blank"><img class="statcounter" src="http://c.statcounter.com/4932734/0/d6ef0c3a/1/" alt="joomla 1.5 stats" ></a></div></noscript> <!-- End of StatCounter Code --> (:htmlend:)

(:html:) <script type="text/javascript"> var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www."); document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E")); </script> <script type="text/javascript"> try { var pageTracker = _gat._getTracker("UA-4677301-2"); pageTracker._trackPageview(); } catch(err) {}</script> (:htmlend:)

• Ensuring Collective Availability in Volatile Resource Pools Via Forecasting. Artur Andrzejak, Derrick Kondo and David P. Anderson. In DSOM, pages 149-161, 2008. (BIB)

• Understanding Availability. Bhagwan, R., Savage, S. and Voelker, G.. In Proceedings of IPTPS'03, 2003. (BIB)

• Microsoft

• Overnet
  • Feasibility of a Serverless Distributed file System Deployed on an Existing Set of Desktop PCs. Bolosky, W., Douceur, J., Ely, D. and Theimer, M.. In Proceedings of SIGMETRICS, 2000. (BIB)
• Microsoft

• Mining for Statistical Availability Models in Large-Scale Distributed Systems: An Empirical Study of SETI@home. B. Javadi, D. Kondo, JM. Vincent and D.P. Anderson. In 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September 2009. (URL) (BIB)

• Predicting Machine Availabilities in Desktop Pools. Andrzejak, A., Domingues, P. and Silva, L.. In IEEE/IFIP Network Operations and Management Symposium, pages 225-234, 2006. (BIB)

• SETI@home
  • Computing Low Latency Batches with Unreliable Workers in Volunteer Computing Environments. Eric Martin Heien, David P. Anderson and Kenichi Hagihara. J. Grid Comput., 7(4):501-518, 2009. (BIB)
  • On Correlated Availability in Internet Distributed Systems. Kondo, Derrick, Andrzejak, Artur and Anderson, David P.. In IEEE/ACM International Conference on Grid Computing (Grid), Tsukuba,Japan, 2008. (PDF) (BIB)
  • Predicting Machine Availabilities in Desktop Pools. Andrzejak, A., Domingues, P. and Silva, L.. In IEEE/IFIP Network Operations and Management Symposium, pages 225-234, 2006. (BIB)

Publications are grouped by the data sets used. In cases where authors use multiple data sets, the publications are cited again.

Here we list which data sets have been used in which publications.

Publications are grouped by the data sets that the authors have used. In cases where authors use multiple data sets, the publications are cited again.

• SETI@home

• Data sets used: SETI@home

• Data sets used: SETI@home
  • On Correlated Availability in Internet Distributed Systems. Kondo, Derrick, Andrzejak, Artur and Anderson, David P.. In IEEE/ACM International Conference on Grid Computing (Grid), Tsukuba,Japan, 2008. (PDF) (BIB)

• On Correlated Availability in Internet Distributed Systems. Kondo, Derrick, Andrzejak, Artur and Anderson, David P.. In IEEE/ACM International Conference on Grid Computing (Grid), Tsukuba,Japan, 2008. (PDF)[==] (BIB)

kondo_grid08

Bibtex entry:

• Invalid BibTex Entry!

• Invalid BibTex Entry!

to appear in 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September, 2009,

• Data sets used: SETI@home

• Mining for Statistical Models of Availability in Large-Scale Distributed Systems: An Empirical Study of SETI@home \\

• http://mescal.imag.fr/membres/derrick.kondo/pubs/javadi_mascots09.pdf? \\

Bahman Javadi, Derrick Kondo, Jean-Marc Vincent, David P. Anderson \\

• Mining for Statistical Models of Availability in Large-Scale Distributed Systems: An Empirical Study of SETI@home \\

• Mining for Statistical Models of Availability in Large-Scale Distributed Systems: An Empirical Study of SETI@home <<

to appear in 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September, 2009, (Also INRIA Technical Report Number 00375624.)

• Mining for Statistical Models of Availability in Large-Scale Distributed Systems: An Empirical Study of SETI@home \

• Mining for Statistical Models of Availability in Large-Scale Distributed Systems: An Empirical Study of SETI@home

Bahman Javadi, Derrick Kondo, Jean-Marc Vincent, David P. Anderson. to appear in 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September, 2009, (Also INRIA Technical Report Number 00375624.) We determine the probability distributions that model availability of individual hosts in SETI@home.