|
HotOS X, Tenth Workshop on Hot Topics in Operating Systems — Abstract
Three Research Challenges at the Intersection of Machine Learning, Statistical Induction, and Systems
Moises Goldszmidt and Ira Cohen, Hewlett-Packard Labs; Armando Fox and Steve Zhang,
Stanford University
Abstract
Recent research
activity has shown encouraging results for performance debugging and
failure diagnosis and detection in systems by using approaches
based on automatically inducing models and deriving correlations
from observed data. We believe that maximizing the potential of this
line of research will require surmounting some fundamental challenges
arising not from the modeling techniques themselves, but specifically
from the application of those techniques to real-world systems.
We specifically formulate three challenges. First, as new data is
collected from a system, previously-induced models must be continuously
assessed and validated, with the ultimate aim of
achieving online adaption to system changes. Second, human operators
must be able to effectively interact with the models,
including interpreting model findings to generate explanations, enabling
human feedback to improve the models, and identifying false positives
and missed detections. Third, it should be possible to formally
manipulate ``signatures'' of system state,
allowing us to query the system's past to identify
recurring problems and manually annotate them with
additional information.
We contend that the specifics of this problem domain not only raise
these challenges, but also provide the knowledge base from which to
derive well-engineered solutions to them.
- View the full text of this paper in HTML and PDF.
Until June 2006, you will need your USENIX membership identification in order to access the full papers. The Proceedings are published as a collective work, © 2005 by the USENIX Association. All Rights Reserved. Rights to individual papers remain with the author or the author's employer. Permission is granted for the noncommercial reproduction of the complete work for educational or research purposes. USENIX acknowledges all trademarks within this paper.
- If you need the latest Adobe Acrobat Reader, you can download it from Adobe's site.
|
Need help? Use our Contacts page.
