CA2471013A1 - Method and system for analyzing and predicting the behavior of systems - Google Patents

Method and system for analyzing and predicting the behavior of systems Download PDF

Info

Publication number
CA2471013A1
CA2471013A1 CA002471013A CA2471013A CA2471013A1 CA 2471013 A1 CA2471013 A1 CA 2471013A1 CA 002471013 A CA002471013 A CA 002471013A CA 2471013 A CA2471013 A CA 2471013A CA 2471013 A1 CA2471013 A1 CA 2471013A1
Authority
CA
Canada
Prior art keywords
input variable
selected input
computing
time
estimate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002471013A
Other languages
French (fr)
Other versions
CA2471013C (en
Inventor
David Helsper
David Homoki
Amanda Rasmussen
Robert Jannarone
Jean-Francois Huard
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netuitive Inc
Original Assignee
David Helsper
David Homoki
Amanda Rasmussen
Robert Jannarone
Jean-Francois Huard
Netuitive, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by David Helsper, David Homoki, Amanda Rasmussen, Robert Jannarone, Jean-Francois Huard, Netuitive, Inc. filed Critical David Helsper
Publication of CA2471013A1 publication Critical patent/CA2471013A1/en
Application granted granted Critical
Publication of CA2471013C publication Critical patent/CA2471013C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3065Monitoring arrangements determined by the means or processing involved in reporting the monitored data
    • G06F11/3072Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
    • G06F11/3082Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting the data filtering being achieved by aggregating or compressing the monitored data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3055Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/32Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324Display of status information
    • G06F11/327Alarm or error message display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3452Performance evaluation by statistical analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3447Performance evaluation by modeling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466Performance evaluation by tracing or monitoring
    • G06F11/3476Data logging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/81Threshold

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Computing Systems (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Hardware Design (AREA)
  • Probability & Statistics with Applications (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Testing And Monitoring For Control Systems (AREA)
  • Alarm Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

A monitoring system including a baseline model that automatically captures and models normal system behavior, a correlation model that employs multivariate autoregression analysis to detect abnormal system behavior, and an alarm service that weight and scores a variety of alerts to determine an alarm status and implement appropriate response actions. The baseline model decomposes the input variables into a number of components representing relatively predictable behaviors so that the erratic component e(t) may be isolated for further processing. These components include a global trend component, a cyclical component, and a seasonal component. Modeling and continually updating these components separately permits a more accurate identification of the erratic component of the input variable, which typically reflects abnormal patterns when they occur.

Claims (43)

1. A method for analyzing and predicting the behavior of a system, comprising the steps of:

continually receiving measurements defining signatures for a plurality of input variables reflecting the behavior of the system, each signature comprising a time series of measurements including historical measurements for past time trials and a current measurement for a current time trial;
computing a time-based baseline mean and variance for a selected input variable based on the historical measurements for the selected input variable;
computing an erratic component for the selected input variable by comparing the measurement for the selected input value for the current time trial to the time-based baseline mean for the selected input variable;
computing an imputed estimate for the selected input variable based on erratic components computed for other input variables for the current time trial and learned parameters reflecting observed relationships between the erratic component for the selected input variable and the erratic components for the other input variables; and determining an alert status for the imputed estimate based on the imputed estimate and the erratic component for the input variable for the current time trial.
2. The method of claim 1, further comprising the step of updating the time-based baseline mean and variance for the selected input variable based on the measurement received for the selected input value for the current time trial.
3. The method of claim 2, comprising the step of repeating the steps of claims 1 and 2 for multiple input variables.
4. The method of claim 3, further comprising the step of continually repeating the steps of claims 1, 2, and 3 for multiple current time trials.
5. The method of claim 1, wherein the step of determining the alert status for the imputed estimate comprises the steps of:
computing a confidence value associated with the imputed estimate;
computing a threshold value for the imputed estimate based on the confidence value;
computing an imputed estimate alert value reflecting a difference between the imputed estimate and the erratic component . for the selected input variable to the threshold value; and determining an alert status for the imputed estimate by comparing the alert value to the threshold value.
6. The method of claim 5, wherein:
the confidence value comprises a standard error associated with the imputed estimate; and the threshold value is based on the standard error and a user-defined configuration parameter.
7. The method of claim 2, wherein the step of computing the time-based baseline mean and variance for the selected input variable comprises the steps of:
decomposing the signature for the input variable into components;
computing a mean and variance for each component;
combining the means for the components to obtain the time-based baseline mean; and combining the variances for the components to obtain the time-based baseline variance.
8. The method of claim 7, wherein the step of decomposing the signature for the input variable into components comprises the steps of:
defining a repeating cycle for the historical measurements;

dividing the cycle into a plurality of contiguous time periods wherein each cycle comprises a similar set of time periods, each time period having a corresponding time index;
computing a global trend component for the selected input variable reflecting measurements received for the selected input variable for temporally contiguous time indices; and computing a cyclical component for the selected input variable reflecting data accumulated across multiple cycles for each time index.
9. The method of claim 2, wherein the step of updating the time-based baseline mean and variance for the selected input variable comprises the steps of:
computing an updated baseline mean based on a weighted sum comprising the baseline mean for the selected input variable and the measurement for the current time trial for the selected input variable; and computing an updated baseline variance based on a weighted sum comprising the baseline variance for the selected input variable and the measurement for the current time trial for the selected input variable.
10. The method of claim 7, wherein the step of updating the time-based baseline mean and variance for the selected input variable comprises the steps of:
computing an updated time-based baseline mean by:
computing an updated mean for each component based on a weighted sum comprising the baseline mean for the component and the measurement received for the selected input variable for the current time trial, and summing the updated means for the components; and computing an updated time-based baseline variance by:
computing an updated variance for each component based on a weighted sum comprising the baseline variance for the component and the measurement received for the selected input variable for the current time trial, and summing the updated variances for the components.
11. The method of claim 4, further comprising the steps of:
receiving imputed estimate alerts corresponding to multiple input measurements;
weighting the alerts;
computing an alert score based on the weighted alerts; and determining whether to activate an alarm condition based on the alert score.
12. A computer storage medium storing computer-executable instruction for performing the method of claim 1.
13. An apparatus configured to perform the method of claim 1.
14. A method for analyzing and predicting the behavior of a system, comprising the steps of:
continually receiving measurements defining signatures for a plurality of input variables reflecting the behavior of the system, each signature comprising a time series of measurements including historical measurements for past time trials and a current measurement for a current time trial;
computing a time-based baseline mean and variance for a selected input variable based on the historical measurements for the selected input variable;
computing an erratic component for the selected input variable by comparing the measurement for the selected input value for the current time trial to the baseline mean for the selected input variable;
computing a forecast estimate for the selected input variable based on erratic components computed for other input variables and learned parameters reflecting observed relationships between the erratic component for the selected input variable and the erratic components for the other input variables; and determining an alert status for the forecast estimate.
15. The method of claim 14, further comprising the step of updating the time-based baseline mean and variance for the selected input variable based on the measurement received for the selected input value for the current time trial.
16. The method of claim 15, comprising the step of repeating the steps of claims 14 and 15 for multiple input variables.
17. The method of claim 16, further comprising the step of continually repeating the steps of claims 14, 15, and 16 for multiple future forecasts.
18. The method of claim 17, further comprising the step of continually repeating the steps of claims 14, 15, 16, and 17 for multiple current time trials.
19. The method of claim 15, wherein the step of determining the alert status for the forecast estimate comprises the steps of:
computing a threshold value for the forecast estimate; and determining an alert status for the forecast estimate by comparing the forecast:
estimate to the threshold value.
20. The method of claim 19, wherein the threshold value is based on the time-based baseline variance for the selected input variable and a user-defined configuration parameter.
21. The method of claim 15, wherein the step of computing the time-based baseline mean and variance for the selected input variable comprises the steps of:
decomposing the signature for the input variable into components;
computing a mean and variance for each component;
combining the means for the components to obtain the time-based baseline mean; and combining the variances for the components to obtain the time-based baseline variance.
22. The method of claim 21, wherein the step of decomposing the signature for the input variable into components comprises the steps of:

defining a repeating cycle for the historical measurements;
dividing the cycle into a plurality of contiguous time periods wherein each cycle comprises a similar set of time periods, each time period having a corresponding time index;

computing a global trend component for the selected input variable reflecting measurements received for the selected input variable for temporally contiguous time indices; and computing a cyclical component for the selected input variable reflecting data accumulated across multiple cycles for each time index.
23. The method of claim 15, wherein the step of updating the time-based baseline mean and variance for the selected input variable comprises the steps of:
computing an updated baseline mean based on a weighted sum comprising the baseline mean for the selected input variable and the measurement for the current time trial for the selected input variable; and computing an updated baseline variance based on a weighted sum comprising the baseline variance for the selected input variable and the measurement for the current time trial for the selected input variable.
24. The method of claim 21, wherein the step of updating the time-based baseline mean and variance for the selected input variable comprises the steps of:
computing an updated time-based baseline mean by:
computing an updated mean for each component based on a weighted sum comprising the baseline mean for the component and the measurement received for the selected input variable for the current time trial, and summing the updated means for the components; and computing an updated time-based baseline variance by:
computing an updated variance for each component based on a weighted sum comprising the baseline variance for the component and the measurement received for the selected input variable for the current time trial, and summing the updated variances for the components.
25. The method of claim 18, further comprising the steps of:
receiving imputed estimate alerts corresponding to multiple input measurements;
weighting the alerts;
computing an alert score based on the weighted alerts; and determining whether to activate an alarm condition based on the alert score.
26. A computer storage medium storing computer-executable instruction for performing the method of claim 18.
27. An apparatus configured to perform the method of claim 18.
28. A method for analyzing and predicting the behavior of a system, comprising the steps of:
continually receiving measurements defining signatures for a plurality of input variables reflecting the behavior of the system, each signature comprising a time series of measurements including historical measurements for past time trials and a current measurement for a current time trial;
computing a time-based baseline mean and variance for a selected input variable based on the historical measurements for the selected input variable;
computing an erratic component for the selected input variable by comparing the measurement for the selected input value for the current time trial to the baseline mean for the selected input variable;
computing an imputed estimate for the selected input variable based on erratic components computed for other input variables for the current, time trial and learned parameters reflecting observed relationships between the erratic component for the selected input variable and the erratic components for the other input variables;
determining an alert status for the imputed estimate based on the imputed estimate and the erratic component for the input variable for the current time trial;
computing a forecast estimate for the selected input variable based on erratic components computed for other input variables and learned parameters reflecting observed relationships between the erratic component for the selected input variable and the erratic components for the other input variables; and determining an alert status for the forecast estimate.
29. The method of claim 28, further comprising the step of updating the time-based baseline mean and variance for the selected input variable based on the measurement received for the selected input value for the current time trial.
30. The method of claim 29, comprising the step of repeating the steps of claims 28 and 28 for multiple input variables.
31. The method of claim 30, further comprising the step of continually repeating the steps of claims 28, 29, and 30 for multiple future forecasts.
32. The method of claim 31, further comprising the step of continually repeating the steps of claims 28, 29, 30, and 31 for multiple current time trials.
33. The method of claim 32, wherein the step of determining the alert status for the imputed estimate comprises the steps of:
computing a confidence value for the imputed estimate;
computing a threshold value for the imputed estimate based on the confidence value;
computing an imputed estimate alert value reflecting a difference between the imputed estimate and the erratic component for the selected input variable to the threshold value for the imputed estimate; and determining an alert status for the imputed estimate by comparing the alert value to the threshold value for the imputed estimate.
34. The method of claim 33, wherein:
the confidence value for the imputed estimate comprises a standard error associated with the imputed estimate; and the threshold value for the imputed estimate is based on the standard error and a user-defined configuration parameter.
35. The method of claim 34, wherein the step of determining the alert status for the forecast estimate comprises the steps of:
computing a threshold value for the forecast estimate; and determining an alert status for the forecast estimate by comparing the forecast estimate to the threshold value.
36. The method of claim 35, wherein the threshold value is based on the time-based baseline variance for the selected input variable and a user-defined configuration parameter.
37. The method of claim 36, wherein the step of computing the time-based baseline mean and variance for the selected input variable comprises the steps of:
decomposing the signature for the input variable into components;
computing a mean and variance for each component;
combining the means for the components to obtain the time-based baseline mean; and combining the variances for the components to obtain the time-based baseline variance.
38. The method of claim 37, wherein the step of decomposing the signature for the input variable into components comprises the steps of:
defining a repeating cycle for the historical measurements;
dividing the cycle into a plurality of contiguous time periods wherein each cycle comprises a similar set of time periods, each time period having a corresponding time index;
computing a global trend component for the selected input variable reflecting measurements received for the selected input variable for temporally contiguous time indices; and computing a cyclical component for the selected input variable reflecting data accumulated across multiple cycles for each time index.
39. The method of claim 38, wherein the step of updating the time-based baseline mean and variance for the selected input variable comprises the steps of:
computing an updated baseline mean based on a weighted sum comprising the baseline mean for the selected input variable and the measurement for the current time trial for the selected input variable; and computing an updated baseline variance based on a weighted sum comprising the baseline variance for the selected input variable and the measurement for the current time trial for the selected input variable.
40. The method of claim 39, wherein the step of updating the time-based baseline mean and variance for the selected input variable comprises the steps of:
computing an updated time-based baseline mean by:
computing an updated mean for each component based on a weighted sum comprising the baseline mean for the component and the measurement received for the selected input variable for the current time trial, and summing the updated means for the components; and computing an updated time-based baseline variance by:
computing an updated variance for each component based on a weighted sum comprising the baseline variance for the component and the measurement received for the selected input variable for the current time trial, and summing the updated variances for the components.
41. The method of claim 40, further comprising the steps of:
receiving imputed estimate and forecast estimate alerts corresponding to multiple input measurements;
weighting the alerts;
computing an alert score based on the weighted alerts; and determining whether to activate an alarm condition based on the alert score.
42. A computer storage medium storing computer-executable instruction for performing the method of claim 41.
43. An apparatus configured to perform the method of claim 41.
CA2471013A 2001-12-19 2002-12-19 Method and system for analyzing and predicting the behavior of systems Expired - Fee Related CA2471013C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US34231201P 2001-12-19 2001-12-19
US60/342,312 2001-12-19
PCT/US2002/040837 WO2003054704A1 (en) 2001-12-19 2002-12-19 Method and system for analyzing and predicting the behavior of systems

Publications (2)

Publication Number Publication Date
CA2471013A1 true CA2471013A1 (en) 2003-07-03
CA2471013C CA2471013C (en) 2011-07-26

Family

ID=23341268

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2471013A Expired - Fee Related CA2471013C (en) 2001-12-19 2002-12-19 Method and system for analyzing and predicting the behavior of systems

Country Status (5)

Country Link
US (1) US7280988B2 (en)
EP (1) EP1468361A1 (en)
AU (1) AU2002360691A1 (en)
CA (1) CA2471013C (en)
WO (1) WO2003054704A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11150165B2 (en) * 2019-03-01 2021-10-19 Dell Products, L.P. System and method for configuration drift detection and remediation

Families Citing this family (117)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7065566B2 (en) * 2001-03-30 2006-06-20 Tonic Software, Inc. System and method for business systems transactions and infrastructure management
AU2002305889A1 (en) 2001-06-08 2002-12-23 Netuitive, Inc. Automated analyzers for estimation systems
US20030208592A1 (en) * 2002-05-01 2003-11-06 Taylor William Scott System and method for proactive maintenance through monitoring the performance of a physical interface
US7539608B1 (en) * 2002-05-10 2009-05-26 Oracle International Corporation Techniques for determining effects on system performance of a memory management parameter
JP2004047885A (en) * 2002-07-15 2004-02-12 Matsushita Electric Ind Co Ltd Monitoring system and monitoring method of semiconductor manufacturing apparatus
US7281041B2 (en) * 2002-10-31 2007-10-09 Hewlett-Packard Development Company, L.P. Method and apparatus for providing a baselining and auto-thresholding framework
US20040199913A1 (en) * 2003-04-07 2004-10-07 Perrow Michael S. Associative memory model for operating system management
US7624174B2 (en) * 2003-05-22 2009-11-24 Microsoft Corporation Self-learning method and system for detecting abnormalities
EP1652088B1 (en) * 2003-07-25 2017-09-13 Philips Intellectual Property & Standards GmbH Method and device for monitoring a system
CA2543698C (en) 2003-10-27 2013-08-06 Netuitive, Inc. Computer performance estimation system configured to take expected events into consideration
US7873724B2 (en) * 2003-12-05 2011-01-18 Microsoft Corporation Systems and methods for guiding allocation of computational resources in automated perceptual systems
US20050216241A1 (en) * 2004-03-29 2005-09-29 Gadi Entin Method and apparatus for gathering statistical measures
GB2414576A (en) * 2004-05-25 2005-11-30 Arion Human Capital Ltd Business communication monitoring system detecting anomalous communication patterns
US7729269B1 (en) * 2004-06-09 2010-06-01 Sprint Communications Company L.P. Method for identifying and estimating mean traffic for high traffic origin-destination node pairs in a network
US7756043B1 (en) 2004-06-09 2010-07-13 Sprint Communications Company L.P. Method for identifying high traffic origin-destination node pairs in a packet based network
WO2006002071A2 (en) * 2004-06-15 2006-01-05 K5 Systems Inc. System and method for monitoring performance of groupings of network infrastructure and applications
US20070260350A1 (en) * 2004-08-20 2007-11-08 Maxim Zagrebnov Method for Improving Efficiency of a Manufacturing Process Such as a Semiconductor Fab Process
US20060092851A1 (en) * 2004-10-29 2006-05-04 Jeffrey Forrest Edlund Method and apparatus for communicating predicted future network requirements of a data center to a number of adaptive network interfaces
US7693982B2 (en) * 2004-11-12 2010-04-06 Hewlett-Packard Development Company, L.P. Automated diagnosis and forecasting of service level objective states
US7788536B1 (en) 2004-12-21 2010-08-31 Zenprise, Inc. Automated detection of problems in software application deployments
US20060150188A1 (en) * 2004-12-21 2006-07-06 Manuel Roman Method and apparatus for supporting soft real-time behavior
US7743286B2 (en) * 2005-05-17 2010-06-22 International Business Machines Corporation Method, system and program product for analyzing demographical factors of a computer system to address error conditions
US7908357B2 (en) * 2005-09-21 2011-03-15 Battelle Memorial Institute Methods and systems for detecting abnormal digital traffic
US20070174074A1 (en) * 2006-01-24 2007-07-26 International Business Machine Corporation Method, system, and program product for detecting behavior change in transactional data
US7395187B2 (en) * 2006-02-06 2008-07-01 International Business Machines Corporation System and method for recording behavior history for abnormality detection
US7523014B2 (en) * 2006-02-06 2009-04-21 Sun Microsystems, Inc. High-sensitivity detection of an anomaly in a quantized signal
US7533070B2 (en) * 2006-05-30 2009-05-12 Honeywell International Inc. Automatic fault classification for model-based process monitoring
US7987106B1 (en) * 2006-06-05 2011-07-26 Turgut Aykin System and methods for forecasting time series with multiple seasonal patterns
US7546198B2 (en) * 2006-08-03 2009-06-09 Spectral Dynamics, Inc. Dynamic noise-reduction baselining for real-time spectral analysis of internal combustion engine knock
US20080052145A1 (en) * 2006-08-10 2008-02-28 V2 Green, Inc. Power Aggregation System for Distributed Electric Resources
US20080056144A1 (en) * 2006-09-06 2008-03-06 Cypheredge Technologies System and method for analyzing and tracking communications network operations
US8014880B2 (en) 2006-09-29 2011-09-06 Fisher-Rosemount Systems, Inc. On-line multivariate analysis in a distributed process control system
US7673191B2 (en) * 2006-11-03 2010-03-02 Computer Associates Think, Inc. Baselining backend component error rate to determine application performance
US7676706B2 (en) * 2006-11-03 2010-03-09 Computer Associates Think, Inc. Baselining backend component response time to determine application performance
US7840377B2 (en) * 2006-12-12 2010-11-23 International Business Machines Corporation Detecting trends in real time analytics
US8271981B2 (en) * 2006-12-12 2012-09-18 International Business Machines Corporation Detecting an extraordinary behavior
US20080183444A1 (en) * 2007-01-26 2008-07-31 Grichnik Anthony J Modeling and monitoring method and system
US20100131082A1 (en) * 2007-05-23 2010-05-27 Chandler Larry S Inversion Loci Generator and Criteria Evaluator for Rendering Errors in Variable Data Processing
US7930146B2 (en) * 2007-05-23 2011-04-19 Chandler Larry S Errors-in-variables data processing including essential weighting of mapped path-oriented deviations with normal component discrimination
US8032867B2 (en) 2007-06-05 2011-10-04 Computer Associates Think, Inc. Programmatic root cause analysis for application performance management
US20090077156A1 (en) * 2007-09-14 2009-03-19 Srinivas Raghav Kashyap Efficient constraint monitoring using adaptive thresholds
US20090198559A1 (en) * 2008-02-06 2009-08-06 Disney Enterprises, Inc. Multi-resolutional forecasting system
US9363143B2 (en) 2008-03-27 2016-06-07 International Business Machines Corporation Selective computation using analytic functions
US20090248722A1 (en) * 2008-03-27 2009-10-01 International Business Machines Corporation Clustering analytic functions
US8745361B2 (en) * 2008-12-02 2014-06-03 Microsoft Corporation Sandboxed execution of plug-ins
US20100257533A1 (en) 2009-04-01 2010-10-07 Soluto Ltd Computer applications scheduler
US9805213B1 (en) 2009-06-03 2017-10-31 James F. Kragh Identity validation and verification system and associated methods
US9280684B1 (en) 2009-06-03 2016-03-08 James F. Kragh Identity validation and verification system and associated methods
US10255419B1 (en) 2009-06-03 2019-04-09 James F. Kragh Identity validation and verification system and associated methods
US8984282B1 (en) 2009-06-03 2015-03-17 James F. Kragh Identity validation and verification system and associated methods
WO2011046228A1 (en) * 2009-10-15 2011-04-21 日本電気株式会社 System operation management device, system operation management method, and program storage medium
US20110098973A1 (en) * 2009-10-23 2011-04-28 Computer Associates Think, Inc. Automatic Baselining Of Metrics For Application Performance Management
US8644813B1 (en) 2009-12-02 2014-02-04 Sprint Communications Company L.P. Customer initiated mobile diagnostics service
EP2360590A3 (en) * 2009-12-10 2011-10-26 Prelert Ltd. Apparatus and method for analysing a computer infrastructure
US20110161048A1 (en) * 2009-12-31 2011-06-30 Bmc Software, Inc. Method to Optimize Prediction of Threshold Violations Using Baselines
US8457928B2 (en) * 2010-03-26 2013-06-04 Bmc Software, Inc. Automatic determination of dynamic threshold for accurate detection of abnormalities
US8478569B2 (en) * 2010-03-26 2013-07-02 Bmc Software, Inc. Auto adjustment of baseline on configuration change
WO2011128922A1 (en) * 2010-04-15 2011-10-20 Neptuny S.R.L. Automated upgrading method for capacity of it system resources
US9443201B2 (en) * 2010-06-09 2016-09-13 Siemens Aktiengesellschaft Systems and methods for learning of normal sensor signatures, condition monitoring and diagnosis
EP2583225A4 (en) * 2010-06-21 2014-03-05 Hewlett Packard Development Co System for testing and certifying a virtual appliance on a customer computer system
WO2012029500A1 (en) * 2010-09-01 2012-03-08 日本電気株式会社 Operations management device, operations management method, and program
US8560544B2 (en) 2010-09-15 2013-10-15 International Business Machines Corporation Clustering of analytic functions
US8620851B2 (en) 2010-11-23 2013-12-31 Novell, Inc. System and method for determining fuzzy cause and effect relationships in an intelligent workload management system
US20150235312A1 (en) 2014-02-14 2015-08-20 Stephen Dodson Method and Apparatus for Detecting Rogue Trading Activity
JP5532150B2 (en) * 2011-01-24 2014-06-25 日本電気株式会社 Operation management apparatus, operation management method, and program
MX2013011619A (en) * 2011-04-04 2014-01-23 Numerex Corp Systems and method for monitoring and managing the communications of remote devices.
US20120272103A1 (en) * 2011-04-21 2012-10-25 Microsoft Corporation Software operability service
CN102270271B (en) * 2011-05-03 2014-03-19 北京中瑞泰科技有限公司 Equipment failure early warning and optimizing method and system based on similarity curve
US9928130B2 (en) * 2011-06-03 2018-03-27 Beet, Llc Method for generating a machine heartbeat
US8880442B2 (en) * 2011-06-03 2014-11-04 Beet, Llc Method for generating a machine heartbeat
US20130166337A1 (en) * 2011-12-26 2013-06-27 John MacGregor Analyzing visual representation of data
US8588764B1 (en) * 2012-01-26 2013-11-19 Sprint Communications Company L.P. Wireless network edge guardian
US10353738B2 (en) * 2012-03-21 2019-07-16 International Business Machines Corporation Resource allocation based on social networking trends in a networked computing environment
EP2645257A3 (en) * 2012-03-29 2014-06-18 Prelert Ltd. System and method for visualisation of behaviour within computer infrastructure
US10162693B1 (en) 2012-10-18 2018-12-25 Sprint Communications Company L.P. Evaluation of mobile device state and performance metrics for diagnosis and troubleshooting of performance issues
US9450839B2 (en) * 2012-11-09 2016-09-20 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Efficient network bandwidth utilization in a distributed processing system
US9386463B1 (en) 2012-11-19 2016-07-05 Sprint Communications Company L.P. Application risk analysis
KR101980834B1 (en) * 2012-11-28 2019-05-21 한국전자통신연구원 Method and apparatus for managing applications based on contexts
EP2743831A1 (en) * 2012-12-13 2014-06-18 Telefonica S.A. A method and a system for the self-adjustment optimization of a computing device
US9965946B2 (en) * 2013-03-13 2018-05-08 Masimo Corporation Systems and methods for monitoring a patient health network
US10628838B2 (en) 2013-04-24 2020-04-21 International Business Machines Corporation System and method for modeling and forecasting cyclical demand systems with dynamic controls and dynamic incentives
CN104182332B (en) * 2013-05-21 2017-09-29 华为技术有限公司 Judge resource leakage, predict the method and device of resource service condition
GB2517147A (en) 2013-08-12 2015-02-18 Ibm Performance metrics of a computer system
GB2519941B (en) 2013-09-13 2021-08-25 Elasticsearch Bv Method and apparatus for detecting irregularities on device
US10114148B2 (en) 2013-10-02 2018-10-30 Nec Corporation Heterogeneous log analysis
EP2887236A1 (en) * 2013-12-23 2015-06-24 D square N.V. System and method for similarity search in process data
CN103927695B (en) * 2014-04-22 2017-11-24 国家电网公司 Ultrashort-term wind power prediction method based on self study complex data source
US9400731B1 (en) * 2014-04-23 2016-07-26 Amazon Technologies, Inc. Forecasting server behavior
US10048670B2 (en) * 2014-05-08 2018-08-14 Beet, Llc Automation operating and management system
US11017330B2 (en) * 2014-05-20 2021-05-25 Elasticsearch B.V. Method and system for analysing data
CN104317681B (en) * 2014-09-02 2017-09-08 上海交通大学 For the behavioral abnormal automatic detection method and detecting system of computer system
US10176032B2 (en) * 2014-12-01 2019-01-08 Uptake Technologies, Inc. Subsystem health score
US9866578B2 (en) * 2014-12-03 2018-01-09 AlphaSix Corp. System and method for network intrusion detection anomaly risk scoring
US9646264B2 (en) * 2015-02-25 2017-05-09 International Business Machines Corporation Relevance-weighted forecasting based on time-series decomposition
US10579750B2 (en) 2015-06-05 2020-03-03 Uptake Technologies, Inc. Dynamic execution of predictive models
US10176279B2 (en) 2015-06-05 2019-01-08 Uptake Technologies, Inc. Dynamic execution of predictive models and workflows
US10254751B2 (en) 2015-06-05 2019-04-09 Uptake Technologies, Inc. Local analytics at an asset
US10878385B2 (en) 2015-06-19 2020-12-29 Uptake Technologies, Inc. Computer system and method for distributing execution of a predictive model
US10628801B2 (en) * 2015-08-07 2020-04-21 Tata Consultancy Services Limited System and method for smart alerts
EP3341808B1 (en) * 2015-08-24 2023-09-06 BEET, Inc. Method for generating a machine heartbeat to monitor such machine
US9959158B2 (en) * 2015-10-13 2018-05-01 Honeywell International Inc. Methods and apparatus for the creation and use of reusable fault model components in fault modeling and complex system prognostics
US10101049B2 (en) 2015-11-12 2018-10-16 Oracle International Corporation Determining parameters of air-cooling mechanisms
US10102033B2 (en) * 2016-05-26 2018-10-16 International Business Machines Corporation Method and system for performance ticket reduction
US10565046B2 (en) * 2016-09-01 2020-02-18 Intel Corporation Fault detection using data distribution characteristics
CN106407077A (en) * 2016-09-21 2017-02-15 广州华多网络科技有限公司 A real-time alarm method and system
US10771369B2 (en) * 2017-03-20 2020-09-08 International Business Machines Corporation Analyzing performance and capacity of a complex storage environment for predicting expected incident of resource exhaustion on a data path of interest by analyzing maximum values of resource usage over time
US11621969B2 (en) 2017-04-26 2023-04-04 Elasticsearch B.V. Clustering and outlier detection in anomaly and causation detection for computing environments
US11783046B2 (en) 2017-04-26 2023-10-10 Elasticsearch B.V. Anomaly and causation detection in computing environments
US11014780B2 (en) 2017-07-06 2021-05-25 Otis Elevator Company Elevator sensor calibration
US10829344B2 (en) 2017-07-06 2020-11-10 Otis Elevator Company Elevator sensor system calibration
US11023280B2 (en) * 2017-09-15 2021-06-01 Splunk Inc. Processing data streams received from instrumented software using incremental finite window double exponential smoothing
US10922204B2 (en) * 2018-06-13 2021-02-16 Ca, Inc. Efficient behavioral analysis of time series data
US11132248B2 (en) * 2018-11-29 2021-09-28 Nec Corporation Automated information technology system failure recommendation and mitigation
CN112580903A (en) * 2019-09-27 2021-03-30 华晨宝马汽车有限公司 Method and apparatus for evaluating quality stability of engine and storage medium
US11392473B2 (en) 2020-12-10 2022-07-19 International Business Machines Corporation Automated extension of program data storage
US11294929B1 (en) * 2021-06-09 2022-04-05 Aeec Smart water data analytics
CN113870304B (en) * 2021-12-07 2022-06-07 江西中业智能科技有限公司 Abnormal behavior detection and tracking method and device, readable storage medium and equipment

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE68922567T2 (en) 1988-10-06 1995-08-17 Toshiba Kawasaki Kk Neural network system.
US5239594A (en) * 1991-02-12 1993-08-24 Mitsubishi Denki Kabushiki Kaisha Self-organizing pattern classification neural network system
EP0528399A3 (en) 1991-08-19 1994-12-21 Toyoda Machine Works Ltd Method and apparatus for learning of neural network
JPH05342191A (en) * 1992-06-08 1993-12-24 Mitsubishi Electric Corp System for predicting and analyzing economic time sequential data
DE4243882C1 (en) 1992-12-23 1994-01-05 Baleanu Michael Alin Method and device for monitoring a technical process
US5461699A (en) * 1993-10-25 1995-10-24 International Business Machines Corporation Forecasting using a neural network and a statistical forecast
US5748851A (en) * 1994-02-28 1998-05-05 Kabushiki Kaisha Meidensha Method and apparatus for executing short-term prediction of timeseries data
US5835902A (en) 1994-11-02 1998-11-10 Jannarone; Robert J. Concurrent learning and performance information processing system
EP0770967A3 (en) * 1995-10-26 1998-12-30 Koninklijke Philips Electronics N.V. Decision support system for the management of an agile supply chain
US5727128A (en) * 1996-05-08 1998-03-10 Fisher-Rosemount Systems, Inc. System and method for automatically determining a set of variables for use in creating a process model
CA2272621C (en) 1996-11-20 2006-07-04 Robert J. Jannarone Multi-kernel neural network concurrent learning, monitoring, and forecasting system
EP0895197B1 (en) * 1997-07-31 2006-01-11 Sulzer Markets and Technology AG Method for monitoring installations with mechanical components
US6216119B1 (en) 1997-11-19 2001-04-10 Netuitive, Inc. Multi-kernel neural network concurrent learning, monitoring, and forecasting system
US6182022B1 (en) * 1998-01-26 2001-01-30 Hewlett-Packard Company Automated adaptive baselining and thresholding method and system
US6327677B1 (en) * 1998-04-27 2001-12-04 Proactive Networks Method and apparatus for monitoring a network environment
US6205431B1 (en) * 1998-10-29 2001-03-20 Smart Software, Inc. System and method for forecasting intermittent demand
US6792399B1 (en) * 1999-09-08 2004-09-14 C4Cast.Com, Inc. Combination forecasting using clusterization
US6801945B2 (en) * 2000-02-04 2004-10-05 Yahoo ! Inc. Systems and methods for predicting traffic on internet sites
US6879988B2 (en) * 2000-03-09 2005-04-12 Pkware System and method for manipulating and managing computer archive files
US6876988B2 (en) 2000-10-23 2005-04-05 Netuitive, Inc. Enhanced computer performance forecasting system
US6928398B1 (en) * 2000-11-09 2005-08-09 Spss, Inc. System and method for building a time series model
US20030036890A1 (en) 2001-04-30 2003-02-20 Billet Bradford E. Predictive method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11150165B2 (en) * 2019-03-01 2021-10-19 Dell Products, L.P. System and method for configuration drift detection and remediation

Also Published As

Publication number Publication date
WO2003054704A1 (en) 2003-07-03
CA2471013C (en) 2011-07-26
US7280988B2 (en) 2007-10-09
AU2002360691A1 (en) 2003-07-09
EP1468361A1 (en) 2004-10-20
US20030139905A1 (en) 2003-07-24

Similar Documents

Publication Publication Date Title
CA2471013A1 (en) Method and system for analyzing and predicting the behavior of systems
CN108052528A (en) A kind of storage device sequential classification method for early warning
JP6354755B2 (en) System analysis apparatus, system analysis method, and system analysis program
WO2021056724A1 (en) Anomaly detection method and apparatus, electronic device and storage medium
CN111459700A (en) Method and apparatus for diagnosing device failure, diagnostic device, and storage medium
Lai et al. Online pattern matching and prediction of incoming alarm floods
CN113518011B (en) Abnormality detection method and apparatus, electronic device, and computer-readable storage medium
CN110032490A (en) Method and device thereof for detection system exception
JP2004531815A (en) Diagnostic system and method for predictive condition monitoring
CN111045894A (en) Database anomaly detection method and device, computer equipment and storage medium
CN112800116A (en) Method and device for detecting abnormity of service data
CN111538311B (en) Flexible multi-state self-adaptive early warning method and device for mechanical equipment based on data mining
CN110858072B (en) Method and device for determining running state of equipment
KR101960755B1 (en) Method and apparatus of generating unacquired power data
EP2132609A1 (en) Machine condition monitoring using discontinuity detection
CN113949652A (en) User abnormal behavior detection method and device based on artificial intelligence and related equipment
CN116894653A (en) Personnel management data processing method and system based on multi-prediction model linkage
US7840391B2 (en) Model-diversity technique for improved proactive fault monitoring
CN110517731A (en) Genetic test quality monitoring data processing method and system
JP2007164346A (en) Decision tree changing method, abnormality determination method, and program
CN112949951A (en) Data prediction method, data prediction device, electronic equipment and storage medium
CN114490829A (en) Fault identification method, device, equipment and storage medium
EP3604195B1 (en) Method, system and computer program product for predicting failure of a noise-emitting apparatus
CN111625437A (en) Monitoring method and device of wind control model
CN114692783B (en) Intelligent service abnormality detection method based on hierarchical graph deviation network

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20151221