CN102710446A - Performance tuning method of colony memory system based on synchronous strategy - Google Patents
Performance tuning method of colony memory system based on synchronous strategy Download PDFInfo
- Publication number
- CN102710446A CN102710446A CN2012101849632A CN201210184963A CN102710446A CN 102710446 A CN102710446 A CN 102710446A CN 2012101849632 A CN2012101849632 A CN 2012101849632A CN 201210184963 A CN201210184963 A CN 201210184963A CN 102710446 A CN102710446 A CN 102710446A
- Authority
- CN
- China
- Prior art keywords
- module
- control module
- read
- performance
- client node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a performance tuning method of a colony memory system based on a synchronous strategy. The system comprises a data node module group, a control module group and a client node module group, wherein three module groups are matched and communicated with each other through taking the control module group as a core, so that test and monitoring tasks of the system are completed, wherein the control module group is responsible for loading, scheduling and balancing all modules, collecting a test result and synchronizing time of all modules, the data node module group is used for collecting data node monitoring information and time synchronization, the client node module group is used for simulating reading and writing operations, collecting monitoring data of a client node and realizing time synchronization, through monitoring data, a bottleneck of the system is discovered, so that the system structure is adjusted, and the system performance is optimized.
Description
Technical field
The present invention relates to the Computer Applied Technology field, specifically a kind of cluster storage system Performance tuning method based on synchronization policy.
The present invention is applicable in the popular cluster storage system of present industry.Computer cluster be called for short cluster be a kind of computer system it couple together highly closely cooperation completion evaluation work through one group of loose integrated computer software and hardware.At present; Because the dramatic growth of individual and business data; The cluster storage system development rapidly; But at present for cluster storage system be to test the aspect, basically still prolong method according to the individual node performance test, the method that then The performance test results of each node is added up is come the performance of gauge cluster storage system.This method, though simple, rigorous inadequately and science.
Background technology
At present; Popular performance testing tool, though can multithreading, multi-process test readwrite bandwidth; Many test options also are provided; Can test the performance index with machine-readable, random write, sequential read, sequential write, still, these instruments are just done test to the readwrite bandwidth of individual node.Test the performance of whole group system if desired, add up if just simply the The performance test results of a plurality of nodes is done one, because the asynchronism that the process of the asynchronism of time and each node finishes, test result is often not accurate enough.Therefore, based on cluster storage system architecture design testing tool, just extremely urgent.
Summary of the invention
The purpose of this invention is to provide a kind of cluster storage system Performance tuning method based on synchronization policy.
The objective of the invention is to realize that by following mode system comprises: back end module groups, control module group and client node module groups, three module groups cooperatively interact and communicate by letter; With the control module group is core, accomplishes system testing and monitor task jointly, wherein; The control module group is responsible for load dispatch and balanced all modules, collects the time of test result and synchronous all modules, and the back end module groups is used to collect back end monitor message and time synchronized; The client node module groups is used to simulate read-write operation, collects the monitor data of client node and realizes time synchronized; Through monitor data, find the bottleneck of system, thus the Adjustment System structure; Optimization of system performance, wherein:
The back end module groups comprises three sub-module: data performance monitor module, time synchronized module and communication control module; Wherein, The data performance monitor module is used to collect the offered load of back end, the information of cpu load; The time synchronized module is used for and control module group lock in time, and the information interaction of data performance monitor module and time synchronized module and control module group is to accomplish through the communication control module of communication control module and control module group;
The control module groupComprise load dispatch module, information gathering module, computing module, time synchronized control module, communication control module and communication control module as a result; Load dispatch module and time synchronized control module; Can make balanced more and the better consistent and synchronism of read-write operation on each node; The load dispatch module receive computing module as a result as a result the time, dispatch and adjust the read-write analog module of each client, make each client node read-write operation balanced more; Here it is so-called synchronization policy guarantees the synchronism of each node time and read-write operation;
The client node module groups comprises read-write analog module, performance monitoring module, time synchronized module and communication control module; The read-write analog module is responsible on client node, simulating read-write operation; And accept the scheduling of load dispatch module; Adjustment read-write operation, performance monitoring module are responsible for collecting performance, the cpu load of client node, the information of offered load.
The invention has the beneficial effects as follows: under this pattern; Because testing tool all has traffic monitoring to all nodes of whole system,, be easy to find bottleneck if when therefore the performance of system goes wrong; Thereby realize quick trouble-shooting, the purpose of fixing a breakdown.Debugging and failure diagnosis and optimization for system play a key effect.During this Software deployment, need be in the back end deploy back end module groups of cluster storage system, in client node deploy client node module groups.The control module group can be deployed on the arbitrary node in the cluster as required.
Method of the present invention adapts to the framework and the testing requirement of cluster storage system; Can monitor simultaneously the readwrite performance of each node; Be easy to find the performance bottleneck of group system, and, make that the test on each node can be accomplished synchronously owing to introduced the function of time synchronized and load dispatch; The result who tests out is more reliable, more science.
Description of drawings
Fig. 1 cluster memory property test job schematic diagram;
Fig. 2 cluster storage system Organization Chart.
Embodiment
With reference to Figure of description to explanation at length below the work of the present invention.
Given this, the present invention provides a kind of cluster storage system Performance tuning method based on synchronization policy.This method adapts to the framework and the testing requirement of cluster storage system; Can monitor simultaneously the readwrite performance of each node; Be easy to find the performance bottleneck of group system, and, make that the test on each node can be accomplished synchronously owing to introduced the function of time synchronized and load dispatch; The result who tests out is more reliable, more science.
This method comprises three big module groups: back end module groups (101), control module group (102) and client node module groups (103).Three big module groups cooperatively interact and communicate by letter, and are core with the control module group, accomplish system testing and monitor task jointly.Wherein, the control module group is responsible for load dispatch and balanced all modules, collects the time of test result and synchronous all modules.The back end module groups is used to collect back end monitor message and time synchronized.The client node module groups is used to simulate read-write operation, collects the monitor data of client node and realizes time synchronized.
Back end module groups (101) comprises three sub-module: data performance monitor module, time synchronized module and communication control module.Wherein, the data performance monitor module is used to collect information such as the offered load, cpu load of back end, and the time synchronized module is used for and control module group lock in time.The information interaction of data performance monitor module and time synchronized module and control module group is to accomplish through the communication control module 2 of communication control module and control module group.
Control module group (102) comprises the load dispatch module, and the information gathering module, computing module, time synchronized control module, communication control module 1 and communication control module 2 are formed as a result.Wherein, the information gathering module is responsible for collecting the monitor message of each module, feeds back to computing module as a result then, and the performance that performance adds up and all back end monitor that calculates all client nodes respectively by computing module as a result then adds up.Simultaneously; Computing module will calculate the performance difference between each client node as a result; At this moment; If each client node performance difference surpasses certain value, just call the read-write analog module of load dispatch module schedules and balanced each client node, make each client node balancing performance.Wherein, communication control module 1 is responsible for and the communicating by letter of all client node module groups.Communication control module 2 is responsible for communicating by letter with all back end module groups.The time synchronized control module is responsible for the time of synchronous whole system, guarantees the consistency and the synchronism of test.The core of this method that Here it is, utilize the time synchronized control module guarantee each node time synchronously, utilize the load dispatch module to guarantee the synchronism of the read-write operation of each node.
Client node module groups (103) comprises read-write analog module, performance monitoring module, time synchronized module and communication control module.The read-write analog module is responsible on client node, simulating read-write operation, and accepts the scheduling of load dispatch module, the adjustment read-write operation.The performance monitoring module is responsible for collecting information such as the performance, cpu load, offered load of client node.
Except that the described technical characterictic of specification, be the known technology of those skilled in the art.
Claims (1)
1. cluster storage system Performance tuning method based on synchronization policy is characterized in that system comprises: back end module groups, control module group and client node module groups, and three module groups cooperatively interact and communicate by letter; With the control module group is core, accomplishes system testing and monitor task jointly, wherein; The control module group is responsible for load dispatch and balanced all modules, collects the time of test result and synchronous all modules, and the back end module groups is used to collect back end monitor message and time synchronized; The client node module groups is used to simulate read-write operation, collects the monitor data of client node and realizes time synchronized; Through monitor data, find the bottleneck of system, thus the Adjustment System structure; Optimization of system performance, wherein:
The back end module groups comprises three sub-module: data performance monitor module, time synchronized module and communication control module; Wherein, The data performance monitor module is used to collect the offered load of back end, the information of cpu load; The time synchronized module is used for and control module group lock in time, and the information interaction of data performance monitor module and time synchronized module and control module group is to accomplish through the communication control module of communication control module and control module group;
The control module group comprises load dispatch module, information gathering module, computing module, time synchronized control module, communication control module and communication control module as a result; Load dispatch module and time synchronized control module; Can make balanced more and the better consistent and synchronism of read-write operation on each node; The load dispatch module receive computing module as a result as a result the time, dispatch and adjust the read-write analog module of each client, make each client node read-write operation balanced more; Here it is so-called synchronization policy guarantees the synchronism of each node time and read-write operation;
The client node module groups comprises read-write analog module, performance monitoring module, time synchronized module and communication control module; The read-write analog module is responsible on client node, simulating read-write operation; And accept the scheduling of load dispatch module; Adjustment read-write operation, performance monitoring module are responsible for collecting performance, the cpu load of client node, the information of offered load.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101849632A CN102710446A (en) | 2012-06-07 | 2012-06-07 | Performance tuning method of colony memory system based on synchronous strategy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101849632A CN102710446A (en) | 2012-06-07 | 2012-06-07 | Performance tuning method of colony memory system based on synchronous strategy |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102710446A true CN102710446A (en) | 2012-10-03 |
Family
ID=46903016
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101849632A Pending CN102710446A (en) | 2012-06-07 | 2012-06-07 | Performance tuning method of colony memory system based on synchronous strategy |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102710446A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078763A (en) * | 2012-12-18 | 2013-05-01 | 北京尊冠科技有限公司 | Multi-protocol parallel test method and system of information storage system |
| CN103116538A (en) * | 2013-01-25 | 2013-05-22 | 浪潮电子信息产业股份有限公司 | Design for computer performance self-adjusting system |
| CN103984619A (en) * | 2014-06-06 | 2014-08-13 | 山东超越数控电子有限公司 | Performance monitoring method of network storage system |
| CN104536861A (en) * | 2015-01-26 | 2015-04-22 | 浪潮电子信息产业股份有限公司 | Multi-operation system based FC SAN (Fiber Channel Storage Area Network) memory testing method |
| CN103116538B (en) * | 2013-01-25 | 2016-11-30 | 浪潮电子信息产业股份有限公司 | A kind of design for computing power self-regulating system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050187993A1 (en) * | 2001-10-24 | 2005-08-25 | Bea Systems, Inc. | Data synchronization |
| US20090106179A1 (en) * | 2007-10-18 | 2009-04-23 | Friedlander Robert R | System and method for the longitudinal analysis of education outcomes using cohort life cycles, cluster analytics-based cohort analysis, and probablistic data schemas |
| CN102291449A (en) * | 2011-08-08 | 2011-12-21 | 浪潮电子信息产业股份有限公司 | Method for testing and adjusting cluster storage system performance based on synchronous strategy |
-
2012
- 2012-06-07 CN CN2012101849632A patent/CN102710446A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050187993A1 (en) * | 2001-10-24 | 2005-08-25 | Bea Systems, Inc. | Data synchronization |
| US20090106179A1 (en) * | 2007-10-18 | 2009-04-23 | Friedlander Robert R | System and method for the longitudinal analysis of education outcomes using cohort life cycles, cluster analytics-based cohort analysis, and probablistic data schemas |
| CN102291449A (en) * | 2011-08-08 | 2011-12-21 | 浪潮电子信息产业股份有限公司 | Method for testing and adjusting cluster storage system performance based on synchronous strategy |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078763A (en) * | 2012-12-18 | 2013-05-01 | 北京尊冠科技有限公司 | Multi-protocol parallel test method and system of information storage system |
| CN103078763B (en) * | 2012-12-18 | 2016-04-20 | 北京尊冠科技有限公司 | A kind of multi-protocols parallel test method of information storage system and system |
| CN103116538A (en) * | 2013-01-25 | 2013-05-22 | 浪潮电子信息产业股份有限公司 | Design for computer performance self-adjusting system |
| CN103116538B (en) * | 2013-01-25 | 2016-11-30 | 浪潮电子信息产业股份有限公司 | A kind of design for computing power self-regulating system |
| CN103984619A (en) * | 2014-06-06 | 2014-08-13 | 山东超越数控电子有限公司 | Performance monitoring method of network storage system |
| CN104536861A (en) * | 2015-01-26 | 2015-04-22 | 浪潮电子信息产业股份有限公司 | Multi-operation system based FC SAN (Fiber Channel Storage Area Network) memory testing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102291449B (en) | Method for testing and adjusting cluster storage system performance based on synchronous strategy | |
| CN108469989A (en) | A kind of reaction type based on clustering performance scalable appearance method and system automatically | |
| CN108845954B (en) | Pressure testing method, system and storage medium | |
| CN109933632B (en) | Data migration method, device and equipment for database | |
| CN102967815B (en) | Chip testing method, automated testing equipment and system | |
| CN206224231U (en) | A kind of HIL test systems of entire car controller VCU | |
| CN108508477B (en) | Seismic data acquisition system and method | |
| EP3486780B1 (en) | Instruction processing alignment system | |
| CN102710446A (en) | Performance tuning method of colony memory system based on synchronous strategy | |
| CN110287107A (en) | The data processing of block chain and intelligent contract combined debugging integrated approach, system and computer readable storage medium | |
| CN108804241B (en) | Cross-platform task scheduling method, system, computer equipment and storage medium | |
| CN111581137B (en) | Data record recharge system and method | |
| CN109117244A (en) | A kind of implementation method of resources of virtual machine application queuing mechanism | |
| CN109542602A (en) | It is a kind of based on the distributed task scheduling processing method of block chain, apparatus and system | |
| CN101098359B (en) | Time sharing test approach for tester | |
| US10175678B2 (en) | Automatic thin-cutting device, parameter generation device, automatic thin-cutting method, and program | |
| CN108334428B (en) | Parallel testing method for system functions | |
| CN104731702B (en) | Test system and its service end | |
| CN103778005A (en) | Automatic task allocation method and device | |
| CN103279408A (en) | RAID (redundant array of inexpensive disk) performance testing method | |
| TW201310181A (en) | Multi-testing process management method and system | |
| CN108718253A (en) | A kind of positioning problems method and device | |
| CN103605612A (en) | Method for rapidly selecting automatic test case | |
| US10599513B2 (en) | Message synchronization system | |
| CN113282393A (en) | Method for solving task scheduling facing to multiple portrait label jobs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121003 |