Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberCN102045399 B
Publication typeGrant
Application numberCN 201010609600
Publication date18 Sep 2013
Filing date30 Dec 2010
Priority date30 Dec 2010
Also published asCN102045399A
Publication number201010609600.X, CN 102045399 B, CN 102045399B, CN 201010609600, CN-B-102045399, CN102045399 B, CN102045399B, CN201010609600, CN201010609600.X
Inventors郭强, 贾宝军, 郝芸霞
Applicant中国联合网络通信集团有限公司
Export CitationBiBTeX, EndNote, RefMan
External Links: SIPO, Espacenet
Cloud computing mode file system and file reading method
CN 102045399 B
Abstract  translated from Chinese
本发明提供一种云计算模式文件系统及文件读取方法。 The present invention provides a cloud computing mode file system and file reading method. 其中,所述系统包括:第一客户端模块,用于发出文件读取请求;文件管理模块,用于根据第一客户端模块发出的所述文件读取请求发出索引获取请求;分布式管理模块,用于根据文件管理模块发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址;分布式传输模块,用于根据分布式管理模块获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块发送给所述第一客户端模块。 Wherein the system comprises: a first client module for issuing a file read request; document management module for issuing index acquisition request based on the file first client module issues a read request; Distributed Management Module for acquiring management module according to the index file requests from IP address to obtain the required documents and index information in the file where the server; distributed transmission modules for the index information based on distributed management module acquires and the said IP address to read the file from the appropriate server, via the file management module is sent to the first client module. 本发明实现了基于IP的文件读取方式,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大。 The present invention enables to read the papers based on IP, for IP distributed structure, with open and unified standard interface, extend strong performance.
Claims(7)  translated from Chinese
1.一种云计算模式文件系统,其特征在于,包括: 第一客户端模块,用于发出文件读取请求; 文件管理模块,用于根据第一客户端模块发出的所述文件读取请求发出索引获取请求; 分布式管理模块,用于根据文件管理模块发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址; 分布式传输模块,用于根据分布式管理模块获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块发送给所述第一客户端模块; 协议适配模块,根据所述服务器的本地文件系统格式对分布式管理模块获取的所述索弓I信息进行协议适配,得到适配后的索引信息; 所述分布式传输模块还用于根据协议适配模块得到的所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件; 所述协议适配模块还用于对分布式传输模块读取的所述文件进行协议适配,得到适配后的文件; 所述分布式传输模块经所述文件管理模块将所述适配后的文件发送给所述第一客户端模块。 A cloud computing model file system comprising: a first client module for issuing a file read request; document management module for the read request according to the document issued by the first client module issue index acquisition request; distributed management module for acquiring management module according to the index file requests from IP address to obtain the required documents and index information in the file server; distributed transmission module for distributed management the index information and the IP address of the module obtained from the corresponding server reads the file and sent to the first client module via the file management module; protocol adaptation module, based on the server's local file the system format for the index bow I get information distributed management protocol adapter module, get the adapted index information; and the distributed transmission module is further configured according to the protocol adaptation module obtained after the adaptation index information and the IP address to read the file from the appropriate server; the protocol adaptation module is also used to read the file transfer module will be distributed protocol adaptation, give the file the adapted; the said distributed transmission module via the File Manager module file is sent to the adapter after the first client module.
2.根据权利要求1所述的系统,其特征在于,还包括: 配置管理模块,用于根据文件管理模块发出的所述索引获取请求查找相应的资源分布配置信息; 核心算法模块,用于根据配置管理模块查找到的资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址发送给所述分布式管理模块。 2. The system according to claim 1, characterized by further comprising: a configuration management module, the index for the document issued by the management module according to the acquisition request to find the appropriate configuration information resource distribution; core algorithm module for configuration management module to the distribution of resources to find the configuration information needed to obtain the index file and the file server where the IP address is sent to the Distributed Management module.
3.根据权利要求1所述的系统,其特征在于,还包括:点对点传输模块;所述分布式传输模块还用于根据读取的所述文件生成相应的文件种子保存在所述点对点传输模块中。 3. The system according to claim 1, characterized by further comprising: a point to point transmission module; the distributed transmission module is further configured to generate a corresponding file in accordance with the seed stored in the file read point transmission modules in.
4.根据权利要求3所述的系统,其特征在于,还包括: 第二客户端模块,用于发出另一文件读取请求; 所述文件管理模块还用于查询所述分布式传输模块是否曾经向所述第一客户端模块传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户端模块; 当所述查询结果为是时,所述第二客户端模块还用于从所述点对点传输模块中获取相应的文件种子,并根据该文件种子以点对点方式从相应的第一客户端模块获取该第一客户端模块中保存的与所述文件种子相应的文件。 4. The system according to claim 3, characterized in that, further comprising: a second client module for issuing another read request file; the file management module is further configured to query whether the distributed transmission module Once transmitted through the first client module to the other file read requests to read the file, and sends the query result to the second client module; when the query result is YES, the the second client module is also used to obtain the appropriate file from the seed point to point transmission module and to point the way to get the first client module stored with the client from the respective first module based on the file seed the corresponding file seed.
5.一种文件读取方法,其特征在于,包括: 接收由第一客户端模块发出的文件读取请求; 根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址; 根据所述索引信息及所述IP地址从相应的服务器读取所述文件; 将读取的所述文件发送给所述第一客户端模块; 根据所述索引信息及所述IP地址从相应的服务器读取所述文件包括: 根据所述服务器的本地文件系统格式对所述索引信息进行协议适配,得到适配后的索弓K目息;根据所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件; 将读取的所述文件发送给所述第一客户端模块包括: 对读取的所述文件进行协议适配,得到适配后的文件; 将所述适配后的文件发送给所述第一客户端模块。 A document reading method comprising: receiving document issued by the first client module read request; acquiring IP index information required files and the file server where the file according to the read request address; read in accordance with the index information and the IP address of the appropriate server from the file; the file will be sent to read the first client module; according to the index information and the IP address from corresponding server reads the file includes: according to the local file system format on the server the protocol adaptation index information, obtain cable mesh bow K Adapted interest; after the index information and the adaptation The IP address to read the file from the appropriate server; will read the file is sent to the first client module comprises: read the file protocol adapter, get the file after adaptation ; the file is sent to the adapter after the first client module.
6.根据权利要求5所述的方法,其特征在于,根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址包括: 根据所述文件读取请求生成索引获取请求; 根据所述索引获取请求查找相应的资源分布配置信息; 根据查找到的所述资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址。 6. The method according to claim 5, characterized in that the information needed to obtain the IP address of the index file and the file based on the file server, including the read request: according to the document read request generating an index acquisition request ; acquisition request according to the index to find the appropriate distribution of resources configuration; configuration information based on the distribution of resources to find the information needed to get the index file and the file server where the IP address.
7.根据权利要求5所述的方法,其特征在于,根据所述索引信息及所述IP地址从相应的服务器读取所述文件之后还包括: 根据读取的所述文件生成相应的文件种子; 当接收到来自第二客户端模块发出的另一文件读取请求时,查询是否曾经向所述第一客户端模块传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户块; 当所述查询结果为是时,`所述第二客户端模块获取相应的文件种子; 所述第二客户端模块根据所述文件种子以点对点方式从所述第一客户端模块获取与所述文件种子相应的文件。 7. The method according to claim 5, characterized in that the read from the corresponding server based on the index information and the IP address of the file after further comprising: generating a seed based on the corresponding document file read ; when receiving another document from the second client module sends a read request, whether the query has been transmitted to the first client module through the file to another file read requests to read and query The results sent to the second client block; when the query result is `the second client module for the appropriate seed file; the second client module according to the document from the seed-to-point mode said first client module acquires the seed file the appropriate file.
Description  translated from Chinese

云计算模式文件系统及文件读取方法 Cloud computing mode file system and file read method

技术领域 Technical Field

[0001] 本发明涉及一种云计算模式文件系统及文件读取方法,属于云计算技术领域。 [0001] The present invention relates to a cloud computing mode file system and file reading method, belonging to cloud computing technology.

背景技术 Background

[0002] 云计算模式是一种通过网络将多个成本相对较低的计算实体整合成一个具有强大计算能力的模式,其中一个重要的部分是文件系统。 [0002] The cloud computing model is a process by consolidating multiple network relatively low-cost computing entity into a pattern with a powerful computing capability, which is an important part of the file system. 现有的单机文件系统主要基于裸机设备构建;而现有存储域网络(Storage AreaNetwork,简称:SAN)方式文件系统基于各个厂商的独立冗余磁盘阵列(Redundant Array of Independent Disk,简称:RAID)方式构建。 Existing single file system based primarily on bare metal Equipment Building; and the existing storage area network (Storage AreaNetwork, abbreviation: SAN) file system approach based on independent of each redundant disk array vendors (Redundant Array of Independent Disk, abbreviation: RAID) mode Construction.

[0003] 现有技术中至少存在如下问题:现有云计算模式文件系统没有统一的标准接口,只能使用昂贵的存储设备和高性能的计算服务器,因此开放性差且适应性弱。 The presence of [0003] the art at least the following questions: current cloud computing mode file system is no unified standard interface, can only use expensive storage devices and high-performance computing server, so the difference between open and adaptable weaker.

发明内容 DISCLOSURE

[0004] 本发明提供一种云计算模式文件系统及文件读取方法,用以提高文件系统的扩展性能。 [0004] The present invention provides a cloud computing mode file system and file reading method to improve scalability of the file system.

[0005] 本发明一方面提供一种云计算模式文件系统,其中包括: [0005] The present invention in one aspect provides a cloud computing mode file system, including:

[0006] 第一客户端模块,用于发出文件读取请求; [0006] The first client module for issuing a file read request;

[0007] 文件管理模块,用于根据第一客户端模块发出的所述文件读取请求发出索引获取请求; [0007] The file management module for issuing index acquisition request based on the file first client module issues read requests;

[0008] 分布式管理模块,用于根据文件管理模块发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址; [0008] Distributed Management module, the index for issuing the document management module according to the index information acquisition request to obtain the required documents and the file server where the IP address;

[0009] 分布式传输模块,用于根据分布式管理模块获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块发送给所述第一客户端模块。 [0009] The distributed transmission modules for reading the files through the File Manager module is sent to the first client based on the index information and the IP address of the Distributed Management module obtained from the corresponding server module.

[0010] 本发明另一方面提供一种文件读取方法,其中包括: [0010] The present invention provides a document reading method aspect, including:

[0011] 接收由第一客户端模块发出的文件读取请求; [0011] receiving a document issued by the first client module reads the request;

[0012] 根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址; [0012] According to the file read request to obtain the IP address of the required documents and index information in the file server;

[0013] 根据所述索引信息及所述IP地址从相应的服务器读取所述文件; [0013] reading the file from the appropriate server based on the index information and the IP address;

[0014] 将读取的所述文件发送给所述第一客户端模块。 [0014] read the file is sent to the first client module.

[0015] 本发明实现了基于IP的文件读取方式,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大,仅需要扩展廉价PC服务器,便可扩展存储性能和计算能力,使用户不必采用昂贵的存储和高性能的计算服务器便可搭建自己的云计算平台,开发自己的云计 [0015] The present invention enables to read the papers based on IP, for IP distributed structure, with open and unified standard interface, extend strong performance, only need to extend the low-cost PC servers, you can expand storage performance and computing power, so users do not have to use expensive storage and high performance computing server can build their own cloud computing platform to develop their own cloud

算应用。 Computing applications.

附图说明 Brief Description

[0016] 为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。 [0016] In order to more clearly illustrate the embodiments or the prior art technical solutions embodiment of the present invention, it will implement the following figures for the cases described in the prior art or require the use of a simple introduction, Obviously, the description below The drawings are some of the embodiments of the present invention, those of ordinary skill in terms of creative effort without precondition, you can also obtain other drawings based on these drawings.

[0017] 图1为本发明所述文件读取方法实施例一的流程图; [0017] FIG. 1 of the present invention to read the file flowchart illustrating an embodiment of the method;

[0018] 图2为本发明所述文件读取方法实施例二的流程图; [0018] FIG. 2 is a schematic flow diagram of the file read method II implementation;

[0019]图3为本发明所述云计算模式文件系统实施例的结构示意图; [0019] FIG. 3 of the present invention of the cloud computing model file system structure schematic of an embodiment;

[0020] 图4为图3所示系统的函数调用命令传输过程示意图。 [0020] Figure 4 is a system of Figure 3 shown a schematic view of a function call command transmission process.

具体实施方式 DETAILED DESCRIPTION

[0021] 为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。 [0021] The purpose of the present invention, technical solutions and advantages of the embodiments more clearly, the present invention will now be combined with the implementation of the drawings, were a clear example of the technical solutions of the present invention, a complete description of, obviously, the described examples are part of the embodiments of the present invention, but not all embodiments. 基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。 Based on the embodiments of the present invention, those of ordinary skill in making all other embodiments no creative effort obtained are within the scope of protection of the present invention.

[0022] 图1为本发明所述文件读取方法实施例的流程图,如图所示,包括如下步骤: [0022] Figure 1 is a flowchart of the invention the file read method embodiment, as shown in Fig, comprising the steps of:

[0023] 步骤110,接收由第一客户端模块发出的文件读取请求。 [0023] Step 110, receiving a document issued by the first client module to read requests.

[0024] 其中,该文件读取请求是由第一用户通过操作第一客户端模块发出的,用以请求读取所需的文件。 [0024] where the file read request is issued by the user through the operation of the first module of the first client to request to read the desired file.

[0025] 步骤120,根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址。 [0025] Step 120, according to the document read request to obtain the IP address of the required documents and index information server where the file.

[0026] 具体地,可以先根据所述文件读取请求生成索引获取请求,根据该索引获取请求查找相应的资源分布配置信息;然后再根据查找到的所述资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址。 [0026] Specifically, according to the first read request to generate an index file acquisition request, based on the index acquisition request to find the appropriate configuration information resource distribution; then according to the distribution of the resources to find the configuration file to obtain the required information index information and IP address of the server where the file.

[0027] 步骤130,根据所述索引信息及所述IP地址从相应的服务器读取所述文件。 [0027] Step 130, read the file from the server according to the respective index information and said IP addresses.

[0028] 其中,索引信息中记录了所述文件在服务器中的本地物理存储位置。 [0028] where the index information is recorded in the file server in the local physical storage location. 索引信息与文件分离的方式是现有技术中主要的文件管理方式。 Index information file separate ways in the prior art is the main file management. 本实施例所述方法沿用该方式,以便于与现有服务器的本地文件系统相适应。 The method according to the present embodiment follow the way to the local file system to adapt existing server.

[0029] 具体地,可以先根据所述服务器的本地文件系统格式对所述索引信息进行协议适配,得到适配后的索引信息;然后再根据所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件。 [0029] Specifically, according to the local file system format of the index information server protocol adaptation, adapted to obtain index information after; then based on the index information after adaptation and the IP Address reading the file from the appropriate server. 从而使所述索引信息能够与具有所述IP地址的服务器的本地文件系统相适配。 So that the indexing information can with the local file system with the IP address of the server adapted.

[0030] 步骤140,将读取的所述文件发送给所述第一客户端模块。 [0030] step 140, the file will be sent to read the first client module.

[0031] 具体地,可以对读取的所述文件进行协议适配,得到适配后的文件;然后再将所述适配后的文件发送给所述第一客户端模块。 [0031] In particular, it can read the file protocol adapter, get the file the adapted; then send the file to the first client module and then after the adaptation. 从而使所述文件能够与第一客户端模块相适配。 So that the file can be with the first client module adapted. 具体地,进行所述协议适配时可以将读取的所述文件转换为复合索引文件(CFS)格式,以使第一客户端模块可以处理该适配后的CFS格式文件。 In particular, to perform the protocol adaptation can be read when the file is converted to the compound index file (CFS) format to the first client module can handle CFS format after the adaptation.

[0032] 本实施例所述方法实现了基于IP的文件读取方式,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大,仅需要扩展廉价PC服务器,便可扩展存储性能和计算能力,使用户不必采用昂贵的存储和高性能的计算服务器便可搭建自己的云计算平台,开发自己的云计算应用。 [0032] The realization of IP-based document reading mode for IP distributed structure, with open and unified standard interface, extend strong performance, only need to extend the low-cost PC servers, you can expand storage performance and the method described in Example computing capacity, so users do not have to use expensive storage and high performance computing server can build their own cloud computing platform to develop their own cloud computing applications. [0033] 图2为本发明所述文件读取方法实施例二的流程图,如图所示,本实施例所述方法在上述步骤130所述根据所述索引信息及所述IP地址从相应的服务器读取所述文件之后还包括如下步骤: [0033] FIG. 2 is a schematic flow diagram of the document reading method of embodiment II, as shown, in the present embodiment of the method according to the above-described step 130 the index information and the IP address from the corresponding After reading the file server further comprises the steps of:

[0034] 步骤210,根据读取的所述文件生成相应的文件种子。 [0034] Step 210, generate the appropriate files seed according to the document read.

[0035] 其中,所述文件种子记录了该文件曾经被哪个客户端模块读取过的信息以及该文件的索引信息。 [0035] wherein the seed file records the index information of the document had been read over which client module information and files.

[0036] 步骤220,当接收到来自第二客户端模块发出的另一文件读取请求时,查询是否曾经向所述第一客户端模块传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户端模块。 [0036] Step 220, when receiving another document from the second client module sends a read request, inquiry ever been transmitted to the first client module of the read request another file to be read files, and query results transmitted to the second client module.

[0037] 其中,所述另一文件读取请求是由第二用户通过操作第二客户端模块发出的,用以请求读取所需的文件。 [0037] wherein another file read request is issued by a second user through the operation of the second client module for requests to read the desired file.

[0038] 步骤230,当所述查询结果为是时,所述第二客户端模块获取相应的文件种子。 [0038] Step 230, when the query result is YES, the second client module to obtain the appropriate file seed.

[0039] 其中,如果所述查询结果为是,则表明所述第二客户端模块所需的文件与所述第一客户端模块曾经读取过的文件相同。 [0039] where, if the query is yes, then the same as required for the second client module file with the first client module files have been read.

[0040] 步骤240,第二客户端模块根据所述文件种子以点对点方式从所述第一客户端模块获取与所述文件种子相应的文件。 [0040] In step 240, the second client module to point the way to get the seed file the appropriate file from the first client module according to the file seed.

[0041] 另外,如果所述查询结果为否,也就是说所述第一客户端模块没有读取过所述文件,则该第二客户端可以采用实施例一所述方法读取所需的文件,或者也可以从其他客户端模块以点对点方式传输所述文件。 [0041] In addition, if the query is no, that is to say the first client module does not have to read through the file, the client can use the second method according to an embodiment required to read file, or you can point the way to transmit the files from other client module.

[0042] 本实施例所述方法实现了客户端模块之间以点对点方式传输文件,节省了文件传输的时间也减轻了文件系统的工作负担。 [0042] The client module achieved between point to point transfer files, saving time file transfers also alleviate the burden on the file system of the method embodiment.

[0043]图3为本发明所述云计算模式文件系统实施例的结构示意图,如图所示,该系统至少包括:第一客户端模块11、文件管理模块12、分布式管理模块13及分布式传输模块14,其中,文件管理模块12、分布式管理模块13及分布式传输模块14位于服务器的主控单元中。 [0043] FIG. 3 of the present invention of the cloud computing model file system structure schematic of an embodiment, as shown, the system includes at least: a first client module 11, the file management module 12, distributed management and distribution module 13 type transmission module 14, wherein the file management module 12, distributed management module 13 and distributed transmission module 14 in the server's main control unit.

[0044] 此处需要说明的是:本实施例所述客户端模块与服务器实际上是具有相同内部模块结构的同一种设备,只不过该设备在执行不同的操作时扮演了不同的角色。 [0044] It should be noted here that: the present embodiment, the client module and the server is actually the same as having the same kind of device inside the module structure, but the device to perform different actions at the time played a different role. 例如,当该设备请求读取文件时,它作为客户端模块;而当该设备提供所请求的文件时,它作为服务器。 For example, when the device requests to read the file, it acts as a client module; and when the device provides the requested file, it acts as a server.

[0045] 以下说明本实施例所述系统的工作原理: [0045] The following description of this embodiment of the system implementation works:

[0046] 第一客户端模块11发出文件读取请求;文件管理模块12根据第一客户端模块11发出的所述文件读取请求发出索引获取请求;分布式管理模块13根据文件管理模块12发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址;分布式传输模块14根据分布式管理模块13获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块12发送给所述第一客户端模块11。 [0046] The first client module 11 issues a file read request; management module 13 issues distributed file management module 12; file management module 12 reads the request to issue index acquisition request based on the file of the first 11 issues of the client module the index acquisition request to obtain the IP address of the required documents and index information in the file server; distributed transmission module 14 reads from the appropriate server based on the index information and the IP address of the Distributed Management module 13 acquired The document, by sending the file management module 12 to the first client module 11. 具体地,所述服务器中还可以包括通信协议模块,其中保存有TCP/IP协议族,分布式传输模块14可以通过协议适配模块17调用通信协议模块中的TCP/IP协议族对IP地址进行适配后访问相应的服务器。 In particular, the server also may include a communications protocol module, which holds the TCP / IP protocol suite, distributed transmission module 14 via protocol adapter module communication protocol module 17 calls the TCP / IP protocol suite for IP addresses access the appropriate server after adaptation.

[0047] 其中,所述分布式管理模块13主要负责调度查找当前云中可用的存储和计算资源,并创建和管理云缓存,保存云资源的索引。 [0047] wherein the distributed management module 13 is responsible for scheduling find current cloud storage and computing resources available, and to create and manage cloud cache, saving index cloud resources. 所述文件管理模块12主要负责完成文件操作和管理,包括:创建、删除、查找、命名、读取、写入、打开和关闭等操作。 The file management module 12 is responsible for the completion of file operations and management, including: create, delete, search, naming, read, write, open and close operations. 所述分布式传输模块14主要负责在客户端模块与服务器之间完成分布式文件的传输。 The distributed transmission module 14 is responsible for between the client and server modules complete distributed file transfers.

[0048] 具体地,该系统还可以进一步包括:配置管理模块15及核心算法模块16。 [0048] In particular, the system may further comprise: a configuration management module 15 and module 16 core algorithm. 当上述文件管理模块12发出索引获取请求后,可以先由配置管理模块15查找相应的资源分布配置信息;然后再由核心算法模块16根据配置管理模块15查找到的资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址发送给所述分布式管理模块13。 When the above-mentioned document management module 12 generates index acquisition request, you can start with the configuration management module 15 to find the appropriate distribution of resources configuration information; then file by the core algorithm module 16 according to the configuration management module 15 to obtain the distribution of resources to find the desired configuration information The index information and the file server where the IP address is sent to the Distributed Management module 13.

[0049] 其中,所述核心算法模块16的功能可以包括:文件寻址算法、云资源调度算法、文件传输控制算法、点对点种子路径寻址算法、文件加密算法及文件传输压缩和解压算法等。 [0049] wherein the core algorithm module features 16 may include: document addressing algorithms, cloud resource scheduling, file transfer control algorithms, point-seed Path Addressing algorithms, file encryption and file transfer compression and decompression algorithms. 所述配置管理模块15负责完成云配置资源的加载、重载、云服务器的启动、停止,并且负责和分布式管理模块13进行通信,以完成配置资源的变化。 The configuration management module 15 is responsible for the allocation of resources to complete the cloud loading, overloading, cloud servers start, stop, and is responsible for the management and distributed communication module 13 to complete the change in the allocation of resources.

[0050] 具体地,该系统还可以进一步包括:协议适配模块17,根据所述服务器的本地文件系统格式对分布式管理模块13获取的所述索引信息进行协议适配,得到适配后的索引信息;然后由所述分布式传输模块14根据协议适配模块17得到的所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件。 [0050] In particular, the system may further comprise: protocol adaptation module 17, according to the local file system format of the index information server of the distributed management module 13 acquires the protocol adaptation, obtained after adaptation The file is then distributed by the transport module 14 reads from the appropriate server based on the index information after the adaptation protocol and the IP address obtained adaptation module 17; index information. 并且,所述协议适配模块17还可以对分布式传输模块14读取的所述文件进行协议适配,得到适配后的文件,具体地,进行所述协议适配时可以将读取的所述文件转换为CFS格式;然后由所述分布式传输模块14经所述文件管理模块12将所述适配后的文件发送给所述第一客户端模块11。 And the protocol adaptation module 17 may also be distributed transmission module 14 reads the file protocol adaptation, to obtain the adapted file, in particular, can be performed when the read protocol adaptation The file format is converted to CFS; and 12 after the document sent by the adaptation of the distributed transmission module 14 via the file management module to the first client module 11. 其中,该协议适配模块17主要负责适配底层传输协议和本地文件系统。 Wherein the protocol adapter module 17 is responsible for adapting the underlying transport protocol and the local file system.

[0051] 本实施例所述系统也可以称为云文件系统(Cloud File Systems,简称:CFS),该系统基于IP协议,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大,仅需要扩展廉价PC服务器,便可扩展存储性能和计算能力,使用户不必采用昂贵的存储和高性能的计算服务器便可搭建自己的云计算平台,开发自己的云计算应用。 [0051] The system of the present embodiment may also be called cloud file system (Cloud File Systems, abbreviation: CFS), which is based on IP protocol for IP distributed structure, with open and unified standard interface, extend strong performance, only need to extend the low-cost PC servers, you can expand storage performance and computing power, so users do not have to use expensive storage and high performance computing server can build their own cloud computing platform to develop their own cloud computing applications.

[0052] 另外,如图3所示,所述系统中还可以进一步包括:点对点传输模块18和第二客户端模块19,其中,点对点传输模块18可以完成客户端模块间的点对点传输,产生种子监控器(tracker),用于在点对点(Peer to Peer)传输中获知正在传输的文件名称,然后提供给其他下载同样文件的对端设备的清单。 [0052] Further, as shown in FIG. 3, the system may further comprise: a second point to point transmission module 18 and client module 19, wherein the point to point transmission module 18 can be accomplished point transmission between the client module, to produce seed Monitor (tracker), for point to point (Peer to Peer) file transfer in the name of being transferred to know, and then provide a list of the remote device to other download the same file. 该系统的工作原理如下: The system works as follows:

[0053] 所述分布式传输模块14在进行文件读取后,还可以进一步根据读取的所述文件生成相应的文件种子保存在所述点对点传输模块18中;当第二用户通过操作第二客户端模块19发出另一文件读取请求时,所述文件管理模块12根据所述另一文件读取请求查询所述分布式传输模块14是否曾经向所述第一客户端模块11传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户端模块19 ;当所述查询结果为是时,所述第二客户端模块19则从所述点对点传输模块18中获取相应的文件种子,并根据该文件种子以点对点方式从相应的第一客户端模块11获取该第一客户端模块11中保存的与所述文件种子相应的文件。 [0053] The distributed transmission module 14 after performing file read may further generate the corresponding file is stored in the seed-point transmission module 18, according to the document read; when the second user through the operation of the second client module 19 to issue another document read request, the file management module 12 according to the read request to another query the distributed file transfer module 14 ever end module 11 transfers to the first customers through the said another file read requests to read the file, and query results transmitted to the second client module 19; when the query result is YES, the second client module 19 from the point of the transmission module 18 to obtain the appropriate seed file, and point the way to 11 to get the first client module 11 seed saved with the file the appropriate file from the corresponding first client module according to the document seeds. 具体地,第二客户端模块19可以通过点对点传输模块18调用核心算法模块16中的点对点种子路径寻址算法,以实现第二客户端模块19与第一客户端模块11之间的点对点文件传输。 Specifically, the second client module 19 can call the central point transmission module 18 algorithm module 16-point addressing seed path algorithm to achieve the second client module 19 and the first client module 11-point file transfer between .

[0054] 其中,所述第一客户端模块11及第二客户端模块19可以为用户进行的CFS系统操作提供接口,创建并管理本地缓存,并负责点对点的传输调度。 [0054] where, CFS system operating the first client module 11 and the second client module 19 may provide an interface for users to create and manage a local cache, and is responsible for point to point transmission scheduling.

[0055] 此处需要说明的是,图3中所示的虚线箭头表示模块间的调用关系,例如:调用接口调用点对点传输模块18、文件管理模块12和分布式传输模块14 ;分布式管理模块13调用配置管理模块15、核心算法模块16和协议适配模块17 ;分布式传输模块14调用协议适配模块17 ;点对点传输模块18调用核心算法模块16,被调用的模块通过执行函数调用命令来实现如上所述的相应的功能。 [0055] It should be noted here that dotted arrow shown in Figure 3 shows the calls between modules, such as: call interface call point transmission module 18, the file management module 12 and distributed transmission module 14; Distributed Management Module 13 Invoke the configuration management module 15, the core algorithm module 16 and protocol adaptation module 17; distributed transmission module 14 calls the protocol adapter module 17; point to point transmission module 18 calls the core algorithm module 16, the module is invoked by calling the command to execute the function implement corresponding functions as described above. 图4为图3所示系统的函数调用命令传输过程示意图,如图所示,包括如下函数命令调用过程: Figure 4 is a system shown in Figure 3 function call command transmission process schematic, as shown, including the following function call command procedure:

[0056] 1.用户A在客户端模块A调用read O函数命令进行文件读取; [0056] 1. User A client calls read O function module A command file read;

[0057] 2.文件管理模块对readO函数命令进行缓冲,当此条命令进栈后,调用分布式管理模块的readlndexO函数命令; [0057] 2. The file management module readO function command buffer This command into the stack when the call readlndexO function command Distributed Management module;

[0058] 3.分布式管理模块此时通过调用readConfigO函数命令读取配置管理模块的缓冲区(Buffer); [0058] 3. Distributed Management module at this time by calling readConfigO function command read buffer configuration management module (Buffer);

[0059] 4.配置管理模块通过调用getQuickDatalndexO函数命令根据名字空间等索引信息调用核心算法模块,核心算法模块返回需要读取文件的索引信息和所在服务器的IP地址; [0059] The configuration management module by calling getQuickDatalndexO function command name space, according to the index information call the core algorithm module, the core algorithm module returns the IP address needs to read the file server where the index information and;

[0060] 5.分布式管理模块得到文件索引后,通过readLocalFilelndexO函数命令调用协议适配模块; After the [0060] 5. Distributed Management module to get the file index, call protocol adapter module readLocalFilelndexO function command;

[0061] 6.协议适配模块根据IP地址找到文件所在的服务器,并通过调用getAdpterFileHandlerO函数命令向服务器获取本地文件格式数据; [0061] 6. The protocol adapter module to locate the server file is located based on IP address and get the native file format of data to the server by calling getAdpterFileHandlerO function command;

[0062] 7.服务器通过调用getLocalHandlerO函数命令从本地文件系统中获取本地文件格式数据; [0062] 7. The server obtains the native file format of data from the local file system by calling getLocalHandlerO function command;

[0063] 8.服务器通过调用getMatchToHandlerO函数命令将本地文件格式数据返回给协议适配模块,由协议适配模块根据该本地文件格式数据中记录的本地文件系统格式对所述索引信息进行适配,并将适配后的索引信息经分布式管理模块返回给文件管理模块; [0063] 8. The server by calling getMatchToHandlerO function commands the native file format of data returned to the protocol adapter module, the protocol adapter module adapted to the index information according to the local file system format of the native file format of data recorded, and the adapted index information via the Distributed Management module is returned to the document management module;

[0064] 9.文件管理模块获取适配后的索引信息后,调用readDatadndex)函数命令,以获取文件实体; [0064] 9. The file management module after obtaining the adapted index information, call the readDatadndex) function command to obtain the file entity;

[0065] 10.分布式传输模块调用readLocalFileDataO函数命令,以获取文件实体; [0065] 10. The distributed transmission module called readLocalFileDataO function command to obtain the file entity;

[0066] 11.协议适配模块通过调用getAdpaterFileDataO函数命令从服务器的本地文件系统获取相应的文件实体返回给分布式传输模块,并由分布式传输模块经文件管理模块将文件实体传输给客户端模块A,从而完成对文件的读取。 [0066] 11. The protocol adapter module getAdpaterFileDataO function by calling the appropriate command to get back to the distributed file transfer module entities from the local file system server, distributed by the transmission module via the File Manager module entity to transfer files to the client module A, thus completing the document reads.

[0067] 12.用户B在客户端模块B调用readO函数命令,向文件管理模块请求进行文件读取; [0067] 12. The user B client module B readO function call command, to file a request for file management module to read;

[0068] 13.文件管理模块通过调用haveLivelndexO函数命令从分布式传输模块获知是否存在此文件的种子,如果存在,返回给客户端模块B种子索引; [0068] 13. The file management module by calling haveLivelndexO function command to know whether the seeds of this document from a distributed transmission module, if it exists, is returned to the client module B seed index;

[0069] 14.客户端模块B通过getLivelndexO函数命令从点对点传输模块得到文件种子后从相应的客户端模块点对点地传输所要读取的文件,例如,在图4中,如果该文件种子表明相应的文件保存在客户端模块A中,则客户端模块B从客户端模块A点对点地传输所要读取的文件;如果该文件种子表明相应的文件保存在客户端模块C中,则客户端模块B从客户端模块C点对点地传输所要读取的文件。 [0069] 14. The client peer transfer files to be read from the corresponding client module rear end module B function command to get files via getLivelndexO seed from point to point transmission module, for example, in Figure 4, if the document indicates that the respective seed Files stored in the client module A, the file client module B from the client module A point to point transmission to be read; if the file seed indicates that the corresponding file stored in the client module C, then the client module B from file client module C point to point transmission to be read.

[0070] 本实施例所述系统还进一步实现了客户端模块之间以点对点方式传输文件,节省了文件传输的时间也减轻了文件系统的工作负担。 [0070] The system of the present embodiment is further achieved between the client module-to-point transfer files, saving the file transfer time lightening the burden on the file system. [0071] 本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:R0M、RAM、磁碟或者光盘等各种可以存储程序代码的介质。 [0071] One of ordinary skill will appreciate: realize all or part of the steps of the method can be implemented by a program instructing relevant hardware. The program may be stored in a computer readable storage medium, the program execution when executing the method comprising the steps of the above-described embodiments; and the aforementioned storage medium comprising: R0M, RAM, disk, or an optical medium can store program codes.

[0072] 最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。 [0072] Finally, it should be noted that: the above embodiments are merely provided for describing the technical solutions of the present invention, but not intended to limit; although reference to the embodiments of the present invention has been described in detail, those skilled in the art will appreciate: it still may be the foregoing technical solutions described in the embodiments changes, or for some technical features equivalent replacements; and such modifications or replacements do not make the essence of corresponding technical solutions depart from the spirit of the technical programs of the embodiment of the present invention and ranges.

Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
CN101520793A30 Dec 20082 Sep 2009深圳市同洲电子股份有限公司Method and system for storing and reading stream media file and stream media server
CN101854387A14 May 20106 Oct 2010中国科学院计算技术研究所P2P flow optimization method and system based on distributed index server architecture
CN101873481A1 Mar 201027 Oct 2010杭州海康威视数字技术股份有限公司Method and system for playing back videos in video monitoring system and network monitoring client side
CN101901263A22 Jul 20101 Dec 2010华为终端有限公司Access method and device of file system
US73106293 Apr 200218 Dec 2007Napster, Inc.Method and apparatus for controlling file sharing of multimedia files over a fluid, de-centralized network
Classifications
International ClassificationH04L29/08
Legal Events
DateCodeEventDescription
4 May 2011C06Publication
15 Jun 2011C10Request of examination as to substance
18 Sep 2013C14Granted