WO2016022583A3 - Write operations in a tree-based distributed file system - Google Patents

Write operations in a tree-based distributed file system Download PDF

Info

Publication number
WO2016022583A3
WO2016022583A3 PCT/US2015/043646 US2015043646W WO2016022583A3 WO 2016022583 A3 WO2016022583 A3 WO 2016022583A3 US 2015043646 W US2015043646 W US 2015043646W WO 2016022583 A3 WO2016022583 A3 WO 2016022583A3
Authority
WO
WIPO (PCT)
Prior art keywords
file system
copy
tree structure
root node
pointers
Prior art date
Application number
PCT/US2015/043646
Other languages
French (fr)
Other versions
WO2016022583A2 (en
Inventor
Mohit Aron
Ganesha Shanmuganathan
Original Assignee
Cohesity, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cohesity, Inc. filed Critical Cohesity, Inc.
Publication of WO2016022583A2 publication Critical patent/WO2016022583A2/en
Publication of WO2016022583A3 publication Critical patent/WO2016022583A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2246—Trees, e.g. B+trees
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/219—Managing data history or versioning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24553—Query execution of query operations
    • G06F16/24562—Pointer or reference processing operations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/908—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Library & Information Science (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Techniques for cloning, writing to, and reading from file system metadata. Cloning involves identifying a first set of pointers included in a first root node in a file system metadata tree structure that stores file system metadata in leaf nodes of the tree structure, creating a first copy of the first root node that includes the first set of pointers, creating a second copy of the first root node that includes the first set of pointers, associating the first copy with a first view, and associating the second copy with a second view. Reading generally involves traversing the tree structure towards a target leaf node that contains data to be read. Writing generally involves traversing the tree structure in the same manner, but also creating copies of any nodes to be modified if those nodes are deemed to have a different treeID than a particular root node.
PCT/US2015/043646 2014-08-04 2015-08-04 Write operations in a tree-based distributed file system WO2016022583A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/450,848 2014-08-04
US14/450,848 US9792309B2 (en) 2014-08-04 2014-08-04 Write operations in a tree-based distributed file system

Publications (2)

Publication Number Publication Date
WO2016022583A2 WO2016022583A2 (en) 2016-02-11
WO2016022583A3 true WO2016022583A3 (en) 2016-08-25

Family

ID=55180229

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/043646 WO2016022583A2 (en) 2014-08-04 2015-08-04 Write operations in a tree-based distributed file system

Country Status (2)

Country Link
US (1) US9792309B2 (en)
WO (1) WO2016022583A2 (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9921769B2 (en) 2014-06-19 2018-03-20 Cohesity, Inc. Making more active use of a secondary storage system
WO2016082156A1 (en) * 2014-11-27 2016-06-02 华为技术有限公司 Metadata recovery method and apparatus
US9946604B1 (en) 2015-02-04 2018-04-17 Tintri Inc. Optimized remote cloning
US10558736B2 (en) * 2016-02-04 2020-02-11 Sap Se Metadata driven user interface layout control for web applications
US10558622B2 (en) 2016-05-10 2020-02-11 Nasuni Corporation Network accessible file server
US10169392B2 (en) 2017-03-08 2019-01-01 International Business Machines Corporation Persistent data structures on a dispersed storage network memory
US10339016B2 (en) 2017-08-10 2019-07-02 Rubrik, Inc. Chunk allocation
US10819656B2 (en) 2017-07-24 2020-10-27 Rubrik, Inc. Throttling network bandwidth using per-node network interfaces
US11663084B2 (en) 2017-08-08 2023-05-30 Rubrik, Inc. Auto-upgrade of remote data management connectors
US10817472B2 (en) 2017-10-23 2020-10-27 Dropbox, Inc. Storage organization system with associated storage utilization values
US10866963B2 (en) 2017-12-28 2020-12-15 Dropbox, Inc. File system authentication
CN109871715B (en) * 2019-03-12 2022-09-02 深圳市迅雷网络技术有限公司 Access method and device of distributed storage file and storage medium
CN110162525B (en) * 2019-04-17 2023-09-26 平安科技（深圳）有限公司 B+ tree-based read-write conflict resolution method, device and storage medium
CN111090824B (en) * 2019-12-23 2023-09-19 百度国际科技（深圳）有限公司 Content processing method and device
US11842060B2 (en) * 2020-09-04 2023-12-12 Cohesity, Inc. Efficiently storing data in a cloud storage
US11681454B2 (en) 2020-09-04 2023-06-20 Cohesity, Inc. Efficiently storing data in a cloud storage
CN113076292B (en) * 2021-03-30 2023-03-14 山东英信计算机技术有限公司 File caching method, system, storage medium and equipment
US11579864B1 (en) * 2021-09-20 2023-02-14 EMC IP Holding Company LLC Accelerated behavior change for upgrades in distributed systems
US11940969B2 (en) 2022-05-25 2024-03-26 International Business Machines Corporation Managing locations of derived storage objects

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060271606A1 (en) * 2005-05-25 2006-11-30 Tewksbary David E Version-controlled cached data store
US20070106632A1 (en) * 2005-11-04 2007-05-10 Sun Microsystems, Inc. Method and system for object allocation using fill counts
US20080270592A1 (en) * 2004-04-30 2008-10-30 International Business Machines Corporation Managing Introspectable Objects in an Enterprise
US20100115011A1 (en) * 2008-10-30 2010-05-06 Callahan Michael J Enumerating Metadata in File System Directories
US20100198849A1 (en) * 2008-12-18 2010-08-05 Brandon Thomas Method and apparatus for fault-tolerant memory management
US20110289071A1 (en) * 2010-05-20 2011-11-24 International Business Machines Corporation Dynamic self configuring overlays
US20130339406A1 (en) * 2012-06-19 2013-12-19 Infinidat Ltd. System and method for managing filesystem objects
US20140074841A1 (en) * 2012-09-10 2014-03-13 Apple Inc. Concurrent access methods for tree data structures
US20140156618A1 (en) * 2012-12-03 2014-06-05 Vmware, Inc. Distributed, Transactional Key-Value Store

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7917474B2 (en) 2005-10-21 2011-03-29 Isilon Systems, Inc. Systems and methods for accessing and updating distributed data
US8849876B2 (en) * 2009-12-28 2014-09-30 Wenguang Wang Methods and apparatuses to optimize updates in a file system based on birth time
US9009106B1 (en) 2011-08-10 2015-04-14 Nutanix, Inc. Method and system for implementing writable snapshots in a virtualized storage environment
TWI436215B (en) 2011-10-31 2014-05-01 Delta Electronics Inc Distributed file system and method for location of replication strategy of the distributed file system
US8768977B2 (en) * 2012-07-31 2014-07-01 Hewlett-Packard Development Company, L.P. Data management using writeable snapshots in multi-versioned distributed B-trees
US9372757B2 (en) 2013-10-18 2016-06-21 Netapp, Inc. Incremental block level backup

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080270592A1 (en) * 2004-04-30 2008-10-30 International Business Machines Corporation Managing Introspectable Objects in an Enterprise
US20060271606A1 (en) * 2005-05-25 2006-11-30 Tewksbary David E Version-controlled cached data store
US20070106632A1 (en) * 2005-11-04 2007-05-10 Sun Microsystems, Inc. Method and system for object allocation using fill counts
US20100115011A1 (en) * 2008-10-30 2010-05-06 Callahan Michael J Enumerating Metadata in File System Directories
US20100198849A1 (en) * 2008-12-18 2010-08-05 Brandon Thomas Method and apparatus for fault-tolerant memory management
US20110289071A1 (en) * 2010-05-20 2011-11-24 International Business Machines Corporation Dynamic self configuring overlays
US20130339406A1 (en) * 2012-06-19 2013-12-19 Infinidat Ltd. System and method for managing filesystem objects
US20140074841A1 (en) * 2012-09-10 2014-03-13 Apple Inc. Concurrent access methods for tree data structures
US20140156618A1 (en) * 2012-12-03 2014-06-05 Vmware, Inc. Distributed, Transactional Key-Value Store

Also Published As

Publication number Publication date
US20160034508A1 (en) 2016-02-04
WO2016022583A2 (en) 2016-02-11
US9792309B2 (en) 2017-10-17

Similar Documents

Publication Publication Date Title
WO2016022583A3 (en) Write operations in a tree-based distributed file system
WO2015120071A3 (en) Content based organization of file systems
GB2550800A (en) Managing data in storage according to a log structure
WO2015145262A3 (en) Data file discovery, visualization, and actioning
IN2014DE02046A (en)
WO2012125315A3 (en) Virtual disk storage techniques
BR112017000144A2 (en) file identification for data writing operations
AU2018273541A1 (en) Replication lag-constrained deletion of data in a large-scale distributed data storage system
MY175611A (en) Information-processing system
EP3540587A4 (en) Disk data reading/writing method and device
EP4322019A3 (en) Large content file optimization
WO2016174521A8 (en) Multiple read and write port memory
WO2015138114A3 (en) Generating digital data from physical media
JP2017059281A5 (en)
EP3796173A4 (en) Data writing method and storage system
Adachi et al. Erratum to: The economics of tax and social security in japan
WO2016028757A3 (en) Multi-threaded transaction log for primary and restore/intelligence
WO2015034931A3 (en) Media organization recommendations based on user interaction with grouped media assets
GB202301429D0 (en) Metadata based data replication
Windsor Town of
Dorner et al. Information needs analysis
Olabode Trade Liberalization and Economic Growth in Nigeria: Do Concern Matters?
Lin-sen On the Development Histroy of Book Cover Design in the Minguo Period of China
Das et al. Business Sustainability: Challenges and Issues
Hasan Erratum to: Corporate Social Responsibility and the Three Sectors in Asia

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15830496

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12.06.2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15830496

Country of ref document: EP

Kind code of ref document: A2