WO2000029952A3 - Method and system for incremental backup copying of data - Google Patents

Method and system for incremental backup copying of data Download PDF

Info

Publication number
WO2000029952A3
WO2000029952A3 PCT/US1999/027569 US9927569W WO0029952A3 WO 2000029952 A3 WO2000029952 A3 WO 2000029952A3 US 9927569 W US9927569 W US 9927569W WO 0029952 A3 WO0029952 A3 WO 0029952A3
Authority
WO
WIPO (PCT)
Prior art keywords
physical
logical object
storage locations
reference time
layer
Prior art date
Application number
PCT/US1999/027569
Other languages
French (fr)
Other versions
WO2000029952A9 (en
WO2000029952A2 (en
Inventor
Philip E Tamer
Terry Seto Lee
Original Assignee
Emc Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Emc Corp filed Critical Emc Corp
Priority to JP2000582895A priority Critical patent/JP3866038B2/en
Priority to DE19983713T priority patent/DE19983713T1/en
Priority to GB0109796A priority patent/GB2359159B/en
Publication of WO2000029952A2 publication Critical patent/WO2000029952A2/en
Publication of WO2000029952A3 publication Critical patent/WO2000029952A3/en
Priority to HK02101103.0A priority patent/HK1039665B/en
Publication of WO2000029952A9 publication Critical patent/WO2000029952A9/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore
    • G06F11/1451Management of the data involved in backup or backup restore by selection of backup contents
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99951File or database maintenance
    • Y10S707/99952Coherency, e.g. same view to multiple users
    • Y10S707/99953Recoverability
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99951File or database maintenance
    • Y10S707/99952Coherency, e.g. same view to multiple users
    • Y10S707/99954Version management

Abstract

A method and apparatus for identifying changes to a logical object on a host computer by examining information relating to a physical level in a data storage system wherein the logical object is stored. In one embodiment, a method for determining changes to a logical object subsequent to a reference time is described for a logical object that belongs to an application layer of a host computer in a computer system. The computer system includes the host computer, a storage system, and at least one mapping layer that maps the logical object to a physical layer relating to physical storage locations on the storage system. The physical layer includes physical change information relating to changes made to the physical storage locations on the storage system subsequent to the reference time. The method includes steps of mapping the logical object from the application layer to the physical layer to identify which physical storage locations include data corresponding to the logical object, examining the physical change information to identify any of the physical storage locations identified in the step of mapping that include data that has changed subsequent to the reference time, and determining that changes have been made to the logical object when any physical storage locations are identified in the step of examining as including data that has changed subsequent to the reference time.
PCT/US1999/027569 1998-11-19 1999-11-19 Method and system for incremental backup copying of data WO2000029952A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2000582895A JP3866038B2 (en) 1998-11-19 1999-11-19 Method and apparatus for identifying changes to logical objects based on changes to logical objects at the physical level
DE19983713T DE19983713T1 (en) 1998-11-19 1999-11-19 Method and apparatus for identifying changes to a logical object based on changes to the logical object on a physical level
GB0109796A GB2359159B (en) 1998-11-19 1999-11-19 Method and apparatus for identifying changes to a logical object based on changes to the logical object at a physical level
HK02101103.0A HK1039665B (en) 1998-11-19 2002-02-15 Method and apparatus for identifying changes to a logical object based on changes to the logical object at a physical level

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/196,651 US6385626B1 (en) 1998-11-19 1998-11-19 Method and apparatus for identifying changes to a logical object based on changes to the logical object at physical level
US09/196,651 1998-11-19

Publications (3)

Publication Number Publication Date
WO2000029952A2 WO2000029952A2 (en) 2000-05-25
WO2000029952A3 true WO2000029952A3 (en) 2000-08-03
WO2000029952A9 WO2000029952A9 (en) 2002-08-22

Family

ID=22726271

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/027569 WO2000029952A2 (en) 1998-11-19 1999-11-19 Method and system for incremental backup copying of data

Country Status (6)

Country Link
US (1) US6385626B1 (en)
JP (1) JP3866038B2 (en)
DE (1) DE19983713T1 (en)
GB (1) GB2359159B (en)
HK (1) HK1039665B (en)
WO (1) WO2000029952A2 (en)

Families Citing this family (79)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7143193B1 (en) * 1998-05-29 2006-11-28 Yahoo! Inc. Content collection
US7035943B2 (en) * 1998-05-29 2006-04-25 Yahoo! Inc. Web server content replication
US6976093B2 (en) 1998-05-29 2005-12-13 Yahoo! Inc. Web server content replication
US6542909B1 (en) * 1998-06-30 2003-04-01 Emc Corporation System for determining mapping of logical objects in a computer system
US6564219B1 (en) * 1998-11-19 2003-05-13 Emc Corporation Method and apparatus for obtaining an identifier for a logical unit of data in a database
US7107395B1 (en) * 1998-12-31 2006-09-12 Emc Corporation Apparatus and methods for operating a computer storage system
US6754661B1 (en) * 1999-07-13 2004-06-22 Microsoft Corporation Hierarchical storage systems for holding evidentiary objects and methods of creating and operating upon hierarchical storage systems
US6836780B1 (en) * 1999-09-01 2004-12-28 Jacada, Ltd. Method and system for accessing data in legacy applications
US6922685B2 (en) * 2000-05-22 2005-07-26 Mci, Inc. Method and system for managing partitioned data resources
US7401131B2 (en) * 2000-05-22 2008-07-15 Verizon Business Global Llc Method and system for implementing improved containers in a global ecosystem of interrelated services
US6978280B1 (en) * 2000-10-12 2005-12-20 Hewlett-Packard Development Company, L.P. Method and system for improving LUN-based backup reliability
US6970892B2 (en) * 2001-02-16 2005-11-29 Stratus Technologies Bermuda Ltd Implementing standards-based file operations in proprietary operating systems
US7685126B2 (en) 2001-08-03 2010-03-23 Isilon Systems, Inc. System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system
US7146524B2 (en) 2001-08-03 2006-12-05 Isilon Systems, Inc. Systems and methods for providing a distributed file system incorporating a virtual hot spare
US7509356B2 (en) * 2001-09-06 2009-03-24 Iron Mountain Incorporated Data backup
US6826666B2 (en) * 2002-02-07 2004-11-30 Microsoft Corporation Method and system for transporting data content on a storage area network
US7725428B1 (en) * 2002-03-14 2010-05-25 Novell, Inc. System and method for restoring a database in a distributed database system
US7308463B2 (en) * 2002-06-26 2007-12-11 Hewlett-Packard Development Company, L.P. Providing requested file mapping information for a file on a storage device
EP2284735A1 (en) * 2002-11-14 2011-02-16 Isilon Systems, Inc. Systems and methods for restriping files in a distributed file system
US20040221016A1 (en) * 2003-05-01 2004-11-04 Hatch James A. Method and apparatus for preventing transmission of unwanted email
JP2005128771A (en) * 2003-10-23 2005-05-19 Fujitsu Ltd Data file system, data access server, and data access program
US20070198583A1 (en) * 2003-12-25 2007-08-23 H & T Corporation Safety test support system,method,and program
US7734581B2 (en) * 2004-05-18 2010-06-08 Oracle International Corporation Vector reads for array updates
US20060004846A1 (en) * 2004-06-16 2006-01-05 Bmc Software, Inc. Low-overhead relational database backup and restore operations
US8131674B2 (en) 2004-06-25 2012-03-06 Apple Inc. Methods and systems for managing data
US8055711B2 (en) 2004-10-29 2011-11-08 Emc Corporation Non-blocking commit protocol systems and methods
US8238350B2 (en) * 2004-10-29 2012-08-07 Emc Corporation Message batching with checkpoints systems and methods
US8051425B2 (en) * 2004-10-29 2011-11-01 Emc Corporation Distributed system with asynchronous execution systems and methods
US9946729B1 (en) * 2005-03-21 2018-04-17 EMC IP Holding Company LLC Sparse recall and writes for archived and transformed data objects
US7797283B2 (en) 2005-10-21 2010-09-14 Isilon Systems, Inc. Systems and methods for maintaining distributed data
US7346720B2 (en) * 2005-10-21 2008-03-18 Isilon Systems, Inc. Systems and methods for managing concurrent access requests to a shared resource
US7917474B2 (en) * 2005-10-21 2011-03-29 Isilon Systems, Inc. Systems and methods for accessing and updating distributed data
US7788303B2 (en) * 2005-10-21 2010-08-31 Isilon Systems, Inc. Systems and methods for distributed system scanning
US7386675B2 (en) * 2005-10-21 2008-06-10 Isilon Systems, Inc. Systems and methods for using excitement values to predict future access to resources
US7551572B2 (en) * 2005-10-21 2009-06-23 Isilon Systems, Inc. Systems and methods for providing variable protection
US9009114B1 (en) * 2005-10-31 2015-04-14 Symantec Operating Corporation Version mapped incremental backups
US20070112895A1 (en) * 2005-11-04 2007-05-17 Sun Microsystems, Inc. Block-based incremental backup
US7848261B2 (en) 2006-02-17 2010-12-07 Isilon Systems, Inc. Systems and methods for providing a quiescing protocol
US7756898B2 (en) 2006-03-31 2010-07-13 Isilon Systems, Inc. Systems and methods for notifying listeners of events
US8539056B2 (en) 2006-08-02 2013-09-17 Emc Corporation Systems and methods for configuring multiple network interfaces
US7680836B2 (en) 2006-08-18 2010-03-16 Isilon Systems, Inc. Systems and methods for a snapshot of data
US7822932B2 (en) 2006-08-18 2010-10-26 Isilon Systems, Inc. Systems and methods for providing nonlinear journaling
US7953704B2 (en) 2006-08-18 2011-05-31 Emc Corporation Systems and methods for a snapshot of data
US7590652B2 (en) 2006-08-18 2009-09-15 Isilon Systems, Inc. Systems and methods of reverse lookup
US7899800B2 (en) * 2006-08-18 2011-03-01 Isilon Systems, Inc. Systems and methods for providing nonlinear journaling
US7752402B2 (en) 2006-08-18 2010-07-06 Isilon Systems, Inc. Systems and methods for allowing incremental journaling
US7676691B2 (en) 2006-08-18 2010-03-09 Isilon Systems, Inc. Systems and methods for providing nonlinear journaling
US7680842B2 (en) 2006-08-18 2010-03-16 Isilon Systems, Inc. Systems and methods for a snapshot of data
US7882071B2 (en) 2006-08-18 2011-02-01 Isilon Systems, Inc. Systems and methods for a snapshot of data
US8286029B2 (en) 2006-12-21 2012-10-09 Emc Corporation Systems and methods for managing unavailable storage devices
US7593938B2 (en) * 2006-12-22 2009-09-22 Isilon Systems, Inc. Systems and methods of directory entry encodings
US7509448B2 (en) 2007-01-05 2009-03-24 Isilon Systems, Inc. Systems and methods for managing semantic locks
US7900015B2 (en) 2007-04-13 2011-03-01 Isilon Systems, Inc. Systems and methods of quota accounting
US7779048B2 (en) * 2007-04-13 2010-08-17 Isilon Systems, Inc. Systems and methods of providing possible value ranges
US8966080B2 (en) 2007-04-13 2015-02-24 Emc Corporation Systems and methods of managing resource utilization on a threaded computer system
US7966289B2 (en) 2007-08-21 2011-06-21 Emc Corporation Systems and methods for reading objects in a file system
US7949692B2 (en) 2007-08-21 2011-05-24 Emc Corporation Systems and methods for portals into snapshot data
US7882068B2 (en) 2007-08-21 2011-02-01 Isilon Systems, Inc. Systems and methods for adaptive copy on write
US8832163B1 (en) 2007-09-14 2014-09-09 Emc Corporation Techniques for determining logical data objects corresponding to physical storage locations
US8930651B2 (en) * 2007-10-05 2015-01-06 Imation Corp. Archiving system with partitions of individual archives
US8140787B2 (en) 2007-10-05 2012-03-20 Imation Corp. Methods for implementation of an active archive in an archiving system and managing the data in the active archive
US9594794B2 (en) * 2007-10-19 2017-03-14 Oracle International Corporation Restoring records using a change transaction log
US9418154B2 (en) * 2007-10-19 2016-08-16 Oracle International Corporation Push-model based index updating
US8682859B2 (en) 2007-10-19 2014-03-25 Oracle International Corporation Transferring records between tables using a change transaction log
US9594784B2 (en) * 2007-10-19 2017-03-14 Oracle International Corporation Push-model based index deletion
US8046552B2 (en) * 2008-01-30 2011-10-25 Hewlett-Packard Development Company, L.P. Tracking metadata changes during data copy in a storage system
US7953709B2 (en) 2008-03-27 2011-05-31 Emc Corporation Systems and methods for a read only mode for a portion of a storage system
US7870345B2 (en) 2008-03-27 2011-01-11 Isilon Systems, Inc. Systems and methods for managing stalled storage devices
US7984324B2 (en) 2008-03-27 2011-07-19 Emc Corporation Systems and methods for managing stalled storage devices
US7949636B2 (en) * 2008-03-27 2011-05-24 Emc Corporation Systems and methods for a read only mode for a portion of a storage system
AU2009322598B2 (en) * 2008-12-02 2014-11-06 Ab Initio Technology Llc Data maintenance system
US8655892B2 (en) * 2010-09-29 2014-02-18 International Business Machines Corporation Data reorganization
CN102622285B (en) * 2012-02-22 2014-04-02 浪潮(北京)电子信息产业有限公司 System and method for achieving data storage, backup and restore
US9251151B1 (en) * 2013-07-02 2016-02-02 Ca, Inc. System and method for merging continuous volume snapshots
US10521309B1 (en) * 2013-12-23 2019-12-31 EMC IP Holding Company LLC Optimized filesystem walk for backup operations
US9501516B2 (en) * 2014-12-19 2016-11-22 Sap Se Zero downtime upgrade of database applications using triggers and calculated fields
US9898494B2 (en) 2015-02-23 2018-02-20 Sap Se Zero downtime upgrade for database applications using tables with sequences
US11477264B2 (en) * 2016-06-29 2022-10-18 Nicira, Inc. Network workflow replay tool
US20220075771A1 (en) * 2020-09-08 2022-03-10 International Business Machines Corporation Dynamically deploying execution nodes using system throughput

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5497483A (en) * 1992-09-23 1996-03-05 International Business Machines Corporation Method and system for track transfer control during concurrent copy operations in a data processing storage subsystem

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE172309T1 (en) * 1993-07-01 1998-10-15 Legent Corp ARRANGEMENT AND METHOD FOR DISTRIBUTED DATA MANAGEMENT IN NETWORKED COMPUTER SYSTEMS
DE69429651T2 (en) 1993-10-18 2002-09-19 Sony Corp INFORMATION MANAGEMENT PROCEDURE, DATA RECORDING CARRIERS AND PROCEDURES, INFORMATION RECOVERY PROCEDURE AND DEVICE
US5926836A (en) * 1996-12-03 1999-07-20 Emc Corporation Computer and associated method for restoring data backed up on archive media
US6032224A (en) * 1996-12-03 2000-02-29 Emc Corporation Hierarchical performance system for managing a plurality of storage units with different access speeds
US6081800A (en) 1997-02-28 2000-06-27 Oracle Corporation Creating bitmaps from multi-level identifiers
US5963935A (en) 1997-02-28 1999-10-05 Oracle Corporation Combining bitmaps within a memory limit
US6061678A (en) 1997-10-31 2000-05-09 Oracle Corporation Approach for managing access to large objects in database systems using large object indexes
US6141773A (en) * 1998-06-30 2000-10-31 Emc Corporation Method and apparatus for undoing changes to computer memory

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5497483A (en) * 1992-09-23 1996-03-05 International Business Machines Corporation Method and system for track transfer control during concurrent copy operations in a data processing storage subsystem

Also Published As

Publication number Publication date
DE19983713T1 (en) 2002-01-24
US6385626B1 (en) 2002-05-07
HK1039665A1 (en) 2002-05-03
JP3866038B2 (en) 2007-01-10
HK1039665B (en) 2004-01-02
GB0109796D0 (en) 2001-06-13
GB2359159A (en) 2001-08-15
WO2000029952A9 (en) 2002-08-22
JP2002530741A (en) 2002-09-17
WO2000029952A2 (en) 2000-05-25
GB2359159B (en) 2003-08-06

Similar Documents

Publication Publication Date Title
WO2000029952A3 (en) Method and system for incremental backup copying of data
CN1760875B (en) Transparent migration of files among various types of storage volumes based on file access properties
KR100205539B1 (en) Hard disc double partitioning method
GB2377284A (en) Storage system with a point in time copy function
CN107391774B (en) The rubbish recovering method of log file system based on data de-duplication
WO2006052321A3 (en) System and method of reading non-volatile computer memory
WO2005050386A3 (en) System and method for performing a snapshot and for restoring data
AU5795490A (en) Data storage device for a digital data processing system
EP0990988A3 (en) Storage control unit and method for handling data storage system
CA2219037A1 (en) Interface layer for navigation system
WO2001006364A8 (en) Method and apparatus for prioritizing data change requests and maintaining data consistency in a distributed computer system equipped for activity-based collaboration
WO2005114374A3 (en) Object-based storage
CA2575418A1 (en) Information recording medium, recording/ reproducing apparatus, and recording/ reproducing method
CA2447516A1 (en) Management and synchronization application for network file system
EP1109086A3 (en) Construction system and method for the construction or design of new parts
US6636941B1 (en) Enhanced stable disk storage
US6732294B2 (en) Method of disaster recovery testing and storage system
EP0381885A3 (en) Method for identifying bad data
WO2001013232A3 (en) Self-healing computer system storage
US8019953B2 (en) Method for providing atomicity for host write input/outputs (I/Os) in a continuous data protection (CDP)-enabled volume using intent log
JPH1069422A (en) File number remapping method and device for suspended processing
CN109766793A (en) Data processing method and device
CN107122223B (en) Data migration method and device
US8417747B1 (en) Virtually provisioned volume recovery
CA1332247C (en) Rotating storage device track format emulation

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): DE GB JP KR SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): DE GB JP KR SE

ENP Entry into the national phase

Ref document number: 200109796

Country of ref document: GB

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2000 582895

Country of ref document: JP

Kind code of ref document: A

RET De translation (de og part 6b)

Ref document number: 19983713

Country of ref document: DE

Date of ref document: 20020124

WWE Wipo information: entry into national phase

Ref document number: 19983713

Country of ref document: DE

AK Designated states

Kind code of ref document: C2

Designated state(s): DE GB JP KR SE

COP Corrected version of pamphlet

Free format text: PAGES 1/13-13/13, DRAWINGS, REPLACED BY NEW PAGES 1/13-13/13; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

REF Corresponds to

Ref document number: 10083200

Country of ref document: DE

Date of ref document: 20021205

REG Reference to national code

Ref country code: DE

Ref legal event code: 8607