公开(公告)号：US07603391B1

公开(公告)日：2009-10-13

申请号：US11336021

申请日：2006-01-20

申请人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley ,  Steven R. Kleiman

发明人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley ,  Steven R. Kleiman

IPC分类号： G06F17/30

CPC分类号： G06F11/2074 ,  G06F11/1451 ,  G06F11/2066 ,  G06F17/30067 ,  Y10S707/99952 ,  Y10S707/99953 ,  Y10S707/99954

摘要： A system and method for remote asynchronous replication or mirroring of changes in a source file system snapshot in a destination replica file system using a scan (via a scanner) of the blocks that make up two versions of a snapshot of the source file system, which identifies changed blocks in the respective snapshot files based upon differences in volume block numbers identified in a scan of the logical file block index of each snapshot. Trees of blocks associated with the files are traversed, bypassing unchanged pointers between versions and walking down to identify the changes in the hierarchy of the tree. These changes are transmitted to the destination mirror or replicated snapshot. This technique allows regular files, directories, inodes and any other hierarchical structure to be efficiently scanned to determine differences between versions thereof. The changes in the files and directories are transmitted over the network for update of the replicated destination snapshot in an asynchronous (lazy write) manner. The changes are described in an extensible, system-independent data stream format layered under a network transport protocol. At the destination, source changes are used to update the destination snapshot. Any deleted or modified inodes already on the destination are moved to a temporary or “purgatory” directory and, if reused, are relinked to the rebuilt replicated snapshot directory. The source file system snapshots can be representative of a volume sub-organization, such as a qtree.

摘要翻译： 用于使用构成源文件系统的快照的两个版本的块的扫描（通过扫描仪）远程异步复制或镜像目标副本文件系统中源文件系统快照中的更改的系统和方法， 基于每个快照的逻辑文件块索引的扫描中识别的卷块号的差异来识别各个快照文件中的改变的块。 遍历与文件相关联的块的树，绕过版本之间的未改变的指针，并向下走，以识别树的层次结构中的更改。 这些更改将传输到目标镜像或复制快照。 该技术允许有效扫描常规文件，目录，索引节点和任何其他层次结构，以确定其版本之间的差异。 通过网络传输文件和目录中的更改，以便以异步（惰性写入）方式更新复制的目标快照。 这些更改以在网络传输协议下分层的可扩展，系统独立的数据流格式进行描述。 在目的地，源更改用于更新目标快照。 已经在目的地上的任何已删除或已修改的索引节点将被移动到临时或“炼狱”目录，如果重用，将重新链接到重建的复制快照目录。 源文件系统快照可以代表卷子组织，例如qtree。

公开(公告)号：US07769717B2

公开(公告)日：2010-08-03

申请号：US11400912

申请日：2006-04-10

申请人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley

发明人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley

IPC分类号： G06F17/30

CPC分类号： G06F17/30088 ,  G06F11/1451 ,  G06F11/1464 ,  G06F11/2082 ,  G06F17/30174 ,  G06F17/30212 ,  G06F2201/82 ,  H04L67/06 ,  H04L67/1095 ,  H04L67/1097 ,  Y10S707/99956

摘要： A method for transferring data from a source computer to a destination computer, and restarting the source computer transmission after a halt of the transmission, has the following steps. The source computer inserts a checkpoint number into a data stream, the data flowing in the data stream. The checkpoint number is stored at the source computer. The data stream is halted in response to an error in a path of the data stream. The destination computer locates the last checkpoint number successfully received before halting the data stream. The last checkpoint number successfully received before halting the data stream is transferred to the source computer; and the source computer compares it with checkpoint numbers stored in the source computer to determine where in the data stream to resume transfer of the data. Transfer of the data is resumed in response to the last checkpoint number.

摘要翻译： 用于将数据从源计算机传送到目的地计算机的方法，以及在传输停止之后重新启动源计算机传输的方法具有以下步骤。 源计算机将检查点号插入到数据流中，数据流中的数据流。 检查点号存储在源计算机。 响应于数据流的路径中的错误停止数据流。 目标计算机在停止数据流之前定位成功接收的最后一个检查点号。 在停止数据流之前成功接收的最后一个检查点号码被传送到源计算机; 并且源计算机将其与存储在源计算机中的检查点号进行比较，以确定数据流中的哪里恢复传输数据。 响应于最后一个检查点号码恢复数据传输。

公开(公告)号：US06993539B2

公开(公告)日：2006-01-31

申请号：US10100967

申请日：2002-03-19

申请人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley ,  Steven R. Kleiman

发明人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley ,  Steven R. Kleiman

IPC分类号： G06R17/30

CPC分类号： G06F11/2074 ,  G06F11/1451 ,  G06F11/2066 ,  G06F17/30067 ,  Y10S707/99952 ,  Y10S707/99953 ,  Y10S707/99954

摘要： A system and method for remote asynchronous replication or mirroring of changes in a source file system snapshot in a destination replica file system using a scan (via a scanner) of the blocks that make up two versions of a snapshot of the source file system, which identifies changed blocks in the respective snapshot files based upon differences in volume block numbers identified in a scan of the logical file block index of each snapshot. Trees of blocks associated with the files are traversed, bypassing unchanged pointers between versions and walking down to identify the changes in the hierarchy of the tree. These changes are transmitted to the destination mirror or replicated snapshot. This technique allows regular files, directories, inodes and any other hierarchical structure to be efficiently scanned to determine differences between versions thereof. The changes in the files and directories are transmitted over the network for update of the replicated destination snapshot in an asynchronous (lazy write) manner. The changes are described in an extensible, system-independent data stream format layered under a network transport protocol. At the destination, source changes are used to update the destination snapshot. Any deleted or modified inodes already on the destination are moved to a temporary or “purgatory” directory and, if reused, are relinked to the rebuilt replicated snapshot directory. The source file system snapshots can be representative of a volume sub-organization, such as a qtree.

公开(公告)号：US07925749B1

公开(公告)日：2011-04-12

申请号：US11739239

申请日：2007-04-24

申请人： Dong Lin ,  Ravikanth Dronamraju ,  Mark Muhlstein ,  Michael L. Federwisch

发明人： Dong Lin ,  Ravikanth Dronamraju ,  Mark Muhlstein ,  Michael L. Federwisch

IPC分类号： G06F15/167 ,  G06F12/00

CPC分类号： G06F11/2069 ,  G06F11/1484 ,  G06F17/30079 ,  G06F17/30215

摘要： A system and method for transparent data replication of one or more data containers over migrating virtual servers (vfilers) operating on physical storage systems is provided. A mirroring (or other replication) procedure associated with a vfiler generates an entry in a mirror table maintained by one or more appropriate mirroring applications executing on the physical storage systems. The mirror table identifies source and destination “owners” of a replicated data container by vfiler instead of only by physical storage system. Thus, when a vfiler is migrated from a source physical storage system (“source”) to a destination physical storage system (“destination”), the mirroring application may continue to perform mirroring operations on the data containers at a per vfiler level to thereby improve the utility of migration of the vfiler among the storage systems.

摘要翻译： 提供了一种用于在运行在物理存储系统上的迁移虚拟服务器（vfilers）上的一个或多个数据容器的透明数据复制的系统和方法。 与vfiler相关联的镜像（或其他复制）过程在由物理存储系统上执行的一个或多个适当镜像应用程序维护的镜像表中生成条目。 镜像表通过vfiler识别复制数据容器的源和目标“所有者”，而不是仅通过物理存储系统。 因此，当vfiler从源物理存储系统（“源”）迁移到目标物理存储系统（“目标”）时，镜像应用程序可以继续在每个vfiler级别对数据容器执行镜像操作，从而 提高存储系统中vfiler的迁移效用。

公开(公告)号：US07818299B1

公开(公告)日：2010-10-19

申请号：US12552346

申请日：2009-09-02

申请人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley ,  Steven R. Kleiman

发明人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley ,  Steven R. Kleiman

IPC分类号： G06F17/30

CPC分类号： G06F11/2074 ,  G06F11/1451 ,  G06F11/2066 ,  G06F17/30067 ,  Y10S707/99952 ,  Y10S707/99953 ,  Y10S707/99954

摘要： A method for backing up a computer file system is disclosed. A first snapshot of the file system is generated at a first time, the first snapshot having first pointers to data blocks of the file system at the first time. A network adapter receives storage operations to write new data to the file system. A second snapshot of the file system is generated at a second time, the second snapshot having second pointers to data blocks of the file system at the second time, the data blocks at the second time including the new data. The first pointers to the second pointers are compared. In response to the second pointers differing from the first pointers, data of the file system which have been changed between the first snapshot and the second snapshot are copied to a backup copy of the file system.

摘要翻译： 公开了一种用于备份计算机文件系统的方法。 第一次生成文件系统的第一个快照，第一个快照首次具有文件系统的数据块的第一个指针。 网络适​​配器接收存储操作以将新数据写入文件系统。 文件系统的第二个快照是在第二时间生成的，第二个快照具有第二个指向文件系统的数据块的第二个指针，第二次包括新数据的数据块。 比较第二个指针的第一个指针。 响应于与第一指针不同的第二指针，在第一快照和第二快照之间已经改变的文件系统的数据被复制到文件系统的备份副本。

公开(公告)号：US07203796B1

公开(公告)日：2007-04-10

申请号：US10693513

申请日：2003-10-24

申请人： Nitin Muppalaneni ,  Abhijeet P. Gole ,  Michael L. Federwisch ,  Mark Smith ,  Rajesh Sundaram

发明人： Nitin Muppalaneni ,  Abhijeet P. Gole ,  Michael L. Federwisch ,  Mark Smith ,  Rajesh Sundaram

IPC分类号： G06F12/16

CPC分类号： G06F11/2076 ,  G06F2201/855

摘要： A synchronous data mirroring technique includes a log forwarding process and a consistency point (CP) process. During log forwarding, a source storage server receives write requests from clients, creates a log entry for each request in nonvolatile memory, and transmits each log entry to a destination storage server at a mirror site. The destination storage server writes each log entry to a file. If a primary volume becomes inaccessible due to a failure, the file is used to produce an updated mirror volume. The CP process includes updating a primary volume based on the write requests, and updating the mirror volume to reflect the updated primary volume. The mirror volume is updated by transmitting CP data from the source storage server to the destination storage server, and using the CP data to update the mirror volume through a network administration layer and a storage layer in the destination storage server.

摘要翻译： 同步数据镜像技术包括日志转发过程和一致性点（CP）过程。 在日志转发期间，源存储服务器从客户端接收写入请求，为非易失性存储器中的每个请求创建日志条目，并将每个日志条目发送到镜像站点上的目标存储服务器。 目标存储服务器将每个日志条目写入文件。 如果由于故障导致主卷变得无法访问，则该文件用于生成更新的镜像卷。 CP进程包括基于写入请求更新主卷，并更新镜像卷以反映更新的主卷。 通过从源存储服务器发送CP数据到目标存储服务器，并使用CP数据通过目标存储服务器中的网络管理层和存储层更新镜像卷来更新镜像卷。

公开(公告)号：US20090030983A1

公开(公告)日：2009-01-29

申请号：US12129874

申请日：2008-05-30

申请人： Prasanna Kumar Malaiyandi ,  Varun Khurana ,  Michael L. Federwisch

发明人： Prasanna Kumar Malaiyandi ,  Varun Khurana ,  Michael L. Federwisch

IPC分类号： G06F15/16

CPC分类号： G06F11/2064 ,  G06F11/1076 ,  G06F11/1451 ,  G06F11/1456 ,  G06F11/1464 ,  G06F11/1471 ,  G06F11/1612 ,  G06F2201/84 ,  G06F2211/1061

摘要： A system and method for verifying the consistency of mirrored data sets between source and destination storage systems is provided. A destination verification module sends version information to the source storage system where the source verification module determines whether the source and destination storage systems are utilizing compatible versions of the verification module. If the destination verification module receives an acceptable version from the source, the destination module then determines a base PCPI to utilize for verification and sends a PCPI identifier of the base PCPI to the source. The source verification module generates and transmits a data stream consisting of comprising of checksum information. The destination verification module compares the received data stream with checksum information retrieved from disk. If there are mismatches, i.e. the received data differs from the data retrieved from disk, the destination verification module logs the data mismatches in a verification log file.

摘要翻译： 提供了用于验证源和目的地存储系统之间的镜像数据集的一致性的系统和方法。 目的地验证模块将版本信息发送到源存储系统，其中源验证模块确定源和目的地存储系统是否正在利用验证模块的兼容版本。 如果目的地验证模块从源接收到可接受的版本，则目的地模块然后确定用于验证的基本PCPI，并将基本PCPI的​​PCPI标识符发送到源。 源验证模块生成并发送由校验和信息组成的数据流。 目的地验证模块将接收到的数据流与从盘检索的校验和信息进行比较。 如果存在不匹配，即接收的数据与从磁盘检索的数据不同，则目的地验证模块将数据不匹配记录在验证日志文件中。

公开(公告)号：US20090006792A1

公开(公告)日：2009-01-01

申请号：US11770589

申请日：2007-06-28

申请人： Michael L. Federwisch ,  Atul R. Pandit ,  Kapil Kumar

发明人： Michael L. Federwisch ,  Atul R. Pandit ,  Kapil Kumar

IPC分类号： G06F12/16

CPC分类号： G06F16/10 ,  G06F11/1451

摘要： Differences between data objects stored on a mass storage device can be identified quickly and efficiently by comparing block numbers stored in data structures that describe the data objects. Bit-by-bit or byte-by-byte comparisons of the objects' actual data need only be performed if the block numbers are different. Objects that share many data blocks can be compared much faster than by a direct comparison of all the objects' data. The fast comparison techniques can be used to improve storage server mirrors and database storage operations, among other applications.

摘要翻译： 通过比较存储在描述数据对象的数据结构中的块号，可以快速有效地识别存储在大容量存储设备上的数据对象之间的差异。 仅当块号不同时，才需要对对象的实际数据进行逐位或逐字节比较。 与所有对象的数据的直接比较，可以比较共享许多数据块的对象的速度更快。 快速比较技术可用于改进存储服务器镜像和数据库存储操作以及其他应用程序。

公开(公告)号：US07325109B1

公开(公告)日：2008-01-29

申请号：US10692665

申请日：2003-10-24

申请人： Nitin Muppalaneni ,  Abhijeet P. Gole ,  Michael L. Federwisch ,  Mark Smith

发明人： Nitin Muppalaneni ,  Abhijeet P. Gole ,  Michael L. Federwisch ,  Mark Smith

IPC分类号： G06F12/16 ,  G06F15/173 ,  G06F7/00

CPC分类号： G06F11/2082 ,  G06F11/2071 ,  H04L67/1095 ,  Y10S707/99945 ,  Y10S707/99948

摘要： In one embodiment, the present invention provides a method for mirroring data representing a file system. The data is stored on a primary storage server and is mirrored on a secondary storage server. In the method the file system is mirrored without comparing blocks used to that represent the file system at the primary storage server, and the secondary storage server.

摘要翻译： 在一个实施例中，本发明提供了一种镜像表示文件系统的数据的方法。 数据存储在主存储服务器上，并镜像在辅助存储服务器上。 在该方法中，文件系统被镜像，而不比较用于表示主存储服务器和辅助存储服务器上的文件系统的块。

公开(公告)号：US07039663B1

公开(公告)日：2006-05-02

申请号：US10126822

申请日：2002-04-19

申请人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley

发明人： Michael L. Federwisch ,  Shane S. Owara ,  Stephen L. Manley

IPC分类号： G06F17/30

CPC分类号： G06F17/30088 ,  G06F11/1451 ,  G06F11/1464 ,  G06F11/2082 ,  G06F17/30174 ,  G06F17/30212 ,  G06F2201/82 ,  H04L67/06 ,  H04L67/1095 ,  H04L67/1097 ,  Y10S707/99956

摘要： A system and method for inserting checkpoints into a data stream and for restarting an asynchronous transmission of a data stream from a source file system to a destination file system is provided. The data stream can be a set of changes between a base snapshot and incremental snapshot of the source file system for update of a replicated file system on the destination. State information relating to the progress of the source in processing and transmitting the data stream is stored at regular intervals, and a checkpoint number associated with each stored segment of the state information is inserted into the data stream. The destination tracks the fall commitment of each segment of the data stream to persistent storage on the replicated file system. If an error or communication loss requires the data transfer to be restarted, the destination sends the checkpoint number associated with the last fully committed segment of the data stream. The source reinitializes its data gathering processes using the state information associated with the particular checkpoint number. The changes sent from the source file system to the destination file system relate to a sub-organization of a volume on the source such as a qtree, identified by a qtree identifier (ID) in the associated inodes and data stream.

摘要翻译： 提供了一种用于将检查点插入到数据流中并用于重新启动从源文件系统到目的地文件系统的数据流的异步传输的系统和方法。 数据流可以是源文件系统的基本快照和增量快照之间的一组更改，用于更新目标上的复制文件系统。 以规则的间隔存储与处理和发送数据流中的源的进度有关的状态信息，并且将与状态信息的每个存储的段相关联的检查点号插入到数据流中。 目的地跟踪数据流的每个段对复制文件系统上的持久存储器的承诺。 如果错误或通信丢失需要重新启动数据传输，则目的地发送与数据流的最后完全提交的段相关联的检查点号。 源使用与特定检查点号相关联的状态信息重新初始化其数据收集过程。 从源文件系统发送到目的地文件系统的更改涉及源上的卷的子组织，例如由关联的inode和数据流中的qtree标识符（ID）标识的qtree。