File server having a file system cache and protocol for truly safe
asynchronous writes
    1.
    发明授权
    File server having a file system cache and protocol for truly safe asynchronous writes 失效
    文件服务器具有用于真正安全的异步写入的文件系统缓存和协议

    公开(公告)号:US5893140A

    公开(公告)日:1999-04-06

    申请号:US747631

    申请日:1996-11-13

    摘要: A conventional network file server has a file system that permits file attributes and file data to be written in any order. The conventional network file server may also support an asynchronous write protocol, in which file attributes and file data need not be written to disk storage until a client sends a commit request. This asynchronous write protocol has a data security problem if the attributes are written before the data and the server crashes before completing the writing of the data to disk storage. This security problem is solved by adding a file system cache and following a protocol that writes the attributes to storage after writing the data to storage. For example, the attributes and data are stored in the file system cache and are not written down to storage until receipt of a commit request. When the commit request is received, the data is sent first from the file system cache to storage. Then the attributes are sent from the file system cache to storage. Then the file server acknowledges completion of the commit operation. In a preferred embodiment, storage is provided by an integrated cached disk array (ICDA) having a buffer cache and an array of disk drives, and the file system cache is distributed in a plurality of data mover computers interfaced to the ICDA. The addition of the file system cache to solve the security problem also reduces the burden on the buffer cache in the ICDA.

    摘要翻译: 传统的网络文件服务器具有允许以任何顺序写入文件属性和文件数据的文件系统。 传统的网络文件服务器还可以支持异步写入协议,其中文件属性和文件数据不需要写入磁盘存储器,直到客户端发送提交请求。 如果在完成将数据写入磁盘存储器之前,数据之前写入的属性和服务器崩溃,则此异步写入协议有数据安全问题。 通过添加文件系统缓存并在将数据写入存储后遵循将属性写入存储的协议来解决此安全问题。 例如,属性和数据存储在文件系统缓存中,并且不会被写入存储,直到收到提交请求。 收到提交请求后,首先将数据从文件系统缓存发送到存储。 然后将属性从文件系统缓存发送到存储。 然后文件服务器确认完成提交操作。 在优选实施例中,通过具有缓冲高速缓存和磁盘驱动器阵列的集成缓存磁盘阵列(ICDA)提供存储,并且文件系统高速缓存分布在与ICDA接口的多个数据移动器计算机中。 加上文件系统缓存来解决安全问题,也减轻了ICDA缓冲区高速缓存的负担。

    Network file server using a cached disk array storing a network file
directory including file locking information and data mover computers
each having file system software for shared read-write file access
    2.
    发明授权
    Network file server using a cached disk array storing a network file directory including file locking information and data mover computers each having file system software for shared read-write file access 失效
    网络文件服务器使用存储包含文件锁定信息的网络文件目录的缓存磁盘阵列和每个具有用于共享读写文件访问的文件系统软件的数据移动器计算机

    公开(公告)号:US5948062A

    公开(公告)日:1999-09-07

    申请号:US747875

    申请日:1996-11-13

    摘要: For network file access, a plurality of data mover computers are linked to a cached disk array. Read-write files stored in the cached disk array are accessible to network clients through more than one of the data mover computers so that the data mover computers are not a bottleneck to file access. The cached disk array stores a network file directory including file locking information, and the data mover computers each have file system software that accesses the network file directory for shared read-write file access. The data mover computers perform the file system tasks such as managing the file directory for mapping of file names to logical blocks and for locking and unlocking of the files in order to minimize loading on the cached disk array. Therefore, the network file server need not use any particular one of the data mover computers to serve as a control point for read-write file access. Instead, file system software for managing the file directory is replicated in each data mover computer. The cached disk array recognizes logical block addresses, and the cached disk array has a limited internal locking facility ensuring that reading or writing to a logical block is an atomic operation. Preferably the data mover computers are commodity personal computers.

    摘要翻译: 对于网络文件访问,多个数据移动器计算机链接到高速缓存的磁盘阵列。 存储在缓存磁盘阵列中的读写文件可通过多个数据移动计算机访问网络客户端,以便数据移动器计算机不是文件访问的瓶颈。 缓存的磁盘阵列存储包括文件锁定信息的网络文件目录,并且数据移动器计算机各具有访问网络文件目录以获得共享读写文件访问的文件系统软件。 数据移动器计算机执行文件系统任务,例如管理文件目录以将文件名映射到逻辑块,以及用于锁定和解锁文件,以最小化对高速缓存的磁盘阵列的加载。 因此,网络文件服务器不需要使用任何特定的数据移动计算机作为读写文件访问的控制点。 相反,用于管理文件目录的文件系统软件在每个数据移动计算机中被复制。 缓存的磁盘阵列识别逻辑块地址,缓存的磁盘阵列具有有限的内部锁定功能,确保读取或写入逻辑块是原子操作。 优选地,数据移动器计算机是商品个人计算机。

    Network file server maintaining local caches of file directory
information in data mover computers
    3.
    发明授权
    Network file server maintaining local caches of file directory information in data mover computers 失效
    网络文件服务器在数据移动计算机中维护文件目录信息的本地缓存

    公开(公告)号:US5944789A

    公开(公告)日:1999-08-31

    申请号:US748363

    申请日:1996-11-13

    摘要: A network file server includes an integrated cached disk array and a plurality of data mover computers linking the cached disk array to the data network for file access. Each data mover computer maintains a local cache of file directory information including locking information of locked files that are accessible through the data mover. A cache consistency scheme ensures that shared locking information is consistent in the local caches. In a preferred embodiment, the cache consistency scheme uses an internal data link to pass messages between the data movers. The file directory information in the local cache includes information mapping file names to a list of logical blocks for each file name, file attributes that affect data access, and locking information down to a block level of granularity. Each data mover computer has network file manager software that maintains client ownership of locked files and communicates with the clients, and data mover file manager software that manages data mover computer ownership of locked files and communicates with other data mover computers. The cache consistency messages indicate a grant of data mover ownership over a file, a release of data mover ownership over a file, a denial of a request for access to a locked file, and changes to file attributes affecting access to a file. The local caches and the cache consistency scheme eliminate any need to store file locking information in the cached disk array.

    摘要翻译: 网络文件服务器包括集成的缓存磁盘阵列和将高速缓存的磁盘阵列链接到数据网络以进行文件访问的多个数据移动器计算机。 每个数据移动器计算机维护文件目录信息的本地缓存,包括可通过数据移动器访问的锁定文件的锁定信息。 缓存一致性方案确保共享锁定信息在本地缓存中是一致的。 在优选实施例中,高速缓存一致性方案使用内部数据链路来在数据移动器之间传递消息。 本地缓存中的文件目录信息包括将文件名称映射到每个文件名的逻辑块列表,影响数据访问的文件属性以及将信息锁定到块级别的信息。 每个数据移动器计算机具有网络文件管理器软件,其维护客户端对锁定文件的所有权并与客户端通信,以及数据移动器文件管理器软件,其管理数据移动器计算机对锁定文件的所有权并与其他数据移动器计算机通信。 高速缓存一致性消息表示数据移动器对文件的所有权的授予,文件上的数据移动器所有权的释放,对访问被锁定的文件的拒绝请求以及影响访问文件的文件属性的改变。 本地缓存和缓存一致性方案消除了将文件锁定信息存储在缓存磁盘阵列中的任何需要。

    Network file server having a message collector queue for connection and connectionless oriented protocols
    4.
    发明授权
    Network file server having a message collector queue for connection and connectionless oriented protocols 失效
    网络文件服务器具有用于连接和面向无连接的协议的消息收集器队列

    公开(公告)号:US06298386B1

    公开(公告)日:2001-10-02

    申请号:US08747769

    申请日:1996-11-13

    IPC分类号: G06F1516

    CPC分类号: G06F17/30203

    摘要: There is a performance loss associated with servicing a pipe or stream for a connection oriented process by maintaining a connection between a server thread and a client for a series of messages. As a result of maintaining this connection, there is less balance; some threads work harder than others, causing a loss of performance. To solve this problem, a collector queue combines messages from the connection oriented process with messages from the other concurrent processes. The threads receive messages from the collector queue rather than individual pipes. Any idle thread can pick up a message from the collector queue. The collector queue keeps track of which pipe each message came from so that the reply of the server to each message is directed to the same pipe from which the message came from. Therefore the collector queue ensures thread balance and efficiency in servicing the messages. In the preferred implementation, each entry in the collector queue includes a message pointer and a pipe pointer. The message pointer points to allocated memory storing the message in a message buffer. The pipe pointer points to the pipe from which the message originated. The collector queue is a singly linked list. A free thread takes an entry off the collector queue, interprets the message of the entry, sends a reply, and deallocates the memory of the entry and the allocated memory storing the message in the message buffer.

    摘要翻译: 通过维护一系列消息的服务器线程和客户端之间的连接,为为面向连接的进程维护管道或流而导致性能损失。 由于维持这种联系,平衡较少; 一些线程比其他线程更难工作,导致性能下降。 为了解决这个问题,收集器队列将来自面向连接进程的消息与来自其他并发进程的消息相结合。 线程从收集器队列接收消息,而不是单个管道。 任何空闲线程都可以从收集器队列中接收到一条消息。 收集器队列跟踪每个消息来自哪个管道,使得服务器对每个消息的回复被定向到来自消息的相同管道。 因此,收集器队列可确保线程平衡和服务消息的效率。 在优选实现中,收集器队列中的每个条目包括消息指针和管道指针。 消息指针指向在消息缓冲器中存储消息的分配的存储器。 管道指针指向消息始发的管道。 收集器队列是单链表。 一个空闲的线程从收集器队列中取消入口,解释该条目的消息,发送回复,并将该条目的存储器和存储消息的分配的存储器释放到消息缓冲器中。

    Video file server using an integrated cached disk array and stream
server computers
    5.
    发明授权
    Video file server using an integrated cached disk array and stream server computers 失效
    视频文件服务器使用集成的缓存磁盘阵列和流服务器计算机

    公开(公告)号:US6061504A

    公开(公告)日:2000-05-09

    申请号:US661152

    申请日:1996-06-10

    摘要: A video file server includes an integrated cached disk array storage subsystem and a plurality of stream server computers linking the cached disk storage system to the data network for the transfer of video data streams. The video file server further includes a controller server for applying an admission control policy to client requests and assigning stream servers to service the client requests. The stream servers include a real-time scheduler for scheduling isochronous tasks, and supports at least one industry standard network file access protocol and one file access protocol for continuous media file access. The cached disk storage subsystem is responsive to video prefetch commands, and the data specified for a prefetch command for a process are retained in an allocated portion of the cache memory from the time that the cached disk storage subsystem has responded to the prefetch command to the time that the cached disk storage subsystem responds to a fetch command specifying the data for the process. The time between prefetching and fetching is selected based on available disk and cache resources. The video file server provides video-on-demand service by maintaining and dynamically allocating sliding windows of video data in the random access memories of the stream server computers.

    摘要翻译: 视频文件服务器包括集成缓存的磁盘阵列存储子系统和将高速缓存的磁盘存储系统链接到数据网络以便传输视频数据流的多个流服务器计算机。 该视频文件服务器还包括控制器服务器,用于向客户端请求应用准入控制策略,并分配流服务器来服务客户机请求。 流服务器包括用于调度等时任务的实时调度器,并且支持至少一个工业标准网络文件访问协议和用于连续媒体文件访问的一个文件访问协议。 缓存的磁盘存储子系统响应于视频预取命令,并且对于进程的预取命令指定的数据从缓存的磁盘存储子系统对预取命令作出响应的时间保留在高速缓冲存储器的分配部分中 缓存磁盘存储子系统响应指定进程数据的fetch命令的时间。 基于可用的磁盘和缓存资源选择预取和提取之间的时间。 视频文件服务器通过维护和动态地分配流服务器计算机的随机存取存储器中的视频数据的滑动窗口来提供视频点播服务。

    Hardware and software failover services for a file server
    6.
    发明授权
    Hardware and software failover services for a file server 有权
    文件服务器的硬件和软件故障切换服务

    公开(公告)号:US06625750B1

    公开(公告)日:2003-09-23

    申请号:US09440756

    申请日:1999-11-16

    IPC分类号: H02H305

    摘要: A file server includes a plurality of stream server computers linking data storage to a data network, and at least two controller servers for controlling the stream server computers. The controller servers are programmed so that at a given time one of the controller servers is active in controlling the stream server computers, and another of the controller servers is inactive. The inactive controller server is programmed to respond automatically to a failure of the active controller server by becoming active. For example, each of the controller servers has a respective flag for indicating whether or not the controller server is active. Each controller server is programmed so that, upon booting, it will read the flag of the other stream server, and if the flag of the other controller server indicates that the other controller server is active, then the controller server becomes inactive. Otherwise, the stream server assumes an active or inactive state based on a predetermined arbitration method. The active controller server also reports failure conditions to a customer service center, monitors the inactive controller server to ensure that the inactive controller server is in a state of readiness, and monitors itself to determine whether it should become inactive.

    摘要翻译: 文件服务器包括将数据存储器连接到数据网络的多个流服务器计算机以及用于控制流服务器计算机的至少两个控制器服务器。 控制器服务器被编程,使得在给定时间,一个控制器服务器在控制流服务器计算机中是活动的,另一个控制器服务器处于非活动状态。 无效控制器服务器被编程为通过变为活动来自动响应主动控制器服务器的故障。 例如,每个控制器服务器具有用于指示控制器服务器是否活动的相应标志。 每个控制器服务器被编程,使得在引导时,它将读取另一个流服务器的标志,如果其他控制器服务器的标志指示其他控制器服务器是活动的,则控制器服务器变为不活动。 否则,流服务器基于预定的仲裁方法假定为活动或非活动状态。 主动控制器服务器还向客户服务中心报告故障状况,监视非活动控制器服务器以确保非活动控制器服务器处于准备状态,并监控自身以确定其是否应变为非活动状态。

    Hardware and software failover services for a file server
    7.
    发明授权
    Hardware and software failover services for a file server 失效
    文件服务器的硬件和软件故障切换服务

    公开(公告)号:US5987621A

    公开(公告)日:1999-11-16

    申请号:US851507

    申请日:1997-05-05

    摘要: A file server includes stream server computers linking a cached disk array storage subsystem to a data network, and at least two controller servers for receiving requests for file access from network clients. At any given time one of the controller servers is active and another is inactive in servicing client requests. The active controller server selects one of the stream servers to service each request. A controller server failover mechanism is provided for recovering from a failure of the active controller server, and a stream server failover mechanism is provided for recovering from a failure of a stream server. The inactive controller server becomes active when it fails to receive a signal periodically transmitted by the active controller server. The active controller server begins stream server failover when it fails to receive a signal periodically transmitted by each stream server. To resume automatically an interrupted task, the tasks are organized as a series of transactions, and each transaction includes operations which can be duplicated without substantial disruption. The active controller server commits results of each transaction to memory of the cached disk array. Before becoming active, the inactive controller recovers the committed state of the interrupted tasks from the cached disk array.

    摘要翻译: 文件服务器包括将缓存的磁盘阵列存储子系统链接到数据网络的流服务器计算机,以及用于从网络客户端接收文件访问请求的至少两个控制器服务器。 在任何给定的时间,其中一个控制器服务器是活动的,另一个在服务客户机请求时处于不活动状态 主动控制器服务器选择一个流服务器来为每个请求提供服务。 提供控制器服务器故障切换机制用于从主动控制器服务器的故障中恢复,并且提供流服务器故障切换机制用于从流服务器的故障中恢复。 无效控制器服务器在接收到主动控制器服务器周期性发送的信号失败时变为活动状态。 当主控制器服务器无法接收每个流服务器周期性发送的信号时,开始流服务器故障切换。 要自动恢复中断的任务,这些任务被组织成一系列事务,每个事务包括可重复的操作,而不会发生大的中断。 主动控制器服务器将每个事务的结果提交给缓存磁盘阵列的内存。 在活动之前,非活动控制器从缓存的磁盘阵列中恢复已中断任务的提交状态。