WO2000005653A1 - Method for reutilization of data space - Google Patents

Method for reutilization of data space Download PDF

Info

Publication number
WO2000005653A1
WO2000005653A1 PCT/US1999/016592 US9916592W WO0005653A1 WO 2000005653 A1 WO2000005653 A1 WO 2000005653A1 US 9916592 W US9916592 W US 9916592W WO 0005653 A1 WO0005653 A1 WO 0005653A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
user
data volume
space
virtual
Prior art date
Application number
PCT/US1999/016592
Other languages
French (fr)
Inventor
Stephen H. Blendermann
Alan R. Sutton
Original Assignee
Storage Technology Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/121,254 external-priority patent/US6789161B1/en
Application filed by Storage Technology Corporation filed Critical Storage Technology Corporation
Publication of WO2000005653A1 publication Critical patent/WO2000005653A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • G06F3/0605Improving or facilitating administration, e.g. storage management by facilitating the interaction with a user or administrator
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0652Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0686Libraries, e.g. tape libraries, jukebox

Definitions

  • the present invention relates generally to a virtual tape data storage arrangement, and more particularly to an improved method for selectively controlling reutilization of space occupied by expired data .
  • automated cartridge systems provide a mechanism by which multiple users in a data processing system can have common access to multiple data storage subsystems such as magnetic tape cartridge devices.
  • data files generated by remote user computer systems for storage on a particular tape cartridge include a predetermined expiration date in the file meta data which is used as a control mechanism by which a tape management subsystem can determine whether a particular space on a tape can be rewritten with new data.
  • expired data from a "scratched" tape volume is not actually deleted from the tape until a user actually writes new data to the tape.
  • conventional tape systems conveniently provide a "safety net" for users who decide they still wish to be able to retrieve data from storage even though the data may be past the original expiration date.
  • a disk buffer is connected between remote users and the tape storage devices and arranged to appear to users as though it were a physical tape device. All data volumes are initially stored in the disk buffer, and subsequently written to a physical tape device using predetermined protocols which limit the occurrence of unusable dead spaces on the tapes while also improving the ability to reclaim any fragmented space which does occur.
  • a user reads and writes only to the disk buffer, but believes they are reading and writing to an actual physical tape device. hile efficiency in space management and utilization are significantly improved with the virtual tape system, users also lose the above-noted safety net feature inherently provided by conventional tape systems.
  • the virtual tape system operates to automatically reutilize any tape and disk buffer space occupied by expired data without user action, i.e., a user does not have exclusive monopoly of a particular tape like in a conventional tape system because the tape can be reused any time a new data volume is received into the disk buffer.
  • Emulating the safety net feature in the virtual tape system would involve prohibiting the reuse of any tape space until a user reuses a corresponding virtual tape volume name for the data volume stored in the space irrespective of whether the corresponding data has expired.
  • the present invention provides a method for controlling reutilization of data space in a virtual tape system which allows a user to designate whether a particular data volume can be automatically deleted at the time of expiration without waiting for the user to actually reuse the virtual volume.
  • a method for selectively controlling reutilization of data space in a virtual tape system which includes selectively designating by a remote user whether a particular data volume file can be automatically deleted by the virtual tape system without any further action by the user after a predetermined expiration date for the data volume file has elapsed, detecting whether a data volume file has been designated by the user for automatic deletion, and prohibiting deletion from the virtual tape system of the stored data corresponding to a data volume based on whether the data volume file was designated by the user for automatic deletion.
  • a predetermined grace period can be provided before automatic deletion is performed.
  • the present invention can allow a user to selectively "protect" data past an original expiration date, while also allowing automatic reutilization of storage space for data which has not been specifically protected by the user.
  • Figure 1 is a block diagram illustrating a virtual tape system utilizing selective deletion of data corresponding to a scratched virtual volume in accordance with the present invention
  • FIG. 2 is a flowchart showing the overall process of the present invention.
  • Figure 3 is a flowchart showing verification and deletion of designated data from a scratch virtual volume.
  • a virtual tape system 10 includes a virtual tape control system 12 having a suitable control processor (not shown) for routing all data volume files received from remote users to a disk buffer 14.
  • Virtual tape control system 12 is arranged to transfer data from disk buffer 14 to one or more multiple volume cartridges (MVC) 16 as virtual tape volumes (VTV) .
  • MVC multiple volume cartridges
  • VTV virtual tape volumes
  • a map matching the MVC location with corresponding VTV names and all corresponding file meta data is maintained by the virtual tape control system 12.
  • An external tape management system (TMS) 18 provides overall management of the use of virtual tapes used by virtual tape system 10.
  • users can selectively tag or encode any desired data volume file to indicate that the tape and/or disk buffer space occupied by the corresponding virtual volume can be automatically reused either immediately after the expiration date or a predetermined period of time after the expiration date, i.e., a data deletion "grace period.” Otherwise, if the user does not expressly designate a data volume file, virtual tape control system 12 will be prohibited from deleting and reusing the space of an expired virtual volume until a user reuses the VTV name for a new file of data.
  • FIG. 3 illustrates an example of automatic deletion of data from a scratch VTV in accordance with the present invention.
  • a VTV which has been selected for scratch at block 108 is analyzed at block 110 to determine whether the VTV has been designated for automatic deletion. If automatic deletion has been identified, the data is deleted from the disk buffer at block 112 (if the data is disk buffer resident) , and the MVC map is updated at block 114 to reflect the deletion of the data from the VTV and the space on the physical tape occupied by the virtual volume can be reused.
  • the virtual volume is marked as scratch at block 116 and therefore reusable. However, the VTV marked for scratch will still contain the data until the VTV is actually reused if the data was not deleted at block 112 or the MVC map was not updated at block 114.
  • the present invention advantageously provides a method for selectively controlling reutilization of data space in a virtual tape system which allows a user to designate whether a particular scratched data volume can be automatically deleted without any further user action.
  • the data deletion safety net provided by conventional tape systems is effectively incorporated into a virtual tape system while also minimizing the impact of such a safety net feature on the overall efficiency in space management provided by the virtual tape system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A method for selectively controlling reutilization of data space in a virtual tape system is provided that stores (100) data volume files in a disk buffer, and analyzes (102) the files to determine whether the user has designated the corresponding data for immediate deletion at an associated expiration date. If the data has been designated (104), identifying and mapping information are marked to indicate that the corresponding data can be immediately deleted at the expiration date. Otherwise, the virtual volume is stored (106) using a default policy which prevents the virtual tape control system from reusing the tape and disk space occupied by the virtual volume after scratching until that particular virtual volume name is actually reused by the user. Thus, a user can selectively protect data past an original expiration date, while minimizing the impact to the overall efficiency in space management otherwise provided by the virtual tape system.

Description

METHOD FOR REUTILIZATION OF DATA SPACE
Technical Field
The present invention relates generally to a virtual tape data storage arrangement, and more particularly to an improved method for selectively controlling reutilization of space occupied by expired data .
Background Art
Generally, automated cartridge systems (ACS) provide a mechanism by which multiple users in a data processing system can have common access to multiple data storage subsystems such as magnetic tape cartridge devices. In conventional tape systems, data files generated by remote user computer systems for storage on a particular tape cartridge include a predetermined expiration date in the file meta data which is used as a control mechanism by which a tape management subsystem can determine whether a particular space on a tape can be rewritten with new data. However, in conventional tape systems, expired data from a "scratched" tape volume is not actually deleted from the tape until a user actually writes new data to the tape. In other words, conventional tape systems conveniently provide a "safety net" for users who decide they still wish to be able to retrieve data from storage even though the data may be past the original expiration date.
Because conventional tape systems have proven to be quite inefficient in data storage space utilization, a virtual tape system has been developed which significantly improves storage space utilization and control by incorporating the advantages of an intermediate disk buffer as part of a tape emulation arrangement. Such an arrangement is taught in commonly owned copending U.S. patent application serial no. 09/110,217, filed on July, 6, 1998.
More specifically, in the referenced virtual tape system, a disk buffer is connected between remote users and the tape storage devices and arranged to appear to users as though it were a physical tape device. All data volumes are initially stored in the disk buffer, and subsequently written to a physical tape device using predetermined protocols which limit the occurrence of unusable dead spaces on the tapes while also improving the ability to reclaim any fragmented space which does occur. In such a virtual tape system, a user reads and writes only to the disk buffer, but believes they are reading and writing to an actual physical tape device. hile efficiency in space management and utilization are significantly improved with the virtual tape system, users also lose the above-noted safety net feature inherently provided by conventional tape systems. More specifically, to achieve higher efficiency, the virtual tape system operates to automatically reutilize any tape and disk buffer space occupied by expired data without user action, i.e., a user does not have exclusive monopoly of a particular tape like in a conventional tape system because the tape can be reused any time a new data volume is received into the disk buffer. Emulating the safety net feature in the virtual tape system would involve prohibiting the reuse of any tape space until a user reuses a corresponding virtual tape volume name for the data volume stored in the space irrespective of whether the corresponding data has expired.
However, such an arrangement reintroduces significant inefficiency in storage space utilization and reclamation, thereby defeating a main advantage of the virtual tape system. As a result, a need exists for an improved method of controlling reutilization of data space in a virtual tape system which can provide a safety net for users while also minimizing the impact of such a feature on efficiency of data storage space utilization and management. Disclosure of the Invention
It is therefore an object of the present invention to provide an improved method for controlling reutilization of data space in a virtual tape system which allows a user to control whether space occupied by expired data can be automatically reused by a tape management system.
It is another object of the present invention to provide a method for controlling reutilization of data space in a virtual tape system which allows selective reuse of physical storage space occupied by a scratched virtual volume without waiting until a user actually reuses the virtual volume.
In accordance with these and other objects, the present invention provides a method for controlling reutilization of data space in a virtual tape system which allows a user to designate whether a particular data volume can be automatically deleted at the time of expiration without waiting for the user to actually reuse the virtual volume.
In accordance with one aspect of the present invention, a method is provided for selectively controlling reutilization of data space in a virtual tape system which includes selectively designating by a remote user whether a particular data volume file can be automatically deleted by the virtual tape system without any further action by the user after a predetermined expiration date for the data volume file has elapsed, detecting whether a data volume file has been designated by the user for automatic deletion, and prohibiting deletion from the virtual tape system of the stored data corresponding to a data volume based on whether the data volume file was designated by the user for automatic deletion. In accordance with another aspect, a predetermined grace period can be provided before automatic deletion is performed.
With such an arrangement, the present invention can allow a user to selectively "protect" data past an original expiration date, while also allowing automatic reutilization of storage space for data which has not been specifically protected by the user.
These and other objects, features, and advantages of the present invention will be readily apparent from the following detailed description of the best mode for carrying out the invention when taken in connection with the accompanying drawings. Brief Description of the Drawings
Figure 1 is a block diagram illustrating a virtual tape system utilizing selective deletion of data corresponding to a scratched virtual volume in accordance with the present invention;
Figure 2 is a flowchart showing the overall process of the present invention; and
Figure 3 is a flowchart showing verification and deletion of designated data from a scratch virtual volume.
Best Mode for Carrying Out The Invention
The overall method of the present invention will now be described in connection with Figs. 1-3. More specifically, a virtual tape system 10 includes a virtual tape control system 12 having a suitable control processor (not shown) for routing all data volume files received from remote users to a disk buffer 14. Virtual tape control system 12 is arranged to transfer data from disk buffer 14 to one or more multiple volume cartridges (MVC) 16 as virtual tape volumes (VTV) . A map matching the MVC location with corresponding VTV names and all corresponding file meta data is maintained by the virtual tape control system 12. An external tape management system (TMS) 18 provides overall management of the use of virtual tapes used by virtual tape system 10.
In accordance with the present invention, users can selectively tag or encode any desired data volume file to indicate that the tape and/or disk buffer space occupied by the corresponding virtual volume can be automatically reused either immediately after the expiration date or a predetermined period of time after the expiration date, i.e., a data deletion "grace period." Otherwise, if the user does not expressly designate a data volume file, virtual tape control system 12 will be prohibited from deleting and reusing the space of an expired virtual volume until a user reuses the VTV name for a new file of data.
This process is summarized in the flow charts of Figs. 2 and 3. As denoted at block 100, all data volume files are stored in the disk buffer, and analyzed at block 102 to determine whether or not the user has designated the corresponding data for immediate deletion at the expiration date, or alternatively after a predetermined or user defined grace period. At block 104, if the data has been designated, the appropriate identifying and mapping information are marked to indicate that the corresponding data can be immediately deleted at either the expiration date or the end of the predetermined grace period. Otherwise, at block 106 the virtual volume is stored in accordance with a default policy which will not allow the virtual tape control system to reuse the tape and disk space occupied by the virtual volume after scratching until that particular virtual volume name is actually reused by the user.
The flowchart of Fig. 3 illustrates an example of automatic deletion of data from a scratch VTV in accordance with the present invention. A VTV which has been selected for scratch at block 108 is analyzed at block 110 to determine whether the VTV has been designated for automatic deletion. If automatic deletion has been identified, the data is deleted from the disk buffer at block 112 (if the data is disk buffer resident) , and the MVC map is updated at block 114 to reflect the deletion of the data from the VTV and the space on the physical tape occupied by the virtual volume can be reused. After updating of the MVC map, or if the data had not been identified for automatic deletion at block 110, the virtual volume is marked as scratch at block 116 and therefore reusable. However, the VTV marked for scratch will still contain the data until the VTV is actually reused if the data was not deleted at block 112 or the MVC map was not updated at block 114.
While the present invention has been described as requiring the user to designate whether the data can be automatically deleted to allow bypassing of the default policy of prohibiting such automatic deletion in the absence of a designation, it will be appreciated that the reverse arrangement could be implemented if desired, i.e., the default policy could allow immediate scratched data deletion if an appropriate designation was not made by the user.
Thus, the present invention advantageously provides a method for selectively controlling reutilization of data space in a virtual tape system which allows a user to designate whether a particular scratched data volume can be automatically deleted without any further user action. In this manner, the data deletion safety net provided by conventional tape systems is effectively incorporated into a virtual tape system while also minimizing the impact of such a safety net feature on the overall efficiency in space management provided by the virtual tape system.
While the best mode for carrying out the invention has been described in detail, those familiar with the art to which this invention relates will recognize various alternative designs and embodiments for practicing the invention as defined by the following claims .

Claims

What Is Claimed Is:
1. A method for selectively controlling reutilization of data space in a virtual tape system comprising : a remote user selectively designating whether a particular data volume file can be automatically deleted by the virtual tape system without any further action by the user after a predetermined expiration date for the data volume file has elapsed; detecting if a received data volume file has been designated by the user; and prohibiting automatic deletion of the received data volume file from the virtual tape system based on whether the data volume file was designated by the user.
2. The method of claim 1 wherein the user selectively tags a particular data volume file before originally transferring to the virtual tape system to indicate that the data volume file is not to be automatically deleted.
3. The method of claim 1 wherein if a user has not designated a particular data volume file for protection from automatic deletion, determining that the expiration date has passed, and marking the space on a data storage media occupied by the data corresponding to - l i ¬
the data volume file to indicate the space can be automatically reused when desired.
4. The method of claim 1 wherein if automatic deletion has been designated, deleting a particular data volume space only after predetermined period of time has passed after the data volume file expiration date.
5. The method of claim 4 further comprising determining that the predetermined period of time has passed, and marking the space on a data storage media occupied by the data corresponding to the data volume file to indicate the space can be automatically reused when desired.
PCT/US1999/016592 1998-07-23 1999-07-22 Method for reutilization of data space WO2000005653A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/121,254 US6789161B1 (en) 1998-07-06 1998-07-23 Method for controlling reutilization of data space in virtual tape system
US09/121,254 1998-07-23

Publications (1)

Publication Number Publication Date
WO2000005653A1 true WO2000005653A1 (en) 2000-02-03

Family

ID=22395506

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/016592 WO2000005653A1 (en) 1998-07-23 1999-07-22 Method for reutilization of data space

Country Status (1)

Country Link
WO (1) WO2000005653A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101290557B (en) * 2007-04-19 2012-02-29 国际商业机器公司 Method for determining tape drive resource allocation for safe data erasure

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5265159A (en) * 1992-06-23 1993-11-23 Hughes Aircraft Company Secure file erasure

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5265159A (en) * 1992-06-23 1993-11-23 Hughes Aircraft Company Secure file erasure

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"DFSMS/MVS V1R2 ACCESS METHOD SERVICES FOR VSAM", XP002924925, Retrieved from the Internet <URL:HTTP://WWW.S390.IBM.COM/BOOKMGR-CGI/BOOKMGR.CMD/BOOKS/DGT1V402/CCONTENTS?SHELF=EZ239701> [retrieved on 19990830] *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101290557B (en) * 2007-04-19 2012-02-29 国际商业机器公司 Method for determining tape drive resource allocation for safe data erasure

Similar Documents

Publication Publication Date Title
US6789161B1 (en) Method for controlling reutilization of data space in virtual tape system
US6289425B1 (en) Method for verifying availability of data space in virtual tape system
US8838875B2 (en) Systems, methods and computer program products for operating a data processing system in which a file delete command is sent to an external storage device for invalidating data thereon
EP2115595B1 (en) Memory device performance enhancement through pre-erase mechanism
US6571326B2 (en) Space allocation for data in a nonvolatile memory
US8069317B2 (en) Providing and utilizing high performance block storage metadata
US11782632B2 (en) Selective erasure of data in a SSD
WO2002075640A3 (en) System and method of storing data in jpeg files
CN103150256B (en) Improve method and the device of USB flash memory write performance
US7624243B2 (en) Apparatus and method for protecting system data on computer hard-disk
US7305537B1 (en) Method and system for I/O scheduler activations
US8024524B2 (en) Method, system, and program for an adaptor to read and write to system memory
US20020103784A1 (en) Fast data retrieval based upon contiguous consolidation of records according to frequency of access
WO1993025956B1 (en) Method and apparatus for writing files on nonerasable storage medium
US20040158566A1 (en) Snapshot by deferred propagation
US7469261B2 (en) Apparatus and method for protecting system data on computer hard-disk
US7895164B1 (en) Efficient checkpoint process
CN112527694A (en) Fragmentation degree alarm method and device
WO2000005653A1 (en) Method for reutilization of data space
US6574703B1 (en) Initializing selected extents of a storage device
EP1046996B1 (en) Memory defragmentation in chipcards
JP2001084180A (en) File managing device
JPH03116248A (en) Data maintenance system for data base
CN115328922B (en) Data management method, device and system for one-way linked list
JP3978720B2 (en) Data storage method

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): JP

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase