CA2263453A1 - A lempel-ziv data compression technique utilizing a dictionary pre-filled with frequent letter combinations, words and/or phrases - Google Patents

A lempel-ziv data compression technique utilizing a dictionary pre-filled with frequent letter combinations, words and/or phrases

Info

Publication number
CA2263453A1
CA2263453A1 CA002263453A CA2263453A CA2263453A1 CA 2263453 A1 CA2263453 A1 CA 2263453A1 CA 002263453 A CA002263453 A CA 002263453A CA 2263453 A CA2263453 A CA 2263453A CA 2263453 A1 CA2263453 A1 CA 2263453A1
Authority
CA
Canada
Prior art keywords
compression
filled
lempel
dictionary
ziv
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002263453A
Other languages
French (fr)
Other versions
CA2263453C (en
Inventor
Jeffrey C. Reynar
Fred Herz
Jason Eisner
Lyle Ungar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2263453A1 publication Critical patent/CA2263453A1/en
Application granted granted Critical
Publication of CA2263453C publication Critical patent/CA2263453C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3084—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method
    • H03M7/3088—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method employing the use of a dictionary, e.g. LZ78
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/005—Statistical coding, e.g. Huffman, run length coding
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3084—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method
    • H03M7/3086—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method employing a sliding window, e.g. LZ77
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/93—Run-length coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding

Abstract

The adaptive compression technique improves the Lempel-Ziv (LZ) technique because it reduces the required storage space (18) and transmission time with transferring data (22). Pre-filled compression dictionaries (48) are utilized to resolve prior problems with the Lempel-Ziv technique where compression software starts with an empty compression dictionary and little compression is attained until dictionary has been filled with sequences common in the data being compared. The compression dictionary (48) is pre-filled with letter sequences, words and/or phrases that are commonly found in the compressed area. They may be used in the pre-filled dictionary where they are determined by sampling text data from the same text genre.
Initially, multiple pre-filled dictionaries (52) may be utilized by the software, where the most appropriate dictionary for maximum compression is identified and used to compress current data. These modifications are made to any of the known Lempel-Ziv compression techniques based on the variants detailed in 1977 and 1978 articles by Ziv and Lempel.
CA002263453A 1996-08-06 1997-08-04 A lempel-ziv data compression technique utilizing a dictionary pre-filled with frequent letter combinations, words and/or phrases Expired - Fee Related CA2263453C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/692,474 US5951623A (en) 1996-08-06 1996-08-06 Lempel- Ziv data compression technique utilizing a dictionary pre-filled with frequent letter combinations, words and/or phrases
US08/692,474 1996-08-06
PCT/US1997/013681 WO1998006028A1 (en) 1996-08-06 1997-08-04 A lempel-ziv data compression technique utilizing a dicionary pre-filled with fequent letter combinations, words and/or phrases

Publications (2)

Publication Number Publication Date
CA2263453A1 true CA2263453A1 (en) 1998-02-12
CA2263453C CA2263453C (en) 2004-10-05

Family

ID=24780736

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002263453A Expired - Fee Related CA2263453C (en) 1996-08-06 1997-08-04 A lempel-ziv data compression technique utilizing a dictionary pre-filled with frequent letter combinations, words and/or phrases

Country Status (9)

Country Link
US (2) US5951623A (en)
EP (1) EP0970419B1 (en)
JP (1) JP3935952B2 (en)
AT (1) ATE366435T1 (en)
AU (1) AU721734B2 (en)
CA (1) CA2263453C (en)
DE (1) DE69737892T2 (en)
ES (1) ES2289762T3 (en)
WO (1) WO1998006028A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115988569A (en) * 2023-03-21 2023-04-18 浙江省疾病预防控制中心 Bluetooth device data rapid transmission method

Families Citing this family (163)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5758257A (en) 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
JPH11143877A (en) * 1997-10-22 1999-05-28 Internatl Business Mach Corp <Ibm> Compression method, method for compressing entry index data and machine translation system
KR100448289B1 (en) * 1997-12-20 2004-11-16 주식회사 대우일렉트로닉스 Data compression system having a string matching module
US6055526A (en) * 1998-04-02 2000-04-25 Sun Microsystems, Inc. Data indexing technique
US6100824A (en) * 1998-04-06 2000-08-08 National Dispatch Center, Inc. System and method for data compression
US6216175B1 (en) * 1998-06-08 2001-04-10 Microsoft Corporation Method for upgrading copies of an original file with same update data after normalizing differences between copies created during respective original installations
JP4242970B2 (en) * 1998-07-09 2009-03-25 富士通株式会社 Data compression method and data compression apparatus
US6393149B2 (en) 1998-09-17 2002-05-21 Navigation Technologies Corp. Method and system for compressing data and a geographic database formed therewith and methods for use thereof in a navigation application program
CH693729A5 (en) * 1998-10-28 2003-12-31 Andrei Vertel A method and system for processing or transmission of text.
US6298321B1 (en) * 1998-11-23 2001-10-02 Microsoft Corporation Trie compression using substates and utilizing pointers to replace or merge identical, reordered states
US6304878B1 (en) 1998-11-23 2001-10-16 Microsoft Corporation Method and system for improved enumeration of tries
US6456209B1 (en) * 1998-12-01 2002-09-24 Lucent Technologies Inc. Method and apparatus for deriving a plurally parsable data compression dictionary
US6604106B1 (en) * 1998-12-10 2003-08-05 International Business Machines Corporation Compression and delivery of web server content
US6624761B2 (en) 1998-12-11 2003-09-23 Realtime Data, Llc Content independent data compression method and system
US6604158B1 (en) 1999-03-11 2003-08-05 Realtime Data, Llc System and methods for accelerated data storage and retrieval
US6601104B1 (en) 1999-03-11 2003-07-29 Realtime Data Llc System and methods for accelerated data storage and retrieval
US6347383B1 (en) * 1999-03-31 2002-02-12 International Business Machines Corporation Method and system for address trace compression through loop detection and reduction
EP1211601A4 (en) * 1999-08-13 2004-03-10 Fujitsu Ltd File processing method, data processing device and storage medium
US6675169B1 (en) 1999-09-07 2004-01-06 Microsoft Corporation Method and system for attaching information to words of a trie
US6535886B1 (en) * 1999-10-18 2003-03-18 Sony Corporation Method to compress linguistic structures
US20010047473A1 (en) 2000-02-03 2001-11-29 Realtime Data, Llc Systems and methods for computer initialization
DE60134255D1 (en) * 2000-07-25 2008-07-10 Juniper Networks Inc NETWORK ARCHITECTURE AND METHOD FOR TRANSPARENT ONLINE CROSS SECTION CODING AND TRANSMISSION OF NETWORK COMMUNICATION DATA
US6856651B2 (en) * 2000-07-25 2005-02-15 Peribit Networks, Inc. System and method for incremental and continuous data compression
DE10196513T1 (en) * 2000-08-15 2003-11-13 Seagate Technology Llc Dual mode data compression for an operational code
US20030217025A1 (en) * 2000-09-11 2003-11-20 David Costantino Textual data storage system and method
US6898605B2 (en) * 2000-09-11 2005-05-24 Snap-On Incorporated Textual data storage system and method
US9143546B2 (en) 2000-10-03 2015-09-22 Realtime Data Llc System and method for data feed acceleration and encryption
US7417568B2 (en) 2000-10-03 2008-08-26 Realtime Data Llc System and method for data feed acceleration and encryption
US8692695B2 (en) 2000-10-03 2014-04-08 Realtime Data, Llc Methods for encoding and decoding data
US6359548B1 (en) 2000-10-16 2002-03-19 Unisys Corporation Data compression and decompression method and apparatus with embedded filtering of infrequently encountered strings
US6735339B1 (en) * 2000-10-27 2004-05-11 Dolby Laboratories Licensing Corporation Multi-stage encoding of signal components that are classified according to component value
US6985965B2 (en) * 2000-11-16 2006-01-10 Telefonaktiebolaget Lm Ericsson (Publ) Static information knowledge used with binary compression methods
KR100382649B1 (en) * 2000-12-29 2003-05-09 삼성전자주식회사 Methods and apparatuses for compressing and recovering data for hard copy apparatus
US20020085764A1 (en) * 2000-12-29 2002-07-04 Brady Thomas S. Enhanced data compression technique
US7386046B2 (en) 2001-02-13 2008-06-10 Realtime Data Llc Bandwidth sensitive data compression and decompression
US6392568B1 (en) * 2001-03-07 2002-05-21 Unisys Corporation Data compression and decompression method and apparatus with embedded filtering of dynamically variable infrequently encountered strings
US7155173B2 (en) * 2001-03-14 2006-12-26 Nokia Corporation Method and system for providing a context for message compression
US7500017B2 (en) * 2001-04-19 2009-03-03 Microsoft Corporation Method and system for providing an XML binary format
US6400286B1 (en) * 2001-06-20 2002-06-04 Unisys Corporation Data compression method and apparatus implemented with limited length character tables
US20030153338A1 (en) 2001-07-24 2003-08-14 Herz Frederick S. M. Autoband
US6961011B2 (en) * 2001-08-27 2005-11-01 Freescale Semiconductor, Inc. Data compression system
IL162425A0 (en) 2001-12-10 2005-11-20 Virtual Locality Ltd Apparatus and method for optimized and secured reflection of network services to remote locations
US6624762B1 (en) * 2002-04-11 2003-09-23 Unisys Corporation Hardware-based, LZW data compression co-processor
US20030231184A1 (en) * 2002-04-22 2003-12-18 Gurney Darin V. Directory listings white space reduction method, apparatus, and system
US7071854B1 (en) * 2002-05-13 2006-07-04 Unisys Corporation Hardware-implemented LZW data decompression
US7269548B2 (en) * 2002-07-03 2007-09-11 Research In Motion Ltd System and method of creating and using compact linguistic data
US6608570B1 (en) * 2002-07-15 2003-08-19 Unisys Corporation Matrix implemented data compression apparatus and method
US6798362B2 (en) 2002-10-30 2004-09-28 International Business Machines Corporation Polynomial-time, sequential, adaptive system and method for lossy data compression
US20060142997A1 (en) * 2002-12-27 2006-06-29 Per Jakobsen Predictive text entry and data compression method for a mobile communication terminal
US20040139298A1 (en) * 2003-01-09 2004-07-15 International Business Machines Corporation Method and apparatus for instruction compression and decompression in a cache memory
US6674374B1 (en) * 2003-01-25 2004-01-06 Unisys Corporation Data compressor utilizing switched input coincidence elements
US6847315B2 (en) * 2003-04-17 2005-01-25 International Business Machines Corporation Nonuniform compression span
US6756923B1 (en) * 2003-05-30 2004-06-29 Unisys Corporation Data compressor utilizing switched input coincidence elements arranged in virtual levels
GB2403033A (en) * 2003-06-18 2004-12-22 Research In Motion Ltd PDA software compression
US20070162957A1 (en) * 2003-07-01 2007-07-12 Andrew Bartels Methods, systems and devices for securing supervisory control and data acquisition (SCADA) communications
US9614772B1 (en) 2003-10-20 2017-04-04 F5 Networks, Inc. System and method for directing network traffic in tunneling applications
US7039394B2 (en) * 2003-11-25 2006-05-02 Good Technology, Inc. Communication system and method for compressing information sent by a communication device to a target portable communication device
US7079054B2 (en) * 2004-06-04 2006-07-18 Broadcom Corporation V.42bis standalone hardware accelerator and architecture of construction
US8954400B2 (en) * 2004-09-13 2015-02-10 International Business Machines Corporation Method, system and program product for managing structured data
US8024483B1 (en) 2004-10-01 2011-09-20 F5 Networks, Inc. Selective compression for network connections
US20060106870A1 (en) * 2004-11-16 2006-05-18 International Business Machines Corporation Data compression using a nested hierarchy of fixed phrase length dictionaries
US8511558B2 (en) * 2005-04-12 2013-08-20 Sandisk Il Ltd. Smartcard power management
US7102552B1 (en) * 2005-06-07 2006-09-05 Windspring, Inc. Data compression with edit-in-place capability for compressed data
US7783781B1 (en) 2005-08-05 2010-08-24 F5 Networks, Inc. Adaptive compression
US8533308B1 (en) 2005-08-12 2013-09-10 F5 Networks, Inc. Network traffic management through protocol-configurable transaction processing
US7739586B2 (en) * 2005-08-19 2010-06-15 Microsoft Corporation Encoding of markup language data
US8745140B2 (en) * 2005-10-14 2014-06-03 Blackberry Limited System and method of handling messages for forwarding
SE530081C2 (en) 2005-10-24 2008-02-26 Algotrim Ab Method and system for data compression
US20070124306A1 (en) * 2005-11-09 2007-05-31 Honda Motor Co., Ltd. Method and system for transmitting data to vehicles over limited data links
US7307552B2 (en) * 2005-11-16 2007-12-11 Cisco Technology, Inc. Method and apparatus for efficient hardware based deflate
US8275909B1 (en) 2005-12-07 2012-09-25 F5 Networks, Inc. Adaptive compression
US7882084B1 (en) * 2005-12-30 2011-02-01 F5 Networks, Inc. Compression of data transmitted over a network
US8565088B1 (en) 2006-02-01 2013-10-22 F5 Networks, Inc. Selectively enabling packet concatenation based on a transaction boundary
US7873065B1 (en) 2006-02-01 2011-01-18 F5 Networks, Inc. Selectively enabling network packet concatenation based on metrics
JP4256397B2 (en) 2006-02-17 2009-04-22 誠 後藤 File storage device
US7552363B2 (en) * 2006-03-23 2009-06-23 Arm Limited Generation of trace elements within a data processing apparatus
US9772981B2 (en) * 2006-03-29 2017-09-26 EMC IP Holding Company LLC Combined content indexing and data reduction
US20070255570A1 (en) * 2006-04-26 2007-11-01 Annaz Fawaz Y Multi-platform visual pronunciation dictionary
US8769311B2 (en) 2006-05-31 2014-07-01 International Business Machines Corporation Systems and methods for transformation of logical data objects for storage
JP5431148B2 (en) 2006-05-31 2014-03-05 インターナショナル・ビジネス・マシーンズ・コーポレーション Method and system for converting logical data object for storage
US9356824B1 (en) 2006-09-29 2016-05-31 F5 Networks, Inc. Transparently cached network resources
US20080120315A1 (en) * 2006-11-21 2008-05-22 Nokia Corporation Signal message decompressor
US8417833B1 (en) 2006-11-29 2013-04-09 F5 Networks, Inc. Metacodec for optimizing network data compression based on comparison of write and read rates
US7817630B2 (en) * 2006-12-18 2010-10-19 Telefonaktiebolaget Lm Ericsson (Publ) Method, communications node, and memory for dynamic dictionary updating and optimization for compression and decompression of messages
US9106606B1 (en) 2007-02-05 2015-08-11 F5 Networks, Inc. Method, intermediate device and computer program code for maintaining persistency
US7439887B2 (en) * 2007-02-13 2008-10-21 Seiko Epson Corporation Method and apparatus for GIF decompression using fixed-size codeword table
US7439882B1 (en) * 2007-04-05 2008-10-21 Novell, Inc. Optimized decompression using annotated back buffer
US8819288B2 (en) * 2007-09-14 2014-08-26 Microsoft Corporation Optimized data stream compression using data-dependent chunking
US8078454B2 (en) * 2007-09-28 2011-12-13 Microsoft Corporation Two-pass hash extraction of text strings
FR2926378B1 (en) * 2008-01-14 2013-07-05 Canon Kk METHOD AND PROCESSING DEVICE FOR ENCODING A HIERARCHISED DATA DOCUMENT
US7688233B2 (en) * 2008-02-07 2010-03-30 Red Hat, Inc. Compression for deflate algorithm
US8572287B2 (en) * 2008-02-14 2013-10-29 Blackberry Limited Method and apparatus for communicating compression state information for interactive compression
US8166249B2 (en) * 2008-03-10 2012-04-24 International Business Machines Corporation Performing a least recently used (LRU) algorithm for a co-processor
US8688654B2 (en) 2009-10-06 2014-04-01 International Business Machines Corporation Data compression algorithm selection and tiering
US7953881B1 (en) * 2008-06-12 2011-05-31 Juniper Networks, Inc. Network characteristic-based compression of network traffic
FR2933793B1 (en) * 2008-07-11 2013-07-05 Canon Kk METHODS OF ENCODING AND DECODING, BY REFERENCING, VALUES IN A STRUCTURED DOCUMENT, AND ASSOCIATED SYSTEMS.
US8108361B2 (en) * 2008-07-31 2012-01-31 Microsoft Corporation Efficient column based data encoding for large-scale data storage
US7696906B2 (en) * 2008-08-13 2010-04-13 International Business Machines Corporation LZW data compression algorithm
US7764202B2 (en) * 2008-11-26 2010-07-27 Red Hat, Inc. Lossless data compression with separated index values and literal values in output stream
US7750826B2 (en) * 2008-11-26 2010-07-06 Red Hat, Inc. Data structure management for lossless data compression
US7764201B2 (en) * 2008-11-26 2010-07-27 Red Hat, Inc. Table management for LZW with fixed-size tables
US8918374B1 (en) * 2009-02-13 2014-12-23 At&T Intellectual Property I, L.P. Compression of relational table data files
US8874529B2 (en) * 2009-03-16 2014-10-28 Bert A. Silich User-determinable method and system for manipulating and displaying textual and graphical information
US9160611B2 (en) * 2009-04-22 2015-10-13 Webroot Inc. System and method for performing longest common prefix strings searches
US8355585B2 (en) * 2009-05-12 2013-01-15 Red Hat Israel, Ltd. Data compression of images using a shared dictionary
US9438413B2 (en) 2010-01-08 2016-09-06 Novell, Inc. Generating and merging keys for grouping and differentiating volumes of files
US9298722B2 (en) * 2009-07-16 2016-03-29 Novell, Inc. Optimal sequential (de)compression of digital data
KR101049699B1 (en) * 2009-07-17 2011-07-15 (주)이스트소프트 Data Compression Method
US7982636B2 (en) * 2009-08-20 2011-07-19 International Business Machines Corporation Data compression using a nested hierachy of fixed phrase length static and dynamic dictionaries
US8832103B2 (en) 2010-04-13 2014-09-09 Novell, Inc. Relevancy filter for new data based on underlying files
JP5520391B2 (en) * 2010-12-28 2014-06-11 インターナショナル・ビジネス・マシーンズ・コーポレーション Apparatus and method for determining search start point
EP2706466A4 (en) * 2011-05-02 2015-06-17 Fujitsu Ltd Extraction method, information processing method, extraction program, information processing program, extraction device, and information processing device
US9363339B2 (en) 2011-07-12 2016-06-07 Hughes Network Systems, Llc Staged data compression, including block level long range compression, for data streams in a communications system
US9479383B2 (en) 2011-07-12 2016-10-25 Hughes Network Systems, Llc Data compression for priority based data traffic, on an aggregate traffic level, in a multi stream communications system
US20130018932A1 (en) 2011-07-12 2013-01-17 Hughes Network Systems, Llc System and method for long range and short range data compression
GB2496385B (en) 2011-11-08 2014-03-05 Canon Kk Methods and network devices for communicating data packets
US8610604B2 (en) 2011-11-24 2013-12-17 International Business Machines Corporation Compression algorithm incorporating a feedback loop for dynamic selection of a predefined Huffman dictionary
US8542135B2 (en) 2011-11-24 2013-09-24 International Business Machines Corporation Compression algorithm incorporating automatic generation of a bank of predefined huffman dictionaries
US8610606B2 (en) 2011-11-24 2013-12-17 International Business Machines Corporation Compression algorithm incorporating dynamic selection of a predefined huffman dictionary
US9251143B2 (en) 2012-01-13 2016-02-02 International Business Machines Corporation Converting data into natural language form
US8593308B1 (en) 2012-05-31 2013-11-26 International Business Machines Corporation Method of accelerating dynamic Huffman decompaction within the inflate algorithm
US8674856B2 (en) 2012-08-16 2014-03-18 International Business Machines Corporation Data compression utilizing longest common subsequence template
US8791843B2 (en) 2012-10-15 2014-07-29 Lsi Corporation Optimized bitstream encoding for compression
US9035809B2 (en) 2012-10-15 2015-05-19 Seagate Technology Llc Optimizing compression engine throughput via run pre-processing
US9231615B2 (en) 2012-10-24 2016-01-05 Seagate Technology Llc Method to shorten hash chains in Lempel-Ziv compression of data with repetitive symbols
US20140149605A1 (en) * 2012-11-26 2014-05-29 Saravana Annamalaisami Systems and methods for dictionary based compression
US9087070B2 (en) * 2013-01-31 2015-07-21 Yahoo! Inc. System and method for applying an efficient data compression scheme to URL parameters
US9998140B2 (en) 2013-04-22 2018-06-12 International Business Machines Corporation Matching pattern combinations via fast array comparison
US8804814B1 (en) * 2013-06-04 2014-08-12 Centri Technology, Inc. Seeding of a workspace to optimize codec operations
US8902087B1 (en) * 2013-08-27 2014-12-02 International Business Machines Corporation Data decompression utilizing pre-expanded dictionaries during decompression
US8933829B2 (en) * 2013-09-23 2015-01-13 International Business Machines Corporation Data compression using dictionary encoding
JP6319740B2 (en) * 2014-03-25 2018-05-09 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ Method for speeding up data compression, computer for speeding up data compression, and computer program therefor
US9450607B1 (en) * 2014-07-10 2016-09-20 Google Inc. Encoding or decoding characters as word in corpus
US9805099B2 (en) 2014-10-30 2017-10-31 The Johns Hopkins University Apparatus and method for efficient identification of code similarity
US9413386B1 (en) 2015-02-19 2016-08-09 Qualcomm Incorporated System, apparatus, and method for decompressing data
US10102215B2 (en) * 2015-03-27 2018-10-16 Intel Corporation Apparatus for hardware implementation of lossless data compression
US9971704B2 (en) 2015-03-27 2018-05-15 International Business Machines Corporation Data compression accelerator methods, apparatus and design structure with improved resource utilization
US9736081B2 (en) 2015-06-04 2017-08-15 At&T Intellectual Property I, L.P. Apparatus and method to improve compression and storage data
JP6536243B2 (en) * 2015-07-16 2019-07-03 富士通株式会社 Encoding program, encoding apparatus, encoding method, verification program, verification apparatus and verification method
US9953058B1 (en) 2015-07-29 2018-04-24 Levyx, Inc. Systems and methods for searching large data sets
US10339121B2 (en) * 2015-08-06 2019-07-02 Sap Se Data compression
US9584155B1 (en) * 2015-09-24 2017-02-28 Intel Corporation Look-ahead hash chain matching for data compression
US10303759B2 (en) 2015-12-03 2019-05-28 International Business Machines Corporation Memory preserving parse tree based compression with entropy coding
US9513813B1 (en) 2015-12-18 2016-12-06 International Business Machines Corporation Determining prefix codes for pseudo-dynamic data compression utilizing clusters formed based on compression ratio
US10509580B2 (en) * 2016-04-01 2019-12-17 Intel Corporation Memory controller and methods for memory compression utilizing a hardware compression engine and a dictionary to indicate a zero value, full match, partial match, or no match
JP6648620B2 (en) * 2016-04-19 2020-02-14 富士通株式会社 Encoding program, encoding device, and encoding method
US10303402B2 (en) 2016-08-02 2019-05-28 Seagate Technology Llc Data compression using partial statistics
US20220107919A1 (en) * 2017-05-19 2022-04-07 Takashi Suzuki Computerized systems and methods of data compression
US10956440B2 (en) 2017-10-16 2021-03-23 International Business Machines Corporation Compressing a plurality of documents
US10224957B1 (en) * 2017-11-27 2019-03-05 Intel Corporation Hash-based data matching enhanced with backward matching for data compression
US10097201B1 (en) * 2017-11-30 2018-10-09 Intel Corporation LZ77 compression of data with data runs
US10128868B1 (en) * 2017-12-29 2018-11-13 Intel Corporation Efficient dictionary for lossless compression
US10735025B2 (en) * 2018-03-02 2020-08-04 Microsoft Technology Licensing, Llc Use of data prefixes to increase compression ratios
US20190348999A1 (en) * 2018-05-12 2019-11-14 Redpine Signals, Inc. Method and apparatus for compression and decompression of a numerical file
US10897270B2 (en) 2018-06-06 2021-01-19 Yingquan Wu Dynamic dictionary-based data symbol encoding
US11387844B2 (en) * 2019-04-19 2022-07-12 Preferred Networks, Inc. Data compression method, data compression apparatus, data decompression method, data decompression apparatus and data storage system
US11122095B2 (en) 2019-09-23 2021-09-14 Netapp, Inc. Methods for dictionary-based compression and devices thereof
US11803693B2 (en) 2021-06-18 2023-10-31 Microsoft Technology Licensing, Llc Text compression with predicted continuations
US20230281164A1 (en) * 2022-03-03 2023-09-07 Fotonation Limited Data decompression apparatus
CN115801902B (en) * 2023-02-09 2023-04-11 北京特立信电子技术股份有限公司 Compression method of network access request data
CN116683916B (en) * 2023-08-03 2023-10-10 山东五棵松电气科技有限公司 Disaster recovery system of data center
CN117113383B (en) * 2023-10-19 2024-01-26 山东万世机械科技有限公司 Privacy protection method and system for local production data of equipment
CN117171118B (en) * 2023-11-02 2024-02-20 山东天晴生物科技股份有限公司 Rural marketing data intelligent management system

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US545576A (en) * 1895-09-03 Hame-tug
US4386416A (en) * 1980-06-02 1983-05-31 Mostek Corporation Data compression, encryption, and in-line transmission system
US4464650A (en) * 1981-08-10 1984-08-07 Sperry Corporation Apparatus and method for compressing data signals and restoring the compressed data signals
US4814746A (en) * 1983-06-01 1989-03-21 International Business Machines Corporation Data compression method
US4558302A (en) * 1983-06-20 1985-12-10 Sperry Corporation High speed data compression and decompression apparatus and method
US4672679A (en) * 1983-08-16 1987-06-09 Wang Laboratories, Inc. Context redundancy text compression
GB2172127B (en) * 1985-03-06 1988-10-12 Ferranti Plc Data compression system
US4843389A (en) * 1986-12-04 1989-06-27 International Business Machines Corp. Text compression and expansion method and apparatus
US4881075A (en) * 1987-10-15 1989-11-14 Digital Equipment Corporation Method and apparatus for adaptive data compression
US4876541A (en) * 1987-10-15 1989-10-24 Data Compression Corporation Stem for dynamically compressing and decompressing electronic data
US4847619A (en) * 1987-10-19 1989-07-11 Hewlett-Packard Company Performance-based reset of data compression dictionary
US4906991A (en) * 1988-04-29 1990-03-06 Xerox Corporation Textual substitution data compression with finite length search windows
GB8815978D0 (en) * 1988-07-05 1988-08-10 British Telecomm Method & apparatus for encoding decoding & transmitting data in compressed form
US5016009A (en) * 1989-01-13 1991-05-14 Stac, Inc. Data compression apparatus and method
US5126739A (en) * 1989-01-13 1992-06-30 Stac Electronics Data compression apparatus and method
US5003307A (en) * 1989-01-13 1991-03-26 Stac, Inc. Data compression apparatus with shift register search means
DE3921646A1 (en) * 1989-06-30 1991-01-03 Siemens Ag METHOD FOR CODING AN ELEMENT SEQUENCE AND DEVICE FOR CARRYING OUT THE METHOD
US5058137A (en) * 1989-07-31 1991-10-15 North American Philips Corporation Lempel-Ziv decoder
US4988998A (en) * 1989-09-05 1991-01-29 Storage Technology Corporation Data compression system for successively applying at least two data compression methods to an input data stream
US5001478A (en) * 1989-12-28 1991-03-19 International Business Machines Corporation Method of encoding compressed data
US5023610A (en) * 1990-06-13 1991-06-11 Cordell Manufacturing, Inc. Data compression method using textual substitution
US5049881A (en) * 1990-06-18 1991-09-17 Intersecting Concepts, Inc. Apparatus and method for very high data rate-compression incorporating lossless data compression and expansion utilizing a hashing technique
US5087913A (en) * 1990-08-27 1992-02-11 Unisys Corporation Short-record data compression and decompression system
US5179378A (en) * 1991-07-30 1993-01-12 University Of South Florida Method and apparatus for the compression and decompression of data using Lempel-Ziv based techniques
US5140321A (en) * 1991-09-04 1992-08-18 Prime Computer, Inc. Data compression/decompression method and apparatus
US5155484A (en) * 1991-09-13 1992-10-13 Salient Software, Inc. Fast data compressor with direct lookup table indexing into history buffer
US5243341A (en) * 1992-06-01 1993-09-07 Hewlett Packard Company Lempel-Ziv compression scheme with enhanced adapation
US5373290A (en) * 1991-09-25 1994-12-13 Hewlett-Packard Corporation Apparatus and method for managing multiple dictionaries in content addressable memory based data compression
JPH05241775A (en) 1992-02-28 1993-09-21 Fujitsu Ltd Data compression system
JP3241788B2 (en) 1992-02-28 2001-12-25 富士通株式会社 Data compression method
US5590317A (en) * 1992-05-27 1996-12-31 Hitachi, Ltd. Document information compression and retrieval system and document information registration and retrieval method
US5485526A (en) * 1992-06-02 1996-01-16 Hewlett-Packard Corporation Memory circuit for lossless data compression/decompression dictionary storage
JPH0628149A (en) 1992-07-10 1994-02-04 Fujitsu Ltd Method for compressing plural kinds of data
JPH06161705A (en) 1992-11-19 1994-06-10 Fujitsu Ltd Data encoding system and data decoding system
US5455576A (en) * 1992-12-23 1995-10-03 Hewlett Packard Corporation Apparatus and methods for Lempel Ziv data compression with improved management of multiple dictionaries in content addressable memory
DE4244272A1 (en) 1992-12-28 1994-06-30 Daimler Benz Ag Field effect controlled semiconductor device
JP2536422B2 (en) 1993-08-31 1996-09-18 日本電気株式会社 Data compression device and data decompression device
JP3346626B2 (en) 1993-11-30 2002-11-18 京セラ株式会社 Data compression device
US5572206A (en) 1994-07-06 1996-11-05 Microsoft Corporation Data compression method and system
US5561421A (en) * 1994-07-28 1996-10-01 International Business Machines Corporation Access method data compression with system-built generic dictionaries
JPH08162874A (en) 1994-11-30 1996-06-21 Kinseki Ltd Manufacture of crystal vibrator
JP3277792B2 (en) * 1996-01-31 2002-04-22 株式会社日立製作所 Data compression method and apparatus

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115988569A (en) * 2023-03-21 2023-04-18 浙江省疾病预防控制中心 Bluetooth device data rapid transmission method

Also Published As

Publication number Publication date
EP0970419A1 (en) 2000-01-12
ES2289762T3 (en) 2008-02-01
JP3935952B2 (en) 2007-06-27
US5951623A (en) 1999-09-14
AU721734B2 (en) 2000-07-13
DE69737892T2 (en) 2008-04-03
ATE366435T1 (en) 2007-07-15
JP2000516058A (en) 2000-11-28
DE69737892D1 (en) 2007-08-16
AU4051297A (en) 1998-02-25
EP0970419B1 (en) 2007-07-04
USRE41152E1 (en) 2010-02-23
EP0970419A4 (en) 2000-05-10
CA2263453C (en) 2004-10-05
WO1998006028A1 (en) 1998-02-12

Similar Documents

Publication Publication Date Title
CA2263453A1 (en) A lempel-ziv data compression technique utilizing a dictionary pre-filled with frequent letter combinations, words and/or phrases
EP0399487A3 (en) Transformation coding device
US5010345A (en) Data compression method
EP1283486A3 (en) Storage of row-column data
EP0438956A1 (en) Method of encoding compressed data
EP0331094A3 (en) Multimedia data transmission system
WO2002015408A3 (en) Dual mode data compression for operating code
WO1998040969A3 (en) Text file compression system
EP2053498A3 (en) Data storewidth accelerator
WO2002071622A3 (en) Device and method for compressing a signal
EP0642117A3 (en) Data compression for speech recognition
MY119474A (en) Efficient fixed-length block compression and decompression
CA2260883A1 (en) Data compression and decompression system with immediate dictionary updating interleaved with string search
AU4344389A (en) Improved low-profile, rubber keypad
AU687902B2 (en) Spring loaded screw and driver/extractor therefor
WO1994003983A1 (en) Single clock cycle data compressor/decompressor with a string reversal mechanism
CA2131875A1 (en) A syringe assembly for the storage and application of a biological multi-component material
WO2001050325A3 (en) Lossless data compression
EP0783208A3 (en) Method and apparatus for double run-length encoding of binary data
AU7936094A (en) Chinese character input method and associated keyboard based on the double strokes and roots containing the double strokes
AU5274690A (en) Two-stage pumping apparatus with low shear first stage
CA2328043A1 (en) Data compression system, data decompression system, supervisory control system and computer-readable storage medium
EP0874365A3 (en) Storage sub-system compression and dataflow chip offering excellent data integrity
CA2168284A1 (en) Apparatus and Associated Method for Compressing and Decompressing Digital Data
US8332209B2 (en) Method and system for text compression and decompression

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20170804