Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUS8135169 B2
Publication typeGrant
Application numberUS 12/857,358
Publication date13 Mar 2012
Filing date16 Aug 2010
Priority date30 Sep 2002
Also published asUS7778438, US8509477, US20070150517, US20100303288, US20120183134, US20130329086
Publication number12857358, 857358, US 8135169 B2, US 8135169B2, US-B2-8135169, US8135169 B2, US8135169B2
InventorsMichael F. Malone
Original AssigneeMyport Technologies, Inc.
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
US 8135169 B2
Abstract
This invention relates to an apparatus for capturing data a first capture device interfacing with a primary data source to capture data therefrom for storage into a primary data set. A second capture device is provided interfacing with a secondary data source to capture data therefrom for storage into a secondary data set. An associating device is then operable to associate the converted data set with the primary data set. A data converter converts the data stored in the second data set to a different and converted form as a converted data set.
Images(5)
Previous page
Next page
Claims(22)
What is claimed is:
1. An apparatus for capturing data:
a first capture device interfacing with a primary data source to capture data therefrom for storage into a primary data set;
a second capture device interfacing with a secondary data source to capture data therefrom for storage into a secondary data set;
a data converter for converting the data stored in the secondary data set to a different and inverted converted form as a converted data set, which converted data set is searchable with a searchable algorithm compatible with such converted data set;
an associating device for associating the converted data set with the primary data set to
provide a searchable composite data set with the converted data set closely associated with the primary data set in the searchable composite data set; and
a transmitter for transmitting the searchable composite data set to a remote storage facility over a wireless communication path.
2. The apparatus of claim 1 wherein the first capture device is a camera capable of capturing data into a primary data set composed of an image.
3. The apparatus of claim 1 wherein the second capture device is a microphone capable of capturing data into a secondary data set composed of audio.
4. The apparatus of claim 1 wherein the second capture device is a keypad capable of capturing data representing a keypad output and the data converter is operable to convert the keypad output to a text form.
5. The apparatus of claim 1 wherein the data converter converts the secondary data set to a data form that is a function of a process that identifies features in the primary data set.
6. The process of claim 5 wherein the feature identification process is confirmed by a user instruction with a user input device.
7. The apparatus of claim 1 wherein the second capture device is a location-determining device capable of capturing location information.
8. The apparatus of claim 1 wherein the second capture device is an identification device capable of providing identification information.
9. The apparatus of claim 1 wherein the composite data set is an e-mail message.
10. The apparatus of claim 1 wherein the composite data set is an image with embedded tags.
11. The apparatus of claim 1 wherein the composite data set is a compressed archive.
12. The apparatus of claim 1 in which the form of the converted data set is plain text format.
13. The apparatus of claim 1 in which the form of the converted secondary data set is XML format.
14. The apparatus of claim 1 in which the primary and secondary data sets are stored in a storage medium.
15. The apparatus of claim 3 in which the data converter converts the secondary data set to text by an algorithmic process to identify speech elements in the recorded audio.
16. The apparatus of claim 15 in which the text converted from speech is further converted to searchable tags.
17. A portable apparatus for capturing media information, comprising:
a camera for capturing media information for storage into a primary data set at a time of capture when it was fixed as a captured image in the camera;
a capture device interfacing with a data source to capture data from a media source having associated therewith information different than the media information captured by the camera for storage into a secondary data set;
a data converter for converting the data stored in the secondary data set to a different and converted form as a converted data set, which converted data set is searchable with a searchable algorithm compatible with such converted data set; and
an associating device for associating the converted data set with the primary data set to provide a searchable composite data set with the converted data set closely associated with the primary data set in the searchable composite data set, the associating device also associating the time of capture with at least the primary data set in close association therewith such that the time of capture can be differentiated from the time that the second capture device captures data; and
a transmitter for transmitting the searchable composite data set to a remote storage facility over a wireless communication path.
18. The apparatus of claim 17 wherein the capture device is a microphone capable of capturing audio into a secondary data set.
19. The apparatus of claim 17 wherein the capture device is a keypad capable of capturing data representing a keypad output and the data converter is operable to convert the keypad output to a text form.
20. The apparatus of claim 17 wherein the data converter converts the secondary data set to a data form that is a function of a process that identifies features in the primary data set.
21. The apparatus of claim 17 wherein the capture device is a location-determining device capable of capturing location information.
22. The apparatus of claim 17 in which the primary and secondary data sets are stored in a storage medium.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No. 11/621,062, filed on Jan. 8, 2007, and entitled METHOD FOR MULTI-MEDIA RECOGNITION, DATA CONVERSION, CREATION OF METATAGS, STORAGE AND SEARCH RETRIEVAL, published as U.S. Patent Application Publication No. US 2007/0150517, now U.S. Pat. No. 7,778,438, issued on Aug. 17, 2010. U.S. Patent Application Publication No. US 2007/0150517 and U.S. Pat. No. 7,778,438 are incorporated by reference herein.

U.S. patent application Ser. No. 11/621,062 is a Continuation-in-Part of U.S. patent application Ser. No. 11/325,373, filed Jan. 4, 2006, and entitled APPARATUS FOR CAPTURING INFORMATION AS A FILE AND ENHANCING THE FILE WITH EMBEDDED INFORMATION, published as U.S. Patent Application Publication No. US 2006/0115111, now U.S. Pat. No. 7,184,573, issued on Feb. 27, 2007, which application is a Continuation of U.S. patent application Ser. No. 10/674,910, filed Sep. 29, 2003, and entitled FORENSIC COMMUNICATION APPARATUS AND METHOD, published as U.S. Patent Application Publication No. US 2004/0125208, now U.S. Pat. No. 6,996,251, issued on Feb. 7, 2006, which application claims benefit of U.S. Application Ser. No. 60/414,449, filed Sep. 30, 2002, and entitled FORENSIC COMMUNICATION APPARATUS AND METHOD. U.S. patent application Ser. No. 11/621,062 also claims benefit of U.S. Application Ser. No. 60/757,075, filed on Jan. 6, 2006, and entitled APPARATUS AND METHOD FOR EMBEDDING META-TAGS INTO MEDIA FILES.

U.S. Patent Application Publication Nos. US 2006/0115111, US 2004/0125208 and U.S. Pat. Nos. 7,184,573 and 6,996,251 are incorporated by reference herein.

TECHNICAL FIELD OF THE INVENTION

This invention relates to the storage and search retrieval of all types of digital media files, whether music or other audio, still photographs, videos, movies or other types of media.

BACKGROUND OF THE INVENTION

The popularity of digital media devices such as digital cameras, video cameras, mobile phones with audio and video recording capability and portable music devices that have recording capability has exploded in recent years. Instead of recording pictures, video and sound on physical media, modern devices record to rewritable memory devices. This means that the cost to create a new image, movie or audio recording has fallen to near zero, making the number of these recordings available in any given individual's library skyrocket.

But this new ability to store virtually unlimited numbers of media files introduces new problems. First, the sheer number makes it nearly impossible to manually describe and index every media file in one's possession. This means that, for many, photographs, movies and audio recordings are kept in poorly organized computer files and finding any particular picture, movie or recording is a difficult and time-consuming process.

The second problem is the fact that people typically trade up to a new computer every three years or so. This means that hours of video, thousands of pictures or hundreds of audio files must be transferred from the old system to the new—a sometimes daunting task.

A third problem is one can typically access locally stored media files only on the computer on which they reside. If one wishes to share the file with another one must typically employ some file-transfer method ahead of time (email, FTP, public server, etc.)

A fourth problem relates to e-mailing or sending your media files to another party, whereas the receiving party is not able to search the media files for the specific key indexes that the original owner had intended. While there are programs to allow the originator to type in key index words (tags) for searching and retrieving these media files from their personal computer, when these media files are e-mailed or sent to another party, these tags are removed from the media file, therefore the receiving party does not have an ability to search, sort, display, play or print these media files based on the original owners key indexes.

Finally, those who make a living providing content need some method for proving that a given work belongs to them, and that they are the original creator of the work.

SUMMARY OF THE INVENTION

The present invention disclosed and claimed in one aspect thereof an apparatus for capturing data a first capture device interfacing with a primary data source to capture data therefrom for storage into a primary data set. A second capture device is provided interfacing with a secondary data source to capture data therefrom for storage into a secondary data set. An associating device is then operable to associate the converted data set with the primary data set. A data converter converts the data stored in the second data set to a different and converted form as a converted data set.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present invention and the advantages thereof, reference is now made to the following description taken in conjunction with the accompanying Drawings in which:

FIG. 1 illustrates a block diagram of the overall operation of the system in accordance with the present disclosure.

FIG. 2 illustrates a block diagram of one embodiment of the overall operation of the system in accordance with the present disclosure.

FIG. 3 illustrates a block diagram of another embodiment of the overall operation of the system in accordance with the present disclosure.

FIG. 4 illustrates a block diagram of the file management of the system in accordance with the present disclosure.

DETAILED DESCRIPTION OF THE INVENTION

Referring now to FIG. 1, there is illustrated a block diagram of the overall operation of the system in accordance with the present disclosure. The invention is best described by beginning with the capture device 100.

Still pictures, moving pictures, audio, telemetry or other information (hereafter called simply, “information”) is gathered by the data converter 102 and organized into one “data element” 104 consisting of a single picture, a movie/video clip, an audio clip, a sample of telemetry data or other logical grouping of related information. The data converter 102 can be any type of data capture information. For pictures, a digital camera can be utilized and, for movie/video clips, the data converter can be a digital video recorder (DVR). In general, the data converter is any type of device that will capture the information and place it in some type of digitized format. As will be understood and discussed herein below, this digitized format is typically native to the data converter and the manufacturer. Some manufacturers have a particular file format in which they generate the information. This file format may have a designator as to the user, a sequence number or time stamp.

At the same time the data element is created by the capture device 100, certain other data (“meta data”) 106 is captured as well. This meta data may include time and date 158, location 160, operator identification 162, or other information deemed relevant to establish the context of the data element. The time, date and location may be taken from a GPS unit, or may be derived by time-domain analysis of certain types of mobile phone signals or wireless network domains.

In some embodiments of this invention, it may be desirable to use a technique known as steganography to permanently and indelibly embed the meta data directly into the data element. By using one of several well-known steganographic techniques, the data element can be subtly altered such that 1) it is difficult to determine that hidden information is stored in the data element, and 2 even if it is known that hidden information is stored in the data element, retrieval without some secret information (a “key”) is difficult. In this way, the data element can be guaranteed authentic even if stripped from external meta data.

Also, at the time of information capture, the capture device may gather additional information from the operator by means of a secondary data converter 108 that relates to defining the context of the data element. For example, after a camera/video recorder takes a picture/video, a microphone (the secondary data converter) might capture the audio describing the image or the audio from the video just captured. This “context description element” 110 is stored along with the data element and the meta data.

At this point, the capture device 100 has in its internal temporary storage the data element, the meta data and optionally the context description element. It now creates a composite data set using one of a number of well-known algorithms for combining multiple data sets into a single data set. For example, the well-known ZIP compression algorithm routinely performs statistical compression on a number of input files and creates a single output file such that, with the proper decompression algorithm, the original set of files can be recovered without data loss. This “combine and compress” function 112 creates a data set called the “composite element.” 114.

The capture device now encrypts the composite element using any of a number of well-known encryption algorithms. In the preferred embodiment, the composite element is first encrypted using a symmetrical cryptosystem 116 using a key 118 shared by the capture device and the storage facility. The resulting “singly-encrypted element” 120 is then hashed. “Hashing” 122 is a technique that generates a digital “signature” for a data set, such that any party wishing to verify the correctness of the data set can easily recalculate the hash and compares it with the previously calculated hash. Hash algorithms have the further property that it is computationally difficult to find multiple data sets that have the same hash value. This calculated hash value (“element hash”) 124 becomes part of the meta data set that is to be associated with the data element.

It is now necessary for the capture device to contact the storage facility over some communications medium. This communications medium 126 can be any mechanism that permits near real-time, two-way communication. The specifics of the communication medium are not disclosed here, but could comprise a wireless telephone network, the public switched telephone network, or the Internet. The capture device sends the meta data 106 (now consisting of the time, date, operator identification, image, video, audio, “context description element” 110, hash 122 and possibly other data) to the storage facility 128.

The storage facility validates the meta data received from the capture device and, if authorized, combines and hashes 130 the received meta data and a secret number 132 known only to the storage facility. This hash is appended to the original meta data set and is then returned to the capture device as a “certificate.” 134 At a later time, the certificate can be presented to the storage facility to determine if a data element is authentic.

The singly encrypted element 120 is now combined with the certificate 134 and then is further encrypted using an asymmetrical cryptosystem 136 under the public encryption key 164 of the storage facility 128, designated KSU. This new packet (the “transport packet”) 138 is now ready to transmit to the storage facility 128.

When it receives the transport packet 138, the storage facility 128 first decrypts 140 the packet 138 using its private decryption key 166 designated as KSR. This gives the storage facility 128 access to the certificate 134 (which contains the meta data 106). The certificate can be validated 142 by rehashing the meta data 106 and the secret number 132. Unpacking the certificate 134, the storage facility 128 now knows the identity of the capture device 100, and can use this to retrieve the secret, symmetrical key 118 under which the singly encrypted element 120 is encrypted. The storage facility 128 now decrypts 149) the singly encrypted element 120 to retrieve the composite element 114; then expands and recovers 150 the composite element to retrieve the data element 104, the meta data 106, and the context description element 110, if present.

Now, the storage facility 128 can store the data element 104 under the owner's account in its mass storage 144. The storage facility knows the owner's identity because it was disclosed in the meta data 106. The storage facility also adds “context tags” 146 by methods dependent on the type of data that is being stored.

Context tags 146 are searchable elements derived from either the data element 104 itself or from the context description element 110. For example, if the data element 104 is a still photograph or video, the storage facility may create context tags that describe elements of the scene or image(s), such as “animal,” or “dog,” or “Spot,” depending on the mechanism that converts the information in the data element or the context description element into a tag.

It is equipment analyze the data elements (photograph, movie, audio recording, etc.) and create 148 a set of appropriate tags. For audio files, this may include a speech-to-text algorithm; for still or moving images, it may include image recognition and identification. Whatever the method used, at the end of the process the set of data to store includes the data element 102, the context element 110, and meta data 106 that now includes a set of searchable tags specific to that image, video, audio or other media. 146, presumed that, as image and voice recognition improve; this task can be fully automated. Therefore, the preferred embodiment of this invention is to have the task automated.

Retrieval of the data elements is performed from some access point 152 remote from the storage facility 128. To retrieve data elements, a client must prove to the storage facility that the client is authorized to access the desired data element. This can be done in any number of ways, but in the preferred embodiment of the invention, it is a password challenge. The access point 152 creates an authentication request 154 and transmits the request via the communications medium 126 to the storage facility 128. At the storage facility, the request is authenticated 156. Once the challenge has been successfully met, the client can access the data elements belonging to it. Details of the authentication process may include password authentication, a challenge/response protocol, or may employ a hardware authentication device.

Once the request for information has been authenticated, the storage facility 128 reads the requested information from the bulk storage device 144 and encrypts 169) under the public key of the requester 168, designated as KCU. The encrypted data is then transmitted to the client over the communications medium 126. Upon arrival, the message is decrypted 172 under the client's private key 170 designated as KCR and the data 174 is recovered.

Once the data has been retrieved, the tags may be edited or removed and new tags added. Other meta data; particularly location and time and date cannot be changed.

Variations of the system include placing the ability to enter tags on the data capture device itself. This could be in the form of a keypad, a touch screen or voice recognition software. If this option were taken, the data packet from the image capture device would include the tags in the meta data rather than a context description element.

Another variation applies to highly secure applications in which it is desirable to keep the data element 104 encrypted even while at the storage facility. In this variation, the data element 104 is encrypted under a symmetrical cryptosystem prior to combination with the meta data 106 and the context description element 110. This variation precludes the automatic extraction of tags from the data element itself, but still permits tagging based on the context description element.

Referring now to FIG. 2, there is illustrated a diagrammatic view of the overall operation of the system. In this system, the capture device 100 is disclosed wherein the actual device that captured it, the device 102, is illustrated as being a digital camera. This has a lens 202 associated therewith, with the output of the camera being a digitized image 204. This is basically the data element 104 of FIG. 1. It can be seen that the element 204 is in a digitized format that is typically native to the camera. This can be any type of video capture element for capturing an image 206.

Once the image is captured, it is stored in a data base 208. In addition to this information, various associated information such as audio, timestamp, GPS, location, etc. can be collected. One method for collecting the audio information, for example, is to utilize a microphone 210 that will capture the information and then digitize it in a digitizing block 212 utilizing an analog-to-digital converter, for example. This not only converts it to a digital value but, further, will convert it to a particular audio format such as a *.WAV file format. This particular file format is stored in the database 208. Of course, any other type of digital format could be utilized that is consistent with an audio format. The GPS information for location can be collected with an external GPS system 218 and timestamp information can internally be generated.

After all the information regarding the video information and the audio information, for example, is collected, it is stored in the database 208 and then must be output therefrom. In this embodiment, there are two types of attached information that are to be embedded within the image at a later time. The first set of information is the GPS information, the timestamp information, etc., that is collected automatically with any image. This information is created in a temporal relationship with respect to that particular image at the time of the capture of the image information. This location information, timestamp information, etc., is information that is unique to the photograph and defines that image. Further, user information can be provided which defines the user information that is associated with the capture device, i.e., the camera. The additional information, the audio information, is provided in the form of comments and the such which can be stored. Therefore, when the data in the form of the image information is to be transmitted to the remote site, it is combined with the additional GPS, location, timestamp, etc., information and the audio input information.

There is typically provided a unique file format that defines the digital image and this unique file name can be utilized to define all of the secondary information such that there is a unique association of that information with the image. Thereafter, a compress module 220 is provided for compressing the information in a compressed file format such as a *.ZIP file format. This is just a manner to transmit a number of files together. However, at the reception point, when the files are extracted from this *.ZIP file, there must be some way to distinguish the files and again associate them. This is done, for example, with a unique file naming structure. However, there could be other techniques utilized to uniquely identify the association between these different files.

Once this compressed file format is transmitted to the storage facility 128, it is stored in a database 226. At this time there will be, for example, a video clip or a video image (such as a still image) stored in association with the various information that is associated therewith. This, in effect, is a relational database that provides data storage in close association with each other. The first thing that must be done is to extract the information from the data. This is done in a block 228 wherein the associated information is extracted from the database, this being the associated information, and then processed. Typically, the associated information will be the audio information in the audio file format. This must be converted. One conversion that is provided for is to convert the audio formatted data to text data. Therefore, one type of audio-to-text converter can be a voice translation system. There are many of these that are provided such as the Dragon Naturally Speaking systems.

Once the text format has been provided, this is a converted to intermediate formatted data, i.e., text data, that can then be processed in a format that can be embedded within a video file or an image file. This can then be converted into HTML data or other data. This will typically be formatted such that it can be defined as a meta tag for association with the video image. This meta tag is then combined with the image in a block 230. Once combined, this will then be stored in the database in association with the original raw video and raw audio files. Thereafter, there is an access and retrieval block 152 that can allow one to access the particular modified or “tagged” image via a search. There can be provided a search algorithm that searches all of the tagged images. This searching can be performed based upon the GPS location information, the timestamp information, the added audio comment information, etc. Any information that can be provided over and above the video information that was provided in all of the associated information at the camera can then be searched, as this is the information that is contained in the appended information to the image.

Referring now to FIG. 3, there is illustrated an alternate embodiment wherein substantially all of the combining operation is contained within the capture device 100 or the camera. Again, there is provided the capture device 102 in the form of the camera that captures the image 206. This is converted and stored in a database 306. The database 306 is basically the combination of database 208 and the database 226. Initially, all of the information from the digital video image 204 and the audio information and all other associated information such as the GPS information, timestamp, etc., are all stored in the database 306. There will be a corresponding process 308 for taking the associated information and converting it into different information, i.e., a meta tag, which is substantially the same as the process 228. Once the associated process is combined it is converted into that format, then it can be combined with the image in a process block 310, similar to the process block 230. Once this occurs, then there is provided a combined video/image with meta data that can be transmitted. This is illustrated as the augmented image 316 which has meta data associated therewith. This is transmitted for storage at the storage facility in a database 318. This is searchable through the access/retrieval process 152, as described herein above.

Referring now to FIG. 4, there is illustrated one exemplary embodiment of the file structure. The image 204 is a digitized image that constitutes a particular file folder that will have a particular video or image format. This could be a JPEG format, an MPEG format or any other type of video format. This is referred to as one having the extension *.VID (for generic purposes). The file format in this embodiment will have a user ID section 402, a time/date stamp section 404, a sequence number 406 and a device number 408. This will have the format of XXX.AAAA.XXX.XXX.VID. The user ID section 402 will define the user of the capture device, this typically being configuration information that is input to the system. The time/date stamp is time and date information that can be taken from an internal clock or it can be derived from some external accurate time source. The sequence number 406 is typically internally generated with a counter that represents an internal sequence that is unique to a particular capture device. However, among different capture devices, the sequence could be the same. The device section 408 is a unique device number given to a particular device. Therefore, with the user ID information, the time/date stamp, the sequence number and the device number, a very unique file number will be generated. Further, the sequence and the time/date information will be different for each file. Thereafter, the information retrieved from the GPS 218 will be disposed in a folder with an extension of, for example, *.GPS. This will be stored in the file folder 208. The file numbering will be identical to the file nomenclature other than the extension will be identical to that of the digitized video file. Similarly, the audio information will be stored in a file folder with an extension of, for example, *.WAV with the body of the file name being identical to that of the digitized video file. This will all be stored in the database 208 and then combined in a compressed folder of the *.ZIP type. The actual file name for this can be any type of file name and it does not have to be identical or unique with respect to the name. However, there should be some type of unique file name in that, a random filename could be duplicated by other capture devices. Thus, in the preferred embodiment of this disclosure, the unique body of the *.ZIP file will be identical to that associated with the files contained therein such that this will have a filename of “XXX.AAAA.XXX.XXX.ZIP.” This is the file that is transmitted.

As a summary, the system of the present disclosure provides a system for capturing, storing, indexing and retrieving data objects, which can include a capture device, a storage facility and an access point. The system consists of a primary data converter, a secondary data converter, a meta data source, a data combiner and compressor, a symmetrical encryptor, a one-way hash function, an asymmetric encryptor, and a communications port. The primary data converter captures some physical phenomenon such as, but not limited to a still image, a moving image, a sound, or some other factor, into a primary data set. The secondary data converter is capable of capturing some phenomenon into a secondary data set, related to but separate from the information captured by the primary data converter. The meta data source produces a device identifier, time, date, location, and other data related to the information captured by the primary data converter into a meta data set. The source of the time, date and location information is a GPS receiver, a wireless receiver or another receiver. The source of the device identifier is a read-only memory device. The data combiner and compressor is capable of combining the output of the multiple sources of data (the primary data converter, the secondary data converter, and the meta data source) into a single data stream, and then compressing said data stream into a compressed data set such that the compressed data set requires fewer transmission or storage resources than the uncompressed stream, but remains recoverable such that the original data from the primary data converter, the secondary data converter and the meta data source can be recovered without error. The symmetrical encryptor is capable of using a key shared with another party to convert the data stream from the data combiner and compressor into a singly encrypted data set that is unusable by any party other than the party that has knowledge of the key. The one-way hash function is capable of calculating for the encrypted data stream from the symmetric encryptor a number associated with said data stream such that (a) the number represents the data stream, but the data stream is not recoverable from the number, and (b) that it is computationally infeasible to created a second data stream that, when presented to the one-way hash function, produces an identical number. The communications port is capable of sending the meta data and the hash to a second party. The communications port is further capable of receiving from a second party a certificate that has the property of (a) being uniquely and verifiably identified with the meta data and hash of claim 12, and (b) being verifiably identified as originating with the second party. The asymmetric encryptor is capable of converting the output of the symmetric encryptor and other data into an encrypted information packet that can be read only by a specific second party by means of a pair of related but non-identical keys, the encryption key and the decryption key. The communications port is further capable of conveying the encrypted information packet to a second party. The storage facility consists of a communications port, a device authenticator, an asymmetric decryptor, a validator, a symmetric decryptor, a data expander and recovery device, a tag generator, a mass storage mechanism, an asymmetric encryptor, and a user authenticator. The communications port is capable of receiving a request from validation from the capture device. The device authenticator is capable of verifying that the capture device is authorized to use the storage facility and to create an authentication certificate such that (a) it is computationally infeasible to create a second meta data set or hash that creates an identical authentication record, and (b) the authentication record is uniquely identified with the storage facility. The asymmetric encryptor is capable of using the decryption key to recover the authentication certificate and the singly encrypted data set. The validator is capable of determining if the recovered authentication certificate (a) was generated by the storage facility, and (b) is valid for the presented hash and meta data. The symmetric decryptor is capable of converting the singly encrypted data set into the compressed data set. The data expander and recovery device is capable of converting the compressed data set into the original primary data set, the secondary data set, and the meta data set. The tag generator is capable of taking the primary data set, the secondary data set and the meta data set and producing a set of index tags that describe the primary data set. The tag generator in which the tag generation is performed by a human operator. The tag generation is performed by a speech-to-text function or by an image recognizer. The mass storage mechanism is capable of storing the primary data set, the secondary data set and the meta data set in a way that the information can be retrieved based on the index tags. The user authenticator is capable of receiving requests from access points and verifying their authority to perform retrieval operations at the storage facility.

The system can, at its most condensed version, comprise an asymmetric encryptor capable of converting data read from the mass storage mechanism using a public encryption key into a form usable only by a party with knowledge of a secret key that corresponds to the said public encryption key. The access point consists of an asymmetric decryptor, a communications port and an authentication requester. The authentication requester is capable of identifying the access point and the data element or elements to be recovered from the storage facility in a manner that proves its authority to access said data element or elements.

Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US554225 Jun 1866 Improvement in take-up mechanisms for circular-knitting machines
US295097117 Dec 195730 Aug 1960George LewinMultiple sound tracks
US343959825 May 196622 Apr 1969Weitzner DCamera and sound recording device
US401524012 Feb 197529 Mar 1977Calspan CorporationPattern recognition apparatus
US410923717 Jan 197722 Aug 1978Hill Robert BApparatus and method for identifying individuals through their retinal vasculature patterns
US411580523 May 197519 Sep 1978Bausch & Lomb IncorporatedImage analysis indexing apparatus and methods
US427085321 Mar 19792 Jun 1981West Electric Company, Ltd.Sound-recording instant-printing film and camera therefor
US427085410 Sep 19792 Jun 1981Agfa-Gevaert, A.G.Photographic instant camera with magnetic recording capability
US433424114 Apr 19808 Jun 1982Hitachi, Ltd.Pattern position detecting system
US434468217 Dec 198017 Aug 1982Olympus Optical Co., Ltd.Data recording device
US438910929 Dec 198021 Jun 1983Minolta Camera Co., Ltd.Camera with a voice command responsive system
US444307730 Apr 198117 Apr 1984Olympus Optical Co., LtdFilm cassette and a photographing device using the same
US452858825 Sep 19819 Jul 1985Loefberg BoMethod and apparatus for marking the information content of an information carrying signal
US45743193 May 19824 Mar 1986Fuji Photo Film Co., Ltd.Electronic camera having non-image data recorder
US46139114 Dec 198423 Sep 1986Fuji Photo Film Co., Ltd.Photographic film with magnetic recording track and method of recording on the track and reproduction from the same
US462031818 Apr 198328 Oct 1986Eye-D Development Ii Ltd.Fovea-centered eye fundus scanner
US464271718 Mar 198510 Feb 1987Fuji Photo Optical Co., Ltd.Mechanism for lifting and lowering magnetic head in magnetic recording and reproducing device
US474236928 Jul 19873 May 1988Casio Computer Co., Ltd.Electronic still camera
US490502928 Sep 198827 Feb 1990Kelley Scott AAudio still camera system
US495107926 Jan 198921 Aug 1990Konica Corp.Voice-recognition camera
US49656267 Oct 198823 Oct 1990Eastman Kodak CompanyPrinting and makeover process for magnetically encodable film with dedicated magnetic tracks
US49774197 Oct 198811 Dec 1990Eastman Kodak CompanySelf-clocking encoding/decoding film information exchange system using dedicated magnetic tracks on film
US498399622 May 19908 Jan 1991Casio Computer Co., Ltd.Data recording apparatus for still camera
US499483111 Dec 198919 Feb 1991Beattie Systems, Inc.Floating image camera
US499508613 Sep 198819 Feb 1991Siemens AktiengesellschaftArrangement and procedure for determining the authorization of individuals by verifying their fingerprints
US502363523 Jun 198911 Jun 1991Eastman Kodak CompanyDual film and still video studio portrait system using parallel dedicated magnetic tracks on film
US502528323 Aug 199018 Jun 1991Eastman Kodak CompanyMagnetic recording on film of scene parameters and photofinishing process for use therewith
US502714921 Mar 199025 Jun 1991Konica CorporationVoice-recognition camera
US503112228 Nov 19909 Jul 1991Witty Craig DProcess and apparatus for adding titles, subtitles, and computer-generated images to pre-existing photographic images
US507035518 May 19903 Dec 1991Minolta Camera Kabushiki KaishaCamera system capable of recording information in an external memory
US509727814 Mar 199117 Mar 1992Canon Kabushiki KaishaCamera using a film with a magnetic memory
US50992624 Aug 198924 Mar 1992Minolta Camera Kabushiki KaishaCamera having sound recording function
US510348619 Apr 19907 Apr 1992Grippi Victor JFingerprint/signature synthesis
US512870011 May 19907 Jul 1992Minolta Camera Kabushiki KaishaCamera capable of recording sounds relevant to the photographing
US514231025 Jul 199025 Aug 1992Minolta Camera Kabushiki KaishaPseudo format camera system
US514624924 Jan 19918 Sep 1992Minolta Camera Kabushiki KaishaFilm cartridges, films and cameras adapted for use therewith
US516095217 Apr 19913 Nov 1992Canon Kabushiki KaishaPrint control apparatus
US524537213 Mar 199214 Sep 1993Canon Kabushiki KaishaCamera using a film with a magnetic memory portion with a two-speed film transporting feature
US5247300 *27 Sep 199121 Sep 1993Goldstar Co., Ltd.Automatic audio/video signal combination apparatus
US52670429 Jul 199130 Nov 1993Pioneer Electronic CorporationImage pickup device for automatically recording the location where an image is recorded
US527647219 Nov 19914 Jan 1994Eastman Kodak CompanyPhotographic film still camera system with audio recording
US531323528 Feb 199217 May 1994Minolta Camera Kabushiki KaishaSound playback apparatus capable of playing back sounds relevant to photographs
US533507212 Mar 19932 Aug 1994Minolta Camera Kabushiki KaishaPhotographic system capable of storing information on photographed image data
US541059827 Sep 199425 Apr 1995Electronic Publishing Resources, Inc.Database usage metering and protection system and method
US54267453 Mar 199420 Jun 1995Hitachi, Ltd.Apparatus including a pair of neural networks having disparate functions cooperating to perform instruction recognition
US54936778 Jun 199420 Feb 1996Systems Research & Applications CorporationComputer-implemented process
US549929424 May 199512 Mar 1996The United States Of America As Represented By The Administrator Of The National Aeronautics And Space AdministrationDigital camera with apparatus for authentication of images produced from an image file
US550257624 Aug 199226 Mar 1996Ramsay International CorporationMethod and apparatus for the transmission, storage, and retrieval of documents in an electronic domain
US55066448 Sep 19949 Apr 1996Olympus Optical Co., Ltd.Camera
US551504220 Jan 19957 May 1996Nelson; LorryMethod of monitoring traffic speed and gathering evidence
US551977826 Sep 199421 May 1996Silvio MicaliMethod for enabling users of a cryptosystem to generate and use a private pair key for enciphering communications between the users
US55307591 Feb 199525 Jun 1996International Business Machines CorporationColor correct digital watermarking of images
US554614530 Aug 199413 Aug 1996Eastman Kodak CompanyCamera on-board voice recognition
US556857030 Sep 199422 Oct 1996Eastman Kodak CompanyMethod and apparatus for reducing quantization artifacts in a hierarchical image storage and retrieval system
US55818007 Jun 19953 Dec 1996The Arbitron CompanyMethod and apparatus for automatically identifying a program including a sound signal
US56024585 Oct 199511 Feb 1997Eastman Kodak CompanyRechargeable camera having operational inhibit of a flash unit power storage circuit during recharging
US56171197 Jun 19951 Apr 1997Systems Research & Applications CorporationComputer-implemented process
US562998023 Nov 199413 May 1997Xerox CorporationSystem for controlling the distribution and use of digital works
US563367820 Dec 199527 May 1997Eastman Kodak CompanyElectronic still camera for capturing and categorizing images
US564228531 Jan 199524 Jun 1997Trimble Navigation LimitedOutdoor movie camera GPS-position and time code data-logging for special effects production
US564699021 Sep 19958 Jul 1997Rockwell International CorporationEfficient speakerphone anti-howling system
US564699714 Dec 19948 Jul 1997Barton; James M.Method and apparatus for embedding authentication information within digital data
US565707718 Feb 199312 Aug 1997Deangelis; Douglas J.For recording/displaying a time sequence of bodies crossing a plane
US568245818 Jun 199628 Oct 1997Fuji Photo Film Co., Ltd.Camera for recording shot data on a magnetic recording area of a film
US569210427 Sep 199425 Nov 1997Apple Computer, Inc.Method and apparatus for detecting end points of speech activity
US569222530 Aug 199425 Nov 1997Eastman Kodak CompanyVoice recognition of recorded messages for photographic printers
US57064577 Jun 19956 Jan 1998Hughes ElectronicsImage display and archiving system and method
US571267916 Jan 199027 Jan 1998Coles; Christopher FrancisSecurity system with method for locatable portable electronic camera image transmission to a remote receiver
US57266601 Dec 199510 Mar 1998Purdy; Peter K.Personal data collection and reporting system
US573749128 Jun 19967 Apr 1998Eastman Kodak CompanyElectronic imaging system capable of image capture, local wireless transmission and voice recognition
US57402447 May 199614 Apr 1998Washington UniversityMethod and apparatus for improved fingerprinting and authenticating various magnetic media
US576515213 Oct 19959 Jun 1998Trustees Of Dartmouth CollegeSystem and method for managing copyrighted electronic media
US576749612 May 199516 Jun 1998Symbol Technologies, Inc.System for verifying the authenticity of a manual signature
US576864017 Oct 199616 Jun 1998Konica CorporationCamera having an information recording function
US578685129 Jan 199728 Jul 1998Canon Kabushiki KaishaImaging system for recording or reproducing a photographed image signal or input audio signal as a digital signal
US578718620 Feb 199528 Jul 1998I.D. Tec, S.L.Biometric security process for authenticating identity and credit cards, visas, passports and facial recognition
US579642817 Oct 199418 Aug 1998Hitachi, Ltd.Electronic photography system
US579909228 Feb 199525 Aug 1998Lucent Technologies Inc.Self-verifying identification card
US580600510 May 19968 Sep 1998Ricoh Company, Ltd.Wireless image transfer from a digital still video camera to a networked computer
US581520121 Feb 199629 Sep 1998Ricoh Company, Ltd.Method and system for reading and assembling audio and image information for transfer out of a digital camera
US581928913 May 19976 Oct 1998The Regents Of The University Of CaliforniaData embedding employing degenerate clusters of data having differences less than noise value
US582243217 Jan 199613 Oct 1998The Dice CompanyMethod for human-assisted random key generation and application for digital watermark system
US58288091 Oct 199627 Oct 1998Matsushita Electric Industrial Co., Ltd.Computer-implemented speech and video analysis system
US583566714 Oct 199410 Nov 1998Carnegie Mellon UniversityMethod and apparatus for creating a searchable digital video library and a system and method of using such a library
US58418864 Dec 199624 Nov 1998Digimarc CorporationSecurity system for photographic identification
US584197827 Jul 199524 Nov 1998Digimarc CorporationNetwork linking method using steganographically embedded data objects
US584528131 Jan 19961 Dec 1998Mediadna, Inc.Method and system for managing a data object so as to comply with predetermined conditions for usage
US585703829 Jun 19945 Jan 1999Canon Kabushiki KaishaImage processing apparatus and method for synthesizing first and second image data
US586226016 May 199619 Jan 1999Digimarc CorporationMethods for surveying dissemination of proprietary empirical data
US58728658 Feb 199516 Feb 1999Apple Computer, Inc.Method and system for automatic classification of video images
US588957826 Oct 199330 Mar 1999Eastman Kodak CompanyMethod and apparatus for using film scanning information to determine the type and category of an image
US589290030 Aug 19966 Apr 1999Intertrust Technologies Corp.Systems and methods for secure transaction management and electronic rights protection
US589309528 Mar 19976 Apr 1999Virage, Inc.Similarity engine for content-based retrieval of images
US590714927 Jun 199425 May 1999Polaroid CorporationTo determine access to an event/transaction for a bearer of data holding
US592332723 Apr 199713 Jul 1999Bell-Northern Research Ltd.Scrolling with automatic compression and expansion
US594012120 Feb 199717 Aug 1999Eastman Kodak CompanyHybrid camera system with electronic album control
US594342212 Aug 199624 Aug 1999Intertrust Technologies Corp.Steganographic techniques for securely delivering electronic digital rights management control information over insecure communication channels
US59787733 Oct 19952 Nov 1999Neomedia Technologies, Inc.System and method for using an ordinary article of commerce to access a remote computer
US59918761 Apr 199623 Nov 1999Copyright Clearance Center, Inc.Electronic rights management and authorization system
US599563028 Feb 199730 Nov 1999Dew Engineering And Development LimitedBiometric input with encryption
US6397334 *17 Dec 199828 May 2002International Business Machines CorporationMethod and system for authenticating objects and object data
US6687383 *9 Nov 19993 Feb 2004International Business Machines CorporationSystem and method for coding audio information in images
US7043048 *1 Jun 20009 May 2006Digimarc CorporationCapturing and encoding unique user attributes in media signals
US7778438 *8 Jan 200717 Aug 2010Myport Technologies, Inc.Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
Non-Patent Citations
Reference
1Franks, et al., "An Extension to HTTP: Digest Access Authentication," The Internet Society, Jan. 1997.
2Franks, et al., "HTTP Authentication: Basic and Digest Access Authentication," The Internet Society, Jun. 1999.
3G. Friedman, "The Trustworthy Digital Camera: Restoring Credibility to the Photographic Image," IEEE Transactions on Consumer Electronics, pp. 905-910, vol. 39, No. 4, Nov. 1993.
4H. Krawczyk, RFC 2104 (RFC2104) RFC 2104-HMAC: Keyed-Hashing for Message Authentication https://www.faqs.org/rfcs/rfc2104.htm, Feb. 1997.
5H. Krawczyk, RFC 2104 (RFC2104) RFC 2104—HMAC: Keyed-Hashing for Message Authentication https://www.faqs.org/rfcs/rfc2104.htm, Feb. 1997.
6Stansell, Jr., "Civil GPS from a Future Perspective," Proceedings of the IEEE, Oct. 1983, vol. 71, No. 10; pp. 1187-1192.
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US20100066494 *17 Sep 200918 Mar 2010Martis Dinesh JTest Authorization System
US20100253578 *24 Nov 20087 Oct 2010Mantovani Jose R BNavigation data acquisition and signal post-processing
Classifications
U.S. Classification382/100
International ClassificationG06K9/00
Cooperative ClassificationH04L2209/80, H04L2209/60, H04L9/3271, H04L9/3297, H04L9/3263, G06F17/30244, G06F17/30749, H04N5/76, G06F17/30038
European ClassificationH04L9/32T, G06F17/30U2, G06F17/30E2M, G06F17/30M
Legal Events
DateCodeEventDescription
19 Mar 2013CCCertificate of correction
8 Jan 2013CCCertificate of correction
19 Jun 2012ASAssignment
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MYPORT TECHNOLOGIES, INC.;REEL/FRAME:028401/0717
Owner name: MYPORT IP, INC., TEXAS
Effective date: 20101222
31 Aug 2010ASAssignment
Owner name: MYPORT TECHNOLOGIES, INC., TEXAS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MALONE, MICHAEL F.;REEL/FRAME:024919/0204
Effective date: 20070108