US20050010602A1 - System and method for acquisition of related graphical material in a digital graphics album - Google Patents
System and method for acquisition of related graphical material in a digital graphics album Download PDFInfo
- Publication number
- US20050010602A1 US20050010602A1 US10/910,161 US91016104A US2005010602A1 US 20050010602 A1 US20050010602 A1 US 20050010602A1 US 91016104 A US91016104 A US 91016104A US 2005010602 A1 US2005010602 A1 US 2005010602A1
- Authority
- US
- United States
- Prior art keywords
- keywords
- graphical
- processor
- annotations
- search criteria
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99933—Query processing, i.e. searching
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99933—Query processing, i.e. searching
- Y10S707/99935—Query augmenting and refining, e.g. inexact access
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99941—Database schema or data structure
- Y10S707/99943—Generating database or data structure, e.g. via user interface
Definitions
- the invention relates generally to the field of digital graphics albums, and, more particularly, to the searching, acquisition, and insertion of related digital images and video clips into a digital graphics album.
- a traditional photo album is a place to store photographic prints. Pictures were placed in the album and often times notes and annotations were added to identify pertinent information about the pictures. In recent times, the electronic photo album has been developed to store digital graphic image files much in the same way as the traditional photo album. Eastman Kodak Company has developed digital graphic album applications, such as the Kodak Picture Page software, which allow a user to organize digital graphics images into album pages. Typically, users organize images by dates and times, places, subject and so forth. Such software allows the user to annotate the images by entering text, or other data, describing the image.
- digital graphic materials may come from a user's digital camera. They may also come from scanned photographic prints that are converted to digital format. They may also be created electronically, such as with graphic software or photo editing software.
- private and commercial sources of graphical images include stock photo agencies, and shared photo resources that provide the sharing of images over networks, such as the Internet. User can now access digital graphical images on the Internet and download them into their personal computer. These images can be placed in a digital graphic album and be made an integral part of the album.
- Cameras may have a built in clock which time stamps the images. Some allow entry of textual data that can be associated with the digital images. Some even include a global position systems (GPS) receiver which can mark images with the geographic location of the camera at the time the image is exposed. Some allow for voice annotation. All of these kinds of information can be fed to the digital graphics albuming application to be used to annotate the digital graphics materials.
- GPS global position systems
- An aspect of the subsequent arrangements that a user may make to a photo album is that the user may desire to add additional images to complete the album.
- the sources are many and varied. This presents a problem to the user because the user may know what kind of images are desired, but not know where to obtain such images. For example, suppose a user has returned from a vacation in France and has a collection of images and videos from the vacation. These are placed in the digital graphics album, annotated and arranged. Upon review, the user realizes that there are several images of the user in the vicinity of the Eiffel Tower, but no images of the Tower itself. Or perhaps the user knows that during the vacation, a major news story broke about France, and the users desires a video clip for the album. Through some amount of search, the user may find such digital graphics materials, but such searching is cumbersome and time consuming.
- a method of adding graphical material to a digital graphics album includes specifying reference material in a digital graphics album and extracting annotation data from said reference material. Then, processing the extracted annotation data by a natural language processor to produce search keywords. User directive data is then received and processed by the natural language processor to produce additional keywords. Both the keywords and additional keywords are prioritized followed by querying a graphical material database through a network connection in accordance with the keywords. Then, receiving from the database at least one resultant graphical material and selecting one or more of the resultant graphical material for insertion into the digital graphics album.
- the resultant graphical materials specifying at least one reference graphic material indicative of a desired search result and processing the reference graphical material to produce search criteria that are image content descriptors.
- search criteria that are image content descriptors.
- querying an image content database through a network connection and receiving from the image content database at least one resultant image.
- selecting at least one of the resultant images and inserting the selected resultant image in the digital graphics album.
- the apparatus is a digital graphics albuming system for searching a graphical material database
- the apparatus includes a display, an input device, a network interface, a memory, and a processor coupled to the display, the input device, the network interface and the memory.
- the processor which is inherently a general purpose machine is programmed to implement the forgoing function of the present invention, and, in one illustrative embodiment, the processor is operable to store a digital graphics album in the memory, and the processor is operable to recall a portion of the digital graphics album and display the portion of the digital graphics album on the display.
- the processor is operable to receive a selection of reference material from the input device, and the processor is operable to process this reference material to produce search criteria.
- the processor is operable to couple the search criteria to the network interface and access a graphical material database there through, and thereby enabling a search that returns at least one resultant graphical material.
- the processor is operable to receive at least one resultant graphical material from the network interface, and the processor is operable to display the resultant graphical material on the display and to receive a selection input specifying at least one of the resultant graphical materials from the input device.
- the processor is operable to store the selected resultant graphical material in the memory as a part of the digital graphics album.
- FIG. 1 is a diagram of the apparatus of an illustrative embodiment of the present invention.
- FIG. 2 is a functional block diagram of the software applications in an illustrative embodiment of the present invention.
- FIG. 3 is a diagram of the display when reference material is selected in the digital graphics album.
- FIG. 4 is a diagram of the display when a search is selected in an illustrative embodiment of the present invention.
- FIG. 5 is a diagram of the display requesting user directives for a search in an illustrative embodiment of the present invention.
- FIG. 6 is a diagram of the display when resultant graphical material are displayed in an illustrative embodiment of the present invention.
- FIG. 7 is a diagram of the display of a user menu in an illustrative embodiment of the present invention.
- FIG. 8 is a diagram of the display requesting an refined search in an illustrative embodiment of the present invention.
- FIG. 9 is a page one of three of a flow diagram of an illustrative embodiment of the present invention.
- FIG. 10 is a page two of three of a flow diagram of an illustrative embodiment of the present invention.
- FIG. 11 is a page three of three of a flow diagram of an illustrative embodiment of the present invention.
- FIG. 1 is a diagram of the apparatus of an illustrative embodiment of the present invention.
- the apparatus and methods utilize a computer 2 that has an input device 3 , which is typically a keyboard, but could be other input devices such as a touch screen, character recognition system, mouse, track ball, touch pad, or other human interface device or peripheral.
- the input device 3 is coupled to processing unit 4 which includes a processor, memory, power supply, input/output circuits, mass storage devices and other circuits and devices typically found in a computer.
- the processing unit may be a personal computer, such as an IBM PC compatible personal computer.
- the processing unit 4 is coupled to a display 5 which serves as a video display for visual user interface to the user. Any of the commonly used computer visual display device may be utilized, including, but not limited to, cathode ray tubes, matrix displays, LCD displays, TFT displays, and so forth.
- the processing unit 4 is also coupled to a network interface 6 .
- the network interface 6 is here illustrated as being outside of the processing unit 4 , but could be located inside the processing unit 4 , as well.
- the network interface can be any device, or even a simple conductive circuit, to interface the processing unit 4 to an external network 7 or device.
- This illustrative embodiment illustrates the Internet 7 as the external network, however, the networks utilized could be a private network, an intranet, the Internet, a commercial network, or other network which hosts a database of graphical data.
- Respecting the network interface device 6 this could be a conventional dial-up modem, an ADSL model, an ISDN interface, a cable modem, direct hardwire, a radio modem, an optical modem or any other device suitable for interconnecting the processing unit 4 to an external network 7 , as described previously.
- the present invention relies upon access to a graphical material database 8 as the source of graphical material used to supplement the digital graphics album.
- a graphical material database 8 as the source of graphical material used to supplement the digital graphics album. The requirements of such a database 8 will be more fully discussed hereinafter.
- FIG. 2 is a functional block diagram of the software applications in an illustrative embodiment of the present invention.
- the digital albuming application 10 runs on the processor 4 .
- the digital graphic album search application 12 runs on the same processor 4 . In this illustrative embodiment, the two are shown as running on the same processor 18 .
- It is the image search application 12 in this illustrative embodiment, that executes a portion of the claimed methods in the present invention.
- the image search application communicates to the external graphical material databases. In the first example, it is a digital image database 14 and/or a digital video database 16 . Such a database comprises a number of digital graphical materials that are accessible by a search function.
- the database is a relational database indexed by a plurality of indices.
- the conventional approach to search such a database is to provide one or more prioritized keywords.
- the database responds to such a request with a search result that lists a number of hits.
- resultant graphical materials In the case of a graphical material database, these are called resultant graphical materials.
- databases such as 14 and 16 may use more sophisticated indexing strategies and that any such database would be applicable to the present invention.
- the graphical images may be indexed based on image content descriptors, rather than keywords.
- keywords may describe the circumstances surrounding the image, things such as the who, what, where, when, and why parameters, content descriptors actually describe the data within the digital graphical material.
- Such factors are derived from the image itself and may include a color histogram, texture data, resolution, brightness, contrast and so forth.
- the source of the graphical material databases may be existing databases such as stock photo databases or private databases. Where a stock database is used, the user will be required to pay a copyright fee for access to the graphical materials. This is a basic subscription transaction that is well understood by those skilled in the art.
- the supplier of the albuming software or search software may provide access for users to a database of graphical materials. This could be handled as a subscription or as an incentive to users to purchase the software. It is also foreseeable that public sites will develop for dissemination of graphical materials.
- FIG. 3 is a diagram of the display in which a user specifies reference material in the digital graphics album.
- the display 20 appears on the screen of a personal computer.
- the display 20 has a pull-down menu 24 in this illustrative embodiment.
- the albuming application has multiple album pages 22 that appear on the screen 20 .
- the graphic materials are digital photographs, and the annotation is a brief description of the event in the photograph.
- FIG. 4 is a diagram of the display used when a user initiates a search for additional graphical materials.
- the pull-down menu 24 which is selected by the user to initiate a search.
- the menu allows the user to select an image search 30 or a video search 32 . It would also be reasonable to select a unified search for both digital images and video clips if desired.
- separate graphical material databases are used for digital images and video clips. For this reason, the search is directed to one of two of these sources of digital graphical materials.
- FIG. 5 After the user has initiated a search, the processor of this illustrative embodiment of the present invention processes that reference material to produce search criteria.
- This aspect will be more fully discussed hereinafter, but in this present example, the user has selected three digital images with annotations so the processor extracts the annotation data and processes it to produce a set of search keywords. These keywords establish the criteria of the subsequent search. However, these keywords are augmented in FIG. 5 by the addition of user directives.
- a pop-up display 34 is overlaid on screen 20 and offers a range of options 36 to the users. Since a search may produce very large amounts of relevant search result, the pop-up display 34 also allows the user to limit the number of resultant graphical materials at option 38 . In this example, eighteen resultant graphical materials.
- the options are: MORE IMAGES LIKE THESE which will cause the processor to prioritize and augment the search to produce results similar to the annotation keywords; IMAGES WITH MORE DETAILS which will cause the processor to prioritize and augment the keywords to produce search results producing detailed images similar to those references selected; IMAGES WITH WIDER VIEWS which will cause the processor to prioritize and augment the keywords to produce resultant images with more expansive views; and IMAGES THAT CONTRAST which will cause the processor to prioritize and augment the keywords to produce search results that are in contrast with the selected reference materials.
- Another option is VIDEO CLIP SEARCH in this example, which will cause the processor to direct a search to video clips related to the selected digital images.
- the video clip can be represented by key frames that have been extracted a prior, for content-based matching. It should be understood that the foregoing list is not exhaustive. Other criteria for contouring the search to the user directives can be defined and would be understood by those skilled in the art.
- a text window can be offered for the user to enter additional keywords. In the example of wanting a picture of the Eiffel Tower, the user might merely type in “get me a picture of the Eiffel Tower” and the processor would process this request along with the selected reference materials to search for an image of the Eiffel tower that is consistent the reference graphical materials selected.
- FIG. 6 is a diagram of the display after the database search has been conducted in an illustrative embodiment of the present invention.
- the screen 40 displays a plurality of resultant graphical materials 42 that may have associated annotation data 44 , if the search database offered such information.
- a menu option 46 is present. The user reviews the images to determine if one or more of them are deemed suitable for inclusion into the user's digital photo album. If so, the images are selected and placed in the album. This placement can be by any means, and may include a drag and drop interface for convenience.
- the image resolution may be high and therefore the search may produce initial resultant materials that are lower resolution, or thumbnail, representations of the final image for review. This has the advantage of increasing the speed of the search and reducing the download time of images that may not ultimately be selected. Once an image is selected, based on the thumbnail representation, a full resolution version can be downloaded for inclusion in the album.
- FIG. 7 is a diagram of the display after the search results have been received.
- the screen 40 includes menu 46 which offers a choice 48 to refine the search. The user selects this and the process proceeds to the screen depicted in FIG. 8 .
- the present invention contemplates that an offer to refine the search be presented to the user.
- a pop-up menu 50 offers additional choices 52 . Since another search will be conducted to refine the results, the user is again offered a choice 54 to limit the number resultant graphical materials from the search.
- the user may choose to more narrowly construe the keywords previously produced by selecting IMAGES LIKE SELECTED, or may enter specific keywords to refine the search by selecting KEYWORD. Also, the user may elect to conduct a video clip search by selecting VIDEO CLIP.
- a content search is not based on keywords, but rather on the content of the reference images themselves, sometimes called the visual characteristics. If selected, the processor analyzes the images to produce metrics of the image content which may include a color histogram, textural data, contrast, brightness, geometric information and other data. Details of such a search and cataloging approach can be found in U.S. Pat. No. 5,751,286 to Barber et al.
- the results of the content search are offered to the users in a manner as was previously described.
- FIG. 9 is the first of three figures depicting a flow chart of an illustrative embodiment of the present invention.
- the process begins at step 60 and immediately proceeds to step 62 where the user browses an albuming application and decides that additional graphical materials are needed and therefore selects certain reference material from the album that may be in the form of digital images, video clip key frames, of other graphical materials that may reside in the album.
- the processor extracts the annotation data from the selected reference materials as the initial search will be a keyword search.
- the processor processes the annotation data in accordance with a natural language processing routine.
- Natural language processing routines are known in the art and in this instance are used to extract the who, where, what, why, and when metrics of the annotation data, as these are the kinds of metrics that are useful in association with graphical information in a digital graphics album.
- natural language processing see U.S. Pat. No. 5,963,940 to Liddy et al. For NATURAL LANGUAGE INFORMATION RETRIEVAL SYSTEM AND METHOD; and U.S. Pat. No. 5,590,039 to Ikeda et al.
- the result of the natural language processing is a list of prioritized keywords that are used to drive the search of one or more relational databases.
- the processor inquires as to whether the desired search is a digital image search or a video clip search. If a video clip search is selected, a video search routine is run at step 70 .
- the video clip routine closely parallels the image search routine which will be discussed next. One difference is that a separate data base is searched. Another difference is that the video clip is not reference material in and of itself, it may be annotated so the keyword aspects are the same as with digital image searches. In the video clip circumstance, the video clip is represented by a key frame.
- the processor presents the user directive input screen at step 72 for entry of user directives.
- the processor tests to determine what, if any, user directives have been received. If user directives have been selected, the user directives are processed with the natural language processor at step 76 to produce additional keywords, called directive keywords, in this example. The keywords derived from the annotations and the keywords derived from the directives are prioritized and augmented at step 78 to produce a set of search keywords more closely tailored to the user's intent.
- the processor initiates an image search with the available keywords at step 80 . Process then flows through node 82 in FIG. 9 to node 82 in FIG. 10 .
- the processor initiates the graphical material database search
- the database may be a commercial stock photograph database, or it could be a private database accessible only to users of the present invention. Or, other kinds of database services may evolve to meet the demand for this kind of service.
- the user will have specified the databases beforehand so that the processor identifies the appropriate database and is given a path to access it. Such a path may be an Internet IP address, a uniform resource locator (URL), or any other address in a public or private network.
- a path may be an Internet IP address, a uniform resource locator (URL), or any other address in a public or private network.
- URL uniform resource locator
- the process continues in FIG. 10 , which is page two of three of the flow diagram.
- the database search will typically return a plurality of graphical material which are received by the processor at step 84 . If the images are in reduced resolution, or thumbnail, form, they are present to the user at step 86 where they are displayed on the display for review. Of course, if the images are provided in full resolution form, they are displayed in full resolution form at step 86 .
- step 88 if the user selects one or more graphical materials, and if thumb nails where provided as the search results, then the processor requests full resolution versions of the graphical materials from the database at step 90 .
- the graphical material is then presented to the albuming application at step 92 where it is inserted into the album. If the user selects another graphical material at step 94 , the flow recirculates to step 90 where the download and insertion are reiterated on an image by image basis.
- step 94 the processor inquires with the user as to whether the search results were satisfactory or not at step 96 . If the answer is yes, the process finishes at step 98 . On the other hand, if the search was not satisfactory at step 96 , the process requests further directives from the user at step 100 for use in refining the search. If the user provides additional keywords to this request at step 102 , the flow continues through node 104 back to step 76 in FIG. 9 to reiterate the previously described search procedure, but with the newly added keywords from step 100 . On the other hand, if further keywords were not provided at step 100 , step 102 directs flow through node 106 to step 108 in FIG. 11 .
- the processor test to determine if the user has requested a content search at step 108 . If no content search was requested, the process is finished at step 98 . On the other hand if a content search was requested, flow continues to step 110 where images, or thumbnail images from the album are presented to the user for selection of a reference image or images. At this point, the user is changing the focus of the search from using keywords to describe what is being search for to using existing image content to define what is being searched for.
- the processor obtains a full resolution image at step 114 .
- the user may select an image from the album at step 116 . If no image is selected, the process is finished at step 98 .
- the processor extracts content information at step 118 .
- the process was described hereinbefore.
- the content data is then provided to a database which is indexed by content at step 120 .
- the flow re-circulates to step 84 , through node 82 , where the search results are handled as was previously described.
Abstract
Description
- This is a continuation of application Ser. No. 09/642,534, filed 18 Aug. 2000.
- The invention relates generally to the field of digital graphics albums, and, more particularly, to the searching, acquisition, and insertion of related digital images and video clips into a digital graphics album.
- With the advent of digital imaging in the marketplace, and the broad acceptance of digital cameras, as well as broad utilization of digital images in Internet applications, the volume of commercial and consumer held digital image files has increased dramatically in recent years. Much like the problem of a closet full of shoe boxes of randomly filed photographic prints, in the digital image and graphics environment, there are computer “shoe boxes” full of randomly stored digital graphic images. This leads to problems in locating and categorizing digital graphics files.
- A traditional photo album is a place to store photographic prints. Pictures were placed in the album and often times notes and annotations were added to identify pertinent information about the pictures. In recent times, the electronic photo album has been developed to store digital graphic image files much in the same way as the traditional photo album. Eastman Kodak Company has developed digital graphic album applications, such as the Kodak Picture Page software, which allow a user to organize digital graphics images into album pages. Typically, users organize images by dates and times, places, subject and so forth. Such software allows the user to annotate the images by entering text, or other data, describing the image.
- Traditionally, picture albums contained photographs taken by a user, and perhaps photographs given to them by others. In the digital environment, however, the sources of digital graphic materials is much more diverse. Of course, digital graphic materials may come from a user's digital camera. They may also come from scanned photographic prints that are converted to digital format. They may also be created electronically, such as with graphic software or photo editing software. In addition, there are private and commercial sources of graphical images. These include stock photo agencies, and shared photo resources that provide the sharing of images over networks, such as the Internet. User can now access digital graphical images on the Internet and download them into their personal computer. These images can be placed in a digital graphic album and be made an integral part of the album.
- As a user builds a digital graphic album, there are many choices as to how the images will be organized and annotated. Naturally, digital graphic album software applications allow the user to do this manually. But because of the power of computers and software, software suppliers have added features which make organization of images in digital graphic albums more automated, easier and more flexible. In addition, the kinds of things that can be stored in a digital graphics album has increased. For example, video clips can be placed in the album as well as still images, computer generated graphics, and other digital materials. In the case of a video image, typically a key frame is selected for static display, identifying the video. When a user desires to watch the video, the key frame is selected and this causes the software application to play the video clip.
- Modern camera systems have evolved and some now provide a means of generating annotation data for digital graphic images. Cameras may have a built in clock which time stamps the images. Some allow entry of textual data that can be associated with the digital images. Some even include a global position systems (GPS) receiver which can mark images with the geographic location of the camera at the time the image is exposed. Some allow for voice annotation. All of these kinds of information can be fed to the digital graphics albuming application to be used to annotate the digital graphics materials.
- When the digital graphics materials are added to the digital graphics albuming applications, users can manually add annotation data to the graphics materials. These, combined with the aforementioned automatic annotation materials allow the final, arranged, album to be more rich and full in its context and presentation, which prompts a viewer's memory and greatly expands the enjoyment of viewing such an album. Of course, the arrangement of such a wealth of information can be cumbersome and time consuming. Digital graphics albuming application suppliers have responded by providing features which automatically arrange digital graphics materials within such albums. Kodak Picture Page software is an example of this. The arrangement decisions can be based on the classical indicia, such as time, place, event, and so forth. Much of this information is derived from the annotation materials associated with particular graphical materials. After the graphical material is preliminarily arranged by the software application, the user can make modifications to suit personal tastes.
- An aspect of the subsequent arrangements that a user may make to a photo album is that the user may desire to add additional images to complete the album. As was discussed earlier, the sources are many and varied. This presents a problem to the user because the user may know what kind of images are desired, but not know where to obtain such images. For example, suppose a user has returned from a vacation in France and has a collection of images and videos from the vacation. These are placed in the digital graphics album, annotated and arranged. Upon review, the user realizes that there are several images of the user in the vicinity of the Eiffel Tower, but no images of the Tower itself. Or perhaps the user knows that during the vacation, a major news story broke about France, and the users desires a video clip for the album. Through some amount of search, the user may find such digital graphics materials, but such searching is cumbersome and time consuming.
- Consequently, a need exists in the art for an automatic way of identifying, searching and selecting digital graphical materials for use in supplementing digital graphics albums.
- The need in the art is addressed by the apparatus and methods of the present invention. In an illustrative embodiment of the present invention, a method of adding graphical material to a digital graphics album is disclosed. The method includes specifying reference material in a digital graphics album and extracting annotation data from said reference material. Then, processing the extracted annotation data by a natural language processor to produce search keywords. User directive data is then received and processed by the natural language processor to produce additional keywords. Both the keywords and additional keywords are prioritized followed by querying a graphical material database through a network connection in accordance with the keywords. Then, receiving from the database at least one resultant graphical material and selecting one or more of the resultant graphical material for insertion into the digital graphics album. However, if none of the resultant graphical materials is selected, specifying at least one reference graphic material indicative of a desired search result and processing the reference graphical material to produce search criteria that are image content descriptors. Using the image content descriptors, querying an image content database through a network connection, and receiving from the image content database at least one resultant image. Having received the resultant image or images, selecting at least one of the resultant images, and inserting the selected resultant image in the digital graphics album.
- In addition to the method described above, an illustrative apparatus of the present invention is disclosed. The apparatus is a digital graphics albuming system for searching a graphical material database, and the apparatus includes a display, an input device, a network interface, a memory, and a processor coupled to the display, the input device, the network interface and the memory. The processor, which is inherently a general purpose machine is programmed to implement the forgoing function of the present invention, and, in one illustrative embodiment, the processor is operable to store a digital graphics album in the memory, and the processor is operable to recall a portion of the digital graphics album and display the portion of the digital graphics album on the display. The processor is operable to receive a selection of reference material from the input device, and the processor is operable to process this reference material to produce search criteria. The processor is operable to couple the search criteria to the network interface and access a graphical material database there through, and thereby enabling a search that returns at least one resultant graphical material. The processor is operable to receive at least one resultant graphical material from the network interface, and the processor is operable to display the resultant graphical material on the display and to receive a selection input specifying at least one of the resultant graphical materials from the input device. The processor is operable to store the selected resultant graphical material in the memory as a part of the digital graphics album.
- These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following detailed description of the preferred embodiments and appended claims, and by reference to the accompanying drawings.
-
FIG. 1 is a diagram of the apparatus of an illustrative embodiment of the present invention. -
FIG. 2 is a functional block diagram of the software applications in an illustrative embodiment of the present invention. -
FIG. 3 is a diagram of the display when reference material is selected in the digital graphics album. -
FIG. 4 is a diagram of the display when a search is selected in an illustrative embodiment of the present invention. -
FIG. 5 is a diagram of the display requesting user directives for a search in an illustrative embodiment of the present invention. -
FIG. 6 is a diagram of the display when resultant graphical material are displayed in an illustrative embodiment of the present invention. -
FIG. 7 is a diagram of the display of a user menu in an illustrative embodiment of the present invention. -
FIG. 8 is a diagram of the display requesting an refined search in an illustrative embodiment of the present invention. -
FIG. 9 is a page one of three of a flow diagram of an illustrative embodiment of the present invention. -
FIG. 10 is a page two of three of a flow diagram of an illustrative embodiment of the present invention. -
FIG. 11 is a page three of three of a flow diagram of an illustrative embodiment of the present invention. - While the present invention is described herein with reference to illustrative embodiments for particular applications, it should be understood that the invention is not limited thereto. Those having ordinary skill in the art and access to the teachings provided herein will recognize additional modifications, applications, and embodiments within the scope thereof and additional fields in which the present invention would be of significant utility.
- Reference is directed to
FIG. 1 which is a diagram of the apparatus of an illustrative embodiment of the present invention. The apparatus and methods utilize acomputer 2 that has an input device 3, which is typically a keyboard, but could be other input devices such as a touch screen, character recognition system, mouse, track ball, touch pad, or other human interface device or peripheral. The input device 3 is coupled toprocessing unit 4 which includes a processor, memory, power supply, input/output circuits, mass storage devices and other circuits and devices typically found in a computer. The processing unit may be a personal computer, such as an IBM PC compatible personal computer. Theprocessing unit 4 is coupled to adisplay 5 which serves as a video display for visual user interface to the user. Any of the commonly used computer visual display device may be utilized, including, but not limited to, cathode ray tubes, matrix displays, LCD displays, TFT displays, and so forth. - The
processing unit 4 is also coupled to anetwork interface 6. Thenetwork interface 6 is here illustrated as being outside of theprocessing unit 4, but could be located inside theprocessing unit 4, as well. The network interface can be any device, or even a simple conductive circuit, to interface theprocessing unit 4 to an external network 7 or device. This illustrative embodiment illustrates the Internet 7 as the external network, however, the networks utilized could be a private network, an intranet, the Internet, a commercial network, or other network which hosts a database of graphical data. Respecting thenetwork interface device 6, this could be a conventional dial-up modem, an ADSL model, an ISDN interface, a cable modem, direct hardwire, a radio modem, an optical modem or any other device suitable for interconnecting theprocessing unit 4 to an external network 7, as described previously. - While not a part of this illustrative embodiment, the present invention relies upon access to a
graphical material database 8 as the source of graphical material used to supplement the digital graphics album. The requirements of such adatabase 8 will be more fully discussed hereinafter. - References is directed to
FIG. 2 which is a functional block diagram of the software applications in an illustrative embodiment of the present invention. Thedigital albuming application 10, as was discussed earlier runs on theprocessor 4. In addition, the digital graphicalbum search application 12 runs on thesame processor 4. In this illustrative embodiment, the two are shown as running on thesame processor 18. It is theimage search application 12, in this illustrative embodiment, that executes a portion of the claimed methods in the present invention. The image search application communicates to the external graphical material databases. In the first example, it is adigital image database 14 and/or adigital video database 16. Such a database comprises a number of digital graphical materials that are accessible by a search function. Typically, the database is a relational database indexed by a plurality of indices. The conventional approach to search such a database is to provide one or more prioritized keywords. The database responds to such a request with a search result that lists a number of hits. In the case of a graphical material database, these are called resultant graphical materials. - It is understood by those skilled in the art that databases such as 14 and 16 may use more sophisticated indexing strategies and that any such database would be applicable to the present invention. For example, the graphical images may be indexed based on image content descriptors, rather than keywords. Where keywords may describe the circumstances surrounding the image, things such as the who, what, where, when, and why parameters, content descriptors actually describe the data within the digital graphical material. Such factors are derived from the image itself and may include a color histogram, texture data, resolution, brightness, contrast and so forth.
- The source of the graphical material databases may be existing databases such as stock photo databases or private databases. Where a stock database is used, the user will be required to pay a copyright fee for access to the graphical materials. This is a basic subscription transaction that is well understood by those skilled in the art. In the case of a private database, the supplier of the albuming software or search software may provide access for users to a database of graphical materials. This could be handled as a subscription or as an incentive to users to purchase the software. It is also foreseeable that public sites will develop for dissemination of graphical materials.
- Reference is directed to
FIG. 3 which is a diagram of the display in which a user specifies reference material in the digital graphics album. Thedisplay 20 appears on the screen of a personal computer. Thedisplay 20 has a pull-down menu 24 in this illustrative embodiment. The albuming application hasmultiple album pages 22 that appear on thescreen 20. On the front page, in this example, four graphic materials appear 28 and 26, each of which as someannotation 27 associated therewith. In one illustrative embodiment, if the graphic materials are digital photographs, and the annotation is a brief description of the event in the photograph. - The user reviews the graphic materials and may decide that additional materials would improve the album, especially if the additional materials logically augmented some of the existing materials. The user specifies some of the graphical materials in the album as reference materials by highlighting them as shown 28. By doing this, the user is establishing a reference from which new materials may be searched for and added to the album.
- Reference is directed to
FIG. 4 which is a diagram of the display used when a user initiates a search for additional graphical materials. In thedisplay 20 is the pull-down menu 24, which is selected by the user to initiate a search. The menu, in this illustrative embodiment, allows the user to select animage search 30 or avideo search 32. It would also be reasonable to select a unified search for both digital images and video clips if desired. In this illustrative embodiment of the present invention, separate graphical material databases are used for digital images and video clips. For this reason, the search is directed to one of two of these sources of digital graphical materials. It will be understood by those skilled in the art that a single search could access a plurality of database and that the selection of the search type does not necessarily need to limit the search to a single database. Once the user has selected the search type, the content of the reference graphical materials, which isdigital images 28 and theirrespective annotation 27 in this example, are subsequently used to direct the search to produce results consistent with the user selection. The process of generating keywords and annotation of images is discussed in U.S. Pat. No. 5,493,677 to Balogh et al. For GENERATING, ARCHIVING, AND RETRIEVAL OF DIGITAL IMAGES WITH EVOKED SUGGESTION-SET CAPTIONS AND NATURAL LANGUAGE INTERFACE, the substance of which is hereby incorporated by reference. - Reference is directed to
FIG. 5 . After the user has initiated a search, the processor of this illustrative embodiment of the present invention processes that reference material to produce search criteria. This aspect will be more fully discussed hereinafter, but in this present example, the user has selected three digital images with annotations so the processor extracts the annotation data and processes it to produce a set of search keywords. These keywords establish the criteria of the subsequent search. However, these keywords are augmented inFIG. 5 by the addition of user directives. Essentially, a pop-up display 34 is overlaid onscreen 20 and offers a range ofoptions 36 to the users. Since a search may produce very large amounts of relevant search result, the pop-up display 34 also allows the user to limit the number of resultant graphical materials atoption 38. In this example, eighteen resultant graphical materials. - Considering again the range of
options 36 offered to the user, in this example the options are: MORE IMAGES LIKE THESE which will cause the processor to prioritize and augment the search to produce results similar to the annotation keywords; IMAGES WITH MORE DETAILS which will cause the processor to prioritize and augment the keywords to produce search results producing detailed images similar to those references selected; IMAGES WITH WIDER VIEWS which will cause the processor to prioritize and augment the keywords to produce resultant images with more expansive views; and IMAGES THAT CONTRAST which will cause the processor to prioritize and augment the keywords to produce search results that are in contrast with the selected reference materials. Another option is VIDEO CLIP SEARCH in this example, which will cause the processor to direct a search to video clips related to the selected digital images. In this case, the video clip can be represented by key frames that have been extracted a prior, for content-based matching. It should be understood that the foregoing list is not exhaustive. Other criteria for contouring the search to the user directives can be defined and would be understood by those skilled in the art. In another illustrative embodiment, a text window can be offered for the user to enter additional keywords. In the example of wanting a picture of the Eiffel Tower, the user might merely type in “get me a picture of the Eiffel Tower” and the processor would process this request along with the selected reference materials to search for an image of the Eiffel tower that is consistent the reference graphical materials selected. - Reference is directed to
FIG. 6 which is a diagram of the display after the database search has been conducted in an illustrative embodiment of the present invention. In this example thescreen 40 displays a plurality of resultantgraphical materials 42 that may have associatedannotation data 44, if the search database offered such information. In addition, amenu option 46 is present. The user reviews the images to determine if one or more of them are deemed suitable for inclusion into the user's digital photo album. If so, the images are selected and placed in the album. This placement can be by any means, and may include a drag and drop interface for convenience. - In some applications, the image resolution may be high and therefore the search may produce initial resultant materials that are lower resolution, or thumbnail, representations of the final image for review. This has the advantage of increasing the speed of the search and reducing the download time of images that may not ultimately be selected. Once an image is selected, based on the thumbnail representation, a full resolution version can be downloaded for inclusion in the album.
- Reference is directed to
FIG. 7 which is a diagram of the display after the search results have been received. In this instance, the user has reviewed the resultant graphical materials and determined that none of the images is desirable for inclusion in the album. Thescreen 40 includesmenu 46 which offers achoice 48 to refine the search. The user selects this and the process proceeds to the screen depicted inFIG. 8 . At this point, inFIG. 8 , the present invention contemplates that an offer to refine the search be presented to the user. On top of theprevious screen 40, a pop-upmenu 50 offersadditional choices 52. Since another search will be conducted to refine the results, the user is again offered achoice 54 to limit the number resultant graphical materials from the search. The user may choose to more narrowly construe the keywords previously produced by selecting IMAGES LIKE SELECTED, or may enter specific keywords to refine the search by selecting KEYWORD. Also, the user may elect to conduct a video clip search by selecting VIDEO CLIP. - However, there may be situations where the keyword data is insufficient to produce the results desired by the user. This may be because of insufficient annotation materials, or because the desired results are not easily described by words. In such situations, the user can select that CONTENT SEARCH option in pop-up
menu 50. A content search is not based on keywords, but rather on the content of the reference images themselves, sometimes called the visual characteristics. If selected, the processor analyzes the images to produce metrics of the image content which may include a color histogram, textural data, contrast, brightness, geometric information and other data. Details of such a search and cataloging approach can be found in U.S. Pat. No. 5,751,286 to Barber et al. For IMAGE QUERY SYSTEM AND METHOD, the substance of which is hereby incorporated by reference. This option affords an alternative to the keyword search. It should be understood that the option to conduct a content search may be manually selected, as described in this illustrative embodiment, or may be accomplished automatically by the processor which the initial search results have been otherwise deemed inadequate. - The results of the content search are offered to the users in a manner as was previously described.
- Reference is directed to
FIG. 9 which is the first of three figures depicting a flow chart of an illustrative embodiment of the present invention. The process begins atstep 60 and immediately proceeds to step 62 where the user browses an albuming application and decides that additional graphical materials are needed and therefore selects certain reference material from the album that may be in the form of digital images, video clip key frames, of other graphical materials that may reside in the album. Atstep 64, the processor extracts the annotation data from the selected reference materials as the initial search will be a keyword search. - At
step 66, the processor processes the annotation data in accordance with a natural language processing routine. Natural language processing routines are known in the art and in this instance are used to extract the who, where, what, why, and when metrics of the annotation data, as these are the kinds of metrics that are useful in association with graphical information in a digital graphics album. For a more detailed discussion of natural language processing, see U.S. Pat. No. 5,963,940 to Liddy et al. For NATURAL LANGUAGE INFORMATION RETRIEVAL SYSTEM AND METHOD; and U.S. Pat. No. 5,590,039 to Ikeda et al. for NATURAL LANGUAGE PROCESSING APPARATUS AND METHOD FOR PERFORMING PROCESSING TO ANALYZE THE MEANING OF AN INPUT SENTENCE ENTERED IN THE FORM OF A NATURAL LANGUAGE; and U.S. Pat. No. 6,052,656 to Suda et al. for NATURAL LANGUAGE PROCESSING SYSTEM AND METHOD FOR PROCESSING INPUT INFORMATION BY PREDICTING KIND THEREOF, each of which is hereby incorporated by reference. - The result of the natural language processing is a list of prioritized keywords that are used to drive the search of one or more relational databases. Continuing in
FIG. 9 , atstep 68, the processor inquires as to whether the desired search is a digital image search or a video clip search. If a video clip search is selected, a video search routine is run atstep 70. The video clip routine closely parallels the image search routine which will be discussed next. One difference is that a separate data base is searched. Another difference is that the video clip is not reference material in and of itself, it may be annotated so the keyword aspects are the same as with digital image searches. In the video clip circumstance, the video clip is represented by a key frame. This is a single frame, selected from the numerous frames in the video clip, that is used to represent the video in the album display presentation. Therefore, the video clip routine is not detailed in this figure as it can deduced by those skilled in the art by referring to the image routine. It should also be noted that a search for a digital image and a search for a digital graphic is identical, differing only in the original source of the image information, and not in the storage and retrieval of them. - Continuing in
FIG. 9 , if an image search is selected atstep 68, the processor presents the user directive input screen atstep 72 for entry of user directives. Atstep 74 the processor tests to determine what, if any, user directives have been received. If user directives have been selected, the user directives are processed with the natural language processor atstep 76 to produce additional keywords, called directive keywords, in this example. The keywords derived from the annotations and the keywords derived from the directives are prioritized and augmented atstep 78 to produce a set of search keywords more closely tailored to the user's intent. In the event the user has not entered directives atstep 74, or if there were directives which were processed through to step 78, the processor initiates an image search with the available keywords atstep 80. Process then flows throughnode 82 inFIG. 9 tonode 82 inFIG. 10 . - Referring back to
FIG. 9 , block 80, where the processor initiates the graphical material database search, it should be noted that a decision on what database or databases to search must be made. The user will have control over this aspect of the search in another portion of the present invention, which is not illustrated. The database may be a commercial stock photograph database, or it could be a private database accessible only to users of the present invention. Or, other kinds of database services may evolve to meet the demand for this kind of service. In any event, the user will have specified the databases beforehand so that the processor identifies the appropriate database and is given a path to access it. Such a path may be an Internet IP address, a uniform resource locator (URL), or any other address in a public or private network. - The process continues in
FIG. 10 , which is page two of three of the flow diagram. The database search will typically return a plurality of graphical material which are received by the processor atstep 84. If the images are in reduced resolution, or thumbnail, form, they are present to the user atstep 86 where they are displayed on the display for review. Of course, if the images are provided in full resolution form, they are displayed in full resolution form atstep 86. The user reviews the displayed graphical materials and atstep 88 may select one or more of them for inclusion in the album. - At
step 88, if the user selects one or more graphical materials, and if thumb nails where provided as the search results, then the processor requests full resolution versions of the graphical materials from the database atstep 90. The graphical material is then presented to the albuming application atstep 92 where it is inserted into the album. If the user selects another graphical material atstep 94, the flow recirculates to step 90 where the download and insertion are reiterated on an image by image basis. - Once all of the graphical materials are inserted at
step 94, or if the user failed to select any graphical materials atstep 88, the processor inquires with the user as to whether the search results were satisfactory or not atstep 96. If the answer is yes, the process finishes atstep 98. On the other hand, if the search was not satisfactory atstep 96, the process requests further directives from the user atstep 100 for use in refining the search. If the user provides additional keywords to this request atstep 102, the flow continues throughnode 104 back to step 76 inFIG. 9 to reiterate the previously described search procedure, but with the newly added keywords fromstep 100. On the other hand, if further keywords were not provided atstep 100,step 102 directs flow throughnode 106 to step 108 inFIG. 11 . - Referring to
FIG. 11 , which is page three of three of the flow diagram, the processor test to determine if the user has requested a content search atstep 108. If no content search was requested, the process is finished atstep 98. On the other hand if a content search was requested, flow continues to step 110 where images, or thumbnail images from the album are presented to the user for selection of a reference image or images. At this point, the user is changing the focus of the search from using keywords to describe what is being search for to using existing image content to define what is being searched for. Atstep 112, if the user has selected a thumbnail image, the processor obtains a full resolution image atstep 114. On the other hand, atstep 112, if the user has not selected thumbnail images, the user may select an image from the album atstep 116. If no image is selected, the process is finished atstep 98. - If full images are obtained from the database at
step 114 or if the user selects images from the album atstep 116, the processor extracts content information atstep 118. The process was described hereinbefore. The content data is then provided to a database which is indexed by content atstep 120. Upon receipt of resultant graphical material atstep 120, the flow re-circulates to step 84, throughnode 82, where the search results are handled as was previously described. - Thus, the present invention has been described herein with reference to a particular embodiment for a particular application. Those having ordinary skill in the art and access to the present teachings will recognize additional modifications, applications and embodiments within the scope thereof. For example,
- It is therefore intended by the appended claims to cover any and all such applications, modifications and embodiments within the scope of the present invention.
Claims (60)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/910,161 US20050010602A1 (en) | 2000-08-18 | 2004-08-03 | System and method for acquisition of related graphical material in a digital graphics album |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/642,534 US6813618B1 (en) | 2000-08-18 | 2000-08-18 | System and method for acquisition of related graphical material in a digital graphics album |
US10/910,161 US20050010602A1 (en) | 2000-08-18 | 2004-08-03 | System and method for acquisition of related graphical material in a digital graphics album |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/642,534 Continuation US6813618B1 (en) | 2000-08-18 | 2000-08-18 | System and method for acquisition of related graphical material in a digital graphics album |
Publications (1)
Publication Number | Publication Date |
---|---|
US20050010602A1 true US20050010602A1 (en) | 2005-01-13 |
Family
ID=24576981
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/642,534 Expired - Lifetime US6813618B1 (en) | 2000-08-18 | 2000-08-18 | System and method for acquisition of related graphical material in a digital graphics album |
US10/910,161 Abandoned US20050010602A1 (en) | 2000-08-18 | 2004-08-03 | System and method for acquisition of related graphical material in a digital graphics album |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/642,534 Expired - Lifetime US6813618B1 (en) | 2000-08-18 | 2000-08-18 | System and method for acquisition of related graphical material in a digital graphics album |
Country Status (3)
Country | Link |
---|---|
US (2) | US6813618B1 (en) |
EP (1) | EP1182586A3 (en) |
JP (1) | JP2002163264A (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040175036A1 (en) * | 1997-12-22 | 2004-09-09 | Ricoh Company, Ltd. | Multimedia visualization and integration environment |
US20060155761A1 (en) * | 2003-06-30 | 2006-07-13 | Van De Sluis Bartel M | Enhanced organization and retrieval of digital images |
US20060239591A1 (en) * | 2005-04-18 | 2006-10-26 | Samsung Electronics Co., Ltd. | Method and system for albuming multimedia using albuming hints |
US20070271226A1 (en) * | 2006-05-19 | 2007-11-22 | Microsoft Corporation | Annotation by Search |
US20080256488A1 (en) * | 2005-09-30 | 2008-10-16 | Koninklijke Philips Electronics, N.V. | Method and Apparatus for Enabling Browsing of Images |
US20100250601A1 (en) * | 2008-07-29 | 2010-09-30 | Kazutoyo Takata | Image search device and image search method |
US20110072047A1 (en) * | 2009-09-21 | 2011-03-24 | Microsoft Corporation | Interest Learning from an Image Collection for Advertising |
US20110191211A1 (en) * | 2008-11-26 | 2011-08-04 | Alibaba Group Holding Limited | Image Search Apparatus and Methods Thereof |
US8078618B2 (en) | 2006-01-30 | 2011-12-13 | Eastman Kodak Company | Automatic multimode system for organizing and retrieving content data files |
US20120114241A1 (en) * | 2006-06-29 | 2012-05-10 | Google Inc. | Using extracted image text |
US8559682B2 (en) | 2010-11-09 | 2013-10-15 | Microsoft Corporation | Building a person profile database |
US9239848B2 (en) | 2012-02-06 | 2016-01-19 | Microsoft Technology Licensing, Llc | System and method for semantically annotating images |
US9652444B2 (en) | 2010-05-28 | 2017-05-16 | Microsoft Technology Licensing, Llc | Real-time annotation and enrichment of captured video |
US9678992B2 (en) | 2011-05-18 | 2017-06-13 | Microsoft Technology Licensing, Llc | Text to image translation |
US10043199B2 (en) | 2013-01-30 | 2018-08-07 | Alibaba Group Holding Limited | Method, device and system for publishing merchandise information |
CN113225451A (en) * | 2021-04-28 | 2021-08-06 | 维沃移动通信(杭州)有限公司 | Image processing method and device and electronic equipment |
Families Citing this family (70)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7450734B2 (en) * | 2000-01-13 | 2008-11-11 | Digimarc Corporation | Digital asset management, targeted searching and desktop searching using digital watermarks |
US20020093678A1 (en) * | 2000-10-17 | 2002-07-18 | Skidgel John M. | Managing and searching digital images |
US6950198B1 (en) * | 2000-10-18 | 2005-09-27 | Eastman Kodak Company | Effective transfer of images from a user to a service provider |
KR100449497B1 (en) * | 2000-12-21 | 2004-09-21 | 주식회사 매직아이 | Apparatus and method for providing realtime information |
US7197160B2 (en) | 2001-03-05 | 2007-03-27 | Digimarc Corporation | Geographic information systems using digital watermarks |
US20020143762A1 (en) * | 2001-04-02 | 2002-10-03 | Boyd David W. | Envelope printing feature for photo filing system |
US7360149B2 (en) * | 2001-04-19 | 2008-04-15 | International Business Machines Corporation | Displaying text of video in browsers on a frame by frame basis |
US20030046349A1 (en) * | 2001-08-31 | 2003-03-06 | Burgin Richard A. | Easily exchangeable digital photo album |
TW544634B (en) * | 2001-10-05 | 2003-08-01 | Newsoft Technology Corp | Thumbnail sequence generation system and method |
US7068309B2 (en) * | 2001-10-09 | 2006-06-27 | Microsoft Corp. | Image exchange with image annotation |
JP2003256461A (en) * | 2002-03-04 | 2003-09-12 | Fuji Photo Film Co Ltd | Method and device for retrieving image, and program |
US7213051B2 (en) * | 2002-03-28 | 2007-05-01 | Webex Communications, Inc. | On-line conference recording system |
US7092966B2 (en) * | 2002-09-13 | 2006-08-15 | Eastman Kodak Company | Method software program for creating an image product having predefined criteria |
US20040101156A1 (en) * | 2002-11-22 | 2004-05-27 | Dhiraj Kacker | Image ranking for imaging products and services |
AU2002953384A0 (en) * | 2002-12-16 | 2003-01-09 | Canon Kabushiki Kaisha | Method and apparatus for image metadata entry |
US7970854B2 (en) * | 2003-01-15 | 2011-06-28 | Qurio Holdings, Inc. | Method and system for requesting image prints in an online photosharing system |
US7334186B2 (en) * | 2003-04-30 | 2008-02-19 | Hewlett-Packard Development Company, L.P. | System and method for creation of video annotations |
GB2403824A (en) * | 2003-07-09 | 2005-01-12 | Hewlett Packard Development Co | Data processing system and method |
US20070019072A1 (en) * | 2003-07-28 | 2007-01-25 | The Boeing Company | Apparatus for processing digital images |
US7356778B2 (en) * | 2003-08-20 | 2008-04-08 | Acd Systems Ltd. | Method and system for visualization and operation of multiple content filters |
US7398479B2 (en) * | 2003-08-20 | 2008-07-08 | Acd Systems, Ltd. | Method and system for calendar-based image asset organization |
US7334195B2 (en) * | 2003-10-14 | 2008-02-19 | Microsoft Corporation | System and process for presenting search results in a histogram/cluster format |
US7672986B2 (en) * | 2004-02-12 | 2010-03-02 | Microsoft Corporation | Managing graphic databases |
JP4631359B2 (en) * | 2004-09-02 | 2011-02-16 | パナソニック株式会社 | Playback device |
US8570586B2 (en) * | 2005-05-02 | 2013-10-29 | Digimarc Corporation | Active images through digital watermarking |
US7933972B1 (en) | 2005-09-29 | 2011-04-26 | Qurio Holdings, Inc. | Method and system for organizing categories of content in a distributed network |
US7697827B2 (en) | 2005-10-17 | 2010-04-13 | Konicek Jeffrey C | User-friendlier interfaces for a camera |
JP2007179098A (en) * | 2005-12-26 | 2007-07-12 | Canon Inc | Image processing device, image retrieving method, device, and program |
TWI312945B (en) * | 2006-06-07 | 2009-08-01 | Ind Tech Res Inst | Method and apparatus for multimedia data management |
US20080126191A1 (en) * | 2006-11-08 | 2008-05-29 | Richard Schiavi | System and method for tagging, searching for, and presenting items contained within video media assets |
US9208174B1 (en) * | 2006-11-20 | 2015-12-08 | Disney Enterprises, Inc. | Non-language-based object search |
US20080189591A1 (en) * | 2007-01-31 | 2008-08-07 | Lection David B | Method and system for generating a media presentation |
EP2130144A1 (en) * | 2007-03-21 | 2009-12-09 | Koninklijke Philips Electronics N.V. | Method and apparatus for enabling simultaneous reproduction of a first media item and a second media item |
US20080244373A1 (en) * | 2007-03-26 | 2008-10-02 | Morris Robert P | Methods, systems, and computer program products for automatically creating a media presentation entity using media objects from a plurality of devices |
US9361941B2 (en) * | 2007-08-02 | 2016-06-07 | Scenera Technologies, Llc | Method and systems for arranging a media object in a media timeline |
US20090064008A1 (en) * | 2007-08-31 | 2009-03-05 | Matsushita Electric Industrial Co., Ltd. | User interaction for content based storage and retrieval |
US20090276722A1 (en) * | 2008-04-30 | 2009-11-05 | Jonathan Segel | Method and apparatus for dual mode content searching, selection, delivery, and playout |
JP5043748B2 (en) * | 2008-05-19 | 2012-10-10 | キヤノン株式会社 | CONTENT MANAGEMENT DEVICE, CONTENT MANAGEMENT DEVICE CONTROL METHOD, PROGRAM, AND RECORDING MEDIUM |
US8203725B2 (en) * | 2008-06-05 | 2012-06-19 | Hewlett-Packard Development Company, L.P. | Automatic arrangement of nested images as a function of assigned print modes |
US8854395B2 (en) * | 2009-07-30 | 2014-10-07 | Intellectual Ventures Fund 83 Llc | Method for producing artistic image template designs |
US8212834B2 (en) * | 2009-07-30 | 2012-07-03 | Eastman Kodak Company | Artistic digital template for image display |
US8332427B2 (en) * | 2009-07-30 | 2012-12-11 | Eastman Kodak Company | Method of generating artistic template designs |
US20110029914A1 (en) * | 2009-07-30 | 2011-02-03 | Whitby Laura R | Apparatus for generating artistic image template designs |
US8849853B2 (en) * | 2009-07-30 | 2014-09-30 | Intellectual Ventures Fund 83 Llc | Method for matching artistic attributes of a template and secondary images to a primary image |
US8422794B2 (en) * | 2009-07-30 | 2013-04-16 | Intellectual Ventures Fund 83 Llc | System for matching artistic attributes of secondary image and template to a primary image |
US8345057B2 (en) * | 2009-07-30 | 2013-01-01 | Eastman Kodak Company | Context coordination for an artistic digital template for image display |
US20110029635A1 (en) * | 2009-07-30 | 2011-02-03 | Shkurko Eugene I | Image capture device with artistic template design |
US8274523B2 (en) * | 2009-07-30 | 2012-09-25 | Eastman Kodak Company | Processing digital templates for image display |
US8237819B2 (en) * | 2009-07-30 | 2012-08-07 | Eastman Kodak Company | Image capture method with artistic template design |
US8538986B2 (en) * | 2009-07-30 | 2013-09-17 | Intellectual Ventures Fund 83 Llc | System for coordinating user images in an artistic design |
US8289340B2 (en) * | 2009-07-30 | 2012-10-16 | Eastman Kodak Company | Method of making an artistic digital template for image display |
US20110029562A1 (en) * | 2009-07-30 | 2011-02-03 | Whitby Laura R | Coordinating user images in an artistic design |
US20110029860A1 (en) * | 2009-07-30 | 2011-02-03 | Ptucha Raymond W | Artistic digital template for image display |
US8390648B2 (en) * | 2009-12-29 | 2013-03-05 | Eastman Kodak Company | Display system for personalized consumer goods |
US9253447B2 (en) * | 2009-12-29 | 2016-02-02 | Kodak Alaris Inc. | Method for group interactivity |
US9179102B2 (en) * | 2009-12-29 | 2015-11-03 | Kodak Alaris Inc. | Group display system |
US20110157218A1 (en) * | 2009-12-29 | 2011-06-30 | Ptucha Raymond W | Method for interactive display |
US9319640B2 (en) * | 2009-12-29 | 2016-04-19 | Kodak Alaris Inc. | Camera and display system interactivity |
US20110200093A1 (en) * | 2010-02-15 | 2011-08-18 | Lctank Llc | Method and apparatus for transmitting and receiving video and video links |
US20110313995A1 (en) * | 2010-06-18 | 2011-12-22 | Abraham Lederman | Browser based multilingual federated search |
KR101852815B1 (en) * | 2011-06-21 | 2018-06-04 | 엘지전자 주식회사 | Client and server terminals and method for controlling the same |
US9420121B2 (en) * | 2012-09-28 | 2016-08-16 | Interactive Memories Inc. | Method for tracking theme-based digital assets for clients engaged in image-based project creation through an electronic interface |
US10649619B2 (en) * | 2013-02-21 | 2020-05-12 | Oath Inc. | System and method of using context in selecting a response to user device interaction |
JP2014192795A (en) * | 2013-03-28 | 2014-10-06 | Fujifilm Corp | Electronic album insufficient image retrieval device and method for controlling operation of the same |
JP6107518B2 (en) * | 2013-07-31 | 2017-04-05 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
KR102316846B1 (en) * | 2014-04-09 | 2021-10-25 | 삼성전자 주식회사 | Method for sorting a media content and electronic device implementing the same |
US10445317B2 (en) * | 2014-06-09 | 2019-10-15 | Cognitive Scale, Inc. | Graph query engine for use within a cognitive environment |
US10083162B2 (en) * | 2016-11-28 | 2018-09-25 | Microsoft Technology Licensing, Llc | Constructing a narrative based on a collection of images |
US10963512B2 (en) * | 2017-01-20 | 2021-03-30 | Amazon Technologies, Inc. | Query language interoperability in a graph database |
US10970334B2 (en) * | 2017-07-24 | 2021-04-06 | International Business Machines Corporation | Navigating video scenes using cognitive insights |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5493677A (en) * | 1994-06-08 | 1996-02-20 | Systems Research & Applications Corporation | Generation, archiving, and retrieval of digital images with evoked suggestion-set captions and natural language interface |
US5590039A (en) * | 1989-10-14 | 1996-12-31 | Canon Kabushiki Kaisha | Natural language processing apparatus and method for performing processing to analyze the meaning of an input sentence entered in the form of a natural language |
US5751286A (en) * | 1992-11-09 | 1998-05-12 | International Business Machines Corporation | Image query system and method |
US5963940A (en) * | 1995-08-16 | 1999-10-05 | Syracuse University | Natural language information retrieval system and method |
US6052656A (en) * | 1994-06-21 | 2000-04-18 | Canon Kabushiki Kaisha | Natural language processing system and method for processing input information by predicting kind thereof |
US6085185A (en) * | 1996-07-05 | 2000-07-04 | Hitachi, Ltd. | Retrieval method and system of multimedia database |
US6324545B1 (en) * | 1997-10-15 | 2001-11-27 | Colordesk Ltd. | Personalized photo album |
US6499016B1 (en) * | 2000-02-28 | 2002-12-24 | Flashpoint Technology, Inc. | Automatically storing and presenting digital images using a speech-based command language |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5241671C1 (en) * | 1989-10-26 | 2002-07-02 | Encyclopaedia Britannica Educa | Multimedia search system using a plurality of entry path means which indicate interrelatedness of information |
JP3067966B2 (en) * | 1993-12-06 | 2000-07-24 | 松下電器産業株式会社 | Apparatus and method for retrieving image parts |
US5682524A (en) * | 1995-05-26 | 1997-10-28 | Starfish Software, Inc. | Databank system with methods for efficiently storing non-uniform data records |
JP3763872B2 (en) * | 1996-01-30 | 2006-04-05 | 富士写真フイルム株式会社 | Photo printing method and photo printer |
US6321231B1 (en) * | 1997-08-11 | 2001-11-20 | Marshall, O'toole, Gerstein, Murray & Borun | Data management and order delivery system |
US6307550B1 (en) * | 1998-06-11 | 2001-10-23 | Presenter.Com, Inc. | Extracting photographic images from video |
US6434579B1 (en) * | 1998-08-19 | 2002-08-13 | Eastman Kodak Company | System and method of constructing a photo album |
JP3738631B2 (en) * | 1999-09-27 | 2006-01-25 | 三菱電機株式会社 | Image search system and image search method |
US7415662B2 (en) * | 2000-01-31 | 2008-08-19 | Adobe Systems Incorporated | Digital media management apparatus and methods |
US20010039493A1 (en) * | 2000-04-13 | 2001-11-08 | Pustejovsky James D. | Answering verbal questions using a natural language system |
US6629104B1 (en) * | 2000-11-22 | 2003-09-30 | Eastman Kodak Company | Method for adding personalized metadata to a collection of digital images |
US20020184196A1 (en) * | 2001-06-04 | 2002-12-05 | Lehmeier Michelle R. | System and method for combining voice annotation and recognition search criteria with traditional search criteria into metadata |
US6629100B2 (en) * | 2001-10-01 | 2003-09-30 | Ipac Acquisition Subsidiary I, Llc | Network-based photosharing architecture for search and delivery of private images and metadata |
-
2000
- 2000-08-18 US US09/642,534 patent/US6813618B1/en not_active Expired - Lifetime
-
2001
- 2001-08-06 EP EP01202979A patent/EP1182586A3/en not_active Withdrawn
- 2001-08-16 JP JP2001247296A patent/JP2002163264A/en active Pending
-
2004
- 2004-08-03 US US10/910,161 patent/US20050010602A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5590039A (en) * | 1989-10-14 | 1996-12-31 | Canon Kabushiki Kaisha | Natural language processing apparatus and method for performing processing to analyze the meaning of an input sentence entered in the form of a natural language |
US5751286A (en) * | 1992-11-09 | 1998-05-12 | International Business Machines Corporation | Image query system and method |
US5493677A (en) * | 1994-06-08 | 1996-02-20 | Systems Research & Applications Corporation | Generation, archiving, and retrieval of digital images with evoked suggestion-set captions and natural language interface |
US6052656A (en) * | 1994-06-21 | 2000-04-18 | Canon Kabushiki Kaisha | Natural language processing system and method for processing input information by predicting kind thereof |
US5963940A (en) * | 1995-08-16 | 1999-10-05 | Syracuse University | Natural language information retrieval system and method |
US6085185A (en) * | 1996-07-05 | 2000-07-04 | Hitachi, Ltd. | Retrieval method and system of multimedia database |
US6324545B1 (en) * | 1997-10-15 | 2001-11-27 | Colordesk Ltd. | Personalized photo album |
US6499016B1 (en) * | 2000-02-28 | 2002-12-24 | Flashpoint Technology, Inc. | Automatically storing and presenting digital images using a speech-based command language |
Cited By (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8995767B2 (en) * | 1997-12-22 | 2015-03-31 | Ricoh Company, Ltd. | Multimedia visualization and integration environment |
US20040175036A1 (en) * | 1997-12-22 | 2004-09-09 | Ricoh Company, Ltd. | Multimedia visualization and integration environment |
US20060155761A1 (en) * | 2003-06-30 | 2006-07-13 | Van De Sluis Bartel M | Enhanced organization and retrieval of digital images |
US20060239591A1 (en) * | 2005-04-18 | 2006-10-26 | Samsung Electronics Co., Ltd. | Method and system for albuming multimedia using albuming hints |
US20080256488A1 (en) * | 2005-09-30 | 2008-10-16 | Koninklijke Philips Electronics, N.V. | Method and Apparatus for Enabling Browsing of Images |
US8078618B2 (en) | 2006-01-30 | 2011-12-13 | Eastman Kodak Company | Automatic multimode system for organizing and retrieving content data files |
US20070271226A1 (en) * | 2006-05-19 | 2007-11-22 | Microsoft Corporation | Annotation by Search |
KR101354755B1 (en) | 2006-05-19 | 2014-02-07 | 마이크로소프트 코포레이션 | Annotation by search |
US8341112B2 (en) * | 2006-05-19 | 2012-12-25 | Microsoft Corporation | Annotation by search |
US9760781B2 (en) | 2006-06-29 | 2017-09-12 | Google Inc. | Using extracted image text |
US20120114241A1 (en) * | 2006-06-29 | 2012-05-10 | Google Inc. | Using extracted image text |
US9269013B2 (en) | 2006-06-29 | 2016-02-23 | Google Inc. | Using extracted image text |
US8503782B2 (en) * | 2006-06-29 | 2013-08-06 | Google Inc. | Using extracted image text |
US9881231B2 (en) | 2006-06-29 | 2018-01-30 | Google Llc | Using extracted image text |
US9542612B2 (en) | 2006-06-29 | 2017-01-10 | Google Inc. | Using extracted image text |
US8744173B2 (en) | 2006-06-29 | 2014-06-03 | Google Inc. | Using extracted image text |
US7882112B2 (en) | 2008-07-29 | 2011-02-01 | Panasonic Corporation | Image search device and image search method |
US20100250601A1 (en) * | 2008-07-29 | 2010-09-30 | Kazutoyo Takata | Image search device and image search method |
US9563706B2 (en) | 2008-11-26 | 2017-02-07 | Alibaba Group Holding Limited | Image search apparatus and methods thereof |
US8738630B2 (en) | 2008-11-26 | 2014-05-27 | Alibaba Group Holding Limited | Image search apparatus and methods thereof |
US20110191211A1 (en) * | 2008-11-26 | 2011-08-04 | Alibaba Group Holding Limited | Image Search Apparatus and Methods Thereof |
US20110072047A1 (en) * | 2009-09-21 | 2011-03-24 | Microsoft Corporation | Interest Learning from an Image Collection for Advertising |
US9652444B2 (en) | 2010-05-28 | 2017-05-16 | Microsoft Technology Licensing, Llc | Real-time annotation and enrichment of captured video |
US8559682B2 (en) | 2010-11-09 | 2013-10-15 | Microsoft Corporation | Building a person profile database |
US9678992B2 (en) | 2011-05-18 | 2017-06-13 | Microsoft Technology Licensing, Llc | Text to image translation |
US9239848B2 (en) | 2012-02-06 | 2016-01-19 | Microsoft Technology Licensing, Llc | System and method for semantically annotating images |
US10043199B2 (en) | 2013-01-30 | 2018-08-07 | Alibaba Group Holding Limited | Method, device and system for publishing merchandise information |
CN113225451A (en) * | 2021-04-28 | 2021-08-06 | 维沃移动通信(杭州)有限公司 | Image processing method and device and electronic equipment |
Also Published As
Publication number | Publication date |
---|---|
US6813618B1 (en) | 2004-11-02 |
JP2002163264A (en) | 2002-06-07 |
EP1182586A3 (en) | 2005-11-16 |
EP1182586A2 (en) | 2002-02-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6813618B1 (en) | System and method for acquisition of related graphical material in a digital graphics album | |
US7930647B2 (en) | System and method for selecting pictures for presentation with text content | |
US7028253B1 (en) | Agent for integrated annotation and retrieval of images | |
US8464158B2 (en) | Method and arrangement for sharing information search results | |
JP5353148B2 (en) | Image information retrieving apparatus, image information retrieving method and computer program therefor | |
US7149755B2 (en) | Presenting a collection of media objects | |
KR101175858B1 (en) | System and method of inclusion of interactive elements on a search results page | |
US9396214B2 (en) | User interface for viewing clusters of images | |
US8185826B2 (en) | Rendering document views with supplemental information content | |
US20090148045A1 (en) | Applying image-based contextual advertisements to images | |
US20020038299A1 (en) | Interface for presenting information | |
US8700672B2 (en) | Method of processing tag information and client-server system using the method | |
US20080092051A1 (en) | Method of dynamically creating real time presentations responsive to search expression | |
US20060294476A1 (en) | Browsing and previewing a list of items | |
US20040064455A1 (en) | Software-floating palette for annotation of images that are viewable in a variety of organizational structures | |
US20090254643A1 (en) | System and method for identifying galleries of media objects on a network | |
US20180089228A1 (en) | Interactive image selection method | |
JP2013541793A (en) | Multi-mode search query input method | |
US20080215548A1 (en) | Information search method and system | |
WO2010037591A1 (en) | Interactive image selection method | |
US20130326338A1 (en) | Methods and systems for organizing content using tags and for laying out images | |
US7072878B2 (en) | Data search apparatus and method | |
CA2945627A1 (en) | Method and apparatus for retreiving video content | |
US20090070309A1 (en) | System and method for assisting a user in constructing a search query | |
Mukherjea et al. | Using clustering and visualization for refining the results of a WWW image search engine |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: KODAK REALTY, INC., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: QUALEX INC., NORTH CAROLINA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK AVIATION LEASING LLC, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: FPC INC., CALIFORNIA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: NPEC INC., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK PHILIPPINES, LTD., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK IMAGING NETWORK, INC., CALIFORNIA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: PAKON, INC., INDIANA Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: EASTMAN KODAK INTERNATIONAL CAPITAL COMPANY, INC., Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK AMERICAS, LTD., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK PORTUGUESA LIMITED, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: LASER-PACIFIC MEDIA CORPORATION, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: CREO MANUFACTURING AMERICA LLC, WYOMING Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: EASTMAN KODAK COMPANY, NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 Owner name: KODAK (NEAR EAST), INC., NEW YORK Free format text: PATENT RELEASE;ASSIGNORS:CITICORP NORTH AMERICA, INC.;WILMINGTON TRUST, NATIONAL ASSOCIATION;REEL/FRAME:029913/0001 Effective date: 20130201 |
|
AS | Assignment |
Owner name: MONUMENT PEAK VENTURES, LLC, TEXAS Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:INTELLECTUAL VENTURES FUND 83 LLC;REEL/FRAME:064599/0304 Effective date: 20230728 |