US20010047373A1 - Publication file conversion and display - Google Patents

Publication file conversion and display Download PDF

Info

Publication number
US20010047373A1
US20010047373A1 US09/048,621 US4862198A US2001047373A1 US 20010047373 A1 US20010047373 A1 US 20010047373A1 US 4862198 A US4862198 A US 4862198A US 2001047373 A1 US2001047373 A1 US 2001047373A1
Authority
US
United States
Prior art keywords
text
story
page
publication
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US09/048,621
Other versions
US6415307B2 (en
Inventor
Michael William Dudleston Jones
Nicholas Geen
Mischka Hughes
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Infosis Group Ltd
Original Assignee
Infosis Group Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/329,948 external-priority patent/US5748931A/en
Priority claimed from EP97310368A external-priority patent/EP0926610A1/en
Priority to US09/048,621 priority Critical patent/US6415307B2/en
Application filed by Infosis Group Ltd filed Critical Infosis Group Ltd
Assigned to INFOSIS GROUP LTD. reassignment INFOSIS GROUP LTD. EMPLOYMENT AGREEMENT WITH ASSIGNMENT PROVISION Assignors: JONES, MICHAEL WILLIAM DUDLESTON
Assigned to INFOSIS GROUP LTD. reassignment INFOSIS GROUP LTD. EMPLOYMENT AGREEMENT WITH ASSIGNMENT PROVISION Assignors: GEEN, NICHOLAS
Priority to JP2000525845A priority patent/JP2001527246A/en
Priority to CA002309050A priority patent/CA2309050A1/en
Priority to PCT/IB1998/002145 priority patent/WO1999033009A1/en
Publication of US20010047373A1 publication Critical patent/US20010047373A1/en
Assigned to P2I LIMITED (FORMERLY HAMSARD 2210 LIMITED) reassignment P2I LIMITED (FORMERLY HAMSARD 2210 LIMITED) ASSET PURCHASE AGREEMENT Assignors: INFOSIS GROUP LIMITED
Publication of US6415307B2 publication Critical patent/US6415307B2/en
Application granted granted Critical
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/103Formatting, i.e. changing of presentation of documents
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/103Formatting, i.e. changing of presentation of documents
    • G06F40/106Display of layout of documents; Previewing

Definitions

  • the present invention relates to a method and system for converting digital publications files into digital data, and the use of that data to generate a display on a computer system.
  • aspects of the invention relate to an information display system and more particularly to an information display system which provides for the simultaneous display of a graphical representation of a printed publication, or part of a publication, and text data appearing in the printed publication.
  • a further disadvantage of this method of supplying information is that only text information can be provided. Although this text may be searchable or processable, as opposed to a graphical image or microfiche of the publication, it contains less information than the publication. In particular, editorial information is lost.
  • the foregoing problems of prior art information systems manifest the need for improvement. Specifically, there is a need for an information display system that can make use of information provided in publications such as newspapers and magazines in real time thereby benefiting from the editorial experience of the publishers. Furthermore, since a great deal of information can be obtained from the editorial layout of the publication, the foregoing need can be greatly enhanced by the provision of a simultaneous image of the actual publication together with the actual text in the clear and legible form.
  • the present invention provides a screen based information display system which utilizes both the graphical images of pages of a printed publication as well as its text data.
  • the present invention allows for the simultaneous display of an image of the pages of a publication and text data. It is not sufficient merely to provide a readable image of the pages of the publication as this only provides a microfiche representation. Whereas this allows the user to read the text, it does so at a representational level which does not give the overview perspective. The user “cannot see the wood for the trees”, is a realistic analogy.
  • the purpose of providing a simultaneous image of the publication is to allow the user to interpret the editorial importance that has been attached to articles, thereby allowing the user to benefit from the editorial experience of the publishers, as well as giving immediate access to the edited text.
  • the present invention allows for a user to select a passage of text comprising an article or story on the displayed page of the publication whereby the system of the present invention will simultaneously display the text of the passage adjacent to the image of the full page of the publication. This allows the user to clearly read the article if desired.
  • the text is not clear and therefore it is highly advantageous to provide a clear copy of the text separately.
  • the provision of the text separately also allows for further advantages of the present invention including allowing for identifier words such as company names to be clearly seen e.g. highlighted.
  • the present invention provides for further information on the identifier word e.g. company information to be displayed, by the selection of the identifier word.
  • the further information e.g. company reports, can then be displayed simultaneously with the image of the page of the publication.
  • a further feature of the present invention is that a list of contents of the pages of the publication can be displayed, wherein the list of contents for each page are displayed such that the passages of text (articles or stories) are listed in the order of importance which can be attached to them by the way in which they are formatted on the page of the publication by the editors.
  • the list of contents for the publication provided by the present invention provides for an easy means for the important passages in the publication to be identified by a user. When a particular passage is identified which the user wishes to read, this can be selected and the text displayed along with the image of the page of the publication from which the text is taken.
  • the present invention is particularly applicable to business and financial publications such as newspapers.
  • the London Evening Standard is published five times during a day with the financial information in each publication being updated.
  • Electronic data on each publication can be obtained rapidly from the publisher thereby allowing the information display system of the present invention to be updated rapidly in response to each new edition.
  • the present invention thus removes the need for financial institutions to have to purchase multiple hard copies of the newspaper. Instead, the information can be provided electronically over a network to as many users in the institution as is required. Furthermore, the information provided is in a far more user friendly form than the original hard copy and reaches the user rapidly, even where the publication is printed some distance from the desired user, e.g. overseas.
  • a computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein comprising the steps of: extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files; processing page images from the publication files and maintaining them as page image files; mapping story areas for respective stories appearing in the page images and indexing each story area to a text data file corresponding to the text passage in the story area, and maintaining the mapped story areas as image map files; and generating a display on a computer system of page images using the page image files, and linking the stories in the story areas of the displayed page images to the corresponding text data using the text data files and image map files.
  • a computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein comprising the steps of: extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files; parsing the text data to find predetermined keywords appearing therein, indexing each keyword to a page number and a story number for the story corresponding to the text passage in which the keyword is found, and maintaining the indexed keywords on a keyword list; processing page images from the publication files and maintaining them as page image files; generating a display on a computer system of the keyword list, and displaying the page image containing the story in which a selected keyword appears when the keyword is selected from the keyword list.
  • a computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein comprising the steps of: extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files; processing page images from the publication files and maintaining them as page image files; assigning to each story appearing on a page of the publication a page number on which the story appears, and a story number ranking corresponding to the relative importance of the story to other stories on the page; indexing the text data files to the page numbers and story number rankings for the corresponding stories appearing in the page images of the publication; generating a display on a computer system of a page image using the page image files, and a side-by-side display of a list of story titles for the stories appearing on the displayed page ranked in order of their assigned story number rankings.
  • FIG. 1 illustrates an exemplary embodiment of a system for implementing the present invention
  • FIG. 2 illustrates a display generated during the operation of the system illustrated in FIG. 1;
  • FIG. 3 illustrates another display generated by the system of FIG. 1;
  • FIG. 4 illustrates a further display generated by the system of FIG. 1;
  • FIG. 5 illustrates yet another display generated by the system of FIG. 1;
  • FIG. 6 illustrates a still further display generated by the system of FIG. 1;
  • FIG. 7 illustrates another display generated by the system of FIG. 1.
  • FIG. 8 depicts an overall process flow for converting raw publisher input to simultaneous text/image display of a publication.
  • FIG. 9 a is a flow chart illustrating one method of converting the publication files supplied by the publisher into a data structure.
  • FIG. 9 b is a flow chart of an example of an importance-determining model for ordering a list of stories on a page by relative importance.
  • FIG. 10 illustrates the use of keyword lists to navigate to the text passage and page image containing the keywords.
  • FIG. 11 illustrates the use of image maps to navigate to the text passage on a page image containing the imaged article.
  • FIG. 1 there is illustrated an exemplary embodiment of a system for implementing the present invention.
  • Data is received from the publisher in electronic form by the central storage and processor unit 10 . Whilst it is highly desirable that the data be obtained from the publisher in electronic form, it is not essential to the principle of the present invention. Any means of providing images of the publication and separate text data will suffice.
  • portions of each page of the image which correlate to passages of text are defined and the defined portions are correlated with the passages of text.
  • a list of contents for the passages of text is then generated by selecting the headings from each passage of text and ordering these in order of importance which can be attached to each passage of text by studying the image of the page of the publication. For instance, where an article has the largest heading in the publication of a newspaper, clearly this is the most important story of that page. Similarly, if an article has the smallest heading, this is the least important story on that page and is thus placed at the end of the list of contents for that page. Once the list of contents is generated, this is stored for later assimilation into the invention.
  • a detailed description of an exemplary process for the above is provided in the section below entitled “Ordering Text Passages and Generating A List of Contents”.
  • the image received from the publishers or obtained from the publication requires enhancement of visual quality and therefore in an embodiment of the present invention the received image is sharpened to improve the definition and therefore make it clearer when displayed.
  • a detailed description of an exemplary process for the above is provided in the section below entitled “Enhancing Visual Quality Of Page Images”.
  • the information that is available from the central storage and processing unit 10 is a series of images of pages of the publication, the text corresponding to the articles or passages in the publication, which passages of text have been correlated with the particular portions in the image, a list of contents of the passages of text listed in order of importance for each page, an identifier word index identifying the words e.g. company names in the text for which further information is available, and further information on the identifier words e.g. company prospectuses or statistical information together with real time equity price and other information on the companies within the market price pages of the newspaper.
  • the central storage and processing unit 10 can then communicate the stored information using a communication link 20 a and 20 b to a single user or group of users 30 such as a financial institution.
  • the communication link is a high speed ISDN telephone line.
  • any form of communication can be used such as internet, cable, satellite or radio.
  • each user will be provided with a personal computer or terminal 40 which is connected via a local area network (LAN) to a central processor which is for instance a file server 50 which receives the information via the communication link 20 a and 20 b from the central storage and processing unit 10 .
  • LAN local area network
  • each personal computer or terminal 40 has access to all the information available from the central storage and processing unit 10 at the remote location 60 .
  • the central storage and processing unit temporarily stores the information as a digital data structure before transmission in a memory and each personal computer or terminal 40 stores the information as a digital data structure on reception, in a memory.
  • Each personal computer or terminal 40 comprises a central processor unit 41 , a memory 42 , a display 43 and an input device 44 such as a keyboard and/or a pointing device such as mouse or tracker ball.
  • the software utilized in the personal computers 40 operates on the basis of displayed icons which illustrate and control the running of options.
  • the icons are selectable and operable by a pointing device such as a mouse.
  • Each of the icons forms part of the control item, the other part being a link to a text file, page image file or other displayable information. Selecting the icon activates the control item which uses the link to retrieve and display the displayable information.
  • a cursor movement device such as a mouse and instead any means of inputting selections and commands, e.g. a keyboard falls within the scope of the present invention.
  • FIG. 2 there is disclosed an image which is displayed when the embodiment of FIG. 1 is in operation.
  • On one half of the screen there is a page preview of a page of the publication and the page number (page 33 ) is indicated as well as the title in the top left-hand part of the display.
  • the page number page 33
  • the left-hand part of the screen there is displayed a list of contents for the pages of the publication listed by page number and for each page number the articles are listed in order of importance.
  • the list of contents can be scrolled up or down and the next and previous pages of the publication shown on the page preview on the right-hand side of the display can be selected, although in this Figure there is no previous page since this publication has no pages prior to page 33 .
  • Icons are provided at the top of the screen to allow either the next or previous page image to be viewed.
  • Each icon is part of a control item, the other part being a link to a page image file of the next or previous publication page respectively. Selecting an icon activates the control item which uses the link to retrieve and display the relevant page image file.
  • the display of the list of contents is selectable by selecting the contents option at the top left-hand part of the display by moving the cursor and depressing the mouse button i.e. “clicking” on that icon. This activates a control item and the link to the list of contents file is used to retrieve and display the list of contents. It is also possible to select an article on a page to be displayed by moving the cursor to point out the article listed in the contents and clicking on it. This will activate a control item and the text file will be retrieved via a link to display the text of the article in the left-hand part of the display while in the right-hand part of the display the image of the page on which the article appears will be shown.
  • FIG. 3 in this display the article headed “German cheer for shares and bonds” has been selected by moving the cursor to the portion of the image and clicking on it.
  • the image is then highlighted by coloured border or indicated by a web browser with an “active” icon, e.g., a pointing finger as used in the Netscape NavigatorTM browser, while on the left-hand side of the screen the text of the article is displayed.
  • the text displayed can be scrolled up or down in a conventional manner.
  • At the top left-hand part of the screen icons are provided to allow either the previous or next story to be selected.
  • Each icon is part of a control item, the other part being a link to the text file of previous or next story respectively. Selecting the icon activates the control item which uses the link to retrieve and display the relevant text file.
  • FIG. 3 there is no previous story since the selected story or article is the first of the publication.
  • references to companies are highlighted in the text and a user can select to view further information on that company by moving the cursor to the highlighted text acting as an identifier word and clicking on it.
  • the highlighted text acts as an icon and forms part of a control item, the other part of the control item being a link to further information. Clicking on the identifier word activates the control item and causes the retrieval and display of further information in at least the left-hand part of the screen.
  • Such further information can for example be a company prospectus or company report.
  • FIGS. 2 and 3 also show in a bottom left-hand part of the display that the icon “find” is available.
  • the icon “find” is available.
  • the article in which it appears is displayed in the left-hand part of the display together with the page on which it appears in the right-hand part of the display. The text string within the article is highlighted.
  • the display in this embodiment of the present invention is provided with the ability to select a company index.
  • This is provided for in the bottom left-hand corner of the screen as a “Company” icon.
  • This icon forms part of a control item, the other part being a link to a company index. Selecting the icon activates the control item which uses the link to retrieve and display the company index.
  • the display of FIG. 4 is generated.
  • an index of the companies referred to in the publication is given.
  • text is displayed on the left-hand side in which the first mention of the company name occurs and on the right-hand side of the display there is displayed the associated page of the publication.
  • the index of companies can indicate next to a company name the publication number during the day in which there is a mention of that company. This gives further information on the number of times a company is mentioned in the publications throughtout the day and thus gives an indication on the importance of the activities involving that company.
  • FIG. 5 illustrates a display of financial information in the publication.
  • the financial sector can be selected and under that sector the financial information on the companies can be displayed.
  • the financial information available can be far and above what is available in the publication since further financial information is available and can be obtained from other sources and collated in the central storage and processing unit to make it available to users.
  • this illustrates a further display wherein the text on the left-hand side of the display not only includes highlighted company names but also includes a processed image which originated from the image portion on the page preview on the right-hand side of the display under the heading “Footsie Reels from Iraqi Shockwaves”.
  • the processed image of the graph can be manipulated by the user. Further information over and above what is available from the publication can be included in such processed images. Such further information can be made available from alternative sources and can be combined within the central storage and processor unit 10 .
  • FIG. 7 this illustrates a further display wherein further information over and above what is available in the publication is selected and displayed.
  • the page preview on the right-hand side of the display there is an advert for a computer manufacturer.
  • further information which comprises further advertisement information is displayed in the left-hand side of the display.
  • the software moves out of the current application and into another application containing the required additional information.
  • Such further information can take any form such as graphical, textural and video information, thus allowing the present invention to operate as a multimedia software system.
  • the information display system of the present invention by providing both a graphical image of a publication and the text data, acts as a gateway through the publication into a vast array of further information which can be made available to the user via the central storage and processing unit 10 .
  • FIG. 8 An overall process for converting raw publisher input to simultaneous text/image display of a publication is depicted in FIG. 8.
  • the conversion process includes the steps of extracting text data and related graphic images and processing page images (indicated at blocks 81 , 82 , 83 ) from the publisher's raw input ( 80 ), generating a list of contents ( 84 ) and a list of company names ( 85 ), authoring the simultaneous text/image displays of the publication ( 86 , 87 , 88 , 89 ), and providing the information display system as an output to server/users on a network ( 90 ).
  • the invention is not limited to the described implementation, and may be implemented in any equivalent manner using the disclosed principles of the invention.
  • the information display system requires two basic types of input, text data and images of pages of a publication.
  • the publisher typically provides the new data for an issue of a publication in digital electronic form, for example, as publication files such as Quark XPressTM files or as PDF (Portable Document Format) files used in page makeup systems and readers offered by Adobe Systems, Inc., of Boston, Mass.
  • Text is extracted from the Quark XPressTM or EDF files using the built-in functionality of the page makeup program and classified as data entries for storage and retrieval from a data base as digital text data files.
  • the text of each story has a corresponding digital text data file.
  • the page images can be created from Quark XpressTM files by first producing EPS (encapsulated Postscript) files, or from the PDF files by first converting them into EPS files. Each page image is stored as a digital page image file.
  • the processing of the publication files to create page image files can be automated as described in the section “Enhancing Visual Quality of Page Images”.
  • the publication files are in a format suitable for editing the publication document or printing the publication document.
  • the publication document consists of a number of pages each of which contains one or more stories. Each story has at least a headline and a text portion and may in addition have an associated picture.
  • a representation of each page in the published document is produced from the publication files and stored as digital page image files as described in the section entitled “Enhancing Visual Quality of Page Images”.
  • Each page image file is associated with the page of the publication on which it appears and can be used to reproduce the image of the page on a visual display unit.
  • Each page image file may be a bitmap of one page of the publication.
  • the publication files are also processed to extract from each page, the stories which are on that page and for each of those stories the headline, text portion and any pictures associated with that story. This process of extraction may be achieved in any one of three ways.
  • the publication files contain additional format data which identifies where each story is positioned within each page and where each story starts and ends, where each story's headline starts and ends and the font size of the text used within the headline; where the body of text making up the story starts and ends and the font size of text; and where any picture associated with the story is placed within the page.
  • format data is not observable in the image of the published document but describes or controls the format of the published document.
  • a digital processor operates on the digital publication files to extract this additional format data and to create data files for each story including: a headline text file containing information identifying at least the text content of the headline and the headline font size; a story text file containing the text of the story and information identifying the text font size; a picture file containing information sufficient to reproduce a picture associated with the story such as a bit map image of the picture; a picture position file indicating where the associated picture is placed in relation to the text; and a story position file indicating the limit of the boundary of the story in the page image.
  • a second method can be used in the absence of additional format data in the publication files.
  • format data can be derived from the publication files by a digital processor.
  • the first stage is the determination of the number of separate stories in a page of the publication. This is achieved by using the format used to divide individual stories, which may be lines or blank margins for example, to identify the boundary of each story.
  • the processor having identified the number of stories on the page takes each story in turn, and for each story produces data files including: a story position file, a headline text file, a story text file, and if appropriate a picture file and picture position file.
  • the story position file is produced by identifying the limit of the boundary of the story within the page image.
  • the headline text file is produced by identifying the text within the boundary of the story which has the largest font size.
  • the headline text file stores the text of the headline and information identifying the size of the font.
  • the processor may then assign any remaining text within the body of the story to the story text file and also store information identifying the font size of that text.
  • the processor may then identify pictures within the boundary of the story and create a picture file containing a bit map image of the picture and a picture position file storing information identifying where the picture was positioned within the story. The processor then goes through the same process for each of the stories on the page and for each page within the publication.
  • an operator creates the data files including the headline text file, the story text file, the story position file and any picture files and picture position files by selecting areas of the image of the publication displayed on a visual display unit using a cursor control device.
  • the limit of the boundary of the story in the page image is first selected and this information is stored in the story position file.
  • the operator selects the headline of the story and a headline text file is created which stores text data and information identifying the font size of the text.
  • the operator selects any pictures in the story and the bit mapped image of the picture is stored in a picture file with the positioning of the picture within the story being stored within a picture position file.
  • the digital processor then stores the remaining text within the boundary of the story which has not previously been selected and information identifying the font size of the text in a story text file.
  • a data structure is now produced which interlinks the various components of the publication including the data files and the page image files.
  • a RECORD is created for each story on each page.
  • Each RECORD has a one-to-one correspondence with a story on a page.
  • Each RECORD contains a number of fields which associate the RECORD to the data files and page image files of its corresponding story.
  • the first field is a POINTER to the headline text file of the corresponding story
  • the second field is a POINTER to the story text file of the corresponding story
  • the third field is a POINTER to any picture file associated with the corresponding story
  • the fourth field is a POINTER to the picture position file associated with the corresponding story
  • the fifth field is a POINTER to the story position file of the corresponding story.
  • Each RECORD is indexed by a page number (page_no) and a story number (story_no).
  • page_no a page number
  • story_no a story number
  • the page number indicates the page of the publication on which the corresponding story appears
  • the story number identifies the corresponding story amongst the other stories on that page. Consequently, the combination of story number and page number uniquely identifies each RECORD and its corresponding story.
  • the story number (story_no) is used not only to uniquely identify a story on a page but is also used to indicate the relevant importance of a story in comparison to the other stories on a page.
  • the most important story on a page will be assigned a story number 1 with the value of the story number increasing as the importance of the story diminishes.
  • the story number can be assigned on the basis of operator judgement or by digital processing.
  • Each RECORD contains fields saving POINTERS to data files containing all the information associated with a story.
  • Each of the RECORDS corresponding to the stories on a particular page can be processed to determine the relative importance of the stories on that page.
  • the processor accesses the associated headline text file, the story text file End story position file. From these files, the processor can, in relation to each of the stories, determine the positioning of the stories on the page relative to one another, determine the headline font sizes relative to each other, and determine the story text font sizes relative to each other. On the basis of this information, the processor can order the stories in relative importance.
  • any story that continues from a previous page will be given the highest relative importance and the remaining stories will be rated in dependence upon the font size of their headlines with any two stories having the same font size for the headlines being differentiated on the basis of the position of the story within the page and the font size of the text in the body of the story.
  • the model used to weight the relative importance of the various types of format information will depend upon the particular editorial style of the publication and a different model with different weights applied to the different types of format information can be used for different publications.
  • FIG. 9 b A flow chart of an example of a model suitable for determining the relative importance of a story within a page and creating a list of the stories on a page ordered in terms of their relative importance is shown in FIG. 9 b.
  • the process of creating the data structure includes extracting the data files and page image files and creating records is illustrated in FIG. 9 a and steps 81 , 82 , 83 of FIG. 8.
  • VDU visual display unit
  • the end user will be able to view via the page image files accurate representations of the pages of the publication.
  • the end user will also be able to view the text of each story in a clear form via the story text files.
  • the VDU which the end user is using will have a series of icons on the screen which can be selected by using a pointing device such as a mouse. If an icon is selected the end user is able to navigate through the publication.
  • the digital processor processes the data structure and produces an output in a HTML format suitable for use in an end user's browser software such as Netscape Navigator or Internet ExplorerTM.
  • the processing of the data structure transforms the data structure into a code which, on an end user's machine produces an electronic publication having actuatable control items.
  • the control items comprise a visual symbol on the VDU of the end user's machine, such as a word icon, and a link from the visual symbol to other information. In HTML this may be achieved by creating an anchor and a hyperlink. Actuating the visual symbol using a pointing device accesses the other information and enables its display on the VDU. Consequently, when the code is loaded into a computer by an end user a display as illustrated in FIGS.
  • 2 to 7 is produced having a page preview produced from the page image files, a clear text portion produced from the data files and a number of icons for navigating through the publication produced by processing the data structure.
  • icons include previous/next story icons, previous/next page icons and a contents icon.
  • next/previous page icon allows the end user to move through the pages of the publication. If the next page icon is selected the page image file associated with the page following that being currently viewed is loaded for viewing by the user. If the previous page icon is selected the page image file associated with the previous page of the publication is loaded for viewing by the end user.
  • next/previous story icons allow the end user to navigate through the stories on a particular page. Selecting the next story icon displays, in clear text format, the story with the next, lower level of importance on the page. This is equivalent to accessing the story corresponding to a RECORD having the same page number but with a story number one greater than the RECORD corresponding to the story currently displayed on the screen. Selecting the previous story icon displays, in clear text format, the story with the next, higher level of importance, on the page. This is equivalent to accessing the story corresponding to the RECORD having the same page number but having a story number one less than the story number of the RECORD corresponding to the story currently being viewed.
  • Selection of the table of contents icon displays an ordered list of titles equivalent to ordering the RECORDS firstly according to their associated page number, ordering those RECORDS with the same page number according to their story number, and then accessing through the first field of each RECORD the headline text file for each story and displaying a list of headlines in the same order as the RECORDS. Consequently, a table of contents, as illustrated in FIG. 2, can be produced which illustrates the titles for each page of the publication, ordered in dependence on their relative importance. Each title on the page of the table of contents is an anchor for interactive linking to the story in clear text format and/or page view format.
  • a list of the contents of the publication and a series of links from each of the entries in the list of contents to the relevant page imge file can be generatied using digital processing.
  • Each entry in the list forms part of a control item, the other part being a link to the page image file representing the page on which the headline entry appears.
  • Selection of an entry on the contents list by pointing and clicking the headline entry activates the control item which uses the link to retrieve and display the image of the page on which the headline appears.
  • the contents list can be called up for display on the left side of the screen simultaneously with a page image on the right side of the screen (see FIG. 2), to serve as a guide to users of the contents on the current page and on the preceeding and succeeding pages of the publication.
  • Each entry in the list is a selectable “icon” forming a link to the page on which the entry appears.
  • FIG. 1 An example of a program for generating a contents list is given in Appendix 1.
  • the contents list is generated from the text headlines or subheadings associated with the stories ordered by page numbers and story numbers.
  • the generated headline index file is output for use in generating the simultaneous text/image displays for the given publication (“London Evening Standard Business Day” in this example).
  • the text passages are linked by image maps IMx to the locations A-i of the corresponding stories on the page images.
  • Each of the locations A-i of the story areas on the page images is similar to an icon in that it forms part of a control item, the other part being a link to the corresponding text passage (story).
  • Clicking on a story area activates a control item which uses the link to retrieve and display the text file corresponding to the story in the selected story area.
  • the text passage can be called up for display on the left side of the screen simultaneously with display of the page image with story highlighted on the right side of the screen (see FIG. 3), to allow users to view the text in detail and interact with any linkages therein together with the contextual and editorial cues provided by the page image.
  • Image maps are used so that the story area acts like an icon or selectable button, i.e., a text passage is called up by a user clicking on the story area and the text passage is retrieved in response to its linkage on the associated image map for the page image.
  • the image maps can be created using, for example, mapping software such as one designated Web Map, which is available as shareware and stored as digital image map files.
  • mapping software such as one designated Web Map, which is available as shareware and stored as digital image map files.
  • a rectangle or other shape is overlaid on the processed image by an operator who links the pixels within the shape on the image map template with a page number and story number in the database.
  • The can be done by indexing the text file to the pixel group using a corresponding file naming convention, e.g., a “P1S2” suffix for the text file corresponding to the article area delineated on page #1 as story #2.
  • the text files are read into the database which then stores the coordinates of the pixels contained in the map file with the record for that story. It does this by using the file name to identify the corresponding record in the database, in this case, the text record for page #1, story #2.
  • a field in the database is updated to contain the indexing information.
  • the input data conversion process can include the extraction of other pictures and graphics appearing in the page images which are related to the text passages, or of cartoons, advertisements, and other graphics which may be desirable to display in their own right simultaneously with the page images.
  • the graphics images are extracted from the EPS or PDF files into individual graphics files using standard graphics editing tools, e.g., the Adobe IllustratorTM system.
  • Graphics related to the stories such as a photo of the subject of a story or a headshot of a contributing columnist, are indexed in the database to the stories by page numbers and story numbers.
  • sufficient quality can also be obtained by using “screen dumps” of the page makeup files themselves and separating the bit-mapped components. This can be achieved, for example, using the Adobe PhotoshopTM system.
  • Standalone graphics can be linked to their locations in the page images using a control item and the image mapping described above.
  • story-related graphic images appearing in the page images can be retrieved, manipulated, and displayed on the left side of the screen in a window adjacent to the text passage (see FIG. 6).
  • Standalone graphic images can be called up for display on the left side of the screen by a mouse click, or can be used to trigger an external retrieval process resulting in display of a linked graphics file, such as an advertisement (the “Dell” logo linked to the advertisement in FIG. 7), an externally retrieved output (the up-to-date stock performance graph in FIG. 5), or the display of an associated text passage.
  • the extracted text data, list of contents, image maps, and extracted graphic images are stored in the database along with the processed page images.
  • the database thus contains an ordered, structured, and mapped version of all text and related graphics components linked to their positions in the page images.
  • a list of important identifier words appearing in the pages of the publication can also be generated from the extracted text data.
  • Important identifier words can include the names of companies, important persons, well-known products, media programs, etc., which are reported on in the publication.
  • a list of company names reported on in the publication can be called up for display on the left side of the screen (see FIG. 4).
  • a click or entry of a selected company name will result in a display of the page image and highlighted story in which the company name appears on the right side of the screen, and the corresponding text passage on the left side of the screen (see FIG. 6).
  • display of a text passage with important company names highlighted therein allows a user to click on the highlighted name or word and call up another display of further information on the company.
  • Keywords are often designated in text by the publisher, for example, using specialized type fonts such as using bold font for company names or using italics for author's names or publication references. This designation in the text constitutes format data and provides a convenient way to identify keywords from the publisher's input.
  • company names in the input from the publisher are highlighted by tags for bold type font.
  • a list of company names can be generated using a digital processor to parse the digital text data and extracting the names delimited by the bold tags into a company index file. The company names on the list are then indexed to the page numbers and story numbers where they appear in the page images, as well as by their text positions as delimited by the bold tags in the text passages.
  • Each keyword text position is consequently indexed to a page number and a story number, and a link is formed between the text position and the story (text and/or image) in which the keyword appears.
  • the text position and link form a control item which is activated by clicking on the text position. Activation of the control item causes the story to be retrieved and displayed.
  • Indexing by their text positions allows the company names to be highlighted in the text displays and defined as control items having anchors for interactive linkages to further information during the system authoring stage.
  • the resulting company index file is stored in the database for the simultaneous text/image information display system.
  • the company names may also be added to a company name library list which is cumulated over time. In this manner, extensive keyword lists can be developed, and may be used for alternative methods to automated parsing of keywords.
  • One alternative method for generating the list of important identifier words is to use a digital processor to search for text strings in the extracted digital text data which match entries in stored library lists of known company names, important person names, product names, media names, etc.
  • the library lists can be updated from the electronic files processed and/or by manual input of an operator when a new keyword is recognized.
  • the digital processor adds the names to the keyword list, indexes the names to their page numbers and story numbers indicates the names to the positions of the words in the text passages, and creates a link between the name and the story in which the name appears. Keywords can also be added manually to the keyword list by the operator.
  • the keyword lists serve as a powerful method of navigation to the covering stories in the simultaneous text/image information display system.
  • FIG. 10 illustrates the selection of a keyword in a keyword list to navigate to the text passage and page image containing the keywords.
  • the image maps also provide the ability to navigate among stories on a page and call up the corresponding text passages by clicking on the mapped areas of the stories.
  • the page images are processed by processing the (encapsulated postscript files of the publisher's input files to form 72 dpi bit-mapped page images or any other resolution appropriate to the intended output medium.
  • the Internet usually requires images in GIF (Graphic Interchange Format) where the file sizes are minimized to enhance the speed of download. Optimized palettes are used to also minimize file size and increase visual quality.
  • the image files are manipulated using bit-map processing software, such as Adobe PhotoshopTM or DebabaliserTM software, to produce page images that are visually enhanced and/or data compressed to be acceptable in quality and reasonably small in file size.
  • Scripts can be written to batch process the EPS or PDF files into appropriate page image files in a completely automated process. These scripts call a set of routines commonly used in image manipulation software such as PhotoshopTM or DebabaliserTM software.
  • a typical picture or graphic image would appear somewhere before the main body of text. Its position is indicated in the database by a number which instructs the database to output the link to this item after the appropriate numbered text item. Where a picture/graphic element is desired to be presented within the main body of the text, a convention of “[n]” (number within square brackets) may be used for the graphics number to instruct the output stage of the database to substitute this sequence for the appropriate longer form of the graphics name. This is designed to avoid operator error in miskeying longer sequences of characters than necessary in these manual operations.
  • Linkages to external data sources is typically achieved by linking to a predetermined set of hooks in the database.
  • a share price for a company identified by the keyword indexing process can be obtained using the official company name or stock exchange symbol stored in the database. After looking up the unique identifier name in the database, the system performs a share price lookup procedure with an external data source, and returns the retrieved share price for use in the display system.
  • a software routine in the display system creates a sequence of files containing the desired sequence and style of displays, linkages to both internal and external data, and other interactive functions for the information display system, as illustrated in Appendix 1.
  • the linkages between story areas and related graphic images, text passages, keywords in the text passages, and image maps for the page images defined in the data conversion stage are used to define display buttons, highlighted stories, highlighted words, and linked displays in the display authoring stage.
  • Examples of displays of text passages simultaneously with the page images providing contextual cues for the text passages to the viewer are shown in FIGS. 2 - 6 .
  • the resulting processed files constitute a digital data structure viewable using Web browsing software such as NetscapeTM Navigator or MicrosoftTM Internet Explorer on a file server running server software such as NovellTM Netware, AppleshareTM, or Windows NTTM Server software.
  • the digital data structure can also be uploaded onto a Web server running NetscapeTM Server, MicrosoftTM Information Server, or ApacheTM server software.
  • the created files can be converted to a digital data structure in one of many possible formats and stored in a memory.
  • the Web-viewable files are transmitted from the memory of the processing unit 10 to an intended server using suitable transmission software which first identifies files as either new or unchanged from a previous transmission.
  • the Web-viewable files are stored in a memory in the intended server. If the files are changed, they are compressed into a single file and transmitted over ISDN, PSTN, or leased line to the receiving server. The receiving server unpacks the compressed file into its components and copies them into the appropriate place on the user's server. This approach is used for efficiency where multiple destination types may be required. It does not matter whether the user's server is a true file server or whether it is a Web server.
  • the transmission software can also be configured to compress all data all of the time.
  • Alternate software routines such as the “TAR” function used in the UNIXTM operating system, can be used to combine all files for transmission to a remote server.
  • a simple UNIXTM script can be used to scan for these files and decompress them with the “UNTAR” function and copy them to the appropriate directory.
  • each user is provided with a personal computer linked to a central file server to provide the necessary information.
  • the personal computer can be a Macintosh System 7 with a 256 colour video screen or an IBM (Registered Trade Mark) compatible 486 based computer having at least 8 M Bytes of RAM and a 256 colour video screen.
  • the information display system may also be configured as a server for the Internet to which a universe of users and server nodes may have access.
  • the server database for the information display system of the invention has the display content assembled into formats suitable for the medium to which it is targeted. For example, HTML is usually used where the output medium is the World Wide Web.
  • the database can also process the system output files in other structured formats, for example, the BloombergTM real-time display system.
  • the common principle is that the linkages between text passages, keywords, graphics, and page images are ordered based upon their assigned priorities and/or locations on the page images.
  • the information display system of the present invention may be modified and extended in other ways.
  • the text data are extracted from the publisher's input and maintained in the system database, the text data can be readily searched by any search engine to find target stories, names, and references and to retrieve the publication pages containing them.
  • the processed information in the form of the prioritization of stories by importance and keyword lists can be used to assist with conducting high quality searches with high efficiency.
  • the published issues can be converted to a data resource that is fully accessible and searchable by external users.
  • the processed information obtained in the present invention may also be used in other ways to provide further advantages.
  • the image maps defining the story areas for the page images may be used with the original PDF files to provide the capability for enhanced functions.
  • the image map can be overlaid on the PDF file itself and by a click allow simultaneous viewing of the chosen text similar to the display result described previously.
  • the PDF file can retain zoom capabilities inherent in the file reader software. Clicking on the story area of an image map can be used to trigger an internal process, such as zooming in or out on a page view, or an external process, such as connecting to a related database of supporting information.
  • a mouse roll-over can pull up headlines or captions in a pop-up box.
  • Another possibility is to create a floating window which contains the page image. This could develop into an information tool, taking advantage of push technologies and broadcast methodologies using the JAVA language as its development platform rather than HTML, wherein a click can pull up a simultaneous display of background material in another display window.

Abstract

A computerized information display system extracts text data, lists of keywords, story rankings in order of story importance, and image maps identifying the location of stories from an input of publication files from a publisher. The system can generate a simultaneous display of a page image in which a story appears side-by-side with the text for the story when a particular story is selected, in order to allow a viewer can read the text while referring to the page image for visual cues about the text passage. The viewer can select a story from a displayed list of stories ranked in order of importance relative to other stories appearing on a page. The story rankings are derived based upon comparing one or more story importance indicators: location of the story on the page; size of type font of a headline associated with the story; size of type font associated with the story text; and size of text content for the story. The viewer can navigate to the text for a story on a displayed page by clicking in the story area on the page which is linked by image maps to the corresponding text passage. The viewer can also navigate to a text passage and page image by clicking on a keyword from a list of keywords extracted from the text input from the publisher. These computerized contextual display and image navigation tools allow the viewer a highly interactive experience with the publication. They allow a publication to be converted to electronically viewable form frequently, e.g., several times per day, and in a more user friendly form than the original printed copy.

Description

    FIELD OF THE INVENTION
  • The present invention relates to a method and system for converting digital publications files into digital data, and the use of that data to generate a display on a computer system. Aspects of the invention relate to an information display system and more particularly to an information display system which provides for the simultaneous display of a graphical representation of a printed publication, or part of a publication, and text data appearing in the printed publication. [0001]
  • BACKGROUND TO THE INVENTION
  • In today's society, particularly in the business community, it is a necessity to receive published information as quickly as possible. This is especially important for financial information. Thus, the desire to provide such information in electronic form has expanded rapidly in recent years. [0002]
  • In the United Kingdom, there are a number of suppliers of news information delivered electronically for on-screen or other media consumption. These can be segmented into a number of categories: [0003]
  • (a) an electronic text feed of general and specific news items, and data where the only structure consists of headers detailing news category orders (e.g. Press Assoclation); [0004]
  • (b) an electronic text feed of news items addressing specific market sectors (e.g. Extel Finance); [0005]
  • (c) an electronic text feed (not in real time) providing the textual information contained in previously published material. This information provided for archival and search activity as a primary facility (e.g. FT Profile). [0006]
  • The common component of these information provisions is their emphasis on editorial quantity, leaving the editorial and sub-editorial functions to the consumer. Essentially they are providers of a raw material to be used by the customer base as one of their ingredients for the production of their products, or as data for customers to filter to generate information for their own internal or external use. Thus, with this vast quantity of raw data provision with no relative importance attached to each of the individual news items, the user is forced to sift through irrelevant and/or unimportant information to discover their requirement. Additionally, the feeds are, in general, specifically objective rather than subjective. [0007]
  • A further disadvantage of this method of supplying information is that only text information can be provided. Although this text may be searchable or processable, as opposed to a graphical image or microfiche of the publication, it contains less information than the publication. In particular, editorial information is lost. The foregoing problems of prior art information systems manifest the need for improvement. Specifically, there is a need for an information display system that can make use of information provided in publications such as newspapers and magazines in real time thereby benefiting from the editorial experience of the publishers. Furthermore, since a great deal of information can be obtained from the editorial layout of the publication, the foregoing need can be greatly enhanced by the provision of a simultaneous image of the actual publication together with the actual text in the clear and legible form. [0008]
  • SUMMARY OF THE INVENTION
  • The present invention provides a screen based information display system which utilizes both the graphical images of pages of a printed publication as well as its text data. The present invention allows for the simultaneous display of an image of the pages of a publication and text data. It is not sufficient merely to provide a readable image of the pages of the publication as this only provides a microfiche representation. Whereas this allows the user to read the text, it does so at a representational level which does not give the overview perspective. The user “cannot see the wood for the trees”, is a realistic analogy. The purpose of providing a simultaneous image of the publication is to allow the user to interpret the editorial importance that has been attached to articles, thereby allowing the user to benefit from the editorial experience of the publishers, as well as giving immediate access to the edited text. [0009]
  • The present invention allows for a user to select a passage of text comprising an article or story on the displayed page of the publication whereby the system of the present invention will simultaneously display the text of the passage adjacent to the image of the full page of the publication. This allows the user to clearly read the article if desired. In view of the small size of the image of the page of the publication the text is not clear and therefore it is highly advantageous to provide a clear copy of the text separately. The provision of the text separately also allows for further advantages of the present invention including allowing for identifier words such as company names to be clearly seen e.g. highlighted. The present invention provides for further information on the identifier word e.g. company information to be displayed, by the selection of the identifier word. The further information e.g. company reports, can then be displayed simultaneously with the image of the page of the publication. [0010]
  • A further feature of the present invention is that a list of contents of the pages of the publication can be displayed, wherein the list of contents for each page are displayed such that the passages of text (articles or stories) are listed in the order of importance which can be attached to them by the way in which they are formatted on the page of the publication by the editors. Thus, the list of contents for the publication provided by the present invention provides for an easy means for the important passages in the publication to be identified by a user. When a particular passage is identified which the user wishes to read, this can be selected and the text displayed along with the image of the page of the publication from which the text is taken. [0011]
  • The present invention is particularly applicable to business and financial publications such as newspapers. For example, in the United Kingdom, the London Evening Standard is published five times during a day with the financial information in each publication being updated. Electronic data on each publication can be obtained rapidly from the publisher thereby allowing the information display system of the present invention to be updated rapidly in response to each new edition. The present invention thus removes the need for financial institutions to have to purchase multiple hard copies of the newspaper. Instead, the information can be provided electronically over a network to as many users in the institution as is required. Furthermore, the information provided is in a far more user friendly form than the original hard copy and reaches the user rapidly, even where the publication is printed some distance from the desired user, e.g. overseas. [0012]
  • According to a first embodiment there is provided a computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein, comprising the steps of: extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files; processing page images from the publication files and maintaining them as page image files; mapping story areas for respective stories appearing in the page images and indexing each story area to a text data file corresponding to the text passage in the story area, and maintaining the mapped story areas as image map files; and generating a display on a computer system of page images using the page image files, and linking the stories in the story areas of the displayed page images to the corresponding text data using the text data files and image map files. [0013]
  • According to a second embodiment there is provided a computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein, comprising the steps of: extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files; parsing the text data to find predetermined keywords appearing therein, indexing each keyword to a page number and a story number for the story corresponding to the text passage in which the keyword is found, and maintaining the indexed keywords on a keyword list; processing page images from the publication files and maintaining them as page image files; generating a display on a computer system of the keyword list, and displaying the page image containing the story in which a selected keyword appears when the keyword is selected from the keyword list. [0014]
  • According to a third embodiment there is provided a computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein, comprising the steps of: extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files; processing page images from the publication files and maintaining them as page image files; assigning to each story appearing on a page of the publication a page number on which the story appears, and a story number ranking corresponding to the relative importance of the story to other stories on the page; indexing the text data files to the page numbers and story number rankings for the corresponding stories appearing in the page images of the publication; generating a display on a computer system of a page image using the page image files, and a side-by-side display of a list of story titles for the stories appearing on the displayed page ranked in order of their assigned story number rankings.[0015]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates an exemplary embodiment of a system for implementing the present invention; [0016]
  • FIG. 2 illustrates a display generated during the operation of the system illustrated in FIG. 1; [0017]
  • FIG. 3 illustrates another display generated by the system of FIG. 1; [0018]
  • FIG. 4 illustrates a further display generated by the system of FIG. 1; [0019]
  • FIG. 5 illustrates yet another display generated by the system of FIG. 1; [0020]
  • FIG. 6 illustrates a still further display generated by the system of FIG. 1; [0021]
  • FIG. 7 illustrates another display generated by the system of FIG. 1. [0022]
  • FIG. 8 depicts an overall process flow for converting raw publisher input to simultaneous text/image display of a publication. [0023]
  • FIG. 9[0024] a is a flow chart illustrating one method of converting the publication files supplied by the publisher into a data structure.
  • FIG. 9[0025] b is a flow chart of an example of an importance-determining model for ordering a list of stories on a page by relative importance.
  • FIG. 10 illustrates the use of keyword lists to navigate to the text passage and page image containing the keywords. [0026]
  • FIG. 11 illustrates the use of image maps to navigate to the text passage on a page image containing the imaged article.[0027]
  • DETAILED DESCRIPTION
  • Referring now to the drawings, and initially to FIG. 1, there is illustrated an exemplary embodiment of a system for implementing the present invention. Data is received from the publisher in electronic form by the central storage and [0028] processor unit 10. Whilst it is highly desirable that the data be obtained from the publisher in electronic form, it is not essential to the principle of the present invention. Any means of providing images of the publication and separate text data will suffice.
  • Within the central storage and [0029] processor unit 10, portions of each page of the image which correlate to passages of text are defined and the defined portions are correlated with the passages of text. A list of contents for the passages of text is then generated by selecting the headings from each passage of text and ordering these in order of importance which can be attached to each passage of text by studying the image of the page of the publication. For instance, where an article has the largest heading in the publication of a newspaper, clearly this is the most important story of that page. Similarly, if an article has the smallest heading, this is the least important story on that page and is thus placed at the end of the list of contents for that page. Once the list of contents is generated, this is stored for later assimilation into the invention. A detailed description of an exemplary process for the above is provided in the section below entitled “Ordering Text Passages and Generating A List of Contents”.
  • The image received from the publishers or obtained from the publication requires enhancement of visual quality and therefore in an embodiment of the present invention the received image is sharpened to improve the definition and therefore make it clearer when displayed. A detailed description of an exemplary process for the above is provided in the section below entitled “Enhancing Visual Quality Of Page Images”. [0030]
  • Within the text information there will be certain words such as company names which can serve as identifier words for which the central storage and [0031] processing unit 10 has further information which can be made available to the user. Therefore, the text data which is received from the publisher is searched and compared with known identifier words such as company names. The identified identifier words are then flagged in the text and are also entered into an index which is then stored for later assimilation into the invention. A detailed description of an exemplary process for the above is provided in the section below entitled “Generating a List of Identified Words”.
  • Additionally, within the page images and text information, there will be stock market equity price information from a variety of Stock Exchanges around the world, together with the price movement on those equities. These prices and price movements will be those standing at the time of the publication of the newspaper. Within the central storage and [0032] processing unit 10 there is additional information on many equity companies, including the current real time price of these equities.
  • Therefore, the text data and the images which are received from the publisher is searched and the particular companies used within the publication identified and the further information and real time price data within the central storage and [0033] processing unit 10 can be made available for the user when assimilated into the invention. A detailed description of an exemplary process for the above is provided in the section below entitled “Linking Identified Information With Further Data”.
  • Thus, the information that is available from the central storage and [0034] processing unit 10 is a series of images of pages of the publication, the text corresponding to the articles or passages in the publication, which passages of text have been correlated with the particular portions in the image, a list of contents of the passages of text listed in order of importance for each page, an identifier word index identifying the words e.g. company names in the text for which further information is available, and further information on the identifier words e.g. company prospectuses or statistical information together with real time equity price and other information on the companies within the market price pages of the newspaper.
  • The series of steps to compile this data will be carried out for each publication. Thus, in the case of a newspaper for which there are several publications in a day, this process must be carried out each publication as quickly as possible in order that the information can be made available to users without delay. [0035]
  • The central storage and [0036] processing unit 10 can then communicate the stored information using a communication link 20 a and 20 b to a single user or group of users 30 such as a financial institution. In FIG. 1 the communication link is a high speed ISDN telephone line. However, any form of communication can be used such as internet, cable, satellite or radio. Typically, in such an institution where a plurality of users require information, each user will be provided with a personal computer or terminal 40 which is connected via a local area network (LAN) to a central processor which is for instance a file server 50 which receives the information via the communication link 20 a and 20 b from the central storage and processing unit 10. A detailed description of a specific implementation for the above is provided in the section below entitled “Output Of Information System Displays To Users”.
  • Thus, each personal computer or terminal [0037] 40 has access to all the information available from the central storage and processing unit 10 at the remote location 60. The central storage and processing unit temporarily stores the information as a digital data structure before transmission in a memory and each personal computer or terminal 40 stores the information as a digital data structure on reception, in a memory. Each personal computer or terminal 40 comprises a central processor unit 41, a memory 42, a display 43 and an input device 44 such as a keyboard and/or a pointing device such as mouse or tracker ball.
  • In order to make the interface of the computer system with the user as easy as possible, according to one embodiment of the present invention, the software utilized in the [0038] personal computers 40 operates on the basis of displayed icons which illustrate and control the running of options. The icons are selectable and operable by a pointing device such as a mouse. Each of the icons forms part of the control item, the other part being a link to a text file, page image file or other displayable information. Selecting the icon activates the control item which uses the link to retrieve and display the displayable information. However, the present invention is not limited to the use of a cursor movement device such as a mouse and instead any means of inputting selections and commands, e.g. a keyboard falls within the scope of the present invention.
  • Referring now to FIG. 2, there is disclosed an image which is displayed when the embodiment of FIG. 1 is in operation. On one half of the screen there is a page preview of a page of the publication and the page number (page [0039] 33) is indicated as well as the title in the top left-hand part of the display. In the left-hand part of the screen there is displayed a list of contents for the pages of the publication listed by page number and for each page number the articles are listed in order of importance. The list of contents can be scrolled up or down and the next and previous pages of the publication shown on the page preview on the right-hand side of the display can be selected, although in this Figure there is no previous page since this publication has no pages prior to page 33. Icons are provided at the top of the screen to allow either the next or previous page image to be viewed. Each icon is part of a control item, the other part being a link to a page image file of the next or previous publication page respectively. Selecting an icon activates the control item which uses the link to retrieve and display the relevant page image file. The display of the list of contents is selectable by selecting the contents option at the top left-hand part of the display by moving the cursor and depressing the mouse button i.e. “clicking” on that icon. This activates a control item and the link to the list of contents file is used to retrieve and display the list of contents. It is also possible to select an article on a page to be displayed by moving the cursor to point out the article listed in the contents and clicking on it. This will activate a control item and the text file will be retrieved via a link to display the text of the article in the left-hand part of the display while in the right-hand part of the display the image of the page on which the article appears will be shown.
  • Referring now to FIG. 3, in this display the article headed “German cheer for shares and bonds” has been selected by moving the cursor to the portion of the image and clicking on it. The image is then highlighted by coloured border or indicated by a web browser with an “active” icon, e.g., a pointing finger as used in the Netscape Navigator™ browser, while on the left-hand side of the screen the text of the article is displayed. The text displayed can be scrolled up or down in a conventional manner. At the top left-hand part of the screen icons are provided to allow either the previous or next story to be selected. Each icon is part of a control item, the other part being a link to the text file of previous or next story respectively. Selecting the icon activates the control item which uses the link to retrieve and display the relevant text file. In the display of FIG. 3 there is no previous story since the selected story or article is the first of the publication. [0040]
  • Within the story or article there may appear references to companies. When such references occur, these are highlighted in the text and a user can select to view further information on that company by moving the cursor to the highlighted text acting as an identifier word and clicking on it. The highlighted text (identifier word) acts as an icon and forms part of a control item, the other part of the control item being a link to further information. Clicking on the identifier word activates the control item and causes the retrieval and display of further information in at least the left-hand part of the screen. Such further information can for example be a company prospectus or company report. [0041]
  • FIGS. 2 and 3 also show in a bottom left-hand part of the display that the icon “find” is available. Next to this, it is possible to enter a string of text which the user wishes to find within the text of the publication, once the text string is entered in the string entry field and the “find” icon is activated. Once the text string is found within the text, the article in which it appears is displayed in the left-hand part of the display together with the page on which it appears in the right-hand part of the display. The text string within the article is highlighted. [0042]
  • The display in this embodiment of the present invention is provided with the ability to select a company index. This is provided for in the bottom left-hand corner of the screen as a “Company” icon. This icon forms part of a control item, the other part being a link to a company index. Selecting the icon activates the control item which uses the link to retrieve and display the company index. When the icon is selected, the display of FIG. 4 is generated. In FIG. 4 in the left-hand half of the screen, an index of the companies referred to in the publication is given. By moving the cursor to a particular company name and clicking on it, text is displayed on the left-hand side in which the first mention of the company name occurs and on the right-hand side of the display there is displayed the associated page of the publication. Where there are a number of publications per day, the index of companies can indicate next to a company name the publication number during the day in which there is a mention of that company. This gives further information on the number of times a company is mentioned in the publications throughtout the day and thus gives an indication on the importance of the activities involving that company. [0043]
  • FIG. 5 illustrates a display of financial information in the publication. In the page of the publication the financial sector can be selected and under that sector the financial information on the companies can be displayed. The financial information available can be far and above what is available in the publication since further financial information is available and can be obtained from other sources and collated in the central storage and processing unit to make it available to users. [0044]
  • Referring now to FIG. 6, this illustrates a further display wherein the text on the left-hand side of the display not only includes highlighted company names but also includes a processed image which originated from the image portion on the page preview on the right-hand side of the display under the heading “Footsie Reels from Iraqi Shockwaves”. The processed image of the graph can be manipulated by the user. Further information over and above what is available from the publication can be included in such processed images. Such further information can be made available from alternative sources and can be combined within the central storage and [0045] processor unit 10.
  • Referring now to FIG. 7, this illustrates a further display wherein further information over and above what is available in the publication is selected and displayed. In the page preview on the right-hand side of the display there is an advert for a computer manufacturer. When the cursor is moved to this portion of the image and clicked on, further information which comprises further advertisement information is displayed in the left-hand side of the display. [0046]
  • When the option of requesting further information is selected, the software moves out of the current application and into another application containing the required additional information. Such further information can take any form such as graphical, textural and video information, thus allowing the present invention to operate as a multimedia software system. Thus, the information display system of the present invention, by providing both a graphical image of a publication and the text data, acts as a gateway through the publication into a vast array of further information which can be made available to the user via the central storage and [0047] processing unit 10.
  • A specific implementation of the information display system of the present invention is described in detail below for a given example of an electronic publication. For the described implementation, an overall process for converting raw publisher input to simultaneous text/image display of a publication is depicted in FIG. 8. The conversion process includes the steps of extracting text data and related graphic images and processing page images (indicated at [0048] blocks 81, 82, 83) from the publisher's raw input (80), generating a list of contents (84) and a list of company names (85), authoring the simultaneous text/image displays of the publication (86, 87, 88, 89), and providing the information display system as an output to server/users on a network (90). It is to be understood that the invention is not limited to the described implementation, and may be implemented in any equivalent manner using the disclosed principles of the invention.
  • Ordering Text Passages and Generating a List of Contents [0049]
  • The information display system requires two basic types of input, text data and images of pages of a publication. The publisher typically provides the new data for an issue of a publication in digital electronic form, for example, as publication files such as Quark XPress™ files or as PDF (Portable Document Format) files used in page makeup systems and readers offered by Adobe Systems, Inc., of Boston, Mass. Text is extracted from the Quark XPress™ or EDF files using the built-in functionality of the page makeup program and classified as data entries for storage and retrieval from a data base as digital text data files. The text of each story has a corresponding digital text data file. The page images can be created from Quark Xpress™ files by first producing EPS (encapsulated Postscript) files, or from the PDF files by first converting them into EPS files. Each page image is stored as a digital page image file. The processing of the publication files to create page image files can be automated as described in the section “Enhancing Visual Quality of Page Images”. [0050]
  • The publication files are in a format suitable for editing the publication document or printing the publication document. The publication document consists of a number of pages each of which contains one or more stories. Each story has at least a headline and a text portion and may in addition have an associated picture. A representation of each page in the published document is produced from the publication files and stored as digital page image files as described in the section entitled “Enhancing Visual Quality of Page Images”. Each page image file is associated with the page of the publication on which it appears and can be used to reproduce the image of the page on a visual display unit. Each page image file may be a bitmap of one page of the publication. The publication files are also processed to extract from each page, the stories which are on that page and for each of those stories the headline, text portion and any pictures associated with that story. This process of extraction may be achieved in any one of three ways. [0051]
  • According to a first method, the publication files contain additional format data which identifies where each story is positioned within each page and where each story starts and ends, where each story's headline starts and ends and the font size of the text used within the headline; where the body of text making up the story starts and ends and the font size of text; and where any picture associated with the story is placed within the page. Such format data is not observable in the image of the published document but describes or controls the format of the published document. A digital processor operates on the digital publication files to extract this additional format data and to create data files for each story including: a headline text file containing information identifying at least the text content of the headline and the headline font size; a story text file containing the text of the story and information identifying the text font size; a picture file containing information sufficient to reproduce a picture associated with the story such as a bit map image of the picture; a picture position file indicating where the associated picture is placed in relation to the text; and a story position file indicating the limit of the boundary of the story in the page image. [0052]
  • A second method can be used in the absence of additional format data in the publication files. In this method, format data can be derived from the publication files by a digital processor. The first stage is the determination of the number of separate stories in a page of the publication. This is achieved by using the format used to divide individual stories, which may be lines or blank margins for example, to identify the boundary of each story. The processor having identified the number of stories on the page takes each story in turn, and for each story produces data files including: a story position file, a headline text file, a story text file, and if appropriate a picture file and picture position file. The story position file is produced by identifying the limit of the boundary of the story within the page image. The headline text file is produced by identifying the text within the boundary of the story which has the largest font size. The headline text file stores the text of the headline and information identifying the size of the font. The processor may then assign any remaining text within the body of the story to the story text file and also store information identifying the font size of that text. The processor may then identify pictures within the boundary of the story and create a picture file containing a bit map image of the picture and a picture position file storing information identifying where the picture was positioned within the story. The processor then goes through the same process for each of the stories on the page and for each page within the publication. [0053]
  • According to a third method, an operator creates the data files including the headline text file, the story text file, the story position file and any picture files and picture position files by selecting areas of the image of the publication displayed on a visual display unit using a cursor control device. The limit of the boundary of the story in the page image is first selected and this information is stored in the story position file. The operator then selects the headline of the story and a headline text file is created which stores text data and information identifying the font size of the text. The operator then selects any pictures in the story and the bit mapped image of the picture is stored in a picture file with the positioning of the picture within the story being stored within a picture position file. The digital processor then stores the remaining text within the boundary of the story which has not previously been selected and information identifying the font size of the text in a story text file. [0054]
  • A data structure is now produced which interlinks the various components of the publication including the data files and the page image files. A RECORD is created for each story on each page. Each RECORD has a one-to-one correspondence with a story on a page. Each RECORD contains a number of fields which associate the RECORD to the data files and page image files of its corresponding story. The first field is a POINTER to the headline text file of the corresponding story, the second field is a POINTER to the story text file of the corresponding story, the third field is a POINTER to any picture file associated with the corresponding story, the fourth field is a POINTER to the picture position file associated with the corresponding story and the fifth field is a POINTER to the story position file of the corresponding story. Consequently, the digital processor parses the publication into pages thence into stories and each story into its component items such as headlines, text portions and pictures. It produces a data structure consisting of a plurality of data files, page image files and RECORDS which interlinks the components of the publication, and from which the publication can be recreated in different electronic formats. [0055]
  • The RECORDS are now indexed. Each RECORD is indexed by a page number (page_no) and a story number (story_no). For a particular RECORD, the page number indicates the page of the publication on which the corresponding story appears, and the story number identifies the corresponding story amongst the other stories on that page. Consequently, the combination of story number and page number uniquely identifies each RECORD and its corresponding story. The story number (story_no) is used not only to uniquely identify a story on a page but is also used to indicate the relevant importance of a story in comparison to the other stories on a page. The most important story on a page will be assigned a [0056] story number 1 with the value of the story number increasing as the importance of the story diminishes.
  • The story number can be assigned on the basis of operator judgement or by digital processing. Each RECORD contains fields saving POINTERS to data files containing all the information associated with a story. Each of the RECORDS corresponding to the stories on a particular page can be processed to determine the relative importance of the stories on that page. For each of the RECORDS, the processor accesses the associated headline text file, the story text file End story position file. From these files, the processor can, in relation to each of the stories, determine the positioning of the stories on the page relative to one another, determine the headline font sizes relative to each other, and determine the story text font sizes relative to each other. On the basis of this information, the processor can order the stories in relative importance. Generally, any story that continues from a previous page will be given the highest relative importance and the remaining stories will be rated in dependence upon the font size of their headlines with any two stories having the same font size for the headlines being differentiated on the basis of the position of the story within the page and the font size of the text in the body of the story. It will be appreciated that the model used to weight the relative importance of the various types of format information will depend upon the particular editorial style of the publication and a different model with different weights applied to the different types of format information can be used for different publications. A flow chart of an example of a model suitable for determining the relative importance of a story within a page and creating a list of the stories on a page ordered in terms of their relative importance is shown in FIG. 9[0057] b.
  • The process of creating the data structure includes extracting the data files and page image files and creating records is illustrated in FIG. 9[0058] a and steps 81, 82, 83 of FIG. 8.
  • Once all the stories have been indexed through RECORDS the data structure is processed by means of a digital processor to produce output files, or an output signal which can be used by an end user to access the information stored within the data structure and hence within the publication and display that information on a visual display unit (VDU). The end user will be able to view via the page image files accurate representations of the pages of the publication. The end user will also be able to view the text of each story in a clear form via the story text files. In addition the VDU which the end user is using will have a series of icons on the screen which can be selected by using a pointing device such as a mouse. If an icon is selected the end user is able to navigate through the publication. [0059]
  • According to one example the digital processor processes the data structure and produces an output in a HTML format suitable for use in an end user's browser software such as Netscape Navigator or Internet Explorer™. The processing of the data structure transforms the data structure into a code which, on an end user's machine produces an electronic publication having actuatable control items. The control items comprise a visual symbol on the VDU of the end user's machine, such as a word icon, and a link from the visual symbol to other information. In HTML this may be achieved by creating an anchor and a hyperlink. Actuating the visual symbol using a pointing device accesses the other information and enables its display on the VDU. Consequently, when the code is loaded into a computer by an end user a display as illustrated in FIGS. [0060] 2 to 7 is produced having a page preview produced from the page image files, a clear text portion produced from the data files and a number of icons for navigating through the publication produced by processing the data structure. These icons include previous/next story icons, previous/next page icons and a contents icon.
  • The next/previous page icon allows the end user to move through the pages of the publication. If the next page icon is selected the page image file associated with the page following that being currently viewed is loaded for viewing by the user. If the previous page icon is selected the page image file associated with the previous page of the publication is loaded for viewing by the end user. [0061]
  • The next/previous story icons allow the end user to navigate through the stories on a particular page. Selecting the next story icon displays, in clear text format, the story with the next, lower level of importance on the page. This is equivalent to accessing the story corresponding to a RECORD having the same page number but with a story number one greater than the RECORD corresponding to the story currently displayed on the screen. Selecting the previous story icon displays, in clear text format, the story with the next, higher level of importance, on the page. This is equivalent to accessing the story corresponding to the RECORD having the same page number but having a story number one less than the story number of the RECORD corresponding to the story currently being viewed. [0062]
  • Selection of the table of contents icon displays an ordered list of titles equivalent to ordering the RECORDS firstly according to their associated page number, ordering those RECORDS with the same page number according to their story number, and then accessing through the first field of each RECORD the headline text file for each story and displaying a list of headlines in the same order as the RECORDS. Consequently, a table of contents, as illustrated in FIG. 2, can be produced which illustrates the titles for each page of the publication, ordered in dependence on their relative importance. Each title on the page of the table of contents is an anchor for interactive linking to the story in clear text format and/or page view format. [0063]
  • When a particular page image file is loaded, it is possible for the end user to locate the cursor over a particular story on the page image and select that story. The story text file associated with the selected story will be loaded and the story displayed in a clear text format as illustrated in FIG. 3. When the selection is made the page number associated with the page image file currently being viewed is known, and the location of the cursor within the page image when the selection was made is known. The display of the selected story is equivalent to searching the RECORDS to select the one which is associated with the correct page number and which has a POINTER in its fifth field pointing to the story position file defining the area in which the cursor was positioned when the selection was made, and displaying the text data and other information of the selected RECORD on the VDU. [0064]
  • Once the text data have been extracted and the text passages have been assigned page and story numbers, a list of the contents of the publication and a series of links from each of the entries in the list of contents to the relevant page imge file can be generatied using digital processing. Each entry in the list forms part of a control item, the other part being a link to the page image file representing the page on which the headline entry appears. Selection of an entry on the contents list by pointing and clicking the headline entry activates the control item which uses the link to retrieve and display the image of the page on which the headline appears. In the information display system output, the contents list can be called up for display on the left side of the screen simultaneously with a page image on the right side of the screen (see FIG. 2), to serve as a guide to users of the contents on the current page and on the preceeding and succeeding pages of the publication. Each entry in the list is a selectable “icon” forming a link to the page on which the entry appears. [0065]
  • An example of a program for generating a contents list is given in [0066] Appendix 1. The contents list is generated from the text headlines or subheadings associated with the stories ordered by page numbers and story numbers. The generated headline index file is output for use in generating the simultaneous text/image displays for the given publication (“London Evening Standard Business Day” in this example).
  • As shown in FIG. 11, the text passages (text stories) are linked by image maps IMx to the locations A-i of the corresponding stories on the page images. Each of the locations A-i of the story areas on the page images is similar to an icon in that it forms part of a control item, the other part being a link to the corresponding text passage (story). Clicking on a story area activates a control item which uses the link to retrieve and display the text file corresponding to the story in the selected story area. In the information display system output, the text passage can be called up for display on the left side of the screen simultaneously with display of the page image with story highlighted on the right side of the screen (see FIG. 3), to allow users to view the text in detail and interact with any linkages therein together with the contextual and editorial cues provided by the page image. [0067]
  • Image maps are used so that the story area acts like an icon or selectable button, i.e., a text passage is called up by a user clicking on the story area and the text passage is retrieved in response to its linkage on the associated image map for the page image. [0068]
  • The image maps can be created using, for example, mapping software such as one designated Web Map, which is available as shareware and stored as digital image map files. Typically, a rectangle or other shape is overlaid on the processed image by an operator who links the pixels within the shape on the image map template with a page number and story number in the database. The can be done by indexing the text file to the pixel group using a corresponding file naming convention, e.g., a “P1S2” suffix for the text file corresponding to the article area delineated on [0069] page #1 as story #2. The text files are read into the database which then stores the coordinates of the pixels contained in the map file with the record for that story. It does this by using the file name to identify the corresponding record in the database, in this case, the text record for page #1, story #2. A field in the database is updated to contain the indexing information.
  • The input data conversion process can include the extraction of other pictures and graphics appearing in the page images which are related to the text passages, or of cartoons, advertisements, and other graphics which may be desirable to display in their own right simultaneously with the page images. The graphics images are extracted from the EPS or PDF files into individual graphics files using standard graphics editing tools, e.g., the Adobe Illustrator™ system. Graphics related to the stories, such as a photo of the subject of a story or a headshot of a contributing columnist, are indexed in the database to the stories by page numbers and story numbers. Besides extracting the Postscript images in the manner described above, sufficient quality can also be obtained by using “screen dumps” of the page makeup files themselves and separating the bit-mapped components. This can be achieved, for example, using the Adobe Photoshop™ system. Standalone graphics can be linked to their locations in the page images using a control item and the image mapping described above. [0070]
  • In the information system display output, story-related graphic images appearing in the page images can be retrieved, manipulated, and displayed on the left side of the screen in a window adjacent to the text passage (see FIG. 6). Standalone graphic images can be called up for display on the left side of the screen by a mouse click, or can be used to trigger an external retrieval process resulting in display of a linked graphics file, such as an advertisement (the “Dell” logo linked to the advertisement in FIG. 7), an externally retrieved output (the up-to-date stock performance graph in FIG. 5), or the display of an associated text passage. [0071]
  • The extracted text data, list of contents, image maps, and extracted graphic images are stored in the database along with the processed page images. The database thus contains an ordered, structured, and mapped version of all text and related graphics components linked to their positions in the page images. [0072]
  • Generating a List of Identified Words [0073]
  • A list of important identifier words appearing in the pages of the publication can also be generated from the extracted text data. Important identifier words can include the names of companies, important persons, well-known products, media programs, etc., which are reported on in the publication. In the information display system output, a list of company names reported on in the publication can be called up for display on the left side of the screen (see FIG. 4). A click or entry of a selected company name will result in a display of the page image and highlighted story in which the company name appears on the right side of the screen, and the corresponding text passage on the left side of the screen (see FIG. 6). Similarly, display of a text passage with important company names highlighted therein allows a user to click on the highlighted name or word and call up another display of further information on the company. [0074]
  • Keywords are often designated in text by the publisher, for example, using specialized type fonts such as using bold font for company names or using italics for author's names or publication references. This designation in the text constitutes format data and provides a convenient way to identify keywords from the publisher's input. In the example illustrated in [0075] Appendix 2, company names in the input from the publisher are highlighted by tags for bold type font. Thus, a list of company names can be generated using a digital processor to parse the digital text data and extracting the names delimited by the bold tags into a company index file. The company names on the list are then indexed to the page numbers and story numbers where they appear in the page images, as well as by their text positions as delimited by the bold tags in the text passages. Each keyword text position is consequently indexed to a page number and a story number, and a link is formed between the text position and the story (text and/or image) in which the keyword appears. The text position and link form a control item which is activated by clicking on the text position. Activation of the control item causes the story to be retrieved and displayed. Indexing by their text positions allows the company names to be highlighted in the text displays and defined as control items having anchors for interactive linkages to further information during the system authoring stage. The resulting company index file is stored in the database for the simultaneous text/image information display system. The company names may also be added to a company name library list which is cumulated over time. In this manner, extensive keyword lists can be developed, and may be used for alternative methods to automated parsing of keywords.
  • One alternative method for generating the list of important identifier words (keywords) is to use a digital processor to search for text strings in the extracted digital text data which match entries in stored library lists of known company names, important person names, product names, media names, etc. The library lists can be updated from the electronic files processed and/or by manual input of an operator when a new keyword is recognized. When important identifier words are identified in the text passages, the digital processor adds the names to the keyword list, indexes the names to their page numbers and story numbers indicates the names to the positions of the words in the text passages, and creates a link between the name and the story in which the name appears. Keywords can also be added manually to the keyword list by the operator. The keyword lists serve as a powerful method of navigation to the covering stories in the simultaneous text/image information display system. FIG. 10 illustrates the selection of a keyword in a keyword list to navigate to the text passage and page image containing the keywords. The image maps also provide the ability to navigate among stories on a page and call up the corresponding text passages by clicking on the mapped areas of the stories. [0076]
  • Enhancing Visual Quality Of Page Images [0077]
  • Along with the above, the page images are processed by processing the (encapsulated postscript files of the publisher's input files to form [0078] 72 dpi bit-mapped page images or any other resolution appropriate to the intended output medium. The Internet, for example, usually requires images in GIF (Graphic Interchange Format) where the file sizes are minimized to enhance the speed of download. Optimized palettes are used to also minimize file size and increase visual quality. The image files are manipulated using bit-map processing software, such as Adobe Photoshop™ or Debabaliser™ software, to produce page images that are visually enhanced and/or data compressed to be acceptable in quality and reasonably small in file size. Scripts can be written to batch process the EPS or PDF files into appropriate page image files in a completely automated process. These scripts call a set of routines commonly used in image manipulation software such as Photoshop™ or Debabaliser™ software.
  • Linking Identified Information with Further Data [0079]
  • Further information is stored in the database by establishing indexes to its parent page/story number. “Regular” features, e.g., where the same page/story is always written by the same author, and may include a picture of the author, can be added automatically as a default by the database. Others are identified by an operator who may use a pull down menu of regular features or may insert the name manually. The naming convention of “P1S2G3” may be used typically indicating the [0080] graphics #3 connected to page #1, story #2.
  • A typical picture or graphic image would appear somewhere before the main body of text. Its position is indicated in the database by a number which instructs the database to output the link to this item after the appropriate numbered text item. Where a picture/graphic element is desired to be presented within the main body of the text, a convention of “[n]” (number within square brackets) may be used for the graphics number to instruct the output stage of the database to substitute this sequence for the appropriate longer form of the graphics name. This is designed to avoid operator error in miskeying longer sequences of characters than necessary in these manual operations. [0081]
  • Linkages to external data sources, i.e., external to the original publication, is typically achieved by linking to a predetermined set of hooks in the database. For example, a share price for a company identified by the keyword indexing process can be obtained using the official company name or stock exchange symbol stored in the database. After looking up the unique identifier name in the database, the system performs a share price lookup procedure with an external data source, and returns the retrieved share price for use in the display system. [0082]
  • Output of Information System Display to User [0083]
  • When the conversion of the publisher's input data in the database has been completed, a software routine in the display system creates a sequence of files containing the desired sequence and style of displays, linkages to both internal and external data, and other interactive functions for the information display system, as illustrated in [0084] Appendix 1. The linkages between story areas and related graphic images, text passages, keywords in the text passages, and image maps for the page images defined in the data conversion stage are used to define display buttons, highlighted stories, highlighted words, and linked displays in the display authoring stage. In accordance with the invention, examples of displays of text passages simultaneously with the page images providing contextual cues for the text passages to the viewer are shown in FIGS. 2-6. The resulting processed files constitute a digital data structure viewable using Web browsing software such as Netscape™ Navigator or Microsoft™ Internet Explorer on a file server running server software such as Novell™ Netware, Appleshare™, or Windows NT™ Server software. The digital data structure can also be uploaded onto a Web server running Netscape™ Server, Microsoft™ Information Server, or Apache™ server software. Once in the database, given the structuring of the data as described, the created files can be converted to a digital data structure in one of many possible formats and stored in a memory.
  • The Web-viewable files (digital data structure) are transmitted from the memory of the [0085] processing unit 10 to an intended server using suitable transmission software which first identifies files as either new or unchanged from a previous transmission. The Web-viewable files (digital data structure) are stored in a memory in the intended server. If the files are changed, they are compressed into a single file and transmitted over ISDN, PSTN, or leased line to the receiving server. The receiving server unpacks the compressed file into its components and copies them into the appropriate place on the user's server. This approach is used for efficiency where multiple destination types may be required. It does not matter whether the user's server is a true file server or whether it is a Web server. The transmission software can also be configured to compress all data all of the time. Alternate software routines, such as the “TAR” function used in the UNIX™ operating system, can be used to combine all files for transmission to a remote server. A simple UNIX™ script can be used to scan for these files and decompress them with the “UNTAR” function and copy them to the appropriate directory.
  • In an information display system configured for an intranet as shown in FIG. 1, each user is provided with a personal computer linked to a central file server to provide the necessary information. The personal computer can be a [0086] Macintosh System 7 with a 256 colour video screen or an IBM (Registered Trade Mark) compatible 486 based computer having at least 8 M Bytes of RAM and a 256 colour video screen. The information display system may also be configured as a server for the Internet to which a universe of users and server nodes may have access.
  • The server database for the information display system of the invention has the display content assembled into formats suitable for the medium to which it is targeted. For example, HTML is usually used where the output medium is the World Wide Web. However, the database can also process the system output files in other structured formats, for example, the Bloomberg™ real-time display system. The common principle is that the linkages between text passages, keywords, graphics, and page images are ordered based upon their assigned priorities and/or locations on the page images. [0087]
  • In addition to the solution of providing simultaneous displays for communicating familiar visual contextual and editorial information to the reader of text passages in the publication, the provision of the system output files in a readily viewable HTML format provides certain other advantages over simply viewing the publisher's publication file in PDF format with a plug-in or other formats not supported on the Internet currently. A PDF file is published as a single large file. Although there are advanced download technologies available, a PDF file typically takes longer to download than an HTML file, which contains many smaller files. An HTML file is also simpler to edit, integrates seamlessly with other Web technologies, and can provide access to further information from other active processes and databases dynamically. [0088]
  • The information display system of the present invention may be modified and extended in other ways. For example, since the text data are extracted from the publisher's input and maintained in the system database, the text data can be readily searched by any search engine to find target stories, names, and references and to retrieve the publication pages containing them. The processed information in the form of the prioritization of stories by importance and keyword lists can be used to assist with conducting high quality searches with high efficiency. Thus, the published issues can be converted to a data resource that is fully accessible and searchable by external users. [0089]
  • The processing of publisher's input into system output files and authoring of linkages between text passages, keywords, graphics, and page images can be developed further for fully automated processing. Batch processing scripts can be developed for automatedly extracting text data, graphics images, and keywords, generating image maps, and updating system library files. Stories may be tagged in the database in such a way that advertisements handled by the system will be changed as different stories are selected. This would allow customizing of advertising opportunities by associating different story types with different advertisements. [0090]
  • The processed information obtained in the present invention may also be used in other ways to provide further advantages. For example, the image maps defining the story areas for the page images may be used with the original PDF files to provide the capability for enhanced functions. The image map can be overlaid on the PDF file itself and by a click allow simultaneous viewing of the chosen text similar to the display result described previously. Additionally, the PDF file can retain zoom capabilities inherent in the file reader software. Clicking on the story area of an image map can be used to trigger an internal process, such as zooming in or out on a page view, or an external process, such as connecting to a related database of supporting information. [0091]
  • If the headlines are too small to read on a given display of a bitmapped page, a mouse roll-over can pull up headlines or captions in a pop-up box. Another possibility is to create a floating window which contains the page image. This could develop into an information tool, taking advantage of push technologies and broadcast methodologies using the JAVA language as its development platform rather than HTML, wherein a click can pull up a simultaneous display of background material in another display window. [0092]
  • It should be understood that the foregoing description of the present invention is meant to be illustrative only. While a few examples of the present invention have been described in detail, the principles of the present invention may be adapted to many different variations without departing from the spirit of the invention. [0093]

Claims (41)

We claim:
1. A computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein, comprising the steps of:
extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files;
processing page images from the publication files and maintaining them as page image files;
mapping story areas for respective stories appearing in the page images and indexing each story area to a text data file corresponding to the text passage in the story area, and maintaining the mapped story areas as image map files; and
generating a display on a computer system of page images using the page image files, and linking the stories in the story areas of the displayed page images to the corresponding text data using the text data files and image map files.
2. A computerized method of generating an information display according to
claim 1
, wherein said mapping step further includes the step of assigning to each mapped story area a page number of the page on which the story appears and a story number which corresponds to the relative importance of the story to other stories on the page.
3. A computerized method of generating an information display according to
claim 2
, wherein the story number is derived based upon any one of the following group of story importance indicators: location of the story area on the page; size of type font of a headline associated with the story; size of type font associated with the text passage corresponding to the story area; and size of text content of the text passage corresponding to the story area.
4. A computerized method of generating an information display according to
claim 2
, further comprising the steps of:
parsing the text data for the text passages to find predetermined keywords therein, indexing each keyword to a page number and a story number for the story corresponding to the text passage in which the keyword is found, and maintaining the indexed keywords on a keyword list from which the corresponding story and text passage can be found.
5. A computerized method of generating an information display according to
claim 4
, wherein said parsing step is carried out automatedly by performing a text string search of the text passages based upon text string entries contained in a library list of keywords.
6. A computerized method of generating an information display according to
claim 1
, further comprising the step of mapping graphics image areas for respective graphic images appearing in the page images and indexing each mapped graphics image to a page number of the page on which the graphics image appears and a graphics image area number, and maintaining the mapped graphics image areas as image map files.
7. A computerized method of generating an information display according to
claim 1
, wherein in the display generating step, a page image is displayed side-by-side with a text passage corresponding to a selected story appearing in the page image, whereby a viewer can read the text in the text passage while referring to the page image for visual cues about the text passage.
8. A computerized method of generating an information display according to
claim 7
, wherein the text passage is retrieved for simultaneous display with the page image upon clicking with a cursor on the corresponding story area defined in the image map for the story contained in the page image.
9. A computerized method of generating an information display according to
claim 2
, wherein the display generating step includes displaying a list of story titles ordered by page number and story numbers for stories appearing on a page simultaneously with display of the page image for the page.
10. A computerized method of generating an information display according to
claim 4
, wherein the display generating step includes displaying a list of keywords indexed in the publication, and displaying a text passage indexed to a keyword selected from the list of keywords simultaneously with the page image corresponding to the page on which the story corresponding to the text passage appears.
11. A computerized method of generating an information display according to
claim 6
, wherein the display generating step includes displaying further information linked to a graphics image appearing in a page simultaneously with the page image for the page in which the graphics image appears.
12. A computerized method of generating an information display according to
claim 11
, wherein the displayed further information is obtained from one of the following group of information sources: a stored graphics image; an output of an externally run process; and a stored text passage.
13. A computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein, comprising the steps of:
extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files;
parsing the text data to find predetermined keywords appearing therein, indexing each keyword to a page number and a story number for the story corresponding to the text passage in which the keyword is found, and maintaining the indexed keywords on a keyword list;
processing page images from the publication files and maintaining them as page image files;
generating a display on a computer system of the keyword list, and displaying the page image containing the story in which a selected keyword appears when the keyword is selected from the keyword list.
14. A computerized method of generating an information display according to
claim 13
, wherein the parsing step is carried out automatedly by performing a text string search of the text passages based upon text string entries contained in a library list of keywords.
15. A computerized method of generating an information display according to
claim 13
, wherein the text data extracted from the publication files include type font delimiters identifying keywords appearing in the text passages, and the parsing step is carried out automatedly by performing a search for keywords based upon locating them by their type font delimiters.
16. A computerized method of generating an information display from an input of publication files containing text, graphics, and other data viewable as page images of a publication having stories (text passages) and graphics images appearing therein, comprising the steps of:
extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files;
processing page images from the publication files and maintaining them as page image files;
assigning to each story appearing on a page of the publication a page number on which the story appears, and a story number ranking corresponding to the relative importance of the story to other stories on the page;
indexing the text data files to the page numbers and story number rankings for the corresponding stories appearing in the page images of the publication;
generating a display on a computer system of a page image using the page image files, and a side-by-side display of a list of story titles for the stories appearing on the displayed page ranked in order of their assigned story number rankings.
17. A computerized method of generating an information display according to
claim 16
, wherein the story number rankings are derived based upon comparing any one or more of the following group of story importance indicators: location of the story area on the page; size of type font of a headline associated with the story; size of type font associated with the text passage corresponding to the story area; and size of text content of the text passage corresponding to the story area.
18. A computerized method of generating an information display according to
claim 17
, wherein the text data for a text passage corresponding to a selected story is retrieved using the text data files upon clicking with a cursor on a selected story title on the list of story titles.
19. A computerized method of generating an information display according to
claim 18
, wherein the display generating step includes displaying the text passage corresponding to a selected story title simultaneously with the page image for the page in which the selected story appears, whereby a viewer can read the text in the text passage while referring to the page image for visual cues about the text passage.
20. A computerized method of generating an information display according to
claim 17
, further comprising the steps of:
parsing the text data to find predetermined keywords appearing therein, indexing each keyword to a page number and a story number for the story corresponding to the text passage in which the keyword is found, and maintaining the indexed keywords on a keyword list;
generating a display on a computer system of the keyword list, and simultaneously displaying the page image containing the story in which a selected keyword appears side-by-side with the text passage in which selected keyword appears, when the keyword is selected from the keyword list.
21. A method of converting digital publication files containing text, graphics, and other data corresponding to pages of a publication having stories (text passages) and graphics images appearing therein to digital data for generating and controlling a display on a computer system, comprising the steps of:
extracting text data from the publication files corresponding to stories appearing in the pages of the publication, and maintaining them as digital text data files;
producing page images corresponding to pages of the publication and maintaining them as digital page image files;
mapping story areas for respective stories appearing in the pages of the publication and indexing each story area to a text data file corresponding to the text passage in the story area, and maintaining the mapped story areas as digital control data; and
producing from the digital text data files, the digital page image files and the digital control data, digital data for generating a display on a computer system of page images in dependence on the page image files, and linking the stories in the mapped story areas of the displayed page images to the corresponding text data in dependence on the text data files and digital control data.
22. A method according to
claim 21
, wherein said mapping step further includes the step of assigning to each mapped story area a page number of the page on which the story appears and a story number which corresponds to the relative importance of the story to other stories on the page.
23. A method according to
claim 21
, wherein the story number is derived based upon any one of the following group of story importance indicators: location of the story area on the page; size of type font of a headline associated with the story; size of type font associated with the text passage corresponding to the story area; and size of text content of the text passage corresponding to the story area.
24. A method according to
claim 21
, further comprising the steps of:
parsing the text data for the text passages to find predetermined keywords therein; indexing each keyword to a page number and a story number for the story corresponding to the text passage in which the keyword is found; maintaining the indexed keywords on a keyword list from which the corresponding story and text passage can be found; and using said keyword list in the production of said digital data.
25. A method according to
claim 24
, wherein said parsing step is carried out automatedly by performing a text string search of the text passages based upon text string entries contained in a library list of keywords.
26. A method according to
claim 21
, further comprising the step of mapping graphics image areas for respective graphic images appearing in the page images and indexing each mapped graphics image to a page number of the page on which the graphics image appears and a graphics image area number, and maintaining the mapped graphics image areas as image map files.
27. A method according to
claim 21
, further comprising the step of generating a display on a computer system of page images in dependence on the page image files, and linking the stories in the mapped story areas of the displayed page images to the corresponding text data in dependence on the text data files and digital control data.
28. A method of converting digital publication files containing text, graphics, and other data corresponding to pages of a publication having stories (text passages) and graphics images appearing therein to digital data for generating and controlling a display on a computer screen, comprising the steps of:
extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as digital text data files;
parsing the text data to find predetermined keywords appearing therein, indexing each keyword to a page number and a story number for the story corresponding to the text passage in which the keyword is found, and maintaining the indexed keywords as digital control data;
producing page images corresponding to the pages of the publication and maintaining them as digital page image files;
producing from the digital text data files, the digital page image files and the digital control data, digital data for generating a display on a computer system listing the keywords and linking each keyword to its corresponding story in dependence on said digital control data wherein on selection of a keyword from the list, the page image containing the story in which a selected keyword appears is displayed.
29. A method according to
claim 28
, wherein the parsing step is carried out automatedly by performing a text string search of the text passages based upon text string entries contained in a library list of keywords.
30. A method according to
claim 28
, wherein the text data extracted from the publication files include type font delimiters identifying keywords appearing in the text passages, and the parsing step is carried out automatedly by performing a search for keywords based upon locating them by their type font delimiters.
31. A method according to
claim 28
, further comprising the step of generating a display on a computer system listing the keywords and linking each keyword to its corresponding story in dependence on said digital control data wherein on selection of a keyword from the list, the page image containing the story in which a selected keyword appears is displayed.
32. A method of converting digital publication files containing text, graphics, and other data corresponding to pages of a publication having stories (text passages) and graphics images appearing therein to digital data for generating and controlling a display on a computer screen, comprising the steps of:
extracting text data from the publication files corresponding to stories appearing in the page images of the publication, and maintaining them as text data files;
producing page images corresponding to the pages of the publication and maintaining them as text data files;
assigning to each story appearing on a page of the publication a page number on which the story appears, and a story number ranking corresponding to the relative importance of the story to other stories on the page;
indexing the text data files to the page numbers and story number rankings for the corresponding stories appearing in the page images of the publication;
producing from the digital text data files and the page image files, digital data for generating a display on a computer system of a page image in dependence on the page image files, and, in dependence on said text data files and indexing, a side-by-side display of a list of story titles for the stories appearing on the displayed page ranked in order of their assigned story number rankings.
33. A method according to
claim 32
, wherein the story number rankings are derived based upon comparing any one or more of the following group of story importance indicators: location of the story area on the page; size of type font of a headline associated with the story; size of type font associated with the text passage corresponding to the story area; and size of text content of the text passage corresponding to the story area.
34. A method according to
claim 32
, further comprising the step of generating a display on a computer system of a page image in dependence on the page image files, and, in dependence on said text data files and indexing, a side-by-side display of a list of story titles for the stories appearing on the displayed page ranked in order of their assigned story number rankings.
35. A method according to
claim 34
, wherein the text data for a text passage corresponding to a selected story is retrieved using the text data files upon clicking with a cursor on a selected story title on the list of story titles.
36. A method according to
claim 34
, wherein the display generating step includes displaying the text passage corresponding to a selected story title simultaneously with the page image for the page in which the selected story appears, whereby a viewer can read the text in the text passage while referring to the page image for visual cues about the text passage.
37. A method according to
claim 32
, further comprising the steps of:
parsing the text data to find predetermined keywords appearing therein, indexing each keyword to a page number and a story number for the story corresponding to corresponding to that first mapped story area.
38. A digital data structure for remote reproduction of a publication on a visual display unit of a computer system, comprising:
extracted text data for reproducing textual content of stories appearing in pages of the publication;
text indexed data indexing each story on each page of the publication to the extracted text data for reproducing the textual content of that story;
page image data for reproducing a visual image of pages of the publication;
image indexed data indexing each page of the publication to the page image data for reproducing that page;
control data including mapping data indexing mapped areas of the visual image of the publication, as defined by the page image data, to text portions defined by the extracted text data; and
an interfacing instruction sequence for execution by a computer system to generate a display of visual images of pages of the publication in dependence on the page image data and image index data, a display of the text of stories in the publication in dependence on the extracted text data and text index data, and providing for the linking of the mapped story areas on the visual images of pages of the publication to text portions in dependence on the control data and extracted text data, wherein selection of a first mapped story area effects the display of the text publication;
display means for displaying a graphical image of a page of the publication simultaneously with display of text data corresponding to a text passage appearing in the graphical image of the displayed page; and
section means operable by a user for selecting a text passage appearing in the graphical image of the page displayed by said display means;
said display means being responsive to said selection means and said data access means to simultaneously display the graphical image of the page of the publication accessed from said page image data alongside the selected passage of text accessed from said text data such that the user can view the text passage in detail as text data while being apprised of its relative importance in relation to the other text passages through viewing the simultaneous display of the graphical image of the pages and wherein said display means is adapted to visually identify said selected portion of the displayed page of said images including said predefined passage of text and any associated non-text matter.
39. A digital data structure according to
claim 38
, further comprising keyword data for reproducing keywords appearing in the pages of the publication and keyword index data indexing each keyword to the story in which the keyword is found, wherein said interfacing instruction sequence for execution by a computer system generates a display of a list of keywords and provides for linking each keyword to its corresponding story wherein on selection of the keyword from the list the page image containing the story in which the selected keyword appears is displayed.
40. A digital data structure according to
claim 38
, wherein said text index data ranks the stories appearing on a page of the publication relative to one another and said interfacing instruction sequence for execution by a computer system generates a display of visual images of pages of the publication in dependence on the page image data and image index data, and, in dependence on said extracted text data and text index data, a side-by-side display of a list of story titles for the stories appearing on the displayed page ranked in order of their assigned story number rankings.
41. An information display system comprising:
data access means for accessing page image data comprising graphical images of pages of a publication and text data, said page image data comprising graphical images of both text and non-text matter, said text matter including a plurality of predefined passages of text which are arranged on the page in an ordering indicating their relative importance in relation to other text passages on the page, and said text data comprising a plurality of predefined passages; of text corresponding to text passages appearing in the graphical images of the pages of the the text passage in which the keyword is found, and maintaining the indexed keywords on a keyword list;
generating a display on a computer system of the keyword list, and simultaneously displaying the page image containing the story in which a selected keyword appears side-by-side with the text passage in which selected keyword appears, when the keyword is selected from the keyword list.
US09/048,621 1994-10-24 1998-03-26 Publication file conversion and display Expired - Fee Related US6415307B2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US09/048,621 US6415307B2 (en) 1994-10-24 1998-03-26 Publication file conversion and display
JP2000525845A JP2001527246A (en) 1997-12-19 1998-12-16 Convert and display publication files
PCT/IB1998/002145 WO1999033009A1 (en) 1997-12-19 1998-12-16 Publication file conversion and display
CA002309050A CA2309050A1 (en) 1997-12-19 1998-12-16 Publication file conversion and display

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US08/329,948 US5748931A (en) 1994-10-24 1994-10-24 Information display system for simultaneously displaying graphical images and text of a publication
EP97310368.2 1997-12-19
EP97310368A EP0926610A1 (en) 1997-12-19 1997-12-19 Publication file conversion and display
US09/048,621 US6415307B2 (en) 1994-10-24 1998-03-26 Publication file conversion and display

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US08/329,948 Continuation-In-Part US5748931A (en) 1994-10-24 1994-10-24 Information display system for simultaneously displaying graphical images and text of a publication

Publications (2)

Publication Number Publication Date
US20010047373A1 true US20010047373A1 (en) 2001-11-29
US6415307B2 US6415307B2 (en) 2002-07-02

Family

ID=26147755

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/048,621 Expired - Fee Related US6415307B2 (en) 1994-10-24 1998-03-26 Publication file conversion and display

Country Status (4)

Country Link
US (1) US6415307B2 (en)
JP (1) JP2001527246A (en)
CA (1) CA2309050A1 (en)
WO (1) WO1999033009A1 (en)

Cited By (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020077832A1 (en) * 2000-11-06 2002-06-20 Batchilo Leonid Computer based integrated text/graphic document analysis
US20020118379A1 (en) * 2000-12-18 2002-08-29 Amit Chakraborty System and user interface supporting user navigation of multimedia data file content
US20020152245A1 (en) * 2001-04-05 2002-10-17 Mccaskey Jeffrey Web publication of newspaper content
US20040047510A1 (en) * 2000-08-17 2004-03-11 Hideki Kawabata Method of preparing publication, electronic publication using the method and displaying method therefor and network system
US20060069996A1 (en) * 2004-09-30 2006-03-30 Greaves P D Fisheye viewer and wiggly icon
US20060075327A1 (en) * 2004-09-29 2006-04-06 Joe Sriver User interface for presentation of a document
US7058647B1 (en) 1999-08-31 2006-06-06 Charles E. Hill & Associates Electronic presentation generation system and method
US20060129973A1 (en) * 2004-11-30 2006-06-15 Newcorn David C Method and system for digital publication of electronic information
US20060282760A1 (en) * 2005-06-14 2006-12-14 Canon Kabushiki Kaisha Apparatus, method and system for document conversion, apparatuses for document processing and information processing, and storage media that store programs for realizing the apparatuses
US7171414B1 (en) * 1997-06-12 2007-01-30 Yahoo, Inc. Dynamic page generator
US20070047818A1 (en) * 2005-08-23 2007-03-01 Hull Jonathan J Embedding Hot Spots in Imaged Documents
US20070067348A1 (en) * 2005-09-18 2007-03-22 Andreyev Dmitriy S Repeated Segment Manager
US20070171482A1 (en) * 2006-01-24 2007-07-26 Masajiro Iwasaki Method and apparatus for managing information, and computer program product
US20070180357A1 (en) * 2006-01-31 2007-08-02 Microsoft Corporation Story Tracking for Fixed Layout Markup Documents
US20070180358A1 (en) * 2006-01-31 2007-08-02 Microsoft Corporation Structural Context for Fixed Layout Markup Documents
US20070250791A1 (en) * 2006-04-20 2007-10-25 Andrew Halliday System and Method for Facilitating Collaborative Generation of Life Stories
US20070261071A1 (en) * 2006-04-20 2007-11-08 Wisdomark, Inc. Collaborative system and method for generating biographical accounts
US20070268520A1 (en) * 1999-05-25 2007-11-22 Silverbrook Research Pty Ltd Method of delivering interactive publications
US20070269110A1 (en) * 1999-05-25 2007-11-22 Silverbrook Research Pty Ltd. Periodical distribution via a computer network
US20080004956A1 (en) * 2006-06-28 2008-01-03 Andrew Ian Atherton System and method for generating graphical advertisements based on text offers
US20080147690A1 (en) * 2006-12-19 2008-06-19 Swisscom Mobile Ag Method and apparatuses for selectively accessing data elements in a data library
US7433881B1 (en) 2000-08-31 2008-10-07 Charles E. Hill & Associates, Inc. System and method for handling multi-resolution graphics files
US20080275732A1 (en) * 2007-05-01 2008-11-06 Best Doctors, Inc. Using patterns of medical treatment codes to determine when further medical expertise is called for
US20080306913A1 (en) * 2007-06-05 2008-12-11 Aol, Llc Dynamic aggregation and display of contextually relevant content
US20080320386A1 (en) * 2007-06-23 2008-12-25 Advancis.Com, Inc. Methods for optimizing the layout and printing of pages of Digital publications.
US20090024667A1 (en) * 2005-01-12 2009-01-22 Masatsugu Noda Information processing device, file data merging method, file naming method, and file data output method
US20090113282A1 (en) * 2001-01-04 2009-04-30 Schultz Dietrich W Automatic Linking of Documents
US20100077478A1 (en) * 1999-09-17 2010-03-25 Ricoh Co., Ltd. Method and Apparatus for Publishing Documents Over a Network
US20100274777A1 (en) * 2009-04-28 2010-10-28 Danny Ho Method and System for Processing a Variable Click Domain Display
US20110010190A1 (en) * 1997-03-14 2011-01-13 Best Doctors, Inc. Health care management system
WO2011132188A1 (en) * 2010-04-19 2011-10-27 Tactile World Ltd. Intelligent display system and method
WO2011135475A2 (en) 2010-04-26 2011-11-03 Nds Limited Method for formatting text for display on an e-reader
US20110271228A1 (en) * 2010-05-03 2011-11-03 Zumobi, Inc. Systems, Methods, and Computer Program Products Providing an Article Selection Structure
WO2012058339A1 (en) * 2010-10-26 2012-05-03 Barnes & Noble, Inc System and method for displaying electronic publications cross reference to related application
US20120159526A1 (en) * 2006-11-22 2012-06-21 Bindu Rama Rao System for providing interactive media to user of mobile device
US20120254745A1 (en) * 2010-05-03 2012-10-04 Zumobi, Inc. Systems, Methods, and Computer Program Products Providing an Integrated User Interface for Reading Content
US20120297286A1 (en) * 2011-05-18 2012-11-22 Kabushiki Kaisha Toshiba Method of processing data for an information processing apparatus
EP2541441A1 (en) * 2010-02-26 2013-01-02 Rakuten, Inc. Information processing device, information processing method, and recording medium that has recorded information processing program
US20130185658A1 (en) * 2010-09-30 2013-07-18 Beijing Lenovo Software Ltd. Portable Electronic Device, Content Publishing Method, And Prompting Method
US8689098B2 (en) 2006-04-20 2014-04-01 Google Inc. System and method for organizing recorded events using character tags
US8825682B2 (en) 2006-07-31 2014-09-02 Ricoh Co., Ltd. Architecture for mixed media reality retrieval of locations and registration of images
US8838591B2 (en) 2005-08-23 2014-09-16 Ricoh Co., Ltd. Embedding hot spots in electronic documents
US20140281931A1 (en) * 2013-03-16 2014-09-18 Sears Brands, L.L.C. E-pub creator
US8856108B2 (en) 2006-07-31 2014-10-07 Ricoh Co., Ltd. Combining results of image retrieval processes
US8868555B2 (en) 2006-07-31 2014-10-21 Ricoh Co., Ltd. Computation of a recongnizability score (quality predictor) for image retrieval
US8892595B2 (en) 2011-07-27 2014-11-18 Ricoh Co., Ltd. Generating a discussion group in a social network based on similar source materials
US8965145B2 (en) 2006-07-31 2015-02-24 Ricoh Co., Ltd. Mixed media reality recognition using multiple specialized indexes
US8989431B1 (en) 2007-07-11 2015-03-24 Ricoh Co., Ltd. Ad hoc paper-based networking with mixed media reality
US9020966B2 (en) 2006-07-31 2015-04-28 Ricoh Co., Ltd. Client device for interacting with a mixed media reality recognition system
US20150169545A1 (en) * 2013-12-13 2015-06-18 International Business Machines Corporation Content Availability for Natural Language Processing Tasks
US9063952B2 (en) 2006-07-31 2015-06-23 Ricoh Co., Ltd. Mixed media reality recognition with image tracking
US9063953B2 (en) 2004-10-01 2015-06-23 Ricoh Co., Ltd. System and methods for creation and use of a mixed media environment
US9087104B2 (en) 2006-01-06 2015-07-21 Ricoh Company, Ltd. Dynamic presentation of targeted information in a mixed media reality recognition system
US9092423B2 (en) 2007-07-12 2015-07-28 Ricoh Co., Ltd. Retrieving electronic documents by converting them to synthetic text
US9171202B2 (en) 2005-08-23 2015-10-27 Ricoh Co., Ltd. Data organization and access for mixed media document system
US9176984B2 (en) 2006-07-31 2015-11-03 Ricoh Co., Ltd Mixed media reality retrieval of differentially-weighted links
US9311336B2 (en) 2006-07-31 2016-04-12 Ricoh Co., Ltd. Generating and storing a printed representation of a document on a local computer upon printing
US9357098B2 (en) 2005-08-23 2016-05-31 Ricoh Co., Ltd. System and methods for use of voice mail and email in a mixed media environment
US9373029B2 (en) 2007-07-11 2016-06-21 Ricoh Co., Ltd. Invisible junction feature recognition for document security or annotation
US9384619B2 (en) 2006-07-31 2016-07-05 Ricoh Co., Ltd. Searching media content for objects specified using identifiers
US9392429B2 (en) 2006-11-22 2016-07-12 Qualtrics, Llc Mobile device and system for multi-step activities
US9405751B2 (en) 2005-08-23 2016-08-02 Ricoh Co., Ltd. Database for mixed media document system
US9530050B1 (en) 2007-07-11 2016-12-27 Ricoh Co., Ltd. Document annotation sharing
US20170046446A1 (en) * 2004-09-29 2017-02-16 Google Inc. User interfaces for a document search engine
US9613061B1 (en) * 2004-03-19 2017-04-04 Google Inc. Image selection for news search
US9870388B2 (en) 2006-07-31 2018-01-16 Ricoh, Co., Ltd. Analyzing usage of visual content to determine relationships indicating unsuccessful attempts to retrieve the visual content
US9930162B2 (en) * 2014-12-02 2018-03-27 Facebook, Inc. Techniques for enhancing content on a mobile device
CN108121987A (en) * 2018-01-02 2018-06-05 联想(北京)有限公司 A kind of information processing method and electronic equipment
US20190155955A1 (en) * 2017-11-20 2019-05-23 Rovi Guides, Inc. Systems and methods for filtering supplemental content for an electronic book
US10649624B2 (en) 2006-11-22 2020-05-12 Qualtrics, Llc Media management system supporting a plurality of mobile devices
US10803474B2 (en) 2006-11-22 2020-10-13 Qualtrics, Llc System for creating and distributing interactive advertisements to mobile devices
US10817646B2 (en) * 2016-09-16 2020-10-27 Canon Kabushiki Kaisha Information processing system and control method therefor
US10853508B2 (en) * 2017-01-25 2020-12-01 Teramind Inc. Method and system for reactive mining of computer screens
US10909191B2 (en) 2017-11-20 2021-02-02 Rovi Guides, Inc. Systems and methods for displaying supplemental content for an electronic book
US11003349B2 (en) * 2013-09-27 2021-05-11 Microsoft Technology Licensing, Llc Actionable content displayed on a touch screen
US11256386B2 (en) 2006-11-22 2022-02-22 Qualtrics, Llc Media management system supporting a plurality of mobile devices

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6978418B1 (en) * 1999-04-13 2005-12-20 Hewlett-Packard Development Company, L.P. Dynamic-adaptive client-side image map
JP2000305822A (en) * 1999-04-26 2000-11-02 Denso Corp Device for database management and device for database extraction, and method for database management and method for database extraction
US7594166B1 (en) * 1999-05-20 2009-09-22 Microsoft Corporation Dynamic web page behaviors
JP3897494B2 (en) * 1999-08-31 2007-03-22 キヤノン株式会社 Image management search device, image management search method, and storage medium
US6903839B1 (en) * 1999-09-03 2005-06-07 Imagex, Inc. Apparatus for washing of graphic image files
US20040122731A1 (en) * 1999-09-23 2004-06-24 Mannik Peeter Todd System and method for using interactive electronic representations of objects
US8429005B2 (en) 1999-09-23 2013-04-23 Activ8Now, Llc Method for determining effectiveness of display of objects in advertising images
US7216115B1 (en) * 1999-11-10 2007-05-08 Fastcase.Com, Inc. Apparatus and method for displaying records responsive to a database query
JP2001169067A (en) * 1999-12-10 2001-06-22 Ricoh Co Ltd Device and method for image processing and computer readable storage medium with program making computer perform the method stored therein
JP2001331362A (en) * 2000-03-17 2001-11-30 Sony Corp File conversion method, data converter and file display system
JP3623715B2 (en) * 2000-04-07 2005-02-23 日本電気株式会社 Communication terminal device
US7739354B2 (en) * 2000-10-12 2010-06-15 Sap Portals Israel Ltd. Adding data to text pages by means of an intermediary proxy
US6738756B1 (en) * 2000-06-30 2004-05-18 Ncr Corporation Analysis method and apparatus for a parallel system
US7185000B1 (en) * 2000-06-30 2007-02-27 Ncr Corp. Method and apparatus for presenting query plans
US7568152B1 (en) * 2000-07-14 2009-07-28 International Business Machines Corporation Text file interface support in an object oriented application
US7086067B1 (en) 2000-07-14 2006-08-01 International Business Machines Corporation Dynamic Java bean for VisualAge for Java
US6654758B1 (en) * 2000-07-21 2003-11-25 Unisys Corporation Method for searching multiple file types on a CD ROM
US6938083B1 (en) * 2000-07-21 2005-08-30 Unisys Corporation Method of providing duplicate original file copies of a searched topic from multiple file types derived from the web
AU2001294655A1 (en) 2000-09-25 2002-04-08 Richard Fuisz System for providing access to product data
US20020108115A1 (en) * 2000-12-11 2002-08-08 The Associated Press News and other information delivery system and method
US20020124056A1 (en) * 2001-03-01 2002-09-05 International Business Machines Corporation Method and apparatus for modifying a web page
US20030033294A1 (en) * 2001-04-13 2003-02-13 Walker Jay S. Method and apparatus for marketing supplemental information
US20030145017A1 (en) * 2002-01-31 2003-07-31 Patton Thadd Clark Method and application for removing material from documents for external sources
US8266270B1 (en) * 2002-07-16 2012-09-11 At&T Intellectual Property I, L.P. Delivery performance analysis for internet services
US7461346B2 (en) * 2002-07-30 2008-12-02 Sap Ag Editing browser documents
US6998727B2 (en) * 2003-03-10 2006-02-14 The United States Of America As Represented By The Administrator Of The Environmental Protection Agency Methods of operating a parallel hybrid vehicle having an internal combustion engine and a secondary power source
US20040250220A1 (en) * 2003-06-09 2004-12-09 Mika Kalenius System, apparatus, and method for navigation in a hypertext document
KR100539834B1 (en) * 2003-06-30 2005-12-28 엘지전자 주식회사 System and Method for Managing Map version using of car navigation
US7970889B2 (en) * 2003-12-11 2011-06-28 International Business Machines Corporation Intelligent subscription builder
US20050131778A1 (en) * 2003-12-11 2005-06-16 International Business Machines Corporation Customized subscription builder
US20060161537A1 (en) * 2005-01-19 2006-07-20 International Business Machines Corporation Detecting content-rich text
JP2006202081A (en) * 2005-01-21 2006-08-03 Seiko Epson Corp Metadata creation apparatus
JPWO2007021038A1 (en) * 2005-08-12 2009-02-26 俊彦 岡部 List comparison display method, system, apparatus, program, recording medium, and two-dimensionally encoded comparison display list
US20070094267A1 (en) * 2005-10-20 2007-04-26 Glogood Inc. Method and system for website navigation
US20080256066A1 (en) * 2007-04-10 2008-10-16 Tikatok Inc. Book creation systems and methods
US8031170B2 (en) * 2007-05-09 2011-10-04 Research In Motion Limited User interface for selecting a photo tag
US9195661B2 (en) * 2007-06-07 2015-11-24 Thomson Reuters Global Resources Method and system for click-thru capability in electronic media
US10089306B1 (en) 2008-03-31 2018-10-02 Amazon Technologies, Inc. Dynamically populating electronic item
US20100097635A1 (en) * 2008-10-17 2010-04-22 Infoprint Solutions Company Llc Printer upgrade mechanism
US8588528B2 (en) * 2009-06-23 2013-11-19 K-Nfb Reading Technology, Inc. Systems and methods for displaying scanned images with overlaid text
US20100331043A1 (en) * 2009-06-23 2010-12-30 K-Nfb Reading Technology, Inc. Document and image processing
US9501582B2 (en) * 2010-05-10 2016-11-22 Amazon Technologies, Inc. Providing text content embedded with protected multimedia content
EP2584515B1 (en) * 2010-06-15 2020-06-10 Navitime Japan Co., Ltd. Navigation system, terminal apparatus, navigation server, navigation apparatus, navigation method, and program
JP5629509B2 (en) * 2010-07-01 2014-11-19 株式会社Kadokawa Information processing apparatus, information browsing apparatus, information processing method, and program
US9218680B2 (en) 2010-09-01 2015-12-22 K-Nfb Reading Technology, Inc. Systems and methods for rendering graphical content and glyphs
JP6651563B2 (en) * 2018-02-28 2020-02-19 シナノケンシ株式会社 Electronic book browsing program and electronic book browsing device
CN109241495B (en) * 2018-08-28 2023-05-16 浪潮软件科技有限公司 Hypertext output method based on itext+jfreechart

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63170780A (en) * 1986-10-03 1988-07-14 インタランド・コーポレーション Integrated multi-display type overlay control system communication work station
CA1337132C (en) * 1988-07-15 1995-09-26 Robert Filepp Reception system for an interactive computer network and method of operation
US5241624A (en) * 1991-10-03 1993-08-31 International Business Machines Corporation Method for determining a user selected group of data objects for the propagation of attribute values
US5689648A (en) 1992-01-31 1997-11-18 Raychem Corporation Method and apparatus for publication of information
US5819259A (en) * 1992-12-17 1998-10-06 Hartford Fire Insurance Company Searching media and text information and categorizing the same employing expert system apparatus and methods
US5553277A (en) * 1992-12-29 1996-09-03 Fujitsu Limited Image search method for searching and retrieving desired image from memory device
US5524201A (en) 1993-11-03 1996-06-04 Apple Computer, Inc. Method of preparing an electronic book for a computer system
US5623681A (en) * 1993-11-19 1997-04-22 Waverley Holdings, Inc. Method and apparatus for synchronizing, displaying and manipulating text and image documents
US5799325A (en) * 1993-11-19 1998-08-25 Smartpatents, Inc. System, method, and computer program product for generating equivalent text files
US5930809A (en) * 1994-01-18 1999-07-27 Middlebrook; R. David System and method for processing text
US5502637A (en) 1994-06-15 1996-03-26 Thomson Shared Services, Inc. Investment research delivery system
US5624265A (en) * 1994-07-01 1997-04-29 Tv Interactive Data Corporation Printed publication remote contol for accessing interactive media
US5623652A (en) * 1994-07-25 1997-04-22 Apple Computer, Inc. Method and apparatus for searching for information in a network and for controlling the display of searchable information on display devices in the network
US5748931A (en) * 1994-10-24 1998-05-05 Infosis Group Ltd. Information display system for simultaneously displaying graphical images and text of a publication
US6029195A (en) * 1994-11-29 2000-02-22 Herz; Frederick S. M. System for customized electronic identification of desirable objects
US5758257A (en) * 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5706365A (en) * 1995-04-10 1998-01-06 Rebus Technology, Inc. System and method for portable document indexing using n-gram word decomposition
US6026388A (en) * 1995-08-16 2000-02-15 Textwise, Llc User interface and other enhancements for natural language information retrieval system and method
US5675788A (en) 1995-09-15 1997-10-07 Infonautics Corp. Method and apparatus for generating a composite document on a selected topic from a plurality of information sources
US5920854A (en) * 1996-08-14 1999-07-06 Infoseek Corporation Real-time document collection search engine with phrase indexing
US6119114A (en) * 1996-09-17 2000-09-12 Smadja; Frank Method and apparatus for dynamic relevance ranking
US5960383A (en) * 1997-02-25 1999-09-28 Digital Equipment Corporation Extraction of key sections from texts using automatic indexing techniques
US6012053A (en) * 1997-06-23 2000-01-04 Lycos, Inc. Computer system with user-controlled relevance ranking of search results

Cited By (138)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110010190A1 (en) * 1997-03-14 2011-01-13 Best Doctors, Inc. Health care management system
US20080046826A1 (en) * 1997-06-12 2008-02-21 Yahoo! Inc. Dynamic page generator
US9836445B2 (en) 1997-06-12 2017-12-05 Excalibur Ip, Llc Dynamic page generator
US7171414B1 (en) * 1997-06-12 2007-01-30 Yahoo, Inc. Dynamic page generator
US8352854B2 (en) 1997-06-12 2013-01-08 Yahoo! Inc. Dynamic page generator
US7925972B2 (en) 1999-05-25 2011-04-12 Silverbrook Research Pty Ltd System for initiating action in processing system
US7539937B2 (en) 1999-05-25 2009-05-26 Silverbrook Research Pty Ltd Periodical distribution via a computer network
US20070269110A1 (en) * 1999-05-25 2007-11-22 Silverbrook Research Pty Ltd. Periodical distribution via a computer network
US20070268520A1 (en) * 1999-05-25 2007-11-22 Silverbrook Research Pty Ltd Method of delivering interactive publications
US20090196530A1 (en) * 1999-05-25 2009-08-06 Silverbrook Research Pty Ltd System for initiating action in processing system
US7058647B1 (en) 1999-08-31 2006-06-06 Charles E. Hill & Associates Electronic presentation generation system and method
US7873652B1 (en) 1999-08-31 2011-01-18 Charles E. Hill & Associates, Inc. Electronic presentation generation system and method
US8082328B2 (en) * 1999-09-17 2011-12-20 Ricoh Co., Ltd. Method and apparatus for publishing documents over a network
US20100077478A1 (en) * 1999-09-17 2010-03-25 Ricoh Co., Ltd. Method and Apparatus for Publishing Documents Over a Network
US20040047510A1 (en) * 2000-08-17 2004-03-11 Hideki Kawabata Method of preparing publication, electronic publication using the method and displaying method therefor and network system
US7447992B2 (en) * 2000-08-17 2008-11-04 E Media Ltd. Method of producing publications, electronic publication produced by the method, and method and network system for displaying the electronic publication
US7433881B1 (en) 2000-08-31 2008-10-07 Charles E. Hill & Associates, Inc. System and method for handling multi-resolution graphics files
US20020077832A1 (en) * 2000-11-06 2002-06-20 Batchilo Leonid Computer based integrated text/graphic document analysis
US7013309B2 (en) * 2000-12-18 2006-03-14 Siemens Corporate Research Method and apparatus for extracting anchorable information units from complex PDF documents
US20020118379A1 (en) * 2000-12-18 2002-08-29 Amit Chakraborty System and user interface supporting user navigation of multimedia data file content
US8887036B2 (en) * 2001-01-04 2014-11-11 Adobe Systems Incorporated Automatic linking of documents
US20090113282A1 (en) * 2001-01-04 2009-04-30 Schultz Dietrich W Automatic Linking of Documents
US20020152245A1 (en) * 2001-04-05 2002-10-17 Mccaskey Jeffrey Web publication of newspaper content
US9613061B1 (en) * 2004-03-19 2017-04-04 Google Inc. Image selection for news search
US20170046446A1 (en) * 2004-09-29 2017-02-16 Google Inc. User interfaces for a document search engine
US11023550B2 (en) * 2004-09-29 2021-06-01 Google Llc User interfaces for a document search engine
US10528650B2 (en) 2004-09-29 2020-01-07 Google Llc User interface for presentation of a document
US9514102B2 (en) 2004-09-29 2016-12-06 Google Inc. User interface for presentation of a document
US11803604B2 (en) * 2004-09-29 2023-10-31 Google Llc User interfaces for a document search engine
US20060075327A1 (en) * 2004-09-29 2006-04-06 Joe Sriver User interface for presentation of a document
US20210286852A1 (en) * 2004-09-29 2021-09-16 Google Llc User Interfaces for a Document Search Engine
US9348937B2 (en) * 2004-09-30 2016-05-24 Elsevier B.V. Fisheye viewer and wiggly icon
US20060069996A1 (en) * 2004-09-30 2006-03-30 Greaves P D Fisheye viewer and wiggly icon
US9063953B2 (en) 2004-10-01 2015-06-23 Ricoh Co., Ltd. System and methods for creation and use of a mixed media environment
US20060129973A1 (en) * 2004-11-30 2006-06-15 Newcorn David C Method and system for digital publication of electronic information
US8065267B2 (en) * 2005-01-12 2011-11-22 Masatsugu Noda Information processing device, file data merging method, file naming method, and file data output method
US20090024667A1 (en) * 2005-01-12 2009-01-22 Masatsugu Noda Information processing device, file data merging method, file naming method, and file data output method
US8453045B2 (en) 2005-06-14 2013-05-28 Canon Kabushiki Kaisha Apparatus, method and system for document conversion, apparatuses for document processing and information processing, and storage media that store programs for realizing the apparatuses
US20060282760A1 (en) * 2005-06-14 2006-12-14 Canon Kabushiki Kaisha Apparatus, method and system for document conversion, apparatuses for document processing and information processing, and storage media that store programs for realizing the apparatuses
US7853866B2 (en) * 2005-06-14 2010-12-14 Canon Kabushiki Kaisha Apparatus, method and system for document conversion, apparatuses for document processing and information processing, and storage media that store programs for realizing the apparatuses
US20100329567A1 (en) * 2005-06-14 2010-12-30 Canon Kabushiki Kaisha Apparatus, method and system for document converstion, apparatuses for document processing and information processing, and storage media that store programs for realizing the apparatuses
US9405751B2 (en) 2005-08-23 2016-08-02 Ricoh Co., Ltd. Database for mixed media document system
US20070047818A1 (en) * 2005-08-23 2007-03-01 Hull Jonathan J Embedding Hot Spots in Imaged Documents
US8949287B2 (en) * 2005-08-23 2015-02-03 Ricoh Co., Ltd. Embedding hot spots in imaged documents
US9357098B2 (en) 2005-08-23 2016-05-31 Ricoh Co., Ltd. System and methods for use of voice mail and email in a mixed media environment
US8838591B2 (en) 2005-08-23 2014-09-16 Ricoh Co., Ltd. Embedding hot spots in electronic documents
US9171202B2 (en) 2005-08-23 2015-10-27 Ricoh Co., Ltd. Data organization and access for mixed media document system
US20070067348A1 (en) * 2005-09-18 2007-03-22 Andreyev Dmitriy S Repeated Segment Manager
US9087104B2 (en) 2006-01-06 2015-07-21 Ricoh Company, Ltd. Dynamic presentation of targeted information in a mixed media reality recognition system
US20070171482A1 (en) * 2006-01-24 2007-07-26 Masajiro Iwasaki Method and apparatus for managing information, and computer program product
US7676741B2 (en) 2006-01-31 2010-03-09 Microsoft Corporation Structural context for fixed layout markup documents
US7721198B2 (en) * 2006-01-31 2010-05-18 Microsoft Corporation Story tracking for fixed layout markup documents
US20070180357A1 (en) * 2006-01-31 2007-08-02 Microsoft Corporation Story Tracking for Fixed Layout Markup Documents
US20070180358A1 (en) * 2006-01-31 2007-08-02 Microsoft Corporation Structural Context for Fixed Layout Markup Documents
US8689098B2 (en) 2006-04-20 2014-04-01 Google Inc. System and method for organizing recorded events using character tags
US20070250791A1 (en) * 2006-04-20 2007-10-25 Andrew Halliday System and Method for Facilitating Collaborative Generation of Life Stories
US8103947B2 (en) * 2006-04-20 2012-01-24 Timecove Corporation Collaborative system and method for generating biographical accounts
US20070261071A1 (en) * 2006-04-20 2007-11-08 Wisdomark, Inc. Collaborative system and method for generating biographical accounts
US10001899B2 (en) 2006-04-20 2018-06-19 Google Llc Graphical user interfaces for supporting collaborative generation of life stories
US8793579B2 (en) 2006-04-20 2014-07-29 Google Inc. Graphical user interfaces for supporting collaborative generation of life stories
US10180764B2 (en) 2006-04-20 2019-01-15 Google Llc Graphical user interfaces for supporting collaborative generation of life stories
US8775951B2 (en) 2006-04-20 2014-07-08 Google Inc. Graphical user interfaces for supporting collaborative generation of life stories
US20090012807A1 (en) * 2006-06-28 2009-01-08 Yahoo! Inc. System and Method for Generating Graphical Advertisements Based on Text Offers
US20080004956A1 (en) * 2006-06-28 2008-01-03 Andrew Ian Atherton System and method for generating graphical advertisements based on text offers
US9176984B2 (en) 2006-07-31 2015-11-03 Ricoh Co., Ltd Mixed media reality retrieval of differentially-weighted links
US9311336B2 (en) 2006-07-31 2016-04-12 Ricoh Co., Ltd. Generating and storing a printed representation of a document on a local computer upon printing
US9384619B2 (en) 2006-07-31 2016-07-05 Ricoh Co., Ltd. Searching media content for objects specified using identifiers
US9870388B2 (en) 2006-07-31 2018-01-16 Ricoh, Co., Ltd. Analyzing usage of visual content to determine relationships indicating unsuccessful attempts to retrieve the visual content
US9063952B2 (en) 2006-07-31 2015-06-23 Ricoh Co., Ltd. Mixed media reality recognition with image tracking
US8825682B2 (en) 2006-07-31 2014-09-02 Ricoh Co., Ltd. Architecture for mixed media reality retrieval of locations and registration of images
US9020966B2 (en) 2006-07-31 2015-04-28 Ricoh Co., Ltd. Client device for interacting with a mixed media reality recognition system
US8965145B2 (en) 2006-07-31 2015-02-24 Ricoh Co., Ltd. Mixed media reality recognition using multiple specialized indexes
US8856108B2 (en) 2006-07-31 2014-10-07 Ricoh Co., Ltd. Combining results of image retrieval processes
US8868555B2 (en) 2006-07-31 2014-10-21 Ricoh Co., Ltd. Computation of a recongnizability score (quality predictor) for image retrieval
US10838580B2 (en) 2006-11-22 2020-11-17 Qualtrics, Llc Media management system supporting a plurality of mobile devices
US10686863B2 (en) 2006-11-22 2020-06-16 Qualtrics, Llc System for providing audio questionnaires
US10649624B2 (en) 2006-11-22 2020-05-12 Qualtrics, Llc Media management system supporting a plurality of mobile devices
US9392429B2 (en) 2006-11-22 2016-07-12 Qualtrics, Llc Mobile device and system for multi-step activities
US10803474B2 (en) 2006-11-22 2020-10-13 Qualtrics, Llc System for creating and distributing interactive advertisements to mobile devices
US11128689B2 (en) 2006-11-22 2021-09-21 Qualtrics, Llc Mobile device and system for multi-step activities
US11064007B2 (en) 2006-11-22 2021-07-13 Qualtrics, Llc System for providing audio questionnaires
US10747396B2 (en) 2006-11-22 2020-08-18 Qualtrics, Llc Media management system supporting a plurality of mobile devices
US11256386B2 (en) 2006-11-22 2022-02-22 Qualtrics, Llc Media management system supporting a plurality of mobile devices
US10659515B2 (en) 2006-11-22 2020-05-19 Qualtrics, Inc. System for providing audio questionnaires
US20120159526A1 (en) * 2006-11-22 2012-06-21 Bindu Rama Rao System for providing interactive media to user of mobile device
US10846717B2 (en) 2006-11-22 2020-11-24 Qualtrics, Llc System for creating and distributing interactive advertisements to mobile devices
US8433299B2 (en) * 2006-11-22 2013-04-30 Bindu Rama Rao System for providing interactive media to user of mobile device
EP1939761A1 (en) * 2006-12-19 2008-07-02 Swisscom Mobile AG Method and device for selective access to data elements in a data set
EP2503475A1 (en) * 2006-12-19 2012-09-26 Swisscom AG Method and device for selective access to data elements in a data set
US20080147690A1 (en) * 2006-12-19 2008-06-19 Swisscom Mobile Ag Method and apparatuses for selectively accessing data elements in a data library
US20080275732A1 (en) * 2007-05-01 2008-11-06 Best Doctors, Inc. Using patterns of medical treatment codes to determine when further medical expertise is called for
US9613008B2 (en) * 2007-06-05 2017-04-04 Aol Inc. Dynamic aggregation and display of contextually relevant content
US8656264B2 (en) 2007-06-05 2014-02-18 Aol Inc. Dynamic aggregation and display of contextually relevant content
US20140189480A1 (en) * 2007-06-05 2014-07-03 Aol Inc. Dynamic aggregation and display of contextually relevant content
US20080306913A1 (en) * 2007-06-05 2008-12-11 Aol, Llc Dynamic aggregation and display of contextually relevant content
US20110173216A1 (en) * 2007-06-05 2011-07-14 Eric Newman Dynamic aggregation and display of contextually relevant content
US7917840B2 (en) * 2007-06-05 2011-03-29 Aol Inc. Dynamic aggregation and display of contextually relevant content
US20080320386A1 (en) * 2007-06-23 2008-12-25 Advancis.Com, Inc. Methods for optimizing the layout and printing of pages of Digital publications.
US10192279B1 (en) 2007-07-11 2019-01-29 Ricoh Co., Ltd. Indexed document modification sharing with mixed media reality
US8989431B1 (en) 2007-07-11 2015-03-24 Ricoh Co., Ltd. Ad hoc paper-based networking with mixed media reality
US9373029B2 (en) 2007-07-11 2016-06-21 Ricoh Co., Ltd. Invisible junction feature recognition for document security or annotation
US9530050B1 (en) 2007-07-11 2016-12-27 Ricoh Co., Ltd. Document annotation sharing
US9092423B2 (en) 2007-07-12 2015-07-28 Ricoh Co., Ltd. Retrieving electronic documents by converting them to synthetic text
US20100274777A1 (en) * 2009-04-28 2010-10-28 Danny Ho Method and System for Processing a Variable Click Domain Display
EP2541441A4 (en) * 2010-02-26 2014-10-15 Rakuten Inc Information processing device, information processing method, and recording medium that has recorded information processing program
EP2541441A1 (en) * 2010-02-26 2013-01-02 Rakuten, Inc. Information processing device, information processing method, and recording medium that has recorded information processing program
US8949267B2 (en) 2010-02-26 2015-02-03 Rakuten, Inc. Information processing device, information processing method, and recording medium that has recorded information processing program
US20150170391A1 (en) * 2010-04-19 2015-06-18 Tactile World Ltd. Intelligent display system and method
WO2011132188A1 (en) * 2010-04-19 2011-10-27 Tactile World Ltd. Intelligent display system and method
US20130033521A1 (en) * 2010-04-19 2013-02-07 Tactile World Ltd. Intelligent display system and method
WO2011135474A1 (en) 2010-04-26 2011-11-03 Nds Limited Method for formatting text for display on an e-reader
WO2011135475A2 (en) 2010-04-26 2011-11-03 Nds Limited Method for formatting text for display on an e-reader
US20110271228A1 (en) * 2010-05-03 2011-11-03 Zumobi, Inc. Systems, Methods, and Computer Program Products Providing an Article Selection Structure
US20120254745A1 (en) * 2010-05-03 2012-10-04 Zumobi, Inc. Systems, Methods, and Computer Program Products Providing an Integrated User Interface for Reading Content
US9361130B2 (en) * 2010-05-03 2016-06-07 Apple Inc. Systems, methods, and computer program products providing an integrated user interface for reading content
US20130185658A1 (en) * 2010-09-30 2013-07-18 Beijing Lenovo Software Ltd. Portable Electronic Device, Content Publishing Method, And Prompting Method
WO2012058339A1 (en) * 2010-10-26 2012-05-03 Barnes & Noble, Inc System and method for displaying electronic publications cross reference to related application
US20120137200A1 (en) * 2010-10-26 2012-05-31 Jonathan Shar System and method for displaying electronic publications
US20120297286A1 (en) * 2011-05-18 2012-11-22 Kabushiki Kaisha Toshiba Method of processing data for an information processing apparatus
US8972842B2 (en) * 2011-05-18 2015-03-03 Kabushiki Kaisha Toshiba Method of processing data for an information processing apparatus
US8892595B2 (en) 2011-07-27 2014-11-18 Ricoh Co., Ltd. Generating a discussion group in a social network based on similar source materials
US9058331B2 (en) 2011-07-27 2015-06-16 Ricoh Co., Ltd. Generating a conversation in a social network based on visual search results
US11947900B2 (en) 2013-03-16 2024-04-02 Transform Sr Brands Llc e-Pub creator
US11615232B2 (en) 2013-03-16 2023-03-28 Transform Sr Brands Llc E-Pub creator
US10621277B2 (en) * 2013-03-16 2020-04-14 Transform Sr Brands Llc E-Pub creator
US20140281931A1 (en) * 2013-03-16 2014-09-18 Sears Brands, L.L.C. E-pub creator
US11003349B2 (en) * 2013-09-27 2021-05-11 Microsoft Technology Licensing, Llc Actionable content displayed on a touch screen
US9830316B2 (en) 2013-12-13 2017-11-28 International Business Machines Corporation Content availability for natural language processing tasks
US20150169545A1 (en) * 2013-12-13 2015-06-18 International Business Machines Corporation Content Availability for Natural Language Processing Tasks
US9792276B2 (en) * 2013-12-13 2017-10-17 International Business Machines Corporation Content availability for natural language processing tasks
US9930162B2 (en) * 2014-12-02 2018-03-27 Facebook, Inc. Techniques for enhancing content on a mobile device
US10122839B1 (en) * 2014-12-02 2018-11-06 Facebook, Inc. Techniques for enhancing content on a mobile device
US10817646B2 (en) * 2016-09-16 2020-10-27 Canon Kabushiki Kaisha Information processing system and control method therefor
US10853508B2 (en) * 2017-01-25 2020-12-01 Teramind Inc. Method and system for reactive mining of computer screens
US10909193B2 (en) * 2017-11-20 2021-02-02 Rovi Guides, Inc. Systems and methods for filtering supplemental content for an electronic book
US10909191B2 (en) 2017-11-20 2021-02-02 Rovi Guides, Inc. Systems and methods for displaying supplemental content for an electronic book
US20190155955A1 (en) * 2017-11-20 2019-05-23 Rovi Guides, Inc. Systems and methods for filtering supplemental content for an electronic book
CN108121987A (en) * 2018-01-02 2018-06-05 联想(北京)有限公司 A kind of information processing method and electronic equipment

Also Published As

Publication number Publication date
US6415307B2 (en) 2002-07-02
WO1999033009A1 (en) 1999-07-01
JP2001527246A (en) 2001-12-25
CA2309050A1 (en) 1999-07-01

Similar Documents

Publication Publication Date Title
US6415307B2 (en) Publication file conversion and display
US5748931A (en) Information display system for simultaneously displaying graphical images and text of a publication
US6442574B1 (en) Structured document browser
US7698167B2 (en) Catalog building method and system
CN1928865B (en) Method and apparatus for synchronizing, displaying and manipulating text and image documents
US20010029465A1 (en) System and method for processing and displaying product information on a computer
EP0384986A2 (en) Method for displaying online information
EP0926610A1 (en) Publication file conversion and display
JP2550068B2 (en) How to search and display information
JP3910680B2 (en) Material allocation device prepared as digital data
MXPA00006111A (en) Publication file conversion and display
JPH07271814A (en) Electronic filing device for retrieving data from visual position or shape without requiring keyword
JPH06266487A (en) Information processor and help information presenting method
JPH08272574A (en) Data display device

Legal Events

Date Code Title Description
AS Assignment

Owner name: INFOSIS GROUP LTD., UNITED KINGDOM

Free format text: EMPLOYMENT AGREEMENT WITH ASSIGNMENT PROVISION;ASSIGNOR:JONES, MICHAEL WILLIAM DUDLESTON;REEL/FRAME:009338/0057

Effective date: 19950223

Owner name: INFOSIS GROUP LTD., ENGLAND

Free format text: EMPLOYMENT AGREEMENT WITH ASSIGNMENT PROVISION;ASSIGNOR:GEEN, NICHOLAS;REEL/FRAME:009338/0035

Effective date: 19960528

AS Assignment

Owner name: P2I LIMITED (FORMERLY HAMSARD 2210 LIMITED), UNITE

Free format text: ASSET PURCHASE AGREEMENT;ASSIGNOR:INFOSIS GROUP LIMITED;REEL/FRAME:012862/0228

Effective date: 20010919

FPAY Fee payment

Year of fee payment: 4

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20100702