WO2001022298A1 - Enhancing touch and feel on the internet - Google Patents

Enhancing touch and feel on the internet Download PDF

Info

Publication number
WO2001022298A1
WO2001022298A1 PCT/US2000/026128 US0026128W WO0122298A1 WO 2001022298 A1 WO2001022298 A1 WO 2001022298A1 US 0026128 W US0026128 W US 0026128W WO 0122298 A1 WO0122298 A1 WO 0122298A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
image
product
resolution
book
Prior art date
Application number
PCT/US2000/026128
Other languages
French (fr)
Inventor
Scott C. Harris
Original Assignee
Harris Scott C
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=26852399&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=WO2001022298(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Harris Scott C filed Critical Harris Scott C
Priority to AU40205/01A priority Critical patent/AU4020501A/en
Publication of WO2001022298A1 publication Critical patent/WO2001022298A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0623Item investigation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • G06F30/23Design optimisation, verification or simulation using finite element methods [FEM] or finite difference methods [FDM]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0603Catalogue ordering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23412Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/812Monomedia components thereof involving advertisement data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/02CAD in a network environment, e.g. collaborative CAD or distributed simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2113/00Details relating to the application field
    • G06F2113/20Packaging, e.g. boxes or containers

Definitions

  • the present application relates to improvements in the user interface that enables enhancing simulation of real touch and feel over a remote information server. More specifically, the present application describes enhancing the realism of product descriptions over the Internet, to make Internet shopping more like real life shopping .
  • the present application teaches a new paradigm of selling over the Internet.
  • Figure 1A shows a screen shot of an exemplary web page for selling a product
  • Figures IB and IC show views of the simulated 3D product, respectively from the front and the rear;
  • Figure ID shows an image formed of varying resolution portions ;
  • Figure 2 shows a flowchart of operation of the first embodiment
  • Figure 3A and 3B show different vantage points used to view an object to enable simulated three dimensional view
  • Figure 3C shows a flowchart of operation with these simulated viewpoints
  • Figures 4A and 4B show a book display embodiment, showing the book from front and rear respectively;
  • Figure 4C shows the inside of the book;
  • Figure 5 shows a flowchart of operation of this embodiment .
  • a user interface which provides the same information to a user that could be provided if the user could physically pick up and handle the product.
  • the entire product package is rendered in three dimensions.
  • the rendering includes the shape and color of the product from at least a plurality of different angles, and specifically from at least enough angles to enable reading each label on the package.
  • the user interface includes controls that enable moving the product within the user interface, m a way that enables viewing from each of these different angles.
  • One special application of this system is for use in books, music and videos. Bookstores are used by people who browse through the book selection, reading pages, looking at pictures, and trying to get the feel of the different books.
  • the present system teaches an interface to the book contents that enables viewing the outside portion of the book, specified pages of the book, and leafing through random pages of the book.
  • An embodiment limits the amount of reading that the user can do, to prevent the entire book from simply being read on line.
  • Another aspect of the above applies the same kind of operation to videos and music.
  • the liner notes can be perused, and the packaging of the video/music element can be viewed from different angles.
  • a special extension to hypertext markup language is defined.
  • a hypertext mark up language extension/object is defined which can be hold the information that is contained in the three dimensions of the package being viewed.
  • Another aspect allows the information to be used within other programs, e.g., Powerpoint, or an executable file.
  • a graduated view system which displays different amounts of information while loading additional information.
  • the system starts by displaying a two- dimensional image, or "splash".
  • the two-dimensional image itself is formed in a graduated manner, using a low resolution image, which is progressively increased in resolution as more information is received.
  • the two dimensional image is shown while the three-dimensional image information is loading.
  • the final image can also be graduated. It can include lower resolution portions which show the ornamental portions of the object, and higher-resolution portions which show the readable portions of the object.
  • the higher-resolution portions are formed from ASCII text.
  • an HTML extension is defined which enables the three dimensional viewing.
  • Another aspect defines a reduced data set for the system described above which enables separate views from different angles to simulate three dimensional viewing without actually using a continuous three dimensional view.
  • Another aspect teaches a new paradigm for selling products in which the products are exhibited on the Internet using information that is obtained from a three- dimensional view of the product that includes at least enough resolution to read each of a plurality of labels of the product, and to see the shape of the product from each of a plurality of different views.
  • Another part of the paradigm has the seller of the product providing electronic images representing packaging information for the product.
  • the web sites that sell the product can use that packaging information as parts of their website. Like stores, where every store gets a package for the product from the vendor, each Internet seller gets an electronic package for their product from the vendor.
  • the product shown in this embodiment is a bottle of aspirin.
  • the bottle of aspirin has a specified three- dimensional shape.
  • the manufacturer of the aspirin produces the bottle and the packaging for the product.
  • the manufacturer also provides two different files, one being a progressively renderable two- dimensional JPEG image of the bottle as seen from the front.
  • Another image is a three-dimensional rendering of the bottle.
  • Such information can be produced using three- dimensional AUTOCAD (TM) , or some other three-dimensional drawing program.
  • the three dimensional rendering that is produced has at least sufficient resolution to enable reading all of the labels on the product.
  • TM three- dimensional AUTOCAD
  • Figure 1A a screen shown at an initial time is shown.
  • a normal sales screen 100 includes the general description of the product, the price, and ability to "add to cart” and “Check out”.
  • Figure 1A also shows a image portion 110.
  • the whole page -- image portion 110 and the sales screen 100, are defined at step 200.
  • the sales screen is defined using HTML code.
  • the image portion is defined within the HTML code also and this can be displayed as a rectangle as shown in Figure 1A.
  • Figure 1A shows a progressively-rendered two dimensional JPEG being displayed as 112. This is shown in the Figure 2 flowchart.
  • the display of the progressively rendered JPEG begins. First the lowest resolution version is displayed at step 202. After the lowest resolution version is on the screen, the 3D image begins loading at step 204, and at the same time more information about the two-dimensional JPEG is loaded at 206. The JPEG resolution is increased by the additional information .
  • a new image portion 110 is displayed at 208 that shows the information in the 3D image.
  • Figure IB shows this image portion including a simulated three-dimensional view of the product 122.
  • a plurality of movement keys 123 - 130 define different movement directions. Each enables rotating the view of the product in the direction defined by the arrow of the key.
  • Figure IB shows the front view.
  • Figure IC shows the rear view. Both of these views have sufficient size and resolution to allow the labels to be clearly visible and preferably large enough to be read. The user can also rotate the view to obtain different views -- a side view, an edge view, and views of different labels.
  • the user can also actuate the zoom-in button 136 to zoom-in on a portion of the product.
  • the zoom can be centered on the readable label so that the user can obtain a larger picture of the label to read the information from that picture.
  • Figure IC shows a slightly zoomed-in version.
  • Another aspect uses graded resolution for the image.
  • the ornamental part of the packaging can be displayed with different resolution than the readable parts, e.g., the labels.
  • the actual product is formed of different zones as shown in Figure ID.
  • Each zone has a different kind of information, e.g., a highly compressed JPEG image portion 180 for the ornamental part, a less compressed JPEG portion 182 for more important parts, and finer resolution parts 184.
  • the fine resolution part 184 can be ASCII or rich text format type textual information.
  • the user can look at the product from any desired angle.
  • the user can read all of the labels on the product, and can see packaging from different angles.
  • the user can see the box from all different angles including front, back, top and sides.
  • Another movement key can enable the user virtual opening of the box to see the product inside.
  • the entire three-dimensional image loads until it is completely loaded, and then it is displayed.
  • the three- dimensional image is preferably compressed using lossy compression to minimize the size of the image.
  • Another embodiment of this system defines an extension to hypertext mark up language which simulates the three- dimensional representation of the product/packaging using a reduced data set.
  • the true 3D image stores real 3D information that can be manipulated to see the object from any angle or view.
  • this HTML extension in contrast, it is recognized that most objects can be looked at as being like a cube. The cube can be viewed from points 1-6 shown in Figure 3A -- front, back; top, bottom; left, right.
  • Additional vantage points may be desireable to allow viewing from angles. 20 additional points are shown in Figure 3B. Therefore, 26 discrete images provides all the basic views that could simulate a three-dimensional view of the product.
  • a reduced data set view can be formed from only the six basic views in Figure 3A, viewing the object from only the points 1 through 6 shown in Figure 3A.
  • An even further reduced data set can view the object only from front and back views without allowing viewing front, back, top and bottom.
  • the product is first displayed from a default view in the product screen 100.
  • the default view is one in which the front of the product, for example, is viewed.
  • the image for each of the views is lossy-compressed using JPEG or MPEG compression.
  • This default image loads first, as shown in step 350 in Figure 3C.
  • the other n images e.g. 21 other images, begin loading in the background.
  • the HTML extension also displays arrow keys which enable rotation of the image and viewing the image from other vantage points. Depending on the number of images, each actuation of the arrow keys will select a different amount of rotation. The rotation is in actuality effected by displaying a different image.
  • the arrows are detected in step 352, and used to select a different image. The next image is loaded.
  • This HTML code can be executed by loading the first JPEG and loading the remainder in the background, or can load the views only when requested.
  • This system allows the web site operator to select the amount of information they want to present.
  • the amount of change from the arrows depends on the number of images that have been loaded.
  • a reduced data set can be provided, or more information to show more about the product packaging.
  • preferably enough information is provided such that each of the labels on the product can be read, either directly, or using the zoom function.
  • a particularly preferred form of compression uses an adaptable lossy compression where parts of the product are compressed with a first compression ratio, and the parts containing the label are stored in a different way. For example, the label could have more resolution, or be stored in text form.
  • the data that is put on the website is typically data that is decided by the website designers, rather than the publishers of the book.
  • the present paradigm allows those who package the book to decide what the book should look like, and what a buyer should see when they are thinking about buying the book.
  • Bookstores operate based on the assumption that most people will not read all books in that way. However, it enhances the experience of the bookstore. It allows the user to decide if they like the book or not.
  • the present embodiment teaches a remote information server sales paradigm, which starts by obtaining a digital image of at least parts of the book. Those digital images could be supplied by the publisher or designer and then used to provide information on the book to people reading the book. This allows the user to read parts of the book.
  • a limit is defined that limits the amount of reading that can be done.
  • the amount of reading is stored in a file indicating the user' s activity, e.g., a "cookie".
  • the cookie can expire or persist, as described herein.
  • the cookie can be stored on the information server, or on the user's home computer. If the cookie expires, then additional reading can be done later.
  • Another embodiment defines total limits, where the user is limited in the amount that they can read any title, and the cookie does not expire.
  • the present system also facilitates touch and feel like in the first embodiment.
  • the touch and feel is modified for use in reading a book.
  • a reader of a book looking at the exterior of the book needs only to see the front cover, back cover and spine. There is no need to see the top, bottom or other edges that do not typically contain viewed information.
  • certain information is often printed on insides of the covers, on, for example, the liner notes.
  • the book is virtually openable to read those inside portions.
  • at least the covers, the liner notes and biographic/informational notes, and the table of contents, if any are provided as digital images.
  • a front view of the book as displayed on the web browser is shown in Figure 4A.
  • the view includes the front cover of the book showing an accurate depiction of the look of the book including the title, and artwork.
  • the view has a resolution that is sufficient to enable the printing on the book to be read by a viewer.
  • a number of additional manipulation keys are also defined to change the view of the book that is seen by a viewer.
  • a first manipulation key 402 defines turning over the book. When the cursor is placed over this key for about 2 seconds, a small text item, a "screen tip”, is displayed indicating "turn the book over”. If that key is depressed, the view changes to the view shown in Figure 4B which shows the book from the back. Again, the colors and artwork of the book are accurately depicted.
  • the printed portion of the book is displayed in a manner enabling that printed portion to be accurately read. As in the previous embodiments, this can use a graded resolution system, that provides more resolution for the readable parts of the book than is provided for the ornamental parts of
  • An "open the book” indicia is also shown as element 506 in both the front and rear views shown in Figure 4A and 4B respectively.
  • the open book When the open book is actuated, the book is virtually opened.
  • Clicking the open in Figure 4A yields the screen shown in Figure 4C which shows the first two printed pages of the book.
  • a "zoom" function changes the operation to show only a single printed page, with enhanced detail.
  • Clicking the open in Figure 4B yields an analogous operation of opening from the rear of the book, exactly as the book would be opened if it were placed from the rear. This operation is not shown, but would yield the last two pages of the book.
  • the front pages and rear pages of the book often include liner notes about the book, general information about the book or its author, pictures, and the like. One or more than one page of this information can be provided.
  • Two indicia 422 and 424 are also displayed respectively representing page forward and page backward.
  • the page forward advances the open page by one sheet, much as it would look if the page were turned on a book. In the dual page display of Figure 4C, this would be like paging forward in the book, to show two new pages.
  • Page back 424 goes back by one sheet.
  • move keys are always shown as arrow keys. These keys change meaning based on context, but always mean that movement in some direction will be carried out .
  • Each open page enables reading the entire amount of print on the page.
  • There may be no limit set for retrieval of certain pages such as liner notes, pictures and biographies, table of contents and indices.
  • some predefined limit on total new page requests can be defined.
  • the user is allowed to read, for example, 20 pages out of the entire book.
  • a next page operation at 500 first detects if a new page is being requested, at 502. If so, a count is incremented at 504. When the counter reaches a specified value detected at 506, e.g. 20 times, further requests are prohibited.
  • the counter can be present in a cookie, and the cookie can be reset, for example, each 24 hour period. This enables the user to come back a day later and look at other pages in the same book. If the limit is not exceeded, then the page is fetched at 508. Just like being in a real bookstore -- with enough patience and ingenuity, the entire book can be read. However, at any one sitting, the user can select a certain number of pages to read. For instance, the limit can also be set to only allow certain pages to be read, such as the first chapter only.
  • a fee e.g. a book reading fee
  • a fee could be charged for allowing the user to read the entire book. After paying this fee, the user gets unrestricted access to the whole book.
  • the user can read the whole book in one or many sessions.
  • the cookie can also store a bookmark, so that the user can return to their computer during a later session, and take up reading where they left off.
  • This embodiment has described reading books. However, these techniques can also be used for any other system in which the merchandise can be read. This can be used with music such as Cds, videos, etc. In those cases, the entire stored information can be the inside and outside of the covers, and the liner notes that go along with the music, e.g., length of songs, band members, song lyrics, etc.
  • the present application is described as being used with HTML over the Internet. However, it could be used with any remote information server, using any programming language. For example, this could be used over a modem or other information line that is dialed up or connected point-to-point.
  • the screens described herein could be compiled into, for example, an executable file that is downloaded with an instruction to execute upon receipt. Then, the file is executed to allow viewing the merchandise.
  • the limits described herein in the "book reading" embodiment could be compiled as part of the code. Also, like in the embodiment, the whole book could be downloaded, and only part of it availible for viewing. The rest would be viewable only after paying a fee. The rest could be, for example, encrypted, and the user is given the decryption code after paying the fee.
  • the embodiment has described images being used to represent the items. However, it should be understood that other forms are possible.

Abstract

A system for enabling touch and feel over the internet provides a three-dimensional (122) representation of a good being sold (100), that three-dimensional representation being viewable from a number of different directions (136). The good being sold is in a package and the package is displayed from the number of different direction.

Description

ENHANCING TOUCH AND FEEL ON THE INTERNET
This application claims priority from Provisional Application Serial No. 60/155,543, filed on September 22, 1999.
The present application relates to improvements in the user interface that enables enhancing simulation of real touch and feel over a remote information server. More specifically, the present application describes enhancing the realism of product descriptions over the Internet, to make Internet shopping more like real life shopping .
Background
Shopping over the Internet has become very popular. A primary reason is convenience. A user can sit at their computer and shop from a number of different Internet web sites. Without physically moving, the user can select from different items in different sites. The prices are often lower than, or at least comparable to, what one would pay in retail stores. The shopping is very convenient. Internet browsing provides a limited amount of information about the product. In a store, if a user wants to select between multiple items, the user consults the packaging that accompanies the product. They can read the packages, look at information on the package, and touch the package. The packaging often sells the product. Large amounts of money are spent on packaging for the products.
Internet web pages often reflect minimal information about the product packaging. Hence, shopping on the Internet is most effective when the user already knows what they want .
Software such as Apple Quicktime VR (TM) allows some limited pseudo three-dimensional viewing.
Summary
The present application teaches a new paradigm of selling over the Internet.
Brief Description of the Drawings
These and other aspects will now be described in detail with reference to the accompanying drawings, wherein : Figure 1A shows a screen shot of an exemplary web page for selling a product;
Figures IB and IC show views of the simulated 3D product, respectively from the front and the rear; Figure ID shows an image formed of varying resolution portions ;
Figure 2 shows a flowchart of operation of the first embodiment;
Figure 3A and 3B show different vantage points used to view an object to enable simulated three dimensional view;
Figure 3C shows a flowchart of operation with these simulated viewpoints;
Figures 4A and 4B show a book display embodiment, showing the book from front and rear respectively; Figure 4C shows the inside of the book; and
Figure 5 shows a flowchart of operation of this embodiment .
Description of the Preferred Embodiment According to the present application, a user interface is described which provides the same information to a user that could be provided if the user could physically pick up and handle the product. According to one aspect of the present application, the entire product package is rendered in three dimensions. The rendering includes the shape and color of the product from at least a plurality of different angles, and specifically from at least enough angles to enable reading each label on the package. The user interface includes controls that enable moving the product within the user interface, m a way that enables viewing from each of these different angles. One special application of this system is for use in books, music and videos. Bookstores are used by people who browse through the book selection, reading pages, looking at pictures, and trying to get the feel of the different books. The present system teaches an interface to the book contents that enables viewing the outside portion of the book, specified pages of the book, and leafing through random pages of the book. An embodiment limits the amount of reading that the user can do, to prevent the entire book from simply being read on line. Another aspect of the above applies the same kind of operation to videos and music. The liner notes can be perused, and the packaging of the video/music element can be viewed from different angles. According to one aspect of this system, a special extension to hypertext markup language is defined. A hypertext mark up language extension/object is defined which can be hold the information that is contained in the three dimensions of the package being viewed. Another aspect allows the information to be used within other programs, e.g., Powerpoint, or an executable file.
A graduated view system which displays different amounts of information while loading additional information. The system starts by displaying a two- dimensional image, or "splash". The two-dimensional image itself is formed in a graduated manner, using a low resolution image, which is progressively increased in resolution as more information is received. The two dimensional image is shown while the three-dimensional image information is loading.
The final image can also be graduated. It can include lower resolution portions which show the ornamental portions of the object, and higher-resolution portions which show the readable portions of the object. In one embodiment, the higher-resolution portions are formed from ASCII text. According to another aspect, an HTML extension is defined which enables the three dimensional viewing.
Another aspect defines a reduced data set for the system described above which enables separate views from different angles to simulate three dimensional viewing without actually using a continuous three dimensional view.
Another aspect teaches a new paradigm for selling products in which the products are exhibited on the Internet using information that is obtained from a three- dimensional view of the product that includes at least enough resolution to read each of a plurality of labels of the product, and to see the shape of the product from each of a plurality of different views. Another part of the paradigm has the seller of the product providing electronic images representing packaging information for the product. The web sites that sell the product can use that packaging information as parts of their website. Like stores, where every store gets a package for the product from the vendor, each Internet seller gets an electronic package for their product from the vendor.
The preferred embodiment will be described with reference to Figures 1 which shows an exemplary web page using the present system. While the preferred embodiment describes this system being used on the Internet, it should be understood that this can be used on any remote information server that is used to sell products.
The product shown in this embodiment is a bottle of aspirin. The bottle of aspirin has a specified three- dimensional shape. The manufacturer of the aspirin produces the bottle and the packaging for the product. In this embodiment, the manufacturer also provides two different files, one being a progressively renderable two- dimensional JPEG image of the bottle as seen from the front. Another image is a three-dimensional rendering of the bottle. Such information can be produced using three- dimensional AUTOCAD (TM) , or some other three-dimensional drawing program. The three dimensional rendering that is produced has at least sufficient resolution to enable reading all of the labels on the product. In Figure 1A, a screen shown at an initial time is shown. A normal sales screen 100 includes the general description of the product, the price, and ability to "add to cart" and "Check out". Figure 1A also shows a image portion 110. The whole page -- image portion 110 and the sales screen 100, are defined at step 200. The sales screen is defined using HTML code. The image portion is defined within the HTML code also and this can be displayed as a rectangle as shown in Figure 1A.
Figure 1A shows a progressively-rendered two dimensional JPEG being displayed as 112. This is shown in the Figure 2 flowchart. At step 202, the display of the progressively rendered JPEG begins. First the lowest resolution version is displayed at step 202. After the lowest resolution version is on the screen, the 3D image begins loading at step 204, and at the same time more information about the two-dimensional JPEG is loaded at 206. The JPEG resolution is increased by the additional information .
When the 3D image is completely loaded, a new image portion 110 is displayed at 208 that shows the information in the 3D image. Figure IB shows this image portion including a simulated three-dimensional view of the product 122. A plurality of movement keys 123 - 130 define different movement directions. Each enables rotating the view of the product in the direction defined by the arrow of the key. Figure IB shows the front view. By manipulating the movement keys, the rear of the product 122 can be viewed. Figure IC shows the rear view. Both of these views have sufficient size and resolution to allow the labels to be clearly visible and preferably large enough to be read. The user can also rotate the view to obtain different views -- a side view, an edge view, and views of different labels.
The user can also actuate the zoom-in button 136 to zoom-in on a portion of the product. The zoom can be centered on the readable label so that the user can obtain a larger picture of the label to read the information from that picture. Figure IC shows a slightly zoomed-in version.
Another aspect uses graded resolution for the image. The ornamental part of the packaging can be displayed with different resolution than the readable parts, e.g., the labels. In one embodiment, the actual product is formed of different zones as shown in Figure ID.
Each zone has a different kind of information, e.g., a highly compressed JPEG image portion 180 for the ornamental part, a less compressed JPEG portion 182 for more important parts, and finer resolution parts 184. The fine resolution part 184 can be ASCII or rich text format type textual information.
It should be appreciated from the above that the user can look at the product from any desired angle. The user can read all of the labels on the product, and can see packaging from different angles. In the case of a boxed product, the user can see the box from all different angles including front, back, top and sides. Another movement key can enable the user virtual opening of the box to see the product inside.
According to a preferred mode of carrying out this system, the entire three-dimensional image loads until it is completely loaded, and then it is displayed. The three- dimensional image is preferably compressed using lossy compression to minimize the size of the image.
In an alternative mode, only the view being called for is loaded. The remainder of the portions of the three- dimensional views are loaded in the background, or only loaded when requested.
Another embodiment of this system defines an extension to hypertext mark up language which simulates the three- dimensional representation of the product/packaging using a reduced data set. The true 3D image stores real 3D information that can be manipulated to see the object from any angle or view. In this HTML extension, in contrast, it is recognized that most objects can be looked at as being like a cube. The cube can be viewed from points 1-6 shown in Figure 3A -- front, back; top, bottom; left, right.
Additional vantage points may be desireable to allow viewing from angles. 20 additional points are shown in Figure 3B. Therefore, 26 discrete images provides all the basic views that could simulate a three-dimensional view of the product.
A reduced data set view can be formed from only the six basic views in Figure 3A, viewing the object from only the points 1 through 6 shown in Figure 3A. An even further reduced data set can view the object only from front and back views without allowing viewing front, back, top and bottom.
Other combinations of these sets are also possible. According to this system, the product is first displayed from a default view in the product screen 100.
The default view is one in which the front of the product, for example, is viewed. The image for each of the views is lossy-compressed using JPEG or MPEG compression. This default image loads first, as shown in step 350 in Figure 3C. After the default image is loaded, the other n images, e.g. 21 other images, begin loading in the background. The HTML extension also displays arrow keys which enable rotation of the image and viewing the image from other vantage points. Depending on the number of images, each actuation of the arrow keys will select a different amount of rotation. The rotation is in actuality effected by displaying a different image. The arrows are detected in step 352, and used to select a different image. The next image is loaded. For example, if the default view is loaded (front in Figure 3A) , then an arrow to the left selects view 17 in Figure 3B. An arrow left/down (arrow 123 in Figure IB) selects view 5 in Figure 3B. Each arrow operation can be used in conjunction with the map of views to select the next view for viewing.
This HTML code can be executed by loading the first JPEG and loading the remainder in the background, or can load the views only when requested.
This system allows the web site operator to select the amount of information they want to present. The amount of change from the arrows depends on the number of images that have been loaded. A reduced data set can be provided, or more information to show more about the product packaging. The smallest data set that contemplated is n=2 which would show the front and the back of the product. As in the other embodiments, preferably enough information is provided such that each of the labels on the product can be read, either directly, or using the zoom function. A particularly preferred form of compression uses an adaptable lossy compression where parts of the product are compressed with a first compression ratio, and the parts containing the label are stored in a different way. For example, the label could have more resolution, or be stored in text form.
The concept of touch and feel is quite prevalent in a bookstore. Many bookstores are common on the web, such as BarnesandNoble.com and Amazon.com. These provide very convenient browsing for an individual who knows what book they want to buy. The individual can often see a picture of the cover of the book, and read certain reviews about the book. However, the amount of data is often limited.
Moreover, the data that is put on the website is typically data that is decided by the website designers, rather than the publishers of the book. The present paradigm allows those who package the book to decide what the book should look like, and what a buyer should see when they are thinking about buying the book.
In bookstores, readers can often sit and look at the books or even read from parts of the books. A user with enough determination can sit and read a whole book. Bookstores operate based on the assumption that most people will not read all books in that way. However, it enhances the experience of the bookstore. It allows the user to decide if they like the book or not.
The present embodiment teaches a remote information server sales paradigm, which starts by obtaining a digital image of at least parts of the book. Those digital images could be supplied by the publisher or designer and then used to provide information on the book to people reading the book. This allows the user to read parts of the book.
A problem would exist, however, if the entire book was freely available. In that case, any user could download the whole book and then read it on their computer at their leisure. Accordingly, the present system teaches limits on the amount of reading that can be done. A limit is defined that limits the amount of reading that can be done. The amount of reading is stored in a file indicating the user' s activity, e.g., a "cookie". The cookie can expire or persist, as described herein. The cookie can be stored on the information server, or on the user's home computer. If the cookie expires, then additional reading can be done later. Another embodiment defines total limits, where the user is limited in the amount that they can read any title, and the cookie does not expire.
The present system also facilitates touch and feel like in the first embodiment. However, the touch and feel is modified for use in reading a book. A reader of a book looking at the exterior of the book needs only to see the front cover, back cover and spine. There is no need to see the top, bottom or other edges that do not typically contain viewed information. In addition, certain information is often printed on insides of the covers, on, for example, the liner notes. The book is virtually openable to read those inside portions. According to this embodiment, at least the covers, the liner notes and biographic/informational notes, and the table of contents, if any are provided as digital images.
A front view of the book as displayed on the web browser is shown in Figure 4A. The view includes the front cover of the book showing an accurate depiction of the look of the book including the title, and artwork. The view has a resolution that is sufficient to enable the printing on the book to be read by a viewer. A number of additional manipulation keys are also defined to change the view of the book that is seen by a viewer. A first manipulation key 402 defines turning over the book. When the cursor is placed over this key for about 2 seconds, a small text item, a "screen tip", is displayed indicating "turn the book over". If that key is depressed, the view changes to the view shown in Figure 4B which shows the book from the back. Again, the colors and artwork of the book are accurately depicted. The printed portion of the book is displayed in a manner enabling that printed portion to be accurately read. As in the previous embodiments, this can use a graded resolution system, that provides more resolution for the readable parts of the book than is provided for the ornamental parts of the book.
An "open the book" indicia is also shown as element 506 in both the front and rear views shown in Figure 4A and 4B respectively. When the open book is actuated, the book is virtually opened. Clicking the open in Figure 4A yields the screen shown in Figure 4C which shows the first two printed pages of the book. A "zoom" function changes the operation to show only a single printed page, with enhanced detail. Clicking the open in Figure 4B yields an analogous operation of opening from the rear of the book, exactly as the book would be opened if it were placed from the rear. This operation is not shown, but would yield the last two pages of the book. The front pages and rear pages of the book often include liner notes about the book, general information about the book or its author, pictures, and the like. One or more than one page of this information can be provided.
Two indicia 422 and 424 are also displayed respectively representing page forward and page backward. The page forward advances the open page by one sheet, much as it would look if the page were turned on a book. In the dual page display of Figure 4C, this would be like paging forward in the book, to show two new pages. Page back 424 goes back by one sheet.
Note that the move keys are always shown as arrow keys. These keys change meaning based on context, but always mean that movement in some direction will be carried out .
Each open page enables reading the entire amount of print on the page. There may be no limit set for retrieval of certain pages such as liner notes, pictures and biographies, table of contents and indices. However, for actual text, some predefined limit on total new page requests can be defined. The user is allowed to read, for example, 20 pages out of the entire book. Each time a page that has a certain data type loads, it executes the flowchart of Figure 5. A next page operation at 500 first detects if a new page is being requested, at 502. If so, a count is incremented at 504. When the counter reaches a specified value detected at 506, e.g. 20 times, further requests are prohibited. The counter can be present in a cookie, and the cookie can be reset, for example, each 24 hour period. This enables the user to come back a day later and look at other pages in the same book. If the limit is not exceeded, then the page is fetched at 508. Just like being in a real bookstore -- with enough patience and ingenuity, the entire book can be read. However, at any one sitting, the user can select a certain number of pages to read. For instance, the limit can also be set to only allow certain pages to be read, such as the first chapter only.
Right clicking on any of the images brings up a context menu which enables the different possible operation, e.g., close the book, a go-to dialog enabling changing to a specified page in the book and other navigation items.
Another modification describes allowing the limits on the book reading to be lifted by payment of a fee. In this embodiment, a fee, e.g. a book reading fee, could be charged for allowing the user to read the entire book. After paying this fee, the user gets unrestricted access to the whole book. The user can read the whole book in one or many sessions. The cookie can also store a bookmark, so that the user can return to their computer during a later session, and take up reading where they left off.
This embodiment has described reading books. However, these techniques can also be used for any other system in which the merchandise can be read. This can be used with music such as Cds, videos, etc. In those cases, the entire stored information can be the inside and outside of the covers, and the liner notes that go along with the music, e.g., length of songs, band members, song lyrics, etc.
Other embodiments are within the disclosed modes. For example, the present application is described as being used with HTML over the Internet. However, it could be used with any remote information server, using any programming language. For example, this could be used over a modem or other information line that is dialed up or connected point-to-point. The screens described herein could be compiled into, for example, an executable file that is downloaded with an instruction to execute upon receipt. Then, the file is executed to allow viewing the merchandise. The limits described herein in the "book reading" embodiment could be compiled as part of the code. Also, like in the embodiment, the whole book could be downloaded, and only part of it availible for viewing. The rest would be viewable only after paying a fee. The rest could be, for example, encrypted, and the user is given the decryption code after paying the fee. The embodiment has described images being used to represent the items. However, it should be understood that other forms are possible.

Claims

What is claimed is:
1. A method, comprising: sending over a network from a server computer to a client computer, information indicative of an image to be displayed on said client computer, said sending comprising first sending a first, reduced resolution version of said information and second sending a second, improved resolution version representing three-dimensional information; first displaying, on said client computer, said first information; loading said second information over said network while said first information is being displayed; and after said second information is loaded, second displaying said second information.
2. A method as in claim 1, wherein said second displaying said second information replaces a display of said first information.
3. A method as in claim 1, wherein said first information is a two-dimensional image, and said second information is a three-dimensional image.
4. A method as in claim 1, wherein said first information is a progressively renderable image.
5. A method as in claim 1, wherein said information is information indicative of an image of a product being displayed.
6. A method as in claim 1, wherein said first image is a two-dimensional image, and said first displaying includes first displaying a lower resolution version of said two-dimensional image, and subsequently increasing a resolution of the two-dimensional image using additional information.
7. A method as in claim 6, wherein begins said loading of said second information after said lower resolution version is displayed.
8. A method as in claim 5, wherein said second image has sufficient resolution to enable reading all labels on a product represented by the image, from all angles.
9. A method as in claim 8, further comprising enabling said three-dimensional image represented by said second information to be rotated in any desired direction.
10. A method as in claim 5, wherein each view of the three-dimensional image has sufficient size and resolution to allow labels on the product to be read.
11. A method as in claim 5, wherein the second, three-dimensional image has graded resolution, wherein one part of the second information has a first resolution, and another part of the second information has a second resolution .
12. A method as in claim 11, wherein said another part is a higher resolution, used for reading labels on the product .
13. A method as in claim 11, wherein labels on the product are formed of text information.
14. A method as in claim 1, wherein said second information is a complete three-dimensional rendering.
15. A method as in claim 1, wherein said second information is a reduced data set three-dimensional rendering formed of a plurality of discrete images from different views.
16. A method as in claim 15, wherein said views include front, back, top, bottom, left and right.
17. A method as in claim 15, wherein said second displaying second information comprises first displaying a default discrete image, and while said default two- dimensional image is displayed, loading other discrete images in the background.
18. A method as in claim 5, wherein said product is a bottle.
19. A method as in claim 1, wherein said product is a book.
20. A method as in claim 1, wherein said image is an image of an entertainment media.
21. A method of selling goods over a remote information server, comprising: displaying, on a terminal of the remote information server, a simulated three-dimensional representation of a good to be sold; controlling a direction of viewing the good from multiple different directions, at least one of said directions including readable information, and wherein said displaying operates with sufficient resolution to enable reading the information from the good.
22. A method as in claim 21 wherein said simulated three-dimensional representation is a complete three- dimensional representation which can be moved continuously.
23. A method as in claim 21 wherein said simulated three-dimensional representation includes a plurality of different discrete representations.
24. A method as in claim 21 wherein said image of the good includes a first resolution portion including textural information thereon at a first resolution suitable for reading, and a second portion having information thereon at a different resolution.
25. A method as in claim 21 further comprising displaying the information on the remote information server by first displaying a low resolution version while loading the higher resolution version in the background.
26. A method as in claim 21 wherein said remote information server is the Internet.
27. A method as in claim 21 where in said good is a book and further comprising controls enabling reading at least a cover and specified pages of said book.
28. A method, comprising: obtaining an product to sell; obtaining electronic packaging information associated with said product to sell, along with said product; and displaying said object over a remote information server, or displaying said electronic packaging information associated with said product.
29. A method as in claim 28, wherein said remote information server is the Internet.
30. A method as in claim 29, wherein said electronic packaging information includes at least a shape of the overall package for the product.
31. A method as in claim 29, wherein said electronic packaging includes at least readable labels for the product .
32. A method as in claim 31, wherein said product is a product which is sold in a bottle.
33. A method as in claim 31, wherein said product is entertainment media, and said labels includes liner notes from the entertainment media.
34. A method as in claim 31, wherein said product is a book, and said labels include at least liner notes of the book.
35. A method comprising: detecting a request from a user on a client connected to a network for more information about a specified product; responsive to said request, sending first information about said product to said client, said first information including a reduced data set indicative of data from which a first image of said product can be viewed; causing said client to display first image; while said client is displaying said first image, sending said client additional information indicative of a simulated three-dimensional view of said product; and subsequently displaying said three-dimensional view.
36. A method as in claim 35, further comprising subsequently allowing a user at the client to view the product from different perspectives.
37. A method as in claim 36, wherein the product is an product that comes in a bottle.
38. A method as in claim 36, wherein the product is a book.
39. A method as in claim 36, wherein the product is an entertainment medium.
40. A method, comprising: forming a three-dimensional representation of an object in graded resolution in which one part of the has representation more resolution than another part of the representation; sending said graded resolution representation over a network to a client; and displaying said graded resolution image at said client site .
41. A method as in claim 40, wherein said object is a product, and a label of the product has a different resolution than other parts of the product.
42. A method as in claim 41, wherein said label has a higher resolution.
43. A method as in claim 42, wherein said label is represented by text indicative of the printed information on the label.
44. A method as in claim 40, wherein said network is the Internet.
45. A method as in claim 44, wherein labels are formed with a higher resolution than at least one other part of the image.
46. A method as in claim 40, wherein the object representation is formed of different zones, each having a different kind of information.
47. A method as in claim 46, wherein information on a readable portion of said object is in a format which includes text, and a look of the text.
48. A method as in claim 40, further comprising enabling the object to be rotated on the client.
49. A method as in claim 48, wherein said representation includes both two-dimensional and three- dimensional information.
50. A method, comprising: obtaining information including an image of both a product, and an outer packaging that is separate from the product; sending said information from a server of a network to a client of the network; and at the client of the network, allowing the user to view said outer packaging, and also to virtually remove said outer packaging to view said product.
51. A method as in claim 50, wherein said outer packaging is a three-dimensional representation of a box covering the product, and said inner packaging is the product itself.
52. A method as in claim 51, further comprising virtually opening the box.
53. A method as in claim 51, further comprising displaying a control enabling opening the box to reveal the product inside.
54. A method as in claim 50, wherein said information is three-dimensional image information comprising a three- dimensional view of the product and the box.
55. A method as in claim 50, wherein said product information comprises a plurality of discrete two- dimensional views collectively forming a simulated three- dimensional view.
56. A method as in claim 55, wherein a current view is loaded at a first time, and other views are loaded at a second time.
57. A method as in claim 56, wherein said second time is in the background while the current view is being displayed.
58. A method as in claim 56, wherein said second time is when requested.
59. A method as in claim 50, wherein said network is the Internet.
60. A method as in claim 50, further comprising displaying by first loading a reduced resolution image, displaying said reduced resolution image, and then loading an increased resolution image.
61. A method as in claim 60, wherein said reduced resolution image is a two-dimensional representation, and said increased resolution image is a three-dimensional image .
62. A method of displaying a simulated three- dimensional image, comprising: first, obtaining a simulated three-dimensional representation of an object, which represents the object from multiple points of view, each of said multiple points of view being a discrete representation of the object; sending a first of said discrete images over a network to a client of the network, and displaying said discrete image on said client of the network; detecting a request for a different view on a client of the network; and displaying said different view.
63. A method as in claim 62, further comprising loading other discrete views in the background, while the first view is being displayed.
64. A method as in claim 62, further comprising loading an additional view when requested.
65. A method as in claim 62, wherein each of said views comprise compressed image versions.
66. A method as in claim 62, wherein there are n images representing different views from different discrete angles, further comprising loading a default image first, displaying said default image, and, after the default image is loaded, loading the other n-1 images in the background.
67. A method as in claim 66, further comprising displaying, on the client, a rotation requesting key.
68. A method as in claim 67, further comprising: detecting a request for rotation; determining a different image which would be seen based on the requested rotation; and displaying said different image responsive to the request .
69. A method as in claim 62, wherein the representation is product packaging.
70. A method as in claim 69, wherein the network is the internet.
71. A method as in claim 69, wherein the product is a book.
72. A method as in claim 69, wherein the product is a product in a bottle.
73. A method as in claim 62, further comprising determining different parts of the packaging, storing an image of the first part of the packaging using a first compression technique and storing an image of a second part of the packaging using a second compression technique.
74. A method comprising: obtaining a plurality of images representing information about contents of a book, at least some of said images including readable information; detecting a request for specific book information from a client, over a network; determining a previous number of requests from said client about said book; and sending said information to said client.
75. A method as in claim 74, further comprising determining if said number of requests is greater than a predetermined number, and sending said information only if said number is not greater than said predetermined number.
76. A method as in claim 74, wherein said information comprises images of a jacket of the book, and images of text on the jacket of the book.
77. A method as in claim 76, wherein said information further comprises information about pages of the book.
78. A method as in claim 74, wherein said information on pages of the book includes text information.
79. A method as in claim 74, wherein one of said images comprises multiple zones of information including a first zone of decorative information and a second zone of readable information, said first and second zones being stored in different ways.
80. A method as in claim 79, wherein said second zone of readable information is stored as text.
81. A method as in claim 79, wherein said first zone of decorative information is stored as a compressed image.
82. A method as in claim 75, wherein said network is the internet.
83. A method, comprising: in a server of a network, storing a plurality of images representing pages of a book, said images stored with a resolution effective to enable said book to be read; and responsive to a request over the network, sending one of said images to a remote node.
84. A method as in claim 83, wherein said network is the internet.
85. A method as in claim 84, further comprising determining if the request for pages exceeds a certain threshold, and sending said information only if said threshold is not exceeded.
86. A method as in claim 85, wherein said images are classified according to whether they count towards said threshold, and incrementing a counter when an image that counts towards said threshold is requested.
87. A method as in claim 85 wherein said determining comprises storing information indicative of an amount of reading into a computer file.
88. A method as in claim 87 wherein said computer file is a cookie.
89. A method as in claim 87 wherein said computer file is persistent.
90. A method as in claim 87 wherein said computer file expires after a predetermined time.
91. A method comprising: receiving, at a client of a network, information about which of a specified plurality of images to be displayed, each of specified plurality of images showing textual information and at least a plurality of said images showing non-textual information, said textual information representative of contents of an entertainment media; and displaying said images responsive to said requests.
92. A method as in claim 91 wherein said information media is a book.
93. A method as in claim 91 wherein one of said images includes liner notes.
94. A method as in claim 91 wherein said specified images include a front, a back cover, a spine, and liner notes .
95. A method as in claim 94 wherein said images do not include an image of a top edge of the book and an image of a bottom edge of the book.
96. A method as in claim 92 further comprising displaying a screen tip, indicating what the reaction will be to a specified operation.
97. A method as in claim 92 further comprising commanding an opening of the book to see an inside of the book.
98. A method as in claim 91 wherein each of said images use a graded resolution, which provides readable resolution for readable parts and a different resolution for non-readable parts.
99. A method as in claim 91 wherein said readable parts are in a text format and said different parts are in an image format.
100. A method as in claim 91 further comprising displaying keys which enable moving a position of viewing.
101. A method as in claim 100 wherein said keys change meaning depending on their position.
102. A method as in claim 91 further comprising detecting a number of pages that have been read, and limiting use to said number of pages.
103. A method as in claim 102 further comprising detecting a type of page which is being requested, and limiting use of only a specified type page.
104. A method as in claim 91 wherein said network is the Internet.
105. A method of reading a book over the Internet, comprising: requesting a page of a book on a client of the Internet; determining, in a server of the Internet, if more than a specified number of pages of said book have been requested by a specified user; and sending said page only if the specified number of pages does not exceed a threshold.
106. A method as in claim 105 wherein the specified pages are specified types of pages, and wherein non- specified types of pages are sent without said limit.
107. A method as in claim 105 further comprising allowing the user to read beyond the specified number of pages after paying a fee.
108. An apparatus comprising: a client computer, connected to a network, said client computer operating to display a first image indicative of a reduced resolution version of an image to be displayed, and a second image indicative of an increased resolution version of information to be displayed, said second image comprising three-dimensional information, and a process, running in said client computer, which first displays said first information, and second loads said second information while said first information is being loaded.
109. An apparatus as in claim 108 further comprising a network server which stores said images.
110. An apparatus as in claim 109 wherein said network server stores a reduced quality three-dimensional image and an increased quality three-dimensional image.
111. A method of manufacturing and selling products comprising: at a manufacturer, designing packaging material to use for housing said product; housing said product using said packaging material; also forming an electronic version of said packaging material; and selling said product to a distributor along with both said non-electronic and said electronic packaging material.
112. A method as in claim 111 wherein said selling comprises displaying said product for sale over the Internet using said electronic packaging material.
113. A method as in claim 24 wherein said second resolution is a lower resolution then said first resolution.
114. A method as in claim 51, further comprising enabling viewing the box from a plurality of different angles .
115. A method as in claim 91 wherein said information media includes video or audio-containing information.
PCT/US2000/026128 1999-09-22 2000-09-21 Enhancing touch and feel on the internet WO2001022298A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU40205/01A AU4020501A (en) 1999-09-22 2000-09-21 Enhancing touch and feel on the internet

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US15554399P 1999-09-22 1999-09-22
US60/155,543 1999-09-22
US09/505,646 2000-02-16
US09/505,646 US7111252B1 (en) 1999-09-22 2000-02-16 Enhancing touch and feel on the internet

Publications (1)

Publication Number Publication Date
WO2001022298A1 true WO2001022298A1 (en) 2001-03-29

Family

ID=26852399

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/026128 WO2001022298A1 (en) 1999-09-22 2000-09-21 Enhancing touch and feel on the internet

Country Status (3)

Country Link
US (5) US7111252B1 (en)
AU (1) AU4020501A (en)
WO (1) WO2001022298A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003084231A2 (en) * 2002-03-28 2003-10-09 Superscape Group Plc Item display
KR101741426B1 (en) 2008-12-24 2017-05-30 더 킹덤 오드 더 네덜란드, 레프리젠티드 바이 더 미니스트리 오브 헬스, 웰페어 앤드 스포츠, 온 비하프 오브 더 미니스터, 더 내셔널 인스티튜트 포 퍼블릭 헬스 앤드 디 인바이런먼트 Modified Streptococcus pneumonia pneumolysin (PLY) polypeptides

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7111252B1 (en) 1999-09-22 2006-09-19 Harris Scott C Enhancing touch and feel on the internet
US7346543B1 (en) 2000-02-24 2008-03-18 Edmark Tomima L Virtual showroom method
JP2002312694A (en) * 2001-01-24 2002-10-25 Sony Computer Entertainment Inc Electronic commerce system, and device and method for supporting merchandise purchase
US7096187B1 (en) 2002-07-23 2006-08-22 Harris Scott C Compressed audio information
US11481834B2 (en) 2006-07-07 2022-10-25 Joseph R. Dollens Method and system for managing and displaying product images with progressive resolution display with artificial realities
US8554639B2 (en) * 2006-07-07 2013-10-08 Joseph R. Dollens Method and system for managing and displaying product images
US9691098B2 (en) * 2006-07-07 2017-06-27 Joseph R. Dollens Method and system for managing and displaying product images with cloud computing
US8260689B2 (en) * 2006-07-07 2012-09-04 Dollens Joseph R Method and system for managing and displaying product images
US11049175B2 (en) 2006-07-07 2021-06-29 Joseph R. Dollens Method and system for managing and displaying product images with progressive resolution display with audio commands and responses
US10614513B2 (en) * 2006-07-07 2020-04-07 Joseph R. Dollens Method and system for managing and displaying product images with progressive resolution display
KR102204485B1 (en) * 2007-09-26 2021-01-19 에이큐 미디어 인크 Audio-visual navigation and communication
US9052797B2 (en) * 2007-09-26 2015-06-09 Autodesk, Inc. Navigation system for a 3D virtual scene
US11157977B1 (en) 2007-10-26 2021-10-26 Zazzle Inc. Sales system using apparel modeling system and method
US20090164273A1 (en) * 2007-12-21 2009-06-25 Glyde Corporation Product distribution system and method thereof
US7831584B2 (en) 2007-12-21 2010-11-09 Glyde Corporation System and method for providing real-time search results on merchandise
US8244590B2 (en) * 2007-12-21 2012-08-14 Glyde Corporation Software system for decentralizing ecommerce with single page buy
US8630923B2 (en) * 2007-12-21 2014-01-14 Glyde Corporation Virtual shelf with single-product choice and automatic multiple-vendor selection
US20090164339A1 (en) * 2007-12-21 2009-06-25 Glyde Corporation 3d product display on internet with content or transaction data on back of image
US8447645B2 (en) * 2007-12-21 2013-05-21 Glyde Corporation System and method for dynamic product pricing
US7899716B2 (en) * 2007-12-21 2011-03-01 Glyde Corporation System and method for integrated payment and shipping information
WO2010014750A1 (en) * 2008-07-29 2010-02-04 Zazzle.Com, Inc. Product customization system and method
US10719862B2 (en) 2008-07-29 2020-07-21 Zazzle Inc. System and method for intake of manufacturing patterns and applying them to the automated production of interactive, customizable product
GB2466652A (en) * 2008-12-31 2010-07-07 Generated Packaging Ltd Comp Animating product packaging emphasising product code
US8819541B2 (en) * 2009-02-13 2014-08-26 Language Technologies, Inc. System and method for converting the digital typesetting documents used in publishing to a device-specfic format for electronic publishing
US20130246917A1 (en) * 2010-03-17 2013-09-19 Andrew Neil Carne Virtual Representation of a Media Product
US8620749B2 (en) 2011-06-20 2013-12-31 Glyde Corporation Customized offers for E-commerce
US10969743B2 (en) 2011-12-29 2021-04-06 Zazzle Inc. System and method for the efficient recording of large aperture wave fronts of visible and near visible light
US9104298B1 (en) * 2013-05-10 2015-08-11 Trade Only Limited Systems, methods, and devices for integrated product and electronic image fulfillment
US10482512B2 (en) 2013-05-31 2019-11-19 Michele Meek Systems and methods for facilitating the retail shopping experience online
US9684440B2 (en) * 2014-06-30 2017-06-20 Apple Inc. Progressive rotational view
JP6349618B2 (en) * 2015-07-13 2018-07-04 スター精密株式会社 Information provision system by data relay application
US10004991B2 (en) 2016-06-28 2018-06-26 Hothead Games Inc. Systems and methods for customized camera views in virtualized environments
US10157408B2 (en) 2016-07-29 2018-12-18 Customer Focus Software Limited Method, systems, and devices for integrated product and electronic image fulfillment from database
KR102597036B1 (en) 2016-10-11 2023-11-02 삼성전자주식회사 electronic device having a dual-display and operating method thereof
US10387968B2 (en) * 2017-01-26 2019-08-20 Intuit Inc. Method to determine account similarity in an online accounting system
US10248971B2 (en) 2017-09-07 2019-04-02 Customer Focus Software Limited Methods, systems, and devices for dynamically generating a personalized advertisement on a website for manufacturing customizable products

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5848399A (en) * 1993-11-30 1998-12-08 Burke; Raymond R. Computer system for allowing a consumer to purchase packaged goods at home
US5850352A (en) * 1995-03-31 1998-12-15 The Regents Of The University Of California Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images
US5930501A (en) * 1996-09-20 1999-07-27 Neil; John M. Pictorial user interface for establishing time of day and geographical or environmental context on a computer display or other monitor
US6058397A (en) * 1997-04-08 2000-05-02 Mitsubishi Electric Information Technology Center America, Inc. 3D virtual environment creation management and delivery system

Family Cites Families (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4796201A (en) 1985-04-30 1989-01-03 Wake Warren K Stored program controlled system for creating and printing graphics bearing packaging
US5214695A (en) * 1990-07-23 1993-05-25 International Business Machines Corporation Apparatus and method for loading a system reference diskette image from a system partition in a personal computer system
AU8415891A (en) 1990-07-27 1992-03-02 Harvey M. Ross System and method of manufacturing a single book copy
US5259515A (en) * 1991-12-12 1993-11-09 Gressco, Ltd. Rotatable display tower for audio cassette tapes and the like
US5214696A (en) * 1992-02-04 1993-05-25 International Business Machines Corporation Data processing system and method to produce softcopy book readers which are limited to reading only books published by a specific publisher
JP2659896B2 (en) 1992-04-29 1997-09-30 インターナショナル・ビジネス・マシーンズ・コーポレイション Structured document copy management method and structured document copy management device
US5321520A (en) * 1992-07-20 1994-06-14 Automated Medical Access Corporation Automated high definition/resolution image storage, retrieval and transmission system
JPH0696100A (en) 1992-09-09 1994-04-08 Mitsubishi Electric Corp Remote transaction system
US7835989B1 (en) 1992-12-09 2010-11-16 Discovery Communications, Inc. Electronic book alternative delivery systems
US7401286B1 (en) 1993-12-02 2008-07-15 Discovery Communications, Inc. Electronic book electronic links
US5463725A (en) 1992-12-31 1995-10-31 International Business Machines Corp. Data processing system graphical user interface which emulates printed material
US6243071B1 (en) 1993-11-03 2001-06-05 Apple Computer, Inc. Tool set for navigating through an electronic book
US5751931A (en) 1995-04-18 1998-05-12 Lucent Technologies Inc. Three dimensional graphical display of information
US5781189A (en) 1995-05-05 1998-07-14 Apple Computer, Inc. Embedding internet browser/buttons within components of a network component system
US5675377A (en) * 1995-06-30 1997-10-07 Telefonaktiebolaget Lm Ericsson True three-dimensional imaging and display system
US6486895B1 (en) * 1995-09-08 2002-11-26 Xerox Corporation Display system for displaying lists of linked documents
US5748188A (en) 1995-10-12 1998-05-05 Ncr Corporation Hypertext markup language (HTML) extensions for graphical reporting over an internet
US5852800A (en) * 1995-10-20 1998-12-22 Liquid Audio, Inc. Method and apparatus for user controlled modulation and mixing of digitally stored compressed data
US5761485A (en) 1995-12-01 1998-06-02 Munyan; Daniel E. Personal electronic book system
US5781198A (en) * 1995-12-22 1998-07-14 Intel Corporation Method and apparatus for replacing a background portion of an image
WO1997025798A1 (en) * 1996-01-11 1997-07-17 Mrj, Inc. System for controlling access and distribution of digital property
US5988862A (en) 1996-04-24 1999-11-23 Cyra Technologies, Inc. Integrated system for quickly and accurately imaging and modeling three dimensional objects
US5745109A (en) 1996-04-30 1998-04-28 Sony Corporation Menu display interface with miniature windows corresponding to each page
US6311197B2 (en) * 1996-06-03 2001-10-30 Webtv Networks, Inc. Method for downloading a web page to a client for efficient display on a television screen
US5870220A (en) 1996-07-12 1999-02-09 Real-Time Geometry Corporation Portable 3-D scanning system and method for rapid shape digitizing and adaptive mesh generation
US5956034A (en) * 1996-08-13 1999-09-21 Softbook Press, Inc. Method and apparatus for viewing electronic reading materials
US5838326A (en) 1996-09-26 1998-11-17 Xerox Corporation System for moving document objects in a 3-D workspace
US5926179A (en) 1996-09-30 1999-07-20 Sony Corporation Three-dimensional virtual reality space display processing apparatus, a three-dimensional virtual reality space display processing method, and an information providing medium
US5930769A (en) 1996-10-07 1999-07-27 Rose; Andrea System and method for fashion shopping
US6123733A (en) * 1996-11-27 2000-09-26 Voxel, Inc. Method and apparatus for rapidly evaluating digital data processing parameters
US5841440A (en) 1996-12-17 1998-11-24 Apple Computer, Inc. System and method for using a pointing device to indicate movement through three-dimensional space
EP0990224B1 (en) 1997-06-17 2002-08-28 BRITISH TELECOMMUNICATIONS public limited company Generating an image of a three-dimensional object
US6029141A (en) * 1997-06-27 2000-02-22 Amazon.Com, Inc. Internet-based customer referral system
US6037954A (en) 1997-07-23 2000-03-14 Mcmahon; M. James Portable hand-held reading device
US5957697A (en) * 1997-08-20 1999-09-28 Ithaca Media Corporation Printed book augmented with an electronic virtual book and associated electronic data
US5907328A (en) 1997-08-27 1999-05-25 International Business Machines Corporation Automatic and configurable viewpoint switching in a 3D scene
US20020019950A1 (en) 1997-11-26 2002-02-14 Huffman James R. System for inhibiting the operation of an electronic device during take-off and landing of an aircraft
US6038598A (en) * 1998-02-23 2000-03-14 Intel Corporation Method of providing one of a plurality of web pages mapped to a single uniform resource locator (URL) based on evaluation of a condition
US6201546B1 (en) * 1998-05-29 2001-03-13 Point Cloud, Inc. Systems and methods for generating three dimensional, textured models
US6241086B1 (en) * 1998-07-07 2001-06-05 Case Logic, Inc. Sleeve for holding digital video discs and graphics
US6144958A (en) * 1998-07-15 2000-11-07 Amazon.Com, Inc. System and method for correcting spelling errors in search queries
US6157392A (en) * 1998-07-20 2000-12-05 Micron Technology, Inc. Animation packager for an on-line book
US6307544B1 (en) 1998-07-23 2001-10-23 International Business Machines Corporation Method and apparatus for delivering a dynamic context sensitive integrated user assistance solution
US6243093B1 (en) * 1998-09-14 2001-06-05 Microsoft Corporation Methods, apparatus and data structures for providing a user interface, which exploits spatial memory in three-dimensions, to objects and which visually groups matching objects
US6275934B1 (en) 1998-10-16 2001-08-14 Soft Book Press, Inc. Authentication for information exchange over a communication network
US6748419B2 (en) 1998-11-25 2004-06-08 Alibre, Inc. System and method for solid modeling
US6384846B1 (en) * 1998-12-11 2002-05-07 Hitachi America Ltd. Methods and apparatus for rendering multiple images using a limited rendering resource
US7353192B1 (en) * 1999-02-16 2008-04-01 Autobytel Inc. Product configuration display system and method with user requested physical product alterations
US6307562B1 (en) 1999-03-15 2001-10-23 Sun Microsystems, Inc. Graphical interface with event horizon
JP3798571B2 (en) * 1999-04-14 2006-07-19 株式会社東芝 Protective device
US6522769B1 (en) * 1999-05-19 2003-02-18 Digimarc Corporation Reconfiguring a watermark detector
US8738471B2 (en) * 1999-09-22 2014-05-27 Scott C. Harris Enhancing touch and feel on the internet
US7111252B1 (en) * 1999-09-22 2006-09-19 Harris Scott C Enhancing touch and feel on the internet
US6868405B1 (en) 1999-11-29 2005-03-15 Microsoft Corporation Copy detection for digitally-formatted works
US6933928B1 (en) * 2000-07-18 2005-08-23 Scott E. Lilienthal Electronic book player with audio synchronization
US20030018543A1 (en) 2001-06-25 2003-01-23 Alger Jeffrey H. Client portal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5848399A (en) * 1993-11-30 1998-12-08 Burke; Raymond R. Computer system for allowing a consumer to purchase packaged goods at home
US5850352A (en) * 1995-03-31 1998-12-15 The Regents Of The University Of California Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images
US5930501A (en) * 1996-09-20 1999-07-27 Neil; John M. Pictorial user interface for establishing time of day and geographical or environmental context on a computer display or other monitor
US6058397A (en) * 1997-04-08 2000-05-02 Mitsubishi Electric Information Technology Center America, Inc. 3D virtual environment creation management and delivery system

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003084231A2 (en) * 2002-03-28 2003-10-09 Superscape Group Plc Item display
WO2003084231A3 (en) * 2002-03-28 2004-05-06 Superscape Group Plc Item display
GB2401504A (en) * 2002-03-28 2004-11-10 Superscape Group Plc Item display
GB2401504B (en) * 2002-03-28 2006-03-22 Superscape Group Plc Item display
KR101741426B1 (en) 2008-12-24 2017-05-30 더 킹덤 오드 더 네덜란드, 레프리젠티드 바이 더 미니스트리 오브 헬스, 웰페어 앤드 스포츠, 온 비하프 오브 더 미니스터, 더 내셔널 인스티튜트 포 퍼블릭 헬스 앤드 디 인바이런먼트 Modified Streptococcus pneumonia pneumolysin (PLY) polypeptides

Also Published As

Publication number Publication date
US7111252B1 (en) 2006-09-19
US9582824B2 (en) 2017-02-28
US20060178952A1 (en) 2006-08-10
US20060218055A1 (en) 2006-09-28
US20150019379A1 (en) 2015-01-15
AU4020501A (en) 2001-04-24
US8086505B2 (en) 2011-12-27
US8850361B2 (en) 2014-09-30
US20090055289A1 (en) 2009-02-26
US8103973B2 (en) 2012-01-24

Similar Documents

Publication Publication Date Title
US9582824B2 (en) Enhancing touch and feel on the Internet
US20200175580A1 (en) 3d imaging
US10552897B2 (en) 3D imaging
US6922815B2 (en) Display method and apparatus for facilitating interaction with Web sites
US6026377A (en) Computer system for allowing a consumer to purchase packaged goods at home
EP2357623A1 (en) Graphical user interface for browsing, searching and presenting media items
US20090210790A1 (en) Interactive video
WO2004034280A1 (en) System and method for selecting, ordering and accessing copyrighted information from physical documents
KR20020084148A (en) Natural user interface for virtual reality shopping systems
JP2001160069A5 (en)
US8738471B2 (en) Enhancing touch and feel on the internet
US6985897B1 (en) Method and system for animated and personalized on-line product presentation
US7617135B2 (en) Enhancing touch and feel on the internet
KR20000049801A (en) Operating method of 3D shopping mall by using virtual reality and its device
JP5041530B2 (en) Product sales system
JP4190092B2 (en) Content providing device
WO2011009141A1 (en) System and method for conducting transactions from third party sites
WO2011114154A1 (en) Virtual representation of a media product
JP2002215913A (en) On-demand book buying method
WO2005041099A1 (en) Virtual shopping system
JP2008135050A (en) Content providing apparatus
CN116910390A (en) Method for providing content and features for an object
JP2001175738A (en) Information data sales system and information data sales system method

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP