CA2131221C - Method and apparatus for rendering objects on a display with added realism - Google Patents
Method and apparatus for rendering objects on a display with added realism Download PDFInfo
- Publication number
- CA2131221C CA2131221C CA002131221A CA2131221A CA2131221C CA 2131221 C CA2131221 C CA 2131221C CA 002131221 A CA002131221 A CA 002131221A CA 2131221 A CA2131221 A CA 2131221A CA 2131221 C CA2131221 C CA 2131221C
- Authority
- CA
- Canada
- Prior art keywords
- objects
- predetermined
- image
- rendering
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 88
- 238000000034 method Methods 0.000 title claims description 21
- 230000000694 effects Effects 0.000 claims abstract description 26
- 230000009466 transformation Effects 0.000 claims description 2
- 241000475481 Nebula Species 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
Abstract
The graphics applications of a 2-D graphics computer system provide each object to be rendered on a 2-D raster display with a pair of rendering reference coordinates (x and y), and a relative depth value (z).
Additionally, the computer system is provided with a library of predetermined D images and sounds, and a number of graphics toolkit routines. As the user "moves", the graphics toolkit routines render selected ones of the predetermined images based on x/z and y/z values of recomputed x and y rendering coordinates and the relative depths value z of the objects, and actuate the sounds if applicable based on their predetermined manners of rendering.
As a result, the objects that are further away from the user will move slower than the objects that are closer to the user, thereby introducing the effect of parallax and added realism to the 2-D graphics computer system at a substantially lower cost.
Additionally, the computer system is provided with a library of predetermined D images and sounds, and a number of graphics toolkit routines. As the user "moves", the graphics toolkit routines render selected ones of the predetermined images based on x/z and y/z values of recomputed x and y rendering coordinates and the relative depths value z of the objects, and actuate the sounds if applicable based on their predetermined manners of rendering.
As a result, the objects that are further away from the user will move slower than the objects that are closer to the user, thereby introducing the effect of parallax and added realism to the 2-D graphics computer system at a substantially lower cost.
Description
w ~~.a ~~~~~
~ACKGEiOUNI~ ~F THh Ii~V~tdT'B(91~J
1. Field of the Invention: -The present invention relates to the field of computer graphics, including graphical user interfaces. More specifically, the present invention relates to a method and apparatus for rendering objects in a computer display with added realism.
~ACKGEiOUNI~ ~F THh Ii~V~tdT'B(91~J
1. Field of the Invention: -The present invention relates to the field of computer graphics, including graphical user interfaces. More specifically, the present invention relates to a method and apparatus for rendering objects in a computer display with added realism.
2. l3ec ~ round:
In a 3-D graphics computer system having a 2-D tester display, realistic 3-D effects are typically achieved by rendering objects on the 2-D
raster display using perspective algorithms. A perspective algorithm well known in the art is the "z-divide" algorithm. Under this approach, ev~ry point of every object to be rendered has a triplet of coordinates (x, y, z) associated with it. Before the objects are rendered, the x and y coordinates of all points of all objects, are divided by their corresponding z values. The objects are then rendered by rendering all points in accordance with the computed x/z and y/z values. An example of such 3-D graphics computer systems is the Sparcstation~, manufactured by Sun Microsystems Inc., of Mountain View, California, embodied with the Programmer's Hierarchical Interactive Graphics System (I'hiIGS) (Sparcstation is a registered trademartc of Sun Microsystems). The 3-D effects are realistically achieved. because the z-divides are performed for ail points of all objects to be rendered, and the amount of computations, and therefore the resources in terms o9 CPU time and storage required, are substantial. As a result, Naughcon and Flank 1 82225.p458 M&A Fot Rendetin8 Objects inn A Display ATA/yh With Added Realism ~~e~~N~~
~-D graphics computer systems tend to be more costly than other non-three dim~nsional display systems.
In 2-D graphics computer systems, objects are rendered on the 2-D
- raster display through parallel projections. The user's eye is set at infinity. Using this approach, every object to be rendered has a pair of coordinates (x, y) associat~d with it. Beyond the x and y coordinates, only a "depth" order is provided for determining which object gets displayed when two objects overlap.
Particular ~xamples of such 2-D graphics computer systems include the Macintosh~ computer systems, manufactured by Apple Computer, Inc. of Cupertino, California, and various personal computers based on the X'86 microprocessor of lntei, Inc., of Santa Clare, California, manufactured by IBM
of Armonk, New York, and other vendors, embodied with th~ i~Nindow~ system of Microsoft, Inc. of Redmond, lNashington (Macintosh is a registered trademark of Apple Computer and 9Nindow is a trademark of Microsoft). Since there are no z-divides to be performed for every point of every object to be rendered, the amount of computations, and therefore the resources required, are substantially less.
As a result, 2-D graphics computer systems tend to be relatively less expensive than their three dimensionat counterparts.
However, the 3-D affects are not realistically achieved on these 2-D
graphics a~mputer systems. For example, as the user's viewpoint (location) changes, objects at different depths wiH move the same distance. This is not what happens in the real world, where the user will see the effect of parallax.
That is, objects closer to the user will appear to move more in distanc~, while objects further away from the user will appear to move a little bit, if at all.
Naughton and Frank 2 82225.P458 M&A For Rendering Objecas On A Display ATA/yh W ith Added Realism --, Thus, it is desirable to be able to render objects on a 2-D raster display of a 2-D graphics computer system with added realism, without requiring the amount of computations and the resources of a 3-D graphics computer system. More specifically, it is desirable to ba able to introduce the parallax effect to objects rendered in a less costly manner. As will be disclosed, the present invention provides for such a method and apparatus which advantageously achieves the desired results.
Naughton and Frank 3 82225.P45$
M6iA Fa Rendeaatg Objects O~ A Display ATA/~h With Added Realism ~~.~~a.~~:1 Under the present invention, the desired results are advantageously achieved by having the graphics applications of a 2-D graphics computer system provide each object to be rendered on a 2-D raster display of the computer system with a pair of rendering reference coordinates (x and y), and a relative depth value (z). The x and y rendering reference coordinates and the relative depth value z of an object describe the geometric location of the object relative to the user's eye, which is set at a predetermined location.
l~dditionally, the 2-D graphics computer system is provided with a library of predetermined 2-D images and a number of graphics toolkit routines.
The library comprises at least one predetermined 2-D image for each object to be rendered on th~ 2-D raster display. Each of the at least on~ pr~determined 2-D
image is the image of the object to be rendered in a display sector of the 2-D
raster display. Each predetermined 2-D image has a first and a second rendering control value for controlling the rendering of the particular predetermined 2-D
image in the corresponding display sector. The graphics toolkit routines cooperate with the graphic applications and the library to introduce the parallax effect to the objects being rendered.
As the user "moves" relative to the objects rendered, the graphics toolkit routines recompute the x and y rendering reference coordinates and the relative depth value z of the objects. Then the graphics toolkit routines divide the x and y rendering reference coordinates of each object by its relative depth value z. Next, the graphics toolkit routines select, for each object, a predetermined 2-D
Naughton and Frank 4 82225.P458 MdcA For Ravdautg Objaa~ On A Desplay ATA/jh With Added Realisra~
a image from each object's at least one predetermined 2-D
image, using the object's x/z and y/z values. Finally, the graphics toolkit routines cause the selected predetermined 2-D images of the objects to be rendered using the objects' x/z and y/z values as the rendering controlling values.
As a result, the objects that are further away from the user will appear to move slower than the objects that are closer to the user, thereby introducing the effect of parallax and added realism to the 2-D graphics computer system. However, because the graphics toolkit routines perform the z-divides only once per object, rather than as many times as the number of points in an object to be rendered, the number of computations, and therefore the resources required, are substantially less than a 3-D graphics computer system. Thus, the added reaslism is achieved at a substantially lower cost.
In the presently preferred embodiment, the 2-D
graphics computer system further includes a pair of stereo speakers. The library further comprises predetermined sounds for a subset of the objects. Each of these objects is provided with at least one predetermined stereo sound pair. Each of the at least one predetermined stereo sound pair describes the characteristics of the predetermined sound to be v rendered in the speakers, and has a pair of left and right rendering control values.
In one aspect, the present invention relates to a computer system comprising a raster display, a method for generating and displaying at least txo objects at different depths on said raster display arith added realism, said method comprising the steps of:
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set'of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f(z)) of said z values to 5a v generate a parallax effect between said at least two objects;
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selecting a pr~determined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
In a further aspect, the present invention provides in an apparatus for generating and displaying at least two objects at different depths on said raster display with added realism, said apparatus comprising:
storage means for storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computation means for computing a pair of x and y rendering reference coordinates and a relative depth 5b value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
transformation means coupled to said computation means for computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function (f(z)) of said z value to generate a parallax effect between said at least two objects;
means for modifying the transformed set of coordinates by a selected factor to enhance the parallax effect selection means coupled to said storage means and said adjustment means for selecting a predetermined 2-D
image for each of said objects based on said transformed set of coordinates; and rendering means coupled to said selection means for rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
Tn a still further aspect, the present invention provides a computer readable medium containing 5c instructions for controlling a computer system having a display to perform a method for generating and displaying at least two objects at different depths on said display pith added realism, the method comprising:
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D iatage of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined Z-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relata.ve d~pth values of said obj~cts describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f (z) ) of said z values to generate a parallax effect between said at least tyro objects;
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
5d selecting a predetermined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
5e l3RiE ~~S~~JLP~~L~F Zb.
FICl3RE 9 is a system view of an exemplary ~-D graphics computer system incorporating the teachings of the present invention.
In a 3-D graphics computer system having a 2-D tester display, realistic 3-D effects are typically achieved by rendering objects on the 2-D
raster display using perspective algorithms. A perspective algorithm well known in the art is the "z-divide" algorithm. Under this approach, ev~ry point of every object to be rendered has a triplet of coordinates (x, y, z) associated with it. Before the objects are rendered, the x and y coordinates of all points of all objects, are divided by their corresponding z values. The objects are then rendered by rendering all points in accordance with the computed x/z and y/z values. An example of such 3-D graphics computer systems is the Sparcstation~, manufactured by Sun Microsystems Inc., of Mountain View, California, embodied with the Programmer's Hierarchical Interactive Graphics System (I'hiIGS) (Sparcstation is a registered trademartc of Sun Microsystems). The 3-D effects are realistically achieved. because the z-divides are performed for ail points of all objects to be rendered, and the amount of computations, and therefore the resources in terms o9 CPU time and storage required, are substantial. As a result, Naughcon and Flank 1 82225.p458 M&A Fot Rendetin8 Objects inn A Display ATA/yh With Added Realism ~~e~~N~~
~-D graphics computer systems tend to be more costly than other non-three dim~nsional display systems.
In 2-D graphics computer systems, objects are rendered on the 2-D
- raster display through parallel projections. The user's eye is set at infinity. Using this approach, every object to be rendered has a pair of coordinates (x, y) associat~d with it. Beyond the x and y coordinates, only a "depth" order is provided for determining which object gets displayed when two objects overlap.
Particular ~xamples of such 2-D graphics computer systems include the Macintosh~ computer systems, manufactured by Apple Computer, Inc. of Cupertino, California, and various personal computers based on the X'86 microprocessor of lntei, Inc., of Santa Clare, California, manufactured by IBM
of Armonk, New York, and other vendors, embodied with th~ i~Nindow~ system of Microsoft, Inc. of Redmond, lNashington (Macintosh is a registered trademark of Apple Computer and 9Nindow is a trademark of Microsoft). Since there are no z-divides to be performed for every point of every object to be rendered, the amount of computations, and therefore the resources required, are substantially less.
As a result, 2-D graphics computer systems tend to be relatively less expensive than their three dimensionat counterparts.
However, the 3-D affects are not realistically achieved on these 2-D
graphics a~mputer systems. For example, as the user's viewpoint (location) changes, objects at different depths wiH move the same distance. This is not what happens in the real world, where the user will see the effect of parallax.
That is, objects closer to the user will appear to move more in distanc~, while objects further away from the user will appear to move a little bit, if at all.
Naughton and Frank 2 82225.P458 M&A For Rendering Objecas On A Display ATA/yh W ith Added Realism --, Thus, it is desirable to be able to render objects on a 2-D raster display of a 2-D graphics computer system with added realism, without requiring the amount of computations and the resources of a 3-D graphics computer system. More specifically, it is desirable to ba able to introduce the parallax effect to objects rendered in a less costly manner. As will be disclosed, the present invention provides for such a method and apparatus which advantageously achieves the desired results.
Naughton and Frank 3 82225.P45$
M6iA Fa Rendeaatg Objects O~ A Display ATA/~h With Added Realism ~~.~~a.~~:1 Under the present invention, the desired results are advantageously achieved by having the graphics applications of a 2-D graphics computer system provide each object to be rendered on a 2-D raster display of the computer system with a pair of rendering reference coordinates (x and y), and a relative depth value (z). The x and y rendering reference coordinates and the relative depth value z of an object describe the geometric location of the object relative to the user's eye, which is set at a predetermined location.
l~dditionally, the 2-D graphics computer system is provided with a library of predetermined 2-D images and a number of graphics toolkit routines.
The library comprises at least one predetermined 2-D image for each object to be rendered on th~ 2-D raster display. Each of the at least on~ pr~determined 2-D
image is the image of the object to be rendered in a display sector of the 2-D
raster display. Each predetermined 2-D image has a first and a second rendering control value for controlling the rendering of the particular predetermined 2-D
image in the corresponding display sector. The graphics toolkit routines cooperate with the graphic applications and the library to introduce the parallax effect to the objects being rendered.
As the user "moves" relative to the objects rendered, the graphics toolkit routines recompute the x and y rendering reference coordinates and the relative depth value z of the objects. Then the graphics toolkit routines divide the x and y rendering reference coordinates of each object by its relative depth value z. Next, the graphics toolkit routines select, for each object, a predetermined 2-D
Naughton and Frank 4 82225.P458 MdcA For Ravdautg Objaa~ On A Desplay ATA/jh With Added Realisra~
a image from each object's at least one predetermined 2-D
image, using the object's x/z and y/z values. Finally, the graphics toolkit routines cause the selected predetermined 2-D images of the objects to be rendered using the objects' x/z and y/z values as the rendering controlling values.
As a result, the objects that are further away from the user will appear to move slower than the objects that are closer to the user, thereby introducing the effect of parallax and added realism to the 2-D graphics computer system. However, because the graphics toolkit routines perform the z-divides only once per object, rather than as many times as the number of points in an object to be rendered, the number of computations, and therefore the resources required, are substantially less than a 3-D graphics computer system. Thus, the added reaslism is achieved at a substantially lower cost.
In the presently preferred embodiment, the 2-D
graphics computer system further includes a pair of stereo speakers. The library further comprises predetermined sounds for a subset of the objects. Each of these objects is provided with at least one predetermined stereo sound pair. Each of the at least one predetermined stereo sound pair describes the characteristics of the predetermined sound to be v rendered in the speakers, and has a pair of left and right rendering control values.
In one aspect, the present invention relates to a computer system comprising a raster display, a method for generating and displaying at least txo objects at different depths on said raster display arith added realism, said method comprising the steps of:
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set'of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f(z)) of said z values to 5a v generate a parallax effect between said at least two objects;
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selecting a pr~determined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
In a further aspect, the present invention provides in an apparatus for generating and displaying at least two objects at different depths on said raster display with added realism, said apparatus comprising:
storage means for storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computation means for computing a pair of x and y rendering reference coordinates and a relative depth 5b value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
transformation means coupled to said computation means for computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function (f(z)) of said z value to generate a parallax effect between said at least two objects;
means for modifying the transformed set of coordinates by a selected factor to enhance the parallax effect selection means coupled to said storage means and said adjustment means for selecting a predetermined 2-D
image for each of said objects based on said transformed set of coordinates; and rendering means coupled to said selection means for rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
Tn a still further aspect, the present invention provides a computer readable medium containing 5c instructions for controlling a computer system having a display to perform a method for generating and displaying at least two objects at different depths on said display pith added realism, the method comprising:
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D iatage of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined Z-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relata.ve d~pth values of said obj~cts describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f (z) ) of said z values to generate a parallax effect between said at least tyro objects;
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
5d selecting a predetermined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
5e l3RiE ~~S~~JLP~~L~F Zb.
FICl3RE 9 is a system view of an exemplary ~-D graphics computer system incorporating the teachings of the present invention.
Flgur~ 2 is a logical view of the relevant contents of the memory of Figure ~ in further detail.
Figure 3 is an exploded view of an exemplary screen of objects rendered on the display of Figure 1 illustrating the teachings of the present invention incorporated in the graphics applications of Ftgure 2.
Figures 4~1~ illustrate the relevant contents of the library of predetermined 2-D images and sounds of Figur~ 2 in further detail.
Figure 7 illustrates the operational flow of the relevant graphics toolkit routines of Ftgur~ 2 for introducing the effect of parallax to objects.
Ftgure~ ~a ~ ~d ii(ustrate the parallax ~ffect introduced to the objects by the present invention.
Naughton arrd Franc 6 82225.P458 MdcA Fa Ra~derin8 Objects On A Display ATA/jh l~lith Added Realism ~E'TAIL~~ ~I'~cRI~TIC)tJ
In the following description, for purposes of explanation,_specific numbers, materials and configurations are set forth in order to provide a thorough _ understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced without the specific details. In other instances, well known systems are shown in diagrammatic or block diagram form in order not to obscure the present invention unnecessarily.
Referring now to Flgure ~, a ;system view of an exemplary 2-D
graphics computer system incorporating the teachings of the present invention is shown. The exemplary 2-D graphics computer system 10 comprises a CPU i2 and a memory 94, ~upled to a bus 20. The exemplary 2-D graphics computer system 10 further comprises various input devices i3, such as a keyboard and a cursor control device, a 2~~D raster display 30, and a pair of speakers 34.
The input devices 16 era coupled to the bus 20 through an UO interface 16, while the 2-D raster display ~0 and the speakers 34 ar~ coupled to the bus 20 through their respective controll~rs, the display controller 22 and the audio controller 32.
The display controller 22 includes a frame buffer control 24, a video RAIv126, and a display adapter control 2a3. Except for the teachings of the present invention incorporated, these elements 12 - 34 era intended to represent a broad category of CPUs, memory units, input devices, controllers, displays, and speakers found in many general purpose and special purpose 2-D graphics computer syst~ms. They are well known in the art and will not be further described.
Afaughton and Frank 7 82225.P458 MdcA Foe Rendering Objects On A Display ATA/~h W ith Addai Realism i Referring now to Figure 2, a logical view of the relevant contents in the memory of Flgur~ 1 is shown. Shown is an operating system 36, a graphics rendering library 3~, a graphics application development toolkit 40, and a number of graphics applications 42. The graphics application development _ toolkit 40 and the graphics applications 42 are incorporated with the teachings of the present invention. Also shawn is a cooperative multimedia data library 44 of the present invention comprising predetermined images 45 and sounds 47. The teachings of the present invention incorporated in the graphics application development toolkit 4A and the graphics applications 42, and the cooperative multimedia data library 44 will be described in further detail below with additional references to the remaining figures. ~Otherwis~, the elements 36 - 42 are well known in the art, and will not be further described.
Referring now to Figure 3, an exploded view of an exemplary screen of objects rendered on the raster display of FHgure 1, illustrating the teachings of the present invention incorporated in the graphics applications of Flgu~re 2 is shown. The graphics applications provide and maintain a pair of rendering reference coordinates (x, y) and a relative depth value (z) for each object~o be rendered. The x and y rendering reference coordinates and the z relative depth values of the objects describe the geometric locations of the objects 4~ relative to the users eye, which is set at some predetermined location, for example, {(x, y) _ (0, 0) and z ~ - 10}. For the exemplary screen of objects illustrated, the first and second group of stars and the nebula are 10X, 100X, and 1000X further away from the space shuttle and astronaut than the earth. How the x and y rendering reference coordinates and the z relative depth values of the Naughton and Frank 8 82225.P458 M&A Foc Ra~der'ug Objects On A Display ATA/jh W ith Added Realism ~~~~.~~i objects are used by the graphics application development toolkit routines to introduce parallax effect will be described in further detail below.
Referring now to Figures 4 ~ 6, three diagrams illustrating the relevant contents of the multimedia data library of Figure 2 in further detail are shown. As illustrated in Figure 4, the multimedia data library comprises at least one predetermined 2-D image 50 for each object 48. Each predetermined 2-D
image 50 is the 2-D image of an object to be rendered in a display sector of the raster display. Each predetermined 2-D image 50 is defined by a first and a second rendering control valu~.
For example, as illustrated in Figure 5, the multimedia data library provides for eight predetermined 2-D images 50 for an exemplary "book" object.
Each predetermined 2-D image 50 is the 2-D image of the "book" object to be rendered in a display sector of the raster display. The second predetermined 2-D
image 50a (n=i ) is to be rendered in the display sector bounded by the line segments forming the angle a1, whereas the sixth predetermined 2-D image 50a (n=5) is to be rendered in the display sector bounded by the line segments forming the angle a2. Each predetermined 2-D image 50a is defined by the geometric position of the top left corner of the predetermined 2-D image, i.e.
the x and y coordinates of the top left corner.
While the present invention is being illustrated with the exemplary "book" object having eight predetermined 2-D images for eight display sectors partitioned by line segments radiating from the center of the display, and each predetermined 2-D image being defined by the geometric location of its top left Naughcon and Frank 9 82225.P458 VtBcA Far Rendering Objects On A Display ATA/jh With Added Realism 1 a ~;:~~1~~.~
~rnsr, it will b~ appreciated that the present invention may b~ practiced with objects being provided with one or more predetermined 2-A images corresponding to one or more display sectors partitioned in any number of manners, and each predetermined 2-D image being defined with any number of 5- controlling references.
As illustrated in Ftgur~ 4, preferably, the multimedia data library further comprises at least one predetermined sound 52 for a subset of the objects ~5. Each predetermined stereo sound pair 52 of an objecR ~t~ describes the characteristics of the predetermined sound to b~ rendered in the speakers, and has a pair of left and right rendering control values.
For example, as illustrated in Flgur~ 6, the multimedia data library provides for a prodetermined "buzzing" sound pair for an exemplary "bee"
object.
'The predetermined "buzzing" sound pair describes the amplitude of "buzzing"
to be rendered in the speakers, and the amplitude of "buzzing" is given by C~, -x zd -z L.A (x, z) = X
=d e~c_x,~)r~,cx,Z) ZO where x is the x-coordinate of a reference point of the "bee" objoct, = is the depth value of the "be~" object, w is the width of the display screen, and z~ is the deepest depth value of all objects currently being Naughton and Frank t 0 82225.P458 MdcA Fa R~dtring Objects On A Display AT~~
W ith Addod Realism rendered on the display screen.
The amplitude of "buzzing" is maximized when the ex~mplary "bee" object is closest t~ the user at either the left or right ~dge of the display screen.._The amplitude of "buzaing" decreases as the exemplary "bee" object moves away S - from the user and/or away from the either edge of the display scr~en.
While the present invention is being illustrated with the exemplary "bee" object having one predetermined sound pair describing the amplitude of "buzzing", and the amplitude of "buzzing" being given by the x-coordinate of a reference point, the depth value of the "bee" object, the width of the display screen and the depth value of the deepest object, it wii! be appreciated that the present invention may be practiced with objects being provided with one or more predetermined sound pairs describing one or more sound characteristics, and each predetermined sound pair being defined with any number of rendering IS controlling values.
Referring now to Figure 7, a block diagram illustrating the operational flow of the relevant graphics application development toolkit routines is shown. As the user "moves" relative to the objects rendered, the relevant graphics application development toolldt routines recompute the x and y rendering reference coordinates and the z relative depth values for all objects, block 57. Then th~ routines divide the x and y rendering reference coordinates of each.object by its z relative depth value, block 59. Preferably, the xlz and y/z valees are then scaled by a scale factor, block 59. The scaling factor is used to minimize or exaggerate the object's differences in relative depth. Next, the routines select a predetermined 2-D image for each object, and if applicable, a Naughton snd Ftattk 1 1 82225.P458 Md~A Fcr Ra~deting Objects On A Display ATA/jh With Added Realism predetermined sound pair, block 61. The predeterrrlined 2-D image is selected based on the unsealed or scaled x/z and ylz values, whereas the predetermined sound pair is selected in an application dependent predetermined manner.
Finally, the routines cause the selected images and sound pairs to be rendered 5~ black 6~. The predetermined 2-D images are rendered in the corresponding display sectors with the scaled or unsealed x/z and y/z values as their rendering control values, and the selected sound pairs are rendered at the speakers in an application dependent predetermined manner.
i0 Since the selected images are rendered using the scaled or unsealed x/z and y/z values as their rendering control values, the objects further away from the user will move slower than the objects closer to the user, as illustrated by Figures 8a ~ 8d, thereby introducing the effect of parallax to the objects rendered. Figures 8a ~ 8b illustrate the affect of parallax for horizontal 15 movement, while Figures 8c ~ 8d illustrate the effect of parallax for vertical movement, tn both cases, the specs shuttle and the astronaut, which are closest to the user, will appear to have moved the most, while the earth, the various stars, and the nebula, which are further away from the user, will appear to have moved progressively less. Scaling is employed to make the nebula appear to have 20 moved a little bit for the user, thereby increasing the dramatic effect of the graphics. In the real world, because the nebula are so far away, the user will not perceive any movement. Since the z divides are performed only once per object, and not for every point of every object, the amount of computations and therefore the resources required in the exemplary 2-D graphics computer system are 25 substantially less. As a result, the effect of parallax and added realism are achieved in substantially lower cost.
Naustttcm utd Fsartk 12 82225.P458 Me~.A For Rmdain8 Objec~~ On A Display ATA/~
with Addod Realism ~~~i~~:~
While Figures 8a - ~d illustrate the effect of parallax using a space related graphics application, it will be appreciated that the present invention may be practiced with any user interfaces, including but not limited to - an interface where the objects represent different units of time, with !he smaller units such as nanoseconds and seconds being closer to the user, and the larger units such as years, centuries, and millennia bring farther away from the user, or an interface where the objects represent the elements of an hierarchical system with the younger offspring being closer to the user, and the older ancestors being farther away from the user, or an interface where the objects represent the elements of a book, with th~ paragraphs and sections being closer to the user, and the chapters and parts being farther away from th~ user.
While the present invention has been described in terms of presently preferred and alternate embodiments, those skilled in the art will recognize that the invention is not limited to the embodiments described. The method and apparatus of the present invention can be practiced with modification and alt~ration within the spirit and scope of the appended claims. The description is thus to b~ regarded as illustrative of, and not limiting the scope of the present inv~ntion.
Naughton u~d Fru~Jc 13 82225.P458 M&A Fa Ra~daing Objects an A Display ATA/,yh With Addod Realism
Figure 3 is an exploded view of an exemplary screen of objects rendered on the display of Figure 1 illustrating the teachings of the present invention incorporated in the graphics applications of Ftgure 2.
Figures 4~1~ illustrate the relevant contents of the library of predetermined 2-D images and sounds of Figur~ 2 in further detail.
Figure 7 illustrates the operational flow of the relevant graphics toolkit routines of Ftgur~ 2 for introducing the effect of parallax to objects.
Ftgure~ ~a ~ ~d ii(ustrate the parallax ~ffect introduced to the objects by the present invention.
Naughton arrd Franc 6 82225.P458 MdcA Fa Ra~derin8 Objects On A Display ATA/jh l~lith Added Realism ~E'TAIL~~ ~I'~cRI~TIC)tJ
In the following description, for purposes of explanation,_specific numbers, materials and configurations are set forth in order to provide a thorough _ understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced without the specific details. In other instances, well known systems are shown in diagrammatic or block diagram form in order not to obscure the present invention unnecessarily.
Referring now to Flgure ~, a ;system view of an exemplary 2-D
graphics computer system incorporating the teachings of the present invention is shown. The exemplary 2-D graphics computer system 10 comprises a CPU i2 and a memory 94, ~upled to a bus 20. The exemplary 2-D graphics computer system 10 further comprises various input devices i3, such as a keyboard and a cursor control device, a 2~~D raster display 30, and a pair of speakers 34.
The input devices 16 era coupled to the bus 20 through an UO interface 16, while the 2-D raster display ~0 and the speakers 34 ar~ coupled to the bus 20 through their respective controll~rs, the display controller 22 and the audio controller 32.
The display controller 22 includes a frame buffer control 24, a video RAIv126, and a display adapter control 2a3. Except for the teachings of the present invention incorporated, these elements 12 - 34 era intended to represent a broad category of CPUs, memory units, input devices, controllers, displays, and speakers found in many general purpose and special purpose 2-D graphics computer syst~ms. They are well known in the art and will not be further described.
Afaughton and Frank 7 82225.P458 MdcA Foe Rendering Objects On A Display ATA/~h W ith Addai Realism i Referring now to Figure 2, a logical view of the relevant contents in the memory of Flgur~ 1 is shown. Shown is an operating system 36, a graphics rendering library 3~, a graphics application development toolkit 40, and a number of graphics applications 42. The graphics application development _ toolkit 40 and the graphics applications 42 are incorporated with the teachings of the present invention. Also shawn is a cooperative multimedia data library 44 of the present invention comprising predetermined images 45 and sounds 47. The teachings of the present invention incorporated in the graphics application development toolkit 4A and the graphics applications 42, and the cooperative multimedia data library 44 will be described in further detail below with additional references to the remaining figures. ~Otherwis~, the elements 36 - 42 are well known in the art, and will not be further described.
Referring now to Figure 3, an exploded view of an exemplary screen of objects rendered on the raster display of FHgure 1, illustrating the teachings of the present invention incorporated in the graphics applications of Flgu~re 2 is shown. The graphics applications provide and maintain a pair of rendering reference coordinates (x, y) and a relative depth value (z) for each object~o be rendered. The x and y rendering reference coordinates and the z relative depth values of the objects describe the geometric locations of the objects 4~ relative to the users eye, which is set at some predetermined location, for example, {(x, y) _ (0, 0) and z ~ - 10}. For the exemplary screen of objects illustrated, the first and second group of stars and the nebula are 10X, 100X, and 1000X further away from the space shuttle and astronaut than the earth. How the x and y rendering reference coordinates and the z relative depth values of the Naughton and Frank 8 82225.P458 M&A Foc Ra~der'ug Objects On A Display ATA/jh W ith Added Realism ~~~~.~~i objects are used by the graphics application development toolkit routines to introduce parallax effect will be described in further detail below.
Referring now to Figures 4 ~ 6, three diagrams illustrating the relevant contents of the multimedia data library of Figure 2 in further detail are shown. As illustrated in Figure 4, the multimedia data library comprises at least one predetermined 2-D image 50 for each object 48. Each predetermined 2-D
image 50 is the 2-D image of an object to be rendered in a display sector of the raster display. Each predetermined 2-D image 50 is defined by a first and a second rendering control valu~.
For example, as illustrated in Figure 5, the multimedia data library provides for eight predetermined 2-D images 50 for an exemplary "book" object.
Each predetermined 2-D image 50 is the 2-D image of the "book" object to be rendered in a display sector of the raster display. The second predetermined 2-D
image 50a (n=i ) is to be rendered in the display sector bounded by the line segments forming the angle a1, whereas the sixth predetermined 2-D image 50a (n=5) is to be rendered in the display sector bounded by the line segments forming the angle a2. Each predetermined 2-D image 50a is defined by the geometric position of the top left corner of the predetermined 2-D image, i.e.
the x and y coordinates of the top left corner.
While the present invention is being illustrated with the exemplary "book" object having eight predetermined 2-D images for eight display sectors partitioned by line segments radiating from the center of the display, and each predetermined 2-D image being defined by the geometric location of its top left Naughcon and Frank 9 82225.P458 VtBcA Far Rendering Objects On A Display ATA/jh With Added Realism 1 a ~;:~~1~~.~
~rnsr, it will b~ appreciated that the present invention may b~ practiced with objects being provided with one or more predetermined 2-A images corresponding to one or more display sectors partitioned in any number of manners, and each predetermined 2-D image being defined with any number of 5- controlling references.
As illustrated in Ftgur~ 4, preferably, the multimedia data library further comprises at least one predetermined sound 52 for a subset of the objects ~5. Each predetermined stereo sound pair 52 of an objecR ~t~ describes the characteristics of the predetermined sound to b~ rendered in the speakers, and has a pair of left and right rendering control values.
For example, as illustrated in Flgur~ 6, the multimedia data library provides for a prodetermined "buzzing" sound pair for an exemplary "bee"
object.
'The predetermined "buzzing" sound pair describes the amplitude of "buzzing"
to be rendered in the speakers, and the amplitude of "buzzing" is given by C~, -x zd -z L.A (x, z) = X
=d e~c_x,~)r~,cx,Z) ZO where x is the x-coordinate of a reference point of the "bee" objoct, = is the depth value of the "be~" object, w is the width of the display screen, and z~ is the deepest depth value of all objects currently being Naughton and Frank t 0 82225.P458 MdcA Fa R~dtring Objects On A Display AT~~
W ith Addod Realism rendered on the display screen.
The amplitude of "buzzing" is maximized when the ex~mplary "bee" object is closest t~ the user at either the left or right ~dge of the display screen.._The amplitude of "buzaing" decreases as the exemplary "bee" object moves away S - from the user and/or away from the either edge of the display scr~en.
While the present invention is being illustrated with the exemplary "bee" object having one predetermined sound pair describing the amplitude of "buzzing", and the amplitude of "buzzing" being given by the x-coordinate of a reference point, the depth value of the "bee" object, the width of the display screen and the depth value of the deepest object, it wii! be appreciated that the present invention may be practiced with objects being provided with one or more predetermined sound pairs describing one or more sound characteristics, and each predetermined sound pair being defined with any number of rendering IS controlling values.
Referring now to Figure 7, a block diagram illustrating the operational flow of the relevant graphics application development toolkit routines is shown. As the user "moves" relative to the objects rendered, the relevant graphics application development toolldt routines recompute the x and y rendering reference coordinates and the z relative depth values for all objects, block 57. Then th~ routines divide the x and y rendering reference coordinates of each.object by its z relative depth value, block 59. Preferably, the xlz and y/z valees are then scaled by a scale factor, block 59. The scaling factor is used to minimize or exaggerate the object's differences in relative depth. Next, the routines select a predetermined 2-D image for each object, and if applicable, a Naughton snd Ftattk 1 1 82225.P458 Md~A Fcr Ra~deting Objects On A Display ATA/jh With Added Realism predetermined sound pair, block 61. The predeterrrlined 2-D image is selected based on the unsealed or scaled x/z and ylz values, whereas the predetermined sound pair is selected in an application dependent predetermined manner.
Finally, the routines cause the selected images and sound pairs to be rendered 5~ black 6~. The predetermined 2-D images are rendered in the corresponding display sectors with the scaled or unsealed x/z and y/z values as their rendering control values, and the selected sound pairs are rendered at the speakers in an application dependent predetermined manner.
i0 Since the selected images are rendered using the scaled or unsealed x/z and y/z values as their rendering control values, the objects further away from the user will move slower than the objects closer to the user, as illustrated by Figures 8a ~ 8d, thereby introducing the effect of parallax to the objects rendered. Figures 8a ~ 8b illustrate the affect of parallax for horizontal 15 movement, while Figures 8c ~ 8d illustrate the effect of parallax for vertical movement, tn both cases, the specs shuttle and the astronaut, which are closest to the user, will appear to have moved the most, while the earth, the various stars, and the nebula, which are further away from the user, will appear to have moved progressively less. Scaling is employed to make the nebula appear to have 20 moved a little bit for the user, thereby increasing the dramatic effect of the graphics. In the real world, because the nebula are so far away, the user will not perceive any movement. Since the z divides are performed only once per object, and not for every point of every object, the amount of computations and therefore the resources required in the exemplary 2-D graphics computer system are 25 substantially less. As a result, the effect of parallax and added realism are achieved in substantially lower cost.
Naustttcm utd Fsartk 12 82225.P458 Me~.A For Rmdain8 Objec~~ On A Display ATA/~
with Addod Realism ~~~i~~:~
While Figures 8a - ~d illustrate the effect of parallax using a space related graphics application, it will be appreciated that the present invention may be practiced with any user interfaces, including but not limited to - an interface where the objects represent different units of time, with !he smaller units such as nanoseconds and seconds being closer to the user, and the larger units such as years, centuries, and millennia bring farther away from the user, or an interface where the objects represent the elements of an hierarchical system with the younger offspring being closer to the user, and the older ancestors being farther away from the user, or an interface where the objects represent the elements of a book, with th~ paragraphs and sections being closer to the user, and the chapters and parts being farther away from th~ user.
While the present invention has been described in terms of presently preferred and alternate embodiments, those skilled in the art will recognize that the invention is not limited to the embodiments described. The method and apparatus of the present invention can be practiced with modification and alt~ration within the spirit and scope of the appended claims. The description is thus to b~ regarded as illustrative of, and not limiting the scope of the present inv~ntion.
Naughton u~d Fru~Jc 13 82225.P458 M&A Fa Ra~daing Objects an A Display ATA/,yh With Addod Realism
Claims (24)
1. In a computer system comprising a raster display, a method for generating and displaying at least two objects at different depths on said raster display with added realism, said method comprising the steps of:
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered an a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f(z)) of said z values to generate a parallax effect between said at least two objects:
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selecting a predetermined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered an a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f(z)) of said z values to generate a parallax effect between said at least two objects:
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selecting a predetermined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
2. The method as set forth in claim 1, wherein, eight predetermined 2-D images corresponding to eight display sectors are stored for a first of said objects, one for each of said eight display sectors, each said display sectors being bounded by a first and a second line segment radiating from a center of said raster display forming an angle of a predetermined size; and said selection of a predetermined 2-D image for said first object in said step of selecting a predetermined image comprises selecting one of the eight predetermined 2-D images.
3. The method as set forth in claim 1, wherein said function in said step of computing a transformed set of coordinates is f(z)=z.
4. The method as set forth in claim 3, wherein, each of said at least one predetermined 2-D images has a rendering control point;
said first and second image rendering control values of said predetermined 2-D images are x and y coordinates of said rendering control points of said selected 2-D images to said transformed set of coordinates.
said first and second image rendering control values of said predetermined 2-D images are x and y coordinates of said rendering control points of said selected 2-D images to said transformed set of coordinates.
5. The method as set forth in claim 4, wherein said rendering control points of said at least one predetermined 2-D images are geometric top left corners of said predetermined 2-D images.
6. The method as set forth in claim 1, wherein, said computer system further comprises at least one speaker;
said step of storing at least one predetermined 2-D
image further comprises storing at least one predetermined sound for each member of a subset of said objects, each of said at least one predetermined sound of said member objects describing the frequency of the sound to be rendered, and having a predetermined manner of rendering;
said step of selecting a predetermined 2-D image further comprises selecting a predetermined sound for each of said member objects in a predetermined manner;
and said step of rendering said objects on said raster display further comprises actuating said at least one speaker using said selected sounds, said selected sounds being rendered in accordance to their predetermined manners of rendering.
said step of storing at least one predetermined 2-D
image further comprises storing at least one predetermined sound for each member of a subset of said objects, each of said at least one predetermined sound of said member objects describing the frequency of the sound to be rendered, and having a predetermined manner of rendering;
said step of selecting a predetermined 2-D image further comprises selecting a predetermined sound for each of said member objects in a predetermined manner;
and said step of rendering said objects on said raster display further comprises actuating said at least one speaker using said selected sounds, said selected sounds being rendered in accordance to their predetermined manners of rendering.
7. The method as set forth in claim 6, wherein, said computer system comprises two speakers, a left and a right speaker;
a predetermined sound describing an amplitude characteristic of the sound is stored for a second of said objects, said predetermined sound having a left and a right rendering control values (LA and RA) given by a first and a second equation, said first and second equations being RA (-x, z) = LA (x, z) where x is the x-coordinate of a reference point of said second object, z is the depth value of said second object, w is a screen width of said display, and z d is the deepest depth value of all objects currently being rendered on said display.
a predetermined sound describing an amplitude characteristic of the sound is stored for a second of said objects, said predetermined sound having a left and a right rendering control values (LA and RA) given by a first and a second equation, said first and second equations being RA (-x, z) = LA (x, z) where x is the x-coordinate of a reference point of said second object, z is the depth value of said second object, w is a screen width of said display, and z d is the deepest depth value of all objects currently being rendered on said display.
8. The method as set forth in claim 1, where said objects are elements of the user interface of an application and represent entities which a user of said computer system views and manipulates through the user interface of said application.
9. The method as set forth in claim 8, wherein said entities represented by said objects are members of a multilevel hierarchical system comprising a plurality of ancestors and offspring, said offspring being represented by objects closer to said user's eye, and said ancestors being represented by objects farther away from said user's eye.
10. The method of claim 8, where said entities represented by said objects are parts, chapters, sections, and paragraphs of a book, said paragraphs and sections being represented by objects closer to said user's eye, and said parts and chapters being represented by objects farther away from said user's eye.
11. In a computer system comprising a raster display, an apparatus for generating and displaying at least two objects at different depths on said raster display with added realism, said apparatus comprising:
storage means for storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computation means for computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
transformation means coupled to said computation means for computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function (f(z)) of said z value to generate a parallax effect between said at least two objects;
means for modifying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selection means coupled to said storage means and said adjustment means for selecting a predetermined 2-D
image for each of said objects based on said transformed set of coordinates; and rendering means coupled to said selection means for rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
storage means for storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computation means for computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
transformation means coupled to said computation means for computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function (f(z)) of said z value to generate a parallax effect between said at least two objects;
means for modifying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selection means coupled to said storage means and said adjustment means for selecting a predetermined 2-D
image for each of said objects based on said transformed set of coordinates; and rendering means coupled to said selection means for rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
12. The apparatus as set forth in claim 11, wherein, said storage means stores eight predetermined 2-D
images corresponding to eight display sectors for a first of said objects, one for each of said eight display sectors, each of said display sectors being bounded by a first and a second line segment radiating from a center forming an angle of a predetermined size;
and said selection means selects one of the eight predetermined 2-D images as the predetermined 2-D image to be rendered for said first object.
images corresponding to eight display sectors for a first of said objects, one for each of said eight display sectors, each of said display sectors being bounded by a first and a second line segment radiating from a center forming an angle of a predetermined size;
and said selection means selects one of the eight predetermined 2-D images as the predetermined 2-D image to be rendered for said first object.
13. The apparatus as set forth in claim 11, wherein said function is f (z) =z .
14. The apparatus as set forth in claim 13, wherein, each of said at least one predetermined 2-D images has a rendering control point;
said first and second image rendering control values of said predetermined 2-D images are x and y display coordinates of said rendering control points of said predetermined 2-D images; and said determination means determines said first and second image rendering control values of said selected 2-D images by setting said x and y display coordinates of said rendering control points of said selected 2-D
images to said transformed set of coordinates.
said first and second image rendering control values of said predetermined 2-D images are x and y display coordinates of said rendering control points of said predetermined 2-D images; and said determination means determines said first and second image rendering control values of said selected 2-D images by setting said x and y display coordinates of said rendering control points of said selected 2-D
images to said transformed set of coordinates.
15. The apparatus as set forth in claim 14, wherein said rendering control points of said predetermined 2-D
images are geometric top left corners of said at least one predetermined 2-D images.
images are geometric top left corners of said at least one predetermined 2-D images.
16. The apparatus as set forth in claim 11, wherein, said computer system further comprises at least one speaker;
said storage means further stores at least one predetermined sound for each member of a subset of said objects, each of said at least one predetermined sound of said member objects describing the frequency of the sound to be rendered, and having a predetermined manner of rendering;
said selection means further selects a predetermined sound for each of said member objects in a predetermined manner;
and said rendering means further actuates said at least one speaker using said selected sounds, said selected sounds be rendered in accordance to their predetermined manner of rendering.
said storage means further stores at least one predetermined sound for each member of a subset of said objects, each of said at least one predetermined sound of said member objects describing the frequency of the sound to be rendered, and having a predetermined manner of rendering;
said selection means further selects a predetermined sound for each of said member objects in a predetermined manner;
and said rendering means further actuates said at least one speaker using said selected sounds, said selected sounds be rendered in accordance to their predetermined manner of rendering.
17. The apparatus as set forth in claim 16, wherein, said computer system comprises two speakers, a left and a right speaker;
a predetermined sound describing an amplitude characteristic of the sound is stored for a second of said objects, said predetermined sound having a left and a right rendering control values (LA and RA) given by a first and a second equation, said first and second equations being RA (-x, z) = LA (x, z) where x is the x-coordinate of a reference point of said second object, z is the depth value of said second object, w is a screen width of said display, and z d is the deepest depth value of all objects currently being rendered on said display.
a predetermined sound describing an amplitude characteristic of the sound is stored for a second of said objects, said predetermined sound having a left and a right rendering control values (LA and RA) given by a first and a second equation, said first and second equations being RA (-x, z) = LA (x, z) where x is the x-coordinate of a reference point of said second object, z is the depth value of said second object, w is a screen width of said display, and z d is the deepest depth value of all objects currently being rendered on said display.
18. The apparatus as set forth in claim 11, wherein said objects are elements of the user interface of an application and represent entities which a user of said computer system views and manipulates through the user interface of said application.
19. The apparatus as set forth in claim 18, wherein said entities represented by said objects are members of a multilevel hierarchical system comprising a plurality of ancestors and offspring, said offspring being represented by objects closer to said user's eye, and said ancestors being represented by objects farther away from said user's eye.
20. The apparatus of claim 18, where said entities represented by said objects are parts, chapters, sections, and paragraphs of a book, said paragraphs and sections being represented by objects closer to said user's eye, and said parts and chapters being represented by objects farther away from said user's eye.
21. A computer-readable medium containing instructions for controlling a computer system having a display to perform a method for generating and displaying at least two objects at different depths on said display with added realism, the method comprising:
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f(z)) of said z values to generate a parallax effect between said at least two objects;
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selecting a predetermined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
storing at least one predetermined 2-D image for each of said objects, each of said at least one predetermined 2-D image of said objects corresponding to the image of one of said objects to be rendered in a display sector of said raster display, each of said at least one predetermined 2-D image of said objects being defined based on a first and a second image rendering control value;
computing a pair of x and y rendering reference coordinates and a relative depth value (z) for each of said objects, said x and y rendering reference coordinates and said z relative depth values of said objects describing geometric locations of said objects relative to a user's eye set at a predetermined location;
computing a transformed set of coordinates by dividing said pair of x and y rendering reference coordinates by a function of (f(z)) of said z values to generate a parallax effect between said at least two objects;
multiplying the transformed set of coordinates by a selected factor to enhance the parallax effect;
selecting a predetermined 2-D image for each of said objects based on the object's transformed set of coordinates; and rendering said objects on said raster display using said selected 2-D images, said first and second image rendering control values of said selected 2-D images being determined using said transformed set of coordinates.
22. The computer-readable medium of claim 21, wherein eight predetermined 2-D images corresponding to eight display sectors are stored for a first of said objects, one for each of said eight display sectors, each said display sectors being bounded by a first and a second line segment radiating from a center of said raster display forming an angle of a predetermined size, and wherein said selection of a predetermined 2-D image for said first object in said step of selecting a predetermined image comprises:
selecting one of the eight predetermined 2-D
images.
selecting one of the eight predetermined 2-D
images.
23. The computer-readable medium of claim 21, wherein said function in said step of computing a transformed set of coordinates is f(z)=z.
24. The computer-readable medium of claim 21, wherein said computer system further comprises at least one speaker, and wherein said step of storing at least one predetermined 2-D image further comprises storing at least one predetermined sound for each member of a subset of said objects, each of said at least one predetermined sound of, said member objects describing the frequency of the sound to be rendered, and having a predetermined manner of rendering, and wherein said step of selecting a predetermined 2-D
image further comprises:
selecting a predetermined sound for each of said member objects in a predetermined manner, and wherein said step of rendering said objects on said raster display further comprises actuating said at least one speaker using said selected sounds, said selected sounds being rendered in accordance to their predetermined manners of rendering.
image further comprises:
selecting a predetermined sound for each of said member objects in a predetermined manner, and wherein said step of rendering said objects on said raster display further comprises actuating said at least one speaker using said selected sounds, said selected sounds being rendered in accordance to their predetermined manners of rendering.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US11465593A | 1993-08-31 | 1993-08-31 | |
| US08/114,655 | 1993-08-31 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2131221A1 CA2131221A1 (en) | 1995-03-01 |
| CA2131221C true CA2131221C (en) | 2004-06-22 |
Family
ID=22356605
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002131221A Expired - Fee Related CA2131221C (en) | 1993-08-31 | 1994-08-31 | Method and apparatus for rendering objects on a display with added realism |
Country Status (6)
| Country | Link |
|---|---|
| US (2) | US5864343A (en) |
| EP (2) | EP1143383B1 (en) |
| JP (1) | JP3700863B2 (en) |
| KR (1) | KR950006645A (en) |
| CA (1) | CA2131221C (en) |
| DE (2) | DE69428849T2 (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE69428849T2 (en) * | 1993-08-31 | 2002-11-14 | Sun Microsystems Inc | Method and device for rendering objects on a display device with more reality |
| JPH09237234A (en) * | 1996-02-29 | 1997-09-09 | Toshiba Corp | Television mail system |
| JP4086336B2 (en) * | 1996-09-18 | 2008-05-14 | 富士通株式会社 | Attribute information providing apparatus and multimedia system |
| US7071949B1 (en) * | 1998-11-18 | 2006-07-04 | Microsoft Corporation | View dependent tiled textures |
| US6980690B1 (en) * | 2000-01-20 | 2005-12-27 | Canon Kabushiki Kaisha | Image processing apparatus |
| US6760021B1 (en) | 2000-07-13 | 2004-07-06 | Orasee Corp. | Multi-dimensional image system for digital image input and output |
| US6711586B1 (en) | 2000-07-17 | 2004-03-23 | William Mitchell Wells | Methods and systems for providing information based on similarity |
| US6657617B2 (en) | 2001-06-25 | 2003-12-02 | International Business Machines Corporation | Method, apparatus and computer program product for three dimensional text creation |
| US7627832B2 (en) * | 2006-02-22 | 2009-12-01 | The Escher Group, Ltd. | Dynamically placing resources within a graphical user interface |
| EP1884864A1 (en) * | 2006-08-02 | 2008-02-06 | Research In Motion Limited | System and Method for Adjusting Presentation of Moving Images on an Electronic Device According to an Orientation of the Device |
| US8139026B2 (en) | 2006-08-02 | 2012-03-20 | Research In Motion Limited | System and method for adjusting presentation of text and images on an electronic device according to an orientation of the device |
| US8493323B2 (en) | 2006-08-02 | 2013-07-23 | Research In Motion Limited | System and method for adjusting presentation of moving images on an electronic device according to an orientation of the device |
| US9454283B1 (en) * | 2008-01-07 | 2016-09-27 | The Mathworks, Inc. | Three-dimensional visualization |
| US8531450B2 (en) | 2008-08-28 | 2013-09-10 | Adobe Systems Incorporated | Using two dimensional image adjustment operations on three dimensional objects |
| EP2239652A1 (en) * | 2009-04-07 | 2010-10-13 | Keywords.de GmbH | Providing an interactive visual representation on a display |
| US9682321B2 (en) * | 2012-06-20 | 2017-06-20 | Microsoft Technology Licensing, Llc | Multiple frame distributed rendering of interactive content |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4951229A (en) * | 1988-07-22 | 1990-08-21 | International Business Machines Corporation | Apparatus and method for managing multiple images in a graphic display system |
| US5046026A (en) * | 1989-06-13 | 1991-09-03 | Sun Microsystems, Inc. | Method and apparatus for precisely varying the display rate of computer generated graphic images |
| US5093907A (en) * | 1989-09-25 | 1992-03-03 | Axa Corporation | Graphic file directory and spreadsheet |
| US5359703A (en) * | 1990-08-02 | 1994-10-25 | Xerox Corporation | Moving an object in a three-dimensional workspace |
| DE69113199T2 (en) * | 1990-10-05 | 1996-02-22 | Texas Instruments Inc | Method and device for producing a portable optical display. |
| US5261041A (en) * | 1990-12-28 | 1993-11-09 | Apple Computer, Inc. | Computer controlled animation system based on definitional animated objects and methods of manipulating same |
| US5524187A (en) * | 1991-03-25 | 1996-06-04 | The Trustees Of Columbia University | Worlds-within-worlds nested display and interaction system and method |
| US5349658A (en) * | 1991-11-01 | 1994-09-20 | Rourke Thomas C O | Graphical user interface |
| US5315057A (en) * | 1991-11-25 | 1994-05-24 | Lucasarts Entertainment Company | Method and apparatus for dynamically composing music and sound effects using a computer entertainment system |
| JPH07306955A (en) * | 1992-07-24 | 1995-11-21 | Walt Disney Co:The | Method and system for generation of three-dimensional illusion |
| US5524195A (en) * | 1993-05-24 | 1996-06-04 | Sun Microsystems, Inc. | Graphical user interface for interactive television with an animated agent |
| DE69428849T2 (en) * | 1993-08-31 | 2002-11-14 | Sun Microsystems Inc | Method and device for rendering objects on a display device with more reality |
-
1994
- 1994-08-30 DE DE69428849T patent/DE69428849T2/en not_active Expired - Fee Related
- 1994-08-30 EP EP01200735A patent/EP1143383B1/en not_active Expired - Lifetime
- 1994-08-30 EP EP94306377A patent/EP0640942B1/en not_active Expired - Lifetime
- 1994-08-30 DE DE69433307T patent/DE69433307D1/en not_active Expired - Lifetime
- 1994-08-31 JP JP20727394A patent/JP3700863B2/en not_active Expired - Lifetime
- 1994-08-31 CA CA002131221A patent/CA2131221C/en not_active Expired - Fee Related
- 1994-08-31 KR KR1019940021814A patent/KR950006645A/en not_active Application Discontinuation
-
1996
- 1996-02-20 US US08/603,689 patent/US5864343A/en not_active Expired - Lifetime
-
1998
- 1998-11-09 US US09/188,288 patent/US6184890B1/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| US5864343A (en) | 1999-01-26 |
| EP0640942A2 (en) | 1995-03-01 |
| EP0640942A3 (en) | 1995-03-22 |
| CA2131221A1 (en) | 1995-03-01 |
| KR950006645A (en) | 1995-03-21 |
| EP1143383B1 (en) | 2003-11-05 |
| DE69428849T2 (en) | 2002-11-14 |
| DE69433307D1 (en) | 2003-12-11 |
| EP1143383A2 (en) | 2001-10-10 |
| EP1143383A3 (en) | 2002-01-16 |
| EP0640942B1 (en) | 2001-10-31 |
| DE69428849D1 (en) | 2001-12-06 |
| JPH07254076A (en) | 1995-10-03 |
| JP3700863B2 (en) | 2005-09-28 |
| US6184890B1 (en) | 2001-02-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2131221C (en) | Method and apparatus for rendering objects on a display with added realism | |
| US6426757B1 (en) | Method and apparatus for providing pseudo-3D rendering for virtual reality computer user interfaces | |
| Grossman et al. | The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area | |
| US7439975B2 (en) | Method and system for producing dynamically determined drop shadows in a three-dimensional graphical user interface | |
| US7983473B2 (en) | Transparency adjustment of a presentation | |
| US5841440A (en) | System and method for using a pointing device to indicate movement through three-dimensional space | |
| US6943811B2 (en) | Apparatus and method of managing data objects | |
| KR100971853B1 (en) | System and method for aligning objects using non-linear pointer movement | |
| JP2009217838A (en) | Display method of multilayered screen | |
| WO2001038956A2 (en) | Three-dimensional gui windows | |
| KR20050050139A (en) | Method and system for producing a pseudo three-dimensional display utilizing a two-dimensional display device | |
| WO1999039328A1 (en) | Multiscreen display system and method | |
| US11024094B2 (en) | Methods and apparatus to map a virtual environment to a physical environment | |
| US20230143010A1 (en) | Integration of a two-dimensional input device into a three-dimensional computing environment | |
| Theoktisto et al. | Rendering detailed haptic textures | |
| US6927768B2 (en) | Three dimensional depth cue for selected data | |
| LU501299B1 (en) | Block group detection | |
| EP1720090B1 (en) | Computerized method and computer system for positioning a pointer | |
| JPH07262400A (en) | Computer graphics display device | |
| EP0408232A2 (en) | Spatial augmentation of vertices for level of detail transition | |
| CN115984513A (en) | Integrating two-dimensional input devices into three-dimensional computing environments | |
| CN115202792A (en) | Method, apparatus, device and storage medium for scene switching | |
| WO2018127904A1 (en) | Methods and systems for stereoscopic presentation of digital content | |
| Ma et al. | Power Distribution Failure Analysis Using Transition-Delay Fault Patterns | |
| Andersson | VR Technology, TNM053 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed | ||
| MKLA | Lapsed |
Effective date: 20060831 |