US6760050B1 - Virtual three-dimensional sound pattern generator and method and medium thereof - Google Patents

Virtual three-dimensional sound pattern generator and method and medium thereof Download PDF

Info

Publication number
US6760050B1
US6760050B1 US09/275,396 US27539699A US6760050B1 US 6760050 B1 US6760050 B1 US 6760050B1 US 27539699 A US27539699 A US 27539699A US 6760050 B1 US6760050 B1 US 6760050B1
Authority
US
United States
Prior art keywords
sound
virtual
marker
player character
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US09/275,396
Inventor
Teruhiko Nakagawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sega Corp
Original Assignee
Sega Enterprises Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sega Enterprises Ltd filed Critical Sega Enterprises Ltd
Assigned to KABUSHIKI KAISHA SEGA ENTERPRISES reassignment KABUSHIKI KAISHA SEGA ENTERPRISES ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NAKAGAWA, TERUHIKO
Application granted granted Critical
Publication of US6760050B1 publication Critical patent/US6760050B1/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S1/00—Two-channel systems
    • H04S1/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing

Definitions

  • the present invention relates to a three-dimensional sound pattern generator and a method and a medium thereof, and more particularly, to a virtual three-dimensional sound pattern generator for progressing a game which mainly depends on the player's auditory sense.
  • a device comprising: an object storing portion for storing three-dimensional object information; a sound source storing portion for storing sound source information; a central processing portion for forming sound signals for generating sound reaching the position of a player character in conformity with the information concerning walls and other objects stored in the storing portions, information on the sound source, and the progress of the game; a speaker for converting the sound signals formed at the central processing portion into audible sounds; display means for displaying a picture of the game; and an operation panel for moving a character displayed on the display means.
  • an object storing portion for storing three-dimensional object information
  • a sound source storing portion for storing sound source information
  • a central processing portion for forming sound signals for generating sound reaching the position of a player character in conformity with the information concerning walls and other objects stored in the storing portions, information on the sound source, and the progress of the game
  • a speaker for converting the sound signals formed at the central processing portion into audible sounds
  • display means for displaying a picture of the game
  • the player hears different sound effects, feeling as if he/she is standing at the same position and facing the same direction as the character which is moved on the display means with an operation panel.
  • a sense of high virtual reality is provided to the player.
  • sounds are reproduced only at the position and in the direction where such sounds are presumed to be heard assuming from the relative location of the character and other objects.
  • sounds are used only as means for effectively promoting the game as in other conventional devices, and active use of the sounds in the course of the game was not considered.
  • an object of the present invention is to provide a virtual three-dimensional sound pattern generator and a method and a medium thereof based on a new idea of making an active use of sounds in the course of a game.
  • Another object of the present invention is to provide a virtual three-dimensional sound pattern generator and a method and medium thereof for progressing the game pursuant to the sound information that is changed by the player, for example, moving the sound source at his/her discretion.
  • the sound pattern processing means of the present invention comprises means of the present invention comprises means for changing the sound information on the sound marker in accordance with the information on materials of the virtual objects upon identification of collision of the marker with the virtual objects during its movement through the space structured by the virtual objects in conformity with the operational command from the operation means.
  • the sound pattern processing means of the present invention comprises means for forming sound information of the moved sound on the basis of movement of the character within the space structured by the virtual objects.
  • the sound conversion means of the present invention is capable of reproducing three-dimensional sounds.
  • a method of the present invention for generating virtual three-dimensional sound patterns whereby sound patterns are formed within a virtual space comprises the steps of: controlling movement of a player character within a space structured by virtual objects arranged in the virtual space on the basis of operational commands from the operation means and controlling shooting directions and sound generation of a sound source object within the space; variably controlling sound information on the character in accordance with a position of the sound source object of the player character within the space structured by the virtual objects, information on the virtual objects arranged within the virtual three-dimensional space and information on materials of the virtual objects; and allowing sounds to be heard at prescribed positions and in prescribed directions within the three-dimensional space.
  • a method of the present invention for generating virtual three-dimensional sound patterns whereby sound patterns are formed within a virtual space comprises the steps of: controlling movement of a player character and a sound marker in a space structured by virtual objects arranged in the virtual space on the basis of operational commands from the operation means and controlling sound generation of the sound marker; variably controlling sound information on the sound marker in accordance with a position of the sound marker within the space structured by the virtual objects, information on the virtual objects arranged within the virtual three-dimensional space and information on materials of the virtual objects; and allowing sounds to be heard at prescribed positions and in prescribed directions within the three-dimensional space.
  • a method of the present invention for generating three-dimensional virtual sound patterns whereby sound patterns are formed within a virtual space comprises the steps of: controlling movement of a player character and a sound marker in a space structured by virtual objects arranged in the virtual space on the basis of operational commands from the operation means, as well as controlling shooting directions of the sound source object and the sound marker; variably controlling sound information on the source object of the character and/or sound marker in accordance with the relative position of the sound source object of the player character and the sound marker within the space structured by virtual objects; and allowing sounds to be heard at prescribed positions and in prescribed directions within the three-dimensional space.
  • a medium of the present invention has recorded therein, a program causing a computer to function as the aforementioned processing portion or a data device.
  • the medium above stores information (for example, a game program) by certain physical means, and is capable of causing game devices and other information processing devices to execute predetermined functions, for example, execution of a game program.
  • the aforementioned medium includes, for example, a CD-R, a game cartridge, a floppy disc, a magnetic tape, an optical magnetic disc, a CD-ROM, a DVD-ROM, a DVD-RAM, a ROM cartridge, a battery backup RAM, a flash memory, a non-volatile cartridge, and the like.
  • the medium above further includes a communication medium such as a telephone circuit, an optical cable, or other wire communication media, or radio communication media, etc. Internet is also included in such communication media.
  • a communication medium such as a telephone circuit, an optical cable, or other wire communication media, or radio communication media, etc.
  • Internet is also included in such communication media.
  • FIG. 1 is a block diagram showing the outline of the game device employing the virtual three-dimensional sound pattern generator according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing the virtual three-dimensional sound pattern generator of the same embodiment.
  • FIG. 3 is a flowchart illustrating the sound pattern processing of the sound source object held by the player character of the same embodiment.
  • FIG. 4 is a flowchart illustrating the first sound pattern processing of the sound marker of the same embodiment.
  • FIG. 5 is a flowchart illustrating the first sound pattern processing of the sound marker of the same embodiment.
  • FIG. 6 is a block diagram showing an example of space structured by objects arranged in the virtual space which is to be used in the game of the same embodiment.
  • FIG. 7 is an explanatory diagram showing an example of a construction structured by objects arranged in the virtual space, used in the same embodiment.
  • FIG. 1 is a block diagram showing an outline of the game device which employs a virtual three-dimensional sound pattern generator according to an embodiment of the present invention.
  • a game device comprises a body 1 of a processing device, an operation device 2 , a display 3 , and a plurality of speakers 4 , 4 .
  • the body 1 of the processing device comprises a CPU block 10 for controlling the overall device, a video block 11 for controlling display of the game screen, a sound block 12 for generating sound effects etc., and a subsystem 13 for reading out a CD-ROM 5 .
  • the CPU block 10 comprises an SCU (System Control Unit) 100 , a main CPU 101 , a RAM 102 , a ROM 103 , a sub CPU 104 , a CPU bus 105 , etc.
  • SCU System Control Unit
  • the main CPU 101 controls the overall device.
  • a computing function similar to a DSP (Digital Signal Processor) is included inside the main CPU 101 , allowing execution of application software at a high speed.
  • the RAM 102 is used as a work area of the main CPU 101 .
  • an initial program for an initialization processing, etc. are written.
  • the SCU 100 controls buses 105 , 106 and 107 , and thereby allows smooth input and output of data among the main CPU 101 , VDPs 120 and 130 , DSP 140 , CPU 141 , etc.
  • the SCU 100 includes a DMA controller inside, allowing transfer of spright data in the game to VRAMs in the video block 11 .
  • the above-described construction enables execution of games and other application software at a high speed.
  • the sub CPU 104 is called the SMPC (System Manager & Peripheral Control), comprising functions such as collecting data via the operation device (peripheral) 2 upon the request of the main CPU 101 .
  • the main CPU 101 implements processing such as moving the character in the game screen in conformity with the operation (peripheral) data received from the sub CPU 104 .
  • the sub CPU 104 comprises functions such as automatically recognizing the types of peripherals connected to a connector 6 and collecting peripheral data etc. in accordance with the communication method used for the respective types of peripherals.
  • the video block 11 comprises a VDP (Video Display Processor) 120 for drawing video game characters etc. made of polygon data, and a VDP 130 for drawing background images, synthesizing polygon image data and background images and implementing a clipping processing thereof.
  • the VDP 120 is connected to a VRAM 121 and frame buffers 122 and 123 .
  • the drawing data with polygons representing video game characters are sent to the VDP 120 from the main CPU 101 via the SCU 100 so that they are written in the VRAM 121 .
  • the drawing data written in the VRAM 121 are drawn to the frame buffer 122 or 123 in the form of, for example, 16 or 8 bit/pixel. Data drawn to the frame buffer 122 or 123 are sent to the VDP 130 .
  • Information for controlling the drawing is provided to the VDP 120 from the main CPU 101 via the SCU 100 .
  • the VDP 120 executes a drawing processing according to such instructions.
  • the VDP 130 is connected to a VRAM 131 and is structured so that image data output from the VDP 130 are output to an encoder 160 via a memory 132 .
  • the encoder 160 By adding synchronous signals etc. to these image data, the encoder 160 generates video signals and displays such signals on the display 3 . A game screen is thus displayed on the display 3 .
  • the sound block 12 comprises a DSP 140 which conducts voice synthesis under a PCM or an FM method and a CPU 141 which conducts control etc. of the DSP 140 .
  • Voice data produced by the DSP 140 are converted into multi-channel analog sound signals by a D/A converter 170 , and the electric power of the voice data is amplified at the power amplifying circuits 6 , 6 and thereafter respectively output to a plurality of speakers 4 , 4 .
  • the subsystem 13 comprises functions such as reading application software provided in the form of the CD-ROM 5 and reproducing animation data and voice data.
  • FIG. 2 is a block diagram showing the virtual three-dimensional sound pattern generator described above.
  • the virtual three-dimensional sound pattern generator 201 comprises: object information storing means 202 for storing physical information on virtual objects arranged in a virtual three-dimensional space and information on materials of such virtual objects; an operation device 2 for controlling the movement of a character and/or a sound marker within a space structured by virtual objects arranged in the virtual space and for controlling shooting directions from a sound source object of the player character and generation of sounds for the sound source object and the sound marker; sound source storing means 203 for storing information concerning the character and the sound source object; a plurality of sound conversion means 204 for converting the aforementioned sound signals into audible sounds; and sound pattern processing means 205 for variably controlling sound information on the sound source object of the player character or the sound marker in accordance with the position of the sound source object of the player character and/or the sound marker within the space structured by virtual objects arranged in the virtual space and information on materials of the virtual objects, and for forming sound signals audible
  • the sound conversion means 204 comprises: a plurality of speakers 4 , 4 ; power amplifying circuits 6 , 6 for amplifying the power of signals output from the D/A converter 170 and driving the plurality of speakers 4 , 4 ; and a D/A converter 170 providing sound signals to each of the power amplifying circuits 6 , 6 .
  • the sound pattern processing means 205 is realized in the following manner. First of all, a program stored in the CD-ROM 5 is developed in the RAM 102 by the main CPU 101 .
  • the main CPU 101 executes a program developed in the RAM 102 and reads and processes operation data received from the operation device 2 , and also controls operation of a video block 11 and a sound block 12 , thereby realizing the sound pattern processing means 205 .
  • Physical information on the virtual objects arranged in the virtual three-dimensional space and information on materials of the virtual objects are stored in the object information storing area in the RAM 102 . Furthermore, information concerning the character and the sound source object is also stored in the object information storing area in the RAM 102 . If all of the information may not be stored in the RAM 102 , data up to the end of a prescribed scene in the course of the game can be fetched from the CD-ROM 5 on each occasion so that such data are developed at the desired area in the RAM 102 .
  • FIG. 6 is a diagram showing an example of a space structured by objects arranged in the virtual space, which may be used in the game.
  • a plan view of a building 250 is shown in FIG. 6 .
  • the purpose of the game is to bring the player character from the starting point 251 at the building 250 to the goal 252 .
  • the building 250 has the following construction: The building 250 is surrounded by exterior walls 253 , 254 , 255 and 256 . Inside the building 250 , there are rooms 261 , 262 , 263 , and 264 .
  • Room 261 is structured by walls 271 , 272 , 273 , 274 which surround a predetermined area.
  • Room 262 is structured by walls 274 , 275 . . . , 281 which surround a predetermined area.
  • Room 263 is structured by walls 282 , 283 , 284 , 285 which surround a predetermined area.
  • Room 264 is structured by walls 285 , 286 , 287 , 288 which surround a predetermined area.
  • door 290 is furnished, providing a passage only to room 262 .
  • door 291 is furnished, thereby providing a passage between room 262 and hallway 303 .
  • doors 292 and 293 are furnished on the respective walls 284 and 285 of room 263 .
  • Door 292 provides a passage between hallway 301 and room 263
  • door 293 provides a passage between room 263 and room 264 .
  • door 294 is furnished, providing a passage between hallway 305 and room 264 .
  • Hallway 301 is connected with hallways 302 , 303 , 304 and 305 .
  • Hallway 306 is connected with hallways 302 , 304 and 305 .
  • An enemy character 420 may be arranged, for example, near the intersection of hallway 301 and hallway 305 .
  • the medium filled in the aforementioned space structured by the virtual objects is conditioned to have an enormous sound transferring ability but an extremely low sound transferring speed.
  • the player character 410 holds a sound source object 411 capable of shooting sound waves in various directions, namely, forward, backward, rightward, leftward, upward and downward.
  • the player character 410 carries different types of sound markers 412 , 412 , . . . , which can be thrown or arranged within the aforementioned space.
  • the shooting sounds from the sound source object 411 and the sound marker 412 can be modulated according to the features of the respective objects.
  • the player moves the character through the space, aiming to bring the character from the start 251 to the goal 252 .
  • an enemy character 420 may appear. Since there may be fellow comrades within the space, attack is made only after confirming them with the sound wave.
  • the player hears a reflected sound after shooting a sound wave with the shooting means, it is obvious that some object exists in the direction of the reflected sound; if the player hears no reflected sound, it means that no object exists in that direction. Moreover, by the volume of the reflected sound, the player can assume the distance between the player character 410 and the object. For example, upon shooting in the upward direction in FIG. 6 from hallway 301 , no reflected sound will be heard, meaning that no object exists in that direction. Whereas, upon shooting at wall 272 , an immediate reflected sound will be heard, and such sound being loud, the player can assume that there is an object nearby.
  • the sound marker 412 is made so that various types of sounds, for example, continuous sounds or pulse sounds can be shot. Moreover, the sound marker 412 may generate a special sound.
  • the sound marker 412 may be operated by the character 410 .
  • the sound of the sound marker 412 can also be controlled by the player character 410 . In reality, the player can give commands by operating the operation device 2 .
  • sound markers can be dropped at different points so as to avoid taking the same route many times or coming to a dead end.
  • the display 5 displays an image picture 500 of the hallway as shown in FIG. 7, urging the player character 410 to pass through the dark hallway. As the player character enters the hallway, almost nothing is displayed in the game picture shown on the display 5 . The player checks the state of the sounds and moves the player character ahead towards the goal 252 .
  • Data stored in the object information storing means 202 include: data (three-dimensional) concerning the arrangement of the exterior walls 253 through 256 , walls 271 through 282 , doors 290 through 294 , etc.; data (three-dimensional) concerning the arrangement of floors and ceilings, etc. Which are not illustrated herein; data concerning the materials of these components 253 through 256 , 271 through 282 , 290 through 294 , the floors and the ceilings; data concerning hallways 301 through 306 ; and data (three-dimensional) concerning the arrangement of the enemy character 420 .
  • the sound source means 203 stores data concerning the player character 410 and data on the sound of the sound source object.
  • FIG. 3 is a flowchart illustrating the sound pattern processing implemented by the sound source object of the player character.
  • This sound pattern processing is implemented under a presumption that the player character 410 is standing in the three-dimensional space represented by a rectangular coordinate system of (X, Y, Z).
  • the point where the player character 410 is standing shall be the central point or the origin, represented as X 0 , Y 0 , Z 0 .
  • the player When the player wishes to check if any object exists in a certain direction from the point where the player character is standing, the player shoots a sound wave in that direction with the sound source object 411 held by the player character 410 .
  • the main CPU implements processing shown in the flowchart of FIG. 3 .
  • a sound wave is shot, for example, in the direction of the x-axis.
  • the progress of the sound wave is processed on the presumption that a prescribed area D proceeds along the x-axis in conformity with the travelling speed of the sound wave.
  • the value of the x-axis of the area D is changed at the main CPU 101 in conformity with the travelling speed of the sound wave (S 301 ).
  • the medium filled in the virtual space above is conditioned as having an enormous sound transferring ability but an -extremely low sound transferring speed.
  • increase and decrease in the amplitude shall be proportionate to the distance.
  • the area D is moved in equal amount by the main CPU 101 in accordance with the travelling speed of the-sound wave. Furthermore, based on such coordinates of the area D, the main CPU 101 browses the object information storing means 202 to determine whether or not there is any object at the coordinates above (S 302 ). When the main CPU 101 identifies no object at the coordinates of the area D (S 302 ; NO), the main CPU 101 further determines whether or not the sound wave has reached the “critical reaching distance”.
  • the “critical reaching distance” means a distance that the sound wave may no longer reach the point of the player character 410 even when reflected, due to the gradual attenuation of the sound wave amplitude during movement through the medium.
  • the main CPU 101 determines whether or not the attenuation processing has been implemented (S 304 ).
  • the main CPU 101 orders the sound block 12 to attenuate and finally extinguish the soundwave (S 305 ).
  • the speakers 4 , 4 reproduce a sound pattern of a sound wave being shot from the sound source object 411 held in the hands of the player character 410 , for example, a sound pattern of a shooting sound extinguishing immediately after being heard. Then, the processing of the main CPU 101 returns to step S 301 again.
  • the main CPU 101 changes the x-axis value of the area D so that it becomes equal to the distance which the sound wave has moved along the x-axis after a certain period of time (S 301 ). As a result, the area D proceeds along the x-axis from its previous position.
  • the main CPU 101 browses the object information storing means 202 at the RAM 102 and determines whether or not any object exists at the coordinates above (S 302 ). When no object is identified at the coordinates of the area D (S 302 ; NO), the main CPU 101 determines again whether or not the area D has reached the critical reaching distance.
  • the main CPU determines whether or not the attenuation processing has been implemented (S 304 ). Since the execution of such processing is identified by the main CPU 101 (S 304 ; YES), the processing returns to step S 301 again.
  • the main CPU 101 repeats step S S 301 through S 304 and quits the processing upon determining that the area D (sound wave) has reached the critical reaching distance (S 303 ; YES). Since the attenuation property of the sound wave amplitude is at first unknown to the player, in order to inform the player that the sound wave has reached the critical reaching distance, a command for displaying flickering signals on the sound source object 411 may be given to the video block 11 , or a command for generating a special sound may be given to the sound block 12 . By doing so, the player will sense the critical reaching distance and make use of such sense in the next stage.
  • the main CPU 101 repeats step S S 301 through S 304 , and, on the basis of the current position of the area D, browses the object information storing means 202 .
  • the main CPU 101 fetches data regarding such object from the object information storing means 202 at the RAM 102 (S 306 ).
  • the main CPU 101 determines whether or not the object has a sound reflecting property, and if the object is found to be anon-sound-reflecting object (S 307 ; NO), the processing shifts to determination of the critical reaching distance. This is because, if an object does not reflect any sound wave, the sound wave either penetrates through the object or is reduced and extinguished inside the object, and therefore, the object may be thoroughly neglected as if not existing at all.
  • the main CPU 101 determines that the object in question is a sound-reflecting object (S 307 ; YES), the distance between the sound source object 411 and the object will be calculated (S 308 ). According to this calculation, the main CPU 101 forms a command for outputting a reflected sound from the object with an attenuated sound wave amplitude depending on the distance to and back from the object (S 309 ).
  • the main CPU 101 determines that the object is a wall or other structures pursuant to the property data thereof (S 310 ; YES)
  • the aforementioned command from step S 309 and a command for outputting a sound in the same tone as the shooting sound from the sound source object 411 are provided to the sound block 12 (S 313 ).
  • the sound block 12 As a result, some time after shooting of the sound wave, a reflected sound having exactly the same tone as the shooting sound will be heard from the direction where the sound wave has been shot using the sound source object 411 .
  • the player will perceive a sound pattern with attenuated sound wave amplitude depending on the distance to the object.
  • the player will understand that there is a wall in the direction to which the sound source object 411 of the player character 410 is pointed, and that the wall is at a distance equal to half the time before the reflected sound is heard after the shooting of the sound wave from the sound source object 411 .
  • the main CPU 101 determines on the basis of the object property data above that the object is not a wall or other structures (S 310 ; NO)
  • the main CPU 101 checks the registration area where objects previously appearing in the game are registered and compares the property data of the object with data stored in the registration area.
  • the main CPU 101 forms a command for changing the tone from any previous tones and gives such command to the sound block 12 together with the command from step S 309 above (S 313 ).
  • step S 314 After registering the property of the object at the registration area (S 314 ), the main CPU 101 quits this processing.
  • the purpose of step S 314 is to allow formation of the same reflected sound in the subsequent processing when an object having the same property appears.
  • the main CPU 101 determines on the basis of the object property data above that the object is not a wall or other structures (S 310 ; YES), the main CPU 101 checks the registration area where the objects previously appearing in the game are registered, and compares the property data of the object with the data stored in the registration area.
  • the main CPU 101 determines that the property data of the object conforms with previous data (S 312 ; YES)
  • a command for generating sound in the same tone as the sound previously output is given to the sound block 12 together with the command from the aforementioned step S 309 (S 315 ).
  • the explanation above gives an example of the area D moving along the x-axis, it is needless to mention that the area D may also be considered as moving among coordinates in the (X, Y, Z) rectangular coordinate system.
  • the player checks the inner condition of the building 250 on the basis of the reflected sound, namely, by whether or not any reflected sound is heard, and thereby moves the player character ahead through the building 250 from the start 251 to the goal 252 .
  • FIG. 4 is a flowchart explaining the first sound pattern processing operation of the sound marker.
  • the sound marker 412 is placed at a prescribed position and the situation of the player character 410 is determined based on the changes in the positions of the sound marker 412 and the player character 410 . More specifically, by this sound pattern processing, the player may determine the situation of the player character 410 upon respective sound patterns of “an attenuated sound”, “an amplified sound”, “change in the character position and no change in the sound volume” or “a sudden difficulty in hearing any sound.”
  • a sound pattern of “an attenuated sound” is formed by the main CPU 101 and commanded to the sound block 12 while the player operates the operation device 2 to move the player character 410 . Accordingly, the player will know from such sound pattern that the player character 410 is moving away from the sound marker 412 .
  • a sound pattern of “a sudden difficulty in hearing any sound” is formed by the main CPU 101 and commanded to the sound block 12 while the player character 410 is being moved, there will be a sound pattern of any sound suddenly becoming difficult to be heard. Accordingly, the player will know from such sound pattern that there is an obstacle between the player character 410 and the sound marker 412 .
  • a precondition for these operations is that the sound marker 412 is arranged at a prescribed position.
  • the operation device 2 is operated and the player character 410 is moved.
  • the main CPU 101 reads the position of the sound marker 412 (S 401 ).
  • the main CPU 101 reads the position of the player character 410 (S 402 ).
  • the main CPU 101 browses the object information storing means 202 at the RAM 102 to determine whether or not there is any obstacle between the character 410 and the sound marker 412 (S 403 ).
  • the main CPU 101 determines whether or not such object reflects any sound wave (S 405 ). If the main CPU 101 determines that the object reflects a sound wave (S 405 ; YES), the main CPU 101 implements a processing, making it difficult to hear any sound, and thereafter quits the processing (S 406 ; YES). In other words, by step S S 401 through 406 , there is formed a sound pattern of “a sudden difficulty in hearing any sound.”
  • the main CPU 101 determines that the object in question does not reflect any sound wave (S 405 ; NO)
  • the main CPU 101 sets “1” to a flag F (S 407 ) and calculates the distance between the player character 410 and the soundmarker 412 (S 408 ).
  • the main CPU 101 reads the distance of the player character 410 and the sound marker 412 which has been stored the previous time (S 409 ).
  • the main CPU 101 compares the current distance of the player character 410 and the sound marker 412 with the previous distance thereof (S 410 ).
  • the main CPU 101 determines whether or not “1” is set to the flag F (S 411 ). In this case, “1” is set to the flag F (S 411 ; YES), and therefore, the main CPU sets an attenuation coefficient in accordance with the property of the object (S 412 ), and the amplitude of the sound wave is decreased for the amount of the prescribed attenuation coefficient depending on the property of the object (S 414 ). Subsequently, the main CPU 101 determines whether or not the player character 410 has reached the critical reaching distance (S 415 ).
  • step SS 401 through S 405 steps S 407 through S 415 , and a command given to the sound block 12 , the speakers 4 , 4 reproduce an attenuated sound wave due to the sound passing through a sound-penetrating object. Accordingly, the player hears a sound pattern of a sound wave with a suddenly decreased volume.
  • the main CPU 101 determines whether or not “1” is set to the flag F (S 416 ). In this case, “1” is set to the flag F (S 416 ; YES), and therefore, the main CPU sets an attenuation coefficient in accordance with the property of the object (S 417 ), and the amplitude of the sound wave is increased in conformity with a prescribed attenuation coefficient depending on the property of the object (S 418 ). Subsequently, the main CPU 101 determines whether or not the player character has reached the object (S 419 ). If the position of the player character 410 conforms with the position of the object (S 419 , conforming to the position of the object), there is implemented a processing of discontinuing any further increase of the sound wave, and the processing returns to step S 402 .
  • the main CPU 101 determines whether or not “1” is set to the flag F (S 421 ). Since “1” is set to the flag F in the present case (S 421 ; YES), the sound will be attenuated in accordance with the attenuation coefficient depending on the property of the object (S 422 ), and the main CPU further implements a processing of changing the position of the player character 410 without changing the level of the sound wave (S 423 ). Consequently, the player character 410 is found moving, keeping a certain distance from the sound marker 412 .
  • steps S 408 and S 409 are implemented so as to compare the distance between the player character 410 and the sound marker 412 with the previous distance thereof (S 410 ).
  • the main CPU 101 determines whether or not “1” is set to the flag F (S 411 ) In this case, “0” is set to the flag F because no object exists in between (S 411 ; NO), and therefore, the amplitude of the sound wave is attenuated only for the amount of the attenuation coefficient of the space (S 414 ). Subsequently, the main CPU 101 determines whether or not the player character 410 has reached the critical reaching distance (S 415 ).
  • the main CPU 101 reads data concerning the position of the player character 410 (S 402 ).
  • steps S 408 through S 410 , steps S 412 , S 414 and S 415 , and a command given to the sound block 12 the speakers 4 , 4 reproduce a sound which is decreased only for the amount of the attenuation coefficient of the virtual space. Consequently, a sound pattern with a decreased sound wave is provided to the player.
  • the player is provided with a sound pattern of the player character 410 gradually moving away from the sound marker 412 .
  • the main CPU 101 determines whether or not “1” is set to the flag F (S 411 ). In this case, “0” is set to the flag F because there is no object in between (S 416 ; NO), and therefore, the amplitude of the sound wave is increased in accordance with the attenuation coefficient of the virtual space (S 418 ). Subsequently, the main CPU 101 determines whether or not the position of the player character 410 conforms to the position of the sound marker 412 (S 419 ).
  • the main CPU 101 again returns to the processing of reading the position data of the player character 410 (S 402 ).
  • steps S 401 through S 403 steps S 408 through S 410 , steps S 416 , S 418 and S 419 , and a command given to the sound block 12 , the speakers 4 , 4 reproduce a sound gradually increasing in the space. Consequently, the player is provided with a sound pattern with a sound wave being decreased by a normal distance. As a result, a sound pattern of the player character 410 gradually approaching the sound marker 412 is provided.
  • the main CPU 101 determines whether or not “1” is set to the flag F (S 421 ). In this case, since “0” is set to the flag F (S 421 ; NO), there is implemented a processing of changing the position of the player character 410 without changing the level of the sound wave (S 423 ). Consequently, the player character 410 is found moving, keeping a certain distance from the sound marker 412 .
  • a sound pattern is formed with a gradually increasing sound wave amplitude when the player character 410 is approaching the sound marker 412 , and a sound pattern is formed with a gradually decreasing sound wave amplitude when the player character 410 is moving away from the sound marker 412 .
  • the player character 410 picks up the sound marker 412 .
  • the main CPU 101 determines that the player character 101 has reached the critical reaching distance (S 415 ; YES), the main CPU 101 attenuates the sound wave completely (S 101 ) and quits the processing.
  • the player may determine the situation of the player character 410 on the basis of the sound pattern generated from the sound marker 412 .
  • FIG. 5 is a flowchart illustrating the first sound pattern processing. This flowchart shows, for example, the processing of distinguishing the sound marker 412 from another object when a sound wave is generated from the sound marker 412 or when there is an object generating a sound wave similar to that generated from the sound marker 412 .
  • the player arranges the sound marker 412 near the source of the signal located at certain coordinates. For example, the player may throw the sound marker 412 near the source of the signal.
  • the main CPU 101 determines on a constant basis whether or not the sound marker 412 has been arranged (S 501 -S 501 ; NO). If the marker 412 is arranged near the coordinates (S 501 ; YES), the main CPU 101 reads the data of the signal source (S 102 ). If the main CPU determines according to such data that the source of the signal is the sound marker 412 theretofore arranged (S 503 ; YES), the main CPU gives the sound block 12 a command not to generate a sound wave with a roaring tone (S 504 ). Consequently, the speakers 4 , 4 generate a sound wave without any roaring tone, and the player will know that the sound has been generated by the sound marker 412 which was arranged by the player.
  • the main CPU 101 determines on the basis of such data that the sound wave does not come from the sound marker (S 503 ; NO), the main CPU 101 commands the sound block 12 to generate a sound wave with a roaring tone (S 505 ). Consequently, the speakers 4 , 4 generate a sound wave with a roaring tone, and the player will know that the sound comes from another object (for example, an enemy object).
  • the player may distinguish whether the sound comes from the sound marker 412 arranged in respect to the sound source object or any other object.
  • the player can enjoy the game on the basis of the sound pattern being provided.
  • the player may freely operate the sound source and enjoy the game based on the reflected sounds of the sound waves generated from the sound source and the changes in the tones of the sound waves.
  • sounds particular to respective objects are audible at prescribed positions and in prescribed directions, thereby allowing determination of physical positions and content of an object located in the virtual space and providing a new game environment not dependent on the game picture.

Abstract

A virtual three-dimensional sound pattern generator is provided. A player character may move within a virtual three-dimensional space using a sound source object and a sound marker. The player character may use the sound source object to shoot sound signals at the sound marker. The sound marker may then provide sound information based on the relative position of the sound source object for the player character, and based on materials of virtual objects. Audible sounds at prescribed positions and in prescribed directions within the virtual three-dimensional space are then provided.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a three-dimensional sound pattern generator and a method and a medium thereof, and more particularly, to a virtual three-dimensional sound pattern generator for progressing a game which mainly depends on the player's auditory sense.
2. Related Art
As a virtual three-dimensional sound pattern generator of this kind, there is known a device comprising: an object storing portion for storing three-dimensional object information; a sound source storing portion for storing sound source information; a central processing portion for forming sound signals for generating sound reaching the position of a player character in conformity with the information concerning walls and other objects stored in the storing portions, information on the sound source, and the progress of the game; a speaker for converting the sound signals formed at the central processing portion into audible sounds; display means for displaying a picture of the game; and an operation panel for moving a character displayed on the display means. (For example, Patent Laid-Open Publication for Patent Application No. HEI 4-316168)
According to such virtual three-dimensional sound pattern generator, the player hears different sound effects, feeling as if he/she is standing at the same position and facing the same direction as the character which is moved on the display means with an operation panel. Thus, a sense of high virtual reality is provided to the player.
However, in certain conventional virtual three-dimensional sound pattern generators, sounds are reproduced only at the position and in the direction where such sounds are presumed to be heard assuming from the relative location of the character and other objects. Although higher virtual reality is obtained in these devices than in conventional devices, sounds are used only as means for effectively promoting the game as in other conventional devices, and active use of the sounds in the course of the game was not considered.
In view of the limitations encountered in the aforementioned prior art, an object of the present invention is to provide a virtual three-dimensional sound pattern generator and a method and a medium thereof based on a new idea of making an active use of sounds in the course of a game.
Another object of the present invention is to provide a virtual three-dimensional sound pattern generator and a method and medium thereof for progressing the game pursuant to the sound information that is changed by the player, for example, moving the sound source at his/her discretion.
SUMMARY OF THE INVENTION
In order to achieve the aforementioned objects, a virtual three-dimensional sound pattern generator of the present invention for forming sound patterns within a virtual space comprises: object information storing means for storing physical information on virtual objects arranged in the virtual three-dimensional space and information on materials of the virtual objects; operation means for controlling movement of a player character within the space structured by the virtual objects arranged in the virtual space and controlling shooting directions and sound generation of a sound source object; sound source storing means for storing sound source information of the sound source object; a plurality of sound conversion means for converting sound signals into audible sounds; and sound pattern processing means for variably controlling sound information on the sound source object of the player character in accordance with the position of the sound source object of the player character in the space structured by the virtual objects, information on the virtual objects arranged within the virtual three-dimensional space and information on the materials of the virtual objects, and for forming this sound information into sound signals audible at prescribed positions and in prescribed directions within the three-dimensional space, and providing the sound signals to the sound conversion means.
In order to achieve the aforementioned objects, a virtual three-dimensional sound pattern generator of the present invention for forming sound patterns within a virtual space comprises: object information storing means for storing physical information on virtual objects arranged in the virtual three-dimensional space and information on materials of the virtual objects; operation means for controlling movement of a sound marker within the space structured by the virtual objects arranged in the virtual space and controlling sound generation; sound source storing means for storing sound source information of the soundmarker; a plurality of sound conversion means for converting sound signals into audible sounds; and sound pattern processing means for variably controlling sound information on the sound marker in accordance with the position of the sound marker in the space structured by the virtual objects, information on the virtual objects arranged within the virtual three-dimensional space and information on materials of the virtual objects constituting structures in the virtual three-dimensional space, and for forming the sound information into sound signals audible at prescribed positions and in prescribed directions within the three-dimensional space, and providing the sound signals to the sound conversion means.
In order to achieve the aforementioned objects, a virtual three-dimensional sound pattern generator of the present invention for forming sound patterns within a virtual space comprises: object information storing means for storing physical information on virtual objects arranged in the virtual three-dimensional space and information on materials of the virtual objects; operation means for controlling movement of a player character and a sound marker within the space structured by the virtual objects arranged in the virtual space and controlling shooting directions of a sound source object or sound generation of the sound source object and the sound marker; sound source storing means for storing sound source information of the sound source object of the character and the sound marker; a plurality of sound conversion means for converting the sound signals into audible sounds; and sound pattern processing means for variably controlling sound information on the sound source object of the character and/or sound marker in accordance with the relative position of the sound source object of the character and the sound marker in the space structured by the virtual objects, information on the virtual objects arranged within the virtual three-dimensional space and information on materials of the virtual objects constituting structures in the virtual three-dimensional space, and for forming the sound information into sound signals audible at prescribed positions and in prescribed directions within the three-dimensional space, and providing the sound signals to the sound conversion means.
The sound pattern processing means of the present invention comprises means of the present invention comprises means for changing the sound information on the sound marker in accordance with the information on materials of the virtual objects upon identification of collision of the marker with the virtual objects during its movement through the space structured by the virtual objects in conformity with the operational command from the operation means.
The sound pattern processing means of the present invention comprises means for forming sound information of the moved sound on the basis of movement of the character within the space structured by the virtual objects.
The sound conversion means of the present invention is capable of reproducing three-dimensional sounds.
In order to achieve the aforementioned objects, a method of the present invention for generating virtual three-dimensional sound patterns whereby sound patterns are formed within a virtual space, comprises the steps of: controlling movement of a player character within a space structured by virtual objects arranged in the virtual space on the basis of operational commands from the operation means and controlling shooting directions and sound generation of a sound source object within the space; variably controlling sound information on the character in accordance with a position of the sound source object of the player character within the space structured by the virtual objects, information on the virtual objects arranged within the virtual three-dimensional space and information on materials of the virtual objects; and allowing sounds to be heard at prescribed positions and in prescribed directions within the three-dimensional space.
In order to achieve the aforementioned objects, a method of the present invention for generating virtual three-dimensional sound patterns whereby sound patterns are formed within a virtual space, comprises the steps of: controlling movement of a player character and a sound marker in a space structured by virtual objects arranged in the virtual space on the basis of operational commands from the operation means and controlling sound generation of the sound marker; variably controlling sound information on the sound marker in accordance with a position of the sound marker within the space structured by the virtual objects, information on the virtual objects arranged within the virtual three-dimensional space and information on materials of the virtual objects; and allowing sounds to be heard at prescribed positions and in prescribed directions within the three-dimensional space.
In order to achieve the aforementioned objects, a method of the present invention for generating three-dimensional virtual sound patterns whereby sound patterns are formed within a virtual space, comprises the steps of: controlling movement of a player character and a sound marker in a space structured by virtual objects arranged in the virtual space on the basis of operational commands from the operation means, as well as controlling shooting directions of the sound source object and the sound marker; variably controlling sound information on the source object of the character and/or sound marker in accordance with the relative position of the sound source object of the player character and the sound marker within the space structured by virtual objects; and allowing sounds to be heard at prescribed positions and in prescribed directions within the three-dimensional space.
In order to achieve the aforementioned objects, a medium of the present invention has recorded therein, a program causing a computer to function as the aforementioned processing portion or a data device.
The medium above stores information (for example, a game program) by certain physical means, and is capable of causing game devices and other information processing devices to execute predetermined functions, for example, execution of a game program.
The aforementioned medium includes, for example, a CD-R, a game cartridge, a floppy disc, a magnetic tape, an optical magnetic disc, a CD-ROM, a DVD-ROM, a DVD-RAM, a ROM cartridge, a battery backup RAM, a flash memory, a non-volatile cartridge, and the like.
Furthermore, the medium above further includes a communication medium such as a telephone circuit, an optical cable, or other wire communication media, or radio communication media, etc. Internet is also included in such communication media.
DESCRIPTION OF THE DRAWINGS BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram showing the outline of the game device employing the virtual three-dimensional sound pattern generator according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the virtual three-dimensional sound pattern generator of the same embodiment.
FIG. 3 is a flowchart illustrating the sound pattern processing of the sound source object held by the player character of the same embodiment.
FIG. 4 is a flowchart illustrating the first sound pattern processing of the sound marker of the same embodiment.
FIG. 5 is a flowchart illustrating the first sound pattern processing of the sound marker of the same embodiment.
FIG. 6 is a block diagram showing an example of space structured by objects arranged in the virtual space which is to be used in the game of the same embodiment.
FIG. 7 is an explanatory diagram showing an example of a construction structured by objects arranged in the virtual space, used in the same embodiment.
DESCRIPTION OF A PREFERRED EMBODIMENT
A preferred embodiment of the present invention will be explained below with reference to the drawings.
“Structure”
FIG. 1 is a block diagram showing an outline of the game device which employs a virtual three-dimensional sound pattern generator according to an embodiment of the present invention. In FIG. 1, a game device comprises a body 1 of a processing device, an operation device 2, a display 3, and a plurality of speakers 4, 4.
The body 1 of the processing device comprises a CPU block 10 for controlling the overall device, a video block 11 for controlling display of the game screen, a sound block 12 for generating sound effects etc., and a subsystem 13 for reading out a CD-ROM 5.
The CPU block 10 comprises an SCU (System Control Unit) 100, a main CPU 101, a RAM 102, a ROM 103, a sub CPU 104, a CPU bus 105, etc.
The main CPU 101 controls the overall device. A computing function similar to a DSP (Digital Signal Processor) is included inside the main CPU 101, allowing execution of application software at a high speed. The RAM 102 is used as a work area of the main CPU 101. In the ROM 103, an initial program for an initialization processing, etc. are written. The SCU 100 controls buses 105, 106 and 107, and thereby allows smooth input and output of data among the main CPU 101, VDPs 120 and 130, DSP 140, CPU 141, etc. Moreover, the SCU 100 includes a DMA controller inside, allowing transfer of spright data in the game to VRAMs in the video block 11. The above-described construction enables execution of games and other application software at a high speed.
The sub CPU 104 is called the SMPC (System Manager & Peripheral Control), comprising functions such as collecting data via the operation device (peripheral) 2 upon the request of the main CPU 101. The main CPU 101 implements processing such as moving the character in the game screen in conformity with the operation (peripheral) data received from the sub CPU 104. The sub CPU 104 comprises functions such as automatically recognizing the types of peripherals connected to a connector 6 and collecting peripheral data etc. in accordance with the communication method used for the respective types of peripherals.
The video block 11 comprises a VDP (Video Display Processor) 120 for drawing video game characters etc. made of polygon data, and a VDP 130 for drawing background images, synthesizing polygon image data and background images and implementing a clipping processing thereof. The VDP 120 is connected to a VRAM 121 and frame buffers 122 and 123. The drawing data with polygons representing video game characters are sent to the VDP 120 from the main CPU 101 via the SCU 100 so that they are written in the VRAM 121. The drawing data written in the VRAM 121 are drawn to the frame buffer 122 or 123 in the form of, for example, 16 or 8 bit/pixel. Data drawn to the frame buffer 122 or 123 are sent to the VDP 130. Information for controlling the drawing is provided to the VDP 120 from the main CPU 101 via the SCU 100. The VDP 120 executes a drawing processing according to such instructions.
The VDP 130 is connected to a VRAM 131 and is structured so that image data output from the VDP 130 are output to an encoder 160 via a memory 132. By adding synchronous signals etc. to these image data, the encoder 160 generates video signals and displays such signals on the display 3. A game screen is thus displayed on the display 3.
The sound block 12 comprises a DSP 140 which conducts voice synthesis under a PCM or an FM method and a CPU 141 which conducts control etc. of the DSP 140. Voice data produced by the DSP 140 are converted into multi-channel analog sound signals by a D/A converter 170, and the electric power of the voice data is amplified at the power amplifying circuits 6, 6 and thereafter respectively output to a plurality of speakers 4, 4.
The subsystem 13 comprises functions such as reading application software provided in the form of the CD-ROM 5 and reproducing animation data and voice data.
“Functional block”
FIG. 2 is a block diagram showing the virtual three-dimensional sound pattern generator described above. In FIG. 2, the virtual three-dimensional sound pattern generator 201 comprises: object information storing means 202 for storing physical information on virtual objects arranged in a virtual three-dimensional space and information on materials of such virtual objects; an operation device 2 for controlling the movement of a character and/or a sound marker within a space structured by virtual objects arranged in the virtual space and for controlling shooting directions from a sound source object of the player character and generation of sounds for the sound source object and the sound marker; sound source storing means 203 for storing information concerning the character and the sound source object; a plurality of sound conversion means 204 for converting the aforementioned sound signals into audible sounds; and sound pattern processing means 205 for variably controlling sound information on the sound source object of the player character or the sound marker in accordance with the position of the sound source object of the player character and/or the sound marker within the space structured by virtual objects arranged in the virtual space and information on materials of the virtual objects, and for forming sound signals audible at the predetermined position and direction in the virtual three-dimensional space and thereafter providing such sound signals to the sound conversion means 204.
The sound conversion means 204 comprises: a plurality of speakers 4, 4; power amplifying circuits 6, 6 for amplifying the power of signals output from the D/A converter 170 and driving the plurality of speakers 4, 4; and a D/A converter 170 providing sound signals to each of the power amplifying circuits 6, 6.
The sound pattern processing means 205 is realized in the following manner. First of all, a program stored in the CD-ROM 5 is developed in the RAM 102 by the main CPU 101. The main CPU 101 executes a program developed in the RAM 102 and reads and processes operation data received from the operation device 2, and also controls operation of a video block 11 and a sound block 12, thereby realizing the sound pattern processing means 205. Physical information on the virtual objects arranged in the virtual three-dimensional space and information on materials of the virtual objects are stored in the object information storing area in the RAM 102. Furthermore, information concerning the character and the sound source object is also stored in the object information storing area in the RAM 102. If all of the information may not be stored in the RAM 102, data up to the end of a prescribed scene in the course of the game can be fetched from the CD-ROM 5 on each occasion so that such data are developed at the desired area in the RAM 102.
FIG. 6 is a diagram showing an example of a space structured by objects arranged in the virtual space, which may be used in the game. A plan view of a building 250 is shown in FIG. 6. The purpose of the game is to bring the player character from the starting point 251 at the building 250 to the goal 252.
The building 250 has the following construction: The building 250 is surrounded by exterior walls 253, 254, 255 and 256. Inside the building 250, there are rooms 261, 262, 263, and 264. Room 261 is structured by walls 271, 272, 273, 274 which surround a predetermined area. Room 262 is structured by walls 274, 275 . . . , 281 which surround a predetermined area. Room 263 is structured by walls 282, 283, 284, 285 which surround a predetermined area. Room 264 is structured by walls 285, 286, 287, 288 which surround a predetermined area.
On wall 274 of room 261, door 290 is furnished, providing a passage only to room 262. On wall 277 of room 262, door 291 is furnished, thereby providing a passage between room 262 and hallway 303. On the respective walls 284 and 285 of room 263, doors 292 and 293 are furnished. Door 292 provides a passage between hallway 301 and room 263, while door 293 provides a passage between room 263 and room 264. On wall 287 of room 264, door 294 is furnished, providing a passage between hallway 305 and room 264.
Hallway 301 is connected with hallways 302, 303, 304 and 305. Hallway 306 is connected with hallways 302, 304 and 305.
An enemy character 420 may be arranged, for example, near the intersection of hallway 301 and hallway 305.
Let it be presumed that the above-described space structured by doors and other virtual objects arranged in the virtual space presents a dark environment with limited visibility as being under turbid water. Therefore, almost nothing is displayed in the game picture shown on the display 5.
On the other hand, the medium filled in the aforementioned space structured by the virtual objects is conditioned to have an incredible sound transferring ability but an extremely low sound transferring speed. In this space, the player character 410 holds a sound source object 411 capable of shooting sound waves in various directions, namely, forward, backward, rightward, leftward, upward and downward. Furthermore, the player character 410 carries different types of sound markers 412, 412, . . . , which can be thrown or arranged within the aforementioned space. The shooting sounds from the sound source object 411 and the sound marker 412 can be modulated according to the features of the respective objects.
By operating the operation device 2, the player moves the character through the space, aiming to bring the character from the start 251 to the goal 252. On the way to the goal, an enemy character 420 may appear. Since there may be fellow comrades within the space, attack is made only after confirming them with the sound wave.
If the player hears a reflected sound after shooting a sound wave with the shooting means, it is obvious that some object exists in the direction of the reflected sound; if the player hears no reflected sound, it means that no object exists in that direction. Moreover, by the volume of the reflected sound, the player can assume the distance between the player character 410 and the object. For example, upon shooting in the upward direction in FIG. 6 from hallway 301, no reflected sound will be heard, meaning that no object exists in that direction. Whereas, upon shooting at wall 272, an immediate reflected sound will be heard, and such sound being loud, the player can assume that there is an object nearby.
The sound marker 412 is made so that various types of sounds, for example, continuous sounds or pulse sounds can be shot. Moreover, the sound marker 412 may generate a special sound. The sound marker 412 may be operated by the character 410. Furthermore, the sound of the sound marker 412 can also be controlled by the player character 410. In reality, the player can give commands by operating the operation device 2. Furthermore, sound markers can be dropped at different points so as to avoid taking the same route many times or coming to a dead end.
When the player character 410 stands at the start 251, the display 5 displays an image picture 500 of the hallway as shown in FIG. 7, urging the player character 410 to pass through the dark hallway. As the player character enters the hallway, almost nothing is displayed in the game picture shown on the display 5. The player checks the state of the sounds and moves the player character ahead towards the goal 252.
Data stored in the object information storing means 202 include: data (three-dimensional) concerning the arrangement of the exterior walls 253 through 256, walls 271 through 282, doors 290 through 294, etc.; data (three-dimensional) concerning the arrangement of floors and ceilings, etc. Which are not illustrated herein; data concerning the materials of these components 253 through 256, 271 through 282, 290 through 294, the floors and the ceilings; data concerning hallways 301 through 306; and data (three-dimensional) concerning the arrangement of the enemy character 420. Furthermore, the sound source means 203 stores data concerning the player character 410 and data on the sound of the sound source object.
“Sound Pattern Processing by the Sound Source Object of the Player Character”.
The sound pattern processing operation of the sound source object carried by the player character in the embodiment above will be explained below with reference to FIGS. 1 through 3, and FIGS. 6 and 7. FIG. 3 is a flowchart illustrating the sound pattern processing implemented by the sound source object of the player character.
This sound pattern processing is implemented under a presumption that the player character 410 is standing in the three-dimensional space represented by a rectangular coordinate system of (X, Y, Z). The point where the player character 410 is standing shall be the central point or the origin, represented as X0, Y0, Z0.
When the player wishes to check if any object exists in a certain direction from the point where the player character is standing, the player shoots a sound wave in that direction with the sound source object 411 held by the player character 410.
Given such a command, the main CPU implements processing shown in the flowchart of FIG. 3. Suppose a sound wave is shot, for example, in the direction of the x-axis. In order to reduce the burden caused to the main CPU 101, the progress of the sound wave is processed on the presumption that a prescribed area D proceeds along the x-axis in conformity with the travelling speed of the sound wave. The area D will be represented as {Y2+Z2 =K2} and processed as if a circular plate having a radius K moves through the space at the speed of the sound wave.
In order to make the area D move in conformity with the travelling speed of the sound wave, the value of the x-axis of the area D is changed at the main CPU 101 in conformity with the travelling speed of the sound wave (S301). As already mentioned, the medium filled in the virtual space above is conditioned as having an incredible sound transferring ability but an -extremely low sound transferring speed. However, increase and decrease in the amplitude shall be proportionate to the distance.
By changing the value of the x-axis subject to the aforementioned condition and arranging the area D at coordinates where the sound wave is to reach after a prescribed period of time, the area D is moved in equal amount by the main CPU 101 in accordance with the travelling speed of the-sound wave. Furthermore, based on such coordinates of the area D, the main CPU 101 browses the object information storing means 202 to determine whether or not there is any object at the coordinates above (S302). When the main CPU 101 identifies no object at the coordinates of the area D (S302; NO), the main CPU 101 further determines whether or not the sound wave has reached the “critical reaching distance”. Here, the “critical reaching distance” means a distance that the sound wave may no longer reach the point of the player character 410 even when reflected, due to the gradual attenuation of the sound wave amplitude during movement through the medium.
When the main CPU 101 determines that the area D has not yet reached the critical reaching distance (S303; NO), the main CPU 101 determines whether or not the attenuation processing has been implemented (S304). When the main CPU 101 determines that the attenuation processing has not been implemented (S304; NO), the main CPU 101 orders the sound block 12 to attenuate and finally extinguish the soundwave (S305). Given such order, the speakers 4, 4 reproduce a sound pattern of a sound wave being shot from the sound source object 411 held in the hands of the player character 410, for example, a sound pattern of a shooting sound extinguishing immediately after being heard. Then, the processing of the main CPU 101 returns to step S301 again.
In conformity with the travelling speed of the sound wave, the main CPU 101 changes the x-axis value of the area D so that it becomes equal to the distance which the sound wave has moved along the x-axis after a certain period of time (S301). As a result, the area D proceeds along the x-axis from its previous position. On the basis of the coordinates of the area D, the main CPU 101 browses the object information storing means 202 at the RAM 102 and determines whether or not any object exists at the coordinates above (S302). When no object is identified at the coordinates of the area D (S302; NO), the main CPU 101 determines again whether or not the area D has reached the critical reaching distance. When it is determined that the area D has not reached the critical reaching distance (S303; NO), the main CPU determines whether or not the attenuation processing has been implemented (S304). Since the execution of such processing is identified by the main CPU 101 (S304; YES), the processing returns to step S301 again.
The aforementioned processing S301 through S304 is repeated by the main CPU 101.
The main CPU 101 repeats step S S 301 through S304 and quits the processing upon determining that the area D (sound wave) has reached the critical reaching distance (S303; YES). Since the attenuation property of the sound wave amplitude is at first unknown to the player, in order to inform the player that the sound wave has reached the critical reaching distance, a command for displaying flickering signals on the sound source object 411 may be given to the video block 11, or a command for generating a special sound may be given to the sound block 12. By doing so, the player will sense the critical reaching distance and make use of such sense in the next stage.
On the other hand, the main CPU 101 repeats step S S 301 through S304, and, on the basis of the current position of the area D, browses the object information storing means 202. When an object is identified at the coordinates of the area D (S302; NO), the main CPU 101 fetches data regarding such object from the object information storing means 202 at the RAM 102 (S306). Then, the main CPU 101 determines whether or not the object has a sound reflecting property, and if the object is found to be anon-sound-reflecting object (S307; NO), the processing shifts to determination of the critical reaching distance. This is because, if an object does not reflect any sound wave, the sound wave either penetrates through the object or is reduced and extinguished inside the object, and therefore, the object may be thoroughly neglected as if not existing at all.
Furthermore, if, on the basis of the data stored in the object information storing means 202, the main CPU 101 determines that the object in question is a sound-reflecting object (S307; YES), the distance between the sound source object 411 and the object will be calculated (S308). According to this calculation, the main CPU 101 forms a command for outputting a reflected sound from the object with an attenuated sound wave amplitude depending on the distance to and back from the object (S309).
If the main CPU 101 determines that the object is a wall or other structures pursuant to the property data thereof (S310; YES), the aforementioned command from step S309 and a command for outputting a sound in the same tone as the shooting sound from the sound source object 411 are provided to the sound block 12 (S313). As a result, some time after shooting of the sound wave, a reflected sound having exactly the same tone as the shooting sound will be heard from the direction where the sound wave has been shot using the sound source object 411. Moreover, the player will perceive a sound pattern with attenuated sound wave amplitude depending on the distance to the object. Consequently, the player will understand that there is a wall in the direction to which the sound source object 411 of the player character 410 is pointed, and that the wall is at a distance equal to half the time before the reflected sound is heard after the shooting of the sound wave from the sound source object 411.
On the other hand, if the main CPU 101 determines on the basis of the object property data above that the object is not a wall or other structures (S310; NO), the main CPU 101 checks the registration area where objects previously appearing in the game are registered and compares the property data of the object with data stored in the registration area. When it is determined that the property data do not conform with any of the previous data (S312; NO), the main CPU 101 forms a command for changing the tone from any previous tones and gives such command to the sound block 12 together with the command from step S309 above (S313). As a result, some time after the shooting of a sound wave, a reflected sound is heard from the direction where the sound wave has been shot using the sound source object 411, but in a tone unfamiliar to the player. The sound pattern provided to the player will have an attenuated sound wave amplitude depending on the distance to the object. Consequently, the player will know from the tone that this object has never been identified. After registering the property of the object at the registration area (S314), the main CPU 101 quits this processing. The purpose of step S314 is to allow formation of the same reflected sound in the subsequent processing when an object having the same property appears.
Furthermore, if the main CPU 101 determines on the basis of the object property data above that the object is not a wall or other structures (S310; YES), the main CPU 101 checks the registration area where the objects previously appearing in the game are registered, and compares the property data of the object with the data stored in the registration area. When the main CPU 101 determines that the property data of the object conforms with previous data (S312; YES), a command for generating sound in the same tone as the sound previously output is given to the sound block 12 together with the command from the aforementioned step S309 (S315). As a result, some time after the shooting of the sound wave, a reflected sound in a familiar tone will be heard from the direction to which the sound wave has been shot using the sound source object 411, thereby providing the player with a sound pattern of attenuated sound wave amplitude depending on the distance to such object.
The explanation above gives an example of the area D moving along the x-axis, it is needless to mention that the area D may also be considered as moving among coordinates in the (X, Y, Z) rectangular coordinate system.
As already explained, by shooting a sound wave from the sound source object held by the player character 410, the player checks the inner condition of the building 250 on the basis of the reflected sound, namely, by whether or not any reflected sound is heard, and thereby moves the player character ahead through the building 250 from the start 251 to the goal 252.
[First Sound Pattern Processing Operation of the Sound Marker]
Next, the sound pattern processing operation according to the same embodiment will be explained referring to FIGS. 1, 2, 4, 6 and 7. FIG. 4 is a flowchart explaining the first sound pattern processing operation of the sound marker.
In the first sound pattern processing operation of the sound marker, the sound marker 412 is placed at a prescribed position and the situation of the player character 410 is determined based on the changes in the positions of the sound marker 412 and the player character 410. More specifically, by this sound pattern processing, the player may determine the situation of the player character 410 upon respective sound patterns of “an attenuated sound”, “an amplified sound”, “change in the character position and no change in the sound volume” or “a sudden difficulty in hearing any sound.”
More specifically, if a sound pattern of “an attenuated sound” is formed by the main CPU 101 and commanded to the sound block 12 while the player operates the operation device 2 to move the player character 410, a sound pattern of an attenuated sound will be provided. Accordingly, the player will know from such sound pattern that the player character 410 is moving away from the sound marker 412.
Furthermore, if a sound pattern of “amplified sound” is formed by the main CPU 101 and commanded to the sound block 12 while the player character 410 is being moved, there will be a sound pattern of an amplified sound. As a result, the player will know from this sound pattern that the player character 410 is approaching the sound marker 412.
Furthermore, if a sound pattern of “change in the character position and no change in the sound volume” is formed by the main CPU 101 and commanded to the sound block 12 while the player character 410 is moved, there will be provided a sound pattern with the character position being changed and the sound volume remaining unchanged. As a result, the player will know from this sound pattern that the player character 410 is moving in parallel with the sound marker 412.
Furthermore, if a sound pattern of “a sudden difficulty in hearing any sound” is formed by the main CPU 101 and commanded to the sound block 12 while the player character 410 is being moved, there will be a sound pattern of any sound suddenly becoming difficult to be heard. Accordingly, the player will know from such sound pattern that there is an obstacle between the player character 410 and the sound marker 412.
Operations for forming these sound patterns will be explained referring to the flowchart of FIG. 4. A precondition for these operations is that the sound marker 412 is arranged at a prescribed position. The operation device 2 is operated and the player character 410 is moved. First of all, the main CPU 101 reads the position of the sound marker 412 (S401). Subsequently, the main CPU 101 reads the position of the player character 410 (S402). On the basis of the position data of the character 410 and the sound marker 412, the main CPU 101 browses the object information storing means 202 at the RAM 102 to determine whether or not there is any obstacle between the character 410 and the sound marker 412 (S403). If the main CPU 101 determines that there is an obstacle between the character 410 and the sound marker 412 (S403; YES), the main CPU 101 reads the property data of the obstacle from the object information storing means 202 (S404). Subsequently, the main CPU 101 determines whether or not such object reflects any sound wave (S405). If the main CPU 101 determines that the object reflects a sound wave (S405; YES), the main CPU 101 implements a processing, making it difficult to hear any sound, and thereafter quits the processing (S406; YES). In other words, by step S S401 through 406, there is formed a sound pattern of “a sudden difficulty in hearing any sound.”
Otherwise, if the main CPU 101 determines that the object in question does not reflect any sound wave (S405; NO), the main CPU 101 sets “1” to a flag F (S407) and calculates the distance between the player character 410 and the soundmarker 412 (S408). Subsequently, the main CPU 101 reads the distance of the player character 410 and the sound marker 412 which has been stored the previous time (S409). The main CPU 101 compares the current distance of the player character 410 and the sound marker 412 with the previous distance thereof (S410).
If the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has decreased (S410; decreased), the main CPU 101 identifies whether or not “1” is set to the flag F (S411). In this case, “1” is set to the flag F (S411; YES), and therefore, the main CPU sets an attenuation coefficient in accordance with the property of the object (S412), and the amplitude of the sound wave is decreased for the amount of the prescribed attenuation coefficient depending on the property of the object (S414). Subsequently, the main CPU 101 determines whether or not the player character 410 has reached the critical reaching distance (S415). If the player character 410 has not reached the critical reaching distance (S415; No), the main CPU 101 reads the position data of the player character 410 again (S402). As a result of step SS401 through S405, steps S407 through S415, and a command given to the sound block 12, the speakers 4, 4 reproduce an attenuated sound wave due to the sound passing through a sound-penetrating object. Accordingly, the player hears a sound pattern of a sound wave with a suddenly decreased volume.
On the other hand, if the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has increased (S410; increased), the main CPU 101 determines whether or not “1” is set to the flag F (S416). In this case, “1” is set to the flag F (S416; YES), and therefore, the main CPU sets an attenuation coefficient in accordance with the property of the object (S417), and the amplitude of the sound wave is increased in conformity with a prescribed attenuation coefficient depending on the property of the object (S418). Subsequently, the main CPU 101 determines whether or not the player character has reached the object (S419). If the position of the player character 410 conforms with the position of the object (S419, conforming to the position of the object), there is implemented a processing of discontinuing any further increase of the sound wave, and the processing returns to step S402.
Furthermore, if the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 remains unchanged (S410; unchanged), the main CPU 101 determines whether or not “1” is set to the flag F (S421). Since “1” is set to the flag F in the present case (S421; YES), the sound will be attenuated in accordance with the attenuation coefficient depending on the property of the object (S422), and the main CPU further implements a processing of changing the position of the player character 410 without changing the level of the sound wave (S423). Consequently, the player character 410 is found moving, keeping a certain distance from the sound marker 412.
According to the operation above, in a case where an object exists between the player character 410 and the sound marker 412 and such object reflects a sound wave completely, a processing of considerably decreasing or blocking the sound wave is implemented; whereas, in a case where the aforementioned object allows complete penetration of the sound wave, there is provided a sound pattern with an increased sound wave amplitude pursuant to the prescribed attenuation rate when the player character 410 is approaching the sound marker 412, and a sound pattern is provided with a more decreased sound wave amplitude than regular amplitude attenuation when the player character 410 is moving away from the sound marker 412.
Furthermore, if the main CPU 101 determines that there is no obstacle between the player character 410 and the sound marker 412 (S403; NO), steps S408 and S409 are implemented so as to compare the distance between the player character 410 and the sound marker 412 with the previous distance thereof (S410).
Moreover, if the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has decreased (S410; decreased), the main CPU 101 determines whether or not “1” is set to the flag F (S411) In this case, “0” is set to the flag F because no object exists in between (S411; NO), and therefore, the amplitude of the sound wave is attenuated only for the amount of the attenuation coefficient of the space (S414). Subsequently, the main CPU 101 determines whether or not the player character 410 has reached the critical reaching distance (S415). If the player character 410 has not reached the critical reaching distance (S415; NO), the main CPU 101 reads data concerning the position of the player character 410 (S402). As a result of step S S401 through S403, steps S408 through S410, steps S412, S414 and S415, and a command given to the sound block 12, the speakers 4, 4 reproduce a sound which is decreased only for the amount of the attenuation coefficient of the virtual space. Consequently, a sound pattern with a decreased sound wave is provided to the player. Thus the player is provided with a sound pattern of the player character 410 gradually moving away from the sound marker 412.
On the other hand, if the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 has increased (S410; increased), the main CPU 101 determines whether or not “1” is set to the flag F (S411). In this case, “0” is set to the flag F because there is no object in between (S416; NO), and therefore, the amplitude of the sound wave is increased in accordance with the attenuation coefficient of the virtual space (S418). Subsequently, the main CPU 101 determines whether or not the position of the player character 410 conforms to the position of the sound marker 412 (S419). If the position of the player character 410 does not conform to the position of the sound marker 412 (S419; NO), the main CPU 101 again returns to the processing of reading the position data of the player character 410 (S402). As a result of steps S401 through S403, steps S408 through S410, steps S416, S418 and S419, and a command given to the sound block 12, the speakers 4, 4 reproduce a sound gradually increasing in the space. Consequently, the player is provided with a sound pattern with a sound wave being decreased by a normal distance. As a result, a sound pattern of the player character 410 gradually approaching the sound marker 412 is provided.
Furthermore, if the main CPU 101 determines that the distance between the player character 410 and the sound marker 412 remains unchanged (S410; unchanged), the main CPU 101 determines whether or not “1” is set to the flag F (S421). In this case, since “0” is set to the flag F (S421; NO), there is implemented a processing of changing the position of the player character 410 without changing the level of the sound wave (S423). Consequently, the player character 410 is found moving, keeping a certain distance from the sound marker 412.
According to the operation above, in a case where there is no object between the player character 410 and the sound marker 412, a sound pattern is formed with a gradually increasing sound wave amplitude when the player character 410 is approaching the sound marker 412, and a sound pattern is formed with a gradually decreasing sound wave amplitude when the player character 410 is moving away from the sound marker 412. When the position of the player character 410 conforms to the position of the sound marker 412, the player character 410 picks up the sound marker 412.
When the main CPU 101 determines that the player character 101 has reached the critical reaching distance (S415; YES), the main CPU 101 attenuates the sound wave completely (S101) and quits the processing.
According to the embodiment above, by arranging the sound marker 412 at a prescribed position or by throwing the sound marker 412 and arranging it at a prescribed position, the player may determine the situation of the player character 410 on the basis of the sound pattern generated from the sound marker 412.
FIG. 5 is a flowchart illustrating the first sound pattern processing. This flowchart shows, for example, the processing of distinguishing the sound marker 412 from another object when a sound wave is generated from the sound marker 412 or when there is an object generating a sound wave similar to that generated from the sound marker 412.
First of all, when a sound wave is heard from the marker 412 or other sound sources while the player character moves through the building 250 in the space, the player needs to determine whether the sound comes from the sound marker placed by the player or from a different sound source.
Therefore, the player arranges the sound marker 412 near the source of the signal located at certain coordinates. For example, the player may throw the sound marker 412 near the source of the signal.
The main CPU 101 determines on a constant basis whether or not the sound marker 412 has been arranged (S501-S501; NO). If the marker 412 is arranged near the coordinates (S501; YES), the main CPU 101 reads the data of the signal source (S102). If the main CPU determines according to such data that the source of the signal is the sound marker 412 theretofore arranged (S503; YES), the main CPU gives the sound block 12 a command not to generate a sound wave with a roaring tone (S504). Consequently, the speakers 4, 4 generate a sound wave without any roaring tone, and the player will know that the sound has been generated by the sound marker 412 which was arranged by the player.
On the other hand, if the main CPU 101 determines on the basis of such data that the sound wave does not come from the sound marker (S503; NO), the main CPU 101 commands the sound block 12 to generate a sound wave with a roaring tone (S505). Consequently, the speakers 4, 4 generate a sound wave with a roaring tone, and the player will know that the sound comes from another object (for example, an enemy object).
Thus, the player may distinguish whether the sound comes from the sound marker 412 arranged in respect to the sound source object or any other object.
Consequently, according to the embodiment above, the player can enjoy the game on the basis of the sound pattern being provided.
As explained above, according to the present invention, instead of depending on one's visual sense, the player may freely operate the sound source and enjoy the game based on the reflected sounds of the sound waves generated from the sound source and the changes in the tones of the sound waves.
Furthermore, according to the present invention, by operating the operation device, sounds particular to respective objects are audible at prescribed positions and in prescribed directions, thereby allowing determination of physical positions and content of an object located in the virtual space and providing a new game environment not dependent on the game picture.

Claims (8)

What is claimed is:
1. A method of generating virtual three-dimensional sound patterns whereby sound patterns are formed within a virtual three-dimensional space, comprising the steps of:
controlling movement of a player character and a sound marker for the player character in the virtual three-dimensional space on the basis of operational commands, and controlling a direction of a wave of sound of a first type generated by a sound source object;
variably controlling sound information of a second type generated by the sound marker in response to the wave of sound of the first type generated by the sound source object in accordance with the direction of the wave of sound of the first type, relative to positions of the sound source object and the sound marker within the virtual three-dimensional space; and
allowing sounds to be heard by the player character at prescribed positions and in prescribed directions within the virtual three-dimensional space based on the direction of the wave of sound of the first type, and the relative positions of the player character and the sound marker.
2. The method of generating virtual three-dimensional sound patterns according to claim 1, further comprising:
changing the sound information of the sound marker in accordance with information on materials of a plurality of virtual objects upon identification of a collision of the sound marker with at least one of the virtual objects.
3. The method of generating virtual three-dimensional sound patterns according to claim 1, further comprising:
forming the sound information indicating motion of the player character within the virtual three-dimensional space.
4. The method of generating virtual three-dimensional sound patterns according to claim 1, further comprising:
reproducing three-dimensional sounds.
5. A computer-readable medium containing instructions for performing a method according to claim 1 when executed by a processing portion of a computer or a data device.
6. The method of generating virtual three-dimensional sound patterns according to claim 1, further comprising:
presenting the virtual three-dimensional space in a dark environment.
7. The method of generating virtual three-dimensional sound patterns according to claim 1, further comprising:
implementing attenuation processing for the sounds heard by the player character.
8. The method of generating virtual three-dimensional sound patterns according to claim 1, further comprising:
implementing attenuation processing according to whether or not the wave of sound travels a predetermined distance.
US09/275,396 1998-03-25 1999-03-24 Virtual three-dimensional sound pattern generator and method and medium thereof Expired - Fee Related US6760050B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP10077769A JPH11272156A (en) 1998-03-25 1998-03-25 Virtual three-dimensional sound image generating device and method and medium thereof
JP10-077769 1998-03-25

Publications (1)

Publication Number Publication Date
US6760050B1 true US6760050B1 (en) 2004-07-06

Family

ID=13643166

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/275,396 Expired - Fee Related US6760050B1 (en) 1998-03-25 1999-03-24 Virtual three-dimensional sound pattern generator and method and medium thereof

Country Status (2)

Country Link
US (1) US6760050B1 (en)
JP (1) JPH11272156A (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020032744A1 (en) * 2000-06-06 2002-03-14 Hidetaka Magoshi Entertainment apparatus having image and sound controlling system
US20040037434A1 (en) * 2002-06-12 2004-02-26 Enterprise Integration Group, Inc. Method and system for using spatial metaphor to organize natural language in spoken user interfaces
US20050222844A1 (en) * 2004-04-01 2005-10-06 Hideya Kawahara Method and apparatus for generating spatialized audio from non-three-dimensionally aware applications
US20050220308A1 (en) * 2004-03-31 2005-10-06 Yamaha Corporation Apparatus for creating sound image of moving sound source
US20050249367A1 (en) * 2004-05-06 2005-11-10 Valve Corporation Encoding spatial data in a multi-channel sound file for an object in a virtual environment
US6973192B1 (en) * 1999-05-04 2005-12-06 Creative Technology, Ltd. Dynamic acoustic rendering
US20060069747A1 (en) * 2004-05-13 2006-03-30 Yoshiko Matsushita Audio signal transmission system, audio signal transmission method, server, network terminal device, and recording medium
US20060206329A1 (en) * 2004-12-22 2006-09-14 David Attwater Turn-taking confidence
US20070196801A1 (en) * 2005-12-09 2007-08-23 Kenichiro Nagasaka Sound effects generation device, sound effects generation method, and computer program product
US20070218993A1 (en) * 2004-09-22 2007-09-20 Konami Digital Entertainment Co., Ltd. Game Machine, Game Machine Control Method, Information Recording Medium, and Program
US20070293314A1 (en) * 1998-10-23 2007-12-20 Kabushiki Kaisha Sega Enterprises Game device and image processing device
US20070293313A1 (en) * 2004-05-10 2007-12-20 Toru Shimizu Electronic Game Machine, Data Processing Method in Electronic Game Machine, Program and Storage Medium for the Same
US20080026827A1 (en) * 2006-04-21 2008-01-31 Pokermatic, Inc. Amusement gaming system
US20080228299A1 (en) * 2007-03-15 2008-09-18 Sony Computer Entertainment Inc. Audio Reproducing Apparatus And Audio Reproducing Method, Allowing Efficient Data Selection
US20080303746A1 (en) * 2007-06-07 2008-12-11 Igt Displaying and using 3d graphics on multiple displays provided for gaming environments
US20090062001A1 (en) * 2001-08-09 2009-03-05 Igt Virtual cameras and 3-d gaming environments in a gaming machine
US7901289B2 (en) * 2001-08-09 2011-03-08 Igt Transparent objects on a gaming machine
US7909696B2 (en) 2001-08-09 2011-03-22 Igt Game interaction in 3-D gaming environments
US7918730B2 (en) 2002-06-27 2011-04-05 Igt Trajectory-based 3-D games of chance for video gaming machines
US8002623B2 (en) 2001-08-09 2011-08-23 Igt Methods and devices for displaying multiple game elements
US8012019B2 (en) 2001-08-09 2011-09-06 Igt 3-D text in a gaming machine
US8267767B2 (en) 2001-08-09 2012-09-18 Igt 3-D reels and 3-D wheels in a gaming machine
EP2533552A3 (en) * 2011-06-10 2014-04-30 Square Enix Co., Ltd. Game sound field creator
US20140357359A1 (en) * 2013-06-04 2014-12-04 Nintendo Co., Ltd. Non-transitory storage medium encoded with information processing program capable of performing natural movement control of character moving in accordance with another character, information processing apparatus, method of controlling information processing apparatus, and information processing system
US20160354693A1 (en) * 2014-03-12 2016-12-08 Tencent Technology (Shenzhen) Company Limited Method and apparatus for simulating sound in virtual scenario, and terminal
US9564115B2 (en) 2011-02-28 2017-02-07 International Business Machines Corporation Producing sounds in a virtual world and related sound card
US10256859B2 (en) 2014-10-24 2019-04-09 Usens, Inc. System and method for immersive and interactive multimedia generation
US20190347885A1 (en) 2014-06-02 2019-11-14 Accesso Technology Group Plc Queuing system
US20210065460A1 (en) * 2017-12-26 2021-03-04 Skonec Entertainment Co., Ltd. Virtual reality control system
US11393271B2 (en) 2014-06-02 2022-07-19 Accesso Technology Group Plc Queuing system

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3955425B2 (en) * 2000-03-24 2007-08-08 三菱電機株式会社 3D sound reproduction system
JP5008234B2 (en) * 2001-08-27 2012-08-22 任天堂株式会社 GAME DEVICE, PROGRAM, GAME PROCESSING METHOD, AND GAME SYSTEM
US7371175B2 (en) 2003-01-13 2008-05-13 At&T Corp. Method and system for enhanced audio communications in an interactive environment
JP4534014B2 (en) * 2004-12-09 2010-09-01 独立行政法人産業技術総合研究所 A walking training environment generation system for the visually impaired
KR100868475B1 (en) * 2007-02-16 2008-11-12 한국전자통신연구원 Method for creating, editing, and reproducing multi-object audio contents files for object-based audio service, and method for creating audio presets
JP2011092302A (en) * 2009-10-27 2011-05-12 Konami Digital Entertainment Co Ltd Game device, method of controlling the same and program
JP5357801B2 (en) * 2010-02-10 2013-12-04 株式会社コナミデジタルエンタテインメント GAME DEVICE, GAME CONTROL METHOD, AND PROGRAM

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3831172A (en) * 1972-01-03 1974-08-20 Universal Res Labor Inc Solid-state sound effect generating system
JPH04316168A (en) 1991-04-15 1992-11-06 Toshiba Corp Picture display device
US5382026A (en) * 1991-09-23 1995-01-17 Hughes Aircraft Company Multiple participant moving vehicle shooting gallery
US5487113A (en) * 1993-11-12 1996-01-23 Spheric Audio Laboratories, Inc. Method and apparatus for generating audiospatial effects
US5633993A (en) * 1993-02-10 1997-05-27 The Walt Disney Company Method and apparatus for providing a virtual world sound system
US5754660A (en) * 1996-06-12 1998-05-19 Nintendo Co., Ltd. Sound generator synchronized with image display
US5784467A (en) * 1995-03-30 1998-07-21 Kabushiki Kaisha Timeware Method and apparatus for reproducing three-dimensional virtual space sound
US5943427A (en) * 1995-04-21 1999-08-24 Creative Technology Ltd. Method and apparatus for three dimensional audio spatialization
US5950202A (en) * 1993-09-23 1999-09-07 Virtual Universe Corporation Virtual reality network with selective distribution and updating of data to reduce bandwidth requirements
US6078669A (en) * 1997-07-14 2000-06-20 Euphonics, Incorporated Audio spatial localization apparatus and methods
US6091421A (en) * 1996-12-19 2000-07-18 U.S. Philips Corporation Displaying autostereograms of various depths until proper 3D perception is achieved
US6149435A (en) * 1997-12-26 2000-11-21 Electronics And Telecommunications Research Institute Simulation method of a radio-controlled model airplane and its system
US6154549A (en) * 1996-06-18 2000-11-28 Extreme Audio Reality, Inc. Method and apparatus for providing sound in a spatial environment
US6172641B1 (en) * 1998-04-09 2001-01-09 Magellan Dis, Inc. Navigation system with audible route guidance instructions

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3831172A (en) * 1972-01-03 1974-08-20 Universal Res Labor Inc Solid-state sound effect generating system
JPH04316168A (en) 1991-04-15 1992-11-06 Toshiba Corp Picture display device
US5382026A (en) * 1991-09-23 1995-01-17 Hughes Aircraft Company Multiple participant moving vehicle shooting gallery
US5633993A (en) * 1993-02-10 1997-05-27 The Walt Disney Company Method and apparatus for providing a virtual world sound system
US5950202A (en) * 1993-09-23 1999-09-07 Virtual Universe Corporation Virtual reality network with selective distribution and updating of data to reduce bandwidth requirements
US5487113A (en) * 1993-11-12 1996-01-23 Spheric Audio Laboratories, Inc. Method and apparatus for generating audiospatial effects
US5784467A (en) * 1995-03-30 1998-07-21 Kabushiki Kaisha Timeware Method and apparatus for reproducing three-dimensional virtual space sound
US5943427A (en) * 1995-04-21 1999-08-24 Creative Technology Ltd. Method and apparatus for three dimensional audio spatialization
US5862229A (en) * 1996-06-12 1999-01-19 Nintendo Co., Ltd. Sound generator synchronized with image display
US5754660A (en) * 1996-06-12 1998-05-19 Nintendo Co., Ltd. Sound generator synchronized with image display
US6154549A (en) * 1996-06-18 2000-11-28 Extreme Audio Reality, Inc. Method and apparatus for providing sound in a spatial environment
US6091421A (en) * 1996-12-19 2000-07-18 U.S. Philips Corporation Displaying autostereograms of various depths until proper 3D perception is achieved
US6078669A (en) * 1997-07-14 2000-06-20 Euphonics, Incorporated Audio spatial localization apparatus and methods
US6149435A (en) * 1997-12-26 2000-11-21 Electronics And Telecommunications Research Institute Simulation method of a radio-controlled model airplane and its system
US6172641B1 (en) * 1998-04-09 2001-01-09 Magellan Dis, Inc. Navigation system with audible route guidance instructions

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
Final Doom software game and help text; Id Software, Inc, Copyright 1996.* *
www.absolute-playstation.com/api_review/rfdoom.htm; Final Doom review, Oct. 1996.* *
www.computerhope.com/doomx/htm; Final Doom; release date Jun. 1996.* *
www.consoledomain.com; Point Blank review Apr. 1, 1998.* *
www.game-revolution.com/games/sony/fdoom; review of FinalDoom; Oct. 1996. *
www.sol.no/games/psgamer/rev_mp/pointb.htm; Point Blank review Feb. 18, 1998.* *
www.vgzone.com/reviews/psx/finaldoom.htm; Final Doom review release date Jun. 1996; printed Aug. 13, 2001.* *

Cited By (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070293314A1 (en) * 1998-10-23 2007-12-20 Kabushiki Kaisha Sega Enterprises Game device and image processing device
US8043158B2 (en) * 1998-10-23 2011-10-25 Kabushiki Kaisha Sega Game device and image processing device
US8275138B2 (en) * 1999-05-04 2012-09-25 Creative Technology Ltd Dynamic acoustic rendering
US20080069367A1 (en) * 1999-05-04 2008-03-20 Creative Technology, Ltd. Dynamic acoustic rendering
US6973192B1 (en) * 1999-05-04 2005-12-06 Creative Technology, Ltd. Dynamic acoustic rendering
US20060029243A1 (en) * 1999-05-04 2006-02-09 Creative Technology, Ltd. Dynamic acoustic rendering
US7248701B2 (en) * 1999-05-04 2007-07-24 Creative Technology, Ltd. Dynamic acoustic rendering
US20020032744A1 (en) * 2000-06-06 2002-03-14 Hidetaka Magoshi Entertainment apparatus having image and sound controlling system
US8267767B2 (en) 2001-08-09 2012-09-18 Igt 3-D reels and 3-D wheels in a gaming machine
US8523672B2 (en) 2001-08-09 2013-09-03 Igt 3-D reels and 3-D wheels in a gaming machine
US9135774B2 (en) 2001-08-09 2015-09-15 Igt 3-D reels and 3-D wheels in a gaming machine
US9418504B2 (en) 2001-08-09 2016-08-16 Igt 3-D reels and 3-D wheels in a gaming machine
US8012019B2 (en) 2001-08-09 2011-09-06 Igt 3-D text in a gaming machine
US8002623B2 (en) 2001-08-09 2011-08-23 Igt Methods and devices for displaying multiple game elements
US7934994B2 (en) 2001-08-09 2011-05-03 Igt Virtual cameras and 3-D gaming environments in a gaming machine
US7909696B2 (en) 2001-08-09 2011-03-22 Igt Game interaction in 3-D gaming environments
US7901289B2 (en) * 2001-08-09 2011-03-08 Igt Transparent objects on a gaming machine
US20090062001A1 (en) * 2001-08-09 2009-03-05 Igt Virtual cameras and 3-d gaming environments in a gaming machine
US7729915B2 (en) * 2002-06-12 2010-06-01 Enterprise Integration Group, Inc. Method and system for using spatial metaphor to organize natural language in spoken user interfaces
US20040037434A1 (en) * 2002-06-12 2004-02-26 Enterprise Integration Group, Inc. Method and system for using spatial metaphor to organize natural language in spoken user interfaces
US9072967B2 (en) 2002-06-27 2015-07-07 Igt Trajectory-based 3-D games of chance for video gaming machines
US8500535B2 (en) 2002-06-27 2013-08-06 Igt Trajectory-based 3-D games of chance for video gaming machines
US9613496B2 (en) 2002-06-27 2017-04-04 Igt Trajectory-based 3-D games of chance for video gaming machines
US9358453B2 (en) 2002-06-27 2016-06-07 Igt Trajectory-based 3-D games of chance for video gaming machines
US7918730B2 (en) 2002-06-27 2011-04-05 Igt Trajectory-based 3-D games of chance for video gaming machines
US8992320B2 (en) 2002-06-27 2015-03-31 Igt Trajectory-based 3-D games of chance for video gaming machines
US8550893B2 (en) 2002-06-27 2013-10-08 Igt Trajectory-based 3-D games of chance for video gaming machines
US8523671B2 (en) 2002-06-27 2013-09-03 Igt Trajectory-based 3-D games of chance for video gaming machines
US20050220308A1 (en) * 2004-03-31 2005-10-06 Yamaha Corporation Apparatus for creating sound image of moving sound source
US7319760B2 (en) * 2004-03-31 2008-01-15 Yamaha Corporation Apparatus for creating sound image of moving sound source
US20050222844A1 (en) * 2004-04-01 2005-10-06 Hideya Kawahara Method and apparatus for generating spatialized audio from non-three-dimensionally aware applications
US7818077B2 (en) * 2004-05-06 2010-10-19 Valve Corporation Encoding spatial data in a multi-channel sound file for an object in a virtual environment
US20050249367A1 (en) * 2004-05-06 2005-11-10 Valve Corporation Encoding spatial data in a multi-channel sound file for an object in a virtual environment
US20070293313A1 (en) * 2004-05-10 2007-12-20 Toru Shimizu Electronic Game Machine, Data Processing Method in Electronic Game Machine, Program and Storage Medium for the Same
US7850525B2 (en) 2004-05-10 2010-12-14 Sega Corporation Mechanism of generating a sound radar image in a video game device
US20060069747A1 (en) * 2004-05-13 2006-03-30 Yoshiko Matsushita Audio signal transmission system, audio signal transmission method, server, network terminal device, and recording medium
US8128497B2 (en) * 2004-09-22 2012-03-06 Konami Digital Entertainment Co., Ltd. Game machine, game machine control method, information recording medium, and program
US20070218993A1 (en) * 2004-09-22 2007-09-20 Konami Digital Entertainment Co., Ltd. Game Machine, Game Machine Control Method, Information Recording Medium, and Program
US20060206329A1 (en) * 2004-12-22 2006-09-14 David Attwater Turn-taking confidence
US20100324896A1 (en) * 2004-12-22 2010-12-23 Enterprise Integration Group, Inc. Turn-taking confidence
US7809569B2 (en) 2004-12-22 2010-10-05 Enterprise Integration Group, Inc. Turn-taking confidence
US7970615B2 (en) 2004-12-22 2011-06-28 Enterprise Integration Group, Inc. Turn-taking confidence
US20070196801A1 (en) * 2005-12-09 2007-08-23 Kenichiro Nagasaka Sound effects generation device, sound effects generation method, and computer program product
US8036395B2 (en) * 2005-12-09 2011-10-11 Sony Corporation Sound effects generation device, sound effects generation method, and computer program product
US20080026827A1 (en) * 2006-04-21 2008-01-31 Pokermatic, Inc. Amusement gaming system
US20080228299A1 (en) * 2007-03-15 2008-09-18 Sony Computer Entertainment Inc. Audio Reproducing Apparatus And Audio Reproducing Method, Allowing Efficient Data Selection
US8335580B2 (en) * 2007-03-15 2012-12-18 Sony Computer Entertainment Inc. Audio reproducing apparatus and audio reproducing method, allowing efficient data selection
US8384710B2 (en) 2007-06-07 2013-02-26 Igt Displaying and using 3D graphics on multiple displays provided for gaming environments
US20080303746A1 (en) * 2007-06-07 2008-12-11 Igt Displaying and using 3d graphics on multiple displays provided for gaming environments
US9564115B2 (en) 2011-02-28 2017-02-07 International Business Machines Corporation Producing sounds in a virtual world and related sound card
EP2533552A3 (en) * 2011-06-10 2014-04-30 Square Enix Co., Ltd. Game sound field creator
US9295909B2 (en) * 2013-06-04 2016-03-29 Nintendo Co., Ltd. Non-transitory storage medium encoded with information processing program capable of performing natural movement control of character moving in accordance with another character, information processing apparatus, method of controlling information processing apparatus, and information processing system
US20140357359A1 (en) * 2013-06-04 2014-12-04 Nintendo Co., Ltd. Non-transitory storage medium encoded with information processing program capable of performing natural movement control of character moving in accordance with another character, information processing apparatus, method of controlling information processing apparatus, and information processing system
US20160354693A1 (en) * 2014-03-12 2016-12-08 Tencent Technology (Shenzhen) Company Limited Method and apparatus for simulating sound in virtual scenario, and terminal
US9981187B2 (en) * 2014-03-12 2018-05-29 Tencent Technology (Shenzhen) Company Limited Method and apparatus for simulating sound in virtual scenario, and terminal
US20190347885A1 (en) 2014-06-02 2019-11-14 Accesso Technology Group Plc Queuing system
US11393271B2 (en) 2014-06-02 2022-07-19 Accesso Technology Group Plc Queuing system
US11869277B2 (en) 2014-06-02 2024-01-09 Accesso Technology Group Plc Queuing system
US11900734B2 (en) 2014-06-02 2024-02-13 Accesso Technology Group Plc Queuing system
US10256859B2 (en) 2014-10-24 2019-04-09 Usens, Inc. System and method for immersive and interactive multimedia generation
US10320437B2 (en) * 2014-10-24 2019-06-11 Usens, Inc. System and method for immersive and interactive multimedia generation
US20210065460A1 (en) * 2017-12-26 2021-03-04 Skonec Entertainment Co., Ltd. Virtual reality control system
US11517821B2 (en) * 2017-12-26 2022-12-06 Skonec Entertainment Co., Ltd. Virtual reality control system

Also Published As

Publication number Publication date
JPH11272156A (en) 1999-10-08

Similar Documents

Publication Publication Date Title
US6760050B1 (en) Virtual three-dimensional sound pattern generator and method and medium thereof
JP4095227B2 (en) Video game apparatus, background sound output setting method in video game, and computer-readable recording medium recorded with background sound output setting program
US6259431B1 (en) Image processor, game machine, image display method, and recording medium
US6599195B1 (en) Background sound switching apparatus, background-sound switching method, readable recording medium with recording background-sound switching program, and video game apparatus
US6572475B1 (en) Device for synchronizing audio and video outputs in computerized games
JP3068205B2 (en) Image processing apparatus, game machine using this processing apparatus, image processing method, and medium
KR101576294B1 (en) Apparatus and method to perform processing a sound in a virtual reality system
JP2950228B2 (en) Game image display method and game device
JP4242318B2 (en) 3D image generation apparatus and 3D image generation program
JPWO2005107903A1 (en) Electronic game device, data processing method in electronic game device, program therefor, and storage medium
JPH1063470A (en) Souond generating device interlocking with image display
EP1795240B1 (en) Game machine, game machine control method, information recording medium, and program
JPH0792981A (en) Method and equipment to provide virtual world sound system
JPH10137445A (en) Game device, visual sound processing device, and storage medium
JP2000112485A (en) Background tone controller, background tone control method, readable recording medium recording background tone program, and video game device
JP6329994B2 (en) Game program and game system
JP2017176728A (en) Simulation system and program
JP2020031303A (en) Voice generating program and voice generating apparatus in virtual space
JP3537238B2 (en) GAME DEVICE AND GAME DEVICE CONTROL METHOD
JP2002373350A (en) Image processor
JP2007289713A (en) Virtual three dimensional sound image formation apparatus, its method, and medium
JP6740297B2 (en) Game program and game device
JP3496149B1 (en) Shooting game apparatus and program
JP2008188308A (en) Game device, game program, and storage medium
JP2024041359A (en) Game programs and game devices

Legal Events

Date Code Title Description
AS Assignment

Owner name: KABUSHIKI KAISHA SEGA ENTERPRISES, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NAKAGAWA, TERUHIKO;REEL/FRAME:009860/0946

Effective date: 19990301

FPAY Fee payment

Year of fee payment: 4

FPAY Fee payment

Year of fee payment: 8

REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20160706