DE102008020340B4 - Gesture-controlled MIDI instrument - Google Patents

Abstract

Gesture-controlled MIDI instrument using microelectronic assemblies, wherein by means of music software the follower devices reproduce the data of the gesture-controlled MIDI instrument in music, characterized in that the gesture-controlled MIDI instrument (16) is constructed such that by the operation of a musician (15) regarding the procedures
a) the sounds
b) the volume
c) the sound modes
are controllable by
a) a potentiometer (2) for controlling the tones is placed in the MIDI instrument (16), wherein the potentiometer (2) is covered with foil, so that there is a touch-sensitive sensor field (3),
b) a distance sensor (4) is placed in the MIDI instrument, which is designed such that when turning on the MIDI instrument (16) a certain reference distance is determined, which corresponds to an average volume and height change of the position of the distance sensor (4 ) the changed position values represent an equivalent for the volume,
c) a compass sensor (5) is placed in the MIDI instrument (16), which is executed in such a way that ...

Description

The The invention relates to a gesture-controlled MIDI instrument with integrated Microcontroller and corresponding assemblies for the production of Note values and to control other sound parameters.

The Capturing the gestures, that is, the human movements, takes place through the use of multiple sensors. The interpretation of the Gestures are transmitted via MIDI protocol to connected followers, which then generate the sound. MIDI (Musical Instrument Digital Interface) is a standardized information protocol for transmission of instructions and commands describing musical events. The codes are used between electronic instruments, computers, Effects devices, Mixers and possibly other assemblies shipped, of these read and processed. A MIDI instrument according to the prior art z. B. a Keyboard, but also a PC each with appropriate music software to be just a few of the most diverse assemblies.

It is relatively easy to arrange music today with the help of music software. Both the professional, as well as the amateur, on the PC sounds, sounds and Sounds with the mouse or other control devices arbitrary join, convert, play and record. The technological development, so will rated here, has the classical boundaries of composition, production and publication canceled. However, it should be noted that in the available technology - as in a technically savvy musician in the absence of empathy - a piece of music rarely be presented to a critical audience to its enthusiasm can.

at the current evolution of digital music production the focus is often on the technical feasibility and so on The user-friendliness and intuitive usability are often lowly treated. The development of user-friendly input devices is thus underway sluggishly. Therefore, should be preceded by the other statements, that it is superficial It's not about giving the audience a perfect dynamic performance but rather, the intuitive and physical motor skills to express the musician's musical performance and to favorably influence the playful handling of instruments.

To the State of the art is generally noted that the development from the electrical over the electronic sound generation goes and now to the digital Generation of sound, using all conceivable hybrid forms. Electronic musical instruments for storing, processing and playing digital audio recordings (sampler) and for generating sounds digital or analog signal generation and processing (synthesizer) are hard to imagine a music production without.

It should in this regard on the DE 102 33 371 B4 "Electronic panpipe" are referenced. This invention relates to a multifunctional musical instrument developed on the basis of a panpipe. According to the DE 102 33 371 B4 In the panpipe wind sensors are arranged to register a passing stream of air, the air stream being blown in by a real existing musician. The wind sensors interact with electronic components that are used to process the sound produced by the wind sensors. This instrument is characterized by good sound volume and is easier to learn than a traditional panpipe. With this solution was moved away from the purely electronically generated music.

Continue to be on the 24.9.2007 utility model application DE 20 2006 020 190 U1 "Automatic drums with pneumatic drive" directed. The automated drum kit consists of two components, a mechanical component using novel drive technology and an electronic component, including a MIDI interface.

Also here was moved away from the purely electronically generated music. The new drive technology in combination with the electronic Component causes real-time playing, with the drum set being real is available.

To US 7297862 B2 For example, a musical sound control apparatus and method is known. This makes it possible to play an instrument easily while getting the feel of a current game. The device contains music parts with which sound intervals are added to pieces of music at intervals. The movement of an operator is perceived. A controller monitors the music score, adjusting it to the movement of the player.

In US 7339107 B2 has been called a method and a system for controlling an audio effect. Here, an audio-effect controller uses special audio effects to generate an audio signal, with a suitable sensor responding to movements associated with the generation of the audio signal. A sensor produces a control signal depending on the detected movement. The control signal is sent to an audio effect device and checked if it matches the audio effect.

With WO 2006/050577 A1 Motion sensors are contained in a button field of a manually operated instrument. Each button results in a note, which is controlled by an input device. The instrument has a motion sensor that can produce musical effects. The music effects are modified in the input device so that eventually music is created.

The solution after US 6969795 B2 specifies an electronic tone generator system and associated batons. The system has a variety of different portable, hand-operated transmitters or batons which assemble multi-player instruments in an orchestra. Each player's baton sends a radio signal to a receiver, which sends an output signal, preferably to a MIDI tone generator, to produce audible sounds through amplifiers and speakers. The batons may be coupled to different musical notes of selected instruments to intone pieces. You can also act in different voice positions.

With US 5541358 A a fixed controller for an electronic musical instrument was presented. This music device can be moved three-dimensionally. In this case, a control circuit is used to determine the position of the device and to generate a position signal. The latter is used to generate a musical sound by means of an electronic musical instrument or it is intended for a control device or for the game of the instrument.

The solution after US 7230178 B2 suggests a hand-held musical instrument, responsive to handles. A music system here includes an input device for obtaining a result by the operator and an output device for obtaining a music sound in response to the input. The input device responds to the grip and rapid pressure of the player. A conversion element of the input device can convert the grip pressure into the corresponding volume of a selected direction.

These two examples of the state of the art show that there are already good suggestions for giving the musician an intuitive scope, as in the case of the DE 102 33 371 B4 "Electronic panpipe" is the case or modern drive technology to use to simulate the style of a drummer, so that an excellent listening experience in real-time playback takes place and possibly a common playing musician and machine can be done on a same drum set. A certain intuitive style of playing is the musician, as far as he is capable of doing so, bring in here.

It is therefore an object of the invention, a gesture-controlled MIDI musical instrument to propose, which is designed such that an interpretation the gestures of the musician, d. H. his movements while playing music and thus playful and emotional interaction with the Music is given. Thus, an input device is to be proposed which allows, Thanks to his talent, the musician can make music intuitively and virtuoso in the aspect of using music software and / or other MIDI devices and thus electronic music is generated.

The gesture-controlled MIDI instrument is also designed for beginners producing electronic Make music and the process of making music comprehensible by the operating concept follows simple rules, intuitive to try and is easily retractable.

The Learning complex handle combinations should be omitted. The input device is intended to be used anywhere be. Without time-consuming Installation, calibration or installation, the user should make music can.

According to the invention Task solved as follows, being respect to the basic inventive idea Reference is made to claim 1.

The Further embodiment of the invention results from the protection claims 2 to 6th

to Presentation of the invention are the following further embodiments required. Relevant module of the MIDI instrument is a controller for generating note values. For this purpose, the MIDI instrument is held with one hand, with the other hand music is made. The control of the sounds happens by touch on an elongated sensor field, which is designed as a film potentiometer or as a capacitance sensor. A light one contact enough. At an instrument length of 500 mm, for example, the sensor field may measure 430 mm because in each case a button is arranged at the ends of the sensor field to move the octaves. In the span of the sensor field of 430 mm can 2 Octaves, that is 24 tones. But also sounds above and to reach below these octaves, the scale should be shifted can be. For that will be also uses the aforementioned buttons, which in terms of capacitance sensors Act. Only after a contact time by a few seconds, the buttons become active to an accidental Trigger when To avoid play.

More actions as a basis of music rens and Arranging are controlling the volume and selecting the MIDI channel.

The volume the sounds to be output the user controls by moving the instrument on a virtual vertical axis. The higher the user holds the instrument, the louder the sound that he sounds on the one already mentioned elongated Sensor field alludes. A calibration of the volume is because of the different size of the users required. Because it is necessary for every user - regardless of his height - the whole Range of volume control to disposal to have. So it is an individual adaptation to the size required. Accordingly, the user should the MIDI instrument when switching in a keep him comfortable playing position. A medium volume will be when switched on in this position as a relative reference point. From this point, the user can adjust the volume by moving up and down of the instrument. Using acceleration sensors, position sensors or distance meters such as ultrasonic, infrared, or laser sensors the position values are determined and from this the volume, under Using the MIDI protocol passed to the following devices. (Conveniently, the relative reference point at power up results from the distance of the MIDI instruments to the floor.)

The Setting the sound modes (of the sound) results from trend-setting Posture of the MIDI instrument. So it gets by keeping the MIDI instrument set a specific MIDI channel in a certain direction, the on the follower the determines the sound to be output. The technical solution is done with the help of a Compass sensor. Thus, the MIDI instrument can radially in (virtual) angular ranges be moved, each angle range a play area, d. H. a MIDI channel is assigned. Depending in which area of the User moves the instrument, a corresponding channel is selected. Of the Location of the user is the circle center around which the angle ranges are arranged. The change between the play areas (angle ranges) is through a tactile feedback signals, that is, a vibration motor is activated and shows the user who is the Holding MIDI instrument with one hand, the possibly upcoming change in the next game area.

Short summarized can be said to adjust the sound that selecting the sound from the radial orientation of the MIDI instrument by the user; depending on what play area the MIDI instrument shows. details Explanations this is done in the embodiment.

As at the volume calibration is performed when the MIDI instrument is turned on in terms of the game area. By the compass sensor is the user independent of the direction of the compass, what a division of the game areas regardless of the direction power. The user stands - comparable with a conductor - im Center of his play areas. The middle of the areas becomes simultaneously with turning on the MIDI instrument determined, d. H. Calibration also takes place in relation to the Game areas through a (virtual) mirror axis. Shows z. B. the MIDI instrument when switching to the audience, runs into this Direction the mirror axis and thus it is determined which game areas each lie next to the mirror axis.

The Playing with the MIDI instrument requires the musician to make the music the sounds and tone sequences (the note values) by touching the sensor field, e.g. B. the cover layer of foil, arranged on the rod-like sensor array of the MIDI instrument. The volume and the sound selection is controlled by human movements. This will make it possible how detailed motion studies and their analysis showed the gestures of the musician into musical intuition. The task The invention is with the gesture-controlled described here MIDI instrument met. The musician becomes a playful and talented person emotional handling of music possible. The gestures of the musician as an expression of his talent and thus intuitive and virtuoso playing style are excellently through the MIDI instrument recorded and played back in music on the subsequent devices. From electronic music without individual artistic influence was moved away.

The Invention will now be explained with reference to an embodiment.

The Figures show a schematic representation

1 : MIDI instrument with integrated assemblies

2 : Illustration of the play areas in the top view

3 : MIDI instrument in side view

1

microcontrollers

2

Potentiometer / capacitance sensor

3

sensor field (eg the cover layer of foil)

4

Distance sensor

5

compass sensor

6

MIDI interface

7

button for microcontroller (simultaneously button for Calibration)

8th

button for shifting to low frequencies

9

button to shift to higher frequencies

10

battery pack

11

Follower synthesizer

12

Follower PC

13

play areas a to g

14

active Game area c

15

Musician

16

MIDI instrument

17

mirror axis

18

handle

The 1 shows the structure of the gesture-controlled MIDI instrument 16 with integrated assemblies and two followers, namely a synthesizer 11 and a PC 12 , where optionally the synthesizer 11 or the PC 12 to the MIDI instrument 16 can be connected.

Out 3 is recognizable that the MIDI instrument 16 represents a hand-held device (see handle 18 ), so that the MIDI instrument is held with one hand and music is made with the other hand, by tactile or light stroking of the sensor field 3 the tones and tone sequences (note values) of electronic music are retrieved. However, the influence of human movements is still part of making music, so the influence of the gestures on the music is decisive.

• – die Töne (Notenwerte)
• – die Lautstärke
• – die Klangmodi (Sound)

müssen bei Einwirkung des Musikers 15 steuerbar sein.The microelectronic construction makes it possible for the required components to fit directly into or on the MIDI instrument, that is the microcontroller 1 , a potentiometer or a capacitance sensor 2 , a distance sensor 4 , a compass sensor 5 , the MIDI interface 6 and the battery 10 , With the MIDI instrument, the following processes must be executable or realizable, ie

• - the notes (note values)
• - the volume
• - the sound modes (sound)

must be under the action of the musician 15 be controllable.

On the MIDI instrument 16 there is a sensor field 3 (about 430 × 13 mm) over a whole length of the MIDI instrument 16 of about 500 mm, which has a film as a cover layer. Under the slide is a potentiometer 2 (alternatively, a capacity sensor 2 ) arranged. Touching or brushing the sensor field with one finger controls the tones (note values).

With the help of the buttons 8th and 9 at the ends of the sensor field 3 a shift of the octaves takes place. The buttons 8th and 9 are capacitance sensors that only become active after approx. 2 seconds of contact time to avoid accidental tripping during play.

Using the distance sensor 4 the volume is controlled. The distance sensor 4 may be an acceleration sensor, position sensor or distance meter based on ultrasound, infrared or laser beams. Because of different sizes of the musicians 15 a calibration is required. This is done by turning on the microcontroller 1 by means of a button 7 , As a reference, a distance when switching is set, z. B. the removal of the MIDI instrument in a pleasant stop position to the floor. During a movement of the MIDI instrument 16 On a virtual vertical axis, the distance of the range sensor changes 4 from the starting point. for example, it may be set: the higher the MIDI instrument 16 is held, the louder the sound resounds, on the sensor field 3 is played.

The 2 shows how to select play areas by radial movement of the MIDI instrument 13a to 13g It is done by the musician 16 the corresponding sound is selected. With the directional attitude of the MIDI instrument 16 determines the desired MIDI channel and thus the playing area.

With the position character 14 (Game area c) an active game area is shown. As with controlling the volume, when you select the ranges, you will need to calibrate when the MIDI instrument is turned on. The one in the center of his play areas 13a to 13g located musicians 15 causes switching on and directional holding of the MIDI instrument 16 Setting the virtual mirror axis 17 which is the mine of the game areas 13a to 13g represents. Depending on the area in which the musician 15 the MIDI instrument 16 So, a specific MIDI channel is selected.

The technical implementation of this problem is done with the help of a compass sensor 5 , Due to the calibration is the musician 13 in the division of its game areas regardless of the direction.

Out 1 could be inferred that the slave devices using cables with the MIDI instrument 16 are connected. It goes without saying that, starting from the prior art, wireless data transmission can take place.

One Mirror-symmetric design of the MIDI instrument allows the Use For Right and left-handers alike.

It has been shown that playing with the MIDI instrument, requires appropriate talent, is relatively easy to learn.

As per stand The technique can be the variety of adjustable parameters in synthesizers and keyboards clearly overwhelm the user, especially the beginner. In the case of the present inventive solution, it also appears to the Beginner logical, with which operation which parameters of the sound control to be influenced.

There the MIDI instrument is constantly human in playing Exercise demands, can especially young musicians their temperament, combined with urge to move, for virtuoso Use music.

Claims (6)

Gesture-controlled MIDI instrument using microelectronic assemblies, wherein by means of music software the follow-up devices reproduce the data of the gesture-controlled MIDI instrument in music, characterized in that the gesture-controlled MIDI instrument ( 16 ) is constructed in such a way that by the action of a musician ( 15 ) the procedures concerning a) the tones b) the volume c) the sound modes are controllable by a) a potentiometer ( 2 ) for controlling the sounds in the MIDI instrument ( 16 ), the potentiometer ( 2 ) is covered with foil so that a touch-sensitive sensor field ( 3 ), b) a distance sensor ( 4 ) is placed in the MIDI instrument, which is designed such that when switching the MIDI instrument ( 16 ) a certain reference distance is determined which corresponds to a medium volume and when the altitude of the location of the distance sensor ( 4 ) the changed position values represent an equivalent for the volume, c) a compass sensor ( 5 ) in the MIDI instrument ( 16 ), which is executed in such a way that regardless of the direction in which the MIDI instrument is turned on ( 16 ) with directional attitude of the MIDI instrument ( 16 ) a mid-range and thus certain MIDI channel is set, which determines the sound to be output on the follower and with radial change of the directional attitude of the MIDI instrument ( 1 ) another playing area and thus a different sound is given. MIDI instrument according to claim 1, characterized in that the button ( 7 ) for the microcontroller ( 1 ) simultaneously displays the button for calibrating the volume and the playing area. MIDI instrument according to claim 1, characterized in that by the keys ( 8th . 9 ) a shift of the octaves is given. MIDI instrument according to claim 1, characterized in that as a sensor for the sounds alternatively a capacitance sensor ( 2 ) in the MIDI instrument ( 16 ) is placed. MIDI instrument according to claim 1 and 3, characterized in that the sensor field ( 3 ) depending on the dimensions of the MIDI instrument ( 16 ) is dimensioned so that the length of the sensor field ( 3 ) recorded two octaves and the dimensions of the sensor field ( 3 ) about 430 mm × 13 mm. MIDI instrument according to claim 1 to 5 or claim 1 and one or more of claims 2 to 5, characterized in that the MIDI instrument ( 16 ) represents a handheld device and the components required for the function in or on the MIDI instrument ( 16 ) are placed.