CN105596119A - Primary-secondary cochlea electrode arrangement, device, system and method for enhancing musical melody perception - Google Patents
Primary-secondary cochlea electrode arrangement, device, system and method for enhancing musical melody perception Download PDFInfo
- Publication number
- CN105596119A CN105596119A CN201610056261.4A CN201610056261A CN105596119A CN 105596119 A CN105596119 A CN 105596119A CN 201610056261 A CN201610056261 A CN 201610056261A CN 105596119 A CN105596119 A CN 105596119A
- Authority
- CN
- China
- Prior art keywords
- electrode
- frequency
- note
- cochlea
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/02—Prostheses implantable into the body
- A61F2/18—Internal ear or nose parts, e.g. ear-drums
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F11/00—Methods or devices for treatment of the ears or hearing sense; Non-electric hearing aids; Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense; Protective devices for the ears, carried on the body or in the hand
- A61F11/04—Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense, e.g. through the touch sense
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F11/00—Methods or devices for treatment of the ears or hearing sense; Non-electric hearing aids; Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense; Protective devices for the ears, carried on the body or in the hand
- A61F11/04—Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense, e.g. through the touch sense
- A61F11/045—Methods or devices for enabling ear patients to achieve auditory perception through physiological senses other than hearing sense, e.g. through the touch sense using mechanical stimulation of nerves
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
- A61N1/00—Electrotherapy; Circuits therefor
- A61N1/02—Details
- A61N1/04—Electrodes
- A61N1/05—Electrodes for implantation or insertion into the body, e.g. heart electrode
- A61N1/0526—Head electrodes
- A61N1/0541—Cochlear electrodes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/02—Prostheses implantable into the body
- A61F2/18—Internal ear or nose parts, e.g. ear-drums
- A61F2002/183—Ear parts
Abstract
The invention discloses primary-secondary cochlea electrode arrangement, a device, a system and a method for enhancing the musical melody perception. According to the characteristic frequency correspondence of musical notes, a phonosensitive full spectrum band corresponding to the cupula cochleae to cochlea base is divided into musical response areas which can respond specific musical note stimulating signals on each cochlea basement membrane. Corresponding electrodes for conducting or sensing frequency band signals are arranged in all the musical response areas, namely each electrode is arranged in the corresponding characteristic frequency band where the musical notes are arranged, the electrodes are divided into two groups, and one group of corresponding electrodes are implanted into the cochlea on the both sides respectively. Due to the fact that the electrodes are distributed into the cochlea on the both sides, the primary-secondary cochlea electrode arrangement is easy to implement, and the electrodes distributed in the cochlea on the both sides can well sense music.
Description
Technical field
The present invention relates to artificial cochlea field, be specifically related to strengthen the major-minor layout of music rhythm perception cochlear electrode, device,System and method.
Background technology
Hearing compensation or reconstruction mainly comprise that hearing aids selection and artificial cochlea implant. To bilateral severe or utmost point severe phonosensitiveNerve Deaf and Hard of Hearing Talents, using audiphone 3 during without positive effect, can consider Cochlear Implantation weight to 6 monthsBuild hearing.
Artificial cochlea implanting device is the converter of a kind of people's of simulation cochlear function. It by voice signal by speech placeReason device be transformed into the signal of telecommunication, the sensation of frequency that imports inner ear into is answered position electrode, with faint stimulation mode (as electricity, light, heat or mechanicalPressure etc.) direct excited auditory nerve, thus produce the sense of hearing. Artificial cochlea device mainly divides two large divisions: implant part (comprises and connecingReceiving apparatus and multilead electrode) and external part (comprising sound collector, speech processor, transmitter etc.).
According to Auditory Perception principle, the sense of hearing is to collect conducted acoustic waves, middle ear amplification acoustic vibration signal, Jin Er by external earInner ear (being cochlea) is organized in time, frequency by some sense of hearing end acoustic cells (claiming again hair cell) of CF corresponding relationAnd in intensity, convert corresponding acous exciting signal to, and through auditory nerve granting, conduction, integrate in Brainstem Auditory district, form the sense of hearingPerception. Artificial cochlea device is the successful Application of this principle just, and this device has solved reconstruction part hearing ability preferably at present,As human speech perception, and for appreciating and the beautiful music information of perception, also there are some problems, have much room for improvement.
Research finds, music signal time, frequently there is larger difference in distribution character and voice signal, as Fig. 1 a-Fig. 1 b instituteShow. Concerning voice signal, the distinguishing characteristics main manifestations of the loud part of pronunciation word is that frequency domain envelope peak distributes above, i.e. spectrum bagFormant centre frequency position, quantity and the intensity of network, formant negligible amounts conventionally, main is no more than 5, but each is altogetherThe peak center frequency location that shakes is uncertain, each formant broader bandwidth (comparing the harmonic spectrum peak bandwidth of music), and wherein compriseTone information; Not loud voiceless sound part in speech, also mainly represents with wider spectrum energy concentration zones, as Fig. 1 a " voice "Shown in; In time domain, when people speaks, whether and speed vocal cord vibration, shows as that corresponding pitch frequency has or not, Yi JigaoLow, compare music, excursion is less, is generally no more than 500Hz, but changes continuously the pronunciation of the every section of meaning of having any differentFragment duration does not have rule. On the whole, voice signal principal character frequency is on docking end auditory nerve, to frequency resolutionRequire lowlyer, be mainly manifested in formant distributing position, express the main sound characteristic of voice segments with how many frequency division bandsIt is the key issue that solves speech perception. Current artificial cochlea electrode quantity is generally no more than 22, although each producer productElectrod-array be distributed on frequency values corresponding relation slightly differently, but be all roughly to draw according to critical band or frequency masking relationPoint, transmit voiced sound formant and voiceless sound information in speech by such distribution of electrodes, its resolution ratio is substantially enough, if but transmitWhen musical sound information, different due to music signal spectrum structure and voice spectrum, the fundamental frequency of a lot of musical tones cannotAccurately conduct by auditory nerve, 22 electrode pairs that provide certain artificial cochlea's product referring to table 1 answer frequency band to cover and note baseRoughly corresponding relation of ripple frequency coverage (or leap), so current cochlear implant is difficult to music appreciating information, to soundMusicality is known not good.
Certain artificial cochlea's product distribution of electrodes of table 1 and with roughly corresponding relation of note fundamental frequency
Concerning musical sound, its sound is from certain musical instrument. All musical instruments with melody performance, its sound height is by soundSymbol determines, does not comprise the percussion instrument without melody performance here. The same note of different instrument playings, its signal spectrum distributes and isCombined and formed by other subharmonic of essentially identical first-harmonic and different amplitude distribution, whole spectrum envelope is more smooth, frequency domainSpan is wider than voice, does not conventionally have the obvious like that multiple formants of voice signal spectrum envelope to change, but music signal harmonic waveQuantity is more, and according to note from low to high, its overtone order can reach tens times to several times not etc., and each harmonic peaks bandwidth is narrower,Peak separation is very regular, substantially by fundamental frequency multiple frequency division cloth, as shown in Fig. 1 b music signal spectrogram. The wherein base of noteWave spectrum peak is most important, can not misplace or lack, otherwise, rebuild music signal and listen perception to get out of tune; And note corresponding the the 2nd, 3,4,5 ... etc. some higher hamonic waves peak, if lack indivedual harmonic waves, can not affect the perception of note melody, can not get out of tune, but when lackingMany higher hamonic waves, tonequality has significant change; From low to high, fundamental frequency excursion is very large for the note of music rhythm, from severalTen hertz～several KHzs, as shown in the note frequency meter in table 2.1. In addition, in time domain, the length of each note, i.e. soundJourney, is regular variation by beat, can be encoded and be controlled by signal time. Therefore, come for cochlear implantSay, the perception of musical sound, the distribution of electrodes density of docking with auditory nerve has direct relation.
At present, artificial cochlea deposits problem both ways to the perception of music:
1, to sound source signal carry out outside gathering, frequency band that should be corresponding with cochlear electrode after conversion matches, and this skillThe problem that art exists is at present that after the note signal of external conversion is processed by signal analysis filtering, each band component is being delivered toWhen cochlear electrode, because cochlea perception music Pin district cannot be aimed in current distribution of electrodes position, make music frequency information mistakePosition or lose ground and transmit is to cause implantation person to Music perception imbalance or main cause that cannot perception.
2, in unilateral cochlear, realize the perception to music by increasing enough number of electrodes modes, although in theory canTo realize (existing Patents is open at present), still, be limited to current technical limitations, the electrode that unilateral cochlear distributes too much willCause being difficult to realize in technique.
Summary of the invention
The deficiency existing for solving prior art, the present invention openly strengthens the cochlear electrode of music rhythm perception and arranges, isSystem and method, the present invention, with reference to musical tones first-harmonic characteristic distributions, improves i-coch sensation of frequency by suitable increase number of electrodesAnswer density, adopt bilateral cochlea location mode, all effective to the perception of music information to guaranteeing technique realization and improving single, double earReally.
For achieving the above object, concrete scheme of the present invention is as follows:
Strengthen the major-minor layout of cochlear electrode of music rhythm perception, near every side basilar membrane, according to musical tonesCharacteristic frequency corresponding relation, cupula cochleae is separated into the frequency field of response particular note to corresponding phonosensitive Whole frequency band at the bottom of snail;The electrode of placing this band signal in each frequency field, each electrode is placed in the feature band at musical tones placeIn, utilize the feature of ears two-channel, electrode is divided into two groups, bilateral ear is adopted to major-minor method distribution of electrodes, both sides cochlea is eachImplant corresponding one group of electrode, in bilateral cochlea, implant respectively the electrode of varying number, wherein one pick up the ears arrange one group of electrodeFor master, another one group of electrode of picking up the ears to arrange is auxiliary side, at the frequency band of setting, by assigned frequency interleaved grouping layoutElectrod-array. Wherein, each electrode is roughly corresponding from the fundamental frequency point of different notes, and electrode is conducting electrode or stimulates electricityThe utmost point.
Further, while implanting respectively the electrode of varying number in the cochlea of both sides, the corresponding cochlea of a side is except low frequency rangeMain frequency induction zone distribute " main electrode group ", totally 38, the corresponding cochlea main frequency of the opposite side induction zone " auxiliary electrode that distributesGroup ", totally 27.
The wherein snail of picking up the ears, the main electrode group layout of distribution is:
First electrode is corresponding with the fundamental frequency of B8 note; The fundamental frequency phase of the 38 electrode and G3 noteCorrespondence, the electrode between first electrode and 38 electrodes is arranged with setting means according to note frequency corresponding relation;
In opposite side cochlea, implant auxiliary electrode group, layout is:
First electrode is corresponding with the fundamental frequency of A#/Bb8 note; The base of the 27 electrode and G#/Ab3 noteRipple frequency is corresponding, the electrode between first electrode and 27 electrodes according to note frequency corresponding relation with setting meansArrange.
Further, at low frequency range, choose and represent that accordingly frequency arranges corresponding electrode, implant respectively both sides cochlea,Both sides identical 3 electrodes that distribute.
Further, at low frequency range, 3 electrodes respectively: the 41 electrode is relative with the fundamental frequency of A1 noteShould, the 40 electrode is corresponding with the fundamental frequency of E2 note, and the 3rd nineteen electrode is relative with the fundamental frequency of C3 noteShould; The 30 electrode is corresponding with the fundamental frequency of A1 note, and the second nineteen electrode is relative with the fundamental frequency of E2 noteShould, the 28 electrode is corresponding with the fundamental frequency of C3 note.
The major-minor method for arranging of cochlear electrode that strengthens music rhythm perception, comprises the following steps:
Electrode is divided into two groups, implants respectively corresponding one group of electrode in bilateral cochlea, each electrode is placed in musical tonesIn the character pair frequency band at place, the main centralized arrangement of electrode is at 100Hz-8000Hz main frequency induction zone, in low frequency districtTerritory, chooses and represents accordingly frequency layout electrode;
In major-minor method, when electrode is divided into two groups that quantity do not wait, in the snail of often picking up the ears, electrode according to note first-harmonic feature frequentlyRate is arranged with setting means.
The cochlear electrode array apparatus that strengthens music rhythm perception, comprises multiple electrodes, and each electrode comprises multiple ring-typesElectrode contacts, ring electrode contact is all connected with electrode loop by the wire of tape insulation layer, and described electrode also comprises parcelThe flexible covering of all electrode loops, described electrode is arranged to array according to above-mentioned arrangement of electrodes method. Described electrode array is equippedPut, except adopting above-mentioned conductive material, also may adopt the corresponding above-mentioned electricity of special material structure of light conducting or heat or pressureUtmost point method for arranging.
In order to implement better above-mentioned electrode arrangement mode of the present invention, the invention also discloses and strengthen music rhythm perceptionArtificial cochlea system, comprise implant part and external part, implant part and external part can adopt radio communication connection sideFormula or wired connection mode, wherein implant part at least comprises electrode array device, external part at least comprises Sound Processor UnitAnd the voice collection device being connected with processor, voice signal is obtained by voice collection device, completes music signal by processorThe analysis of thematic note, interval and coding, processor produces corresponding MIDI music encoding according to musical instrument kind, by phaseThe Processing Algorithm processing of answering, converts the snail electrode stimulating code signal of respectively picking up the ears to, drives through radio communication or special wireline interface,Send to stimulation location.
Further, for radio communication connected mode, electrode array device and receiving system are planted as artificial cochlea'sEnter part, transmitter, processor and voice collection device are as artificial cochlea's external part.
Further, for wired connection mode, electrode array device is as artificial cochlea's implant part, wireline interfaceDevice, signal driver device, processor and voice collection device are as external part, and the signal gathering through voice collection device passesTransport to processor, processor, to the signal obtaining, is sent to signal driver device, letter through decomposing, quantize the corresponding signal of generationNumber drive unit produces Ge road signal by driving and transfers to wireline interface device, at wireline interface device place, each road signal withThe signal docking of the each road of implant electrode, to produce corresponding stimulus signal.
Further, implant part and external part communication can be Bluetooth communication mode, infrared communication sideFormula or RF radio communication mode, wired connection mode adopts the syndeton with flexible material parcel; Syndeton can be light and connectsConnecting structure, thermally coupled structure or mechanical connecting structure.
The method of work that strengthens the artificial cochlea system of music rhythm perception, comprises the following steps:
Signal through voice collection device collection transfers to processor, completes the thematic sound of music signal by processorSymbol, interval analysis and coding, wherein processor can produce corresponding MIDI music encoding according to musical instrument kind, by with patternCorresponding Processing Algorithm processing;
Processor, according to electrode mode of operation, is determined the effective working electrode of each note position, determines every side array and eachElectrode coded sequence;
Processor, by the Processing Algorithm processing corresponding with pattern, converts the snail electrode stimulating code signal of respectively picking up the ears to, warpRadio communication or special wireline interface drive, and send to stimulation location.
Beneficial effect of the present invention:
The present invention provides bilateral cochlear implant electrode method for arranging, divides corresponding musical sound by note characteristic frequency half pitchWith the most frequently used frequency band of speech (about 100Hz-8000Hz), be grouped in ears layout electrode by assigned frequency staggered (being major-minor method)Array, to bulk be difficult for the distributing low side frequency zones of multifrequency point, only chooses and represents frequency, is distributed in master or bilateral electrodeIn array, rebuild and strengthen music and speech perception; The present invention is because arrangement of electrodes, at bilateral cochlea, distributes than unilateral cochlearSo many electrode is easily realized, and kind electrode location mode both can one-sided adapted, also can bilateral adapted simultaneously, utilized twoThe synergistic effect of ear phonosensitive, makes implantation person's perception music better.
Distribution of electrodes after optimization, owing to having considered the distribution of musical sound frequency occupy-place, it is close that the snail of often picking up the ears has all been improved electrodeDegree, can strengthen Music perception, and the method covers original voice electrode frequency simultaneously, even if any lateral electrode work of adapted is logicalCross selection, the switching of outer link voice processor operating mode and sound coding strategy, can ensure the speech perception that the method producesBe not less than the speech perception that current distribution of electrodes method obtains. Thus, the present invention is abundanter to strengthening artificial cochlea's perceptionMusical sound effect there is practical significance.
Brief description of the drawings
Fig. 1 a voice signal time, distribution character frequently;
Fig. 1 b music signal time, distribution character frequently;
One-sided or the bilateral artificial cochlea system structured flowchart of Fig. 2 a wireless transmission method;
One-sided or the bilateral artificial cochlea system structured flowchart of Fig. 2 b wired connection mode;
The each lateral electrode system of Fig. 3 signal processing flow block diagram;
The every lateral electrode array structure of Fig. 4 schematic diagram;
Fig. 5 bilateral ear stack musical sound analog synthesis signal waveform;
One section of oscillogram that music rhythm is corresponding in Fig. 6 examples of implementation.
Detailed description of the invention:
Below in conjunction with accompanying drawing, the present invention is described in detail:
As the cochlea with analysis or induction frequencies composition function, the hair cell (being acoustic cell) on its basilar memebrane and endEnd auditory nerve is connected, and topology location and frequency content in cochlea have corresponding relation. Listen district accurately to rebuild sound if wish brainHappy perception, makes cochlear implant can experience the beautiful of music rhythm, should increase number of electrodes and dock with corresponding auditory nerve.Be difficult to implant the snail of picking up the ears but be limited to excessive number electrode, the present invention utilizes people's ear to have bilateral cochlea and ears to have stack senseAnswer effect, with the selected frequency values of major-minor method, the stimulating electrode that distributes on topology location in corresponding cochlea, listens god to dock endWarp.
Table 2.1 is the corresponding signal table of note frequency in major-minor method, and wherein, the note frequency that master medium-high frequency electrode pair is answered isThickened portion; The note frequency that auxiliary side medium-high frequency electrode pair is answered is italicized item; The layout electrode diaphone that low frequency part is commonSymbol frequency is that overstriking underlines part.
In major-minor method, major-minor lateral electrode is in the time of concrete layout, and the physical relationship of electrode and note frequency is in table 3.1 and table3.2。
The corresponding table of table 2.1 " major-minor method " note frequency (master: black; Auxiliary side: italic; Low frequency is total: black matrix+underscore)
The major-minor method master of table 3.1 distribution of electrodes
The auxiliary lateral electrode of the major-minor method of table 3.2 distributes
| Sequence number | Note | Centre frequency | Free transmission range |
| 27 | G#/Ab3 | 207.65 | 201.7-213.6 |
| 26 | A#/Bb3 | 233.08 | 226.4-239.8 |
| 25 | C#/Db4 | 277.18 | 269.1-285.2 |
| 24 | D#/Eb4 | 311.13 | 302.1-320.2 |
| 23 | F#/Gb4 | 369.99 | 359.4-380.6 |
| 22 | G#/Ab4 | 415.3 | 403.4-427.2 |
| 21 | A#/Bb4 | 466.16 | 452.8-479.5 |
| 20 | C#/Db5 | 544.37 | 538.3-570.5 |
| 19 | D#/Eb5 | 622.25 | 604.1-640.5 |
| 18 | F#/Gb5 | 739.99 | 718.9-761.1 |
| 17 | G#/Ab5 | 830.61 | 806.9-854.3 |
| 16 | A#/Bb5 | 932.33 | 905.7-958.9 |
| 15 | C#/Db6 | 1108.70 | 1076.3-1141.1 |
| 14 | D#/Eb6 | 1244.50 | 1208.3-1280.7 |
| 13 | F#/Gb6 | 1480.00 | 1437.5-1522.5 |
| 12 | G#/Ab6 | 1661.2 | 1613.5-1708.9 |
| 11 | A#/Bb6 | 1864.7 | 1811.1-1918.3 |
| 10 | C#/Db7 | 2217.50 | 2153.3-2281.7 |
| 9 | D#/Eb7 | 2489.00 | 2416.9-2561.1 |
| 8 | F#/Gb7 | 2960 | 2874.7-3045.3 |
| 7 | G#/Ab7 | 3322.4 | 3226.7-3418.1 |
| 6 | A#/Bb7 | 3729.3 | 3621.9-3836.7 |
| 5 | C#/Db8 | 4434.90 | 4306.5-4563.3 |
| 4 | D#/Eb8 | 4978.00 | 4833.9-5122.1 |
| 3 | F#/Gb8 | 5919.9 | 5749.5-6090.3 |
| 2 | G#/Ab8 | 6644.9 | 6454-6835.8 |
| 1 | A#/Bb8 | 7458.6 | 7245.1-7672.1 |
As shown in Fig. 2 a-Fig. 2 b, the present invention is used for artificial cochlea system by electrode in the time implementing, and comprises implant part and outerConnect part, implant part comprises electrode array device, implant part and the external part radio communication of arranging in the manner described aboveTime, electrode array device is connected with receiving system, and external part comprises the transmitter, processor and the sound collection dress that connect successivelyPut. The signal of collection is transferred to processor by voice collection device, and processor transfers to transmitter after signal is further processed,Transmitter is sent to receiving system by signal after treatment by wireless mode, and receiving system triggers electricity according to the signal of receivingThe action of the utmost point, thus the action of respective electrode makes people's ear can hear corresponding music signal.
When implant part and external part wire communication, electrode array device is implant part, and external part comprises successivelyThe wireline interface device, signal driver device, processor and the voice collection device that connect. Voice collection device is by the signal gatheringTransfer to processor, processor transfers to signal driver device after signal is further processed, after signal driver device will be processedSignal be sent to electrode array device by wireline interface device, electrode array device is according to the signal trigger electrode that receivesAction, thereby the action of respective electrode makes people's ear can hear corresponding music signal.
Wherein, the processor outside ear can pass through the parsing to music signal, is converted to the MIDI coded data of music, these latticeThe data of formula can drive the stimulus signal of corresponding each path electrode. Obviously, the more electrode method of dense distribution, not only can be accurately rightAnswer the each frequency of musical tones, make the cochlear implant can Obtaining Accurate note and harmonic information, and to phonetic feature frequentlyThe transmission of rate can, according to " mapping nearby " principle, be determined working electrode, the processing of corresponding employing speech from more intensive electrodeCoding strategy, therefore this arrangement of electrodes method and system has been taken into account the transmission of voice messaging, can not affect speech perception. But,If adopt original less electrode pair musical tones to adopt mapping to transmit, even if external Sound Processor Unit Exact Solutions is separated out noteSymbol information, in body, cochlear electrode also cannot dock auditory nerve by accurate corresponding frequency, passes to brain, and Music perception is still disappearance. This has also illustrated, why current artificial cochlea's perception music preferably.
Experimental study also finds, people's ear has bilateral ear phonosensitive superimposed characteristics, and this characteristic is not only conducive to differentiate sound source, improvesSound source direction ability, also can integrate brain stem district audio, can increase loudness and stack music rhythm and the harmonic information of sound.
In artificial cochlea system, the signal processing flow of each lateral electrode is as shown in Figure 3:
Step 1: determine the each note of music, interval (similar MIDI coded message);
Step 2: fundamental frequency and the harmonic frequency of determining each note;
Step 3: determine music tamber, regulate coefficient correlation;
Step 4: according to electrode mode of operation, comprise major-minor bilateral pattern and major-minor one-sided pattern, music pattern/voicePatterns etc., determine the effective working electrode of each note position, wherein according to multiple principle or strategy process, as critical band, note notPoint side, homonymy are corresponding and suitably give up etc. nearby.
Step 5: determine every side working electrode position and each electrode signal coded sequence;
Step 6: driving or transfer electron coding, generation stimulation pulse signal.
In examples of implementation, for music rhythm multichannel stack perceived effect, we have done special simulation analysis, vacationIf artificial cochlea's optimal recovery effect can reach the perception of normal human ear ears, therefore adopt normal human ear to do emulation. As shown in Figure 5, above,Lower two waveforms are respectively the voice signal time domain waveform that left and right sound channels cochlea is heard, its top L channel waveform, is left ear electricityUtmost point synthesis of artificial sound, comprising the first-harmonic of corresponding note and the synthesized voice signal of main harmonic wave; Its underpart is R channel waveform,For auris dextra electrode synthesis of artificial sound, comprising the first-harmonic of corresponding note and the synthesized voice signal of main harmonic wave. Left and right sound thusRoad alternately transmits music synthetic, that listen district to hear at brain, and the melody perception of its tune is complete, accurately.
The results show, two-channel technology can be transmitted the more subband feature of music signal, can be more accurately, easilyTransmit first-harmonic and crucial harmonic components, in a disguised form increased artificial cochlea's electrode number.
The tone of musical tones mainly determines by fundamental frequency, and the tone color of note determines according to spectral characteristic, i.e. rootHow much decide according to first-harmonic and harmonic wave ratio and harmonic wave. The arrangement of electrodes scheme of this patent is exactly first all musical tones tablesReach needed fundamental frequency position distribution good, and be divided into two component sides layouts, to reduce single-sided electrode number, reduce and arrange difficultyDegree, then the first-harmonic to certain note that will express and harmonic frequency are mapped on a lateral electrode array according to certain principle, fromAnd guarantee that same note is in a lateral electrode job, different notes can be expressed at different lateral electrode arrays, to realize whole musicThe melody processing policy of the alternately synthetic audio of Duan Caiyong bilateral. In actual corresponding conversion, expression, a few harmonics centre frequency canCan meeting " fall nearby " on opposite side electrode position, for this situation, can take " homonymy nearby " or " suitably giving up " principleProcessed.
For the effect that better explanation electrode arrangement mode of the present invention reaches, the present invention has provided another embodimentSon:
Based on above-mentioned two-channel cochlear electrode method for arranging, artificial cochlea's musical sound processor is according to electrode mode of operationAnd coding strategy, produce counter electrode stimulus signal by Fig. 3 signal processing flow, wherein note is lower, at Music perception frequency bandIn scope, its harmonic wave number is more, and corresponding stimulating electrode number should be more, and note is higher, and its harmonic number is fewer, effective stimulus electrodeNumber is just fewer. Determining when each note working electrode, according to critical band principle, determine each effective working electrode, first-harmonic andEach electrode of the same side cochlea that effectively harmonic wave is accurate or approximate corresponding, wherein may give up indivedual harmonic waves, as be similar to separatelyThe harmonic wave of one lateral electrode. This analysis and work for the treatment of are completed by external Sound Processor Unit.
Due to different musical instrument kinds, the amplitude mutual ratios relation of its harmonic components is different, conventionally need be according to musical instrumentKind is done suitable parameter adjustment.
The working condition of prescribed electrode with one section of simple melody:
Choosing one section of music rhythm, be made up of three notes, is A3, G3, C4 successively, supposes that each note interval equates, signalWaveform as shown in Figure 6.
First determining the first-harmonic of note, (is then critical band restriction, same sound according to Fig. 3 handling process and coding strategyThe harmonic wave of symbol is determined working electrode at homonymy, is given up not homonymy harmonic wave counter electrode etc.) process, distribute this note first-harmonic and eachThe alternate electrode of harmonic wave, as shown in table 4.1, to stimulate auditory nerve system, ensures that the music signal of same note docks regardless of sideAuditory nerve stimulates, and does not destroy each note perception globality. Like this, each note is determined each working electrode in a side, differentNote, may be at homonymy or not in homonymy alternation, and complete music rhythm is to be stimulated and listened god by bilateral cochlear electrode arrayThe Overlay of warp obtains Music perception.
If work under major-minor bilateral electrode mode, this melody section A3, G3, C4, because the fundamental frequency master that coexists distributes, threeIndividual note is worked successively on master cochlear electrode, and specific works situation is as table 4.1.
Table 4.1 the 1st (A3), 2 (G3), 3 (C4) note working electrode (successively at master) under major-minor method bilateral pattern
In addition, along with the development of technology, in the time that cochlear electrode layout is not realized process limitations, all frequencies in table 2.1All layout is the most desirable design in unilateral cochlear, in the time that all electrodes are arranged in monaural, above-mentioned artificial cochlea device andCorresponding optimization system is still suitable for.
By reference to the accompanying drawings the specific embodiment of the present invention is described although above-mentioned, not the present invention is protected to modelThe restriction of enclosing, one of ordinary skill in the art should be understood that, on the basis of technical scheme of the present invention, those skilled in the art are notNeed to pay various amendments that creative work can make or distortion still in protection scope of the present invention.
Claims (10)
1. the major-minor layout of cochlear electrode that strengthens music rhythm perception, is characterized in that, near every side basilar membrane, according to soundThe characteristic frequency corresponding relation of musical sound symbol, is separated into corresponding phonosensitive Whole frequency band at the bottom of snail the frequency that responds particular note by cupula cochleaeRegion; The electrode of placing this band signal in each frequency field, each electrode is placed in the spy at musical tones placeLevy in frequency band, utilize the feature of ears two-channel, electrode is divided into two groups, bilateral ear is adopted to major-minor method distribution of electrodes, both sidesCochlea is each implants corresponding one group of electrode, implants respectively the electrode of varying number in bilateral cochlea, wherein one pick up the ears to arrange oneGroup electrode is master, and another one group of electrode of picking up the ears to arrange is auxiliary side, at the frequency band of setting, divides by assigned frequency interleavedGroup layout electrod-array.
2. the major-minor layout of cochlear electrode of enhancing music rhythm as claimed in claim 1 perception, is characterized in that, in the cochlea of both sidesWhile implanting respectively the electrode of varying number, the main frequency induction zone distribution " main electrode of the corresponding cochlea of a side except low frequency rangeGroup ", totally 38, the corresponding cochlea main frequency of opposite side induction zone distributes " auxiliary electrode group ", totally 27;
The wherein snail of picking up the ears, the main electrode group layout of distribution is:
First electrode is corresponding with the fundamental frequency of B8 note; The 38 electrode is relative with the fundamental frequency of G3 noteShould, the electrode between first electrode and 38 electrodes is arranged with setting means according to note frequency corresponding relation;
In opposite side cochlea, implant auxiliary electrode group, layout is:
First electrode is corresponding with the fundamental frequency of A#/Bb8 note; The first-harmonic of the 27 electrode and G#/Ab3 note frequentlyRate is corresponding, the electrode between first electrode and 27 electrodes according to note frequency corresponding relation with setting means clothPut.
3. the major-minor layout of cochlear electrode of enhancing music rhythm as claimed in claim 2 perception, is characterized in that, at low frequency range,Choose and represent that accordingly frequency arranges corresponding electrode, implant respectively both sides cochlea, both sides 3 the identical electrodes that distribute.
4. the major-minor layout of cochlear electrode of enhancing music rhythm as claimed in claim 3 perception, is characterized in that, at low frequency range, and 3Individual electrode is respectively: the 41 electrode of main electrode group is corresponding with the fundamental frequency of A1 note, the 40 electrode and E2The fundamental frequency of note is corresponding, and the 3rd nineteen electrode is corresponding with the fundamental frequency of C3 note; The 30 of auxiliary electrode groupElectrode is corresponding with the fundamental frequency of A1 note, and the second nineteen electrode is corresponding with the fundamental frequency of E2 note, and the 28Individual electrode is corresponding with the fundamental frequency of C3 note.
5. the method for the major-minor layout of cochlear electrode based on the arbitrary described enhancing music rhythm perception of claim 1-4, comprisesFollowing steps:
Electrode is divided into two groups, implants respectively corresponding one group of electrode in bilateral cochlea, each electrode is placed in musical tones placeCharacter pair frequency band in, the main centralized arrangement of electrode is at 100Hz-8000Hz main frequency induction zone, at low-frequency region, choosingGet and represent accordingly frequency layout electrode;
In major-minor method, electrode be divided into quantity not wait two groups time, in the snail of often picking up the ears electrode according to note first-harmonic characteristic frequency withSetting means is arranged.
6. the cochlear electrode array apparatus that strengthens music rhythm perception, comprises multiple electrodes, and described electrode is according to claim 5Arrangement of electrodes method is arranged to array, and each electrode comprises multiple ring electrodes contact, and tape insulation is all passed through in ring electrode contactThe wire of layer is connected with electrode loop, and described electrode also comprises the flexible covering that wraps up all electrode loops, and described electrode is pressedBe arranged to array according to the method for arranging described in the claims 5.
7. strengthen the artificial cochlea system of music rhythm perception, adopt the ear of enhancing music rhythm claimed in claim 6 perceptionSnail electrode array device, is characterized in that, comprises implant part and external part, and implant part and external part can adopt channel radioLetter connected mode or wired connection mode, wherein implant part at least comprises electrode array device, external part at least comprises soundAudio processor and the voice collection device being connected with processor, voice signal is obtained by voice collection device, is completed by processorAnalysis and the coding of the thematic note of music signal, interval, processor produces corresponding MIDI music according to musical instrument kind and compilesCode, by corresponding Processing Algorithm processing, converts the snail electrode stimulating code signal of respectively picking up the ears to, through radio communication or special wiredInterface driver, sends to stimulation location.
8. the artificial cochlea system of enhancing music rhythm as claimed in claim 7 perception, is characterized in that, connects for radio communicationConnect mode, electrode array device and receiving system are as artificial cochlea's implant part, and transmitter, processor and sound collection fillPut the external part as artificial cochlea;
Implant part and external part communication can be Bluetooth communication mode, over the horizon communication system or RF radio communicationMode, wired connection mode adopts the syndeton with flexible material parcel.
9. the artificial cochlea system of enhancing music rhythm as claimed in claim 7 perception, is characterized in that, for wired connection sideFormula, electrode array device is as artificial cochlea's implant part, wireline interface device, signal driver device, processor and soundHarvester, as external part, transfers to processor through the signal of voice collection device collection, and processor is to the signal obtaining,Be sent to signal driver device through decomposing, quantize the corresponding signal of generation, signal driver device will drive and produce Ge road signalTransfer to wireline interface device, at wireline interface device place, each road signal docks with the each road of implant electrode signal, corresponding to produceStimulus signal.
10. the method for work of the artificial cochlea system based on enhancing music rhythm claimed in claim 7 perception, is characterized in that,Comprise the following steps:
Signal through voice collection device collection transfers to processor, completes the thematic note of music signal, sound by processorThe analysis of journey and coding, wherein processor can produce corresponding MIDI music encoding according to musical instrument kind, by corresponding with patternProcessing Algorithm processing;
Processor, according to electrode mode of operation, is determined the effective working electrode of each note position, determines every side array and each electrodeCoded sequence;
Processor, by the Processing Algorithm processing corresponding with pattern, converts the snail electrode stimulating code signal of respectively picking up the ears to, through wirelessCommunication or special wireline interface drive, and send to stimulation location.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610056261.4A CN105596119B (en) | 2016-01-27 | 2016-01-27 | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method |
| PCT/CN2016/108235 WO2017128856A1 (en) | 2016-01-27 | 2016-12-01 | Cochlear electrode arrangement, device, system and method for enhancing melody perception |
| US15/575,078 US11123550B2 (en) | 2016-01-27 | 2016-12-01 | Cochlea electrode arrangement, device, system and method for enhancing musical melody perception |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610056261.4A CN105596119B (en) | 2016-01-27 | 2016-01-27 | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105596119A true CN105596119A (en) | 2016-05-25 |
| CN105596119B CN105596119B (en) | 2017-11-14 |
Family
ID=55976864
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610056261.4A Active CN105596119B (en) | 2016-01-27 | 2016-01-27 | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105596119B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017128856A1 (en) * | 2016-01-27 | 2017-08-03 | 山东大学 | Cochlear electrode arrangement, device, system and method for enhancing melody perception |
| CN109890338A (en) * | 2016-11-04 | 2019-06-14 | Med-El电气医疗器械有限公司 | The two-side synchronous channel selecting of cochlear implant |
| WO2019157872A1 (en) * | 2018-02-13 | 2019-08-22 | 山东大学 | Flexible single-layer conductive micro structure artificial cochlear electrode and manufacturing method thereof |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4284856A (en) * | 1979-09-24 | 1981-08-18 | Hochmair Ingeborg | Multi-frequency system and method for enhancing auditory stimulation and the like |
| CN101347367A (en) * | 2007-07-17 | 2009-01-21 | 美国诺尔康神经电子科技有限公司 | Electronic cochlea utilizing multiple-resolution current sources and flexible data encoding plans |
| CN101564334A (en) * | 2008-04-22 | 2009-10-28 | 上海耳蜗医学科技有限公司 | Artificial cochlear device |
| CN102500059A (en) * | 2011-11-21 | 2012-06-20 | 深圳市圣祥高科技有限公司 | Multi-band music electrotherapy instrument |
| CN102596309A (en) * | 2009-09-11 | 2012-07-18 | Med-El电气医疗器械有限公司 | Low pulse rate cochlear implant stimulation in conjunction with a separate representation of fundamental frequencies and voiced/unvoiced distinctions |
| CN103190966A (en) * | 2013-03-15 | 2013-07-10 | 杭州诺尔康神经电子科技有限公司 | System and method of information processing for cochlear implant virtual channel for enhancing time domain information |
| CN103347465A (en) * | 2011-01-24 | 2013-10-09 | 耳蜗有限公司 | System and method for detecting nerve stimulation with an implanted prosthesis |
| CN104013480A (en) * | 2014-06-13 | 2014-09-03 | 山东大学 | Artificial cochlea acoustic nerve conductive electrode array capable of sensing music melodies |
| WO2014210415A1 (en) * | 2013-06-28 | 2014-12-31 | Med-El Elektromedizinische Geraete Gmbh | Fast fitting for cochlear implants |
| CN104685907A (en) * | 2012-08-14 | 2015-06-03 | 耳蜗有限公司 | Fitting bilateral hearing prostheses |
| CN104905909A (en) * | 2014-03-11 | 2015-09-16 | 奥迪康医疗有限公司 | Bilateral hearing assistance system and method of fitting bilateral hearing assistance system |
| CN205515041U (en) * | 2016-01-27 | 2016-08-31 | 山东大学 | Cochlea electrode of reinforcing music melody perception is arranged, device and system |
-
2016
- 2016-01-27 CN CN201610056261.4A patent/CN105596119B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4284856A (en) * | 1979-09-24 | 1981-08-18 | Hochmair Ingeborg | Multi-frequency system and method for enhancing auditory stimulation and the like |
| CN101347367A (en) * | 2007-07-17 | 2009-01-21 | 美国诺尔康神经电子科技有限公司 | Electronic cochlea utilizing multiple-resolution current sources and flexible data encoding plans |
| CN101564334A (en) * | 2008-04-22 | 2009-10-28 | 上海耳蜗医学科技有限公司 | Artificial cochlear device |
| CN102596309A (en) * | 2009-09-11 | 2012-07-18 | Med-El电气医疗器械有限公司 | Low pulse rate cochlear implant stimulation in conjunction with a separate representation of fundamental frequencies and voiced/unvoiced distinctions |
| CN103347465A (en) * | 2011-01-24 | 2013-10-09 | 耳蜗有限公司 | System and method for detecting nerve stimulation with an implanted prosthesis |
| CN102500059A (en) * | 2011-11-21 | 2012-06-20 | 深圳市圣祥高科技有限公司 | Multi-band music electrotherapy instrument |
| CN104685907A (en) * | 2012-08-14 | 2015-06-03 | 耳蜗有限公司 | Fitting bilateral hearing prostheses |
| CN103190966A (en) * | 2013-03-15 | 2013-07-10 | 杭州诺尔康神经电子科技有限公司 | System and method of information processing for cochlear implant virtual channel for enhancing time domain information |
| WO2014210415A1 (en) * | 2013-06-28 | 2014-12-31 | Med-El Elektromedizinische Geraete Gmbh | Fast fitting for cochlear implants |
| CN104905909A (en) * | 2014-03-11 | 2015-09-16 | 奥迪康医疗有限公司 | Bilateral hearing assistance system and method of fitting bilateral hearing assistance system |
| CN104013480A (en) * | 2014-06-13 | 2014-09-03 | 山东大学 | Artificial cochlea acoustic nerve conductive electrode array capable of sensing music melodies |
| CN205515041U (en) * | 2016-01-27 | 2016-08-31 | 山东大学 | Cochlea electrode of reinforcing music melody perception is arranged, device and system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017128856A1 (en) * | 2016-01-27 | 2017-08-03 | 山东大学 | Cochlear electrode arrangement, device, system and method for enhancing melody perception |
| US11123550B2 (en) | 2016-01-27 | 2021-09-21 | Shandong University | Cochlea electrode arrangement, device, system and method for enhancing musical melody perception |
| CN109890338A (en) * | 2016-11-04 | 2019-06-14 | Med-El电气医疗器械有限公司 | The two-side synchronous channel selecting of cochlear implant |
| US11426581B2 (en) | 2016-11-04 | 2022-08-30 | Med-El Elektromedizinische Geraete Gmbh | Bilateral synchronized channel selection for cochlear implants |
| WO2019157872A1 (en) * | 2018-02-13 | 2019-08-22 | 山东大学 | Flexible single-layer conductive micro structure artificial cochlear electrode and manufacturing method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105596119B (en) | 2017-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7805198B2 (en) | Optimizing pitch and other speech stimuli allocation in a cochlear implant | |
| CN100469158C (en) | Audio processing method and system implantted cochlea | |
| CN103140260B (en) | Cochlear implant stimulation with low frequency channel privilege | |
| US8027733B1 (en) | Optimizing pitch allocation in a cochlear stimulation system | |
| CN100502819C (en) | Artificial cochlea manufacture method suitable for Chinese voice coding strategy | |
| JP2004500788A (en) | Speech processor for cochlear implant stimulator | |
| CN105555354B (en) | It is used as the auditory prosthesis stimulation rate of the multiple of natural oscillation | |
| CN101743036A (en) | Electrical nerve stimulation with broad band low frequency filter | |
| CN101716108B (en) | System for processing electronic cochlear signal and coding electric stimulation | |
| JP2791031B2 (en) | Artificial hearing organ and signal processing device | |
| CN102596309A (en) | Low pulse rate cochlear implant stimulation in conjunction with a separate representation of fundamental frequencies and voiced/unvoiced distinctions | |
| CN105596119B (en) | The major-minor arrangement of cochlear electrode of enhancing music rhythm perception, device, system and method | |
| CN205515041U (en) | Cochlea electrode of reinforcing music melody perception is arranged, device and system | |
| CN104013492B (en) | Based on artificial cochlea's signal processing unit and the method for Auditory Perception prompting | |
| CN105596120B (en) | Strengthen the cochlear electrode that music rhythm perceives and divide equally arrangement, device, system and method | |
| TWI398243B (en) | Electrode simulating method and system thereof | |
| CN107925829B (en) | Stimulation rate and location matched to instantaneous frequency | |
| CN107708794A (en) | Selective stimulating with cochlear implant | |
| CN102139140A (en) | Transcranial micro-current stimulator with music function | |
| CN107925830A (en) | Hearing prosthesis acoustic processing | |
| Omran et al. | Semitone frequency mapping to improve music representation for nucleus cochlear implants | |
| US11123550B2 (en) | Cochlea electrode arrangement, device, system and method for enhancing musical melody perception | |
| EP3442654A1 (en) | Multichannel optogenetic stimulation and inhibition | |
| CN203001232U (en) | Earplug type sound sensing assisting device | |
| CN111905262A (en) | Artificial cochlea audio channel distribution method and device for identifying music |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200120 Address after: Room 601, building 3, Aosheng building, 1166 Xinluo street, high tech Zone, Jinan City, Shandong Province 250101 Patentee after: JINAN USUAL LARGE TECHNOLOGY CO., LTD. Address before: 250061, No. ten, No. 17923, Lixia District, Ji'nan City, Shandong Province Patentee before: Shandong University |
|
| TR01 | Transfer of patent right |