EP2757445A1 - Visual interface system - Google Patents
Visual interface system Download PDFInfo
- Publication number
- EP2757445A1 EP2757445A1 EP12831451.5A EP12831451A EP2757445A1 EP 2757445 A1 EP2757445 A1 EP 2757445A1 EP 12831451 A EP12831451 A EP 12831451A EP 2757445 A1 EP2757445 A1 EP 2757445A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- passive matrix
- display apparatus
- substrate
- information
- matrix display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 45
- 239000011159 matrix material Substances 0.000 claims abstract description 127
- 230000005540 biological transmission Effects 0.000 claims abstract description 59
- 239000000758 substrate Substances 0.000 claims abstract description 57
- 238000000034 method Methods 0.000 claims description 20
- 230000008569 process Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 4
- 230000001960 triggered effect Effects 0.000 claims description 3
- 238000012905 input function Methods 0.000 abstract description 6
- 238000004891 communication Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 12
- 230000008878 coupling Effects 0.000 description 11
- 238000010168 coupling process Methods 0.000 description 11
- 238000005859 coupling reaction Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 239000008186 active pharmaceutical agent Substances 0.000 description 4
- 239000004020 conductor Substances 0.000 description 4
- 230000001939 inductive effect Effects 0.000 description 4
- 230000008054 signal transmission Effects 0.000 description 4
- 230000003321 amplification Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000003199 nucleic acid amplification method Methods 0.000 description 3
- 241001422033 Thestylus Species 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000003098 cholesteric effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000007519 figuring Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000010355 oscillation Effects 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 238000004886 process control Methods 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H04B5/72—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/14—Handling requests for interconnection or transfer
- G06F13/20—Handling requests for interconnection or transfer for access to input/output bus
- G06F13/28—Handling requests for interconnection or transfer for access to input/output bus using burst mode transfer, e.g. direct memory access DMA, cycle steal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04166—Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
- G06F3/0446—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/046—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04101—2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
Definitions
- the present invention relates to a human-machine interface system and, in particular, to a visual interface system.
- touch panels have been widely applied to the commercial electronic products such as smart phones, digital cameras, MP3, PDA, GPS, tablet PC, UMPC, and the likes.
- the touch panel is bound with a screen to form a touch input display apparatus.
- NFC near field communication
- An objective of the present invention is to provide a visual interface system that can achieve the touch input function without configuring an additional touch panel, and is equipped with a near field communication (NFC) function.
- NFC near field communication
- the present invention can be implemented by the following technical proposals.
- a visual interface system of the invention includes an operation apparatus and a passive matrix display apparatus.
- the passive matrix display apparatus includes a first substrate, a display surface and a second substrate.
- the display surface is located at a first side of the first substrate.
- the second substrate is disposed opposite to the first substrate and located at a second side of the first substrate relatively opposite to the first side.
- the transmission signal is transmitted to the passive matrix display apparatus.
- the passive matrix display apparatus has at least an electrode disposed on the first substrate or the second substrate, and the encoded signal is applied to the electrode and is then capacitive or inductive coupled to the operation apparatus from the electrode.
- the electrode is a separate electrode or one of a plurality of electrodes of the passive matrix display apparatus.
- the passive matrix display apparatus processes the transmission signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information.
- the touch input information includes relative position information of the operation apparatus on the display surface.
- the visual interface system further includes at least a relay apparatus for processing the transmission signal to generate a relay processed signal.
- the relay processed signal can be transmitted to the passive matrix display apparatus or other apparatuses outside the visual interface system.
- the transmission signal includes touch input information, instruction information, identification information, transaction information, file information or other information.
- the relay processed signal comprises touch input information, instruction information, identification information, transaction information, file information or other information.
- the passive matrix display apparatus or another apparatus outside the visual interface system processes the relay processed signal to obtain information including touch input information, instruction information, identification information, transaction information, file information or other information.
- the visual interface system further includes a mode trigger device for enabling the passive matrix display apparatus into an operating mode to output the encoded signal as the mode trigger device is triggered by a user or the operation apparatus.
- the visual interface system when the operation apparatus is a user, the visual interface system further includes a sensing device, and then when the user touches the display surface and the sensing device simultaneously, the transmission signal is transmitted to the sensing device.
- the sensing device has a mode trigger function, so the sensing device enables the passive matrix display apparatus into an operating mode to output the encoded signal as the user touches the sensing device.
- the passive matrix display apparatus further includes a display medium layer disposed between the first substrate and the second substrate.
- the passive matrix display apparatus further includes a plurality of column electrodes disposed at the second side of the first substrate and a plurality of row electrodes disposed at one side of the second substrate facing the first substrate.
- the column electrodes and the row electrodes are intersected.
- the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal.
- the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus.
- the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
- the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together.
- the manufactured products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness.
- the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus.
- the touch input application it is unnecessary to add the capacitance sensing components in the display panel for detecting the change of external capacitance values.
- the present invention can decrease the manufacturing cost and shrink the process time.
- FIG. 1 is a block diagram of a visual interface system 1 according to a first embodiment of the invention.
- the visual interface system 1 includes an operation apparatus 11 and a passive matrix display apparatus 12 coupled with each other by, for example, capacitive or inductive coupling for transmitting signals.
- the signal transmission between the operation apparatus 11 and the passive matrix display apparatus 12 is a non-contact signal transmission (wireless).
- the operation apparatus 11 is, for example, a stylus, a conductor, an IC card, an NFC reading apparatus, or a user (especially the finger of a user).
- the operation apparatus 11 is an electronic apparatus, it may include some functional circuits such as a process control circuit, a storage circuit or a transmission circuit.
- any circuit can be composed of hardware, software or firmware, or their combinations.
- the operation apparatus 11 is a user, the user (operation apparatus) can serve as a conductor for transmitting signals.
- the passive matrix display apparatus 12 can be, for example, a passive matrix LCD, a touch input display apparatus, a non-volatile type display apparatus, or a passive matrix OLED display apparatus.
- FIG. 2 is a side view of the passive matrix display apparatus 12 of FIG. 1 .
- the passive matrix display apparatus 12 includes a display surface 121, a first substrate 122 and a second substrate 123.
- the display surface 121 is located at a first side P1 of the first substrate 122.
- the second substrate 123 is disposed opposite to the first substrate 122 and located at a second side P2 of the first substrate 122 relatively opposite to the first side P1.
- the display surface 121 is the surface of the passive matrix display apparatus 12, which is closest to the viewer when the viewer is watching the images displayed on the passive matrix display apparatus 12.
- the first substrate 122 and the second substrate 123 can be glass substrates.
- the passive matrix display apparatus 12 may further include a protect glass 124 disposed on the first side P1 of the first substrate 122.
- the display surface 121 is the surface of the protect glass 124 closest to the viewer.
- the passive matrix display apparatus 12 may further include a display medium layer 125 disposed between the first substrate 122 and the second substrate 123.
- the display medium layer 125 is a liquid crystal layer.
- the LCD apparatus further includes alignment layers, polarizer, color filter layer, backlight or other components.
- the passive matrix display apparatus 12 is a non-volatile type display apparatus
- the display medium layer 125 can be an electrophoretic layer.
- the non-volatile type display apparatus may further include other components such as an accommodating structure.
- the passive matrix display apparatus 12 is an OLED display apparatus
- the display medium layer 125 is an organic light emitting layer. In this case, the passive matrix display apparatus 12 may further include other components such as a color filter layer.
- an encoded signal ES is wirelessly coupled to the operation apparatus 11 (by capacitive or inductive coupling) from the passive matrix display apparatus 12, and the operation apparatus 11 receives the encoded signal ES so as to generate a transmission signal TS.
- the encoded signal ES contains the coordinate of the touch position of the operation apparatus 11 on the display screen of the passive matrix display apparatus 12, and the transmission signal TS contains the coordinate information.
- the encoded signal ES is transmitted form the passive matrix display apparatus 12 to the operation apparatus 11, they are wirelessly transmitted so as to form a near field signal transmission.
- the encoded signal ES can be composed of any information to be transmitted such as touch input information, instruction information, identification information, transaction information, or file information (e.g. music, images, texts, and etc.), so that the transmission signal TS contains the corresponding information.
- the encoded signal ES can be applied to at least one electrode on the passive matrix display apparatus 12. This electrode can be disposed on the first substrate 122 or the second substrate 123. The encoded signal ES is applied to this electrode and then capacitively or inductively coupled to the operation apparatus 11 through the electrode. Besides, additional display data signal are applied to the passive matrix display apparatus 12 for displaying images. The encoded signal ES can be applied during the blanking time of the display signals.
- the encoded signal ES can be applied between two frames or between the signal transmissions of two row or column electrodes, or during the period generated by shortening the duration of the display signals, or the encoded signal ES can have a higher frequency and be directly added to the display signal, or it can be applied between the renewals of the display screen.
- FIG. 3A is a perspective diagram showing the passive matrix display apparatus 12 of FIG. 2
- FIG. 3B is a schematic diagram showing the intersected column electrodes and row electrodes of FIG. 3A .
- FIG. 3B only shows the column electrodes and the row electrodes of the passive matrix display apparatus 12 of FIG. 3A , while the first substrate 122, the second substrate 123 and the display medium layer 125 of the passive matrix display apparatus 12 are not shown in FIG. 3B .
- the passive matrix display apparatus 12 is an OLED display apparatus for example, and the display medium layer 125 is an organic light emitting layer.
- the passive matrix display apparatus 12 further includes a plurality of column electrodes D 1 ⁇ D N and a plurality of row electrodes S 1 ⁇ S M .
- the column electrodes D 1 ⁇ D N are disposed at the second side P2 of the first substrate 122, while the row electrodes S 1 ⁇ S M are disposed at one side of the second substrate 123 facing the first substrate 122.
- the column electrodes D 1 ⁇ D N and the row electrodes S 1 ⁇ S M are intersected, and they are substantially perpendicular to each other or have an included angle.
- the passive matrix display apparatus 12 further includes a driving module (not shown) for driving the passive matrix display apparatus 12 to display image.
- the driving module can drive the selected row and column electrodes for lighting the display medium layer 125 located at the cross of the row and column electrodes so as to display image. Since the driving method of the driving module and the passive matrix display apparatus 12 is a well-known conventional technology, the detailed description thereof will be omitted here.
- the point of this embodiment is in that the column electrodes D 1 ⁇ D N and/or the row electrodes S 1 ⁇ S M transmit the encoded signal ES from the passive matrix display apparatus 12 to the operation apparatus 11 so as to generate the transmission signal TS.
- the encoded signal may carry various information for different applications, such as, the reference coordinates of the display screen of the passive matrix display apparatus 12, the file information of different formats (e.g. personal data, music, images, and etc.), and the likes.
- the column electrodes D 1 ⁇ D N can transmit not only the data signals for displaying images but also the encoded signal ES.
- the encoded signal ES with higher frequency can be directly added to the display signal DS or be added to the blank period of the display signal DS such as the period between two frames or the blank time between the renewals of the screen.
- the encoded signal ES can be provided by the circuit of the driving module of the passive matrix display apparatus 12, thereby simplifying the circuit design.
- the passive matrix display apparatus 12 when the passive matrix display apparatus 12 is a bistable display apparatus such as a cholesteric LCD apparatus, the display apparatus needs the display signals only for the screen renewal, so that the encoded signal can be transmitted during the display screen renewal (carried on the display signal) or between the renewals of the display screen (between display signals). Moreover, the passive matrix display apparatus 12 can renew a part of the display screen only, so that the encoded signal can be transmitted along with the renewal of the part of the display screen or between the renewals of the part of the display screen. Or, the passive matrix display apparatus 12 can be a quasi-bistable display apparatus such as an IMOD (interferometric modulator) display apparatus using MEMS to generate light interference.
- IMOD interferometric modulator
- this kind of display apparatus needs a sustaining signal to maintain the screen image even the screen is not renewed.
- the encoded signal can be carried on the display signal or the sustaining signal, or between the display signals or sustaining signals.
- FIG. 4 is a schematic diagram showing the signals for two adjacent column electrodes of FIG. 3B .
- the encoded signal ES will be described hereinafter with sequential coding in time for one dimension touch input perpendicular to the row electrode as an example.
- this method can also be applied to another dimension touch input perpendicular to the column electrode. Consequently, a complete two-dimensional touch input can be built.
- FIG. 4 only one column electrode transmits the encoded signal ES, wherein the encoded signal ES is labeled with a level different from that of the display signal, or, in practice, the encoded signal ES and the display signal may have the same level.
- the column electrode transmits an encoded signal ES1 and a display signal DS1, and at the next timing, the column electrode transmits another encoded signal ES2 and another display signal DS2.
- FIG. 5 is a timing chart of the encoded signal ES transmitted through each column electrode, wherein the display signals DS for display are omitted.
- the column electrodes D 1 ⁇ D N transmit the encoded signals ES1 ⁇ ESN, respectively.
- the encoded signals ES1 ⁇ ESN can be transmitted through different column electrodes, respectively, or multiple column electrodes may transmit the same encoded signal.
- the column electrodes D 1 ⁇ D 3 transmit the encoded signal ES1
- the column electrodes D 4 ⁇ D 6 transmit the encoded signal ES2.
- This approach may also be applied to the transmission of encoded signals ES through the row electrodes.
- the encoded signals ES transmitted through the row electrodes and the column electrodes may be an independent coding system, respectively. Since the column electrodes transmit the encoded signals ES sequentially, it is necessary to provide a time reference point for determining the positions of the column electrodes by comparing with the reference point. This reference point can be a specific code and transmitted by the same manner.
- all column electrodes may output the code "1" twice and then transmit the sequential signal.
- the encoded signal ES coupled to the operation apparatus 11 is "110010000", it represents that the operation apparatus 11 is located on the third column electrode, thereby figuring out the coordinate (x-coordinate) of the operation apparatus 11.
- the y-coordinate of the operation apparatus 11 can be estimated according to another encoded signal applied to the row electrode.
- the duty cycle of the encoded signal ES of this embodiment is smaller than that of the display signal DS, thereby maintaining the display quality.
- the above modulation is carried out by amplitude modulation technology, which uses the high-low level of the amplitude for representing "1" and “0" digital signals.
- the frequency modulation technology for representing the "1" and “0” digital signals.
- it can define that five oscillations within a unit time is “1", while other frequencies are all "0".
- phase shift modulation technology for representing the digital signals.
- it can define that one high level plus one low level represents "0", and one low level plus one high level represent "1".
- the applied modulation method is not limited.
- the technology of time division, frequency division or code division can be applied to different electrodes.
- the encoded signal ES is coupled capacitively from the passive matrix display apparatus 12 to the operation apparatus 11.
- This embodiment takes the column electrodes D 1 ⁇ D N for transmitting the encoded signals ES as an example, so the column electrode can serve as one of the capacitive coupling electrodes, and the operation apparatus 11 has the other capacitive coupling electrode.
- the operation apparatus 11 is a stylus
- a conductor configured at the tip of the stylus functions as the other capacitive coupling electrode.
- the operation apparatus 11 After receiving the encoded signal ES through the capacitive coupling, the operation apparatus 11 processes the received encoded signal ES to generate a transmission signal TS. This process includes amplifying and/or decoding the encoded signal ES so as to determine which column electrode is touched or pressed, or the touch position, or the touch gesture (writing style), or the corresponding function or instruction deduced from the input.
- the encoded signal ES is capacitively coupled to the operation apparatus 11, and the value of the capacitance depends on the distance between the operation apparatus and the display surface 121, which means the amplitude of the signal can provide the z-axis information, so that the operation apparatus 11 can get not only the two-dimensional coordinates but also the z coordinate.
- the transmission signal TS may denote messages from simple amplification of the encoded signal ES to instructions of the action.
- the operation apparatus 11 can transmit the transmission signal TS to the passive matrix display apparatus 12, other relay apparatus, or other apparatuses outside the visual interface system 1 through wire, or wireless, or electrical coupling (including capacitive or inductive coupling) or optical coupling.
- the transmission signal TS is directly transmitted to the passive matrix display apparatus 12.
- the information to be transmitted is encoded to generate an encoded signal ES based on a specific coding rule, and then the encoded signal ES is capacitive coupled from the passive matrix display apparatus 12 (e.g. configured as a cell phone or tablet computer) to the operation apparatus 11 (e.g. short distance wireless reading apparatus attached on the wall).
- the operation apparatus 11 can process (decodes or modifies) the encoded signal ES based on the preset coding rule so as to obtain the transmission signal TS, and then uses the transmission signal TS on the corresponding application such as access control, payment, financial transaction, file transmission, and the likes.
- the operation apparatus 11 processes the encoded signal ES to obtain the information contained in the transmission signal TS such as the touch input information, instruction information, identification information, transaction information, file information or other information.
- the passive matrix display apparatus 12 may process the transmission signal TS to obtain information, which contains the touch input information, instruction information, identification information, transaction information, file information or other information.
- the touch input information may include the relative position information of the operation apparatus 11 on the display surface 121, wherein this relative position information is a signal outputted from the first substrate 122 and the second substrate 123 of the passive matrix display apparatus 12.
- the signal is gone through the processes, for example, amplification and decoding, which can be handled by either one of the operation apparatus 11 and the passive matrix display apparatus 12 or among these units.
- the resulting transmission signal TS can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
- the information obtained by the passive matrix display apparatus 12 may also contain the touch input information, instruction information, identification information, transaction information, file information or other information.
- a response signal RS can also be transmitted between the operation apparatus 11 and the passive matrix display apparatus 12.
- the response signal RS is for providing the information of the receiving status of the operation apparatus 11 to the passive matrix display apparatus 12, or for announcing the operation apparatus 11 to get ready for receiving the signal, or synchronizing the operation apparatus 11 and the passive matrix display apparatus 12.
- This configuration can create an interactive mechanism between the transmitting and receiving signals.
- the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11 and the passive matrix display apparatus 12.
- FIG. 6 is a perspective view of the passive matrix display apparatus 12 according to the first embodiment of the invention.
- the visual interface system 1 further includes a mode trigger device 127.
- the mode trigger device 127 can enable the passive matrix display apparatus 12 into an operating mode to output the encoded signal ES.
- the mode trigger device 127 e.g. pushes the button
- the row electrode or column electrode starts to transmit the encoded signal.
- the passive matrix display apparatus 12 does not enter the touch input mode and the touch input function of the passive matrix display apparatus 12 may be partially or totally shut down.
- the operation of the mode trigger device 127 may have different operation modes. For example, after been activated, the mode trigger device 127 may remain in the new state for a while and then return to the original state, or it may change the state each time after being activated. Or, the mode trigger device 127 may remain in the new state only when the activation lasts.
- the mode trigger device 127 can be configured on the operation apparatus 11 (e.g. a switch on the stylus). In this case, when the mode trigger device 127 is activated, the operation apparatus 11 transmits a trigger signal to the passive matrix display apparatus 12 to enter the touch input mode.
- the mode trigger device 127 can be triggered once or continuously for switching to the touch input function. Taking the access card, ticket, credit card or file transmission as examples, the user can trigger the mode trigger device 127 to transmit the encoded signal for authorization or personal identification to the corresponding data receiving device.
- the mode trigger device 127 can be, for example, a mechanical switch, a touch sensing switch, or the likes.
- FIG. 7 is a schematic diagram showing the passive matrix display apparatus 12 and a user, as the operation apparatus 11, according to the first embodiment of the invention.
- the visual interface system 1 further includes a sensing device 128, which is electrically coupled with the passive matrix display apparatus 12.
- the transmission signal TS is transmitted to the passive matrix display apparatus 12. That is, the user serves as a large conductor for transmitting the transmission signal TS to the passive matrix display apparatus 12.
- the user can use his/her right hand to operate on the display surface 121, while use the left hand to press the sensing device 128. Accordingly, the encoded signal ES can enter the user body through the right hand, and the transmission signal TS can be outputted from the left hand.
- the transmitted information can be obtained by analyze the transmission signal TS received by the sensing device 128.
- the sensing device 128 may also contain the function of the mode trigger device 127. For example, only when the sensing device 128 is pressed by the left hand, the operation mode will be enabled. This specific function can sufficiently reduce the power consumption and the problem of unintentional touch.
- FIG. 8 is a block diagram of a visual interface system 1a according to a second embodiment of the invention.
- the visual interface system 1a includes an operation apparatus 11 and a passive matrix display apparatus 12.
- the visual interface system 1a further includes at least one relay apparatus 13, and the transmission signal TS is transmitted to the passive matrix display apparatus 12 or other apparatuses outside the visual interface system 1a through the relay apparatus 13.
- the user's hand is used to transmit the transmission signal TS to the relay apparatus 13, and a relay processed signal IS generated by processing the transmission signal TS is then transmitted back to the passive matrix display apparatus 12.
- the relay apparatus 13 can be a portable communication device such as a cell phone. Accordingly, the user can be the transmission media for conducting the encoded signal ES outputted from the passive matrix display apparatus 12 to the relay apparatus 13 in order to transfer the file information.
- the relay apparatus 13 can process the transmission signal TS to generate a relay processed signal IS and then transmit the relay processed signal IS to the passive matrix display apparatus 12.
- the signal is processed by, for example, amplification, decoding, modifying and/or interpretation, which can be implemented by either one of the operation apparatus 11, the passive matrix display apparatus 12 and the relay apparatus 13 or among these units.
- the transmission signal TS or the relay processed signal IS can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
- the response signal RS of the first embodiment can also be applied to the operation apparatus 11, and/or the relay apparatus 13 and/or the passive matrix display apparatus 12 of the second embodiment, thereby creating an interactive mechanism between the transmitting and receiving signals.
- the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11, the relay apparatus 13 and the passive matrix display apparatus 12.
- the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal.
- the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus.
- the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
- the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together.
- the manufactured products can be lighter and thinner and the product cost can be reduced, thereby improving the product competitiveness.
- the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus.
- the touch input application it is unnecessary to add the capacitance sensing component in the display panel for detecting the change of external capacitance values.
- the present invention can decrease the manufacturing cost and time.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Position Input By Displaying (AREA)
- Mobile Radio Communication Systems (AREA)
- Near-Field Transmission Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
- The present invention relates to a human-machine interface system and, in particular, to a visual interface system.
- Recently, touch panels have been widely applied to the commercial electronic products such as smart phones, digital cameras, MP3, PDA, GPS, tablet PC, UMPC, and the likes. In these electronic products, the touch panel is bound with a screen to form a touch input display apparatus.
- In order to broaden the application field of the commercial electronic products, some products have been added with the new function of near field communication (NFC), which can be used to replace the conventional IC card (e.g. door card, credit card, ticket, and etc.), exchange information (e.g. music, image, name card, and etc.) between two electronic devices, or the likes. Accordingly, it is desired to create a product with a simple structure and more functions.
- Therefore, it is an important subject to provide a visual interface system which can achieve the desired touch input function without configuring an additional touch panel, thereby making the product lighter and thinner, lowering the production cost, and providing the NFC function for broadening the application field.
- An objective of the present invention is to provide a visual interface system that can achieve the touch input function without configuring an additional touch panel, and is equipped with a near field communication (NFC) function.
- The present invention can be implemented by the following technical proposals.
- A visual interface system of the invention includes an operation apparatus and a passive matrix display apparatus. The passive matrix display apparatus includes a first substrate, a display surface and a second substrate. The display surface is located at a first side of the first substrate. The second substrate is disposed opposite to the first substrate and located at a second side of the first substrate relatively opposite to the first side. When the operation apparatus is operated on the display surface of the passive matrix display apparatus, an encoded signal is coupled to the operation apparatus from the passive matrix substrate, and the operation apparatus receives the encoded signal to obtain a transmission signal.
- In one embodiment, the transmission signal is transmitted to the passive matrix display apparatus.
- In one embodiment, the passive matrix display apparatus has at least an electrode disposed on the first substrate or the second substrate, and the encoded signal is applied to the electrode and is then capacitive or inductive coupled to the operation apparatus from the electrode. The electrode is a separate electrode or one of a plurality of electrodes of the passive matrix display apparatus.
- In one embodiment, the passive matrix display apparatus processes the transmission signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information. Herein, the touch input information includes relative position information of the operation apparatus on the display surface.
- In one embodiment, the visual interface system further includes at least a relay apparatus for processing the transmission signal to generate a relay processed signal. The relay processed signal can be transmitted to the passive matrix display apparatus or other apparatuses outside the visual interface system. The transmission signal includes touch input information, instruction information, identification information, transaction information, file information or other information. The relay processed signal comprises touch input information, instruction information, identification information, transaction information, file information or other information. Alternatively, the passive matrix display apparatus or another apparatus outside the visual interface system processes the relay processed signal to obtain information including touch input information, instruction information, identification information, transaction information, file information or other information.
- In one embodiment, the visual interface system further includes a mode trigger device for enabling the passive matrix display apparatus into an operating mode to output the encoded signal as the mode trigger device is triggered by a user or the operation apparatus.
- In one embodiment, when the operation apparatus is a user, the visual interface system further includes a sensing device, and then when the user touches the display surface and the sensing device simultaneously, the transmission signal is transmitted to the sensing device. Herein, the sensing device has a mode trigger function, so the sensing device enables the passive matrix display apparatus into an operating mode to output the encoded signal as the user touches the sensing device.
- In one embodiment, the passive matrix display apparatus further includes a display medium layer disposed between the first substrate and the second substrate. In addition, the passive matrix display apparatus further includes a plurality of column electrodes disposed at the second side of the first substrate and a plurality of row electrodes disposed at one side of the second substrate facing the first substrate. Herein the column electrodes and the row electrodes are intersected.
- In the visual interface system of the invention, when the operation apparatus is operated on the display surface of the passive matrix display apparatus, the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal. In the touch input operation, the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus. During this transmission procedure, the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
- As mentioned above, the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together. Thus, the manufactured products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness. Moreover, the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus. For example, regarding the touch input application, it is unnecessary to add the capacitance sensing components in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and shrink the process time.
- The invention will become more fully understood from the detailed description and accompanying drawings, which are given for illustration only, and thus are not limitative of the present invention, and wherein:
-
FIG. 1 is a block diagram of a visual interface system according to a first embodiment of the invention; -
FIG. 2 is a side view of a passive matrix display apparatus according to the first embodiment of the invention; -
FIG. 3A is a perspective diagram showing a passive matrix display apparatus ofFIG. 2 ; -
FIG. 3B is a schematic diagram showing the intersected column electrodes and row electrodes ofFIG. 3A ; -
FIG. 4 is a schematic diagram showing the signals for two adjacent column electrodes ofFIG. 3B ; -
FIG. 5 is a timing chart of the encoded signal transmitted through each column electrode according to the first embodiment of the invention; -
FIG. 6 is a perspective view of the passive matrix display apparatus according to the first embodiment of the invention; -
FIG. 7 is a schematic diagram showing the passive matrix display apparatus and a user, as the operation apparatus, according to the first embodiment of the invention; and -
FIG. 8 is a block diagram of a visual interface system according to a second embodiment of the invention. - The present invention will be apparent from the following detailed description, which proceeds with reference to the accompanying drawings, wherein the same references relate to the same elements.
-
FIG. 1 is a block diagram of avisual interface system 1 according to a first embodiment of the invention. - With reference to
FIG. 1 , thevisual interface system 1 includes anoperation apparatus 11 and a passivematrix display apparatus 12 coupled with each other by, for example, capacitive or inductive coupling for transmitting signals. Thus, the signal transmission between theoperation apparatus 11 and the passivematrix display apparatus 12 is a non-contact signal transmission (wireless). - In this embodiment, the
operation apparatus 11 is, for example, a stylus, a conductor, an IC card, an NFC reading apparatus, or a user (especially the finger of a user). When theoperation apparatus 11 is an electronic apparatus, it may include some functional circuits such as a process control circuit, a storage circuit or a transmission circuit. Herein, any circuit can be composed of hardware, software or firmware, or their combinations. When theoperation apparatus 11 is a user, the user (operation apparatus) can serve as a conductor for transmitting signals. Besides, the passivematrix display apparatus 12 can be, for example, a passive matrix LCD, a touch input display apparatus, a non-volatile type display apparatus, or a passive matrix OLED display apparatus. -
FIG. 2 is a side view of the passivematrix display apparatus 12 ofFIG. 1 . - Referring to
FIG. 2 , the passivematrix display apparatus 12 includes adisplay surface 121, afirst substrate 122 and asecond substrate 123. Thedisplay surface 121 is located at a first side P1 of thefirst substrate 122. Thesecond substrate 123 is disposed opposite to thefirst substrate 122 and located at a second side P2 of thefirst substrate 122 relatively opposite to the first side P1. In this embodiment, thedisplay surface 121 is the surface of the passivematrix display apparatus 12, which is closest to the viewer when the viewer is watching the images displayed on the passivematrix display apparatus 12. Besides, thefirst substrate 122 and thesecond substrate 123 can be glass substrates. The passivematrix display apparatus 12 may further include aprotect glass 124 disposed on the first side P1 of thefirst substrate 122. In this case, thedisplay surface 121 is the surface of theprotect glass 124 closest to the viewer. - In addition, the passive
matrix display apparatus 12 may further include adisplay medium layer 125 disposed between thefirst substrate 122 and thesecond substrate 123. When the passivematrix display apparatus 12 is an LCD apparatus, thedisplay medium layer 125 is a liquid crystal layer. Besides, the LCD apparatus further includes alignment layers, polarizer, color filter layer, backlight or other components. Or, when the passivematrix display apparatus 12 is a non-volatile type display apparatus, thedisplay medium layer 125 can be an electrophoretic layer. Besides, the non-volatile type display apparatus may further include other components such as an accommodating structure. Alternatively, when the passivematrix display apparatus 12 is an OLED display apparatus, thedisplay medium layer 125 is an organic light emitting layer. In this case, the passivematrix display apparatus 12 may further include other components such as a color filter layer. - The implementation of the embodiment used in the touch input purpose will be described hereinafter. Referring to
FIGS. 1 and 2 , when theoperation apparatus 11 is operated on thedisplay surface 121 of the passivematrix display apparatus 12, an encoded signal ES is wirelessly coupled to the operation apparatus 11 (by capacitive or inductive coupling) from the passivematrix display apparatus 12, and theoperation apparatus 11 receives the encoded signal ES so as to generate a transmission signal TS. Herein, the encoded signal ES contains the coordinate of the touch position of theoperation apparatus 11 on the display screen of the passivematrix display apparatus 12, and the transmission signal TS contains the coordinate information. When the encoded signal ES is transmitted form the passivematrix display apparatus 12 to theoperation apparatus 11, they are wirelessly transmitted so as to form a near field signal transmission. Of course, in other applications, the encoded signal ES can be composed of any information to be transmitted such as touch input information, instruction information, identification information, transaction information, or file information (e.g. music, images, texts, and etc.), so that the transmission signal TS contains the corresponding information. The encoded signal ES can be applied to at least one electrode on the passivematrix display apparatus 12. This electrode can be disposed on thefirst substrate 122 or thesecond substrate 123. The encoded signal ES is applied to this electrode and then capacitively or inductively coupled to theoperation apparatus 11 through the electrode. Besides, additional display data signal are applied to the passivematrix display apparatus 12 for displaying images. The encoded signal ES can be applied during the blanking time of the display signals. For example, the encoded signal ES can be applied between two frames or between the signal transmissions of two row or column electrodes, or during the period generated by shortening the duration of the display signals, or the encoded signal ES can have a higher frequency and be directly added to the display signal, or it can be applied between the renewals of the display screen. -
FIG. 3A is a perspective diagram showing the passivematrix display apparatus 12 ofFIG. 2 , andFIG. 3B is a schematic diagram showing the intersected column electrodes and row electrodes ofFIG. 3A . To be noted,FIG. 3B only shows the column electrodes and the row electrodes of the passivematrix display apparatus 12 ofFIG. 3A , while thefirst substrate 122, thesecond substrate 123 and thedisplay medium layer 125 of the passivematrix display apparatus 12 are not shown inFIG. 3B . - In this embodiment, the passive
matrix display apparatus 12 is an OLED display apparatus for example, and thedisplay medium layer 125 is an organic light emitting layer. Referring toFIGS. 2 ,3A and3B , the passivematrix display apparatus 12 further includes a plurality of column electrodes D1∼DN and a plurality of row electrodes S1∼SM. The column electrodes D1∼DN are disposed at the second side P2 of thefirst substrate 122, while the row electrodes S1∼SM are disposed at one side of thesecond substrate 123 facing thefirst substrate 122. The column electrodes D1∼DN and the row electrodes S1∼SM are intersected, and they are substantially perpendicular to each other or have an included angle. Moreover, the passivematrix display apparatus 12 further includes a driving module (not shown) for driving the passivematrix display apparatus 12 to display image. In practice, the driving module can drive the selected row and column electrodes for lighting thedisplay medium layer 125 located at the cross of the row and column electrodes so as to display image. Since the driving method of the driving module and the passivematrix display apparatus 12 is a well-known conventional technology, the detailed description thereof will be omitted here. The point of this embodiment is in that the column electrodes D1∼DN and/or the row electrodes S1∼SM transmit the encoded signal ES from the passivematrix display apparatus 12 to theoperation apparatus 11 so as to generate the transmission signal TS. The encoded signal may carry various information for different applications, such as, the reference coordinates of the display screen of the passivematrix display apparatus 12, the file information of different formats (e.g. personal data, music, images, and etc.), and the likes. - In this embodiment, the column electrodes D1∼DN can transmit not only the data signals for displaying images but also the encoded signal ES. For example, the encoded signal ES with higher frequency can be directly added to the display signal DS or be added to the blank period of the display signal DS such as the period between two frames or the blank time between the renewals of the screen. Herein, the encoded signal ES can be provided by the circuit of the driving module of the passive
matrix display apparatus 12, thereby simplifying the circuit design. - To be noted, when the passive
matrix display apparatus 12 is a bistable display apparatus such as a cholesteric LCD apparatus, the display apparatus needs the display signals only for the screen renewal, so that the encoded signal can be transmitted during the display screen renewal (carried on the display signal) or between the renewals of the display screen (between display signals). Moreover, the passivematrix display apparatus 12 can renew a part of the display screen only, so that the encoded signal can be transmitted along with the renewal of the part of the display screen or between the renewals of the part of the display screen. Or, the passivematrix display apparatus 12 can be a quasi-bistable display apparatus such as an IMOD (interferometric modulator) display apparatus using MEMS to generate light interference. In addition to the display signal for renewing screen, this kind of display apparatus needs a sustaining signal to maintain the screen image even the screen is not renewed. In this case, the encoded signal can be carried on the display signal or the sustaining signal, or between the display signals or sustaining signals. -
FIG. 4 is a schematic diagram showing the signals for two adjacent column electrodes ofFIG. 3B . The encoded signal ES will be described hereinafter with sequential coding in time for one dimension touch input perpendicular to the row electrode as an example. Of course, this method can also be applied to another dimension touch input perpendicular to the column electrode. Consequently, a complete two-dimensional touch input can be built. - In this embodiment, as shown in
FIG. 4 , only one column electrode transmits the encoded signal ES, wherein the encoded signal ES is labeled with a level different from that of the display signal, or, in practice, the encoded signal ES and the display signal may have the same level. In other words, at a specific timing, the column electrode transmits an encoded signal ES1 and a display signal DS1, and at the next timing, the column electrode transmits another encoded signal ES2 and another display signal DS2.FIG. 5 is a timing chart of the encoded signal ES transmitted through each column electrode, wherein the display signals DS for display are omitted. Herein, the column electrodes D1∼DN transmit the encoded signals ES1∼ESN, respectively. To be noted, the encoded signals ES1∼ESN can be transmitted through different column electrodes, respectively, or multiple column electrodes may transmit the same encoded signal. For example, the column electrodes D1∼D3 transmit the encoded signal ES1, and the column electrodes D4∼D6 transmit the encoded signal ES2. This approach may also be applied to the transmission of encoded signals ES through the row electrodes. Alternatively, the encoded signals ES transmitted through the row electrodes and the column electrodes may be an independent coding system, respectively. Since the column electrodes transmit the encoded signals ES sequentially, it is necessary to provide a time reference point for determining the positions of the column electrodes by comparing with the reference point. This reference point can be a specific code and transmitted by the same manner. For example, all column electrodes may output the code "1" twice and then transmit the sequential signal. As mentioned above, if the encoded signal ES coupled to theoperation apparatus 11 is "110010000", it represents that theoperation apparatus 11 is located on the third column electrode, thereby figuring out the coordinate (x-coordinate) of theoperation apparatus 11. Similarly, the y-coordinate of theoperation apparatus 11 can be estimated according to another encoded signal applied to the row electrode. Besides, the duty cycle of the encoded signal ES of this embodiment is smaller than that of the display signal DS, thereby maintaining the display quality. - The above modulation is carried out by amplitude modulation technology, which uses the high-low level of the amplitude for representing "1" and "0" digital signals. Or, it is also possible to use the frequency modulation technology for representing the "1" and "0" digital signals. For example, it can define that five oscillations within a unit time is "1", while other frequencies are all "0". Alternatively, it is also possible to use phase shift modulation technology for representing the digital signals. For example, it can define that one high level plus one low level represents "0", and one low level plus one high level represent "1". Herein, the applied modulation method is not limited. Besides, in order to prevent the interference of the neighbor electrodes, the technology of time division, frequency division or code division can be applied to different electrodes.
- When a user grabs the
operation apparatus 11 and operates it on thedisplay surface 121 of the passive matrix display apparatus 12 (e.g. to contact or approach the display surface 121), the encoded signal ES is coupled capacitively from the passivematrix display apparatus 12 to theoperation apparatus 11. This embodiment takes the column electrodes D1∼DN for transmitting the encoded signals ES as an example, so the column electrode can serve as one of the capacitive coupling electrodes, and theoperation apparatus 11 has the other capacitive coupling electrode. For example, when theoperation apparatus 11 is a stylus, a conductor configured at the tip of the stylus functions as the other capacitive coupling electrode. - After receiving the encoded signal ES through the capacitive coupling, the
operation apparatus 11 processes the received encoded signal ES to generate a transmission signal TS. This process includes amplifying and/or decoding the encoded signal ES so as to determine which column electrode is touched or pressed, or the touch position, or the touch gesture (writing style), or the corresponding function or instruction deduced from the input.. To be noted, the encoded signal ES is capacitively coupled to theoperation apparatus 11, and the value of the capacitance depends on the distance between the operation apparatus and thedisplay surface 121, which means the amplitude of the signal can provide the z-axis information, so that theoperation apparatus 11 can get not only the two-dimensional coordinates but also the z coordinate. Accordingly, the transmission signal TS may denote messages from simple amplification of the encoded signal ES to instructions of the action. - After generating the transmission signal TS, the
operation apparatus 11 can transmit the transmission signal TS to the passivematrix display apparatus 12, other relay apparatus, or other apparatuses outside thevisual interface system 1 through wire, or wireless, or electrical coupling (including capacitive or inductive coupling) or optical coupling. In this embodiment, the transmission signal TS is directly transmitted to the passivematrix display apparatus 12. - When this invention is applied to other non-touch input applications, the information to be transmitted is encoded to generate an encoded signal ES based on a specific coding rule, and then the encoded signal ES is capacitive coupled from the passive matrix display apparatus 12 (e.g. configured as a cell phone or tablet computer) to the operation apparatus 11 (e.g. short distance wireless reading apparatus attached on the wall). Similarly, the
operation apparatus 11 can process (decodes or modifies) the encoded signal ES based on the preset coding rule so as to obtain the transmission signal TS, and then uses the transmission signal TS on the corresponding application such as access control, payment, financial transaction, file transmission, and the likes. - In the above embodiment, the
operation apparatus 11 processes the encoded signal ES to obtain the information contained in the transmission signal TS such as the touch input information, instruction information, identification information, transaction information, file information or other information. In other embodiments, the passivematrix display apparatus 12 may process the transmission signal TS to obtain information, which contains the touch input information, instruction information, identification information, transaction information, file information or other information. The touch input information may include the relative position information of theoperation apparatus 11 on thedisplay surface 121, wherein this relative position information is a signal outputted from thefirst substrate 122 and thesecond substrate 123 of the passivematrix display apparatus 12. - As mentioned above, referring to
FIG. 1 , in the procedures of coupling the encoded signal ES to theoperation apparatus 11 to generate the transmission signal TS and transmitting the transmission signal TS to the passivematrix display apparatus 12 to obtain the information, the signal is gone through the processes, for example, amplification and decoding, which can be handled by either one of theoperation apparatus 11 and the passivematrix display apparatus 12 or among these units. The resulting transmission signal TS can contain the touch input information, instruction information, identification information, transaction information, file information or other information. The information obtained by the passivematrix display apparatus 12 may also contain the touch input information, instruction information, identification information, transaction information, file information or other information. - Besides, a response signal RS can also be transmitted between the
operation apparatus 11 and the passivematrix display apparatus 12. Herein, the response signal RS is for providing the information of the receiving status of theoperation apparatus 11 to the passivematrix display apparatus 12, or for announcing theoperation apparatus 11 to get ready for receiving the signal, or synchronizing theoperation apparatus 11 and the passivematrix display apparatus 12. This configuration can create an interactive mechanism between the transmitting and receiving signals. Moreover, the response signal RS can provide the synchronization function for establishing an information handshaking procedure between theoperation apparatus 11 and the passivematrix display apparatus 12. -
FIG. 6 is a perspective view of the passivematrix display apparatus 12 according to the first embodiment of the invention. - Referring to
FIG. 6 , thevisual interface system 1 further includes amode trigger device 127. When a user or the operation apparatus triggers themode trigger device 127, themode trigger device 127 can enable the passivematrix display apparatus 12 into an operating mode to output the encoded signal ES. For example, when the user needs the touch input function, he/she activates the mode trigger device 127 (e.g. pushes the button) so as to enable the passivematrix display apparatus 12 into the touch input mode. Then, the row electrode or column electrode starts to transmit the encoded signal. Or, the passivematrix display apparatus 12 does not enter the touch input mode and the touch input function of the passivematrix display apparatus 12 may be partially or totally shut down. This function can save power and prevent the system to misinterpret the actions caused by unintentionally contacting the screen. To be noted, the operation of themode trigger device 127 may have different operation modes. For example, after been activated, themode trigger device 127 may remain in the new state for a while and then return to the original state, or it may change the state each time after being activated. Or, themode trigger device 127 may remain in the new state only when the activation lasts. Besides, themode trigger device 127 can be configured on the operation apparatus 11 (e.g. a switch on the stylus). In this case, when themode trigger device 127 is activated, theoperation apparatus 11 transmits a trigger signal to the passivematrix display apparatus 12 to enter the touch input mode. To be noted, themode trigger device 127 can be triggered once or continuously for switching to the touch input function. Taking the access card, ticket, credit card or file transmission as examples, the user can trigger themode trigger device 127 to transmit the encoded signal for authorization or personal identification to the corresponding data receiving device. Themode trigger device 127 can be, for example, a mechanical switch, a touch sensing switch, or the likes. -
FIG. 7 is a schematic diagram showing the passivematrix display apparatus 12 and a user, as theoperation apparatus 11, according to the first embodiment of the invention. - In this aspect, the
visual interface system 1 further includes asensing device 128, which is electrically coupled with the passivematrix display apparatus 12. When the user touches or approaches thedisplay surface 121 and thesensing device 128 of the passivematrix display apparatus 12 simultaneously, the transmission signal TS is transmitted to the passivematrix display apparatus 12. That is, the user serves as a large conductor for transmitting the transmission signal TS to the passivematrix display apparatus 12. In practice, the user can use his/her right hand to operate on thedisplay surface 121, while use the left hand to press thesensing device 128. Accordingly, the encoded signal ES can enter the user body through the right hand, and the transmission signal TS can be outputted from the left hand. The transmitted information can be obtained by analyze the transmission signal TS received by thesensing device 128. Thesensing device 128 may also contain the function of themode trigger device 127. For example, only when thesensing device 128 is pressed by the left hand, the operation mode will be enabled. This specific function can sufficiently reduce the power consumption and the problem of unintentional touch. -
FIG. 8 is a block diagram of a visual interface system 1a according to a second embodiment of the invention. - The visual interface system 1a includes an
operation apparatus 11 and a passivematrix display apparatus 12. - Different from the first embodiment, the visual interface system 1a further includes at least one
relay apparatus 13, and the transmission signal TS is transmitted to the passivematrix display apparatus 12 or other apparatuses outside the visual interface system 1a through therelay apparatus 13. In this aspect, the user's hand is used to transmit the transmission signal TS to therelay apparatus 13, and a relay processed signal IS generated by processing the transmission signal TS is then transmitted back to the passivematrix display apparatus 12. This aspect is only for illustrations and, of course, it is possible to configure multiple relay apparatuses. Besides, when theoperation apparatus 11 is a user, the user can transmit the transmission signal TS to therelay apparatus 13, wherein the signals are not transmitted back to the passivematrix display apparatus 12. Herein, therelay apparatus 13 can be a portable communication device such as a cell phone. Accordingly, the user can be the transmission media for conducting the encoded signal ES outputted from the passivematrix display apparatus 12 to therelay apparatus 13 in order to transfer the file information. - The
relay apparatus 13 can process the transmission signal TS to generate a relay processed signal IS and then transmit the relay processed signal IS to the passivematrix display apparatus 12. In the procedures of coupling the encoded signal ES to theoperation apparatus 11 to generate the transmission signal TS, processing the transmission signal TS by therelay apparatus 13 to generate the relay processed signal IS, and transmitting the relay processed signal IS to the passivematrix display apparatus 12 to obtain the information, the signal is processed by, for example, amplification, decoding, modifying and/or interpretation, which can be implemented by either one of theoperation apparatus 11, the passivematrix display apparatus 12 and therelay apparatus 13 or among these units. Accordingly, the transmission signal TS or the relay processed signal IS can contain the touch input information, instruction information, identification information, transaction information, file information or other information. - Besides, the response signal RS of the first embodiment can also be applied to the
operation apparatus 11, and/or therelay apparatus 13 and/or the passivematrix display apparatus 12 of the second embodiment, thereby creating an interactive mechanism between the transmitting and receiving signals. Moreover, the response signal RS can provide the synchronization function for establishing an information handshaking procedure between theoperation apparatus 11, therelay apparatus 13 and the passivematrix display apparatus 12. - In the visual interface system of the invention, when the operation apparatus is operated on the display surface of the passive matrix display apparatus, the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal. In the example of touch input operation, the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus. During this transmission procedure, the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
- As mentioned above, the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together. Thus, the manufactured products can be lighter and thinner and the product cost can be reduced, thereby improving the product competitiveness. Moreover, the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus. For example, regarding to the touch input application, it is unnecessary to add the capacitance sensing component in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and time.
- Although the invention has been described with reference to specific embodiments, this description is not meant to be construed in a limiting sense. Various modifications of the disclosed embodiments, as well as alternative embodiments, will be apparent to persons skilled in the art. It is, therefore, contemplated that the appended claims will cover all modifications that fall within the true scope of the invention.
Claims (17)
- A visual interface system, comprising:an operation apparatus; anda passive matrix display apparatus, comprising:a first substrate,a display surface located at a first side of the first substrate, anda second substrate disposed opposite to the first substrate and located at a second side of the first substrate relatively opposite to the first side;wherein, when the operation apparatus is operated on the display surface of the passive matrix display apparatus, an encoded signal is coupled to the operation apparatus from the passive matrix substrate, and the operation apparatus receives the encoded signal to obtain a transmission signal.
- The visual interface system of claim 1, wherein the transmission signal is transmitted to the passive matrix display apparatus.
- The visual interface system of claim 1, wherein the passive matrix display apparatus has at least an electrode disposed on the first substrate or the second substrate, and the encoded signal is applied to the electrode and is then capacitively or inductively coupled to the operation apparatus from the electrode.
- The visual interface system of claim 3, wherein the electrode is a separate electrode or one of a plurality of electrodes of the passive matrix display apparatus.
- The visual interface system of claim 3, wherein the passive matrix display apparatus processes the transmission signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information.
- The visual interface system of claim 5, wherein the touch input information includes relative position information of the operation apparatus on the display surface, and the transmission signal is outputted from the first substrate and the second substrate.
- The visual interface system of claim 1, further comprising:at least a relay apparatus for processing the transmission signal to generate a relay processed signal.
- The visual interface system of claim 7, wherein the relay processed signal is transmitted to the passive matrix display apparatus.
- The visual interface system of claim 7, wherein the transmission signal comprises touch input information, instruction information, identification information, transaction information, or file information.
- The visual interface system of claim 7, wherein the relay processed signal comprises touch input information, instruction information, identification information, transaction information, or file information.
- The visual interface system of claim 8, wherein the passive matrix display apparatus processes the relay processed signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information.
- The visual interface system of claim 1 or 7, further comprising:a mode trigger device for enabling the passive matrix display apparatus into an operating mode to output the encoded signal when the mode trigger device is triggered by a user or the operation apparatus.
- The visual interface system of claim 1 or 7, wherein when the operation apparatus is a user, the visual interface system further comprises a sensing device, and then when the user touches the display surface and the sensing device simultaneously, the transmission signal is transmitted to the sensing device.
- The visual interface system of claim 13, wherein the sensing device has a mode trigger function, so the sensing device enables the passive matrix display apparatus into an operating mode to output the encoded signal as the user touches the sensing device.
- The visual interface system of claim 1, wherein the passive matrix display apparatus further comprises a display medium layer disposed between the first substrate and the second substrate.
- The visual interface system of claim 1, wherein the passive matrix display apparatus further comprises:a plurality of column electrodes disposed at the second side of the first substrate; anda plurality of row electrodes disposed at one side of the second substrate facing the first substrate, wherein the column electrodes and the row electrodes are intersected.
- The visual interface system of claim 1, wherein the encoded signal is transmitted as the display screen of the passive matrix display apparatus is renewing or between the renewals of the display screen of the passive matrix display apparatus.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2011/079576 WO2013037103A1 (en) | 2011-09-13 | 2011-09-13 | Visual interface system |
PCT/CN2012/078412 WO2013037238A1 (en) | 2011-09-13 | 2012-07-10 | Visual interface system |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2757445A1 true EP2757445A1 (en) | 2014-07-23 |
EP2757445A4 EP2757445A4 (en) | 2015-07-15 |
EP2757445B1 EP2757445B1 (en) | 2017-10-04 |
Family
ID=47882523
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11872370.9A Not-in-force EP2757444B1 (en) | 2011-09-13 | 2011-09-13 | Visual interface system |
EP12831451.5A Not-in-force EP2757445B1 (en) | 2011-09-13 | 2012-07-10 | Visual interface system |
EP12831883.9A Active EP2757538B1 (en) | 2011-09-13 | 2012-09-10 | Electronic apparatus and data transmission system |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11872370.9A Not-in-force EP2757444B1 (en) | 2011-09-13 | 2011-09-13 | Visual interface system |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12831883.9A Active EP2757538B1 (en) | 2011-09-13 | 2012-09-10 | Electronic apparatus and data transmission system |
Country Status (7)
Country | Link |
---|---|
US (4) | US20140340340A1 (en) |
EP (3) | EP2757444B1 (en) |
JP (3) | JP6142149B2 (en) |
KR (3) | KR101662413B1 (en) |
CN (3) | CN103797448B (en) |
TW (2) | TWI592841B (en) |
WO (3) | WO2013037103A1 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013174186A1 (en) | 2012-05-25 | 2013-11-28 | Tsai Hsiung-Kuang | Non-display signal coding method and matrix substrate |
CN102916729B (en) * | 2012-09-04 | 2014-12-10 | 深圳市汇顶科技股份有限公司 | Near-field communication method and system of touch panel terminal as well as touch panel terminal |
CN104769523B (en) * | 2012-11-06 | 2018-07-13 | 惠普发展公司,有限责任合伙企业 | Interactive display |
CN103176655B (en) * | 2013-03-13 | 2016-05-25 | 北京京东方光电科技有限公司 | A kind of driving method of touch display and device |
US9582186B2 (en) * | 2013-12-20 | 2017-02-28 | Mediatek Inc. | Signature verification between a mobile device and a computing device |
US20160104370A1 (en) | 2014-10-14 | 2016-04-14 | Logitech Europe S.A | Method of controlling an electronic device |
JP2020030884A (en) * | 2016-12-26 | 2020-02-27 | コニカミノルタ株式会社 | Passive matrix type organic electroluminescent display and touch detection method |
US20210014674A1 (en) * | 2019-07-11 | 2021-01-14 | Slim Hmi Technology | Secure interaction system and communication display device |
TWI726488B (en) | 2019-11-19 | 2021-05-01 | 元太科技工業股份有限公司 | Proximity smart card and a method for operating a proximity smart card |
KR20220091700A (en) | 2020-12-23 | 2022-07-01 | 삼성디스플레이 주식회사 | Electronic device |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040262051A1 (en) * | 2003-06-26 | 2004-12-30 | International Business Machines Corporation | Program product, system and method for creating and selecting active regions on physical documents |
US20110007037A1 (en) * | 2009-07-07 | 2011-01-13 | Panasonic Corporation | Electronic pen and electronic pen system |
US20110109568A1 (en) * | 2009-11-09 | 2011-05-12 | Hung-Wei Wu | Touch display device |
Family Cites Families (54)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0738152B2 (en) * | 1986-09-25 | 1995-04-26 | 三菱電機株式会社 | Display device |
JPH03294919A (en) * | 1990-04-12 | 1991-12-26 | Nippon Telegr & Teleph Corp <Ntt> | Display device with tablet function |
US5117071A (en) * | 1990-10-31 | 1992-05-26 | International Business Machines Corporation | Stylus sensing system |
JPH06230884A (en) * | 1993-02-03 | 1994-08-19 | Matsushita Electric Ind Co Ltd | Coordinate input device |
US5491706A (en) * | 1993-04-07 | 1996-02-13 | Sharp Kabushiki Kaisha | Display-integrated type tablet device capable of detecting correct coordinates at a tip end of a detection pen by detecting external noise |
JP3421078B2 (en) * | 1993-05-07 | 2003-06-30 | シャープ株式会社 | Information input / output device |
JPH0720421A (en) * | 1993-06-29 | 1995-01-24 | Asahi Glass Co Ltd | Liquid crystal display element |
JP2653014B2 (en) * | 1993-07-26 | 1997-09-10 | 日本電気株式会社 | Active matrix liquid crystal display device |
JPH08106358A (en) * | 1994-08-10 | 1996-04-23 | Fujitsu Ltd | Liquid crystal display device with tablet function, active matrix type liquid crystal display device, and driving method for liquid crystal display device with tablet function |
JP4939682B2 (en) | 1999-04-27 | 2012-05-30 | エーユー オプトロニクス コーポレイション | Display device |
JP2001075074A (en) * | 1999-08-18 | 2001-03-23 | Internatl Business Mach Corp <Ibm> | Touch sensor type liquid crystal display device |
JP2001144661A (en) * | 1999-11-17 | 2001-05-25 | Sony Corp | Data transmitter and data receiver |
JP3319462B2 (en) * | 2000-06-26 | 2002-09-03 | 松下電工株式会社 | Data transmission system using human body as signal transmission path |
JP2002366051A (en) * | 2001-06-08 | 2002-12-20 | Sanyo Electric Co Ltd | Integrated circuit chip and display device using the same |
JP2004005415A (en) * | 2002-04-19 | 2004-01-08 | Sharp Corp | Input device and input/output integrated display |
JP3966069B2 (en) * | 2002-05-02 | 2007-08-29 | セイコーエプソン株式会社 | Data communication device and portable watch |
JP3794411B2 (en) * | 2003-03-14 | 2006-07-05 | セイコーエプソン株式会社 | Display device and electronic device |
JP5008823B2 (en) * | 2004-03-19 | 2012-08-22 | シャープ株式会社 | Display device |
WO2005096772A2 (en) * | 2004-04-01 | 2005-10-20 | Finepoint Innovations, Inc. | Surface and cordless transducer system |
US20060000893A1 (en) * | 2004-07-01 | 2006-01-05 | American Express Travel Related Services Company, Inc. | Method for biometric security using a smartcard-reader |
US7657242B2 (en) * | 2004-09-27 | 2010-02-02 | Qualcomm Mems Technologies, Inc. | Selectable capacitance circuit |
JP2006127190A (en) * | 2004-10-29 | 2006-05-18 | Citizen Watch Co Ltd | Input device |
US20060094411A1 (en) | 2004-10-29 | 2006-05-04 | Dupont Pierre B | Mobile station telephony service applications for mobile station having integrated transponder readers |
CN100374995C (en) * | 2004-11-08 | 2008-03-12 | 英华达(南京)科技有限公司 | Handwriting pen and handwriting pen system and control method thereof |
JP2006195925A (en) * | 2005-01-17 | 2006-07-27 | Nippon Signal Co Ltd:The | Touch panel device |
WO2006087670A1 (en) | 2005-02-17 | 2006-08-24 | Koninklijke Philips Electronics N.V. | Device capable of being operated within a network, network system, method of operating a device within a network, program element, and computer-readable medium |
JP2006238328A (en) | 2005-02-28 | 2006-09-07 | Sony Corp | Conference system, conference terminal and portable terminal |
CN2785540Y (en) * | 2005-04-21 | 2006-06-07 | 周常安 | Hand held device for physiological signal measuring and wireless transmission and receiving apparatus |
CN101017419B (en) * | 2005-06-30 | 2010-05-12 | 智点科技(深圳)有限公司 | Touch control panel display |
CN1716018A (en) * | 2005-07-14 | 2006-01-04 | 深圳市联思精密机器有限公司 | Plane display with touch control function |
CN1904812A (en) * | 2005-07-29 | 2007-01-31 | 姚华 | Touch pen usable for display screen of common computer |
KR100862578B1 (en) * | 2006-05-16 | 2008-10-09 | 엘지전자 주식회사 | Plasma Display Apparatus |
US20090275283A1 (en) | 2006-08-29 | 2009-11-05 | Zhao Zhuyan | Use of intra-body communication |
US7777719B2 (en) * | 2007-01-19 | 2010-08-17 | Nokia Corporation | System using a living body as a transmission medium |
WO2008098398A2 (en) * | 2007-02-14 | 2008-08-21 | Kaba Ag | System and portable device for transmitting identification signals |
CN201707209U (en) * | 2007-03-09 | 2011-01-12 | 营口方舟科技有限公司 | Wrist strap display |
EP2056186A1 (en) | 2007-10-26 | 2009-05-06 | Research In Motion Limited | Touch screen and electronic device |
JP2009146088A (en) * | 2007-12-13 | 2009-07-02 | Hitachi Displays Ltd | Capacitive coupling-type signal transmission/reception circuit |
JP2009253478A (en) * | 2008-04-02 | 2009-10-29 | Sony Ericsson Mobilecommunications Japan Inc | Information communication device and control method of information communication device |
CN102112950B (en) * | 2008-09-12 | 2015-01-28 | 奥博特瑞克斯株式会社 | Electrostatic capacity type touch panel, display device, and electrostatic capacity type touch panel manufacturing method |
US8482545B2 (en) * | 2008-10-02 | 2013-07-09 | Wacom Co., Ltd. | Combination touch and transducer input system and method |
TWM364503U (en) * | 2009-03-23 | 2009-09-11 | Astek Technology Ltd | Wireless ring-type physiological detector |
KR20120036880A (en) * | 2009-05-27 | 2012-04-18 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Touch- or proximity-sensitive interface |
JP2010286895A (en) * | 2009-06-09 | 2010-12-24 | Toshiba Tec Corp | Information input device and information processor |
KR101562565B1 (en) * | 2009-06-25 | 2015-10-22 | 삼성전자주식회사 | A method for transmitting and receiving data using E-Field in a portable terminal and an apparatus thereof |
TWM371930U (en) * | 2009-06-29 | 2010-01-01 | Ming-Chang Wu | Prompt system for object sensing |
CN101943978B (en) | 2009-07-06 | 2012-12-26 | 弗莱克斯电子有限责任公司 | Capacitive touch screen panel and its manufacturing method, and capacitive touch sensor |
KR20110027572A (en) * | 2009-09-08 | 2011-03-16 | 한국전자통신연구원 | Apparatus for communication using near field |
US20110059692A1 (en) * | 2009-09-08 | 2011-03-10 | Electronics And Telecommunications Research Institute | Communications device using near field |
KR101351413B1 (en) * | 2009-12-11 | 2014-01-14 | 엘지디스플레이 주식회사 | Touch Panel and Liquid Crystal Display Device Including Touch Panel |
KR101107171B1 (en) * | 2010-02-11 | 2012-01-25 | 삼성모바일디스플레이주식회사 | Apparatus for touch sensing, display device and operating method for the same |
JP5440376B2 (en) * | 2010-05-18 | 2014-03-12 | 日本電気株式会社 | Touch sensor, touch panel, and information transmission method using the touch sensor |
CN201828896U (en) | 2010-09-27 | 2011-05-11 | 南京点面光电有限公司 | Capacitance type touch screen |
CN102073409A (en) * | 2010-12-29 | 2011-05-25 | 广东中显科技有限公司 | Touch screen |
-
2011
- 2011-09-13 JP JP2014528827A patent/JP6142149B2/en not_active Expired - Fee Related
- 2011-09-13 EP EP11872370.9A patent/EP2757444B1/en not_active Not-in-force
- 2011-09-13 US US14/344,462 patent/US20140340340A1/en not_active Abandoned
- 2011-09-13 CN CN201180073433.4A patent/CN103797448B/en not_active Expired - Fee Related
- 2011-09-13 KR KR1020147007411A patent/KR101662413B1/en active IP Right Grant
- 2011-09-13 WO PCT/CN2011/079576 patent/WO2013037103A1/en active Application Filing
-
2012
- 2012-07-04 TW TW101124093A patent/TWI592841B/en not_active IP Right Cessation
- 2012-07-10 EP EP12831451.5A patent/EP2757445B1/en not_active Not-in-force
- 2012-07-10 KR KR1020147007412A patent/KR101641802B1/en active IP Right Grant
- 2012-07-10 JP JP2014530079A patent/JP6033308B2/en not_active Expired - Fee Related
- 2012-07-10 WO PCT/CN2012/078412 patent/WO2013037238A1/en active Application Filing
- 2012-07-10 US US14/344,596 patent/US9335849B2/en active Active
- 2012-07-10 CN CN201280044536.2A patent/CN103797450B/en not_active Expired - Fee Related
- 2012-09-10 EP EP12831883.9A patent/EP2757538B1/en active Active
- 2012-09-10 WO PCT/CN2012/081171 patent/WO2013037281A1/en active Application Filing
- 2012-09-10 US US14/344,056 patent/US9489071B2/en active Active
- 2012-09-10 KR KR1020147008929A patent/KR101570309B1/en active IP Right Grant
- 2012-09-10 CN CN201280044584.1A patent/CN103827934B/en not_active Expired - Fee Related
- 2012-09-10 JP JP2014528845A patent/JP5951775B2/en not_active Expired - Fee Related
- 2012-09-10 TW TW101132960A patent/TWI485565B/en not_active IP Right Cessation
-
2017
- 2017-04-17 US US15/488,965 patent/US20170220190A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040262051A1 (en) * | 2003-06-26 | 2004-12-30 | International Business Machines Corporation | Program product, system and method for creating and selecting active regions on physical documents |
US20110007037A1 (en) * | 2009-07-07 | 2011-01-13 | Panasonic Corporation | Electronic pen and electronic pen system |
US20110109568A1 (en) * | 2009-11-09 | 2011-05-12 | Hung-Wei Wu | Touch display device |
Non-Patent Citations (2)
Title |
---|
None * |
See also references of WO2013037238A1 * |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9335849B2 (en) | Visual interface system | |
TWI494798B (en) | Active stylus | |
KR101471845B1 (en) | Display device with input system and method for driving the same | |
US10185448B2 (en) | Touch control liquid crystal display device and electronic apparatus | |
EP3144784B1 (en) | Mobile terminal and control method for the mobile terminal | |
CN103309495A (en) | Display device with integrated touch screen | |
KR102286893B1 (en) | Touch Display Device | |
EP3271914A1 (en) | Providing content to electronic paper display devices | |
KR20130069087A (en) | Liquid crystal display device with interred touch screen and method for driving the same | |
JP6033310B2 (en) | Driving method of vision interface system | |
TWI499917B (en) | Visual interface apparatus and data transfer system | |
US20180373387A1 (en) | Visual interface system | |
US20200004375A1 (en) | Visual interface system | |
TWI492110B (en) | Visual interface system | |
CN106445127A (en) | Method and system for terminal control |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20140320 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
RA4 | Supplementary search report drawn up and despatched (corrected) |
Effective date: 20150612 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04W 4/00 20090101ALI20150608BHEP Ipc: G06F 3/044 20060101AFI20150608BHEP Ipc: G06F 3/041 20060101ALI20150608BHEP |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SLIM HMI TECHNOLOGY |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: TSAI HSIUNG-KUANG |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20170421 |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: TSAI HSIUNG-KUANG |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 934614 Country of ref document: AT Kind code of ref document: T Effective date: 20171015 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602012038233 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20171004 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 934614 Country of ref document: AT Kind code of ref document: T Effective date: 20171004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180104 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180104 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180105 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20180204 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602012038233 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
26N | No opposition filed |
Effective date: 20180705 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180710 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20180731 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180710 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20180710 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20120710 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 Ref country code: MK Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171004 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20171004 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20210723 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20210722 Year of fee payment: 10 Ref country code: DE Payment date: 20210720 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602012038233 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20220710 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220731 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20220710 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230201 |