EP2757445A1 - Visual interface system - Google Patents

Visual interface system Download PDF

Info

Publication number
EP2757445A1
EP2757445A1 EP12831451.5A EP12831451A EP2757445A1 EP 2757445 A1 EP2757445 A1 EP 2757445A1 EP 12831451 A EP12831451 A EP 12831451A EP 2757445 A1 EP2757445 A1 EP 2757445A1
Authority
EP
European Patent Office
Prior art keywords
passive matrix
display apparatus
substrate
information
matrix display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP12831451.5A
Other languages
German (de)
French (fr)
Other versions
EP2757445B1 (en
EP2757445A4 (en
Inventor
Hsiung-Kuang Tsai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Slim Hmi Technology
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of EP2757445A1 publication Critical patent/EP2757445A1/en
Publication of EP2757445A4 publication Critical patent/EP2757445A4/en
Application granted granted Critical
Publication of EP2757445B1 publication Critical patent/EP2757445B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H04B5/72
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14Handling requests for interconnection or transfer
    • G06F13/20Handling requests for interconnection or transfer for access to input/output bus
    • G06F13/28Handling requests for interconnection or transfer for access to input/output bus using burst mode transfer, e.g. direct memory access DMA, cycle steal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0412Digitisers structurally integrated in a display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04166Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G06F3/0446Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/046Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/041012.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup

Definitions

  • the present invention relates to a human-machine interface system and, in particular, to a visual interface system.
  • touch panels have been widely applied to the commercial electronic products such as smart phones, digital cameras, MP3, PDA, GPS, tablet PC, UMPC, and the likes.
  • the touch panel is bound with a screen to form a touch input display apparatus.
  • NFC near field communication
  • An objective of the present invention is to provide a visual interface system that can achieve the touch input function without configuring an additional touch panel, and is equipped with a near field communication (NFC) function.
  • NFC near field communication
  • the present invention can be implemented by the following technical proposals.
  • a visual interface system of the invention includes an operation apparatus and a passive matrix display apparatus.
  • the passive matrix display apparatus includes a first substrate, a display surface and a second substrate.
  • the display surface is located at a first side of the first substrate.
  • the second substrate is disposed opposite to the first substrate and located at a second side of the first substrate relatively opposite to the first side.
  • the transmission signal is transmitted to the passive matrix display apparatus.
  • the passive matrix display apparatus has at least an electrode disposed on the first substrate or the second substrate, and the encoded signal is applied to the electrode and is then capacitive or inductive coupled to the operation apparatus from the electrode.
  • the electrode is a separate electrode or one of a plurality of electrodes of the passive matrix display apparatus.
  • the passive matrix display apparatus processes the transmission signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information.
  • the touch input information includes relative position information of the operation apparatus on the display surface.
  • the visual interface system further includes at least a relay apparatus for processing the transmission signal to generate a relay processed signal.
  • the relay processed signal can be transmitted to the passive matrix display apparatus or other apparatuses outside the visual interface system.
  • the transmission signal includes touch input information, instruction information, identification information, transaction information, file information or other information.
  • the relay processed signal comprises touch input information, instruction information, identification information, transaction information, file information or other information.
  • the passive matrix display apparatus or another apparatus outside the visual interface system processes the relay processed signal to obtain information including touch input information, instruction information, identification information, transaction information, file information or other information.
  • the visual interface system further includes a mode trigger device for enabling the passive matrix display apparatus into an operating mode to output the encoded signal as the mode trigger device is triggered by a user or the operation apparatus.
  • the visual interface system when the operation apparatus is a user, the visual interface system further includes a sensing device, and then when the user touches the display surface and the sensing device simultaneously, the transmission signal is transmitted to the sensing device.
  • the sensing device has a mode trigger function, so the sensing device enables the passive matrix display apparatus into an operating mode to output the encoded signal as the user touches the sensing device.
  • the passive matrix display apparatus further includes a display medium layer disposed between the first substrate and the second substrate.
  • the passive matrix display apparatus further includes a plurality of column electrodes disposed at the second side of the first substrate and a plurality of row electrodes disposed at one side of the second substrate facing the first substrate.
  • the column electrodes and the row electrodes are intersected.
  • the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal.
  • the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus.
  • the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
  • the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together.
  • the manufactured products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness.
  • the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus.
  • the touch input application it is unnecessary to add the capacitance sensing components in the display panel for detecting the change of external capacitance values.
  • the present invention can decrease the manufacturing cost and shrink the process time.
  • FIG. 1 is a block diagram of a visual interface system 1 according to a first embodiment of the invention.
  • the visual interface system 1 includes an operation apparatus 11 and a passive matrix display apparatus 12 coupled with each other by, for example, capacitive or inductive coupling for transmitting signals.
  • the signal transmission between the operation apparatus 11 and the passive matrix display apparatus 12 is a non-contact signal transmission (wireless).
  • the operation apparatus 11 is, for example, a stylus, a conductor, an IC card, an NFC reading apparatus, or a user (especially the finger of a user).
  • the operation apparatus 11 is an electronic apparatus, it may include some functional circuits such as a process control circuit, a storage circuit or a transmission circuit.
  • any circuit can be composed of hardware, software or firmware, or their combinations.
  • the operation apparatus 11 is a user, the user (operation apparatus) can serve as a conductor for transmitting signals.
  • the passive matrix display apparatus 12 can be, for example, a passive matrix LCD, a touch input display apparatus, a non-volatile type display apparatus, or a passive matrix OLED display apparatus.
  • FIG. 2 is a side view of the passive matrix display apparatus 12 of FIG. 1 .
  • the passive matrix display apparatus 12 includes a display surface 121, a first substrate 122 and a second substrate 123.
  • the display surface 121 is located at a first side P1 of the first substrate 122.
  • the second substrate 123 is disposed opposite to the first substrate 122 and located at a second side P2 of the first substrate 122 relatively opposite to the first side P1.
  • the display surface 121 is the surface of the passive matrix display apparatus 12, which is closest to the viewer when the viewer is watching the images displayed on the passive matrix display apparatus 12.
  • the first substrate 122 and the second substrate 123 can be glass substrates.
  • the passive matrix display apparatus 12 may further include a protect glass 124 disposed on the first side P1 of the first substrate 122.
  • the display surface 121 is the surface of the protect glass 124 closest to the viewer.
  • the passive matrix display apparatus 12 may further include a display medium layer 125 disposed between the first substrate 122 and the second substrate 123.
  • the display medium layer 125 is a liquid crystal layer.
  • the LCD apparatus further includes alignment layers, polarizer, color filter layer, backlight or other components.
  • the passive matrix display apparatus 12 is a non-volatile type display apparatus
  • the display medium layer 125 can be an electrophoretic layer.
  • the non-volatile type display apparatus may further include other components such as an accommodating structure.
  • the passive matrix display apparatus 12 is an OLED display apparatus
  • the display medium layer 125 is an organic light emitting layer. In this case, the passive matrix display apparatus 12 may further include other components such as a color filter layer.
  • an encoded signal ES is wirelessly coupled to the operation apparatus 11 (by capacitive or inductive coupling) from the passive matrix display apparatus 12, and the operation apparatus 11 receives the encoded signal ES so as to generate a transmission signal TS.
  • the encoded signal ES contains the coordinate of the touch position of the operation apparatus 11 on the display screen of the passive matrix display apparatus 12, and the transmission signal TS contains the coordinate information.
  • the encoded signal ES is transmitted form the passive matrix display apparatus 12 to the operation apparatus 11, they are wirelessly transmitted so as to form a near field signal transmission.
  • the encoded signal ES can be composed of any information to be transmitted such as touch input information, instruction information, identification information, transaction information, or file information (e.g. music, images, texts, and etc.), so that the transmission signal TS contains the corresponding information.
  • the encoded signal ES can be applied to at least one electrode on the passive matrix display apparatus 12. This electrode can be disposed on the first substrate 122 or the second substrate 123. The encoded signal ES is applied to this electrode and then capacitively or inductively coupled to the operation apparatus 11 through the electrode. Besides, additional display data signal are applied to the passive matrix display apparatus 12 for displaying images. The encoded signal ES can be applied during the blanking time of the display signals.
  • the encoded signal ES can be applied between two frames or between the signal transmissions of two row or column electrodes, or during the period generated by shortening the duration of the display signals, or the encoded signal ES can have a higher frequency and be directly added to the display signal, or it can be applied between the renewals of the display screen.
  • FIG. 3A is a perspective diagram showing the passive matrix display apparatus 12 of FIG. 2
  • FIG. 3B is a schematic diagram showing the intersected column electrodes and row electrodes of FIG. 3A .
  • FIG. 3B only shows the column electrodes and the row electrodes of the passive matrix display apparatus 12 of FIG. 3A , while the first substrate 122, the second substrate 123 and the display medium layer 125 of the passive matrix display apparatus 12 are not shown in FIG. 3B .
  • the passive matrix display apparatus 12 is an OLED display apparatus for example, and the display medium layer 125 is an organic light emitting layer.
  • the passive matrix display apparatus 12 further includes a plurality of column electrodes D 1 ⁇ D N and a plurality of row electrodes S 1 ⁇ S M .
  • the column electrodes D 1 ⁇ D N are disposed at the second side P2 of the first substrate 122, while the row electrodes S 1 ⁇ S M are disposed at one side of the second substrate 123 facing the first substrate 122.
  • the column electrodes D 1 ⁇ D N and the row electrodes S 1 ⁇ S M are intersected, and they are substantially perpendicular to each other or have an included angle.
  • the passive matrix display apparatus 12 further includes a driving module (not shown) for driving the passive matrix display apparatus 12 to display image.
  • the driving module can drive the selected row and column electrodes for lighting the display medium layer 125 located at the cross of the row and column electrodes so as to display image. Since the driving method of the driving module and the passive matrix display apparatus 12 is a well-known conventional technology, the detailed description thereof will be omitted here.
  • the point of this embodiment is in that the column electrodes D 1 ⁇ D N and/or the row electrodes S 1 ⁇ S M transmit the encoded signal ES from the passive matrix display apparatus 12 to the operation apparatus 11 so as to generate the transmission signal TS.
  • the encoded signal may carry various information for different applications, such as, the reference coordinates of the display screen of the passive matrix display apparatus 12, the file information of different formats (e.g. personal data, music, images, and etc.), and the likes.
  • the column electrodes D 1 ⁇ D N can transmit not only the data signals for displaying images but also the encoded signal ES.
  • the encoded signal ES with higher frequency can be directly added to the display signal DS or be added to the blank period of the display signal DS such as the period between two frames or the blank time between the renewals of the screen.
  • the encoded signal ES can be provided by the circuit of the driving module of the passive matrix display apparatus 12, thereby simplifying the circuit design.
  • the passive matrix display apparatus 12 when the passive matrix display apparatus 12 is a bistable display apparatus such as a cholesteric LCD apparatus, the display apparatus needs the display signals only for the screen renewal, so that the encoded signal can be transmitted during the display screen renewal (carried on the display signal) or between the renewals of the display screen (between display signals). Moreover, the passive matrix display apparatus 12 can renew a part of the display screen only, so that the encoded signal can be transmitted along with the renewal of the part of the display screen or between the renewals of the part of the display screen. Or, the passive matrix display apparatus 12 can be a quasi-bistable display apparatus such as an IMOD (interferometric modulator) display apparatus using MEMS to generate light interference.
  • IMOD interferometric modulator
  • this kind of display apparatus needs a sustaining signal to maintain the screen image even the screen is not renewed.
  • the encoded signal can be carried on the display signal or the sustaining signal, or between the display signals or sustaining signals.
  • FIG. 4 is a schematic diagram showing the signals for two adjacent column electrodes of FIG. 3B .
  • the encoded signal ES will be described hereinafter with sequential coding in time for one dimension touch input perpendicular to the row electrode as an example.
  • this method can also be applied to another dimension touch input perpendicular to the column electrode. Consequently, a complete two-dimensional touch input can be built.
  • FIG. 4 only one column electrode transmits the encoded signal ES, wherein the encoded signal ES is labeled with a level different from that of the display signal, or, in practice, the encoded signal ES and the display signal may have the same level.
  • the column electrode transmits an encoded signal ES1 and a display signal DS1, and at the next timing, the column electrode transmits another encoded signal ES2 and another display signal DS2.
  • FIG. 5 is a timing chart of the encoded signal ES transmitted through each column electrode, wherein the display signals DS for display are omitted.
  • the column electrodes D 1 ⁇ D N transmit the encoded signals ES1 ⁇ ESN, respectively.
  • the encoded signals ES1 ⁇ ESN can be transmitted through different column electrodes, respectively, or multiple column electrodes may transmit the same encoded signal.
  • the column electrodes D 1 ⁇ D 3 transmit the encoded signal ES1
  • the column electrodes D 4 ⁇ D 6 transmit the encoded signal ES2.
  • This approach may also be applied to the transmission of encoded signals ES through the row electrodes.
  • the encoded signals ES transmitted through the row electrodes and the column electrodes may be an independent coding system, respectively. Since the column electrodes transmit the encoded signals ES sequentially, it is necessary to provide a time reference point for determining the positions of the column electrodes by comparing with the reference point. This reference point can be a specific code and transmitted by the same manner.
  • all column electrodes may output the code "1" twice and then transmit the sequential signal.
  • the encoded signal ES coupled to the operation apparatus 11 is "110010000", it represents that the operation apparatus 11 is located on the third column electrode, thereby figuring out the coordinate (x-coordinate) of the operation apparatus 11.
  • the y-coordinate of the operation apparatus 11 can be estimated according to another encoded signal applied to the row electrode.
  • the duty cycle of the encoded signal ES of this embodiment is smaller than that of the display signal DS, thereby maintaining the display quality.
  • the above modulation is carried out by amplitude modulation technology, which uses the high-low level of the amplitude for representing "1" and “0" digital signals.
  • the frequency modulation technology for representing the "1" and “0” digital signals.
  • it can define that five oscillations within a unit time is “1", while other frequencies are all "0".
  • phase shift modulation technology for representing the digital signals.
  • it can define that one high level plus one low level represents "0", and one low level plus one high level represent "1".
  • the applied modulation method is not limited.
  • the technology of time division, frequency division or code division can be applied to different electrodes.
  • the encoded signal ES is coupled capacitively from the passive matrix display apparatus 12 to the operation apparatus 11.
  • This embodiment takes the column electrodes D 1 ⁇ D N for transmitting the encoded signals ES as an example, so the column electrode can serve as one of the capacitive coupling electrodes, and the operation apparatus 11 has the other capacitive coupling electrode.
  • the operation apparatus 11 is a stylus
  • a conductor configured at the tip of the stylus functions as the other capacitive coupling electrode.
  • the operation apparatus 11 After receiving the encoded signal ES through the capacitive coupling, the operation apparatus 11 processes the received encoded signal ES to generate a transmission signal TS. This process includes amplifying and/or decoding the encoded signal ES so as to determine which column electrode is touched or pressed, or the touch position, or the touch gesture (writing style), or the corresponding function or instruction deduced from the input.
  • the encoded signal ES is capacitively coupled to the operation apparatus 11, and the value of the capacitance depends on the distance between the operation apparatus and the display surface 121, which means the amplitude of the signal can provide the z-axis information, so that the operation apparatus 11 can get not only the two-dimensional coordinates but also the z coordinate.
  • the transmission signal TS may denote messages from simple amplification of the encoded signal ES to instructions of the action.
  • the operation apparatus 11 can transmit the transmission signal TS to the passive matrix display apparatus 12, other relay apparatus, or other apparatuses outside the visual interface system 1 through wire, or wireless, or electrical coupling (including capacitive or inductive coupling) or optical coupling.
  • the transmission signal TS is directly transmitted to the passive matrix display apparatus 12.
  • the information to be transmitted is encoded to generate an encoded signal ES based on a specific coding rule, and then the encoded signal ES is capacitive coupled from the passive matrix display apparatus 12 (e.g. configured as a cell phone or tablet computer) to the operation apparatus 11 (e.g. short distance wireless reading apparatus attached on the wall).
  • the operation apparatus 11 can process (decodes or modifies) the encoded signal ES based on the preset coding rule so as to obtain the transmission signal TS, and then uses the transmission signal TS on the corresponding application such as access control, payment, financial transaction, file transmission, and the likes.
  • the operation apparatus 11 processes the encoded signal ES to obtain the information contained in the transmission signal TS such as the touch input information, instruction information, identification information, transaction information, file information or other information.
  • the passive matrix display apparatus 12 may process the transmission signal TS to obtain information, which contains the touch input information, instruction information, identification information, transaction information, file information or other information.
  • the touch input information may include the relative position information of the operation apparatus 11 on the display surface 121, wherein this relative position information is a signal outputted from the first substrate 122 and the second substrate 123 of the passive matrix display apparatus 12.
  • the signal is gone through the processes, for example, amplification and decoding, which can be handled by either one of the operation apparatus 11 and the passive matrix display apparatus 12 or among these units.
  • the resulting transmission signal TS can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • the information obtained by the passive matrix display apparatus 12 may also contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • a response signal RS can also be transmitted between the operation apparatus 11 and the passive matrix display apparatus 12.
  • the response signal RS is for providing the information of the receiving status of the operation apparatus 11 to the passive matrix display apparatus 12, or for announcing the operation apparatus 11 to get ready for receiving the signal, or synchronizing the operation apparatus 11 and the passive matrix display apparatus 12.
  • This configuration can create an interactive mechanism between the transmitting and receiving signals.
  • the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11 and the passive matrix display apparatus 12.
  • FIG. 6 is a perspective view of the passive matrix display apparatus 12 according to the first embodiment of the invention.
  • the visual interface system 1 further includes a mode trigger device 127.
  • the mode trigger device 127 can enable the passive matrix display apparatus 12 into an operating mode to output the encoded signal ES.
  • the mode trigger device 127 e.g. pushes the button
  • the row electrode or column electrode starts to transmit the encoded signal.
  • the passive matrix display apparatus 12 does not enter the touch input mode and the touch input function of the passive matrix display apparatus 12 may be partially or totally shut down.
  • the operation of the mode trigger device 127 may have different operation modes. For example, after been activated, the mode trigger device 127 may remain in the new state for a while and then return to the original state, or it may change the state each time after being activated. Or, the mode trigger device 127 may remain in the new state only when the activation lasts.
  • the mode trigger device 127 can be configured on the operation apparatus 11 (e.g. a switch on the stylus). In this case, when the mode trigger device 127 is activated, the operation apparatus 11 transmits a trigger signal to the passive matrix display apparatus 12 to enter the touch input mode.
  • the mode trigger device 127 can be triggered once or continuously for switching to the touch input function. Taking the access card, ticket, credit card or file transmission as examples, the user can trigger the mode trigger device 127 to transmit the encoded signal for authorization or personal identification to the corresponding data receiving device.
  • the mode trigger device 127 can be, for example, a mechanical switch, a touch sensing switch, or the likes.
  • FIG. 7 is a schematic diagram showing the passive matrix display apparatus 12 and a user, as the operation apparatus 11, according to the first embodiment of the invention.
  • the visual interface system 1 further includes a sensing device 128, which is electrically coupled with the passive matrix display apparatus 12.
  • the transmission signal TS is transmitted to the passive matrix display apparatus 12. That is, the user serves as a large conductor for transmitting the transmission signal TS to the passive matrix display apparatus 12.
  • the user can use his/her right hand to operate on the display surface 121, while use the left hand to press the sensing device 128. Accordingly, the encoded signal ES can enter the user body through the right hand, and the transmission signal TS can be outputted from the left hand.
  • the transmitted information can be obtained by analyze the transmission signal TS received by the sensing device 128.
  • the sensing device 128 may also contain the function of the mode trigger device 127. For example, only when the sensing device 128 is pressed by the left hand, the operation mode will be enabled. This specific function can sufficiently reduce the power consumption and the problem of unintentional touch.
  • FIG. 8 is a block diagram of a visual interface system 1a according to a second embodiment of the invention.
  • the visual interface system 1a includes an operation apparatus 11 and a passive matrix display apparatus 12.
  • the visual interface system 1a further includes at least one relay apparatus 13, and the transmission signal TS is transmitted to the passive matrix display apparatus 12 or other apparatuses outside the visual interface system 1a through the relay apparatus 13.
  • the user's hand is used to transmit the transmission signal TS to the relay apparatus 13, and a relay processed signal IS generated by processing the transmission signal TS is then transmitted back to the passive matrix display apparatus 12.
  • the relay apparatus 13 can be a portable communication device such as a cell phone. Accordingly, the user can be the transmission media for conducting the encoded signal ES outputted from the passive matrix display apparatus 12 to the relay apparatus 13 in order to transfer the file information.
  • the relay apparatus 13 can process the transmission signal TS to generate a relay processed signal IS and then transmit the relay processed signal IS to the passive matrix display apparatus 12.
  • the signal is processed by, for example, amplification, decoding, modifying and/or interpretation, which can be implemented by either one of the operation apparatus 11, the passive matrix display apparatus 12 and the relay apparatus 13 or among these units.
  • the transmission signal TS or the relay processed signal IS can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • the response signal RS of the first embodiment can also be applied to the operation apparatus 11, and/or the relay apparatus 13 and/or the passive matrix display apparatus 12 of the second embodiment, thereby creating an interactive mechanism between the transmitting and receiving signals.
  • the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11, the relay apparatus 13 and the passive matrix display apparatus 12.
  • the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal.
  • the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus.
  • the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
  • the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together.
  • the manufactured products can be lighter and thinner and the product cost can be reduced, thereby improving the product competitiveness.
  • the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus.
  • the touch input application it is unnecessary to add the capacitance sensing component in the display panel for detecting the change of external capacitance values.
  • the present invention can decrease the manufacturing cost and time.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Position Input By Displaying (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Near-Field Transmission Systems (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A visual interface system includes an operation apparatus and a passive matrix display apparatus. The passive matrix display apparatus includes a first substrate, a display surface and a second substrate. The display surface is located at a first side of the first substrate, and the second substrate is disposed opposite to the first substrate and located at a second side of the first substrate relatively opposite to the first side. When the operation apparatus is operated on the display surface of the passive matrix display apparatus, an encoded signal is coupled to the operation apparatus from the passive matrix substrate. The operation apparatus receives the encoded signal to obtain a transmission signal. The visual interface system can achieve the touch input function without configuring an additional touch panel, and is equipped with the near field communication (NFC) function.

Description

    BACKGROUND OF THE INVENTION Field of Invention
  • The present invention relates to a human-machine interface system and, in particular, to a visual interface system.
  • Related Art
  • Recently, touch panels have been widely applied to the commercial electronic products such as smart phones, digital cameras, MP3, PDA, GPS, tablet PC, UMPC, and the likes. In these electronic products, the touch panel is bound with a screen to form a touch input display apparatus.
  • In order to broaden the application field of the commercial electronic products, some products have been added with the new function of near field communication (NFC), which can be used to replace the conventional IC card (e.g. door card, credit card, ticket, and etc.), exchange information (e.g. music, image, name card, and etc.) between two electronic devices, or the likes. Accordingly, it is desired to create a product with a simple structure and more functions.
  • Therefore, it is an important subject to provide a visual interface system which can achieve the desired touch input function without configuring an additional touch panel, thereby making the product lighter and thinner, lowering the production cost, and providing the NFC function for broadening the application field.
  • SUMMARY OF THE INVENTION
  • An objective of the present invention is to provide a visual interface system that can achieve the touch input function without configuring an additional touch panel, and is equipped with a near field communication (NFC) function.
  • The present invention can be implemented by the following technical proposals.
  • A visual interface system of the invention includes an operation apparatus and a passive matrix display apparatus. The passive matrix display apparatus includes a first substrate, a display surface and a second substrate. The display surface is located at a first side of the first substrate. The second substrate is disposed opposite to the first substrate and located at a second side of the first substrate relatively opposite to the first side. When the operation apparatus is operated on the display surface of the passive matrix display apparatus, an encoded signal is coupled to the operation apparatus from the passive matrix substrate, and the operation apparatus receives the encoded signal to obtain a transmission signal.
  • In one embodiment, the transmission signal is transmitted to the passive matrix display apparatus.
  • In one embodiment, the passive matrix display apparatus has at least an electrode disposed on the first substrate or the second substrate, and the encoded signal is applied to the electrode and is then capacitive or inductive coupled to the operation apparatus from the electrode. The electrode is a separate electrode or one of a plurality of electrodes of the passive matrix display apparatus.
  • In one embodiment, the passive matrix display apparatus processes the transmission signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information. Herein, the touch input information includes relative position information of the operation apparatus on the display surface.
  • In one embodiment, the visual interface system further includes at least a relay apparatus for processing the transmission signal to generate a relay processed signal. The relay processed signal can be transmitted to the passive matrix display apparatus or other apparatuses outside the visual interface system. The transmission signal includes touch input information, instruction information, identification information, transaction information, file information or other information. The relay processed signal comprises touch input information, instruction information, identification information, transaction information, file information or other information. Alternatively, the passive matrix display apparatus or another apparatus outside the visual interface system processes the relay processed signal to obtain information including touch input information, instruction information, identification information, transaction information, file information or other information.
  • In one embodiment, the visual interface system further includes a mode trigger device for enabling the passive matrix display apparatus into an operating mode to output the encoded signal as the mode trigger device is triggered by a user or the operation apparatus.
  • In one embodiment, when the operation apparatus is a user, the visual interface system further includes a sensing device, and then when the user touches the display surface and the sensing device simultaneously, the transmission signal is transmitted to the sensing device. Herein, the sensing device has a mode trigger function, so the sensing device enables the passive matrix display apparatus into an operating mode to output the encoded signal as the user touches the sensing device.
  • In one embodiment, the passive matrix display apparatus further includes a display medium layer disposed between the first substrate and the second substrate. In addition, the passive matrix display apparatus further includes a plurality of column electrodes disposed at the second side of the first substrate and a plurality of row electrodes disposed at one side of the second substrate facing the first substrate. Herein the column electrodes and the row electrodes are intersected.
  • In the visual interface system of the invention, when the operation apparatus is operated on the display surface of the passive matrix display apparatus, the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal. In the touch input operation, the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus. During this transmission procedure, the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
  • As mentioned above, the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together. Thus, the manufactured products can be lighter and thinner and the product cost can be decreased, thereby improving the product competitiveness. Moreover, the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus. For example, regarding the touch input application, it is unnecessary to add the capacitance sensing components in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and shrink the process time.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The invention will become more fully understood from the detailed description and accompanying drawings, which are given for illustration only, and thus are not limitative of the present invention, and wherein:
    • FIG. 1 is a block diagram of a visual interface system according to a first embodiment of the invention;
    • FIG. 2 is a side view of a passive matrix display apparatus according to the first embodiment of the invention;
    • FIG. 3A is a perspective diagram showing a passive matrix display apparatus of FIG. 2;
    • FIG. 3B is a schematic diagram showing the intersected column electrodes and row electrodes of FIG. 3A;
    • FIG. 4 is a schematic diagram showing the signals for two adjacent column electrodes of FIG. 3B;
    • FIG. 5 is a timing chart of the encoded signal transmitted through each column electrode according to the first embodiment of the invention;
    • FIG. 6 is a perspective view of the passive matrix display apparatus according to the first embodiment of the invention;
    • FIG. 7 is a schematic diagram showing the passive matrix display apparatus and a user, as the operation apparatus, according to the first embodiment of the invention; and
    • FIG. 8 is a block diagram of a visual interface system according to a second embodiment of the invention.
    DETAILED DESCRIPTION OF THE INVENTION
  • The present invention will be apparent from the following detailed description, which proceeds with reference to the accompanying drawings, wherein the same references relate to the same elements.
  • FIG. 1 is a block diagram of a visual interface system 1 according to a first embodiment of the invention.
  • With reference to FIG. 1, the visual interface system 1 includes an operation apparatus 11 and a passive matrix display apparatus 12 coupled with each other by, for example, capacitive or inductive coupling for transmitting signals. Thus, the signal transmission between the operation apparatus 11 and the passive matrix display apparatus 12 is a non-contact signal transmission (wireless).
  • In this embodiment, the operation apparatus 11 is, for example, a stylus, a conductor, an IC card, an NFC reading apparatus, or a user (especially the finger of a user). When the operation apparatus 11 is an electronic apparatus, it may include some functional circuits such as a process control circuit, a storage circuit or a transmission circuit. Herein, any circuit can be composed of hardware, software or firmware, or their combinations. When the operation apparatus 11 is a user, the user (operation apparatus) can serve as a conductor for transmitting signals. Besides, the passive matrix display apparatus 12 can be, for example, a passive matrix LCD, a touch input display apparatus, a non-volatile type display apparatus, or a passive matrix OLED display apparatus.
  • FIG. 2 is a side view of the passive matrix display apparatus 12 of FIG. 1.
  • Referring to FIG. 2, the passive matrix display apparatus 12 includes a display surface 121, a first substrate 122 and a second substrate 123. The display surface 121 is located at a first side P1 of the first substrate 122. The second substrate 123 is disposed opposite to the first substrate 122 and located at a second side P2 of the first substrate 122 relatively opposite to the first side P1. In this embodiment, the display surface 121 is the surface of the passive matrix display apparatus 12, which is closest to the viewer when the viewer is watching the images displayed on the passive matrix display apparatus 12. Besides, the first substrate 122 and the second substrate 123 can be glass substrates. The passive matrix display apparatus 12 may further include a protect glass 124 disposed on the first side P1 of the first substrate 122. In this case, the display surface 121 is the surface of the protect glass 124 closest to the viewer.
  • In addition, the passive matrix display apparatus 12 may further include a display medium layer 125 disposed between the first substrate 122 and the second substrate 123. When the passive matrix display apparatus 12 is an LCD apparatus, the display medium layer 125 is a liquid crystal layer. Besides, the LCD apparatus further includes alignment layers, polarizer, color filter layer, backlight or other components. Or, when the passive matrix display apparatus 12 is a non-volatile type display apparatus, the display medium layer 125 can be an electrophoretic layer. Besides, the non-volatile type display apparatus may further include other components such as an accommodating structure. Alternatively, when the passive matrix display apparatus 12 is an OLED display apparatus, the display medium layer 125 is an organic light emitting layer. In this case, the passive matrix display apparatus 12 may further include other components such as a color filter layer.
  • The implementation of the embodiment used in the touch input purpose will be described hereinafter. Referring to FIGS. 1 and 2, when the operation apparatus 11 is operated on the display surface 121 of the passive matrix display apparatus 12, an encoded signal ES is wirelessly coupled to the operation apparatus 11 (by capacitive or inductive coupling) from the passive matrix display apparatus 12, and the operation apparatus 11 receives the encoded signal ES so as to generate a transmission signal TS. Herein, the encoded signal ES contains the coordinate of the touch position of the operation apparatus 11 on the display screen of the passive matrix display apparatus 12, and the transmission signal TS contains the coordinate information. When the encoded signal ES is transmitted form the passive matrix display apparatus 12 to the operation apparatus 11, they are wirelessly transmitted so as to form a near field signal transmission. Of course, in other applications, the encoded signal ES can be composed of any information to be transmitted such as touch input information, instruction information, identification information, transaction information, or file information (e.g. music, images, texts, and etc.), so that the transmission signal TS contains the corresponding information. The encoded signal ES can be applied to at least one electrode on the passive matrix display apparatus 12. This electrode can be disposed on the first substrate 122 or the second substrate 123. The encoded signal ES is applied to this electrode and then capacitively or inductively coupled to the operation apparatus 11 through the electrode. Besides, additional display data signal are applied to the passive matrix display apparatus 12 for displaying images. The encoded signal ES can be applied during the blanking time of the display signals. For example, the encoded signal ES can be applied between two frames or between the signal transmissions of two row or column electrodes, or during the period generated by shortening the duration of the display signals, or the encoded signal ES can have a higher frequency and be directly added to the display signal, or it can be applied between the renewals of the display screen.
  • FIG. 3A is a perspective diagram showing the passive matrix display apparatus 12 of FIG. 2, and FIG. 3B is a schematic diagram showing the intersected column electrodes and row electrodes of FIG. 3A. To be noted, FIG. 3B only shows the column electrodes and the row electrodes of the passive matrix display apparatus 12 of FIG. 3A, while the first substrate 122, the second substrate 123 and the display medium layer 125 of the passive matrix display apparatus 12 are not shown in FIG. 3B.
  • In this embodiment, the passive matrix display apparatus 12 is an OLED display apparatus for example, and the display medium layer 125 is an organic light emitting layer. Referring to FIGS. 2, 3A and 3B, the passive matrix display apparatus 12 further includes a plurality of column electrodes D1∼DN and a plurality of row electrodes S1∼SM. The column electrodes D1∼DN are disposed at the second side P2 of the first substrate 122, while the row electrodes S1∼SM are disposed at one side of the second substrate 123 facing the first substrate 122. The column electrodes D1∼DN and the row electrodes S1∼SM are intersected, and they are substantially perpendicular to each other or have an included angle. Moreover, the passive matrix display apparatus 12 further includes a driving module (not shown) for driving the passive matrix display apparatus 12 to display image. In practice, the driving module can drive the selected row and column electrodes for lighting the display medium layer 125 located at the cross of the row and column electrodes so as to display image. Since the driving method of the driving module and the passive matrix display apparatus 12 is a well-known conventional technology, the detailed description thereof will be omitted here. The point of this embodiment is in that the column electrodes D1∼DN and/or the row electrodes S1∼SM transmit the encoded signal ES from the passive matrix display apparatus 12 to the operation apparatus 11 so as to generate the transmission signal TS. The encoded signal may carry various information for different applications, such as, the reference coordinates of the display screen of the passive matrix display apparatus 12, the file information of different formats (e.g. personal data, music, images, and etc.), and the likes.
  • In this embodiment, the column electrodes D1∼DN can transmit not only the data signals for displaying images but also the encoded signal ES. For example, the encoded signal ES with higher frequency can be directly added to the display signal DS or be added to the blank period of the display signal DS such as the period between two frames or the blank time between the renewals of the screen. Herein, the encoded signal ES can be provided by the circuit of the driving module of the passive matrix display apparatus 12, thereby simplifying the circuit design.
  • To be noted, when the passive matrix display apparatus 12 is a bistable display apparatus such as a cholesteric LCD apparatus, the display apparatus needs the display signals only for the screen renewal, so that the encoded signal can be transmitted during the display screen renewal (carried on the display signal) or between the renewals of the display screen (between display signals). Moreover, the passive matrix display apparatus 12 can renew a part of the display screen only, so that the encoded signal can be transmitted along with the renewal of the part of the display screen or between the renewals of the part of the display screen. Or, the passive matrix display apparatus 12 can be a quasi-bistable display apparatus such as an IMOD (interferometric modulator) display apparatus using MEMS to generate light interference. In addition to the display signal for renewing screen, this kind of display apparatus needs a sustaining signal to maintain the screen image even the screen is not renewed. In this case, the encoded signal can be carried on the display signal or the sustaining signal, or between the display signals or sustaining signals.
  • FIG. 4 is a schematic diagram showing the signals for two adjacent column electrodes of FIG. 3B. The encoded signal ES will be described hereinafter with sequential coding in time for one dimension touch input perpendicular to the row electrode as an example. Of course, this method can also be applied to another dimension touch input perpendicular to the column electrode. Consequently, a complete two-dimensional touch input can be built.
  • In this embodiment, as shown in FIG. 4, only one column electrode transmits the encoded signal ES, wherein the encoded signal ES is labeled with a level different from that of the display signal, or, in practice, the encoded signal ES and the display signal may have the same level. In other words, at a specific timing, the column electrode transmits an encoded signal ES1 and a display signal DS1, and at the next timing, the column electrode transmits another encoded signal ES2 and another display signal DS2. FIG. 5 is a timing chart of the encoded signal ES transmitted through each column electrode, wherein the display signals DS for display are omitted. Herein, the column electrodes D1∼DN transmit the encoded signals ES1∼ESN, respectively. To be noted, the encoded signals ES1∼ESN can be transmitted through different column electrodes, respectively, or multiple column electrodes may transmit the same encoded signal. For example, the column electrodes D1∼D3 transmit the encoded signal ES1, and the column electrodes D4∼D6 transmit the encoded signal ES2. This approach may also be applied to the transmission of encoded signals ES through the row electrodes. Alternatively, the encoded signals ES transmitted through the row electrodes and the column electrodes may be an independent coding system, respectively. Since the column electrodes transmit the encoded signals ES sequentially, it is necessary to provide a time reference point for determining the positions of the column electrodes by comparing with the reference point. This reference point can be a specific code and transmitted by the same manner. For example, all column electrodes may output the code "1" twice and then transmit the sequential signal. As mentioned above, if the encoded signal ES coupled to the operation apparatus 11 is "110010000", it represents that the operation apparatus 11 is located on the third column electrode, thereby figuring out the coordinate (x-coordinate) of the operation apparatus 11. Similarly, the y-coordinate of the operation apparatus 11 can be estimated according to another encoded signal applied to the row electrode. Besides, the duty cycle of the encoded signal ES of this embodiment is smaller than that of the display signal DS, thereby maintaining the display quality.
  • The above modulation is carried out by amplitude modulation technology, which uses the high-low level of the amplitude for representing "1" and "0" digital signals. Or, it is also possible to use the frequency modulation technology for representing the "1" and "0" digital signals. For example, it can define that five oscillations within a unit time is "1", while other frequencies are all "0". Alternatively, it is also possible to use phase shift modulation technology for representing the digital signals. For example, it can define that one high level plus one low level represents "0", and one low level plus one high level represent "1". Herein, the applied modulation method is not limited. Besides, in order to prevent the interference of the neighbor electrodes, the technology of time division, frequency division or code division can be applied to different electrodes.
  • When a user grabs the operation apparatus 11 and operates it on the display surface 121 of the passive matrix display apparatus 12 (e.g. to contact or approach the display surface 121), the encoded signal ES is coupled capacitively from the passive matrix display apparatus 12 to the operation apparatus 11. This embodiment takes the column electrodes D1∼DN for transmitting the encoded signals ES as an example, so the column electrode can serve as one of the capacitive coupling electrodes, and the operation apparatus 11 has the other capacitive coupling electrode. For example, when the operation apparatus 11 is a stylus, a conductor configured at the tip of the stylus functions as the other capacitive coupling electrode.
  • After receiving the encoded signal ES through the capacitive coupling, the operation apparatus 11 processes the received encoded signal ES to generate a transmission signal TS. This process includes amplifying and/or decoding the encoded signal ES so as to determine which column electrode is touched or pressed, or the touch position, or the touch gesture (writing style), or the corresponding function or instruction deduced from the input.. To be noted, the encoded signal ES is capacitively coupled to the operation apparatus 11, and the value of the capacitance depends on the distance between the operation apparatus and the display surface 121, which means the amplitude of the signal can provide the z-axis information, so that the operation apparatus 11 can get not only the two-dimensional coordinates but also the z coordinate. Accordingly, the transmission signal TS may denote messages from simple amplification of the encoded signal ES to instructions of the action.
  • After generating the transmission signal TS, the operation apparatus 11 can transmit the transmission signal TS to the passive matrix display apparatus 12, other relay apparatus, or other apparatuses outside the visual interface system 1 through wire, or wireless, or electrical coupling (including capacitive or inductive coupling) or optical coupling. In this embodiment, the transmission signal TS is directly transmitted to the passive matrix display apparatus 12.
  • When this invention is applied to other non-touch input applications, the information to be transmitted is encoded to generate an encoded signal ES based on a specific coding rule, and then the encoded signal ES is capacitive coupled from the passive matrix display apparatus 12 (e.g. configured as a cell phone or tablet computer) to the operation apparatus 11 (e.g. short distance wireless reading apparatus attached on the wall). Similarly, the operation apparatus 11 can process (decodes or modifies) the encoded signal ES based on the preset coding rule so as to obtain the transmission signal TS, and then uses the transmission signal TS on the corresponding application such as access control, payment, financial transaction, file transmission, and the likes.
  • In the above embodiment, the operation apparatus 11 processes the encoded signal ES to obtain the information contained in the transmission signal TS such as the touch input information, instruction information, identification information, transaction information, file information or other information. In other embodiments, the passive matrix display apparatus 12 may process the transmission signal TS to obtain information, which contains the touch input information, instruction information, identification information, transaction information, file information or other information. The touch input information may include the relative position information of the operation apparatus 11 on the display surface 121, wherein this relative position information is a signal outputted from the first substrate 122 and the second substrate 123 of the passive matrix display apparatus 12.
  • As mentioned above, referring to FIG. 1, in the procedures of coupling the encoded signal ES to the operation apparatus 11 to generate the transmission signal TS and transmitting the transmission signal TS to the passive matrix display apparatus 12 to obtain the information, the signal is gone through the processes, for example, amplification and decoding, which can be handled by either one of the operation apparatus 11 and the passive matrix display apparatus 12 or among these units. The resulting transmission signal TS can contain the touch input information, instruction information, identification information, transaction information, file information or other information. The information obtained by the passive matrix display apparatus 12 may also contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • Besides, a response signal RS can also be transmitted between the operation apparatus 11 and the passive matrix display apparatus 12. Herein, the response signal RS is for providing the information of the receiving status of the operation apparatus 11 to the passive matrix display apparatus 12, or for announcing the operation apparatus 11 to get ready for receiving the signal, or synchronizing the operation apparatus 11 and the passive matrix display apparatus 12. This configuration can create an interactive mechanism between the transmitting and receiving signals. Moreover, the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11 and the passive matrix display apparatus 12.
  • FIG. 6 is a perspective view of the passive matrix display apparatus 12 according to the first embodiment of the invention.
  • Referring to FIG. 6, the visual interface system 1 further includes a mode trigger device 127. When a user or the operation apparatus triggers the mode trigger device 127, the mode trigger device 127 can enable the passive matrix display apparatus 12 into an operating mode to output the encoded signal ES. For example, when the user needs the touch input function, he/she activates the mode trigger device 127 (e.g. pushes the button) so as to enable the passive matrix display apparatus 12 into the touch input mode. Then, the row electrode or column electrode starts to transmit the encoded signal. Or, the passive matrix display apparatus 12 does not enter the touch input mode and the touch input function of the passive matrix display apparatus 12 may be partially or totally shut down. This function can save power and prevent the system to misinterpret the actions caused by unintentionally contacting the screen. To be noted, the operation of the mode trigger device 127 may have different operation modes. For example, after been activated, the mode trigger device 127 may remain in the new state for a while and then return to the original state, or it may change the state each time after being activated. Or, the mode trigger device 127 may remain in the new state only when the activation lasts. Besides, the mode trigger device 127 can be configured on the operation apparatus 11 (e.g. a switch on the stylus). In this case, when the mode trigger device 127 is activated, the operation apparatus 11 transmits a trigger signal to the passive matrix display apparatus 12 to enter the touch input mode. To be noted, the mode trigger device 127 can be triggered once or continuously for switching to the touch input function. Taking the access card, ticket, credit card or file transmission as examples, the user can trigger the mode trigger device 127 to transmit the encoded signal for authorization or personal identification to the corresponding data receiving device. The mode trigger device 127 can be, for example, a mechanical switch, a touch sensing switch, or the likes.
  • FIG. 7 is a schematic diagram showing the passive matrix display apparatus 12 and a user, as the operation apparatus 11, according to the first embodiment of the invention.
  • In this aspect, the visual interface system 1 further includes a sensing device 128, which is electrically coupled with the passive matrix display apparatus 12. When the user touches or approaches the display surface 121 and the sensing device 128 of the passive matrix display apparatus 12 simultaneously, the transmission signal TS is transmitted to the passive matrix display apparatus 12. That is, the user serves as a large conductor for transmitting the transmission signal TS to the passive matrix display apparatus 12. In practice, the user can use his/her right hand to operate on the display surface 121, while use the left hand to press the sensing device 128. Accordingly, the encoded signal ES can enter the user body through the right hand, and the transmission signal TS can be outputted from the left hand. The transmitted information can be obtained by analyze the transmission signal TS received by the sensing device 128. The sensing device 128 may also contain the function of the mode trigger device 127. For example, only when the sensing device 128 is pressed by the left hand, the operation mode will be enabled. This specific function can sufficiently reduce the power consumption and the problem of unintentional touch.
  • FIG. 8 is a block diagram of a visual interface system 1a according to a second embodiment of the invention.
  • The visual interface system 1a includes an operation apparatus 11 and a passive matrix display apparatus 12.
  • Different from the first embodiment, the visual interface system 1a further includes at least one relay apparatus 13, and the transmission signal TS is transmitted to the passive matrix display apparatus 12 or other apparatuses outside the visual interface system 1a through the relay apparatus 13. In this aspect, the user's hand is used to transmit the transmission signal TS to the relay apparatus 13, and a relay processed signal IS generated by processing the transmission signal TS is then transmitted back to the passive matrix display apparatus 12. This aspect is only for illustrations and, of course, it is possible to configure multiple relay apparatuses. Besides, when the operation apparatus 11 is a user, the user can transmit the transmission signal TS to the relay apparatus 13, wherein the signals are not transmitted back to the passive matrix display apparatus 12. Herein, the relay apparatus 13 can be a portable communication device such as a cell phone. Accordingly, the user can be the transmission media for conducting the encoded signal ES outputted from the passive matrix display apparatus 12 to the relay apparatus 13 in order to transfer the file information.
  • The relay apparatus 13 can process the transmission signal TS to generate a relay processed signal IS and then transmit the relay processed signal IS to the passive matrix display apparatus 12. In the procedures of coupling the encoded signal ES to the operation apparatus 11 to generate the transmission signal TS, processing the transmission signal TS by the relay apparatus 13 to generate the relay processed signal IS, and transmitting the relay processed signal IS to the passive matrix display apparatus 12 to obtain the information, the signal is processed by, for example, amplification, decoding, modifying and/or interpretation, which can be implemented by either one of the operation apparatus 11, the passive matrix display apparatus 12 and the relay apparatus 13 or among these units. Accordingly, the transmission signal TS or the relay processed signal IS can contain the touch input information, instruction information, identification information, transaction information, file information or other information.
  • Besides, the response signal RS of the first embodiment can also be applied to the operation apparatus 11, and/or the relay apparatus 13 and/or the passive matrix display apparatus 12 of the second embodiment, thereby creating an interactive mechanism between the transmitting and receiving signals. Moreover, the response signal RS can provide the synchronization function for establishing an information handshaking procedure between the operation apparatus 11, the relay apparatus 13 and the passive matrix display apparatus 12.
  • In the visual interface system of the invention, when the operation apparatus is operated on the display surface of the passive matrix display apparatus, the encoded signal is coupled to the operation apparatus from the passive matrix display apparatus, and the operation apparatus receives the encoded signal to generate a transmission signal. In the example of touch input operation, the transmission signal can be directly or indirectly transmitted to the passive matrix display apparatus. During this transmission procedure, the transmission signal can be processed by the operation apparatus, and/or at least one relay apparatus, and/or the passive matrix display apparatus, so that the passive matrix display apparatus can retrieve the information (e.g. touch input information, instruction information, identification information, transaction information, file information or other information) contained in the encoded signal and transmission signal.
  • As mentioned above, the visual interface system of the invention can be directly applied to the system containing the passive matrix structure such as passive matrix LCD apparatus, non-volatile type display apparatus, touch input display apparatus, passive matrix OLED display apparatus, or the likes, thereby integrating display, touch input and data transmission functions together. Thus, the manufactured products can be lighter and thinner and the product cost can be reduced, thereby improving the product competitiveness. Moreover, the encoded signal is coupled to the external operation apparatus instead of being directly read by the passive matrix display apparatus, so that it is unnecessary to modify the layout on the passive matrix display apparatus. For example, regarding to the touch input application, it is unnecessary to add the capacitance sensing component in the display panel for detecting the change of external capacitance values. As a result, the present invention can decrease the manufacturing cost and time.
  • Although the invention has been described with reference to specific embodiments, this description is not meant to be construed in a limiting sense. Various modifications of the disclosed embodiments, as well as alternative embodiments, will be apparent to persons skilled in the art. It is, therefore, contemplated that the appended claims will cover all modifications that fall within the true scope of the invention.

Claims (17)

  1. A visual interface system, comprising:
    an operation apparatus; and
    a passive matrix display apparatus, comprising:
    a first substrate,
    a display surface located at a first side of the first substrate, and
    a second substrate disposed opposite to the first substrate and located at a second side of the first substrate relatively opposite to the first side;
    wherein, when the operation apparatus is operated on the display surface of the passive matrix display apparatus, an encoded signal is coupled to the operation apparatus from the passive matrix substrate, and the operation apparatus receives the encoded signal to obtain a transmission signal.
  2. The visual interface system of claim 1, wherein the transmission signal is transmitted to the passive matrix display apparatus.
  3. The visual interface system of claim 1, wherein the passive matrix display apparatus has at least an electrode disposed on the first substrate or the second substrate, and the encoded signal is applied to the electrode and is then capacitively or inductively coupled to the operation apparatus from the electrode.
  4. The visual interface system of claim 3, wherein the electrode is a separate electrode or one of a plurality of electrodes of the passive matrix display apparatus.
  5. The visual interface system of claim 3, wherein the passive matrix display apparatus processes the transmission signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information.
  6. The visual interface system of claim 5, wherein the touch input information includes relative position information of the operation apparatus on the display surface, and the transmission signal is outputted from the first substrate and the second substrate.
  7. The visual interface system of claim 1, further comprising:
    at least a relay apparatus for processing the transmission signal to generate a relay processed signal.
  8. The visual interface system of claim 7, wherein the relay processed signal is transmitted to the passive matrix display apparatus.
  9. The visual interface system of claim 7, wherein the transmission signal comprises touch input information, instruction information, identification information, transaction information, or file information.
  10. The visual interface system of claim 7, wherein the relay processed signal comprises touch input information, instruction information, identification information, transaction information, or file information.
  11. The visual interface system of claim 8, wherein the passive matrix display apparatus processes the relay processed signal to obtain information comprising touch input information, instruction information, identification information, transaction information, or file information.
  12. The visual interface system of claim 1 or 7, further comprising:
    a mode trigger device for enabling the passive matrix display apparatus into an operating mode to output the encoded signal when the mode trigger device is triggered by a user or the operation apparatus.
  13. The visual interface system of claim 1 or 7, wherein when the operation apparatus is a user, the visual interface system further comprises a sensing device, and then when the user touches the display surface and the sensing device simultaneously, the transmission signal is transmitted to the sensing device.
  14. The visual interface system of claim 13, wherein the sensing device has a mode trigger function, so the sensing device enables the passive matrix display apparatus into an operating mode to output the encoded signal as the user touches the sensing device.
  15. The visual interface system of claim 1, wherein the passive matrix display apparatus further comprises a display medium layer disposed between the first substrate and the second substrate.
  16. The visual interface system of claim 1, wherein the passive matrix display apparatus further comprises:
    a plurality of column electrodes disposed at the second side of the first substrate; and
    a plurality of row electrodes disposed at one side of the second substrate facing the first substrate, wherein the column electrodes and the row electrodes are intersected.
  17. The visual interface system of claim 1, wherein the encoded signal is transmitted as the display screen of the passive matrix display apparatus is renewing or between the renewals of the display screen of the passive matrix display apparatus.
EP12831451.5A 2011-09-13 2012-07-10 Visual interface system Not-in-force EP2757445B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/CN2011/079576 WO2013037103A1 (en) 2011-09-13 2011-09-13 Visual interface system
PCT/CN2012/078412 WO2013037238A1 (en) 2011-09-13 2012-07-10 Visual interface system

Publications (3)

Publication Number Publication Date
EP2757445A1 true EP2757445A1 (en) 2014-07-23
EP2757445A4 EP2757445A4 (en) 2015-07-15
EP2757445B1 EP2757445B1 (en) 2017-10-04

Family

ID=47882523

Family Applications (3)

Application Number Title Priority Date Filing Date
EP11872370.9A Not-in-force EP2757444B1 (en) 2011-09-13 2011-09-13 Visual interface system
EP12831451.5A Not-in-force EP2757445B1 (en) 2011-09-13 2012-07-10 Visual interface system
EP12831883.9A Active EP2757538B1 (en) 2011-09-13 2012-09-10 Electronic apparatus and data transmission system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP11872370.9A Not-in-force EP2757444B1 (en) 2011-09-13 2011-09-13 Visual interface system

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP12831883.9A Active EP2757538B1 (en) 2011-09-13 2012-09-10 Electronic apparatus and data transmission system

Country Status (7)

Country Link
US (4) US20140340340A1 (en)
EP (3) EP2757444B1 (en)
JP (3) JP6142149B2 (en)
KR (3) KR101662413B1 (en)
CN (3) CN103797448B (en)
TW (2) TWI592841B (en)
WO (3) WO2013037103A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013174186A1 (en) 2012-05-25 2013-11-28 Tsai Hsiung-Kuang Non-display signal coding method and matrix substrate
CN102916729B (en) * 2012-09-04 2014-12-10 深圳市汇顶科技股份有限公司 Near-field communication method and system of touch panel terminal as well as touch panel terminal
CN104769523B (en) * 2012-11-06 2018-07-13 惠普发展公司,有限责任合伙企业 Interactive display
CN103176655B (en) * 2013-03-13 2016-05-25 北京京东方光电科技有限公司 A kind of driving method of touch display and device
US9582186B2 (en) * 2013-12-20 2017-02-28 Mediatek Inc. Signature verification between a mobile device and a computing device
US20160104370A1 (en) 2014-10-14 2016-04-14 Logitech Europe S.A Method of controlling an electronic device
JP2020030884A (en) * 2016-12-26 2020-02-27 コニカミノルタ株式会社 Passive matrix type organic electroluminescent display and touch detection method
US20210014674A1 (en) * 2019-07-11 2021-01-14 Slim Hmi Technology Secure interaction system and communication display device
TWI726488B (en) 2019-11-19 2021-05-01 元太科技工業股份有限公司 Proximity smart card and a method for operating a proximity smart card
KR20220091700A (en) 2020-12-23 2022-07-01 삼성디스플레이 주식회사 Electronic device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040262051A1 (en) * 2003-06-26 2004-12-30 International Business Machines Corporation Program product, system and method for creating and selecting active regions on physical documents
US20110007037A1 (en) * 2009-07-07 2011-01-13 Panasonic Corporation Electronic pen and electronic pen system
US20110109568A1 (en) * 2009-11-09 2011-05-12 Hung-Wei Wu Touch display device

Family Cites Families (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0738152B2 (en) * 1986-09-25 1995-04-26 三菱電機株式会社 Display device
JPH03294919A (en) * 1990-04-12 1991-12-26 Nippon Telegr & Teleph Corp <Ntt> Display device with tablet function
US5117071A (en) * 1990-10-31 1992-05-26 International Business Machines Corporation Stylus sensing system
JPH06230884A (en) * 1993-02-03 1994-08-19 Matsushita Electric Ind Co Ltd Coordinate input device
US5491706A (en) * 1993-04-07 1996-02-13 Sharp Kabushiki Kaisha Display-integrated type tablet device capable of detecting correct coordinates at a tip end of a detection pen by detecting external noise
JP3421078B2 (en) * 1993-05-07 2003-06-30 シャープ株式会社 Information input / output device
JPH0720421A (en) * 1993-06-29 1995-01-24 Asahi Glass Co Ltd Liquid crystal display element
JP2653014B2 (en) * 1993-07-26 1997-09-10 日本電気株式会社 Active matrix liquid crystal display device
JPH08106358A (en) * 1994-08-10 1996-04-23 Fujitsu Ltd Liquid crystal display device with tablet function, active matrix type liquid crystal display device, and driving method for liquid crystal display device with tablet function
JP4939682B2 (en) 1999-04-27 2012-05-30 エーユー オプトロニクス コーポレイション Display device
JP2001075074A (en) * 1999-08-18 2001-03-23 Internatl Business Mach Corp <Ibm> Touch sensor type liquid crystal display device
JP2001144661A (en) * 1999-11-17 2001-05-25 Sony Corp Data transmitter and data receiver
JP3319462B2 (en) * 2000-06-26 2002-09-03 松下電工株式会社 Data transmission system using human body as signal transmission path
JP2002366051A (en) * 2001-06-08 2002-12-20 Sanyo Electric Co Ltd Integrated circuit chip and display device using the same
JP2004005415A (en) * 2002-04-19 2004-01-08 Sharp Corp Input device and input/output integrated display
JP3966069B2 (en) * 2002-05-02 2007-08-29 セイコーエプソン株式会社 Data communication device and portable watch
JP3794411B2 (en) * 2003-03-14 2006-07-05 セイコーエプソン株式会社 Display device and electronic device
JP5008823B2 (en) * 2004-03-19 2012-08-22 シャープ株式会社 Display device
WO2005096772A2 (en) * 2004-04-01 2005-10-20 Finepoint Innovations, Inc. Surface and cordless transducer system
US20060000893A1 (en) * 2004-07-01 2006-01-05 American Express Travel Related Services Company, Inc. Method for biometric security using a smartcard-reader
US7657242B2 (en) * 2004-09-27 2010-02-02 Qualcomm Mems Technologies, Inc. Selectable capacitance circuit
JP2006127190A (en) * 2004-10-29 2006-05-18 Citizen Watch Co Ltd Input device
US20060094411A1 (en) 2004-10-29 2006-05-04 Dupont Pierre B Mobile station telephony service applications for mobile station having integrated transponder readers
CN100374995C (en) * 2004-11-08 2008-03-12 英华达(南京)科技有限公司 Handwriting pen and handwriting pen system and control method thereof
JP2006195925A (en) * 2005-01-17 2006-07-27 Nippon Signal Co Ltd:The Touch panel device
WO2006087670A1 (en) 2005-02-17 2006-08-24 Koninklijke Philips Electronics N.V. Device capable of being operated within a network, network system, method of operating a device within a network, program element, and computer-readable medium
JP2006238328A (en) 2005-02-28 2006-09-07 Sony Corp Conference system, conference terminal and portable terminal
CN2785540Y (en) * 2005-04-21 2006-06-07 周常安 Hand held device for physiological signal measuring and wireless transmission and receiving apparatus
CN101017419B (en) * 2005-06-30 2010-05-12 智点科技(深圳)有限公司 Touch control panel display
CN1716018A (en) * 2005-07-14 2006-01-04 深圳市联思精密机器有限公司 Plane display with touch control function
CN1904812A (en) * 2005-07-29 2007-01-31 姚华 Touch pen usable for display screen of common computer
KR100862578B1 (en) * 2006-05-16 2008-10-09 엘지전자 주식회사 Plasma Display Apparatus
US20090275283A1 (en) 2006-08-29 2009-11-05 Zhao Zhuyan Use of intra-body communication
US7777719B2 (en) * 2007-01-19 2010-08-17 Nokia Corporation System using a living body as a transmission medium
WO2008098398A2 (en) * 2007-02-14 2008-08-21 Kaba Ag System and portable device for transmitting identification signals
CN201707209U (en) * 2007-03-09 2011-01-12 营口方舟科技有限公司 Wrist strap display
EP2056186A1 (en) 2007-10-26 2009-05-06 Research In Motion Limited Touch screen and electronic device
JP2009146088A (en) * 2007-12-13 2009-07-02 Hitachi Displays Ltd Capacitive coupling-type signal transmission/reception circuit
JP2009253478A (en) * 2008-04-02 2009-10-29 Sony Ericsson Mobilecommunications Japan Inc Information communication device and control method of information communication device
CN102112950B (en) * 2008-09-12 2015-01-28 奥博特瑞克斯株式会社 Electrostatic capacity type touch panel, display device, and electrostatic capacity type touch panel manufacturing method
US8482545B2 (en) * 2008-10-02 2013-07-09 Wacom Co., Ltd. Combination touch and transducer input system and method
TWM364503U (en) * 2009-03-23 2009-09-11 Astek Technology Ltd Wireless ring-type physiological detector
KR20120036880A (en) * 2009-05-27 2012-04-18 코닌클리케 필립스 일렉트로닉스 엔.브이. Touch- or proximity-sensitive interface
JP2010286895A (en) * 2009-06-09 2010-12-24 Toshiba Tec Corp Information input device and information processor
KR101562565B1 (en) * 2009-06-25 2015-10-22 삼성전자주식회사 A method for transmitting and receiving data using E-Field in a portable terminal and an apparatus thereof
TWM371930U (en) * 2009-06-29 2010-01-01 Ming-Chang Wu Prompt system for object sensing
CN101943978B (en) 2009-07-06 2012-12-26 弗莱克斯电子有限责任公司 Capacitive touch screen panel and its manufacturing method, and capacitive touch sensor
KR20110027572A (en) * 2009-09-08 2011-03-16 한국전자통신연구원 Apparatus for communication using near field
US20110059692A1 (en) * 2009-09-08 2011-03-10 Electronics And Telecommunications Research Institute Communications device using near field
KR101351413B1 (en) * 2009-12-11 2014-01-14 엘지디스플레이 주식회사 Touch Panel and Liquid Crystal Display Device Including Touch Panel
KR101107171B1 (en) * 2010-02-11 2012-01-25 삼성모바일디스플레이주식회사 Apparatus for touch sensing, display device and operating method for the same
JP5440376B2 (en) * 2010-05-18 2014-03-12 日本電気株式会社 Touch sensor, touch panel, and information transmission method using the touch sensor
CN201828896U (en) 2010-09-27 2011-05-11 南京点面光电有限公司 Capacitance type touch screen
CN102073409A (en) * 2010-12-29 2011-05-25 广东中显科技有限公司 Touch screen

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040262051A1 (en) * 2003-06-26 2004-12-30 International Business Machines Corporation Program product, system and method for creating and selecting active regions on physical documents
US20110007037A1 (en) * 2009-07-07 2011-01-13 Panasonic Corporation Electronic pen and electronic pen system
US20110109568A1 (en) * 2009-11-09 2011-05-12 Hung-Wei Wu Touch display device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2013037238A1 *

Also Published As

Publication number Publication date
KR20140074902A (en) 2014-06-18
WO2013037238A1 (en) 2013-03-21
EP2757538A4 (en) 2015-05-06
EP2757444B1 (en) 2017-04-19
EP2757538B1 (en) 2019-09-11
US9335849B2 (en) 2016-05-10
US9489071B2 (en) 2016-11-08
KR20140074921A (en) 2014-06-18
US20140340340A1 (en) 2014-11-20
TWI592841B (en) 2017-07-21
CN103797448A (en) 2014-05-14
CN103827934B (en) 2017-10-13
WO2013037103A1 (en) 2013-03-21
KR20140075688A (en) 2014-06-19
EP2757444A1 (en) 2014-07-23
CN103797450A (en) 2014-05-14
WO2013037281A1 (en) 2013-03-21
CN103827934A (en) 2014-05-28
TWI485565B (en) 2015-05-21
US20140220892A1 (en) 2014-08-07
US20140340357A1 (en) 2014-11-20
CN103797448B (en) 2018-09-04
TW201312366A (en) 2013-03-16
JP5951775B2 (en) 2016-07-13
TW201312413A (en) 2013-03-16
KR101641802B1 (en) 2016-07-21
JP6142149B2 (en) 2017-06-07
KR101662413B1 (en) 2016-10-04
EP2757445B1 (en) 2017-10-04
EP2757445A4 (en) 2015-07-15
US20170220190A1 (en) 2017-08-03
CN103797450B (en) 2018-03-23
JP6033308B2 (en) 2016-11-30
EP2757538A1 (en) 2014-07-23
KR101570309B1 (en) 2015-11-18
EP2757444A4 (en) 2015-03-18
JP2014529134A (en) 2014-10-30
JP2014530404A (en) 2014-11-17
JP2014531150A (en) 2014-11-20

Similar Documents

Publication Publication Date Title
US9335849B2 (en) Visual interface system
TWI494798B (en) Active stylus
KR101471845B1 (en) Display device with input system and method for driving the same
US10185448B2 (en) Touch control liquid crystal display device and electronic apparatus
EP3144784B1 (en) Mobile terminal and control method for the mobile terminal
CN103309495A (en) Display device with integrated touch screen
KR102286893B1 (en) Touch Display Device
EP3271914A1 (en) Providing content to electronic paper display devices
KR20130069087A (en) Liquid crystal display device with interred touch screen and method for driving the same
JP6033310B2 (en) Driving method of vision interface system
TWI499917B (en) Visual interface apparatus and data transfer system
US20180373387A1 (en) Visual interface system
US20200004375A1 (en) Visual interface system
TWI492110B (en) Visual interface system
CN106445127A (en) Method and system for terminal control

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140320

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20150612

RIC1 Information provided on ipc code assigned before grant

Ipc: H04W 4/00 20090101ALI20150608BHEP

Ipc: G06F 3/044 20060101AFI20150608BHEP

Ipc: G06F 3/041 20060101ALI20150608BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SLIM HMI TECHNOLOGY

RIN1 Information on inventor provided before grant (corrected)

Inventor name: TSAI HSIUNG-KUANG

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20170421

RIN1 Information on inventor provided before grant (corrected)

Inventor name: TSAI HSIUNG-KUANG

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 934614

Country of ref document: AT

Kind code of ref document: T

Effective date: 20171015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012038233

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20171004

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 934614

Country of ref document: AT

Kind code of ref document: T

Effective date: 20171004

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180104

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180104

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180105

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180204

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602012038233

Country of ref document: DE

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

26N No opposition filed

Effective date: 20180705

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180710

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180731

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180731

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20120710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171004

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171004

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20210723

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20210722

Year of fee payment: 10

Ref country code: DE

Payment date: 20210720

Year of fee payment: 10

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602012038233

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220710

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230201