WO2002003317A1

WO2002003317A1 - Cursor control unit with patterned guide plate

Info

Publication number: WO2002003317A1
Application number: PCT/NO2000/000114
Authority: WO
Inventors: Steinar Pedersen
Original assignee: Steinar Pedersen
Priority date: 2000-07-04
Filing date: 2000-07-04
Publication date: 2002-01-10
Also published as: AU2000267400A1

Abstract

The invention represents a control unit used for positioning and control of PC cursors and other objects, where the device incorporates a control module comprising a control button that is mounted on a horizontally sliding guide plate; where the motion or position of the control module in the X-Y plane is detected by an opto-electronic sensor means encompassing a light source, a photo-sensor matrix and a processor that can interpret signals useful from the matrix and transform them into control signals useful for control of movements and location of said cursor or object on a display or PC screen; where the opto-electronic sensor is capable of detecting X-Y motions of the control module due to the photo-sensor matrix capturing sequential pictures of the lower side of the guide plate which is being illuminated by diffuse light.

Description

Cursor control unit with patterned guide plate

The described invention represents a control unit that is used for positioning and control of PC cursors and other virtual and physical objects. The device's control module comprises a button that is mounted on a horizontally moveable guide plate, and the horizontal (X-Y) position can be determined by an opto-electronic sensor that has the capability to detect movement of a pattern on the lower surface of the guide plate.

The most popular devices used for control of cursors and other graphical symbols and objects on the PC screen are mice, track-balls, touch-pads and TrackPoint™ buttons.

Different varieties of the mouse are described in U.S.

Pat. Nos. 3,541,541; 3,892,963; 3,541,521 and 4,464,652. The track-ball can be compared with an inverted mouse, where the ball is controlled by the thumb. The original track-ball utilised the same signal generating system as the mouse (U.S. Pat. 5,122,654; U.S. Pat. 5,008,528).

A modern version of the track-ball includes a rotating ball with a randomly patterned (speckled) surface that is illuminated by diffuse light, whereby a picture of part of the surface is focussed onto a photosensor matrix (U.S. Pat. 5,288,993 and U.S. Pat. 5,703,356). An analyser associated with the sensor matrix detects motions of the ball and transforms this information into conventional control signals.

A similar system is employed by Microsoft's Intellimouse™, where the a photosensor matrix captures sequential pictures of the surface below the mouse, which are then used to generate motion control signals. Both the mice and track-balls have disadvantages, particularly regarding precision, ergonomics and scalability. Other systems are based on index finger control or incorporate control sticks that are seized by fingers or hand, providing slightly better precision. They are also better suited for incorporation in mobile devices, e.g. hand-held computers and telephones (U.S. Pat. 4,736,191; U.S. Pat. 4,680,577; PCT/US89/05662 ; EP A3 0,295,368; EP Al 0,640,937; U.S. Pat. 4,719,455; PCT/JP89/01148; PCT/CA90/00022 ; U.S. Pat. 4,935,728; EP A3 0,556,936) .

This inventor has developed a control device that is described in e.g. PCT/NO94/00113 , PCT/NO96/00077 and in Norwegian patent No. 300943, where the control module comprises a finger-grip or button that is mounted on a horizontally sliding plate (guide plate) . This "stick- and-plate" concept utilises several different signal- generating systems (sensors) . A preferred embodiment employs a concentrated light beam (generated by a diode laser or LED) , which by means of the control module is directed towards an addressable photosensor matrix. The position of the light spot, appearing where the beam hits the sensor matrix determines the horizontal position of the control module. Movements of the button may thus be used to control movement or position of the cursor .

One disadvantage of the stick-and-plate concept as earlier described (PCT/NO96/00077) is that the optoelectronic sensor system demands several electrical connections to the control module, potentially causing restriction of movement. This inventor has surprisingly discovered that the weaknesses of the speckled track-ball, the Intellimouse™ and previously described stick-and-plate concepts can be eliminated if the irregular pattern as used on the surface of the speckled track-ball instead is applied to the lower surface of the guide plate used with the stick-and-plate concept. By doing this, the precision and scalability of the stick-and-plate concept may be fully utilised to create a compact control unit suitable for incorporation in miniature computer and communication devices.

Although the speckled ball as originally disclosed in U.S. Pat. 5,288,993 and U.S. Pat. 5,703,356 utilised a distinct surface pattern, modern photosensor matrices are capable of detecting minute variations in a surface structure. This is taken advantage of by e.g. the Intellimouse™, which may be used on top of a white surface that contains no other pattern than the surface structure itself, which will create minute shadows when illuminated at an angle less than 90°, preferrably less than 45°. Based on this wide application range of the sensor concept, the surface pattern utilised by the present invention may consist of spots, lines, geometric figures or other shapes that may be printed, painted, etched, engraved, or consisting of surface irregularities stemming from a template or cast used in the production process, or be due to inherent properties of the surface material.

According to the present invention, the signal generating system employs an opto-electronic sensor that is capable of detecting X-Y motions of the control module, whereby a photo-sensor matrix, in association with a set of suitable optical members, a signal processor, a memory, and other electronic utilities, captures sequential pictures of the patterned, lower surface of the guide plate which is being illuminated by diffuse light. The processor/analyser associated with the sensor matrix can interpret signals from said matrix and transform them into control signals that may be used to control movements and location of cursor or object on a display or PC screen.

This inventor has also surprisingly discovered that a segmentation of the pattern may be used for control purposes, a particular asset of this stick-and-plate based invention that distinctly differentiates it from the speckled track-ball and the Intellimouse™, as neither of them are allowing such segmentations. In one embodiment, the rim of the patterned area has a higher reflectivity than the central part . This implies that when the rim enters the focal area of the sensor matrix, this is immediately detected by a set of photosensor pixels that will receive light of higher average intensity than the remaining pixels. The analyser logic will interpret this as being due to the control module approaching the border of its mobility range, and hence activate certain program functions.

Such program functions are particularly useful in connection with the stick-and-plate concept, where movement of the control module is restricted to within a certain delimited area (mobility range) , and functions are needed to prolong motion control of cursor or object when the control module reaches the border of said mobility range. Such functions are e.g.: a) Transition from congruent to vectorial control mode. When the control module is moved in the central part of its mobility range, sequential pictures of the plate pattern taken by the sensor matrix will generate signals that support a congruent cursor control mode, where the motion of cursor mimics motion of control module. When the sensor matrix senses the approach of the fringe zone, a vectorial control mode is instigated, supporting a sustained cursor movement. The vector controlling the movement is based upon the speed and direction of the control module immediately before entering into the fringe zone, this information being recorded by the memory of the sensor or control unit. b) Cursor leap to display border. When the control module enters the fringe zone at a speed above a certain, pre-determined limit, this will immediately move the cursor or object to the accompanying display border. c) Re-positioning function. When the control module enters the fringe zone, a program loop is initiated whereby an analyser circuit connected to the signal processor determines which border or fringe zone segment is involved. The signal processor will interrupt the signal transmission to the object control unit (PC, communication device, etc.), or otherwise give instructions that will terminate any motion of cursor or object, allowing the control module to be retracted from the border without this having any effect on the position of cursor or object. When the analyser detects that retraction has ceased and movement towards the involved border is resumed, the signal processor will re-establish signal transmission or give instruction that movement of cursor or object is resumed. This program will be running as long as the re-positioning function is active.

The activation of functions previously described may be achieved in many different ways, where the use of a segmented pattern is one of several options . Instead of using a rim with higher reflectivity, the same result can, of course be obtained by reducing the reflective properties of the rim. The same result may also be obtained by employing different switch arrangements. By using position-based switch functions whereby different switches are activated depending upon which part or segment of the border is approached by the control module, a switch activation of the described functions can be achieved. Such switch arrangements may be based upon electromechanical or opto-electronic switch concepts .

The described arrangement of a photosensor matrix taking sequential snap-shots of the lower surface of the guide plate also permits a construction whereby there is no need for any electrical connections to the control module itself, as e.g. would be the case if the module incorporated switch functions. Such switch functions may instead be activated indirectly, by having depressions or inclinations of the control button activate switch functions that are associated with other parts of the control unit. This is achieved by mechanical transmissions. The same results may also be obtained by opto-electronic means, by having the control module or part of the control module interrupt beams between a light emitter and a photosensor. Such arrangements are known to persons skilled in the art, and examples of indirect switch activation are hereafter mainly limited to electro-mechanical concepts, without this in any way excluding the use of opto-electronic and other switch concepts .

According to the present invention, a cursor control unit is described comprising a button or finger-grip that is mounted on a horizontally sliding plate (guide plate), together constituting the device's "control module" . The button is generally cylindrical with a diameter of 5-20 mm and a height of 2-20 mm. The guide plate has restricted mobility, being limited in its movement to an area of the plane that is equivalent to a square or circle with a diameter of 5-50 mm (the "mobility range") . The shape of the mobility range is preferably square or rectangular (with rounded corners) , or circular. The plate and button is in its "normal position" when placed in the centre of the mobility range. The guide plate is moved by means of the button, e.g. by putting a finger on top of, or seizing it by two fingers .

The signal generating system comprises a light source that is mounted under the guide plate, illuminating the lower side of the plate with diffuse light. This side of the guide plate has a pattern that is imprinted, engraved, etched or otherwise applied to the surface, providing patch-like reflections when illuminated by the light source. By taking rapid snap-shots of the plate pattern, the photo-sensor matrix (CCD, etc.) in conjunction with an analyser circuit/microprosessor is capable of detecting horizontal movements of the control module. By comparing sequential "pictures" of the plate pattern, the analyser is capable of determining speed and direction of movement, e.g. by means of fuzzy logic. This information is used as basis for generating signals that are used for cursor or object control. Properties of this system are otherwise described in U.S. Pat. 5,228,993.

The plate pattern may otherwise be segmented, e.g. by using different patterns in the centre and in the peripheral parts, giving rise to differences in reflectivity. Such differences will be detected by the sensor matrix when parts of both segment types are positioned within in the focal area of the sensor matrix.

Preferred embodiments of the invention will now be described by means of examples with reference to accompanying figures, where:

Fig. 1 illustrates a mobile communication device utilising the described control unit.

Fig. 2 illustrates a vertical cross-section of the control unit .

Figs. 3A - Fig. 3c are schematic illustrations of three different plate patterns.

Fig. 4 illustrates a vertical cross-section of the optoelectronic sensor.

Fig. 5 illustrates horizontal movement of the button of the control unit . Fig. 6 illustrates a two-component reflection pattern, one pattern located in the centre and another at the border.

Fig. 7 illustrates a reflection pattern where the border pattern reflects light at a higher intensity than the central pattern.

Fig. 8 illustrates a reflection pattern where the border pattern reflects light at a lower intensity than the central pattern.

Fig. 9A - Fig. 9C illustrate the movement of a two- component pattern across a sensor matrix.

Fig. 10A - Fig. IOC illustrate a different movement of a two-component pattern across a sensor matrix.

Fig. 11A - Fig. 11C illustrate movement of a cursor accompanying the movement of a two-component pattern across a sensor matrix, as illustrated in Figs. 10A - IOC.

Fig. 12 illustrates a vertical section of a control unit using a control module without electrical connections, where switch functions are located in the non- oveable part of the unit .

Fig. 13 is a top view of the control unit illustrated in Fig. 12.

Fig. 14 illustrates a vertical section of the control unit according to Fig. 12, where the control button is inclined and activates a switch function.

Fig. 15 illustrates a vertical section of a control unit with one set of switch functions localised below the sensor chamber and another at the periphery of the control module's mobility range.

Fig. 16 illustrates a vertical section of part of a control unit, utilising an alternative switch function.

Fig. 17 is a detail of the switch function utilised by the unit illustrated in Fig. 16.

Fig. 18 is a horizontal section of members of the switch function utilised by the unit illustrated in Fig. 16.

Fig. 19 is a top view of a partial, horizontal section of a spring-loaded, electro-mechanical switch function, activated by a square guide plate.

Fig. 20 is a top view of a partial, horizontal section of an opto-electronic switch function, activated by a circular guide plate.

Fig. 21 is a top view of a partial, horizontal section of a spring-loaded, electro-mechanical switch function, activated by a circular guide plate.

Fig. 22 illustrates a series of logical operations used in connection with a re-positioning function.

A more detailed description of the different parts of the control unit and its application are presented below.

Fig. 1 illustrates a multipurpose communication device 1 showing the button 2 of an incorporated cursor control unit. In Fig. 2, a cross section of the control unit shows that the button 2, including a switch function 3 is mounted on a horizontally sliding guide plate 4. An opto-electronic sensor system 5 is mounted in a detector housing below the guide plate 4.

PJ en Mi M TJ ^ i-i H rr t TJ μ. N rr & 1 O 3 P. O iQ Φ en ^ 3 O PJ TJ rr en i ^fτl

Ω ^ o Φ P> H- Φ φ ø" tr PJ 0 0 ø" H- H- Hi δ H- o TJ ø 3 Φ μ- PJ Ω TJ PJ ^J ø μ. μ- rr en O Hi rr iQ Hi Hi Φ Φ rr fJ- 0 Φ Mi ⁽Q < Hi rr H- H- ø ⁽Q rr Ω TJ rr Φ M Hi iQ

H- ( PJ H rr H rr H- φ Hi . rr Φ Hi _^-_^ H- Pi rr en Φ 0 M rr Ml Hi • φ h-> Φ Φ Φ φ Ω Hi Φ Ω . Ω Φ tr 3 0 O Ω Φ rr O M M μ- Φ O PJ φ J 3 Ω H o Ω Ω Φ M H J Φ H Ch Φ Φ en o PJ H- l-S ι(^ μ- M φ H TJ Ω M >

ΓT PJ rr 0 et et 0 H- 0 rr > 0 Φ ø Φ o H TJ ø PJ μ- P. 0 rr Φ Φ >

Φ rt M P- H- H- rr ø - Φ 0 rr 0 H- Ω rr •« H ιp en μ- M 0 en 0 0

0 Φ O H 1 O 0 1 IQ CL l-i rr H 0 H 3 J »< H • IQ rr 1 O rr 1 o PJ ø to 0 0 J Φ s; O PJ H ø O H- φ Φ rr P. en M O PJ Φ Hi ø ø en ^d en en ø^J 0 TJ rr Hi ⁽Q rr PJ Φ I-¹- rr 0 P. M TJ ^

CD Q o PJ H- N Φ •τ| rr PJ en H ø¹ Ω 0 Hi Φ en ø rr φ Φ rr PJ μ-

Φ Hi Hi O ιp Hi Hi TJ O H H- M PJ M rr O rr rr . en rfi. Hi 3 rr Φ tr Ω tr et iQ o M H M J 0 φ <Q H- M rr ϋ f-¹ tr — 0 H Φ μ- rr Φ et . n et ΓT O O O O M φ ø Φ en PJ Φ O • H¹ PJ en . — _^ PJ rr 3 H Φ tr tr 3 en Ό 3 3 rr rr Φ PJ . rr 3 ø 0 φ <_π rr O en TJ O (Q M CO

3 φ φ en O H> ø^J -j Φ o tr rr >-3 Pi - Φ ø ø ø ø O o rr rr et H> > Φ O J o en & ø O ^* _^ — en et M μ- μ- μ- en

H Pi en ø" PJ H- tr tr t H- Hi 0 0 ø rr Φ P> H- •fl tr Hi ø Ω p. J

CD μ- Φ Φ i~> Φ Φ . H- H QJ φ PJ rr rr Φ iQ H- μ- Φ J rr Φ en M i-h ø T \~> n H- rr Φ O ^* TJ 0 en 0^* ⁽P ø Ω Φ en Φ

Hi Hi en Hi tr C Ω Hi H iq ø ø^J PJ TJ TJ ^. 0 Φ en Φ rr . μ- Φ Pi Φ TJ ø φ o M o n (D H 0 iQ ø^J en Φ 0 PJ I-¹ en J Φ ø 3 ø ø -j en

0 1-5 ι-{ H- rr rr 0 H- H rr rr O H J to en rr en en rr t δ ^* O en PJ - Ω

O Φ 0 o H et 0 ^ Φ H TJ rr rr rr 3 Φ Φ _^ O O — φ Hi Φ O rr ^* rr 0 3 iQ en 0⁾ H IQ H- PJ H- J ^* ø^J H- Φ O rr ø H s; φ M ø M Φ oo φ

H- o PJ Φ Φ rr J Φ <Q rr 0 rr O Φ Ω tr O en TJ φ PJ φ φ rr ιp 3 I

O φ rr ø Φ Φ rr Φ rr H 0 TJ H- 3 O PJ rr 3 n 0 P. ø tr M en - — rr J H

0 H N en N M Φ en O J h-¹ PJ H rr Ω J Pi Ω Φ rr Φ PJ ^ TJ tr rr

W H- μ. O o rr TJ O 00 ø en TJ PJ rr H- H rr . rr en O rr en J μ-

«• 0 X 0 H tr PJ 0 rr en J Φ PJ H rr rr OJ 3 Φ 3 J cn to, Φ rr PJ rr Ω φ Φ H Φ rr tr H- ø rr Φ en PJ M H- rr TJ μ- rr 0 P. Φ rr

Φ 3 rr tr J rr rr en rr TJ H et 0 J X tr J M μ. 3 Φ 3 μ-

. H- Φ H- PJ T h-¹ Φ ø ^ O Φ PJ ø M rr M ø Φ en ø Pi ! I-¹

(Q ⁽Q 0 en rr PJ H¹ υi O et PJ tr H- H-

. Pi 3 en rr Ω Φ Φ _^ TJ ^ tr PJ H en ιfc=- H- o o ø et Ω 0 Φ X cn φ H- tr et rr σi PJ ø et tr φ H- en • H- ø Hi Hi TJ 3 Φ 0 iQ PJ 3 O ø φ ø T Ω - rr tr en

PJ ø X PJ en et PJ PJ H 0 Φ ø M ^ s; iQ M h-ⁱ tr rr Φ rr

H- μ- ΓT iQ Φ M M M rr OJ 0 en • TJ •fl Φ TJ φ Φ o Φ PJ φ ^•^ Φ M

H ø ø Φ H¹ Φ 0 Φ Φ rr H- TJ μ- Hi 0" M M PJ TJ rr Pi μ- M 0 P⁾

Φ rr <Q H > Φ en Hi Hi H- H- H> en Φ ⁽Q o rr O Φ *- ip 0_^ en rr

1 Φ H- • 0 en H- f X 0 CO rr M • Φ rr Ω en O H) _^ . Φ μ-

TJ 0 rr ø Mi en rr Φ Φ Φ H- Ω O O ø μ- 1 O Pi O o en tr iQ H Ω Ω Hi I-¹ rr PJ ø ( l rr en 3 M ⁽Q Φ rr O M

PJ 0 en H- Φ 0 0⁾ rr rr rr ø^J TJ iQ Φ Φ Φ TJ Hi ⁴ H tr M en O en

H- rr H- ø^J O H- H- Φ Φ TJ Hi H- Pi ø 1-5 PJ rr Φ Φ O • ø rr n 0 i T PJ Ml o O Ω H- Φ O rr en H- Ω Ω 0 et TJ O

H- Φ rr H- ø 0 ø rr cn Hi PJ Hi tr O en Φ en et en ⁾ tr Ml P> rr Hi o n- 0 O tQ PJ en en H- H M Ω 0 M H- O M ø rr Φ tr t

0 O en . rr O H- < H- P- rr O en ø O ø O K. ø M Φ rr Φ

H- o rr Φ H) <Q Hi Hi Φ 0 0 :> H rr 3 iQ Mi t 0 Hi M $

0 H tr o 0^* H ϋ ⁽Q <Q O 0 M PJ Ω μ- P> PJ μ- TJ O iQ Φ O rr o O Φ Φ PJ rr rr Φ Ω Ω en Hi O 3 3 H- M rr H ø^J Φ φ PJ 0 Φ H- Φ so rr Φ en X Φ M

Here, two micro-switches 29 are located below the sensor housing 28. Although this device incorporates two or four switch units 29 (only two shown) , the illustrated construction does not permit more that one switch function (on/off) , which is activated and de-activated when the button is depressed and released in any horizontal position.

The control unit illustrated in Fig. 15 furthermore incorporates a switch function 40, 41 that is activated when the control module and its guide plate are pushed towards the border of its mobility range. This switch function is spring-loaded and has four switch positions, as illustrated in Fig. 19. Here, the switch function comprises an outer 40 and an inner 41 frame that are held in position relative to each other by means of four springs 45. Four sets of lead contacts 42, 43 are located between the two frames . Depending upon which part of the inner frame is approached by the guide plate 39, this will determine which switch is going to be activated. The described switch function may be used in connection with the re-positioning utility. A similar construction is shown in Fig. 21, instead employing a circular guide plate 52.

An alternative electro-mechanical switch that is useful in connection with the re-positioning utility is shown in Fig. 16 - Fig. 18. Here, a segmented connector 32 located on the shaft of the button 30 establishes contact between the two members of one of four lead couples 33, 34, 35, 36 when the control module is pushed against the border of its mobility range. This is illustrated in Fig. 17. The connector 32 is segmented in order to avoid contact between two lead couples when the button is pushed into a corner.

TJ PJ H o ø Φ en Pi en μ- ø rr rr 3 μ- tr φ

0 Φ i

0 μ. TJ en

0 so

⁽Q O • iQ

M ι-3

0 J ø^J

0 3 Φ

Ω rr Z TJ

H- μ- M o μ- o

0 ⁽Q

M μ- tr J en Φ 3

PJ H- Φ

Ω 0 X rr ø Φ μ- ø Ω

< μ- ø

PJ ø rr rr iQ μ-

Φ o

Pi PJ 0 en rr

M tr

0 Φ ø ø

⁽Q

H,

PJ Φ en rr ø rr M ^* ø

Φ en

M rr

Φ 0

1 en

Claims

Patent claims

1. Control unit for positioning and control of PC cursors and other objects, where the device incorporates a control module that comprises a control button mounted on a guide plate; the guide plate being moveable in all directions in the X-Y plane by means of the button; where the motion or position of the control module in the X-Y plane is detected by an opto-electronic sensor means encompassing a light source, a photo-sensor matrix and a processor that can interpret signals from the photo-sensor matrix and transform them into control signals that may be used to control movements and . location of said cursor or object on a display or PC screen; characterised in that the opto-electronic sensor is capable of detecting X-Y motions of the control module when the photo-sensor matrix, in association with a set of suitable optical members, a signal processor, a memory, and other electronic utilities, captures sequential pictures of the lower side of the guide plate, which is being illuminated by diffuse light.

2. Control unit according to claim 1, characterised in that the surface of the lower side of the guide plate contains a pattern that yields light reflections of different intensity than the background.

3. Control unit according to claim 2, characterised in that the pattern consists of spots, lines, geometric figures or other shapes that may be printed, painted, etched, engraved, or consisting of surface irregularities stemming from a template or cast used in the production process, or be due to inherent properties of the surface material.

4. Control unit according to claims 2-3, characterised in that the gross appearance of the pattern is different across the surface, depending upon the location.

5. Control unit according to claim 4, characterised in that the appearance is different at the rim of the patterned area; this different pattern entering into the focal area of the sensor matrix when the control module enters into the fringe zone of its mobility range.

6. Control unit according to claim 5, characterised in that the entrance of the rim of the patterned area into the focal area of the sensor matrix and the associated entrance of the control module into the fringe zone is used for cursor control purposes.

7. Control unit according to claims 1-3, characterised in that the unit is equipped with a switch function that is activated when the control module enters into the fringe zone and is pushed towards the border of its mobility range; where different switches are activated depending upon which part or segment of the border that is approached.

8. Control unit according to claim 7, characterised in that the speed of entrance into the fringe zone of the mobility range is recorded and used for cursor control purposes when the switch function is activated.

9. Control unit according to claims 6-8, characterised in that when the rim of the patterned area enters into the focal area of the sensor matrix or the switch function is activated, motion control mode is changed from congruent to vectorial, where the speed of entrance and direction of entrance of the control module into the fringe zone define the size and angle of the vector; this vector defining the speed and direction of a sustained motion of cursor or object.

10. Control unit according to claim 9, characterised in that a spring-loaded frame or other device member ensures that the entrance of the control module into the fringe zone is sensed by the operator.

11. Control unit according to claim 6-10, characterised in that when the control module enters into a particular segment of the fringe zone above a pre-determined speed, the cursor or object is moved instantly to the corresponding border segment of the display.

12. Control unit according to 6-8, characterised in that when the rim of the patterned area enters into the focal area of the sensor matrix or the switch function is activated, a re-positioning function is automatically activated; where an activation of the re-positioning function allows the control module to be moved in a direction away from the involved segment of the outer border or fringe zone without this being accompanied by a movement of cursor or object; where resuming the movement of the control module towards the same segment of the outer border or fringe zone reactivates the control module's motion control of cursor or object.