« PreviousContinue »
COMPUTER KEYBOARD WITH
SWITCHABLE TYPING/CURSOR CONTROL
CROSS-REFERENCE TO RELATED
This application discloses subject matter similar to that illustrated and described in copending U.S. application Ser. No. 08/863,870 now U.S. Pat. No. 5,821,922, filed on May 27, 1997, entitled "COMPUTER HAVING VIDEO CONTROLLED CURSOR SYSTEM", and assigned to the same assignee as this application.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention generally relates to electronic apparatus and, in a preferred embodiment thereof, more particularly relates to cursor control systems for computers.
2. Description of Related Art
A variety of display screen cursor control systems have previously been utilized on or adjacent the keyboard portion of both desktop and portable computers. These cursor control devices include mice, trackballs, touchpads and pointing sticks.
The computer mouse is basically a small housing which has a ball on its underside that is rolled by the computer user along a horizontal support surface adjacent the keyboard in response to hand movement of the mouse housing parallel to the support surface. The sense and speed of the rotation of the mouse ball is monitored and appropriately converted to a positional output signal used to correspondingly reposition the cursor on the computer. The mouse housing typically has at least one "pick" button thereon which may be depressed to select an icon to which the cursor has been moved, or simply to select a desired screen location.
A track ball is basically an inverted mouse with the ball facing upwardly for direct manipulation by the computer user's fingers. The track ball is typically mounted on the base housing of a portable computer adjacent one or more "pick" buttons associated with the ball.
A touchpad typically has a small, generally planar rectangular surface along which the user runs his finger in the desired direction of cursor movement. A sensing structure beneath the user-engaged surface converts his finger movements to appropriate cursor movement signals. As in the case of the track ball and mouse, the touchpad is typically placed adjacent one or more manually depressible "pick" buttons.
A pointing stick is typically placed among and projects upwardly beyond a group of keyboard key cap members— usually in a generally central location of the keyboard between the user's index fingers in their "home" typing positions. Either index finger may be used to tilt the vertically oriented pointing stick in the desired direction of cursor movement, with a pressure sensing base portion of the pointing stick structure detecting the rocking movement of the stick and transforming the detected stick into corresponding cursor movement signals.
A recent potential addition to these types of cursor control devices, a two dimensional optical digitizer device, is illustrated and described in pending U.S. application Ser. No. 08/486,310, filed on Jun. 7, 1995, and pending U.S. application Ser. No. 08/651,881, filed on Jun. 4, 1996, each of such pending applications being assigned to the same assignee as this application. These digitizer devices utilize a
single source of light to form a generally planar two dimensional light pattern disposed over and generally parallel to a computer keyboard. A finger placed in the light pattern interrupts a corresponding portion thereof, with the interruption location being sensed and used to transmit positional information to the display screen to selectively move a cursor thereon. A remote switch is used to activate this optically scanned cursor control mode, in which the movement of the user's hand in the scanned is used to correspondingly move the display screen cursor, and to return the keyboard to its typing mode.
Various problems, limitations and disadvantages are typically associated with these previously proposed types of cursor control devices and systems. It is to these problems, limitations and disadvantages that the present invention is directed.
For example, the computer mouse requires a substantial amount of unobstructed desktop space adjacent the keyboard to be moved around in. Also, many computer mice are configured for right hand use, making them awkward for the left-handed user. The trackball is typically integrated into the system keyboard area in a fixed location which is usually a compromise based on where there is space in the system. Accordingly, the trackball can often be somewhat awkward to use.
The touchpad, like the trackball, is typically integrated into a fixed area of the system keyboard structure. Additionally, the touchpad usually has a relatively small surface area along which the user's finger can be moved to correspondingly move the display screen cursor. Accordingly, the touchpad tends to be rather inconvenient to use when long cursor movements are required.
The pointing stick is the smallest of the conventionally utilized cursor positioning devices and thus may be very compactly located on the keyboard structure. However, the small size of this device makes it somewhat difficult for some users to properly engage and use cursor control and repositioning. Additionally, since the pointing stick is usually centrally located in the keyboard it often must be separated a substantial distance from its associated selection buttons. This, too, is often considered undesirable by computer users. Moreover, due to the "rocking" motion that must be imparted to the pointing stick to operate it, the use of the stick is considered by many users to be at least to some degree counterintuitive.
The optical digitizers mentioned above require for the generation and maintenance of their two dimensional optical fields above and generally parallel to the keyboard a variety of reflector, interceptor and light generating members mounted in exposed orientations on the keyboard. Additionally, these digitizer systems require, for a switchover between their typing and cursor control modes, that a control member located out of the sensing area of the optical scanning area be pressed and held down during the cursor control mode, and released when it is desired to return to the typing mode of the keyboard.
Like various other forms of cursor control associated with a computer keyboard, this requires the user to remove his hand or hands from the home row key position, thereby reducing the efficiency of using the keyboard and cursor device. Keeping the hands in the home row position is the main reason for having the cursor control device located over the keyboard. Having to manipulate a button or other control member located off the keyboard area, for either cursor positioning or selection operations, can be fatiguing and inconvenient, and can limit single hand operation of the cursor control device.
It would thus be desirable to provide apparatus which would enable a computer user to selectively and reliably switch between a typing and cursor control mode while maintaining his hands generally in their home row typing position above the keyboard, and move the display cursor 5 and perform related pick functions while maintaining his hands above the keyboard.
SUMMARY OF THE INVENTION
In carrying out principles of the present invention, in 1° accordance with a preferred embodiment thereof, computer apparatus is provided that comprises a keyboard having a series of manually depressible keys disposed on its top side, the keys having a home typing row, and a screen upon which a movable cursor may be displayed. Representatively, the 15 computer apparatus is a portable notebook computer, but the keyboard may also be, for example, the keyboard portion of a desktop computer system.
Incorporated in the computer apparatus is an observation system which is operable to monitor a three dimensional 20 observation zone extending along the top side of the keyboard. Representatively, the observation system includes a video camera supportable in an elevated relationship with the keyboard and operative to monitor the observation zone.
The computer apparatus also includes control circuitry associated with the observation system and having a typing mode and a cursor control mode. The control circuitry, when in its cursor control mode, is operative in response to detection by the observation system of a control movement of a hand of a user (or another object) through the observation zone to generate a control signal and use the control signal to move the cursor on the screen in a manner corresponding to the detected control movement.
A manual switch structure is associated with the keyboard 3J and is operable to selectively switch the control circuitry between its typing and cursor control modes. With the system switched to its typing mode, hand movement through the observation zone has no effect on the cursor position.
In a preferred embodiment of the invention, the control 40 circuitry is further operative to differentiate between different configurations of the user's hand within the observation zone and alter the control signal in different manners correlated to each configuration. For example, in addition to tracking the movement of the user's hand in a first configu- 45 ration thereof through the observation zone when the system is switched to its cursor control mode, and correspondingly moving the cursor on the screen, the control circuitry is further operative to alter the control signal in a manner using the cursor to select an area of the screen in response to the 50 presence of the user's hand in a second, "pick" configuration within the observation zone.
In accordance with another aspect of the invention, the control circuitry is further operative to switch from the cursor control mode to the typing mode not only in response 55 to the use of the manual switch structure, but also in response to the sequential detection by the observation system of a withdrawal of the user's hand from the observation zone, the re-entry of the user's hand into the observation zone, and the depression of one of the keyboard keys. 60
According to other features of the invention, the switch structure is reachable and operable by a user of the computer apparatus while the user's fingers generally remain on the home typing row of the keyboard keys. The switch structure has a depressible actuation portion projecting upwardly 65 between a plurality of the keys. The actuation portion may be pressed and released to activate one of the typing and
cursor control modes, and then pressed and released again to activate the other mode. Visual indicia means are operative to provide the actuation portion with a first appearance in response to activation of the typing mode, and a second, different appearance in response to activation of the cursor control mode. Preferably, the visual indicia means are operative to provide the switch structure actuation portion with a first coloration in response to activation of the typing mode, and a second coloration in response to activation of the cursor control mode.
In a preferred embodiment of the manual switch structure, its activation portion is a vertically oriented cylindrical plastic light tube member having a bottom end portion slidably extending through an opening in a housing disposed beneath the keys, and an upper end portion extending upwardly between an adj acent plurality of the keys. A toggle switch mechanism is disposed in the housing beneath the lower end of the light tube, is operatively connected to the control circuitry, and is actuated each time the light tube member is downwardly pressed by the computer user.
Also disposed within the housing, and operatively connected to the control circuitry, is a two-color LED light element which is switched from one of its colors to its other color each time the light tube is depressed. The light element alternately illuminates the light tube in these two colors each time the switch is activated by the user, thereby providing the user with a visual indicia as to whether the computer is in its typing mode or its cursor control mode.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a simplified perspective view of a representative portable computer incorporating therein a specially designed video controlled cursor system embodying principles of the present invention;
FIG. 2 is a reduced scale simplified top plan view of the portable computer and illustrates a video camera-monitored cursor control hand observation zone;
FIG. 2A is a reduced scale simplified front side elevational view of the portable computer and also illustrates its cursor control hand observation zone;
FIG. 3 is a simplified, highly schematic block diagram of the computer circuitry in the cursor control system;
FIG. 4 is an enlarged scale top plan view, taken along line 4—4 of FIG. 1, of a specially designed typing/cursor control mode selection switch structure embodying principles of the present invention;
FIG. 5 is an enlarged scale schematic cross-sectional view through the switch structure taken along line 5—5 of FIG. 4;
FIG. 6 is a schematic top plan view of the cursor control hand observation zone and illustrates a user's hand positioned therein and being used in a first predetermined configuration to move the computer's display screen cursor;
FIG. 6Ais a schematic illustration of the computer display screen showing the cursor operation resulting from the user hand movement in FIG. 6;
FIG. 7 is a schematic top plan view of the cursor control hand observation zone and illustrates a user's hand positioned therein and being used in a second predetermined configuration to execute a cursor "pick" function;
FIG. 7Ais a schematic illustration of the computer display screen showing the pick function being generated in response to the user's hand control shown in FIG. 7;
FIG. 8 is a schematic flow diagram illustrating the operation of the computer circuitry in the cursor control system; and
FIG. 9 is a simplified perspective view of a representative alternate mounting of the video camera portion of the cursor control system on a desktop computer system keyboard.
Perspectively illustrated in simplified form in FIG. 1 is a representative portable notebook computer 10 that incorporates therein a specially designed video controlled cursor system which embodies principles of the present invention and is subsequently described in detail herein. The portable computer 10 is shown resting atop a suitable horizontal support surface, such as a desktop 12, and includes a rectangular base housing 14 having top and bottom sides 16 and 18, front and rear sides 20 and 22, and left and right ends 24 and 26. A keyboard assembly 28, having individual keys 29, is mounted on a rear portion of the top side 16. For reasons later described herein, a central rectangular recess 30 is formed in the top side 16 of the base housing 14 in front of the keyboard assembly 28.
In addition to the base housing 14 the computer 10 also includes a somewhat thinner rectangular lid housing 32 which is hinge-secured, as at 34, to a rear top side portion of the base housing 14 for pivotal movement relative thereto (as indicated by the double-ended arrow 36 in FIG. 1) between a generally upright open use orientation (shown in FIG. 1) in which the lid housing 32 exposes the keyboard 28, and a downwardly tilted closed storage and transport orientation in which the lid housing 32 extends across and parallel to the top base housing side 16 and covers the keyboard 28. Suitable latch means (not shown) are provided for releasably locking the lid housing 32 in this closed storage and transport orientation thereof.
Lid housing 32 has a rectangular display screen 38 mounted on the front or inner side 39 thereof, the display screen 38 facing forwardly and being exposed to user view, as shown in FIG. 1, when the lid housing 32 is in its open use orientation. The computer 10 is provided with display screen circuitry 40 (see FIG. 3) which is operative to display on the screen 38 a cursor 42 and a selectable icon 44. As later described herein, cursor control circuitry 46 (see FIG. 3) may be operated to selectively move the cursor 42 upwardly, downwardly, leftwardly and rightwardly along the display screen 38 as indicated by the movement arrows adjacent the cursor 42 in FIG. 1.
Referring now to FIGS. 1-3, the video controlled cursor system 50 includes a small video camera 52 centrally mounted on and projecting outwardly from a top portion of the lid housing front side 39 above the top edge of the display screen 38. When the lid housing 32 is closed, the outwardly projecting video camera 52 is protectively received in the base housing top side recess 30. With the lid housing 32 opened, the video camera 52 monitors a three dimensional in-focus observation zone 54 disposed over a front top side portion of the base housing 14 (see FIGS. 2 and 2A).
According to a key aspect of the present invention, in a manner subsequently described herein the computer 10 is provided with switchable typing and cursor control modes. With the system switched to its cursor control mode the camera-monitored observation zone 54 is used as a cursor control area within which a hand of the computer user may be manipulated in one predetermined configuration to move the cursor 42 around the display screen 38, and then placed in a second predetermined configuration to perform a selection or "pick" action once the cursor is relocated to a desired position on the screen. The system 50 automatically senses
both the position and configurations of the cursor control hand and correspondingly repositions the cursor and generates the desired pick function in conjunction with the repositioned cursor. When the computer 10 is switched to its typing mode, hand movements through the observation zone 54 have no effect on the cursor position.
To permit the computer user to very quickly and reliably switch back and forth between the typing and cursor control modes, the present invention provides a specially designed switch structure 56 which is shown in FIGS. 1, 4 and 5. Switch structure 56 includes a vertically oriented cylindrical switch member 58 which is conveniently positioned in a central location of the "home row" of the keys 29—preferably between the "G", "H" and "B" keys 29 as shown in FIG. 4. The switch member 58 is preferably a clear plastic light tube and has, as best illustrated in FIG. 5, an upper tip portion 58a that projects upwardly past the top sides of the adjacent keys 29.
A lower end portion of the switch member 58 slidably extends downwardly through a circular opening 60 in the top side of an underlying housing 62 (see FIG. 5) and engages the top end of a conventional push-push type electrical toggle switch 64 disposed in the housing 62 next to a two color LED light element 66. The toggle switch 64 and the LED light element 66 are respectively coupled to the cursor control system 50 by electrical leads 68 and 70. With the system in its typing mode, the light 66 is switched to its first color (for example, red) so that the exposed upper tip 58a of the switch member 58 is also red to provide the user with a visual indication that the system is in the typing mode.
To quickly switch the system to its cursor control mode, while the user's hands are still conveniently in their home row typing positions on the keys 29, the user simply reaches over with one of his index fingers and pushes down on the upper end of the switch member 58, as indicated by the arrow 72 in FIG. 5, and then releases the switch member 58. The downward movement and subsequent release of the cylindrical switch member 58 changes the underlying toggle switch 64 from its typing mode configuration to its cursor control mode configuration and thus, via the leads 68, switches the system 50 from the typing mode to the cursor control mode. When this occurs, the system 50 operates to change the LED light from its typing mode color (representatively red) to its cursor control mode color (representatively green). The release of the switch member 58 permits a spring structure in the underlying toggle switch 64 to vertically return the switch member 58 to its original position in which its now green upper end portion 58a is exposed to view to provide the computer user with a visual indicia that the system has been switched to its cursor control mode.
With the system 50 switched to its cursor control mode, the user can move one of his hands through the cameramonitored observation zone 54 to move the cursor 42 and carry out an associated "pick" function as later described herein. When the user is ready to return the system to the typing mode he simply depresses the switch member 58 again, thereby clicking the toggle switch 64 again and returning the LED light (and thus the switch member 58) to its original red color. Alternatively, the user can remove his control hand from the in-focus observation zone 54 and then re-enter the zone 54 and press any of the keys 29 with one of his fingers. As later described herein, the system 50 is operative to sense the withdrawal of the control hand from the zone 54, and the hand's re-entry into the zone 54 and subsequent depressing of one of the keys 29, and responsively re-activate the typing mode without the depression of the switch member 58.