US20100309122A1 - Pointer controlling apparatus - Google Patents
Pointer controlling apparatus Download PDFInfo
- Publication number
- US20100309122A1 US20100309122A1 US12/733,874 US73387410A US2010309122A1 US 20100309122 A1 US20100309122 A1 US 20100309122A1 US 73387410 A US73387410 A US 73387410A US 2010309122 A1 US2010309122 A1 US 2010309122A1
- Authority
- US
- United States
- Prior art keywords
- pointer
- predetermined area
- control mode
- position information
- predetermined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
- The present invention relates to a controlling apparatus and a method for controlling a graphical user interface (GUI) which includes a pointing device such as a mouse. In particular, the present invention relates to a pointer controlling apparatus and a method for changing a moving speed of a pointer between inside and outside a selected area on a display screen indicated by the pointing device in order to improve GUI operability.
- A method of controlling a pointing device such as a mouse, selecting an area with program functions that are indicated by buttons, a slide bar, or the like, and implementing the functions provided to the area (hereafter referred to as ‘selection area’) has been implemented by various user-friendly controlling apparatuses and methods using generally called GUI. With the GUI, in order to select an area such as a button, and implement a function provided to the area, a user must move a pointer of a pointing device such as a mouse into the area, and ensure selection of the area.
- At this time, a position determining means for determining that a pointer such as a cursor exists within the area is essential. Such position determining means is a well-known technology, and is used on GUI software such as Windows (registered trademark), Mac OS (registered trademark), and the like.
- If the pointer exists within the selection area, it is preferred that the pointer can select not the boundary of the area but the center thereof with certainty in order to ensure selection of the area and prevent erroneous operation. For example, users may select the center of the selection area with certainty by automatically moving the pointer to an area adjacent to the center of the area when the pointer has crossed over a boundary of the area from outside to inside. A technology to automatically move a pointer to a central coordinate position is disclosed in Japanese Unexamined Patent Application Publication No. H8-152971, and has already been put into practical use as a software keyboard.
- Further, there are other methods of ensuring selection of the selection area to prevent erroneous operation. For example, there is a method of making the moving speed of the pointer displayed on the screen slower than the usual movement speed of the pointing device when a pointer exists within the area, or fixing the pointer displayed on the screen until the pointing device moves a predetermined distance or greater. Such technology is disclosed in Japanese Unexamined Patent Application Publication No. H10-133822. This method allows prevention of erroneous operation and selection of a desired area with certainty because the pointer does not move outside of the selection area due to shaking of hands, clicking, or the like as long as the pointing device on hand does not move widely.
- There are many screen inputting apparatuses to which GUI is applied. For example, conventionally, in an image editing field, images have been edited using a video playback and storing apparatus and a video editing apparatus. However, advancement of computer technology allows implementation of editing on an editing screen by selecting a function select button or the like provided on the same screen while checking an image being edited.
FIG. 1 is a block diagram showing a display system which implements the video editing on a computer display. According to the display system shown in the drawing, an image filmed by a video camera or the like (not shown in the drawing) is stored in an image storing means 110. Operators may edit video images using anediting computer 180 and an edit controlling means 130 while viewing them on an image displaying means 120. The edited images may be output from the image storing means 110 using an appropriate method. -
FIG. 2 shows an example of an editing screen in the image editing field described above. InFIG. 2 , GUI technology is applied for the selection of input/output channels (240), setting for selection and duration (230) of editing images, and the like. In addition, to implement detailed editing operations using an editing means on a computer screen, it is necessary to display many selection areas for implementing GUI functions, such as buttons, slide bars, and the like on the screen as illustrated inFIG. 2 . -
FIG. 3 is a diagram showing exemplary buttons displayed on an actual editing screen. When many selection areas are provided, the smaller a button-shape selection area, the more the amount of information to be provided on the screen increases. However, it becomes difficult to ensure that the pointer moves into an area to select a function provided to the area due to a decrease in selection area size, resulting in a deterioration of operability. -
FIG. 4 shows an example where many selection areas are provided in multiple rows and columns in order to compensate for the deterioration of operability due to the decrease in selection area size as described above.FIG. 4 shows an example of two rows×two columns. In such a screen including many selection areas, a problem of operability develops when attempting to select a first area by passing over a second selection area. For example, when the technology disclosed in the aforementioned Japanese Unexamined Patent Application Publication No. H10-133822 is used, a decrease in moving speed and suspension is repeated when moving a pointer to the center of the selection area and moving it within the selection area for each selection area along a pointer passing route. Accordingly, it takes time to reach a target selection area, resulting in an extreme deterioration of operability. In addition, a method of expanding an area when a pointer of a pointing device enters within the area has been proposed in attempt to improve certainty of function selection; however, this method has a disadvantage that the expanded area covers other areas and other displaying units. - As described above, it is difficult for the conventional methods to simultaneously meet demands of increase in the number of selection areas displayed on a screen per area, obtained by reducing the size of the selection area, and increase in accuracy when selecting a desired area using a pointer.
- Therefore, in order to solve the aforementioned problems, the present invention aims to provide a pointer controlling apparatus and a method which deploys a pointer at an appropriate selection position without decreasing operability by detecting and controlling position and moving distance of the pointer in given period when a pointing device is moved regardless of alignment and size of selection area.
- In order to solve the above-described problems, the present invention includes: a means for receiving position information of a pointer and determining whether or not the pointer has crossed over a boundary of a predetermined area from outside to inside; a means for determining change in position information of the pointer per unit time (moving speed) or whether or not an event such as a mouse click or the like has occurred, and setting two types of operating modes; a means for moving the pointer to a predetermined position within the predetermined area when the pointer has crossed over the boundary of the area from outside to inside; and a means for changing a moving distance of the pointer, if the pointer moves at a speed less than a predetermined moving speed or the event has not occurred and when it is determined that the pointer exists within the predetermined area, based on the change in the position information of the pointer per unit time determined when the pointer existed outside the predetermined area. It should be noted that the “moving distance” is sometimes defined for brevity as the distance in given period that the pointer is to be moved.
- The present invention will be described in further detail below.
- The determining means of the present invention receives position information of a pointer such as X and Y coordinates on a display screen, and determines whether or not the pointer has crossed over a boundary of a predetermined area from outside to inside based on position information of the boundary and information on change in the position of the pointer. Further, when the pointer has crossed over a boundary of the predetermined area from outside to inside, display of the area may be emphasized. For example, shape of the selection area may be changed (e.g., displays to indicate that a button is pressed), color or design may be changed, or the like.
- A means for determining moving speed of a pointer or whether or not an event has occurred, and setting two types of operating modes sets a first control mode when the change in the pointers position information per unit time is less than a predetermined value and a predetermined event has not occurred, and sets a second control mode when the mount of change exceeds or equals a predetermined value or a predetermined event has occurred. Here, the predetermined value, which may be a value preset by a user, may be continuously used, or may be changed according to size, amount, alignment of an area having a selection function such as a button displayed on a screen, or a request by an operator.
- The predetermined event is a clicking or a dragging operation of a mouse, for example, and may occur by an input operation using a button, a wheel, or the like provided on the pointing device, or combination of input operations of the pointing device and a key on an input device such as a keyboard and the like. In the first control mode, when it is determined that the pointer exists within the predetermined area, the moving distance of the pointer relative to the change in pointer position information per unit time is changed from the moving distance when the pointer exists outside the predetermined area. In the second control mode, the moving distance of the pointer relative to the change in the pointer position information per unit time is not changed regardless of being inside or outside the predetermined area.
- In the first control mode and when the pointer has crossed over the boundary of the predetermined area from outside to inside, means for moving the pointer to a predetermined position within the selection area automatically moves the pointer to the predetermined position within the selection area based on the result determined by a determining means for determining the predetermined position. The predetermined position within the selection area is position information automatically calculated from the position information such as coordinate position information and the like pre-input by a user, and desirably it is a center within the selection area, however, if the center cannot be identified due to the shape of the selection area, an appropriate position may be defined according to on-demand operation. In addition, for example, if functions (e.g., icons such as copy, paste, and the like) provided to the selection area are hidden due to movement of the pointer to the center of the selection area, a position which does not visually intercept the selection area may be intentionally specified in advance.
- In the first control mode, when the pointer moves closer to the center of the predetermined area, the moving distance of the pointer relative to the change in the pointer position information per unit time may increase compared to that when the pointer exists outside the predetermined area. In addition, when the pointer moves away from the center of the predetermined area, the moving distance of the pointer relative to the change in the pointer position information per unit time may be decreased compared to that when the pointer exists outside the predetermined area. Further, when the pointer moves away from the center of the selection area, movement of the pointer may be suspended for a predetermined duration even if change in the pointer position information per unit time occurs. Such behaviors of the pointer movement in the first control mode may be set or changed according to a request of a user.
- Another aspect of the present invention provides a controlling method and a controlling program comprising one or more processing steps, each corresponding to the aforementioned means.
-
FIG. 1 is a block diagram showing a display system which implements video editing on a computer display; -
FIG. 2 is a diagram showing an exemplary editing screen in an image editing field; -
FIG. 3 is a diagram showing exemplary buttons displayed on an actual editing screen; -
FIG. 4 is a diagram showing a display example when a selection area covers multiple rows and columns; -
FIG. 5 is a functional block diagram explaining a first embodiment of the pointer controlling apparatus of the present invention; -
FIG. 6 is a functional block diagram explaining the first embodiment of the pointer controlling apparatus of the present invention applied to the user interface controlling unit shown inFIG. 5 ; -
FIG. 7 is a flowchart explaining the first embodiment of the present invention carried out by the pointer controlling apparatus shown inFIG. 6 ; -
FIG. 8 is a flowchart explaining a second embodiment of the present invention carried out by the pointer controlling apparatus shown inFIG. 6 ; -
FIG. 9 is a diagram showing a display example of the first embodiment of the present invention carried out by the pointer controlling apparatus shown inFIG. 6 ; -
FIG. 10 is a diagram showing a display example of the first embodiment of the present invention carried out by the pointer controlling apparatus shown inFIG. 6 ; -
FIG. 11 is a diagram showing a display example of the second embodiment of the present invention carried out by the pointer controlling apparatus shown inFIG. 6 ; -
FIG. 12 is a diagram showing a display example of the second embodiment of the present invention carried out by the pointer controlling apparatus shown inFIG. 6 ; and -
FIG. 13 is a diagram showing a display example of a third embodiment of the present invention carried out by the pointer controlling apparatus shown inFIG. 6 . -
-
- 110 Image Storing Means
- 120 Image Displaying Means
- 130 Edit Controlling Means
- 180 Editing Computer
- 610 Pointer Controlling Apparatus
- 620 Pointer Position Determining Means
- 630 First/Second Control Mode Setting Means
- 640 Pointer Moving Means
- 650 Pointer Moving Distance Changing Means
- 660 Storing Apparatus
- Preferred embodiments of the present invention will be described below with reference to the accompanying drawings.
-
FIG. 5 is a functional block diagram explaining a first embodiment of the pointer controlling apparatus of the present invention - When a pointer controlling apparatus of the present invention is applied to a video image editing system, it is configured with an input/
output monitor 501, avideo server 510, a userinterface controlling unit 520, amotion controller 530, and a GUI (graphical user interface) 540. - The input/
output monitor 501 is adapted to output images being stored or images and audio signals being edited in thevideo server 510. - The user
interface controlling unit 520 is adapted to control operating instructions input from themotion controller 530 and theGUI 540 and carry out editing operations on a computer display in combination with thevideo server 510. The userinterface controlling unit 520 includes apointer controlling apparatus 610 according to the present invention. - The
motion controller 530 is adapted to output necessary images and audio signals to the userinterface controlling unit 520 in response to instructions required for editing images input by an operator. - The GUI (graphical user interface) 540 is adapted to provide the operator with various operating instructions in an easy-to-operate form such as, for example, an icon for the operator to specify and output instructions to the user
interface controlling unit 520. - A video
server controlling unit 511 is adapted to execute the instructions supplied from the userinterface controlling unit 520 in combination with an image input/output unit 512 and animage storing unit 513, and output images and audio signals to the input/output monitor 501. - The image input/
output unit 512 is adapted to control input/output images and audio signals based on the instructions supplied from the userinterface controlling unit 520 in combination with the videoserver controlling unit 511. - The
image storing unit 513 is adapted to control input images and audio signals based on the instructions supplied from the userinterface controlling unit 520 in combination with the videoserver controlling unit 511. -
FIG. 6 is a functional block diagram showing the first embodiment of thepointer controlling apparatus 610 in an example where thepointer controlling apparatus 610 of the present invention is applied to the userinterface controlling unit 520 ofFIG. 5 . - When receiving a pointer position, a pointer position determining means 620 determines whether or not the pointer has crossed over a boundary of a predetermined area from outside to inside, and transmits a determination result to a first/second control mode setting means 630 and a pointer moving
distance changing means 650. - The first/second control mode setting means 630 determines a moving distance of a pointer per unit time or whether or not an event of the pointer has occurred, and checks with conditions stored in a
storing apparatus 660, thereby setting a first or a second control mode. Here, conditions stored in thestoring apparatus 660 are conditions for setting the first control mode or the second control mode, for example, the moving distance of the pointer per unit time, whether or not an event of a pointer has occurred, and the like. When the first control mode is set, the first/second control mode setting means 630 instructs the pointer moving distance changing means 650 to change the moving distance of the pointer per unit time. When the second control mode is set, the first/second control mode setting means 630 instructs a pointer moving means 640 to move and output a pointer display. - When the first control mode is set, the pointer moving distance changing means 650 instructs the pointer moving means 640 to move the pointer to a predetermined position within a predetermined area based on information such as shape, size, and the like of a selection area read from the storing
apparatus 660. - The pointer moving means 640 moves and outputs a pointer display based on instructions supplied from the first/second control mode setting means 630 or the pointer moving
distance changing means 650. - The storing
apparatus 660 is stored with conditions for setting the first or the second control mode. In addition, programs, data, and the like related to functions given to respective selection areas, such as copying function, pasting function, and the like are stored in addition to information on shape, size, and the like of the selection areas such as various buttons and the like on the GUI. Programs configured with a series of instructions to activate a controlling apparatus according to the present invention, and data which is created or edited using the controlling apparatus may also be stored. -
FIG. 7 is a flowchart of processing by a pointing device according to the first embodiment of the present invention. In this example, when a pointer exists within a predetermined area, and a moving distance per unit time is less than a specified value, the first control mode is set; whereas when the moving distance per unit time is greater than or equal to the specified value, the second control mode is set. - First, in
step 705, thepointer controlling apparatus 610 receives pointer position information, and processing proceeds to step 710. - In
step 710, thepointer controlling apparatus 610 determines whether or not the pointer position is outside the predetermined area based on the pointer position information received instep 705. If the pointer position is outside the area (Y), processing proceeds to step 715; if the pointer position is not outside the area (N), processing proceeds to step 705. - In
step 715, thepointer controlling apparatus 610 determines whether or not the pointer moves. If pointer movement is recognized (Y), processing proceeds to step 720; if pointer movement is not recognized (N), processing proceeds to step 705. - In
step 720, thepointer controlling apparatus 610 determines whether or not the pointer has crossed over a boundary of the area. If the pointer has crossed over the boundary of the area (Y), processing proceeds to step 725; if the pointer has not crossed over the boundary of the area (N), processing proceeds to step 705. - In
step 725, thepointer controlling apparatus 610 determines whether or not the pointer moves. If the pointer movement is recognized (Y), processing proceeds to step 730; if the pointer movement is not recognized (N), processing proceeds to step 753 in thefirst control mode 750. - In
step 730, thepointer controlling apparatus 610 compares a moving distance per unit time of the pointer caused by the movement of the pointing device to a specified value. If the moving distance per unit time exceeds or equals the specified value (Y), processing proceeds to step 745 in thesecond control mode 740; if the distance value is less than the specified value (N), processing proceeds to step 753 in thefirst control mode 750. Here, the specified value is a distance value of a pointer per unit time and may be arbitrarily set according to application and form of a displaying screen, for example, 600 through 700 pixels per second if resolution of the screen is 1280×1024 pixels. - In
step 745, thepointer controlling apparatus 610 moves the pointer without changing the moving distance of the pointer per unit time, and processing proceeds to step 790 and ends. - In
step 753, thepointer controlling apparatus 610 automatically moves the pointer to a predetermined position within the predetermined area, and processing proceeds to step 755. - In
step 755, thepointer controlling apparatus 610 changes the distance to move the pointer from the change in the pointer position information per unit time, and processing proceeds to step 757. Here, the change in the distance to move the pointer may be arbitrarily set based on application and form of display screen, size of predetermined area, and the like; however, it is preferred that relationship of the moving distance of the pointer per unit time to a physical moving distance of the pointing device is set to 20 to 30% before changing. - In
step 757, thepointer controlling apparatus 610 detects whether or not an event of the pointing device has occurred. If an event of the pointing device has occurred (Y), processing proceeds to step 758; if an event of the pointing device has not occurred (N), processing proceeds to step 760. - In
step 758, thepointer controlling apparatus 610 performs appropriate processing for the event of the pointing device, and processing proceeds to step 770. - In
step 760, thepointer controlling apparatus 610 determines whether or not the pointer has crossed over the area boundary and exists outside the area. If the pointer exists outside the area (Y), processing proceeds to step 770. If the pointer is not outside the area, processing proceeds to step 760 again. - In
step 770, thepointer controlling apparatus 610 restores the change in the moving distance of the pointer per unit time, processing proceeds to step 790 and ends. -
FIG. 8 is a flowchart of processing by a pointing device according to a second embodiment of the present invention. In this example, when a pointer exists within a predetermined area, and an event of the pointing device has occurred, the second control mode is set; whereas when no events occur, the first control mode is set. In addition, the processing according to this example is especially effective when the size of the selection area is small. The smaller the size of the selection area, the shorter the duration from when the pointer enters the selection area to when the first control mode is determined. This increases opportunity for the first control mode to be set, with no event occurrence. - The processing procedures in
FIG. 8 are the same as those inFIG. 7 described above except for processing insteps steps - In
step 825, thepointer controlling apparatus 610 determines whether or not an event of the pointing device has occurred. If an event of the pointing device has occurred (Y), processing proceeds to step 830; if an event of the pointing device has not occurred (N), processing proceeds to step 853 in thefirst control mode 850. - In
step 830, thepointer controlling apparatus 610 performs appropriate processing for the event of the pointing device, and processing proceeds to step 845 in thesecond control mode 840. - As described above, the pointer may be moved quickly by moving the pointing device at a speed faster than or equal to the specified value or by carrying out an event such as clicking. In particular, in the case where many selection areas are provided over several rows and columns, smooth and reliable pointer operation is possible without being concerned about deterioration of operability due to decrease in movement of the pointer to the center of the selection area and decrease in the moving distance within the selection area for each selection area along a pointer passing route.
- An example of a screen display according to the first embodiment of the present invention is described below.
FIG. 9 shows apointer 930 existing within aselection area 910. Here, apoint 920 is the center of theselection area 910. -
FIG. 10 shows behavior of pointer display according to the first embodiment. It is assumed that the pointer moves at a moving distance per certain unit time (hereafter also referred to as ‘moving speed’ or ‘speed’) indicated by anarrow 1040 outside the selection area. When the pointer has crossed over the boundary of the selection area from outside to inside, the first control mode is set, and the pointer moves to the center of the selection area as shown by anarrow 1030 if speed indicated by thearrow 1040 is less than a predetermined value. Here, thearrow 1030 indicates the state of the pointer moving to the center of the selection area as if it jumps. Anarrow 1020, which indicates a speed of the pointer moving within the selection area starting from the center of the selection area, shows an example where the moving speed of the pointer on the screen is slower than the actual moving speed of the pointing device. In other words, even when the pointing device is moved at the same speed as that indicated by thearrow 1040, it shows that the pointer speed, that is, the moving distance of the pointer relative to the change in the position information per unit time measured when the pointing device is actually moved changes from the moving distance relative to the change in the position information per unit time measured when the pointer is outside the predetermined area, resulting in a slower moving speed of the pointer. If the pointer crosses from inside the selection area to outside, the first control mode is cancelled and the pointer moves at a speed indicated by anarrow 1010 without any change in speed. In addition, if the speed indicated by thearrow 1040 exceeds or equals the predetermined value, the second control mode is set and the pointer speed does not change. - Behavior in the case of
FIG. 10 where a pointer exists within a selection area and a predetermined event such as clicking, dragging, or the like has occurred is described below. When the predetermined event has occurred, appropriate processing for the event is performed and the second control mode is set. The behavior of the pointer in the second control mode is as described above and the pointer speed does not change. - An example of a screen display according to the second embodiment of the present invention is described below.
FIG. 11 shows a pointer moving at a certain speed indicated by anarrow 1140 outside a selection area. When the pointer has crossed over the boundary of the selection area from outside to inside, the first control mode is set if speed indicated by thearrow 1140 is less than a predetermined value. Further, it shows that if the pointer moves closer to the center of the selection area, the pointer moves at a speed indicated by anarrow 1130, increasing the pointer speed relative to the change in pointer position information per unit time compared to that when the pointer exists outside the predetermined area. Anarrow 1120, which indicates speed when the pointer moves away from the center of the selection area within the selection area crossing over the center of the selection area, shows that a speed of the pointer is slower than a speed when the pointer exists outside the predetermined area even when the pointing device is moved at the same speed as that indicated by thearrow 1140. If the pointer crosses from inside the selection area to outside, the first control mode is cancelled and the pointer moves at a speed indicated by anarrow 1110 without any change in speed. In addition, if the speed indicated by thearrow 1140 exceeds or equals the predetermined value, the second control mode is set and the pointer speed does not change. - Behavior in the case of
FIG. 11 where a pointer exists within a selection area and a predetermined event such as clicking, dragging, or the like has occurred is described below. When the predetermined event has occurred, appropriate processing for the event is performed and the second control mode is set. The behavior of the pointer in the second control mode is as described above and the pointer speed does not change. - An example of a screen display according to a third embodiment of the present invention is described below.
FIG. 12 shows a pointer moving at a certain speed indicated by anarrow 1210 outside a selection area. When the pointer has crossed over the boundary of the selection area from outside to inside, the first control mode is set if a speed indicated by thearrow 1210 is less than a predetermined value. Further, it shows that if the pointer moves closer to the center of the selection area, the pointer moves at a speed indicated by anarrow 1220, increasing the pointer speed. If the pointer crosses over the center of the selection area and moves away from the center of the selection area, movement of the pointer is suspended for a predetermined duration even if change in pointer position information per unit time occurs. It is possible to allow users to select the selection area by implementing event operations such as clicking, dragging, and the like while the movement of the pointer is suspended. In this case, the speed of the pointer may further increase or decrease compared to the speed when the pointer is outside the predetermined area, and is set according to the required operability. If the pointer crosses from inside the selection area to outside, the first control mode is cancelled and the pointer moves without any change in speed. In addition, if the speed indicated by thearrow 1210 exceeds or equals the predetermined value, the second control mode is set and the pointer speed does not change. - Behavior in the case of
FIG. 12 where a pointer exists within a selection area and a predetermined event such as clicking, dragging, or the like has occurred is described below. When the predetermined event has occurred, appropriate processing for the event is performed and the second control mode is set. The behavior of the pointer in the second control mode is as described above and the pointer speed does not change. - An example of a screen display according to a third embodiment of the present invention is described below.
FIG. 13 , which is similar to the example ofFIG. 10 , shows behavior of a pointer in multiple selection areas. The behavior (arrows FIG. 13 , reaches the center of the selection area, and moves to the boundary of the selection area on the right side is the same as that ofFIG. 10 described above. If the pointer crosses over the boundary between two selection areas, the moving speed of the pointer increases again, and the pointer moves to the center of the selection area on the right side as indicated by anarrow 1340. Further, as with the above description ofFIG. 10 , anarrow 1350, which indicates speed when the pointer moves within the selection area starting from the center of the selection area on the right side, becomes slower than the pointer speed. In addition, first and second control mode setting conditions and behavior in the respective control modes are as described above. - Such various behaviors of the pointer may be set in advance as shown in Table 1 below, and may be stored in a
storing apparatus 660. Apointer controlling apparatus 610 may implement a desired pointer's behavior by reading and executing a program specifying necessary behavior from the storingapparatus 660 according to form. -
TABLE 1 Moving speed threshold Moving speed of a Moving speed of a Selection area Central coordinate of within the selection area pointer from L1 to L0 pointer from L0 to L1 Pointer suspension Behavior coordinate(L1) the selection area (L0) (V1) (V2) (V3) duration (sec.) 1 X11, Y11 (X011, Y011) (Vx11, Vy11) (Vx21, Vy21) (Vx31, Vy31) 0 X21, Y21 X31, Y31 X41, Y41 2 X12, Y12 (X012, Y012) (Vx12, Vy12) (Vx22, Vy22) (Vx32, Vy32) t2 X22, Y22 X32, Y32 X42, Y42 . . . . . . . . . . . . . . . . . . . . . - For example, taking behavior 1 in Table 1 as an example, in the selection area including the boundary of the selection area specified by four points ((X11, Y11), (X12, Y12), (X13, Y13), (X14, Y14)), if the moving speed of the pointer within the selection area is less than a certain threshold (Vx11, Vy11), the first control mode is set. In this case, the moving speed of the pointer from the boundary of the selection area to the central coordinates of the selection area is set to (Vx21, Vy21), and the moving speed of the pointer from the center coordinates of the selection area to the boundary of the selection area is set to (Vx31, Vy31), respectively. As seen from the form of
FIG. 12 , it is possible to suspend the pointer's movement for a certain duration at the center of the selection area by setting pointer suspension duration (t2 seconds in the case of behavior 2). In addition, with the pointer controlling apparatus according to the present invention, all behavior condition settings described above may be applied, or may be selected according to the user's request or function or form of application software. - For those skilled in the art, the pointer controlling apparatus according to the present invention has a wide application range, and thus can be applied to any devices as long as the devices have a GUI function, such as game machines, information home electronics, televisions, car navigation systems, security systems, touch-panel type inputting devices, and the like, in addition to application software for computer using GUI, as is seen from the aforementioned description.
- Although a plurality of embodiments of the present invention have been described in the above, the present invention is not limited to those embodiments. Further, it should be understood that effects described in the embodiments of the present invention are for illustrative purposes only, and the effects of the present invention are not limited to those described in the embodiments.
Claims (10)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2007/001089 WO2009044432A1 (en) | 2007-10-05 | 2007-10-05 | Pointer controlling apparatus |
Publications (2)
Publication Number | Publication Date |
---|---|
US20100309122A1 true US20100309122A1 (en) | 2010-12-09 |
US8482521B2 US8482521B2 (en) | 2013-07-09 |
Family
ID=39492330
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/733,874 Expired - Fee Related US8482521B2 (en) | 2007-10-05 | 2007-10-05 | Pointer controlling apparatus |
Country Status (7)
Country | Link |
---|---|
US (1) | US8482521B2 (en) |
EP (1) | EP2195727A1 (en) |
JP (1) | JP5230733B2 (en) |
KR (2) | KR20100085957A (en) |
CN (1) | CN101821705A (en) |
BR (1) | BRPI0722103A2 (en) |
WO (1) | WO2009044432A1 (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100229128A1 (en) * | 2009-03-03 | 2010-09-09 | Funai Electric Co., Ltd. | Input Apparatus and Input System |
US20120092296A1 (en) * | 2010-10-14 | 2012-04-19 | Nlt Technologies, Ltd. | Touch sensor device and electronic apparatus |
US20120146900A1 (en) * | 2010-12-14 | 2012-06-14 | International Business Machines Corporation | Graphic user interface pointer control |
US20130314396A1 (en) * | 2012-05-22 | 2013-11-28 | Lg Electronics Inc | Image display apparatus and method for operating the same |
US20140043535A1 (en) * | 2011-04-04 | 2014-02-13 | Sharp Kabushiki Kaisha | Display apparatus, information processing system and recording medium |
US20140125594A1 (en) * | 2012-11-05 | 2014-05-08 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
JP2014102807A (en) * | 2012-10-26 | 2014-06-05 | Tokai Rika Co Ltd | Touch type input device |
US20140306897A1 (en) * | 2013-04-10 | 2014-10-16 | Barnesandnoble.Com Llc | Virtual keyboard swipe gestures for cursor movement |
US20150177855A1 (en) * | 2013-12-23 | 2015-06-25 | Movea | Air pointer with improved user experience |
US20160124606A1 (en) * | 2014-10-31 | 2016-05-05 | Samsung Electronics Co., Ltd. | Display apparatus, system, and controlling method thereof |
US20160224127A1 (en) * | 2015-01-30 | 2016-08-04 | Lenovo (Beijing) Co., Ltd. | Method for controlling a cursor, electronic device and input device |
CN106304535A (en) * | 2015-06-12 | 2017-01-04 | 松下知识产权经营株式会社 | Lighting control user interface and Lighting Control Assembly |
US20180336634A1 (en) * | 2003-01-14 | 2018-11-22 | Bgc Partners, Inc. | Commission calculator and display |
US10620713B1 (en) * | 2019-06-05 | 2020-04-14 | NEX Team Inc. | Methods and systems for touchless control with a mobile device |
US20210030491A1 (en) * | 2014-11-13 | 2021-02-04 | Intuitive Surgical Operations, Inc. | Interaction between user-interface and master controller |
US11157152B2 (en) * | 2018-11-05 | 2021-10-26 | Sap Se | Interaction mechanisms for pointer control |
US11723734B2 (en) | 2014-11-13 | 2023-08-15 | Intuitive Surgical Operations, Inc. | User-interface control using master controller |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011511332A (en) | 2008-01-30 | 2011-04-07 | トムソン ライセンシング | Pointer control device, control method, and pointer control program |
WO2012043756A1 (en) * | 2010-09-30 | 2012-04-05 | 楽天株式会社 | Viewing device, viewing method, non-transitory computer-readable recording medium whereon program is recorded, and script program |
US8826190B2 (en) | 2011-05-27 | 2014-09-02 | Google Inc. | Moving a graphical selector |
US8656315B2 (en) * | 2011-05-27 | 2014-02-18 | Google Inc. | Moving a graphical selector |
US8687023B2 (en) * | 2011-08-02 | 2014-04-01 | Microsoft Corporation | Cross-slide gesture to select and rearrange |
CN102955579B (en) * | 2011-08-22 | 2016-04-20 | 幻音科技(深圳)有限公司 | Cursor assisted location method and system |
KR101873917B1 (en) | 2011-11-17 | 2018-07-04 | 삼성전자 주식회사 | Display apparatus and control method thereof |
JP5812821B2 (en) * | 2011-11-24 | 2015-11-17 | インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation | Pointer movement control method, apparatus, and program thereof. |
KR101888680B1 (en) * | 2011-12-06 | 2018-08-17 | 삼성전자 주식회사 | Display apparatus and control method thereof |
BR112014020960B1 (en) * | 2012-02-24 | 2022-04-19 | Koninklijke Philips N. V. | System for real-time processing of a pointer movement provided by a pointing device; workstation or image forming apparatus and method for real-time processing of a pointer movement provided by a pointing device |
JP5934008B2 (en) * | 2012-03-30 | 2016-06-15 | 株式会社東海理化電機製作所 | Input device |
US8656296B1 (en) | 2012-09-27 | 2014-02-18 | Google Inc. | Selection of characters in a string of characters |
US9804777B1 (en) | 2012-10-23 | 2017-10-31 | Google Inc. | Gesture-based text selection |
EP2770413A3 (en) * | 2013-02-22 | 2017-01-04 | Samsung Electronics Co., Ltd. | An apparatus for providing a cursor in electronic devices and a method thereof |
CN103164126B (en) * | 2013-02-25 | 2016-03-30 | 联宝(合肥)电子科技有限公司 | A kind of method avoiding mouse maloperation in main interface and Expansion Interface |
RU2608780C2 (en) | 2014-06-30 | 2017-01-24 | Общество С Ограниченной Ответственностью "Яндекс" | Method (versions) and computer-readable medium (versions) for determination of identity of curve point in multidimensional space |
CN104182170B (en) * | 2014-07-30 | 2019-06-04 | 广州三星通信技术研究有限公司 | The method, apparatus and terminal that voice messaging is recorded |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5786805A (en) * | 1996-12-27 | 1998-07-28 | Barry; Edwin Franklin | Method and apparatus for improving object selection on a computer display by providing cursor control with a sticky property |
US5870079A (en) * | 1996-11-12 | 1999-02-09 | Legaltech, Inc. | Computer input device and controller therefor |
US6137487A (en) * | 1997-02-24 | 2000-10-24 | International Business Machines Corporation | Method and apparatus for manipulating graphical objects in a data processing system |
US20020003529A1 (en) * | 1998-07-23 | 2002-01-10 | Harumi Takase | Method for moving a pointing cursor |
US7433179B2 (en) * | 2004-08-10 | 2008-10-07 | Kabushiki Kaisha Toshiba | Electronic apparatus having universal human interface |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2140164A1 (en) | 1994-01-27 | 1995-07-28 | Kenneth R. Robertson | System and method for computer cursor control |
JPH08152971A (en) | 1994-11-28 | 1996-06-11 | Nec Software Ltd | Mouse cursor control system |
TW288129B (en) | 1995-04-28 | 1996-10-11 | Philips Electronics Nv | |
JPH0926850A (en) * | 1995-07-11 | 1997-01-28 | Canon Inc | User interface device |
JPH10133822A (en) | 1996-10-31 | 1998-05-22 | Nec Corp | Mouse cursor control system |
JP3156619B2 (en) * | 1997-02-04 | 2001-04-16 | 日本電気株式会社 | Mouse cursor movement control system |
JPH1145156A (en) | 1997-07-25 | 1999-02-16 | Sharp Corp | Coordinate input device and computer-readable recording medium where coordinate input control program is recorded |
JP3808209B2 (en) | 1998-07-01 | 2006-08-09 | 富士通株式会社 | Cursor control method, storage medium, and information processing apparatus |
US7404149B2 (en) | 2003-03-28 | 2008-07-22 | International Business Machines Corporation | User-defined assistive GUI glue |
JP2006244393A (en) * | 2005-03-07 | 2006-09-14 | Tokai Rika Co Ltd | Input device |
JP4872592B2 (en) | 2006-01-17 | 2012-02-08 | セイコーエプソン株式会社 | Input / output device, input / output method and program |
-
2007
- 2007-10-05 WO PCT/JP2007/001089 patent/WO2009044432A1/en active Application Filing
- 2007-10-05 US US12/733,874 patent/US8482521B2/en not_active Expired - Fee Related
- 2007-10-05 BR BRPI0722103-7A patent/BRPI0722103A2/en not_active IP Right Cessation
- 2007-10-05 KR KR1020107009827A patent/KR20100085957A/en not_active Application Discontinuation
- 2007-10-05 EP EP07827868A patent/EP2195727A1/en not_active Withdrawn
- 2007-10-05 JP JP2010513512A patent/JP5230733B2/en not_active Expired - Fee Related
- 2007-10-05 KR KR1020147019722A patent/KR20140102762A/en not_active Application Discontinuation
- 2007-10-05 CN CN200780100972A patent/CN101821705A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5870079A (en) * | 1996-11-12 | 1999-02-09 | Legaltech, Inc. | Computer input device and controller therefor |
US5786805A (en) * | 1996-12-27 | 1998-07-28 | Barry; Edwin Franklin | Method and apparatus for improving object selection on a computer display by providing cursor control with a sticky property |
US6137487A (en) * | 1997-02-24 | 2000-10-24 | International Business Machines Corporation | Method and apparatus for manipulating graphical objects in a data processing system |
US20020003529A1 (en) * | 1998-07-23 | 2002-01-10 | Harumi Takase | Method for moving a pointing cursor |
US7433179B2 (en) * | 2004-08-10 | 2008-10-07 | Kabushiki Kaisha Toshiba | Electronic apparatus having universal human interface |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180336634A1 (en) * | 2003-01-14 | 2018-11-22 | Bgc Partners, Inc. | Commission calculator and display |
US8875058B2 (en) * | 2009-03-03 | 2014-10-28 | Funai Electric Co., Ltd. | Input apparatus and input system |
US20100229128A1 (en) * | 2009-03-03 | 2010-09-09 | Funai Electric Co., Ltd. | Input Apparatus and Input System |
US20120092296A1 (en) * | 2010-10-14 | 2012-04-19 | Nlt Technologies, Ltd. | Touch sensor device and electronic apparatus |
US8766948B2 (en) * | 2010-10-14 | 2014-07-01 | Nlt Technologies, Ltd. | Touch sensor device and electronic apparatus |
US20120146900A1 (en) * | 2010-12-14 | 2012-06-14 | International Business Machines Corporation | Graphic user interface pointer control |
US10359904B2 (en) * | 2010-12-14 | 2019-07-23 | International Business Machines Corporation | Graphic user interface pointer control |
US20140043535A1 (en) * | 2011-04-04 | 2014-02-13 | Sharp Kabushiki Kaisha | Display apparatus, information processing system and recording medium |
US20130314396A1 (en) * | 2012-05-22 | 2013-11-28 | Lg Electronics Inc | Image display apparatus and method for operating the same |
JP2014102807A (en) * | 2012-10-26 | 2014-06-05 | Tokai Rika Co Ltd | Touch type input device |
US9223428B2 (en) | 2012-10-26 | 2015-12-29 | Kabushiki Kaisha Tokai Rika Denki Seisakusho | Touch type input device |
US9817472B2 (en) * | 2012-11-05 | 2017-11-14 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
US20140125594A1 (en) * | 2012-11-05 | 2014-05-08 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
US20140306897A1 (en) * | 2013-04-10 | 2014-10-16 | Barnesandnoble.Com Llc | Virtual keyboard swipe gestures for cursor movement |
US20150177855A1 (en) * | 2013-12-23 | 2015-06-25 | Movea | Air pointer with improved user experience |
US9958962B2 (en) * | 2013-12-23 | 2018-05-01 | Movea | Air pointer with improved user experience |
US20160124606A1 (en) * | 2014-10-31 | 2016-05-05 | Samsung Electronics Co., Ltd. | Display apparatus, system, and controlling method thereof |
US20210030491A1 (en) * | 2014-11-13 | 2021-02-04 | Intuitive Surgical Operations, Inc. | Interaction between user-interface and master controller |
US11723734B2 (en) | 2014-11-13 | 2023-08-15 | Intuitive Surgical Operations, Inc. | User-interface control using master controller |
US20160224127A1 (en) * | 2015-01-30 | 2016-08-04 | Lenovo (Beijing) Co., Ltd. | Method for controlling a cursor, electronic device and input device |
CN106304535A (en) * | 2015-06-12 | 2017-01-04 | 松下知识产权经营株式会社 | Lighting control user interface and Lighting Control Assembly |
US11157152B2 (en) * | 2018-11-05 | 2021-10-26 | Sap Se | Interaction mechanisms for pointer control |
US10620713B1 (en) * | 2019-06-05 | 2020-04-14 | NEX Team Inc. | Methods and systems for touchless control with a mobile device |
US11868536B2 (en) | 2019-06-05 | 2024-01-09 | NEX Team Inc. | Methods and systems for touchless control with a mobile device |
Also Published As
Publication number | Publication date |
---|---|
KR20100085957A (en) | 2010-07-29 |
JP2010541026A (en) | 2010-12-24 |
WO2009044432A1 (en) | 2009-04-09 |
KR20140102762A (en) | 2014-08-22 |
JP5230733B2 (en) | 2013-07-10 |
CN101821705A (en) | 2010-09-01 |
US8482521B2 (en) | 2013-07-09 |
EP2195727A1 (en) | 2010-06-16 |
BRPI0722103A2 (en) | 2014-04-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8482521B2 (en) | Pointer controlling apparatus | |
KR100301015B1 (en) | Indicator position control method | |
JP5654340B2 (en) | Aspect ratio suggestions for resizable video windows | |
US7551184B2 (en) | Information processing apparatus and information processing method, and program | |
US6889365B2 (en) | Terminal operation apparatus | |
EP2940558B1 (en) | Program, relay device and information processing device | |
US8843848B2 (en) | Information processing system, information processing apparatus, terminal device, and control methods thereof | |
US7522151B2 (en) | Coordinate-based display object movement restriction method | |
US20020158852A1 (en) | Remote control having a touch pad operable in a pad-to-screen mapping mode for highlighting preselected parts of a slide displayed on a display screen | |
JP2007088584A (en) | Monitor camera system, remote control monitor apparatus, control method, and control program thereof | |
JP2004258837A (en) | Cursor operation device, method therefor and program therefor | |
US9772742B2 (en) | System and method for remote controlling computing device | |
JPH10260784A (en) | Method and device for controlling cursor | |
JP4166767B2 (en) | Information processing apparatus, pointer movement display method, program, and recording medium | |
US20120146900A1 (en) | Graphic user interface pointer control | |
US9367222B2 (en) | Information processing apparatus, method of controlling the same, and storage medium | |
US7091994B2 (en) | Method, system, and computer program for displaying screen information | |
US11140306B2 (en) | Method for controlling monitoring camera, and monitoring system employing method | |
JP3156619B2 (en) | Mouse cursor movement control system | |
JP2009225471A (en) | Controller, camera system, and program | |
CN111813408A (en) | View display processing method and device, terminal equipment and storage medium | |
WO2023273462A1 (en) | Display device and color filling method | |
JPH03265920A (en) | Pointing processing system | |
JP6493099B2 (en) | Display system, control method, and program | |
JP2020003917A (en) | Display control unit, display, television, display control method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THOMSON LICENSING, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ABE, KOICHI;TSUBOUCHI, SHOGO;REEL/FRAME:024165/0202 Effective date: 20090825 |
|
AS | Assignment |
Owner name: GVBB HOLDINGS S.A.R.L., LUXEMBOURG Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THOMSON LICENSING;REEL/FRAME:026028/0071 Effective date: 20101231 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: GRASS VALLEY CANADA, QUEBEC Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:GVBB HOLDINGS S.A.R.L.;REEL/FRAME:056100/0612 Effective date: 20210122 |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20210709 |