CA2324466C

CA2324466C - A method and apparatus for writing

Info

Publication number: CA2324466C
Application number: CA002324466A
Authority: CA
Inventors: Kenneth Perlin
Original assignee: New York University NYU
Current assignee: New York University NYU
Priority date: 1998-04-01
Filing date: 1999-03-30
Publication date: 2004-11-09
Anticipated expiration: 2019-03-30
Also published as: CN1295703A; CN1166999C; EP1068609A1; CA2324466A1; WO1999050818A1; US6031525A; AU3215899A; JP2002510105A

Abstract

A table surface (14) sensitive to the position of the writing mechanism and able to detect whether the writing mechanism (12) is in contact with the surface. The apparatus having a computer processor (16) which identifies a writeable character from the motion of the writing mechanism from a resting zone into an other zone of a plurality of zones when the writing mechanism is in contact with the surfa ce (14). The computer processor defines the surface into the resting zone (18) and enough other zones (20) to identify a written alphabet.

Description

A METHOD AND APPARATUS FOR WRITING
FIELD OF THE INVENTION
The present invention is related to a stylus based writing system. More specifically, the present invention is related to a stylus based writing system wherein the motion of the stylus allows for the writing of multi-word text of arbitrary length in a single continuous gesture.
BACKGROUND OF THE INVENTION
Currently, the fast methods available for entering text onto a stylus-based personal digital assistant (PDA) are about six times slower than a good touch-typist can achieve on a computer keyboard. This limits the use of stylus-based PDA's to short notes and messages.
Imagine you could write on a stylus-based PDA
almost as fast as you could touch-type. Entire documents could be efficiently entered and edited. The stylus-based PDA
would find completely new uses and far greater market penetration.
SUMMARY OF THE INVENTION
The present invention pertains to an apparatus for writing. The apparatus comprises a writing mechanism. The WO 99/50818 PC'T/US99/06891 apparatus comprises a tablet surface sensitive to the position of the writing mechanism and able to detect whether the writing mechanism is in contact with the surface. The apparatus comprises a computer processor which identifies a writeable character from the motion of the writing mechanism from a resting zone into an other zone of a plurality of zones when the writing mechanism is in contact with the surface. The computer processor defines the surface into the resting zone and enough other zones to identify a written alphabet. Each other zone is in contact with the resting zone.
The present invention pertains to a method for writing. The method comprises the steps of moving a stylus from a resting zone on a tablet surface to at least an other zone of a plurality of zones in contact with the resting zone while the stylus is in continuous contact with the surface.
The surface is sensitive to the position of the writing mechanism and able to detect whether the writing mechanism is in contact with the surface. Then there is the step of identifying a letter with a processor in contact with the surface from the movement of the stylus from the resting zone to at least the other zone and back to the resting zone.

BRIEF DESCRIPTION OF THE DRAWINGS
In the accompanying drawings, the preferred embodiment of the invention and preferred methods of practicing the invention are illustrated in which:
Figure la is a schematic representation of an apparatus of the present invention.
Figure lb is a flow chart of the method of the present invention.
Figure 2 is a schematic representation of a grid of zones.
Figure 3 is~a schematic representation of a lower case character set.
Figure 4 is a schematic representation of a capital character set.
Figure 5 is a schematic representation of a punctuation character set.
Figure 6 is a schematic representation of a numeric character set.

Figure 7 is a schematic representation of the writing sequence for letter f.
DETAILED DESCRIPTION
Referring now to the drawings wherein like reference numerals refer to similar or identical parts throughout the several views, and more specifically to figure la thereof, there i,s shown an apparatus 10 for writing. The apparatus 10 comprises a writing mechanism 12. The apparatus comprises a tablet surface 14 sensitive to the position of 10 the writing mechanism 12 and able to detect whether the writing mechanism 12 is in contact with the surface 14. The apparatus 10 comprises a computer processor 16 which identities a writeable character from the motion of the writing mechanism 12 such as a stylus 22 from a resting zone 18 into an other zone 20 of a plurality of zones when the writing mechanism 12 is in contact with the surface 14. The computer processor 16 defines the surface 14 into the resting zone 18 and enough other zones 20 to identify a written alphabet. Each other zone 20 is in contact with the resting zone 18.
Preferably, the character is a letter. The writing mechanism 12 is preferably a stylus 22. Preferably, the motion of the stylus 22 , which the computer processor 16 uses to identify letters, can write words by moving the stylus 22 -5- ;
in continuous multi-word text of arbitrary length in a single continuous gesture.
The motion of the stylus 22 on the surface 14 detected by the computer 16 preferably defines a letter by moving from the resting zone 18 to an other zone 20 and then back to the resting zone 18 from an other zone 20.
Preferably, the other zones 20 include eight other zones 20.
The other zone 20 moved to from the resting zone 18 by the stylus 22 and back from the other zone 20 can be the same other zone 20. Alternatively, an other zone 20 the stylus 22 moves to from the resting zone 18 and back from an other zone 20 are different zones.
The present invention pertains to a method for writing, as shown in figure lb. The method comprises the steps of moving a stylus 22 from a resting zone 18 on a tablet surface 14 to at least an other zone 20 of a plurality of other zones 20 in contact with the resting zone 18 while the stylus 22 is in continuous contact with the surface 14.
The surface 14 is sensitive to the position of the writing mechanism 12 and able to detect whether the writing mechanism 12 is in contact with the surface 14. Then there is the step of identifying a letter with a processor 16 in contact with the surface 14 from the movement of the stylus 22 from the resting zone 18 to at least the other zone 20 and back to the resting zone 18.
Preferably, the moving step includes the step of moving the stylus 22 from a resting zone 18 on a tablet surface 14 to no more than two other zone 20s . The moving step preferably includes the steps of moving continuously the stylus 22 after the stylus 22 has been returned to the resting zone 18 to an other zone 20 and back to the resting zone 18. Then there is the step of identifying with the processor a letter associated with the moving continuously again step. Preferably, after the identifying step, there is the step of modifying a display of characters that the movement of the stylus 22 encode.
Preferably, the moving continuously step includes the step of continuously moving the stylus 22 to form multi-word text of arbitrary length in a single continuous gesture.
The moving step preferably includes the steps of moving continuously the stylus 22 after the stylus 22 has been returned to the resting zone 18 to an other zone 20 and back to the resting zone 18. Then there is the step of identifying with the processor 16 a shift or lock key which switches a first set of characters 24 associated with the movement of the stylus 22 to a second set of characters 26 associated with the movement of the stylus 22.

_7_ In the operation of the preferred embodiment, the apparatus 10 comprises:
1. a computer processor 16.
2, a writing stylus 22 3. a tablet surface 14 sensitive to the position of the stylus 22, and able to detect whether the stylus 22 is in contact with the surface 14.
Usually on a PDA the tablet input surface 14 is part of a display screen, (eg: the 3COM PalmPilot or Apple MessagePad?, but that is not necessary.
The process of operation from start to finish as seen by the user of the apparatus 10 is as follows. The user works with a very simple stylized alphabet, in which each character represents one character on the standard typewriter keyboard. The user sees a small writincr area i n ~rh; ,.~, number of zones 20 are arranged around a central resting zone 18. In one instantiation, the zones are arranged in a 3x3 grid as shown in figure 2.
In this 3x3 arrangement, for example, zone 5 is the resting zone 18. To form a character, the user drags the stylus 22 from the central resting zone 18 out to one of the eight outer zones, in this case 1,2,3,4,6,7,8, or 9, then _g_ optionally to a second outer zone, and finally back to the resting zone 18.
The gestures are arranged so that frequent characters can be drawn faster. For example, to draw space, e, t, a, o, or n, the user moves the stylus 22 from the resting zone 18 into only one other zone 20, and then immediately back again to the resting zone. To form other characters, the user moves the stylus 22 from the resting zone 18 first into one zone, and then into a second zone, l0 before moving the stylus 22 back into the resting zone 18.
Certain characters are shifting characters which change to alternate character sets, such as CAPITAL, PUNCTUATION, or NUMERIC. These alternate character sets contain additional characters.
The stylus 22 need never be lifted from the surface 14. Furthermore, the user need never stop moving the stylus 22. Continuous multi-word text of arbitrary length can be written fluidly, even in a single continuous gesture if desired.
The user can employ "quikwriting mode" (the technique of the present invention described herein) even in the middle of using the slower standard writing mode of the PDA. When the user wishes to enter "quikwriting mode", he/she _9_ draws a special gesture, which signals that the next stroke will be a quikwriting entry.
For example, when using the PalmPilot's standard Graffiti language, the user could draw a slash from the lower right to the upper left of the writing area (a gesture never used in Graffiti). Then the next time the user's stylus 22 touches down in the writing area, the PDA will be in "quikwriting mode". The PDA will stay in "quikwriting mode"
until the user next Lifts up the stylus 22, at which point the PDA will be placed back into standard Graffiti writing mode.
The internal sequence of operations of the apparatus 10 is as follows. A computer program well known in the art tracks the x,y position of the stylus 22, and outputs a token when the user's stylus 22 enters or leaves each of the nine zones. This sequence of tokens forms an alphabet, which is categorized by:
1. the first zone entered after leaving the resting zone 18.
2. the last zone exited before returning to the resting zone 18.

The above two zones may be the same. The indices of the two zones are used as a table lookup, to output a single character.
The sequence of operations is:
1. Begin with stylus 22 in the resting zone 18.
2. The computer 16 detects that the stylus 22 has moved out of the resting zone 18, into zone I.
3. The computer 16 detects that the stylus 22 has moved back into the resting zone 18, from zone J.
4. A table lookup is done, retrieving entry ch =
C[I,J], where C is a two-dimensional table that stores the character of the current character set.
5. If ch is a shifting character, then either shift, lock, or unlock the alternate character set S associated with ch, as f of lows 1. if the current character set C is not S, then set C = S, and set locked = false 2. else if not locked then set locked -true 3. else set C = LOWERCASE and set locked =
false return to step 1.
6. Output character ch. return to step 1.
There are four character sets: LOWERCASE, CAPITALS, PUNCTUATION, and NUMERIC. The default is LOWERCASE. The others are reached via shifting keys . Characters within these respective character sets are arranged as shown in figures 3 , 4, 5 and 6.
In the above alphabet, the shifting keys for CAPITALS, PUNCTUATION, and NUMERIC, are, respectively, up-arrow, rectangle, and circle. Every shifting key is present in every character set. The keys for space, backspace, and newline are, respectively, right-arrow, left-arrow, and down-arrow.
One can continually write without ever clicking any mouse buttons . Similarly, one can use this technique on a PDA
without ever needing to lift the stylus 22 from the surface 14. It is preferred if there is present a first region in which the characters are displayed and another region in which the resting zone and the other zones are displayed.

The position of each printed character in the representation (which should be considered as a guide template which is optional) corresponds to how that character is drawn. Each printed character is positioned in one of the eight outer zones (its major zone), and also at some relative position within this zone (indicating its minor zone). To draw a stroke, one moves the stylus 22 from resting zone 18 shown as 5 to the character's major zone, then to the character's minor zone, and finally back to resting zone 18 shown as 5. If the major and minor zones of a character are the same, then to draw the character one needs only to move the stylus 22 from resting zone 18 shown as 5 out to the character's major zone and then back again.
For example, the letter f appears in zone 3 (the top-right zone). This is its major zone, indicating that one begins to draw the letter f by moving the stylus 22 from the central resting zone 18 shown as 5 to zone 3. Furthermore, the printed f is situated in the top-center of its major zone. Since the top-center zone is zone 2, this indicates that the character has minor zone 2. Therefore, one finishes drawing the letter f by moving the stylus 22 into zone 2 , before returning it to resting zone 18 shown as 5. The drawing code for f is 32.

The first two strokes for the letter f is shown in figure 8. Returning the cursor to the center will then complete the character.
Some characters (the most frequent ones) require one to only to move out from zone 18 shown as 5 to one other zone 20, and then right back again. For example, the letter a appears in the middle-left edge of the middle-left zone;
its maj or and minor zones are both 4 . An a is drawn simply by moving the stylus 22 to the left, and back again to the center. The drawing code for a is 4.
There are three shifting keys: cap, alt, and num.
Cap appears in drawing code position 23, alt in drawing code position 21, and num in drawing code position 89. These keys select for CAPITALS, PUNCTUATION, and NUMERIC characters, respectively. If a shifting key is triggered just once, then it only affects the next character drawn. If a shifting key is triggered twice in a row, then its character set locks on.
Triggering a shifting key while its character set is already locked will cause the lock to release, and will revert to the default LOWERCASE character set.
Although the invention has been described in detail in the foregoing embodiments for the purpose of illustration, it is to be understood that such detail is solely for that purpose and that variations can be made therein by those skilled in the art without departing from the spirit and scope of the invention except as it may be described by the following claims.

unport java.awt.*;
audlic c:ass Quiiwvrite e:ctezds animator { -final char = 1;
final char ~.L.T =
_, final char C AP = ~;
nnai char V'U11~I = s;
booie :n can = false, capLOC~ = false, alt = false, aitLocK = false:
booiean num = false, num.i.,oct = false. 'S?.TOW = false;
String outt~ut = "";
char maps] _ {
, : " "~ , , , , a, s, ~, m, , a, ' >
AL T , '\b', C.4P, > >
I I '1? ' , - ~ ,~> , , a~ f y' n> > , , ' .' , r I
h, , e' , c, , , , , , -, , '" ,v;
, > u> > , ~, , >
y: ,W, > r s , n > > > > , 'gin', ' ', NG~i.
, , ,;, ,b, ,d, ,i:
J> , , ~> , ,.
l c:~ar alt_~tap{] = f , ' , ' ,.' ' ' { ' > , > , '\\'~ , ' ALT, '1b', CAP, , . ~ >
".' ', , ,,, '~, ' I ' ' ! > ~' , > , , °~o~
'\" ,., , , > , ~ " > ' _>
> , , , - , "" ,.' i&, , , , , . -> > >
' ' - > > > > a ~ r , > , , yI, ' ', \l-IJ'~I.
. , 'u, ' ' > > > > -> -, char capivlan~] = {
"u, 'Q' , ' ~ 1 > , , ALT, '\b', CAP, , , 'P', 'F' '~'~1' ,L, f 1 , , , , , 'X' 'H, ,E' ,C, , > > > > , , >
-, > > _, , , _, , , ' , 'j.f > ' > '~~> , ->
SUBSTITUTE SHEET (RULE 26) 'vr ~~r ,Cr , . , , , ', , ', > > r r , ,.
czar nutniVlap[ j = {
,lr i {r ,(r rn ,-, , , ~ ~ , , , -, ALT "b' CAP, ,)r a r ,~, ,*r ~ ~ -, , , , , .o, rjr rs~ yr r , , , , - , -, , , , , r~r r . ,pr , , 6, > _ rCr r9r r r r[r r , , , , , rr r -r _ r~r r r , , , , , , , r , _'Or , , , ,fir, r , r r , , ~, ..
r static int zone = 0;
static boolean arawGuide = true:
private char map(int i, int j) {
return ((cap I( capLock) ? capMap (num ~~ numLock) ? nurruyfaa (alt (( altLock) ? alt'Vlan : man)[9*i = j j;
public void render( Graphics g int w = width/2;
int h = he:~r, intp=ll,q=38;
int x0 = 0, x~ = x0 = w, x i = x0 ~ w*p/a, x~ = x~ - (x I -:c0);
int y0 = 0, y~ = y0 = h, yi = y0 = h*p/a,, y4 = y~ - (yi-y0);
int x2 = xI = (x=~-xl)*p/a, ;c i = x~-. - {x?-xI);
int y? = yl = (y'' yl)*p/q~ Y~ = y~ _ (y?_yl);
if (keyDown) {
for(inti=0; i<9;i~) for(intj=O;j<9;j-'-') ii (map(i,j) _ (char)key) {
int a=c0-w/~.,b=~c0=w/2,c=~0-3*w/4;
int x[] _ {a,b,c,a,b,c,a,b,c;;
int d=y0=h/4, e=yQ+h/2, i--y0~3 *h/d;
int y[~ _ {d,d,d,e,e,e,ff,f};
~.setColor(Color.black);
SUBSTITUTE SHEET (RULE 26) drawArrow(g, x[4],y(4],xfi],Yii], w/20);
drawArrow(g, x(i],y[i],xff ],y{j], w/20);
damage(0, 0, width/2, height);
isArrow = u~ue;
if (key ='/') arawGuide = !drawGuide;
if (loX < width/2) {
g. drawLine(x 1, y0, x2, y 1 );
~.drawLine(x4, y0, x3, yl);
g.drawLine(xl, y~, x2, Y4);
g.drawLine(x4, y~, x3, y4);
g.drawLine(x0, yl, xl, y2);
g.drawLine(x0, y4, xl, y3);
g.cirawLine(x~, yl, x4, y2);
~.drawLine(x~, y4, x4, y3);
if (drawGuide) for(inti=O;i<9;i++) for(intj=O;j <9; j++) {
char ch = map(ij);
if (ch !_'~' && ch !_ ~ {
int x = x0+(4*(i%3)+(j%3)+1)*(x~-x0)/12;
int y = y0+(4*(i/3)+(j/3)+1 )*(x~-x0)/1?;
switch (ch) {
case '\b':
drawTriangie(g,x+4,y-.~.,,~-~,y+i,x+4,y+6);
break;
case 'fin':
drawTriangle(g,.Y-S,y-4,x+3,Y-4,.Y- l,Y+6);
break;
case ' ':
drawTriangle(g,x-4,Y-4,.~c+4,Y+1 ~x-q.,y+6);
break;
case CAP:
drawTriangle(g,x-3,Y''5,.~c+S,Y+6,x+1,Y-~) if (cap) drawTriangle(g,x-2.y-~,x+4,y+S,x+l,y-?);
if (capLock) fillTrianale(g,x-3,y+6,x+S,y+6,x+l,Y--~.);
break;
case ALT:
g.drawRect(x-~, y-~, 7, 10);
if (alt) g.drawRect(x-.~, y-3, 5, 8);

if (altLock) g.riIlRect(x-~, y-.~, 7, 10);
break:
case NUM:
g.drawOval(x-3, y--~, 10, 10);
if (num) g.drawOval(x-2, y-;, 8, 8);
ii (numLock) g.nllOval(x-3, y-s, 10, 10);
break;
default:
g.drawString{",~ ~- ch, x-2, y+4);
break;
) ) if (hiX > width/2) {
g.setColor(Color.black);
g.drawRect{0, 0, w, h-1);
g. drawRect{w, 0, w-1, h-1 );
intx=w+7;
int y = 17;
fo (int n = 0 ; n < output.lengthn ; n-) {
String s = output.substring{n, n+I);
int dx = ?.getFontMetrics~.swingWidth(s);
if (x = dx > 2*w - 7 ~~ s.equals(~"gin")) {
x=w+7~
y += 12;
if (! s.equals("fin")) {
g.drawString(s, x, Y);
x '~'_ ~;
) g.setColor(Color.~ay);
g.fillRect(x, y-9, 7, 10);
noDamage~;
if (isArrow && !keyDown) {
damage{0, 0, width/2, height);
isAirow = false;
) WO 99/50818 PCT/US99/Ob891 if (mouse.\~Iove II mouseDown II mouseDraQ II mouseUp) {
int n = 0, zone.~Iap[] _ {4,7,6,8,3,6,0.2.1 } ;
if (above(x2,y~t,x3,y4) = above(x3,y4,x4,y3) ~-above(x4,y3,~c~,y2) = above(x4,y2,x3,y l ) above(x3,yl,.~c2,yl) -~ above(x2,yl,xl,y2) above(xl,y2,xl,y3) = above(xl,y3,x?,ya) < 8) {
n = 1 r above(xl, y~, x4, y0) 2 * above(xl, y0, x4, y5) 2 * above(x0, y4, x~, y 1 ) 2 * above(x0, yl, x~, y4);
}
if (zone != zone.~Ylap[n)) output(zone, zone = zone~~Iap[nJ);
private void drawTriangle(Graphics g, int ax, int ay, int bx, int by, int cx, int cy) {
int x[] _ { ax, bx, cx, ax }; .
int y[] _ { ay, by, cy, ay };
g.drawPolygon(x, y, 4);
}
private void fillTriangle(Graphics g, int ax, int ay, int bx, int by, int cx, int cy) {
int x[] _ { ax, bx, cx, ax };
int y[J _ { ay, by, cy, ay };
g.filPolygon(x, y, 4);
} .
private int above(int xl, int yl, int x2, int y2) f return ((mousex-x 1 )* (y2-y i ) - (mousey-yl ) *(x2-x 1 ) > 0) ~ 1 : 0;
private static int i = 4, j = 4;
private void output(int a, int b) {
if (a = 4) i=j=b;
else if (b != 4) j = b;
else {
char c = map(i,j);
i=j=4;
if (c = ALT) {
if (alt) { alt = capLock = numLock = false; altLock = true; }

WQ:99/50818 PCTNS99/06891 else if (altLock) altLock = false;
else { cap = capLock = num = numLock = false; alt = true; }
damage(0, 0, width/2, height);
} _ else if (c = CAP) {
if (cap) { altLock = cap.= numLock = false; capLock = true: }
else if (capLock) capLock = false;
else { alt = altLock = num = numLock = false; can = true; }
damage(0, 0, width/2, height);
else if (c = NU1V~ {
if (num) { altLock = capLock = num = false; numLock = true; }
else if (numLock) numLock = false;
else { alt = altLock = cap = capLock = false; num = true; }
damage(0, 0, width/2, height);
}
else if (c !_ '-' && c !_ ~ {
if (cap ~~ alt ~) num) -damage(0, 0, width/2, height);
cap = alt = num = false;
if (c ='fib') {
if (output.Iength0 > 0) output = output_substring(0, outnut.lengthU-1);
else output j= c;
damage(width/2, 0, width, height);
}
}
}
}

Claims

WHAT IS CLAIMED IS:

1. An apparatus for writing comprising:
a writing mechanism;
a tablet surface sensitive to the position of the writing mechanism and able to detect whether the writing mechanism is in contact with the surface; and a computer processor which identifies a writeable character from the motion of the writing mechanism from a resting zone into an other zone of a plurality of zones when the writing mechanism is in contact with the surface, said computer processor defining the surface into the resting zone and enough other zones to identify a written alphabet, each other zone in contact with the resting zone.

2. An apparatus as described in Claim 1 wherein the character is a letter.

3. An apparatus as described in Claim 2 wherein a writing mechanism is a stylus.

4. An apparatus as described in Claim 3 wherein the motion of the stylus which the computer processor uses to identify letters can write words by moving the stylus in continuous multi-word text of arbitrary length in a single continuous gesture.

5. An apparatus as described in Claim 4 wherein the motion of the stylus on the surface detected by the computer defines a letter by moving from the resting zone to an other zone and then back to the resting zone from an other zone.

6. An apparatus as described in Claim 5 wherein the other zone moved to from the resting zone by the stylus and back from the other zone is the same other zone.

7. An apparatus as described in Claim 6 wherein an other zone the stylus moves to from the resting zone and back from an other zone are different zones.

8. An apparatus as described in Claim 7 wherein the other zones include eight other zones.

9. A method for writing comprising the steps of:
moving a stylus from a resting zone on a tablet surface to at least an other zone of a plurality of zones in contact with the resting zone while the stylus is in continuous contact with the surface, said surface sensitive to the position of the writing mechanism and able to detect whether the writing mechanism is in contact with the surface;
identifying a letter with a processor in contact with the surface from the movement of the stylus from the resting zone to at least the other zone and back to the resting zone.

10. A method as described in Claim 9 wherein the moving step includes the step of moving the stylus from a resting zone on a tablet surface to no more than two other zones.

11. A method as described in Claim 10 wherein the moving step includes the steps of moving continuously the stylus after the stylus has been returned to the resting zone to an other zone and back to the resting zone, and identifying with the processor a letter associated with the movement of the stylus.

12. A method as described in Claim 11 wherein the moving continuously step includes the step of continuously moving the stylus to form multi-word text of arbitrary length in a single continuous gesture.

13. A method as described in Claim 12 wherein the moving step includes the steps of moving continuously the stylus after the stylus has been returned to the resting zone to an other zone and back to the resting zone, and identifying with the processor a shift or lock key which switches a first set of characters associated with the movement of the stylus to a second set of characters associated with the movement of the stylus.

14. A method as described in Claim 13 including after the identifying step, there is the step of modifying a display of characters that the movement of the stylus encode.