llllillllllllllllllllllllllilllllllllllilllllllIllllllllll?llllllllll?lll USO0RE34476E
United States Patent {191
[11} s
Norwood
[45] Reissued Date of Patent: Dec. 14, 1993
[54] HYBRID INFORMATION MANAGEMENT
Re. 34,476
Freestyle System, Oct. 1988; Wang Freestyle/LAN
SYSTEM FOR HANDWRITING AND TEXT
[76} Inventor:
Patent Number:
Of?ce Interface, Apr. 1989. Linus Technologies, sales brochures, technology paper: "Linus Write~Top”, undated; Forms Write/Arrows,
Donald D. Norwood, PO. Box 3525, Santa Clara, Calif. 95055
1989; Handwritten Data into a Computer, Jun. 1989.
[21] Appl. No.: 889,664 [22] Filed: May 28, 1992
Grid Systems, sales brochures: “Introducing GridPad", 1989, Technical Speci?cations, 1989. Toshiba America, sales brochure: "Toshiba Pen PC", 1989.
Related US. Patent Documents
IBM, research report: "The Paperlike Interface”, Feb. 3, 1989, Wolf, Rhyne and Ellozy.
Reissue of:
[64]
Patent No;
5,063,600
Issued:
Nov. 5, 1991
Appl. No.: Filed:
523,230 May 14, 1990
Primary Examiner-Joseph Mancuso [s7]
ms'nucr
[51] [52]
Int. CH ............................................. .. G06K 9/00 U.S. C1. ............................... .. 382/13; 364/705.03;
[58]
Field of Search ....................... .. 382/13, 3, 59, 61;
written as well as keyboard entered information to meet
364/7091], 705.02, 705.06; 340/712, 721, 723;
a wide spectrum of commonly-occurring, written infor’
A computer system used with special input hardware for providing the bene?ts of computerization to hand
364/705.06; 345/ 173; 345/119
mation processing needs. The input hardware consists
128/18, 19, 20
[56]
of a transparent digitizing tablet mounted atop a ?at
References Cited
panel display screen such that a user can handwrite
U.S. PATENT DOCUMENTS Re. 32.655
4/1988
directly upon the display screen with an attached pen.
4,815,029 4,817,034 4,912,640 4,924,075
3/1989 3/ 1989 3/1990 5/1990
Application program functions include appointment
Levine ................................ .. 368/29
4,727,588 2/1988 Fox et al. Barker :1 a1. ...... .. Hardin, Sr. et a1. . ..... .. Tsugei ....................... .. Tanaka .............................. ..
382/13
documentation and work scheduling, handwritten or
364/900 364/900 364/400 235/380
text file creation and manipulation, author-to-typist liaison functions for document production, handwritten annotation to text, handwritten note creation from text, and text document creation from handwritten source
material.
OTHER PUBLICATIONS Wang Laboratories Inc., various sales brochures:
“Freestyle Personal Computing”, Oct. 1988; The Wang
22 Claims, 17 Drawing Sheets
Flle um 60 tools Objects Change ‘taut Satact E
01’ 0188501112140 FGMIRHPPDINTMENI'S
vsyn/u a“ mu user.
1. no?
................. v.
m
gtéékgicgqi:Iixixiizl. ..................................................... ..
Cilfé-Ilé?iiéééPE/‘iéiijjXXIII: gfiwi'faint-lei'. ....................... .. " I
D‘.‘i?ékéig:gkwiél.‘.‘1...:‘.....I.'.‘...-.‘.:I:‘1-’:
.................................................... .
Clgunlnt. ........................... H’
"
awry ‘‘‘‘‘ “in?” IIIIIIIIIIIIIIIIIII " D .
.
.
.
.
.
.
. .
. .
. .
. .
.
..
c1 ..................
Isl-hum
I
n
.
.
.
.
.
. .
.
.
.
.
.
.
.
.
.
.
. .
. .
_ _ I _ _ _
.....................
_
_ ‘ _ ‘
_
I?
"""""""""""""""""""
lupubulnnanalmal?numa: .................................. .. ‘3
izs-alclulrrsnwama
4ss/xtMlI1-uarnnsom_ was toil’lllllllll'lll'lllll
“
................. n’ {I
US. Patent
Dec. 14, 1993
Sheet 1 of 17
‘a
__
Re. 34,476
Nclvort
Connection 21 ---——>
Dist Fig. IB
Sim"
mm
I
3
Screen Table! I] \u N
24
Computer
‘I9
llllllllll? ‘I
I
' '
’
\
_...
I ‘T'lll
IllIllIl
23 |
|\
22
'\ 2
25
W
--3o cable to mci?uy unit
25
141M400 26 28_
are on hhlet mcrocomvuter II Illllllllllllll?'ll
[
I “ mun
amulet
Fig, I B
portable ancillary unit
US. Patent
File Edit in
Dec. 14, 1993
lib
Sheet 2 of 11
Too! Salad
BISIGSBBEHO FOMBBSCRIPTBIISE
SCR'LP'IBASE
if brawn“ Hieroeonputor have” 6 i989 __ '
?ppoinlments Note Pod
Import Tam Letter Pull
Secretary
Fig. 2
Re. 34,476
US. Patent
Dec. 14, 1993
Sheet 3 of 17
‘ File Edit 60 Tools Object: thanae‘rool Select IE! I 4}
am v.
StCRETARY
42
H5. 3
43
Re. 34,476
US. Patent
Dec. 14,1993
Sheet 4 of 17
Re. 34,476
Ella Edit 60 Tools Bbjaah thong: Tool Salad E
V
3;?
EQUISXSSBBEMU FOIUQRHPPUINTHENTS
9/31.! Sun ‘BN8 WEEK. .... .
‘
To Do 9
. . ...................................... ..'..°. ................................................. ..
BLQQMPPER?‘?....................... .. @Hw‘FTAn’L-QK ....................... .. ‘.1 .................................................. .. C! ...................
.................... ..
gTT'l'f?Q-FFEP?/ixi‘............... .. ‘2 U. . . . . . . . . . . g'pswlo‘
. . . . .
....................... I
I
I
I
I
I
i
l
‘
‘
I
.
'
’
.
-
‘
l
'
‘
-
.
.
'
.
.
.. ‘
'
l
.
.
.
‘ u - | . I . I n . . - . - - - . . 1 - Q a - u ¢ - I - ‘ - - - - - - . - . . - . . . q Q - - - I q u - - 1a
. . . . . . .
D ................ .. m ................... .3‘
. . . . . . . . . . . . . . . . . . . . ‘ . . . . . . - . . . . . . . . . . . . . .
n?
D ...................................................................................... Tei-llnlst lup?btelrllvand{Fladlflllelf .... .402 .................................. .. Z:
??ulMld-wrniwms. .............................................. U‘? 'IBQIImSIBQ?HI'IZMBBBV
FIG. 4
US. Patent
Dec. 14, 1993
Sheet 5 of 17
File £63! 60 Tools abject; thaaga tee! Select U
Update] Iipbnd
el~hsslst 3 6 I 9
c101: L
F GII
3 run!
Go/SrclF .... __
H5. 5
Re. 34,476
US. Patent
Dec. 14, 1993
Sheet 6 of 17
Flll Ellli in T96!‘ Pllll‘! OM10": PHNGI'IIS
BislcSBBEMB F Tel-Basis!
Re. 34,476
TIIIII Select
iNTMENTS "is Time Fl t
2;"; ' (I “64..
lab
82
78
3 1
...I:4@.¢.-..umé<\.:A-w.. 529's... ..
.. Ff?émm?-Q’f'. .......... ..
'
so .
.
.
.
.
.
.
.
.
. . .
.
.
. . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
"a
............................................. Né-é‘. kcl'msu 113 .
.
.
.
. .
-
-
-
-
.
.
.
.
~ .
-
-
.
-
-
-
.
.
.
-
-
-
.
l
_
. ....................................... -
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
-
.
.
.
.
.
.
.
,
c.
.|5&;;S;i€.c.n.q.5.53.3-...‘....--......-~“‘H
.
.
.
.
.
.
.
.
.
.
.
.
............................ ...5...... .. .
.I.
,
.
-‘ -
.
-
.
-
.
-
-,-
-
l
-
n
.
-
.
|
¢
.
~
l
.
.
.
-
.
I
z
.
-
.
.
.
.
.
.
.
.
-
-
-
.
.
.
.
.
»
.
.
-
¢
.
¢
.
.
.
-
I
-
-
-
-
.
.
.
.
.
-
.
.
.
.
.
.
,
-
.
.
.
.
-
.
I
.
I
-
-
I
.
-
-
-
-
-
-
.
.
.
I
-
t
I
.
.
,
-
-
.
I
I
.
'
.
,
-
.
.
.
.
I
.
I
I
.
I
.
-
I
-
-
-
-
-
-
-
HEB
0
-
.
-
v
v
v
p
-
a
-
n
.
.
-
-
.
I
.
-
.
¢
0
.
~
u
.
»
-
l
.
.
.
-
-
-
-
-
-
-
-
.
-
-
-
-
-
-
.
-
I
.
-
-
¢
¢
.
..
.
a
US. Patent
Dec. 14, 1993
Sheet 7 of 17
File Edit 60 ‘tools Paint Buttons Patterns
Cut New Past
Re. 34,476
Toot Satan!
II DlslcSBDEM? FoIdQnIIPPOINTMENTS Tel-Baht Bill W. In" Run 4! T Go/Srch Remind Time II Ill-E
?nial"
u. 2 w
6 7 .
3:40 PM
“nu.
..
inn} "-umUeHL".g-é-;;;‘Zuu"UH...- .--------~--.......»... --..-....|.
HS. 7
"a
US. Patent
Dec. 14, 1993
?le Edit 60 fools Pain!
Sheet 8 of 17
"Hams
Re. 34,476
Tool hlact
DMGSBDEMO FDMORBPPDIN'I'MENTS Cut New PU“
r.‘ “ Bun # T
Tel-assist
Go/Srch
MB ELTECi-LNEC
Remind
Tlma
aucl ‘IQ-n13 1‘ 9?"
...vi%.u.¢.vsém.-..l~.-'.w..... 1.9.... .. Ffl’.%.W.&QL?B!T?PE1ffL
u
“may
Tenal?msgn ‘?g/.1
92553.5.
mmcmw P1" \
h
m. .m
r .slfusuwlww 15'. “1-” w”
...I ...s.
d".
4m“ ?ra'é?d-ueawé * am 1 ‘Jr’! L- —
FIG. 8
.&
"NS.
14'.
.91
.
4m“
1»..§e1¢~.=......... Hi... .9 .
US. Patent
Dec. 14,1993
Flle Edit 69 Toots Ilb
Sheet 9 of 17
Re. 34,476
Toni Saint
DISIISBBEHG I Cut mm 0 link? ?lallndau) New Past m9 Search I RP NH SB M Fl P
T:
Hmsh NEQJ TM), Tu?'n-hd-d‘v ‘Pkhk m u: s d’ ' W6 W2 “EU (4 M5 mar. UAUHII'HMQWPM ‘A i'nclai- am“ 1,31.» 9%
o-sszs Mil-w
m
A» Knms ?at” Puma-1 011M144“ . ,
TL; tub-1e73,
bwmla, Lglfuq, am In]- La sub-s 01/
m“.
Q14
0L
—TL¢~.LQM 4W /':b»\
123 First St,5ta 499 San Jose, CA 95033
Dear Tarrg, Just a nut: to thank you far gour assistance in haiping us apply NSC‘: ?at
FIG. 9
US. Patent
Dec. 14, 1993
Sheet 10 of 17
Illa Edit 60 Tools abject: [3
I_Ter~r~y Hansen, West Coast Sales Mgr. NEC Electronics Div.
123 First St, Suite 456 San Jose, CA 95033
Tow H104» “candida;
mil
FIB. ID
’
Re. 34,476
US. Patent
Dec. 14, 1993
Filo Edit Go mm Paint
Patton:
You! Select
Disk=$80£M0 foldensitre 0 link? ?lotlndoa)
Cut Bite New Post
Sheet 11 of 17
Search
Bl’ Nil SB It FILE
114
s
o haw“ “it gs
Hr. crrg Hansen 2, NEC Electronic 123 First St, to
San Jose, CA 9%
9
_
4-’
9
Dear Terry,
N ‘0
Just a note to thank gou for your assist
n helping
us opptg NEC‘s Hot panel technology to th Mac environment and in tracking down a video
HG. H
Inner who
m
Re. 34,476
US. Patent
Dec. 14, 1993
Filo Edlt Go Tools 89
Cut New Post
Sheet 12 of 17
Tool Soloct
IIIsIcSBDEMB FoldenStBlPTB?SE 9 I link? CCC Bun Search [a ort M’ NR 58 H FILE 1
3mm
October 17, 1989
r1r. Term Hansen
{5
NEC Electronic Div 123 First St, Ste 499 San Jose, CA 95033
Dear Torry, Just a note to thank you (or your assistance in holping
us apply NEE‘: Hot panol technology to the Ho: onvtronmont om! in tracking down a vtdoo ongtnoor who s
H5. 12
Re. 34,476
US. Patent
Dec. 14, 1993
Sheet 13 of 17
flle Edit 60 ‘feels as
Tool Select
l’ lPTBBSE link 7 file (Index) HP Nll 58 It Ht!
tut II I New Post Run Search 4
I“ (out iaijwt
k:
0% In 0
'
we ' 5312i
a:
MM“
?O-J
.7,
0...
u.»
94
cards, ‘I’ t W notes, letters, appointment book, colander, or documents. Alternately, the ScratchPad stands up to be uses just like a regular screen
(or regular programs. Because development work on the ScratchPad hardware
is not yet complete, a graphics tablet will be used ln this
demonstration to display the significant potential productivity gains which the system can make possible.
FIB. I3
Re. 34,476
US. Patent
Dec. 14, 1993
Sheet 14 of 17
m: :on 60 Tools on
Re. 34,476
‘he! mm m
DistnSBDEMG FoldenSCBlPTBBSE Cut New Pas
Bite I till’ Search
link ?iellndalll ll 8 It? NH 88 SC FILE as H l 0 P
.
-
u
s
s
.
-
-
.
.
.
.
-
-
.
.
.
.
-
-
.
.
.
|
.
.
.
.
.
-
-
-
.
.
.
.
.
.
.
.
.
-
-
-
.
¢
.
.
.
. ,
.
.
- _I
-
.
.
.
-
-
u
l
.
.
.
.
.
.
.
-
t
-
-
a
-
. .
.
.
-
.
u
-
.
-
-
-
-
.
.
.
.
-
-
-
.
.
-
-
-
-
.
.
-
s
-
.
.
..............
.....
.
.
-
.
u
s
.
.
.
..
........
....................... ..@.,gul>......6 first question that probobig comes to mind is: Why woutd we wont to do this Probably tho most significant reason is that the productivity prom so of porsonoi computers to many instances simply hos not borne its oxpoc fruit. According to most oxporis, there has been LITTLE OR NO INCREASE m the
HE. I4
.
US. Patent
Dec. 14,1993
Sheet 15 of 17
file Edit 50 Tools Paint Options Pettems
Re. 34,476
Tool Select
OisIcSBBEMO Folderzititl?‘liiii 7 fite linden)
Cut Site I) New Post iii? Search
it? Hit SB St P
“E
~
'.Ij?;LLJQQIQQXRQELUE111111111 -
.
.
-
-
I
.
.
.
l
-
.
.
.
.
-
l
.
.
.
.
-
.
s
.
.
.
.
.
.
-
.
.
.
.
-
t
.
.
-
s
.
.
.
~
.
.
.
.
-
s
'
-
-
.
.
s
.
.
.
~
.
.
.
.
.
.
.
.
.
.
.
.
-
s
.
.
.
.
-
.
-
.
.
.
~
.
.
.
-
.
.
.
.
.
.
.
.
.
.
.
.
s
~
|
l
.
.
-
.
-
.
-
.
.
.
.
.
.
.
.
.
.
.
-
-
- -
-
.
.
.
.
,
.
.
.
.
.
.
.
.
.
..
.
v
.
.
.
-
.
.
-
s
s
.
u
-
.
-
-
.
-
-
.
-
-
u
i
-
I
s
-
-
-
-
-
-
.
.
s
s
s
s
. ,-
s
-
-
-
I
s
.
-
»
.
.
I
.
.
-
-
.
.
.
-
i
s
.
I
-
-
.
.
s
e
-
.
-
s
s
.
v
I
.
.
-
-
- ' -
|
s
t
.
I
-
-
I
-
-
p
-
s
.
s
I
s
e
-
.
.
.
-
.
.
-
s
s
.
.
s
.
.
.
.
-
I
I
.
.
.
.
.
~
.
.
.
.
-
.
-
-
s
-
.
I
-
.
.
.
-
s
.
.
.
.
.
.
-
p
-
.
.
.
.
.
i
.
-
s
-
.
.
-
.
-
.
-
- ,-
.
-
s
s
.
.
.
.
-
-
.
s
.
.
.
~
-
.
-
s
.
.
.
-
.
-
-
s
.
.
.
I
n
n
u
w
1
u
.
.
.
.
-
.
.
.
.
-
s
-
.
-
-
s
s
-
.
-
-
-
-
-
s
.
.
l
.
.
-
i
n
I
-
e
I
t
-
I
-
-
.
-
-
s
.
s
.
-
.
-
u
s
s
-
-
-
.
s
.
s
-
-
-
e‘
Q
n
I
u
u
.
.
s
.
.
~
s
According to most experts, there has been LITTLE OR NO INCREASE W the PRODUCTIVITY of white cotter workers In the US, iN SPITE OF THE INFLUX OF
7 HOW HANV MILLION PERSONAL COMPUTERS. Why? Because, nere-to-fore, the only way one could get assistance with persona! tniorrnetion processing was to type tnformation into the computer. Sit down, sit up straight and TYPE (very laborious - tor most of us). How many us really LIKE to type?
H5115
.
-
.
ee
-
-
.
.
US. Patent
file tax: 5
Dec. 14,1993
Sheet 16 of 17
Re. 34,476
Incl: Object: E3]
III Bl?nSBBEMB Foldcn?atcbank _
US. Patent
Dec. 14, 1993
Fill it!!! 90 ‘M018 0b
Sheet 17 of 11
TIME 58kt‘!
nislnnon's F
‘*
IIINK. iIO.:IIl 39!]
FIG. I?
Re. 34,476
1
Re. 34,476
HYBRID INFOKMATION MANAGEMENT SYSTEM FOR HANDWRITING AND TEXT
tion of the 25 million or more personal computers which have been sold in the United States. There would undoubtedly be many more computer
Matterenelosedtnheavybraekets [ ] appearsinthe original patent but forms no part of this reissue speci?ca tion; matter printed in Italics indicates the additions made
users and more numerous applications targeted at com mon information processing tasks such as those men tioned above if a keyboard were not required to enter
by reissue. This is a reissue of US. Par. No. 5,063,600.
BACKGROUND 1. Field of Invention This invention relates to computers, speci?cally to a
2
ductivity of white collar workers has not signi?cantly increased over the past decade (1979-1989), despite the introduction into the business sector of the major por
10
data. Many people don't know how to type effectively and, for any of a wide variety of reasons, don’t want to
learn. Typical examples include executives, house wives, older people, children and many professionals. The substantial learning requirement thus constitutes a
computer information system which accepts handwrit
signi?cant drawback. In addition, the typical computer
ten as well as keyboard input.
keyboard (known as the QWERTY keyboard) was purposely arranged by its inventors, Sholes et al, in an
2. Description of Prior Art
Keyboard Interface-an impediment to Greater Realization of Computer Bene?ts Personal computers possess the capability for storing, retrieving, and manipulating information more rapidly, accurately and efficiently than do corresponding man ual methods. Yet despite their widespread implementa tion, with limited exceptions, their bene?ts have not signi?cantly affected the bulk of the daily “mainstream” written information processing of most users. The phrase “mainstream written information process
ing” is useful to describe written information processing associated with information items which occur fre‘ quently in the course of a normal day, and associated activities such as storage, retrieval, transmission, and
inefficient manner so as to purposely impede typing
speed to prevent the crude keys of the time from jam 20 thing. The QWERTY keyboard itself thus deters nov ices from using it. While it is possible to type with one ?nger, users perceive little or no bene?t from one-?nger typing. Indeed, even pro?cient typists ?nd that for many potential applications, such short notes, remind 25 ers, calendar annotations, expense record-keeping, per sonal data documentation or messages (i.e., items which constitute the bulk of their daily written information
processing, the typing effort simply outweighs the ad vantages. Even though typing can be faster than handwriting,
the relatively precise positioning of the body, hands, and ?ngers required for typing frequently make it par
manipulation. Thus, the mainstream written informa
ticularly inconvenient for short written work. Imagine the difficulty of trying to take typewritten notes while list of things to do, reminders, miscellaneous notes, 35 using a conventional telephone. Resistance toward tion commerce of a homemaker may be grocery lists, a
check writing and calendar annotations. That of a busi ness employee may embrace a wide plurality of items, such as transmittals (memos) to others, messages, thoughts committed to a scratch pad, notes from meet
ized by novice users as “non-intuitive", "unfriendly",
ings or telephone conversations, “to-do" lists, appoint
and "unnecessarily complex”.
ments, and a wide variety of materials to be typed by a secretary, such as letters, descriptions, reports, etc.
which do not admit handwritten data relates to the fact
computer usage among non-typists is further com
pounded by having to deal with a personal computer interface which, in the majority of cases, is character Another signi?cant drawback to computer systems
Signi?cant gains in productivity have been achieved (1) with custom or specialized PC applications, and (2)
that their storage ?les generally may not contain hand written data. Because most real-world business ?les in areas such as word processing, spreadsheet usage and 45 contain some handwritten information, or at least hand
desktop publishing. However, in comparison with the
written annotations, a second set of manual storage ?les
use of pencil and paper, the relative utilization of such
must be maintained. Signi?cant potential bene?ts of computerization, such as instant, labor-less, retrieval
applications among white-collar workers is relatively
infrequent. Thus, a user may ?nd a word processor to and storage are thus not realized. Employment of a be the court of last resort when the secretary cannot 50 keyboard as the entry mechanism also limits the utility type up an urgently needed communication, or use a of very small portable computers because the restricted
spreadsheet program periodically for quarterly budget
keyboard size makes data entry very inefficient. Thus,
calculations. Even though there are a few high-fre quency application areas, such as calendaring, for
rent computer designed to ?t into a vest pocket. There
one could not effectively enter meeting notes on a cur
which PC software has been developed, in practice, 55 are other disadvantages associated with the keyboard entry mechanism. Different keyboards are required for puterized assistance for the bulk of high-volume infor cultures with different character sets. Also, the key users have generally resisted attempts to provide com
mation commerce activities, such as those mentioned
board can not provide the communicative power of a
above. Thus, despite the large number of personal com puters sold, little headway has been made in utilizing the computer to improve the efficiency of most user's mainstream everyday information processing. The truth of the observation that the potential computer bene?ts
drawing.
are not being realized for much of our daily business
important appointment book and "to do" lists, and, of
Generally, it seems preferable to carry out most writ ten information processing using a pencil or pen and a
variety of manual storage and retrieval devices. These include scratch pads, ?le folders and drawers, our all
information processing is apparent, not only through 65 course our desk top, heaped high with reports, papers, close observation of business practice, but appears also to be borne out by economic statistics. It is widely ac
cepted among contemporary economists that the pro
notes, reminders, at least one stack of magazines and other paraphernalia indicative of the rather chaotic way we carry out our information handling. Thus, in spite of
3
Re. 34,476
4
the many potential bene?ts the personal computer can
"keyed” in by touching graphic representations of
offer, we continue to conduct most of our information
"keys” pictured on the display. Thus, if a user wished to store handwritten notes taken during a telephone con
processing with paper, pencil, and other manual instru
versation, it can be accomplished by simply touching a
ments.
Thus, it is clear that heretofore the requirement that
sequence of graphic "keys" on the display to describe a desired ?le name, followed by another graphic button entitled "FILE".
information be entered via a keyboard represents a sig ni?cant impediment to greater computer usage in terms
of: 1) number of users; 2) number of bene?cial applica Finally, development of handwriting interfaces has tions; and 3) derivation of consequent productivity ben been facilitated by the appearance of software develop 10 ment systems which provide extensive capabilities for e?ts. merging graphic and textual computer representations Feasibility of Handwriting into the Computer and offer the computer developer macro tools for ma nipulating graphics and text in what appears to be an
conceptually, an interface which allowed users to
handwrite information into the computer could allevi almost seamless way. In summary, keyboards represent ate these drawbacks. However, until recently, this idea 5 an impediment to realization of computer bene?ts and, was not greeted with much enthusiasm for several rea they are unnecessary. It has become feasible, practical sons. First, the required hardware accompaniments to and highly desireable to handwrite directly into the enter and display such graphics were excessively costly computer. or rather crude. Secondly, there seemed to be a general sentiment which suggested that information stored in a computer must be digitalized to be useful, and a practi—
Patents on Handwriting in Computers Heretofore, a variety of approaches were made to apply handwriting in limited areas as opposed to the
cal system to digitize (i.e. recognize) handwriting (as
opposed to printing) had not been developed, nor has it totality of the individual’s daily written information yet. processing. The following patents deal with handwrit In the last several years, signi?cant advances in hard 25 ing editing (principally, reformatting to improve legibil ware performance and dramatic reductions in costs ity or more remotely character recognition and combi have combined to make the physical entry of handwrit
ing into a personal computer feasible and practical. It has become possible to combine a flat panel display of
signi?cantly high resolution with a high-resolution, transparent, digitizing tablet to develop what might be
30
described as a screen tablet. Such a device represents a
combined display and entry device about the size of a tablet of paper and approximately 2.5 cm. thick and may be placed on the desk or lap for use. The screen tablet has a pen which is attached by a wire to the digitizer and functions in a manner identical to the pen used with graphic tablets allowing the user to “write" or draw on
nation display screen/graphic tablet technology. Fox et al, (in U.S. Pat. No. 4,727,588, Feb. 23, 1988) shows a system for handwriting duplication for multiple printed copies. Hardin Sr. et al, (in U.S. Pat. No. 4,817,034, Mar. 28, 1989) shows a system for document editing. Barker et al, (U.S. Pat. No. 4,815,029, Mar. 21, 1989) shows a system which allows manipulation of both graphic and textual images similar to text publishing programs now popular. None of these systems seek to
apply handwriting computer technology to areas of high volume daily information processing where it
could do the most good. the transparent digitizing surface, and have the writing show up on the flat panel display which underlies the 40 Handwriting Digitization Efforts digitizing surface. Such devices are available through Interest in the use of handwriting in personal comput several commercial sources including MicroTouch Inc. ers is de?nitely on the increase. The most notable area of Woburn, Mass. or Toishiba Advanced Systems Divi involves character recognition of hand printed charac sion of Irvine, Calif. However, because an appropriate ters. The erroneous belief apparently still persists that in information management system has not been available, order to be useful, information stored within a com their potential has not been fully exploited as an entry puter must be digitized. There are both signi?cant re means to a system which could provide computerized search activities and commercial manifestations of this assistance to the major share of a user's daily written
interest by parties at Linus Technologies, Reston, Va., The feasibility of handwriting into the computer is 50 Grid Computer Systems, Fremont, Calif, and at the IBM Research Laboratories in Yorktown Heights, NY. made more apparent by the realization that it is not even Although recognition of hand printed characters pos necessary to have a keyboard to supply the limited sesses the desirable property of being a very natural amount of digitization needed to index graphical hand entry medium it has numerous drawbacks. It generally written information. I have made an analysis of the
information processing.
items which constitute the bulk of our daily information 55 requires that the user pattem-train the computer to recognize the individual’s printed characters. Without processing. This analysis indicated that only a very training, recognition errors are often excessive. This minor part of the information (or an adjunct to it such as then, restricts entry to users who have “trained” the a ?le description) needed to be digitized to accomplish computer. in addition, entry errors often occur if the the desired information processing functions. For exam ple, to send a note or memo to a colleague, only the 60 user varies the way the character is drawn. Finally, greater computer processing resources (CPU cycles) electronic address of the intended receiver need be in are required than with other entry mechanisms. In digital format; the text or body of the information can short, it is questionable whether much net bene?t de remain in the graphic form in which it was entered and
will be displayed by the recipient exactly as a handwrit
rives from the digitization of hand-printed characters
ten note on his display. Additionally, the very minor 65
through character recognition methods, particularly,
amount of information which must be supplied in a digital format can be either selected from a list of menu
when there exist other means for entering characters which possess fewer drawbacks, yet do not require a
items (such as the names of users on a network) or
keyboard.
