|Publication number||US3846826 A|
|Publication date||5 Nov 1974|
|Filing date||15 Jan 1973|
|Priority date||12 Aug 1971|
|Publication number||US 3846826 A, US 3846826A, US-A-3846826, US3846826 A, US3846826A|
|Original Assignee||R Mueller|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (6), Referenced by (136), Classifications (13)|
|External Links: USPTO, USPTO Assignment, Espacenet|
United States Patent 1191 Mueller Nov. 5, 1974 1 DIRECT TELEVISION DRAWING AND 3,340,401 9/1967 Young 340/365 P IMAGE MANIPULATING SYSTEM 3,539,717 H/1970 3,651,509 3/1972  Inventor: Robert E. Mueller, Britton House, 3,753,712 9/1973 Roosevelt, NJ. 08558  Filed; Jan, 15, 1973 Primary ExaminerRichard Murray  Appl. No.2 323,874 57 ABSTRA T Related US. Application Data C  Continuation-impart of Ser. No. 171,155 Aug. 12 Thls l Person to P or draw 197], abandoned. rectly into color television. No special probe or stylus is required since a person can use brushes or pens, fin- 52 us. c1. ass/s1 P rubber Stamps or any drawing of Painting  Int. Cl. H04n 9/02 ject whatsoever- At the same time a Person can play 58 Field of Search l78/7.6 7.7 5.2 5.4 his free hand Over P keyboard to synthesize 178/D[G 6 7 5SE.179/1M images by manipulating or altering the images or 365 P 324 324 AD 3241 324 35 forms as they are il'ltl'OdUCCd. II iS applicable t0 graphic productions of all sorts, computer input-  keferences Cited output graphic processing systems, for visualizing mathematical transformations, or for use with scan- 2 I68 049 $555 ZZ IT PATENTS 178/20 ning lasers or electron microscopes that etch or score.
e it .Q 2,734,100 2/1956 Kendall 179/1 M 11 Claims, 4 Drawing Figures DIRECT TELEVISION DRAWING AND IMAGE MANIPULATING SYSTEM This application is a continuation-in-part of US. application Ser. No. 171,155 filed Aug. 12, 1971, now abandoned.
BACKGROUND Ever since television was invented artists and designers have been trying to discover exactly what qualities are unique to it as an artistic medium. Recent experimentalists have begun to create images directly in the video medium by electronic circuit manipulation. My invention is a first step toward channelling video image manipulation, allowing a person the necessary freedom of control to keep the human imagination in a free interaction with the medium as unrestrained as possible. It eliminates the need for special styluses or probes, and allows an artist or designer to use the most subtle of his tools directly: the paint brush or a fine steel penpoint. Thus a person can draw or paint directly into the medium of color television in full color without the use of pigments, dyes or inks.
The invention operates when a person places any type of a drawing or painting instrument on a special paintscreen. Marks appear on the color television monitor at points or areas corresponding to the shape of the drawing object tip. One by one, as they are introduced by hand, these marks are made any desired color by controls. The marks can remain where they are placed for a short or a long time, or they can be made to disappear electronically. Color mixing between successively placed forms is either additive or subtractive, or the new color can dominate the old, accomplished electronically and under control of the persons free hand.
Further, the invention enables a person to exert a wide range of automatic visual controls to synthesize images from those actually drawn. For example, by switching on a circuit when a key is pressed it is possible to cause instant size changes in all images drawn in. Other systems allow a person to create the letters of the alphabet, so that he can set them down into the television screen, in any desired color, and move them about at will until he has composed his image.
The versatility of this new medium will obviously make it an important artistic medium for commercial or fine art applications. The results of using this invention can be experienced by looking at the color television monitor at the same moment images are made, or they can be broadcast live over a television station. The pictures can also be recorded on video tape or moving picture film for later viewing. The painting can also be a collaborative effort in which two or more of the instruments are connected together electronically. My invention is in fact a device that turns the visual arts into performing arts so that duets or trios, or even orchestras of visual productions, are possible.
It is clear that my invention has four main areas of application. First, as mentioned above, it is an extremely useful tool for art studios or creative artists, for making pictures for advertising or other printed media, or making animated motion pictures. When used for film animation, background scenes or previously drawn pictures can be applied from conventional television inputs, appearing under the drawn images on the output monitor.
Secondly, the invention serves as a new computer input device, having certain abilities to pre-process forms so that less analysis will be required by the computer, simplifying the problems of pattern recognition and assimilation by the computer.
Third, the invention leads to a simple way for mathematicians to visualize and experiment with electronic symbols, or symbols that immediately manifest mathematical properties such as visual transformations, as for example in transformations that occur when passing from the real to the complex number plane.
Fourth, the output of the invention can be used to control a scanning laser or microscope system employing scanning electrons, for the purposes of etching or burning, allowing a person to perform delicate manual burning or scoring over areas, even down to microscopic dimensions.
Other objects will become obvious as the details of my invention are described. For example, the images can be created by means of musical notes, filtered from an audio circuit and made to activate the manipulating circuits automatically. Various types of image synthesis can also be achieved by differing circuit arrangements, using various types of feedback, for example. Depth can be simulated by causing successively memorized images to be of differing sizes. Depth can also be created by doubling the circuits, providing a means to draw in a volume, and providing dual monitors with appropriate optical systems that allow the right and left eyes to differentiate the images created.
The resolution or detail of all images created in the invention can be made as sharp as desired since it is a closed-circuit color television system. If it is desired to convert the output into standard interlaced 525-line images, they can be derived from a scan converter connected to the output system, or by imaging the visual output directly with a studio television camera.
These are only some of the ideas and applications of my invention that come to mind, but the spirit of my idea as related in detail here naturally include many more.
BRIEF DESCRIPTION OF THE DRAWINGS Other objectives will be apparent from the following detailed description of a preferred embodiment of my invention, taken in conjunction with the accompanying drawings. In the drawings:
FIG. I shows the optical system whereby handplaced marks on a prism cause an interruption of a flying-spot scanner raster image and create a paintpulse gating signal.
FIG. 2 shows a block diagram of a system for utilizing the paintpulse gating signal to introduce and retain any arbitrary color on the screen of a closed-circuit color television system.
FIG. 3 indicates the system whereby movements or distortions can be introduced into the raster to affect the final image.
FIG. 4 shows the details of a key on a piano-type keyboard used to activate and control manipulative image changes through a potentiometer and microswitch arrangement.
DESCRIPTION OF ONE EMBODIMENT Painting or Drawing in Color Television There are many ways to convert a manual movement into an electronic signal suitable for use with a television system to uniquely establish points over the picture area. Most conventional systems use a special probe that a person places onto a television screen, either a probe that detects a position signal from the television raster light itself, as in U.S. Pat. No. 3,271,515 by T. P. Harper, or a probe that causes a position signal to be generated from an overlay or a deformable surface placed over the television screen, as in U.S. Pat. No. 2,227,083 by E. Hendrick. In general a probe has two major disadvantages: it has an inflexible point without variety, and it defines only single points at a time. This limits its usefulness as a source of manual graphic inputs for visual ideas of the complexity required for art productions.
My system, however, enables an artist to use conventional brushes or pens for painting or drawing into color television signals. He can also use his fingers, any type of rubber or plastic form or design, like a rubber stamp, or any stylus whatsoever, which he touches to a special draw or paintscreen, that is one surface of a polished glass or plastic prism or the like. A single stylus can produce a wide variety of line qualities, as for example when its tip is flat so that it can be turned by hand as it is moved, like a flat pen point turned to draw both thick and thin lines. Or if a brush is used, it can cause a very tinydot or line when only the tip is engaged, or a very broad line when it is pressed down. In addition, every point touched on the draw or paintscreen is introduced, so that multiple tipped styluses can introduce large shapes, or rubber stamp-like shapes can introduce symbols or letters, instantly positioned by hand anywhere on the paintscreen and therefore on the output area.
FIG. 1 shows the optical system for causing handintroduced marks to generate a paintpulse gating signal. The raster l of a flying-spot cathode ray tube (CRT) 2, whose sweep is derived from a standard set of vertical and horizontal deflection generators of any line definition desired, is focussed by means of lens 3 through wedge 4 onto the internal totally-reflective undersurface of prism 5. The principal focus of the lens is indicated in the figure by the dashed lines ab to cd, of which only the side portion ae is used. The wedge 4 compensates for the prism refraction in order to bring the entire raster 1 into sharp focus and undistorted at the internal totally reflective surface of prism 5. Normally the entire light from raster 1 is reflected through the prism 5 to condensing lense 6, which gathers all the light and passes it to photo multiplier 7. When some object, like a hand-held brush or stylus 8, touches the top surface outside the totally reflective surface, called here the paintscreen, it causes light at that point to be trapped and not reflected out. For this moment, corresponding to point A of line L in raster 1, there is no, or less signal detected by photo multiplier 7. The signal 9 will appear to dip down from white to black, corresponding to this point, as shown for that line, or for as many points in the lines that the brush or stylus 8 interrupts the raster 1 light. The pulse generated by an arbitrary point A is called the paintpulse." The prism 5 obviously must be highly polished. A slight amount of optically pure oil on the brush or stylus will aid this effeet, but there is sufficient natural oils on brushes that this is unnecessary unless a person is trying to achieve unusual painting effects, in which case he might want to charge a brush highly with water or oil and let it flow over the prism pointscreen as in water-color painting.
FIG. 2 is a block diagram showing how the paintpulse causes any desired color to be generated on the output screen of a color television system. The paintpulse is first amplified in video amp 10, and clipped in the clipper. Clipping is not necessary of course if the paintpulse is of the correct amplitude to drive the gates, as determined by the video amp. 10. Clipper 11 is a voltage-limited diode circuit. The paintpulse serves then as a gating signal to activate three gates 12, 13 and 14. They are each pentode-type keying gates, biased so that when a paintpulse signal is sent to their screen grids they will pass all signals applied to their control grids respectively. The control grids each receive signals from the color generator 15. Color generator 15 produces voltages corresponding to red, green and blue color television signals as they would be required for application directly to the control grids of a color television tri-beam CRT. Since the system is closed circuit, these signals can be dc. The signals necessary to cause white to appear on a color CRT. for example, must have the correct proportionality so that the color phosphors generate the necessary light components that add up to white, namely, equal voltages on each grid. When the three outputs from the color generator 15 maintain this relationship they will produce from black through the grays to white, depending upon their voltage amplitudes. Now if one or the other color signal voltage predominates, that color will predominate in the CRT output; and various combinations of the signals will produce all the colors in the rainbow, at all intensities and saturations, as is well known in the art. The color generator 15 generates these various voltages from a potentiometer-controlled resistive matrixing circuit which generates the R, G and B (Red, Green and Blue) signal voltages under controls 17. This matrix is arranged so that a single control element can be used to introduce the necessary voltage combinations to result in any desired color hue in the output tube. This embodiment of my invention does not require the generation and control of the NTSC composite color television signal since it is closed circuit. If it is desired to use this signal, color gen 15 is a colorizer or color encoder, and the remaining output circuits are designed to operate from this signal, as in a standard color television receiver. The color controls of color gen 15 can be hand set; they can be attached to the piano-like keyboard described below; or they can be mounted on the stylus or brush 8 so that a person can control the color as he paints. The three gates for red 12, green 13 and blue 14 are triggered only when a paintpulse is sent from clipper 11. When they are triggered, they pass the various components of the color signals from color gen 15, set by the controls 17, to three double-ended storage tubes 18, 19 and 20. The signals at this pont are now video signals due to the paintpulse gating actions through the gates, and they are stored by means of the write portion of the storage tubes, deflected across their internal storage surface by the horizontal and vertical deflection portions of scan gen 21, synchronized to the raster 1 of the original flying-spot scanner CRT 2. The various levels of the color signals establish various levels of charge across the storage surface of the storage tubes 18, 19 and 20. This storage is necessary to preserve various signals as the person paints in images across the paintscreen. The read sections of the storage tubes,
also deflected by scan gen 21, detects the various levels of charge across the storage surface, and passes them from a collector element to the color control grids of the color CRT 16. The sweep circuits of the color CRT 16 are also controlled by the scan gen 21. synced to raster 1 through sync 22 in FIG. 3. Blanking signals for the color CRT 16 are generated in 43, also in sync with raster 1.
Therefore, in sum, when a person sets a brush or stylus 8 on the paintscreen of prism 5, he interrupts the raster light 1, causing a lack of light at this point A, which is detected by the photo multiplier 7, amplified in 10, and clipped in 11, and passed to gate in the color signals set by controls 17 in color gen 15, and passed to control the color grids of color CRT 16 through the storage tubes 18, 19 and 20, becomming visible and cumulatively disposed in the correct chosen color at the correctchosen spot corresponding to the original mark position on the visible output screen.
Other images can be introduced into the system through a conventional video resistance network matrix which accepts and combines various video inputs, without their influencing one another. The other images may be background images or other information to be combined with the newly painted inputs, or they may be the input of another similar system controlled by another or by more people. Finally, the images appearing on color CRT 16 can be photographed, or viewed by the person making the color video image. The tri-color output can be replaced by three blackand-white CRTs each therefore giving the red, green and blue images, that lend themselves to be photographed for creating the separation images required for the standard three-color printing process. The entire color output can also be replaced with a scanning laser, scanning electron, iron, X-ray or other scanning system, as described below.
Manipulative Potential This system of point-by-point painting into color television lends itself to the creation of many automatic alterations on the points as they are introduced on the paint screen. My system inherently provides two general manipulative potentials, first one caused by altering, moving or distorting the original raster ground; and second one caused when the gating system introduces information in addition to the color signals, as for instance images derived and generated by vidicon cam eras trained on real images or designs.
Raster Ground Manipulation Considering the first raster ground manipulation, it is clear that the original raster 1 must be in exact focus on the prism 5 totally reflective undersurface, which was the purpose of the correcting wedge 4; that it must not be distorted; and that its shading must be uniform; or otherwise the output signal will not be correct with respect to the drawing or painting laid down. on the paintsurface. This fact can be exploited to cause variations. For example, size variations in the raster 1 will be reflected as size changes in the output. If the raster 1 is made very small with respect to the paint surface of the prism, all movements of the brush or stylus will be written large in the output since small hand movements will encompass the small raster area very easily. And vice versa, if the raster 1 is made to overscan the paint surface, and only a small portion of it covers the paintscreen, all movements of the brush or stylus will only intersect a small portion of the raster, and all movemerits will appear as very small movements in the output since only that portion of the raster scan under the paint surface will be affected by the stylus or brush movements.
FIG. 3 shows how the various control elements of the vertical 23 and horizontal 24 deflection generators that generate raster 1 on CRT 2, can be brought out and controlled by a piane-type keyboard 25. The purpose of this piano of typewriter-like control 25 is to create a versatile and subtle means whereby a person can, with skill and training, be able to synthesize a broad variety of abstract or realistic designs or images everywhere that the painting stylus or brush is placed. The effects of three controls in the vertical circuits and three controls in the horizontal circuits, or six keys on 25, are illustrated in this embodiment of my invention. It is to be understood that the raster can also be altered, distorted, moved or otherwise controlled by means of anaspherical, anamorphic or other types of lenses or mirror systems. The raster can also be computer controlled to create many very complex variations in its geometry and image synthesizing abilities. It can also be controlled by electronic circuits to create symbols, simply by causing it to be moved about in toto by signals that form these symbols and are applied to the centering voltages of the CRT 2, under keyboard or other control. Additionally, the raster can be variously blanked, defocussed or othewise radically altered, as for example if it is turned into a spiral sweep, and so on, all having predetermined effects on the output image and the manner in which the system will break up or distort any drawing or painting laid down by hand point-by-point, but only so long as any particular image manipulating circuit is turned on. The raster can also be distorted or wiggled or moved electronically or optically with acoustical, mechanical-optical or the like systems.
Before describing each of the manipulative functions in this embodiment of my invention it must be understood that they are activated and varied by means of individual keys on a piano keyboard 25 or typewriter-like keyboard not shown. FIG. 4 shows the keys, highlighting the detailed operation of one. The key 26 is pivoted near its rear at 27. An extension of spring metal 28 is engaged with microswitch 29 such that the slightest touch of a finger of hand 30 onto the key will activate it and switch in the appropriate circuit action. At the same time, movement of key 26 will slightly rotate cam 31, and cause it to turn potentiometer 32 by means of the gear surfaces on 31 and 33. Potentiometer 32 is the control element in the same circuit switched on by microswitch 29. Thus a persons touch will activate a circuit and finger pressure will vary its magnitude, springing back off when the finger is lifted. Symbolic representation of this system, its key, microswitch and potentiometer, are shown at 34, 35 and 36 respectively. When no keys are activated, the system operates in the normal, undistorted or unaltered raster position, as described above.
Returning to FIG. 3, the vertical deflection generator, vert def gen 23, is a sawtooth relaxation oscillator, and the horizontal deflection generator, horiz def gen 24, is a flyback-type oscillator, generating a current sawtooth in the deflection yoke of CRT 2. The linearity, height or width, and centering resistive controls of these two circuits are brought out as shown (numbers 37 through 42.) Each of these controls are shunted with six of the variable potentiometer-switch key controls on keyboard 25. The following effects are therefore introduced, and magnitude controlled, as each key is depressed:
Vertical Linearity 37: affects length of small vertical lines, altering the length as they appear in the output, as a function of where they are drawn on the paintscreen along the vertical axis.
Horizontal Linearity 40: same affect as above, only in the horizontal direction.
Vertical Size 38: distorts the vertical size of all lines or shapes drawn on the paintscreen, distorting them along the vertical axis.
Horizontal Size 44: same affect as above, only in the horizontal direction.
Vertical Centering 39: affects position of all points introduced, changing where they will appear along the vertical axis of the output screen.
Horizontal Centering 42: same effect as above, only in the horizontal direction.
In general the system shown in FIG. 3 enables a person to play one hand over the keyboard and manipulate dot-by-dot, or point-by-point, as he draws or paints with his free hand. While the particular manipulations are limited, the potential exists for introducing very comprehensive alterations in the points as they are introduced. It is obvious that a systematic organization of potential manipulations must be made, perhaps under the control of a plug-board type switching system for various different types of image-handling problems.
This system can also cause non-linear coordinate transformations between differing geomemtries of sweep. If, for example, the raster 1 is shifted completely from a rectangular coordinate system to a spiral sweep, and the output monitor maintains a conventional sweep scan, very drastic alterations will occur in all the geometries hand-drawn on the paintscreen, as viewed in the output monitor. In a spiral scan system, the geometric relationships of the scans of raster l and CRT 16 raster, must be such that they begin to scan their respective areas from a given point, generating lines and circles with a consistent relationship, and terminate in synchronism at another given point. Both rasters must be initiated in synchronism, and as the spiral raster is traced out, by a deflection system conventional to the radar art, it must turn one loop of its circle per line of the output raster, terminating at the center when the rectangular raster terminates at its end. All drawn images will therefore be transformed into a distorted, circular image, immediately visible as it is drawn, In another arrangement the invention can be used to manifest visually the discontinuities that occur when complex variables are graphed. If, for example, the paintscreen raster l is overlapped by reflecting it off a broken mirror before it is focussed from 3 to the wedge 4, introducing a discontinuity along a discrete line in the original paintscreen area, when a person draws across this line domain as reflected across the paint surface, the discontinuity will occur as a jump in the output at the same line domain. Discontinuities can also be introduced into the raster l by means of a computer, automatically predistorting it according to any given complex equation, such that any hand-drawn image geometry will be visualized immediately on the output screen in the act of the drawing. The invention therefore becomes a potential adjunct for a mathematician desiring an instantaneous view of transformations of given hand-drawn geometries or shapes transformed from one coordinate system to another. Paintpulse Gating Manipulation In FIG. 2, the gates are turned on in time corresponding to points within the raster l timing, according to where stylus or brush 8 is positioned, generating the paintpulse. If the paintpulse is used to activate signals coming from other sources, those signals will be introduced into the output screen at these points. The desired signals can be derived from a series of small vidicons, whose sweeps are synchronized by the gating paintpulse, trained on a series of specific symbols or images that a person might desire to introduce into the visual output, each switched in by additional keys on keyboard 25. Thus another large body of images can be brought into play with the keyboard, placed down anywhere within the visual output by means of the stylus or brush 8 touching the paintscreen the moment that a particular key is depressed.
The above inputs provide another large group of image manipulations which, in combination with the raster ground manipulation described above, makes the invention a versatile device for graphic creation. The
multi-colored images created are all accumulated withint he storage tubes 18, 19 and 20, unless overdrawn with another images, or erased in total by turning off the storage tubes. 7
Music can be introduced by means of coupling a piano to the switching system of keyboard 25, or the switches of keyboard 25 can control the elements of a music synthesizer or electric organ.
Many variations are also possible, as for example if i the original video derived from the video amp 7 is used to influence the raster l, for example by means of deflection modulating it slightly, or by means of intensity modulating the beam of CRT 2. Thus all images will be distorted according to where the brush or stylus is located, much as if it were a magnet influencing the beam directly. In addition, the image of a given scene or drawing can be derived from a vidicon, applied to the grid of CRT 1, intensity modulating this scene on the raster 1, and with the above feedback, this scene or drawing will be distorted as the person places the brush or stylus over corresponding points, and manipulates them too if desired, allvisible on the monitor output CRT 16, and preserved in the storage tubes or not, as desired.
Another variation introduces paintpulses electronically, eliminating the prism flying-spot painting capability, these pulses being under control of keys on keyboard 25. In such a system single pulses are generated at the raster 1 frame rate in multivibrator circuits, delayed from each other so as not to introduce coincident pulses, each turned on by keys of keyboard 25. When a person plays the keyboard, and also plays circuits that activate manipulation, he can cause images to come and go at various spots across the screen, varied as desired according to the repertory of symbols or images introduced by means of the small vidicons in the system described above.
In another variation musical switching signals, derived from a source of music whose frequencies are filtered and connected to trigger switching voltages as a function of audio frequencies, as in astandard multichannel color organ, are used to turn on the 10 pulses generated above, in a predetermined order across the screen, also switching in designed images from vidicons as described above, according to a random or prearranged musical scheme. Musical audio frequencies would therefore cause images to appear over the visual area of the output screen as a function of the music itself, creating designs and color variations over a color television screen of a pleasing and interesting nature.
Another important variation of my invention replaces the television output with a microscopic laser or electron scanning system for the purpose of scoring, burning, etching or brasing or otherwise influencing areas or objects down to microscopic dimensions. The paintpulse in this etching system for microscopic dimensions is generated by the means outlined above, but it also can be derived from a system identical to that of the Harper invention mentioned above, which is a video-drawing system; or as described in the Hendrick patent, which is a telautographic system.
When the invention output is connected to a scanning electron microscope capable of generating a beam that can etch, score or burn microscope capable of generating a beam that can etch, score or burn miscroscopic objects, similar for example to that described by Braers and Hatzakis in Microcircuits by Electron Beam, in the November 1972 issue of Scientific American, the paintpulse output from clipper 11 controls the beam by deflecting it on and off the axis of the electron microscope column with electrostatic deflection plates. The scanning rate of the microscope is synced to the sync generator 22, and blanking is derived from the same source. Normally a less intense electron beam is made to impinge on the object by having only a portion of the beam in the column line from a small dc level voltage, sufficient to provide enough secondary electrons from the conventionalpickup systems of scanning electron microscopes to view the object. But when the paintpulse is activated it allows the full force of the electron beam to be aimed down the column to etch the object. This action can be activated for as many frame scans as desired to achieve the desired influence upon the microscopic point desired. Using this system, or the laser microscopic system described below, it is possible to alter or influence extremely microscopic dimensions for the purpose of performing delicate manual controls, or making alterations of objects even down to cellular or molecular levels, all under manual control and only limited by the resolution of the microscopic system used. While the scanning electron system is extremely delicate, a laser scanning system could do less diminutive work. In the laser beam output imaging system the laser beam is deflected across a large surface, or through a microscope, to a small area, by means of electrooptical or acoustical-optical deflectors and rotating mirrors, conventional to the laser art. See for example U.S. Pat. No. 3,488,102 by Buck et al., or US. Pat. No. 3,492,596 by Vorie, plus their cited references. Normally, in this application, the laser beam is blocked by a modulating cell to which the video signal containing the potential paintpulses from clipper 11 are applied. The modulator is a Pockels Cell, Kerr Cell or the like, also conventional to the laser art, that is capable of responding to pulse signal inputs. The surface or microscopic object to be influenced by this laser beam is also televised by conventional techniques for observation purposes. When a person places the hand-held stylus on the paint surface, it sends a signal through the amplifier and clipper 11 to operate the modulator, momentarily allowing the laser beam to send its full force against the hand-chosen point on the object or surface to be etched or burned.
While these systems and various methods for drawing point-by-point, and painting into color television, and 5, manipulating the points and images created, and introduce various other types of designed images into a color output, or down to a microscopic dimension for purposes of etching or burning, represent a complete operational system, it should be apparent to anyone familiar with the art that the various elements and steps may be changed or altered, or completely supplanted by the use or substitution of other elements or arrangements of the components without departing from the spirit and scope of my invention. Accordingly, my invention should be considered to include any or all such modifications, variations and alternative forms that fall within the scope of the appended claims.
What I claim is:
1. In a.real-time television drawing system comprismg means to scan over a given area in synchronism with a television timing signal;
means to produce a plurality of image points within said given area;
means to produce electrical signals in response to said image points;
means for generating a plurality of voltages capable of changing said scan in toto according to various patterns;
means for superimposing said voltages selectively on said scanning means;
means including a display system synchronized to said television timing signals responsive to the electrical signals, for producing at points corresponding to said image points the pattern selected during the time of each produced image points.
2. A system according to claim 1,
wherein said means for superimposing said voltages on said scanning means includes a manually operated piano type keyboard.
3. A system according to claim 2 wherein the keys of said keyboard vary the magnitude of the voltages proportionately to the pressure applied to the keys.
4. A system according to claim 3 wherein said keyboard actuates a sound producing instrument.
5. A system according to claim 1 wherein said display system includes a color television display device, and means for supply color television signals to said display device in response to said electrical signals.
6. A system according to claim 1, including:
means for recording siad electrical signals;
means for adjustably modifying selected characteristics of recorded signals with respect to previously recorded signals; and
means for accumulating said signals within at least one television frame-time sequence.
7. An image producing system, comprising an optical device, such as a prism, having a totally re flective surface with an internal side and an exposed outer side; means for contacting the exposed outer side of said totally reflective surface for breaking the total reflectivity thereof at every point of contact; scanning and light detecting means for illuminating and scanning and light detecting means for illuminating and scanning the internal side of said reflective surface and producing electrical output signals in response to diminution of reflected light in accordance with a pattern on said reflective surface during each complete scan of said surface;
means for producing an energy beam and causing it to scan in synchronism with the scanning of the reflective surface; and
output means responsive to said electrical signals for causing said energy beam to produce animage of each contacted point of said reflective surface.
8. A system according to claim 7, wherein said means 9. A system according to claim 7, wherein said last mentioned means includes apparatus for producing a color television image.
10. A system according to claim 7;
means to generate a plurality of television signals which represent specific images;
means responsive to said electical signals that synchronize said television signals;
means to introduce said television signals into said output means at points corresponding to said contact points.
for producing an energy beam includes a microscope wherein said scanning beam physically changes points within the microscopic area.
11. in a real-time television drawing system comprising;
means to cause a narrow beam of light to scan over a given area in synchronism with television timing signals;
an optical device having a totally reflective surface;
time of each contact.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US2168049 *||24 Dec 1936||1 Aug 1939||Bell Telephone Labor Inc||Electro-optical system|
|US2734100 *||7 May 1951||7 Feb 1956||Kendall|
|US3340401 *||26 Dec 1963||5 Sep 1967||Xerox Corp||Motionless data input key|
|US3539717 *||25 Sep 1967||10 Nov 1970||Texas Instruments Inc||Touch control display system|
|US3651509 *||6 Nov 1970||21 Mar 1972||Bell Telephone Labor Inc||Light pen for display having inherent memory|
|US3758712 *||27 Mar 1972||11 Sep 1973||Sarkes Tarzian||Digital special effects generator|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US4025946 *||22 Mar 1976||24 May 1977||Casey Susan D||Method and apparatus for generating graphic designs|
|US4232311 *||20 Mar 1979||4 Nov 1980||Chyron Corporation||Color display apparatus|
|US4318096 *||19 May 1980||2 Mar 1982||Xerox Corporation||Graphics pen for soft displays|
|US4346376 *||16 Apr 1980||24 Aug 1982||Bell Telephone Laboratories, Incorporated||Touch position sensitive surface|
|US4355805 *||30 Sep 1977||26 Oct 1982||Sanders Associates, Inc.||Manually programmable video gaming system|
|US4371893 *||3 Sep 1980||1 Feb 1983||Rabeisen Andre J||Video communication system allowing graphic additions to the images communicated|
|US4484179 *||23 Dec 1981||20 Nov 1984||At&T Bell Laboratories||Touch position sensitive surface|
|US4499457 *||14 May 1982||12 Feb 1985||Evans & Sutherland Computer Corp.||Shadow mask color system with calligraphic displays|
|US4514818 *||1 Dec 1981||30 Apr 1985||Quantel Limited||Video image creation system which simulates drafting tool|
|US4542375 *||11 Feb 1982||17 Sep 1985||At&T Bell Laboratories||Deformable touch sensitive surface|
|US4561017 *||19 Aug 1983||24 Dec 1985||Richard Greene||Graphic input apparatus|
|US4621257 *||15 Aug 1983||4 Nov 1986||At&T Bell Laboratories||Video display touch detection digitizer|
|US4633416 *||29 Jul 1985||30 Dec 1986||Quantel Limited||Video image creation system which simulates drafting tool|
|US4663616 *||25 Jun 1985||5 May 1987||International Business Machines Corp.||Attachment of lines to objects in interactive draw graphics|
|US4683468 *||11 Mar 1985||28 Jul 1987||International Business Machines Corp.||Method for manipulation of graphic sub-objects in an interactive draw graphic system|
|US4694286 *||8 Apr 1983||15 Sep 1987||Tektronix, Inc.||Apparatus and method for modifying displayed color images|
|US4751503 *||24 Dec 1984||14 Jun 1988||Xerox Corporation||Image processing method with improved digital airbrush touch up|
|US4789855 *||19 Feb 1985||6 Dec 1988||Hitachi, Ltd.||Device for editing document in colors|
|US4843568 *||11 Apr 1986||27 Jun 1989||Krueger Myron W||Real time perception of and response to the actions of an unencumbered participant/user|
|US5131056 *||23 Jan 1991||14 Jul 1992||Crosfield Electronics Limited||Electronic airbrushing|
|US5181108 *||7 Oct 1991||19 Jan 1993||Greene Richard M||Graphic input device with uniform sensitivity and no keystone distortion|
|US5216755 *||20 Jun 1991||1 Jun 1993||Quantel Limited||Video image creation system which proportionally mixes previously created image pixel data with currently created data|
|US5459529 *||1 Dec 1989||17 Oct 1995||Quantel, Ltd.||Video processing for composite images|
|US5484288 *||25 Mar 1994||16 Jan 1996||Delgigante; Michael||Apparatus for teaching inscription of characters|
|US5619253 *||28 Apr 1995||8 Apr 1997||Miranda, Jr.; Henry A.||Video display of indicia|
|US5767843 *||29 Oct 1994||16 Jun 1998||Daimler-Benz Aerospace Ag||Manually controlled imput device for a computer|
|US6008800 *||15 Aug 1994||28 Dec 1999||Pryor; Timothy R.||Man machine interfaces for entering data into a computer|
|US6012980 *||16 Oct 1996||11 Jan 2000||Kabushiki Kaisha Sega Enterprises||Coordinates detecting device, method for same and game device|
|US6061177 *||19 Dec 1996||9 May 2000||Fujimoto; Kenneth Noboru||Integrated computer display and graphical input apparatus and method|
|US6750848||3 Nov 1999||15 Jun 2004||Timothy R. Pryor||More useful man machine interfaces and applications|
|US6831220||6 Nov 2003||14 Dec 2004||Rainbow Music Corporation||System for playing music having multi-colored musical notation and instruments|
|US6947029 *||3 Aug 2001||20 Sep 2005||Masaji Katagiri||Handwritten data input device and method, and authenticating device and method|
|US7098891 *||8 Nov 1999||29 Aug 2006||Pryor Timothy R||Method for providing human input to a computer|
|US7714849||31 Jul 2006||11 May 2010||Pryor Timothy R||Control of vehicle functions|
|US7800609||2 Jan 2008||21 Sep 2010||Sensable Technologies, Inc.||Method and apparatus for generating and interfacing with a haptic virtual reality environment|
|US7864173 *||27 Jul 2004||4 Jan 2011||Sensable Technologies, Inc.||Systems and methods for creating virtual objects in a sketch mode in a haptic virtual reality environment|
|US7889195||17 Aug 2007||15 Feb 2011||Sensable Technologies, Inc.||Systems and methods for sculpting virtual objects in a haptic virtual reality environment|
|US7891818||12 Dec 2007||22 Feb 2011||Evans & Sutherland Computer Corporation||System and method for aligning RGB light in a single modulator projector|
|US7990374||28 Jun 2005||2 Aug 2011||Sensable Technologies, Inc.||Apparatus and methods for haptic rendering using data in a graphics pipeline|
|US8077147||13 Mar 2006||13 Dec 2011||Apple Inc.||Mouse with optical sensing surface|
|US8077378||12 Nov 2009||13 Dec 2011||Evans & Sutherland Computer Corporation||Calibration system and method for light modulation device|
|US8111239||8 May 2006||7 Feb 2012||Motion Games, Llc||Man machine interfaces and applications|
|US8125468||30 Jul 2008||28 Feb 2012||Perceptive Pixel Inc.||Liquid multi-touch sensor and display device|
|US8144271||4 Aug 2008||27 Mar 2012||Perceptive Pixel Inc.||Multi-touch sensing through frustrated total internal reflection|
|US8228305||10 Jul 2009||24 Jul 2012||Apple Inc.||Method for providing human input to a computer|
|US8239784||18 Jan 2005||7 Aug 2012||Apple Inc.||Mode-based graphical user interfaces for touch sensitive input devices|
|US8259240||26 Mar 2012||4 Sep 2012||Perceptive Pixel Inc.||Multi-touch sensing through frustrated total internal reflection|
|US8269729||31 Jan 2008||18 Sep 2012||Perceptive Pixel Inc.||Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques|
|US8289316||1 Apr 2010||16 Oct 2012||Perceptive Pixel Inc.||Controlling distribution of error in 2D and 3D manipulation|
|US8306635||23 Jan 2009||6 Nov 2012||Motion Games, Llc||Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction|
|US8314773||13 Feb 2008||20 Nov 2012||Apple Inc.||Mouse having an optically-based scrolling feature|
|US8325181||1 Apr 2010||4 Dec 2012||Perceptive Pixel Inc.||Constraining motion in 2D and 3D manipulation|
|US8358317||26 May 2009||22 Jan 2013||Evans & Sutherland Computer Corporation||System and method for displaying a planar image on a curved surface|
|US8368653||31 Jan 2008||5 Feb 2013||Perceptive Pixel, Inc.||Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques|
|US8381135||30 Sep 2005||19 Feb 2013||Apple Inc.||Proximity detector in handheld device|
|US8405604||31 Oct 2007||26 Mar 2013||Motion Games, Llc||Advanced video gaming methods for education and play using camera based inputs|
|US8427449||23 Jul 2012||23 Apr 2013||Apple Inc.||Method for providing human input to a computer|
|US8441467||3 Aug 2007||14 May 2013||Perceptive Pixel Inc.||Multi-touch sensing display through frustrated total internal reflection|
|US8451268||1 Apr 2010||28 May 2013||Perceptive Pixel Inc.||Screen-space formulation to facilitate manipulations of 2D and 3D structures through interactions relating to 2D manifestations of those structures|
|US8456466||1 Apr 2010||4 Jun 2013||Perceptive Pixel Inc.||Resolving ambiguous rotations in 3D manipulation|
|US8462148||1 Apr 2010||11 Jun 2013||Perceptive Pixel Inc.||Addressing rotational exhaustion in 3D manipulation|
|US8479122||30 Jul 2004||2 Jul 2013||Apple Inc.||Gestures for touch sensitive input devices|
|US8482534||10 Jul 2009||9 Jul 2013||Timothy R. Pryor||Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics|
|US8482535||10 Jul 2009||9 Jul 2013||Apple Inc.||Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics|
|US8493384||1 Apr 2010||23 Jul 2013||Perceptive Pixel Inc.||3D manipulation using applied pressure|
|US8538562||5 Apr 2010||17 Sep 2013||Motion Games, Llc||Camera based interactive exercise|
|US8576199||20 Jul 2007||5 Nov 2013||Apple Inc.||Computer control systems|
|US8576222||3 Jan 2011||5 Nov 2013||3D Systems, Inc.||Systems and methods for interfacing with a virtual object in a haptic virtual environment|
|US8610674||10 Jul 2009||17 Dec 2013||Apple Inc.||Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics|
|US8612856||13 Feb 2013||17 Dec 2013||Apple Inc.||Proximity detector in handheld device|
|US8614668||6 Oct 2011||24 Dec 2013||Motion Games, Llc||Interactive video based games using objects sensed by TV cameras|
|US8624853||9 Apr 2010||7 Jan 2014||Perceptive Pixel Inc.||Structure-augmented touch sensing with frustated total internal reflection|
|US8654104||22 Jul 2013||18 Feb 2014||Perceptive Pixel Inc.||3D manipulation using applied pressure|
|US8654198||30 Apr 2012||18 Feb 2014||Timothy R. Pryor||Camera based interaction and instruction|
|US8674948||31 Jan 2008||18 Mar 2014||Perceptive Pixel, Inc.||Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques|
|US8702248||11 Jun 2009||22 Apr 2014||Evans & Sutherland Computer Corporation||Projection method for reducing interpixel gaps on a viewing surface|
|US8736581||9 Apr 2010||27 May 2014||Perceptive Pixel Inc.||Touch sensing with frustrated total internal reflection|
|US8892219||5 Nov 2012||18 Nov 2014||Motion Games, Llc||Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction|
|US9030411||13 May 2014||12 May 2015||3D Systems, Inc.||Apparatus and methods for haptic rendering using a haptic camera view|
|US9041679||18 Feb 2014||26 May 2015||Perceptive Pixel, Inc.||3D manipulation using applied pressure|
|US9239673||11 Sep 2012||19 Jan 2016||Apple Inc.||Gesturing with a multipoint sensing device|
|US9239677||4 Apr 2007||19 Jan 2016||Apple Inc.||Operation of a computer with touch screen interface|
|US9292111||31 Jan 2007||22 Mar 2016||Apple Inc.||Gesturing with a multipoint sensing device|
|US9323396||1 Jun 2010||26 Apr 2016||Perceptive Pixel, Inc.||Touch sensing|
|US9348458||31 Jan 2005||24 May 2016||Apple Inc.||Gestures for touch sensitive input devices|
|US9448712||14 May 2015||20 Sep 2016||Apple Inc.||Application programming interfaces for scrolling operations|
|US9513744||31 Oct 2007||6 Dec 2016||Apple Inc.||Control systems employing novel physical controls and touch screens|
|US9606668||1 Aug 2012||28 Mar 2017||Apple Inc.||Mode-based graphical user interfaces for touch sensitive input devices|
|US9641826||10 Jul 2012||2 May 2017||Evans & Sutherland Computer Corporation||System and method for displaying distant 3-D stereo on a dome surface|
|US9758042||14 Sep 2012||12 Sep 2017||Apple Inc.|
|US9760272||19 Sep 2016||12 Sep 2017||Apple Inc.||Application programming interfaces for scrolling operations|
|US20030001818 *||3 Aug 2001||2 Jan 2003||Masaji Katagiri||Handwritten data input device and method, and authenticating device and method|
|US20030122733 *||14 Jun 2001||3 Jul 2003||Blackham Geoffrey Howard||Apparatus using framestore demultiplexing|
|US20040074376 *||6 Nov 2003||22 Apr 2004||Rainbow Music Corporation||System for playing music having multi-colored musical notation and instruments|
|US20050174337 *||10 Feb 2005||11 Aug 2005||Nielsen Paul S.||Electronic handheld drawing and gaming system using television monitor|
|US20060109266 *||28 Jun 2005||25 May 2006||Sensable Technologies, Inc.||Apparatus and methods for haptic rendering using data in a graphics pipeline|
|US20060202953 *||8 May 2006||14 Sep 2006||Pryor Timothy R||Novel man machine interfaces and applications|
|US20060267963 *||31 Jul 2006||30 Nov 2006||Pryor Timothy R||Method for providing human input to a computer|
|US20060284834 *||28 Jun 2005||21 Dec 2006||Sensable Technologies, Inc.||Apparatus and methods for haptic rendering using a haptic camera view|
|US20080029691 *||3 Aug 2007||7 Feb 2008||Han Jefferson Y||Multi-touch sensing display through frustrated total internal reflection|
|US20080088620 *||17 Aug 2007||17 Apr 2008||Sensable Technologies, Inc.||Systems and methods for sculpting virtual objects in a haptic virtual reality environment|
|US20080122799 *||31 Oct 2007||29 May 2008||Pryor Timothy R||Human interfaces for vehicles, homes, and other applications|
|US20080179507 *||3 Aug 2007||31 Jul 2008||Han Jefferson||Multi-touch sensing through frustrated total internal reflection|
|US20080180404 *||31 Jan 2008||31 Jul 2008||Han Jefferson Y|
|US20080180405 *||31 Jan 2008||31 Jul 2008||Han Jefferson Y|
|US20080180406 *||31 Jan 2008||31 Jul 2008||Han Jefferson Y|
|US20080212035 *||12 Dec 2007||4 Sep 2008||Christensen Robert R||System and method for aligning RGB light in a single modulator projector|
|US20080218514 *||2 Jan 2008||11 Sep 2008||Sensable Technologies, Inc.||Method and apparatus for generating and interfacing with a haptic virtual reality environment|
|US20080259988 *||22 Jan 2008||23 Oct 2008||Evans & Sutherland Computer Corporation||Optical actuator with improved response time and method of making the same|
|US20080284925 *||4 Aug 2008||20 Nov 2008||Han Jefferson Y||Multi-touch sensing through frustrated total internal reflection|
|US20090002644 *||21 May 2008||1 Jan 2009||Evans & Sutherland Computer Corporation||Invisible scanning safety system|
|US20090033637 *||30 Jul 2008||5 Feb 2009||Han Jefferson Y||Liquid multi-touch sensor and display device|
|US20090168186 *||8 Sep 2008||2 Jul 2009||Forrest Williams||Device and method for reducing etendue in a diode laser|
|US20090219491 *||20 Oct 2008||3 Sep 2009||Evans & Sutherland Computer Corporation||Method of combining multiple Gaussian beams for efficient uniform illumination of one-dimensional light modulators|
|US20090267921 *||10 Jul 2009||29 Oct 2009||Pryor Timothy R|
|US20090322740 *||26 May 2009||31 Dec 2009||Carlson Kenneth L||System and method for displaying a planar image on a curved surface|
|US20100134612 *||4 Feb 2010||3 Jun 2010||Timothy Pryor||Method for enhancing well-being of a small child or baby|
|US20100177060 *||14 Jan 2010||15 Jul 2010||Perceptive Pixel Inc.||Touch-Sensitive Display|
|US20100182136 *||29 Mar 2010||22 Jul 2010||Timothy Pryor||Control of appliances, kitchen and home|
|US20100182137 *||29 Mar 2010||22 Jul 2010||Pryor Timothy R||Control systems involving novel physical controls and touch screens|
|US20100190610 *||5 Apr 2010||29 Jul 2010||Pryor Timothy R||Camera based interactive exercise|
|US20100231547 *||29 Mar 2010||16 Sep 2010||Pryor Timothy R||Reconfigurable tactile control display applications|
|US20100302185 *||9 Apr 2010||2 Dec 2010||Perceptive Pixel Inc.||Touch Sensing|
|US20100302196 *||1 Jun 2010||2 Dec 2010||Perceptive Pixel Inc.||Touch Sensing|
|US20100302210 *||9 Apr 2010||2 Dec 2010||Han Jefferson Y||Touch Sensing|
|US20110018831 *||4 Oct 2010||27 Jan 2011||Pryor Timothy R||Human interfaces for vehicles, homes, and other applications|
|US20110018832 *||4 Oct 2010||27 Jan 2011||Pryor Timothy R||Human interfaces for vehicles, homes, and other applications|
|US20110032203 *||4 Oct 2010||10 Feb 2011||Pryor Timothy R||Human interfaces for vehicles, homes, and other applications|
|US20110037725 *||4 Oct 2010||17 Feb 2011||Pryor Timothy R||Control systems employing novel physical controls and touch screens|
|USRE34835 *||5 Dec 1990||24 Jan 1995||Hitachi, Ltd.||Method and apparatus for editing document in colors|
|USRE45559||8 Oct 1998||9 Jun 2015||Apple Inc.||Portable computers|
|USRE46548||8 Oct 1998||12 Sep 2017||Apple Inc.||Portable computers|
|DE3114354A1 *||9 Apr 1981||24 Jun 1982||Western Electric Co||Beruehrungsempfindliche einrichtung|
|DE3148116A1 *||4 Dec 1981||8 Jul 1982||Quantel Ltd||Videobild-erstellungssystem und bei diesem anwendbares verfahren zum erstellen eines videobildes|
|EP0141729A2 *||23 Oct 1984||15 May 1985||Thomson-Csf||Sensitive display device involving a scanning screen|
|EP0141729A3 *||23 Oct 1984||26 Jun 1985||Thomson-Csf||Sensitive display device involving a scanning screen|
|U.S. Classification||348/207.99, 345/180, 348/239, 345/22, 345/168|
|International Classification||G06F3/033, G06F3/048|
|Cooperative Classification||G06F3/04845, G06F3/033, G06F3/03545|
|European Classification||G06F3/0354N, G06F3/0484M, G06F3/033|