CA2236329C - Three-dimensional drawing system and method - Google Patents

Three-dimensional drawing system and method Download PDF

Info

Publication number
CA2236329C
CA2236329C CA002236329A CA2236329A CA2236329C CA 2236329 C CA2236329 C CA 2236329C CA 002236329 A CA002236329 A CA 002236329A CA 2236329 A CA2236329 A CA 2236329A CA 2236329 C CA2236329 C CA 2236329C
Authority
CA
Canada
Prior art keywords
dimensional
predetermined
images
right eye
filling
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CA002236329A
Other languages
French (fr)
Other versions
CA2236329A1 (en
Inventor
Roman B. Kroitor
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Imax Corp
Original Assignee
Imax Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Imax Corp filed Critical Imax Corp
Publication of CA2236329A1 publication Critical patent/CA2236329A1/en
Application granted granted Critical
Publication of CA2236329C publication Critical patent/CA2236329C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/286Image signal generators having separate monoscopic and stereoscopic modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/334Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spectral multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/337Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using polarisation multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof

Abstract

A method for generating images that appear as complex three-dimensional surfaces when viewed using a stereoscopic viewing system, using only a minimum amount of data to define the images. The stereo contours of a complex three-dimensional surface are drawn using a three-dimensional computer drawing system and three-axis input device. The drawing is viewed with a stereoscopic viewing system using, e.g., a CRT where the left and right eye images are time multiplexed in sequential fields and liquid crystal shutter glasses synchronized with the CRT display. Simply by drawing closed loops in space, filling the closed loops with color, and drawing a minimum number of other stereo contours, an image is created which appears to define a complex three-dimensional surface. The image creates a mental perception of a complete solid object by providing to the observer's eye only the minimum cues required by the brain to create stereo objects with complex surfaces, taking advantage of the stage of human neural processing in which the images the eye sees are coded into similar stereo cues. The normal image processing of the brain is in effect substituted for the complex mathematical processing of prior systems to create objects perceived as having three-dimensional volume and surfaces. Therefore, the tedious design and computations required by present systems to produce a full computer graphics description of the object are eliminated, thereby substantially reducing the time required to draw three-dimensional objects as well as the processing requirements where the images are processed by computers, thus making it possible for artists to create three-dimensional images as simply and intuitively as two-dimensional images have historically been created on two-dimensional surfaces.

Description

WO 97/19423 I'CT/IB96/01481 Three Dimensional Drawing System and Method Fjeid of the Invention This invention relates to a system and method for creating stereoscopic three-dimensional drawings, and in particular an improved three-dimensional drawing system and method requiring specification of only a minimum number of parameters and data to create images that appear three-dimensional when viewed through a stereoscopic viewing system.
>3ackEround of the Invention A problem with existing computer drawing systems far generating images that appear three-dimensional when viewed through a stereoscopic viewing system is that these drawings can be tedious to create, or created in ways that are not natural for artists, and require large amounts of computer memory for storage.
In order for an artist to create a three-dimensional image of an object with a complex surface using traditional computer graphics techniques, hundreds or thousands of polygons must be defined to explicitly define the surfaces of the object in x, y and z coordinates. Alternatively, spline (cubic polynominal) functions may be used which require less descriptive data but a very large number of computer calculations to create an image. These prior art techniques are particularly cumbersome and time-consuming for creating animation sequences of complex objects, such as humans and most living things. Additional background information on computer graphics may be found in Foley, J.D., van Dam, A., Feiner, S.F., and Hughes, J.F., "Computer Graphics -- Principles and Practice,"
2nd edition, 1990.
Systems for drawing directly iu three-dimensional space are known in the art. One example of such a system is described in Schmandt, C., "Interactive Three-dimensional Computer Space, " SPIE Voi. 367, pp. 155-59 (1982). The system described therein utilizes an ordinary CRT display monitor SUBSTITUTE SH~~T (RULE 26) which is viewed by the user through a half silvered mirror placed at a 45° angle with the monitor. The user is provided with a three-dimensional drawing space beneath the mirror and a "wand" for drawing in the three dimensional space.
The wand used in the described system utilizes magnetic position sensing technology to provide its a, y, and z position as well as its attitude. The three dimensional (stereoscopic) effect is achieved by the user viewing the CRT through special glasses utilizing lead lanthanum zirconate titanate (PLZT~ ceramic wafers which function as electrically operated shutters. The Left and right eye views are effectively time-multiplexed by displaying them on alternate scan lines. The operation of the glasses is synchronized with the video signal to allow one eye at a time to view the proper image on the CRT providing the three-dimensional effect.
This technique is sometimes referred to as feld sequential three-dimensional imaging. The observer's brain merges or fuses the left and right eye images to create the perception of depth. The amount of offset between the elements of left and right eye images determines the depth at which the elements are perceived in the resulting stereo image.
An alternate means for providing a three-dimensional view is through the use of anaglyph (two color) left and right eye image separation.
The theory of this techniques is the same as the field sequential technique -- the . observer is provided with separate left and right eye images and the horizontal offset in the images provides the illusion of depth. The observer views an image consisting of two separate images of the same object in two different colors, such as blue and red, superimposed on each other but slightly shifted horizontally.
The observer is provided with a pair of glasses to view the images through filters of matching colors. In this manner, the observer sees, for example, only the blue amage with the red filter lens, and only the red image with the blue filter lens, thus providing separate images to each eye. A limitation of this implementation is that the drawn images are monochrome, whereas the field sequential technique allows for color images.
SUBSTITUTE SHEET (RULE 2fi) A third method for viewing stereoscopic images is through the use of polarizing filters which requires that the left eye image be polarized one way and the right eye image polarized another way. The images are normally projected onto screens using linear polarizing filters as opposed to being viewed on a CRT monitor. The viewer is then provided with corresponding linear polarized glasses.
Summary of the Invention It is an object of the present invention to utilize three-dimensional drawings systems to create stereoscopic drawings using a minimum of artist-defined parameters and data to create the drawn images.
In accordance with a first aspect of the invention, there is provided a computer system for creating apparent stereoscopic three-dimensional images comprising:
a stereoscopic viewing system comprising a display device and means for stereoscopically viewing images on said display device, said stereoscopic viewing means comprising means for generating left eye and right eye two-dimensional images;
a computer input device for defining, by moving said input device in a predetermined three dimensional drawing space, stereo contours of a three-dimensional object from a predetermined perspective view, while not completely defining said object in three dimensions, said stereo contours consisting of closed line loops and other lines;
means for detecting the position of said input device as it is moved within said drawing space;
means, responsive to said detecting means, for determining, for each of said left eye and right eye two-dimensional images, x and y coordinates for a plurality of points on said closed line loops and other lines;
means for generating an apparent three-dimensional surface using said x and y coordinates to generate left and right eye two-dimensional images;
and means in response to said surface-generating means for filling the portions of said left eye and right eye images corresponding to said generated surface in a predetermined color, wherein the image resulting from -3a-the stereoscopic viewing of said filled left eye and right eye images appears as a three-dimensional image of said object from said predetermined perspective view.
A second aspect of the invention provides a method of creating three-dimensional images comprising:
providing a computer drawing system including a computer input device for drawing in a predetermined three-dimensional drawing space and a stereoscopic viewing system, said stereoscopic viewing system generating two-dimensional left eye and right eye images;
defining, by moving said computer input device within said three-dimensional drawing space, the stereo contours of an object, said stereo contours consisting of closed line loops and other lines;
detecting the position of said input device as it is moved within said drawing space;
determining, for each of said left eye and right eye two dimensional images, x and y coordinates for a plurality of points on said closed line loops and other lines in response to said position of said input device;
generating said left eye and right eye images of said object using said x and y coordinates for said plurality of points;
viewing said left eye and right eye images using said stereoscopic viewing system;
defining an apparent three-dimensional surface resulting from said stereoscopic viewing of said left eye and right eye two dimensional images, said surface comprising a closed line loop;
filling, in a predetermined color, the portions of said left eye and right eye images corresponding to said defined surface, whereby the image resulting from the stereoscopic viewing of said left eye and right eye images of said filled surface appears as a three-dimensional image.
A further aspect of the invention provides a method of creating apparent three-dimensional images comprising:
providing a computer drawing system including a computer input device for drawing in a predetermined three dimensional drawing -3b-space and a stereoscopic viewing system, said stereoscopic viewing system generating two-dimensional left eye and right eye images;
defining, by moving said computer input device within said three-dimensional drawing space, the stereo contours of a three-dimensional object from a predetermined perspective view while not completely defining said object in three dimensions, said stereo contours consisting of closed line loops and other lines;
detecting the position of said input device as it is moved within said drawing space;
determining, for each of said left eye and right eye two-dimensional images, x and y coordinates for a plurality of points on said closed line loops and other lines in response to said position of said input device;
generating said left eye and right eye images of said object using said x and y coordinates for said plurality of points;
generating an apparent three-dimensional surface using said left eye and right eye two-dimensional images, said surface comprising a closed line loop;
filling, in a predetermined color, the portions of said left eye and right eye images corresponding to said defined surface, wherein the image resulting from the stereoscopic viewing of said left eye and right eye images of said filled surface appears as a three-dimensional image of said object from said perspective view.
The system and method of the present invention permits a user to simply and quickly draw stereoscopic images with apparently complex surfaces in space by specifying only a minimum amount of data. The invention utilizes the nature of the human stereoscopic visual processing system to interpret the surfaces of the images from stereoscopic contour cues.
The artist utilizes a three axis input device or "wand" and stereoscopic viewing system such as previously described. In the first step of the inventive process, the artist draws, in the three-dimensional drawing space, the required stereo contours of the object by drawing closed line loops and other lines in space. A stereo contour is a differentiable feature of an r WO 97/19423 PCT/IB9b/01481 object, in this case a line, which is displayed laterally displaced in the image seen by the left eye when compared to the image seen by the right eye. The contours .
drawn by the artist do not completely define the outline of the object from top, front, and side view perspectives, but only define the stereo contours of an object from the particular perspective view chosen by the artist.
The second step of the image creation process involves "painting"
the apparent surfaces visible to the observer. This step is accomplished using the known "seed point and flood-fill" technique to fill a closed loop with a color chosen by the artist. The drawing system fills the appropriate portions of the two-dimensional left and right eye image projections of the loop with the chosen color based on the placement of a seed point within the stereo image of the loop.
Alternatively, the color fill may be accomplished using a masking technique, where loops are colored by processing the loop as follows in an off screen buffer for each of the left and right eye images: a simple form, such as a rectangle, just large enough to encompass the two-dimensional Ieft and right eye images of the loop is drawn and filled in the color of the loop chosen by the artist; the outline of the loop is then drawn within the rectangle in the Iine color chosen by the artist;
the region bounded by the interior of the rectangle and the exterior of the loop is then filled in a transparent color; the rectangle is then moved to the viewable display, but only the properly colored loop is visible. The masking technique is an improvement over the seed fill method in the field of computer animation.
The present invention achieves surprising results in that, rather than appearing as two-dimensional planes of color as would be expected, the filed color loops appear to the observer as complex three-dimensional surfaces when viewed through a stereoscopic viewing apparatus because of the three-dimensional stereo contours defined by the edges of the loops and by the additional stereo contour lines drawn by the artist.
The invention thus creates a mental perception of a complete solid object by providing to the observer's eye only the minimum cues required by the SUBSTITUTE SHEET {RULE 26) S
brain to create stereo objects with complex surfaces, taking advantage of the stage of human neural processing in which the images the eye sees are coded into similar cues. In other words, the normal image processing of the brain is substituted for the complex mathematical processing of prior systems to create objects perceived as having three-dimensional volume and surfaces. Therefore, the tedious design and computations required by present systems to produce a full computer graphics description of the object are eliminated, thereby substantially reducing the time required to draw three-dimensional objects as well as the processing and memory requirements where the images are processed by IO computers.
The improved three-dimensional drawing technique has particular application to computer-assisted animation because it permits animators to quickly simply, and intuitively draw three-dimensional objects for use in frames of animation. In addition, the invention has application to virtual reality systems IS where users are provided with stereoscopic viewing systems for viewing three-dimensional images that the viewers may draw themselves.
An additional aspect of the present invention relates to an improved stereoscopicai viewing system that eliminates a problem associated with single monitor systems resulting from the fact that the relationship between the average 20 human eye interocular spacing and the size of an image on a computer monitor does not correspond to the actual theater experience, with the result being that the spatial positioning of drawn objects does not correspond to those seen by a movie audience. The present invention solves this problem by utilizing a binocular viewing system and two physically separated monitors to supply the left and right 25 eye images. In this manner, the scaling between the viewer and the monitors can . be adjusted using the focal Lengths of the objectives and eye pieces.
Brief description of~he drawings Fig. 1(a) illustrates the top view of a three dimensional object.
Fig. 1(b) illustrates the front view of a three dimensional object.
SUBSTITUTE SHEET (RULE 2fi) Fig. 1(c) illustrates the side view of a three dimensional object.
Figs. 2(a)-(c) illustrate three views of a stereo contour line drawn in three-dimensional space to describe a three-dimensional surface in accordance with the present invention.
Figs. 3(a)-(c) illustrate three views of the stereo contour lines drawn in three-dimensional space to describe additional features of a three-dimensional object in accordance with the present invention.
Figs. 4(a)-(c) illustrate three views of the stereo contour Lines drawn in three-dimensional space to describe other additional features of a three-dimensional object in accordance with the present invention.
Figs. S(a)-(c) illustrate the masking technique of the present invention for filling loops with color.
Figs. 5(d)-(fj illustrate the problems with the prior art seed point and flood fill method for filling loops.
Fig. 6 is a block diagram of an improved stereoscopic viewing system of the present invention.
Fig. 7 is a more detailed schematic representation of the improved stereoscopic viewing system of the present invention.
Detailed Description of the Invention The system and method of the present invention provides for fast and intuitive creation of images of complex three-dimensional surfaces, such as human and animal faces and fgures, for which existing computer graphics systems are non-intuitive, tedious and time-consuming. The present invention uses only a minimum of data and computation and thus may be implemented in a low end computer workstation or even a personal computer. For purposes of the detailed description, the invention will be described with reference to its application to computer-assisted animation.
The invention may be further described with regard to Figs. 1-4..
Fig. l illustrates three views of an object (fish) to be animated for viewing using a SUBSTITUTE SHEET tRULE 26j WO 97!19423 PCT/IB96/01481 stereoscopic viewing system. Fig. l(a) illustrates the top or plan view, Fig.
1(b) the front view, and Fig. 1 (c) the side view. In the resulting animation sequence, only the front view is to be seen by the viewer, the top and side views reflect the volume that the object appears to occupy.
In the system and method of the present invention, the animator is provided with a three dimensional drawing space and drawing instrument using a wand and a stereoscopic viewing apparatus. These devices are known in the art of computer graphics. In a preferred embodiment, the three-dimensional drawing system of the present invention is implemented using personal computers. A
total i0 of four PCs are used. One dedicated computer is used to generate the appropriate images for each of the left and right eye views. One computer is used for receiving the input devices, which may, for example, include a joystick in addition to the drawing wand to control the relationship between the movement of the wand in real space and the movement of the wand cursor in the drawing space, and the fourth is used to run control interface software and manage the flle system.
The four computers communicate via their parallel ports. The particular drawing wand used is a "Flock of Birds" by Ascension Technologies, Inc., but such drawing wands are available from other manufacturers. The device uses electromagnetic . waves to provide its position and orientation in three-dimensional space.
The stereoscopic viewing system utilizes liquid crystal shutter glasses, which are available from, among others, Stereographics Corp. When the user moves the wand in space a cursor moves within the space under control of the wand. By pushing a button on the wand, lines are drawn following the path of the wand cursor in three-dimensional space in a color chosen by the artist. It is important that the system provide for vector-based as opposed to bit-mapped drawings, so . that the line segments drawn by the animator may be mathematically defined and processed by the computer. A high resolution 17 inch monitor by Nanao is used s because it was found to be the best from the standpoint of image resolution and stability as well as ease of use.
SUBSTITUTE SHEET (RULE 2b) Fig. 2 illustrates the actual path of the drawing wand cursor in the three dimensional drawing space used to create the body of the fish. The animator draws only the front view of the outline of the object in three-dimensional space as shown in Fig. 2{b). Starting at point A, the wand cursor is moved in a straight downward direction to point B, then forward (i.e., "out" of the paper) along the curved path from B to C, upward along the curved path from C to D, and backward (i.e., "into" the paper) along the curved path from D back to A.
Although three views are shown, top {Fig. 2(a)), front (Fig. 2(b)), and side {Fig.
2(c)), these are not separately drawn by the animator but are included to show the result, in two-dimensional views, of the Line drawn by the animator in three-dimensional space. As shown by the three views of Figs. 2(a)-(c), the Line intersects a plurality of planes and thus describe a three-dimensional surface.
Also, it is apparent that the object has not been fully defined in three-dimensional space by this line and would not have the intended appearance if viewed from the top. This is because only the surface that will be observable in the animation sequence has been defined, thus significantly reducing the processing and memory requirements of the computer system.
- The additional stereo contour features of the object are added to the basic outline in a similar manner. In Fig. 3, the drawing of the eyes and mouth shown in Fig. 1 are illustrated. The front view, Fig. 3(b), shows the movements of the wand cursor used to create the left eye (starting and ending at points E and G), the right eye (starting and ending at points F and F~, and the mouth (starting and ending at point n. The outline of the fish is shown as a dotted Line in Fig.
3(b) for reference. The top and side views of these features are illustrated in Figs.
3(a) and 3(c), respectively. Similarly, Fig. 4 illustrates the top, front and side views, respectively, in Figs. 4(a), 4(b), and 4(c), of the fins shown in Fig.
1. The right fin, Ieft fm, and top fin are shown drawn beginning at points J, K, and L, respectively.
SUBSTITUTE SHEET RULE 2fi) Thus, with only a few movements of the wand in the three-' dimensional drawing space, the fish has been partly defined in three dimensions for a stereoscopic drawing. This process, however, only defines the stereo contours of the fish, and does so only for the particular perspective view chosen by the animator. A further requirement for the creation of apparently complez three-dimensional surfaces of the object is that the appropriate parts of the drawing - those which are intended to create in the viewer's brain an image of a three-dimensional surface -- are filled with color.
Filling of the loops with color can be done using the known seed point and flood-fill method. To fill a region of the object, the animator selects the loop and a color with which it will be filled. This may be implemented in any of a number of ways by, e.g., using known techniques in computer drawing systems such as positioning the drawing wand within the loop to select the loop and determine a "seed" point, and choosing a color from an on-screen color palette. In response to the actions of the animator, the system flood-fills the appropriate portions of the left and right two-dimensional eye images and instantaneously displays the resulting stereo surface. The seed fill method is described in Foley et al.
Alternatively, filling may be accomplished using the novel technique referred to herein as "masking. " Masking is a technique where a loop that is part of a stereo image is felled for display purposes by processing the loop prior to display in the following manner. First, the left and right eye projections of the stereo image of the loop on to a two-dimensional plane are ascertained in order to create the separate left and right eye views required to achieve the three-dimensional effect using any of the above-described techniques (field sequential . image separation, anaglyph, or polarization). For each of these projections, in an off screen buffer, a rectangle at least one pizel larger than the projected loop on each side is generated by determining the minimum and ma~cimum z and y coordinates of the loop as shown in Fig. 5(a). Fig. 5(a) illustrates a single eye SUBSTITUTE SHEET (~iLlL~ 26) WO 97/19423 PCT/gB96/01481 projection of a loop and rectangle. The entire rectangular area is drawn in the color with which the loop is to be felled. The two-dimensional projection of the ' loop originally drawn by the animator is transferred to the buffer in the proper line color for the Loop as shown in Fig. 5(b). A second fill of the rectangle is then performed using the seed point and flood fell method discussed above. The seed point is generated just within any corner of the rectangle. For this second fill, only the region bounded by the exterior of the Loop and the rectangle is fined so that the interior of the loop is not filled and therefore remains in the original loop color as shown in Fig. 5(c). The second fill consists of a code that makes this bounded region transparent when displayed so that only the loop retrains visible in the proper color. After processing in this manner, which takes only a small fraction of a second, the rectangle is transferred from the buffer to the viewable display. All that appears is the Ioop in the proper color and the boundary Iine for the loop. In addition, although in a preferred embodiment a rectangle is used for simplicity, any convenient geometric shape may be used.
The masking technique of the present invention has advantages over the seed fill technique when stereo images are processed. For example, when the seed fell method is used for small loops, it may be difficult or impossible for the animator to place the seed point within the stereo loop in such a position that when the left and right eye two-dimensional projections of the stereo image are generated, the seed point falls within each projected two-dimensional projected loops. The result is that for one or both eye projections, the exterior of the loop is filled and not the interior. In addition, where a computer-assisted animation sequence of drawings is being generated and it is desired to automatically paint the series of drawings created from one original drawing, the generated drawings may, by design, contain loops that twist in three-dimensional space, thus creating several loops in the twv-dimensional projections of the transformed loop. In this situation, the seed point may fall entirely out of the loops, or only fill one of the generated loops. For example, a single loop with a seed point SP, shown in Fig.
SUBSTITUTE SHEET (RULE 2~) WO 97/19423 PCTlIB96/01481 1i 5(d), may be twisted into a figure 8, shown in Fig. 5(e). The seed point SP
may then fail within only one portion of the figure 8 as shown in Fig. 5(e), in which case only that portion will be filled. Alternatively, the seed point may fall outside the loop entirely, as shown in Fig. 5(f), in which case the area external to the Ioop will be colored.
Regardless of which technique is used to fill the closed loops in the two-dimensional left and right eye images, the resulting display is the same -the color filled regions appear to be distorted by the three-dimensional edge contours that define the surface when viewed through a stereo viewing system. Rather than appearing flat as would be expected, the surprising result obtained is that the images are perceived as complex three-dimensional surfaces. To the observer, there appears to be an interaction between the stereo edge contours of the loop (and any other stereo contours drawn by the artist such as the mouth, fins, and eyes of the fish as shown in Figs. 3(a)-(c) and 4(a)-(c)), and the filed regions of the two-dimensional Left and right images -- the felled regions appear distorted by the stereo contours into a complex three-dimensional surface.
Thus, only the minimum amount of information necessary to define the three-dimensional surface to be used in the animation sequence is specified by the animator in a direct and intuitive manner. This greatly simplifies the job of an animator in creating three-dimensional images for animation sequences. The process also minimizes the memory and processing requirements of the comguter system used and creates the appearance of complex three-dimensional volumes and surfaces without the complicated data structures required to completely define a three-dimensional object. In effect, the human brain performs the processing that would otherwise have to be done by computer. The brain is provided with only the minimum amount of data needed for it to create the iliusion that it is viewing complex three-dimensional surfaces. This is an analog in sgace to the temporal ~ illusion of motion created by motion pictures in which the viewer is provided with SUBSTITUTE SHEET (B~~F 2s~

a series of still photographs spaced in time by an amount small enough to cause the brain to think it is viewing real action.
An additional aspect of the present invention relates to an improved stereoscopical viewing system for creating three-dimensional images. Fig. 6 is a block diagram of the viewing system of the present invention 1, which comprises separate monitors i0 and 20 for the left and right eye images and a binocular optical system 30 for viewing the two horizontally separated monitors. The animator, rather than looking directly at a monitor, views the left eye monitor 10 and the right eye monitor 10 through the binocular optical system 30. In this manner, the effective optical distance between the viewer and the monitor may be controlled by adjusting the focal lengths of the objective lenses and eyepieces in the binocular optical system 10.
Fig. 7 is a more detailed schematic representation of the binocular viewing system 30. The system effectively provides telescopes for the left and right eyes which are laterally adjustable so that viewers can match the spacing to that of their own eyes. Each telescope consists of an eyepiece 31, which in one embodiment is a 9mm eyepiece manufactured by Nagler, and a 25mm objective Lens, which may be an off the-shelf 35mm camera lens. Field lenses 34 are placed at the eyepiece field stops. Mirrors 33 at 45° angles redirect the light from the laterally spaced monitors into each objective lens 32. Alternatively, l2mm eyepieces may be used with 35mm objective lenses. Software is used to correct for the top-bottom and left-right inversion of the images caused by the mirrors. In either configuration, the monitors 10 and 20 would be placed approximately 64 inches apart. The field of view may be changed simply by using eyepieces with different focal lengths. Rather than laterally spacing the monitors as shown in Fig. 6, the monitors may be placed in front of the binocular viewing system if additional mirrors 40 angled at 45° are used as shown in Fig. 7.
For example, the optics can provide a full screen view that permits the artist to view the images exactly as they would appear to a viewer in a theater.
SUBSTITUTE SHEET (~L~LE 2b) This is required in order to ensure that no stereo distortion occurs when the . images drawn by the artist are projected in the theater. in a preferred embodiment, the optics are adjusted in accordance with the screen dimensions and seating layout of IMAX~ theaters. A second field of view allows the animator to see a portion of the total image at the same level of detail as would be perceptible by the theater audience. The portion of the image displayed is determined by the ratio of the monitor horizontal pixel resolution to the total horizontal resolution at which the images will be recorded on to film frames. In this case, the optics provide a field of view which matches the angle which the fraction of the whole image would subtend for a viewer sitting in the center row of a theater.
Finally, a field of view approximately midway between the above extremes is provided as this is suitable for the drawing of images. The binocular viewing system, although advantageous for providing the proper scaling to approximate what an audience member would see, has disadvantages as well. First, only one IS person at a time may view what the animator is drawing. Second, it may be aancomfortable for the animator to use for extended periods of time. An alternate means for providing the animator with proper scaling is through the use of large screen displays. In this system, two high resolution HDTV CRT projectors are used to project each of the left and right eye images on to a large display screen approximately I2 feet wide by 8 feet high. A suitable projector is the Marquis 9000 CRT projector from Electrohome of Ontario, Canada. Either the field sequential technique or the polarized light approach may be used to provide the left and right eye images. The use of the large screen displays provides the animator with a subtended angle view that approximates the view from the center seat of an IMAX theater.
In the present embodiment, the control interface software is implemented as a Microsoft Windows''" application and is modelled on the exposure sheets used in the field of animation to keep track of the different frames ~ an animation sequence.
SUBSTITUTE SHEET (RULE 2f) CA 02236329 1998-~04-29 WO 97/19423 PCT/aB96/01481 14~
The invention has been described in greatest detail with -respect to the particular embodiments and exemplary applications described above.
However, the invention is not limited by this embodiment and examples, but is limited only by the scope of the appended claims.
SUBSTITUTE SYEET (RULE 26)

Claims (26)

We Claim:
1. A computer system for creating apparent stereoscopic three-dimensional images comprising:
a stereoscopic viewing system comprising a display device and means for stereoscopically viewing images on said display device, said stereoscopic viewing means comprising means for generating left eye and right eye two-dimensional images;
a computer input device for defining, by moving said input device in a predetermined three dimensional drawing space, stereo contours of a three-dimensional object from a predetermined perspective view, while not completely defining said object in three dimensions, said stereo contours consisting of closed line loops and other lines;
means for detecting the position of said input device as it is moved within said drawing space;
means, responsive to said detecting means, for determining, for each of said left eye and right eye two-dimensional images, x and y coordinates for a plurality of points on said closed line loops and other lines;
means for generating an apparent three-dimensional surface using said x and y coordinates to generate left and right eye two-dimensional images;
and means in response to said surface-generating means for filling the portions of said left eye and right eye images corresponding to said generated surface in a predetermined color, wherein the image resulting from the stereoscopic viewing of said filled left eye and right eye images appears as a three-dimensional image of said object from said predetermined perspective view.
2. The system of claim 1 wherein said stereoscopic viewing system comprises a field sequential three-dimensional imaging apparatus.
3. The system of claim 1 wherein said input device comprises a drawing wand to provide x, y and z coordinates and wand orientation in space.
4. The system of claim 1 wherein said stereoscopic viewing system comprises an anaglyph color separation imaging apparatus.
5. The system of claim 1 wherein said means for filling comprises means for flood-filling predetermined closed line loops in response to placement of a seed paint in said predetermined loops.
6. The system of claim 1 wherein said means for filling comprises means for masking predetermined closed line loops in said predetermined color.
7. The system of claim 2 wherein said means for filling comprises means for flood-filling predetermined closed line loops in response to placement of a seed point in said predetermined loops.
8. The system of claim 2 wherein said means for filling comprises means for masking predetermined closed line loops in said predetermined color.
9. The system of claim 6 wherein said means for masking a predetermined loop comprises, for each of said left eye and right eye images:
means for determining the minimum and maximum x and y coordinates of said predetermined loop;
means for generating, in an off-screen buffer, a rectangle with x and y coordinates at least one pixel greater than said maximum x and y coordinates of said predetermined loop and at least one pixel less than said minimum x and y coordinates of said predetermined loop, said rectangle generated in said predetermined color;
means for transferring said predetermined loop to the interior of said rectangle in said off-screen buffer;
means for generating a seed point slightly within a corner of said rectangle;

means for filling the area bounded by said rectangle and said predetermined loop using a transparent fill color; and means for transferring said rectangle from said off-screen buffer to said display device.
10. The system of claim 1 wherein said stereoscopic viewing system comprises means for polarizing the left eye and right eye images.
11. A method of creating three-dimensional images comprising:
providing a computer drawing system including a computer input device for drawing in a predetermined three-dimensional drawing space and a stereoscopic viewing system, said stereoscopic viewing system generating two-dimensional left eye and right eye images;
defining, by moving said computer input device within said three-dimensional drawing space, the stereo contours of an object, said stereo contours consisting of closed line loops and other lines;
detecting the position of said input device as it is moved within said drawing space;
determining, for each of said left eye and right eye two dimensional images, x and y coordinates for a plurality of points on said closed line loops and other lines in response to said position of said input device;
generating said left eye and right eye images of said object using said x and y coordinates for said plurality of points;
viewing said left eye and right eye images using said stereoscopic viewing system;
defining an apparent three-dimensional surface resulting from said stereoscopic viewing of said left eye and right eye two dimensional images, said surface comprising a closed line loop;
filling, in a predetermined color, the portions of said left eye and right eye images corresponding to said defined surface, whereby the image resulting from the stereoscopic viewing of said left eye and right eye images of said filled surface appears as a three-dimensional image.
12. A method of creating apparent three-dimensional images comprising:
providing a computer drawing system including a computer input device for drawing in a predetermined three dimensional drawing space and a stereoscopic viewing system, said stereoscopic viewing system generating two-dimensional left eye and right eye images;
defining, by moving said computer input device within said three-dimensional drawing space, the stereo contours of a three-dimensional object from a predetermined perspective view while not completely defining said object in three dimensions, said stereo contours consisting of closed line loops and other lines;
detecting the position of said input device as it is moved within said drawing space;
determining, for each of said left eye and right eye two-dimensional images, x and y coordinates for a plurality of points on said closed line loops and other lines in response to said position of said input device;
generating said left eye and right eye images of said object using said x and y coordinates for said plurality of points;
generating an apparent three-dimensional surface using said left eye and right eye two-dimensional images, said surface comprising a closed line loop;
filling, in a predetermined color, the portions of said left eye and right eye images corresponding to said defined surface, wherein the image resulting from the stereoscopic viewing of said left eye and right eye images of said filled surface appears as a three-dimensional image of said object from said perspective view.
13. The method of claim 11 wherein said input device comprises a drawing wand to provide x, y, and z coordinates and wand orientation in space.
14. The method of claim 11 wherein said stereoscopic viewing system comprises an anaglyph color separation imaging apparatus.
15. The method of claim 11 wherein said filling of said portions of said left eye and right eye images comprises flood-filling predetermined closed line loops in response to placement of a seed point in said predetermined loops.
16. The system of claim 11 wherein said filling comprises masking predetermined closed line loops in said predetermined color.
17. The method of claim 12 wherein said filling comprises masking predetermined closed line loops in said predetermined color.
18. The method of claim 13 wherein said filling of said portions of said left eye and right eye images comprises flood-filling predetermined closed line loops in response to placement of a seed point in said predetermined loops.
19. The method of claim 13 wherein said filling comprises masking predetermined closed line loops in said predetermined color.
20. The method of claim 17 wherein said masking a predetermined loop comprises, for each of said left eye and right eye images:
determining the minimum and maximum x and y coordinates of said predetermined loop;
generating, in an off-screen buffer, a rectangle with x and y coordinates at least one pixel greater than said maximum x and y coordinates of said predetermined loop and at least one pixel less than said minimum x and y coordinates of said predetermined loop, said rectangle generated in said predetermined color;
transferring said predetermined loop to the interior of said rectangle in said off-screen buffer;

generating a seed point slightly within a corner of said rectangle;
filling the area bounded by said rectangle and said predetermined loop using a transparent fill color; and transferring said rectangle from said off-screen buffer to a display device.
21. The method of claim 12 wherein said stereoscopic viewing system comprises a field sequential three-dimensional imaging apparatus.
22. The method of claim 21 wherein said filling of said portions of said left eye and right eye images comprises flood-filling predetermined closed line loops in response to placement of a seed point in said predetermined loops.
23. The method of claim 21 wherein said filling comprises masking predetermined closed line loops in said predetermined color.
24. The method of claim 12 wherein said input device comprises a drawing wand to provide x, y, and z coordinates and wand orientation in space.
25. The method of claim 12 wherein said stereoscopic viewing system comprises an anaglyph color separation imaging apparatus.
26. The method of claim 12 wherein said filling of said portions of said left eye and right eye images comprises flood-filling predetermined closed line loops in response to placement of a seed point in said predetermined loops.
CA002236329A 1995-11-24 1996-11-22 Three-dimensional drawing system and method Expired - Fee Related CA2236329C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/562,334 1995-11-24
US08/562,334 US5847710A (en) 1995-11-24 1995-11-24 Method and apparatus for creating three dimensional drawings
PCT/IB1996/001481 WO1997019423A1 (en) 1995-11-24 1996-11-22 Three-dimensional drawing system and method

Publications (2)

Publication Number Publication Date
CA2236329A1 CA2236329A1 (en) 1997-05-29
CA2236329C true CA2236329C (en) 2006-01-31

Family

ID=24245859

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002236329A Expired - Fee Related CA2236329C (en) 1995-11-24 1996-11-22 Three-dimensional drawing system and method

Country Status (7)

Country Link
US (1) US5847710A (en)
EP (1) EP0862767B1 (en)
JP (1) JP3978516B2 (en)
AU (1) AU1168197A (en)
CA (1) CA2236329C (en)
DE (1) DE69621148T2 (en)
WO (1) WO1997019423A1 (en)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060268407A1 (en) * 2000-07-07 2006-11-30 Fergason James L Display system using two displays and polarization direction rotation for showing high-resolution and three-dimensional images and method and use of a DBEF beam splitter
US7401923B2 (en) * 2004-03-09 2008-07-22 Fergason Patent Properties, Llc Monitor for showing high-resolution and three-dimensional images and method
US20020154149A1 (en) * 2001-04-24 2002-10-24 Kiran Hebbar System, method and computer program product for associative region generation and modification
JP2004199496A (en) * 2002-12-19 2004-07-15 Sony Corp Information processor and method, and program
US7411636B2 (en) 2004-11-23 2008-08-12 Fergason Patent Properties, Llc Stereoscopic liquid crystal display (LCD) with polarization method
WO2006060236A2 (en) * 2004-11-23 2006-06-08 Fergason Patent Properties, Llc Monitor for showing high-resolution and three-dimensional images
CA2553473A1 (en) * 2005-07-26 2007-01-26 Wa James Tam Generating a depth map from a tw0-dimensional source image for stereoscopic and multiview imaging
US7353134B2 (en) * 2006-03-09 2008-04-01 Dean A. Cirielli Three-dimensional position and motion telemetry input
US7188045B1 (en) 2006-03-09 2007-03-06 Dean A. Cirielli Three-dimensional position and motion telemetry input
US8243066B2 (en) * 2006-12-11 2012-08-14 Richard Garfinkle System and method for model creation and computer animation
US20110227910A1 (en) * 2008-03-27 2011-09-22 Analogic Corporation Method of and system for three-dimensional workstation for security and medical applications
TWI399702B (en) * 2008-04-18 2013-06-21 Hon Hai Prec Ind Co Ltd System and method for drawing a three-dimensional path
USRE45394E1 (en) 2008-10-20 2015-03-03 X6D Limited 3D glasses
USD666663S1 (en) 2008-10-20 2012-09-04 X6D Limited 3D glasses
USD603445S1 (en) 2009-03-13 2009-11-03 X6D Limited 3D glasses
USD624952S1 (en) 2008-10-20 2010-10-05 X6D Ltd. 3D glasses
US20110205347A1 (en) * 2008-11-17 2011-08-25 X6D Limited Universal 3d glasses for use with televisions
US8542326B2 (en) * 2008-11-17 2013-09-24 X6D Limited 3D shutter glasses for use with LCD displays
US20110216176A1 (en) * 2008-11-17 2011-09-08 Macnaughton Boyd 3D Glasses With RF Synchronization
CA2684513A1 (en) 2008-11-17 2010-05-17 X6D Limited Improved performance 3d glasses
USD646451S1 (en) 2009-03-30 2011-10-04 X6D Limited Cart for 3D glasses
USD650956S1 (en) 2009-05-13 2011-12-20 X6D Limited Cart for 3D glasses
USD672804S1 (en) 2009-05-13 2012-12-18 X6D Limited 3D glasses
USD692941S1 (en) 2009-11-16 2013-11-05 X6D Limited 3D glasses
USD671590S1 (en) 2010-09-10 2012-11-27 X6D Limited 3D glasses
USD669522S1 (en) 2010-08-27 2012-10-23 X6D Limited 3D glasses
USD662965S1 (en) 2010-02-04 2012-07-03 X6D Limited 3D glasses
USD664183S1 (en) 2010-08-27 2012-07-24 X6D Limited 3D glasses
US9300947B2 (en) * 2011-03-24 2016-03-29 Kodak Alaris Inc. Producing 3D images from captured 2D video
USD711959S1 (en) 2012-08-10 2014-08-26 X6D Limited Glasses for amblyopia treatment
JP5966837B2 (en) * 2012-10-05 2016-08-10 大日本印刷株式会社 Depth production support apparatus, depth production support method, and program
CN110889905B (en) * 2019-11-21 2023-06-06 宁波财经学院 Naked eye 3D-based product display method and system

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4734756A (en) * 1981-12-31 1988-03-29 3-D Video Corporation Stereoscopic television system
US4600919A (en) * 1982-08-03 1986-07-15 New York Institute Of Technology Three dimensional animation
EP0314250A3 (en) * 1987-10-30 1992-03-04 New Microtime Inc. Video digital analog signal processing and display
US4952051A (en) * 1988-09-27 1990-08-28 Lovell Douglas C Method and apparatus for producing animated drawings and in-between drawings
US5086354A (en) * 1989-02-27 1992-02-04 Bass Robert E Three dimensional optical viewing system
US5245319A (en) * 1991-03-14 1993-09-14 Cray Research, Inc. Synchronized stereoscopic display system
JPH06231275A (en) * 1993-01-29 1994-08-19 Hitachi Ltd Picture simulation method
IL104575A (en) * 1993-02-01 1997-01-10 Intex Corp Image communication apparatus
US5559903A (en) * 1993-04-08 1996-09-24 Linotype Hell Ag Method for generating geometric masks with a digital color computer
US5365370A (en) * 1993-06-10 1994-11-15 Hudgins J Stephen Three dimensional viewing illusion with 2D display
US5590062A (en) * 1993-07-02 1996-12-31 Matsushita Electric Industrial Co., Ltd. Simulator for producing various living environments mainly for visual perception

Also Published As

Publication number Publication date
DE69621148T2 (en) 2002-11-14
EP0862767A1 (en) 1998-09-09
WO1997019423A1 (en) 1997-05-29
AU1168197A (en) 1997-06-11
EP0862767B1 (en) 2002-05-08
JP2000500598A (en) 2000-01-18
CA2236329A1 (en) 1997-05-29
DE69621148D1 (en) 2002-06-13
JP3978516B2 (en) 2007-09-19
US5847710A (en) 1998-12-08

Similar Documents

Publication Publication Date Title
CA2236329C (en) Three-dimensional drawing system and method
WO1997019423A9 (en) Three-dimensional drawing system and method
KR100520699B1 (en) Autostereoscopic projection system
US8179424B2 (en) 3D display method and apparatus
EP1143747B1 (en) Processing of images for autostereoscopic display
US20140192281A1 (en) Switching dual layer display with independent layer content and a dynamic mask
US20050275915A1 (en) Multi-plane horizontal perspective display
US20020113752A1 (en) Multi-planar volumetric display system and method of operation using psychological vision cues
US20050219694A1 (en) Horizontal perspective display
US20030038922A1 (en) Apparatus and method for displaying 4-D images
US10652528B1 (en) Frustum change in projection stereo rendering
US20060221071A1 (en) Horizontal perspective display
McAllister Display technology: stereo & 3D display technologies
US20060250390A1 (en) Horizontal perspective display
US20130128014A1 (en) System for stereoscopically viewing motion pictures
Kang Wei et al. Three-dimensional scene navigation through anaglyphic panorama visualization
Lipton Future of autostereoscopic electronic displays
Harish et al. A view-dependent, polyhedral 3D display
Hines Autostereoscopic video display with motion parallax
Miller Volumetric Hyper-Reality, A Computer Graphics Holy Grail for the 21st Century?
MXPA05012792A (en) Process and device for generating 3d real motion images from a 2d image source.
Herbison-Evans 4D Computer Output
Dodgson Autostereoscopic 3D displays: stereoscopic perception without the special glasses
CZ112598A3 (en) Method of generating stereoscopic image and apparatus for making the same
WO2006121955A2 (en) Horizontal perspective display

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20141124

MKLA Lapsed

Effective date: 20141124