WO1994005113A1 - Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain - Google Patents

Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain

Info

Publication number
WO1994005113A1
WO1994005113A1 PCT/US1993/007968 US9307968W WO9405113A1 WO 1994005113 A1 WO1994005113 A1 WO 1994005113A1 US 9307968 W US9307968 W US 9307968W WO 9405113 A1 WO9405113 A1 WO 9405113A1
Authority
WO
WIPO (PCT)
Prior art keywords
segment
electronic image
analog signal
memory
frame
Prior art date
Application number
PCT/US1993/007968
Other languages
French (fr)
Inventor
Thomas E. Ramsay
James C. Elkins
Original Assignee
Ramsay Thomas E
Elkins James C
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ramsay Thomas E, Elkins James C filed Critical Ramsay Thomas E
Priority to AU50899/93A priority Critical patent/AU5089993A/en
Publication of WO1994005113A1 publication Critical patent/WO1994005113A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21Intermediate information storage
    • H04N1/2166Intermediate information storage for mass storage, e.g. in document filing systems

Definitions

  • This invention relates generally to interactive document processing in an electronic domain, and particularly to a new modality incorporating hybrid (digital and analog) signal processing for the transmission, storage, and retrieval of documents to optimize informational content and processing time.
  • each image may be stored on a unit of storage medium and addressed by a volume and frame number, and wherein a field may be added to established databases in order to correlate batch-processed documents with their original source documents or transactions, or conversely a separate database may be utilized as a "look-up table" to identify or retrieve the volume and frame number of the stored image corresponding to a specific source document or transaction.
  • Those basic technologies are storage/retrieval servers comprising file storage and indexing capabilities, transformation servers to permit complete or universal compatibility of document formats, communication servers that provide transmission interfaces for both networks and remote transmissions (i.e., satellite, fiber optic, telephone), recognition servers capable of capturing and preserving the fundamental information from tangible documents, and document managers to track the location, flow, and transformation of documents.
  • an electronic publishing and archive system such a system having previously been postulated to maintain every "original" document in storage on only one of a plurality of file servers that may each be accessed independently by any operator within the system, and in which distinct documents may be connected to one another using hypertext pointers
  • the invention comprises a method and apparatus for the high speed conversion of tangible source documents to the electronic image domain, and the subsequent transmission or storage and retrieval of those electronic images, utilizing hybrid (analog and digital) signal processing.
  • the system employs a higher bandwidth analog signal for image capture and lower bandwidth analog signal for transmission or storage and retrieval, with an intervening digital memory buffer utilized to construct a bitmap of the image to facilitate various dissection and seaming schemes which optimize image content and processing time depending upon the size of the source document, the informational content or "resolution" necessary for the particular application, and the particular storage medium or transmission pathway being considered.
  • the system is designed around a conventional bus structure, and the memory buffer may also serves as a transparent and universal junction with conventional interactive document processing systems including personal computers, networks, transmission systems, and various types of peripheral input/output devices.
  • the system also processes electronic images in a manner that provides complete compatibility with formats and standards for digital storage, image transformation and compression, local area networks, and communications systems.
  • the electronic image corresponding to a tangible source document such as an 8-1/2" x 11" page is captured using a camera producing an analog output signal with conventional raster synchronization.
  • the vertical and horizontal synchronization pulses are stripped from the analog signal, which is then digitized in 8-bit grayscale and multiplexed to the memory buffer where the image exists as a digital array or bitmap that may be divided into a plurality of segments.
  • the digital content is read from the memory buffer according to this dissection scheme, converted to an analog signal, and control signals are added.
  • the control signals include horizontal and vertical synchronization pulses (and interval blanking), a pilot signal to maintain alignment along the seams between adjacent segments of the electronic image when it is reconstituted,
  • the resultant analog signal is stored on a randomly accessible storage medium such as a conventional analog optical laser disk recorder (LDR) as one or more frames (each frame corresponding to a segment of the electronic image), or the resultant signal may alternately be transmitted to a remote location and reassembled, or up converted and displayed on a conventional monitor.
  • LDR analog optical laser disk recorder
  • Figure 1 is a diagrammatic depiction of an interactive document processing network utilizing the electronic document transmission, storage, and retrieval system of this invention for the capture, transmission, storage, and retrieval of electronic image documents;
  • Figure 2 is a schematic diagram showing the components of an embodiment of the electronic document transmission, storage, and retrieval system of this invention particularly adapted for the capture, transmission, storage, and retrieval of electronic image documents;
  • Figure 3 is a diagrammatic depiction of an 8-1/2" x 11" tangible source document oriented in the upright or vertical position;
  • Figure 4 is a diagrammatic depiction of the source document of
  • Figure 3 oriented in the sideways or horizontal position, with a phantom line showing the source document divided corresponding to two horizontally adjacent image segments, and further showing two sub-sections corresponding to the front and back of a conventional negotiable instrument (check) superimposed over the right segment of the source document;
  • Figure 5 is a diagrammatic depiction of the source document of
  • Figure 3 oriented in the sideways or horizontal position showing the orientation of typed lines
  • Figure 6 is a diagrammatic depiction of a source document such as a C-size drawing, with phantom lines showing the source document divided into four horizontally and vertically adjacent regions corresponding approximately in size to the source document of Figure 3;
  • Figure 7 is a diagrammatic depiction of a source document (such as a seismic tracing) corresponding approximately in size to several of the source documents of Figure 3;
  • a source document such as a seismic tracing
  • Figure 8 is a diagram showing three grayscale gradients in which 8A is a 4-bit grayscale gradient printed at 300 dpi showing 12 gray levels including black and white, 8B is 8-bit grayscale printed at 300 dpi resolution showing the dithering pattern appearing as dots of progressively increasing diameter from top to bottom, and 8C is the same 8-bit grayscale printed at
  • Figure 9 is a diagrammatic depiction of a single capture device utilized to capture an image associated with the source document of Figures 4 or 5, with a phantom line showing the source document divided corresponding to two horizontally adjacent image segments;
  • Figure 10 is a diagrammatic depiction of a plurality of capture devices utilized to capture an image associated with a source document greater in size than the source document of Figure 3, with a phantom line showing the source document divided corresponding to two adjacent image segments;
  • Figure 11 is a diagrammatic depiction of a plurality of capture devices utilized to capture an image associated with both the front and back faces of a source document such as the negotiable instrument (check) shown in Figure 4;
  • Figure 12 is a diagrammatic depiction of a plurality of linear array type capture devices configured in an array utilized to capture an image associated with a source document greater in size than the source document of Figure 3, with phantom lines showing the source document divided corresponding to an equal plurality of adjacent image segments;
  • Figure 13 is a diagrammatic depiction of a line array type capture device utilized to capture an image associated with a source document, with phantom lines showing the source document divided corresponding to an image segment;
  • Figure 14 is a waveform diagram in which 14a shows synchronization pulses and blanking intervals on opposing sides of a segment of analog signal; 14b shows the analog signal of Figure 14a after digitization; 14c shows the digital signal split and expanded to form two digital segments; 14d shows the two digital segments of Figure 14c converted to analog
  • 14e shows two positive-going calibration pulses
  • 14f shows a negative-going synchronization pulse
  • 14g shows a low level pilot signal
  • 14h shows a composite waveform of the two active signals of Figure 14d summed with the signals of Figures 14e-14g overlaid over the sum of the
  • Figure 15 is a diagram showing the arrangement of segments and frames in Mode Cl (line delay) overlying a raster image composed of horizontal scanning lines;
  • Figure 16 is a diagram showing the arrangement of segments and frames in Mode C2 (field delay) overlying a raster image composed of horizontal scanning lines
  • Figure 17 is a diagram showing the arrangement of segments and frames in Mode C3 (one frame delay) overlying a raster image composed of horizontal scanning lines
  • Figure 18 is a diagram showing the arrangement of segments and frames in Mode C4 (two frame delay) overlying a raster image composed of horizontal scanning lines. DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • FIG. 1 An interactive document processing environment is shown which includes a low speed local area network (LAN) 12 such as a Novell or Ethernet network or a peer-to-peer network system linking a plurality of nodes which may be occupied by personal computers 14, terminals, or workstations.
  • the network 12 is optionally linked to a mainframe 16 or file server along a conventional digital communications pathway.
  • Each computer 14 on the network 12 is linked to various peripheral devices including a digital document input device 18 such as a document scanner, an output or representation device 20 such as a laser printer or film recorder, and a transmission interface 22 such as a modem or facsimile machine.
  • a digital document input device 18 such as a document scanner
  • an output or representation device 20 such as a laser printer or film recorder
  • a transmission interface 22 such as a modem or facsimile machine.
  • Each computer 14 or terminal preferably has various input and output devices for the operator including a keyboard, mouse, trackball, or pressure sensitive tablet, storage mediums such as a magnetic or optical disk, tape cartridge, or compact disc drive, and at least one presentation system such as a raster display or LCD projection screen associated therewith.
  • a keyboard mouse, trackball, or pressure sensitive tablet
  • storage mediums such as a magnetic or optical disk, tape cartridge, or compact disc drive
  • presentation system such as a raster display or LCD projection screen associated therewith.
  • Each of the computers 14 in the network 12 are simultaneously connected to a separate high speed network 28 which includes an interface module (not shown) installed in or linked to each of the computers 14.
  • the interface module will preferably have the capability for at least retrieval and transmission of documents utilizing the high speed network 28, and may optionally include storage capability.
  • the network 12 may also be connected to a remote network 24 through a conventional transmission pathway 26 such as telephone lines or a dedicated cable system, and a "high-speed" transmission pathway 26' capable of transmitting electronic documents at rates equivalent to the faster operating speeds of the high speed network 28 of the system 10.
  • the high speed network 28 is linked to an electronic image server
  • the mass storage device 34 is connected to the electronic image server 30 by both a conventional digital communication pathway and a high speed pathway.
  • the mainframe 16 is also connected to the electronic image server 30 along a digital communications pathway.
  • the electronic image server 30 may be self-contained within its own housing and include the necessary ancillary components such as a power supply, operator interface, and the like, or may be fabricated on a separate interface module mounted in a host processor such as a personal computer or workstation. It is understood that each computer 14 in the network 12 that is linked to the high speed network 28 will also include a separate EIS interface 30 which has some or all of the processing capabilities of the electronic image server 30. Thus, for purposes of clarity, the term electronic image server 30 will be used to refer to the separate unit as shown in Figure 1 that is used primarily for capture and batch processing operations, and the term EIS interface 30 will be used to refer to a computer-based interface associated with each computer 14 or workstation.
  • Each EIS interface 30 may include some or all of the components necessary for storage, retrieval, transmission, or presentation depending on the number and extent of document processing operations that will be performed at that station or node.
  • the EIS interface 30 is hereafter assumed to have the full functional capabilities of, and be functionally indistinguishable from, the separate electronic image server 30 unless otherwise noted, and the schematic shown in Figure 2 will therefore delineate the relationships of both the separate electronic image server 30 and the computer-based EIS interface 30 as being mounted on a host processor such as a personal computer or workstation.
  • images from tangible source documents will be captured using the capture device 32 and stored on the mass storage device 34.
  • a volume and frame number for each image will be written to a database in the mainframe 16 using the conventional digital communications pathway.
  • the mainframe 16 will issue a retrieval command to the mainframe 16 for a particular document image, and the mainframe 16 will access the database to determine the correct volume and frame numbers for the image.
  • mainframe 16 will issue an instruction through the digital communication pathway (and electronic image server 30) to the mass storage device 34, which will retrieve the appropriate number of frames from the storage medium in the mass storage device 34 and transmit those frame over the high speed network 28 to the requesting computer 14.
  • the EIS interface
  • an image may be retrieved from the mass storage device 34, reconstituted in the electronic image server 30, and transmitted along the digital network 12 through the mainframe 16 and to the requesting computer 14.
  • the operator working at one of the computers 14 or workstations makes a transformation to the electronic image and wishes to store that derivative image or a newly created electronic image
  • the operator could issue a store command which would cause the electronic image to be transmitted over the high speed network 28 to the mass storage device 34, with a corresponding instruction being sent to the mainframe 16 over the conventional communications pathway which would update the database with any information concerning the processing history of the electronic image, and also initiate the appropriate subroutine in the mainframe 16 to instruct the mass storage device 34 to receive and store the correct number of frames, and obtain the volume and frame numbers from the mass storage device 34 to be placed in the database.
  • the operator could send the electronic image in digital form through the mainframe 16 to the electronic image server 30 using the conventional digital communication pathways, where the image would be converted to frames and stored on the mass storage device 34 with the database in the mainframe 16 being similarly updated.
  • the remote network 24 will ordinarily be associated with a separate mainframe 16' or fileserver, and a separate high speed network 28' with a separate mass storage device 34' as well as at least one separate electronic image server (not shown) and the associated peripherals and components. If an operator wishes to transmit an electronic image to the remote network 24, the electronic image 24 may be transmitted over the high speed transmission pathway 26' to a high speed network 28' linking the nodes of the remote network 24, where it may be saved on a separate mass storage device 34' and a database in the remote mainframe 16' will perform the necessary cataloging and indexing functions.
  • images may be downloaded in batches directly from one mass storage device 34 to another 34' using the associated high speed networks 28, 28' and the high speed transmission pathway 26', with the corresponding database information being transmitted from one mainframe 16 to the other mainframe 16' along the conventional digital
  • the capture device 32 could be any conventional high speed image capture device, although as discussed herein the capture device 32 and electronic image server 30 are preferably designed, structured, and tuned to match the particular document processing applications for which the high speed network 28 will be utilized.
  • the host processor includes a communications pathway such as a bus structure 36 which may be of any conventional type defining or defined by the architecture of the 1. Although an external bus of the type utilized for real time data acquisition and control systems could be utilized, it has proven suitable to design the embodiments discussed herein around the main bus structure 36 of the host processor. It is understood that the bus structure 36 of most personal computers and work stations is hierarchical, including a backbone or system bus, and one or more subsystems such as an instruction exchange bus, a data exchange bus, an arbitration bus to allocate access among competing devices, and an interrupt bus to accept attention request signals from devices.
  • the bus architecture also dictates such features as the motherboard, slot, and card dimensions, grouping and cooling of components, power distribution, and connector configurations and arrangements.
  • Adapters may also be attached to the system bus to access specialized interface buses such as the Small Computer System Interface (SCSI) for disk drives, scanners, and most other input/output devices, and the General Purpose Instrumentation Bus (GPIB) for measurement and control devices.
  • SCSI Small Computer System Interface
  • GPIB General Purpose Instrumentation Bus
  • Some of the bus structures contemplated for use with the electronic document transmission, storage, and retrieval system 10 include PCBus (IBM PC class), ISA (IBM AT class), MicroChannel (IBM 32-bit OS/2 class), STD Bus, EISA (Compaq 32-bit), S-100 and SBus (Sun Microsystems), VME (Motorola), open Unibus and QBus (Digital/DEC), and MultiBus and MultiBus II (Intel). It may be readily appreciated that since any component connected to a personal computer bus structure 36 must operate with the host processor and all other peripheral devices, the bus structure 36 of the host processor will dictate many of the design characteristics of the EIS interface
  • the bus structure 36 of the host processor is preferably equipped for connection to a digital capture device 38 such as a document scanner through a peripheral interface 40, a local area network 12 or peer-to-peer network through a separate network interface 42, an on board or external device capable of image compression 44 using any conventional compression standard such as JPEG, and an output device 46 such as a laser printer of film recorded connected through a serial or parallel output interface 48.
  • a digital capture device 38 such as a document scanner through a peripheral interface 40, a local area network 12 or peer-to-peer network through a separate network interface 42, an on board or external device capable of image compression 44 using any conventional compression standard such as JPEG, and an output device 46 such as a laser printer of film recorded connected through a serial or parallel output interface 48.
  • the bus structure 36 may of course be connected to many other types of peripheral devices, however these are the basic devices utilized in the capture, representation, and transmission of electronic image documents over existing networks 12 adapted for interactive document processing.
  • the operator will have direct command access to both the bus structure 36 and the interface for the EIS interface 30 through a keyboard 50 or other devices such as a mouse, trackball, tablet, or the like, as well as through any input/output and peripheral devices connected to the bus structure 36.
  • High speed document capture is accomplished using a capture device 52 which provides an analog output signal timed with synchronization and blanking pulses corresponding to individual frames following the normal fast-scan television system standards of 30 frames per second with two interlaced fields or switchable to one progressively scanned field per frame, as modified according to the provisions discussed subsequently herein.
  • the capture device 52 may be any conventional charge-coupled device (CCD) or Vidicon tube type camera, but preferably has a progressive or sequential scan, horizontally and vertically synchronized analog output signal that is switchable between conforming to the fast-scan television system standards producing 30 frames per second and slower vertical sweep rates as required by high resolution modes of operation.
  • CCD charge-coupled device
  • Vidicon tube type camera preferably has a progressive or sequential scan, horizontally and vertically synchronized analog output signal that is switchable between conforming to the fast-scan television system standards producing 30 frames per second and slower vertical sweep rates as required by high resolution modes of operation.
  • An alternative would be to have two cameras to switch between. It may be appreciated that conventional CCD cameras having from less than 512 x 512 to greater than 2048 x 2048 pixel arrays will be suitable for many applications employing the modality disclosed herein, and that non-square, larger and small arrays, and linear array cameras or scanners may be equally suited for some applications.
  • the analog output signal from the capture device is processed through an analog-to- digital converter 54 timed using an input sync-generator 56, with the system being driven by a 124 Mhz clock speed oscillator (crystal) with input to the analog-to-digital converter 54 divided by four to achieve a 31 Mhz conversion clock speed. Since the resultant output signal is still a time-division multiplexed signal, a 31 Mhz to 3.9 Mhz demultiplexer 58 may be used to strip the timing and synchronization pulses from the output signal and distribute the remaining image signal to an input memory buffer 60 with a 3.9 Mhz clock rate that is compatible with a broader spectrum of suitable memory devices that are currently commercially available.
  • the image input memory 60 is preferably an SRAM semiconductor memory.
  • classification of semiconductor memory usually includes dynamic and static random access memory (DRAM and SRAM), read-only memory (ROM), as well as programmable ROMs (PROM), erasable ROMs (EPROM, EEPROM), nonvolatile RAM (NVRAM), and flash-memory such as charge-coupled devices (CCD) and magnetic bubble memory.
  • DRAM and SRAM dynamic and static random access memory
  • ROM read-only memory
  • PROM programmable ROMs
  • EPROM erasable ROMs
  • NVRAM nonvolatile RAM
  • flash-memory such as charge-coupled devices (CCD) and magnetic bubble memory.
  • CCD charge-coupled devices
  • Each type of memory may be classified as dynamic or static, read/write or read-only, random or serial access, volatile or nonvolatile, and erasable using magnetic or ultraviolet radiation. Because a CCD sensor chip is properly categorized as a type of serial access semiconductor memory, it is important to distinguish between the bitmap or digital array corresponding to an electronic image formed
  • LID such as a line-array scanner or an area imaging device (ADD) camera
  • ADD area imaging device
  • the memory buffer 60 connotes digital semiconductor memory other than the image sensor itself which permits interactive addressing and manipulation of pixels or swapping of information into memory from which pixels may be interactively addressed and manipulate, and which may be configured as an interactive junction with a bus structure 36 or similar interfaces.
  • the digital array associated with a particular electronic image may be stored to or retrieved from a conventional digital storage device 62 such as a magnetic or optical disk drive, or transmitted to or through any conventional peripheral, through the bus structure 36. It should also be noted that a previously stored electronic image document may be recaptured using the analog capture pathway by substituting an alternate
  • image input source 64 such as a write-once/read-many-times (WORM) optical laser disc player (LDP) connected through a mechanical or electronic switch 66 to the input channel of the analog-to-digital converter 54.
  • WORM write-once/read-many-times
  • LDP optical laser disc player
  • EIA Standard A Sony Model LDR-5000A optical disc recorder/player (EIA Standard)
  • the switch 66 also provides a suitable junction for linking the input of the analog-to-digital converter 54 to the high speed network 28, and it may therefore be appreciated that an electronic switching device such as a latch controllable by the EIS interface 30 or the mainframe 16 is desired for switching between the capture device 52, laser disc player 64, and high speed network 28 so that electronic images transmitted on the high speed network 28 will not be obstructed or delayed awaiting manual switching.
  • a manual switch 66 would preferably have a default setting to the high speed network 28, with user-selected switching to the capture device 52 or laser disc player 64 intended only for intermittent operation.
  • the electronic image document exists as a digital array or bitmap in active memory.
  • the digital array or bitmap may not have the same physical X-Y coordinate array as was present on a CCD sensor chip.
  • it has proven preferable to divide or section the image into blocks or segments, and to further deposit portions of each block or segment in distinct banks of memory.
  • each pixel remains mapped to a specific memory location by bank, row, column, and phase by a matrix or formula in the memory control module 68, and a set digital array or bitmap is preserved and recognized even though it may require calculation to correlate a pixel's location in memory to its position on a raster line or LCD display.
  • the electronic image document may then be stored on an analog storage device 70 such as an analog WORM optical laser disk recorder
  • LDR by dumping the digital array from memory 60 as a conventional 4 Mhz clock speed digital transmission signal and processing that signal through the first step of a sequential frequency converter 72 (up converter) to achieve a 16 Mhz bandwidth, an 8-bit digital-to-analog converter 74, and multiplexer 76 producing a 6 Mhz bandwidth output and the appropriate timing and synchronization pulses expected by the storage device 70.
  • a switching device 66 may also be utilized to provide a suitable junction for linking the output of the multiplexer 76 to the high speed network 28 for transmission of electronic images, and it may be appreciated that conversion of the signal to the appropriate bandwidth for the high speed transmission pathway may require that the up converter 72 or the multiplexer 76 be instructed by the EIS interface 30 to perform the appropriate signal conversion steps to match the bandwidth of the analog signal to the corresponding transmission pathway.
  • converter 72 may also be processed in a second step to achieve a 124 MHz clock rate signal, converted to analog using a digital-to-analog converter 78, and presented on a conventional raster display 80, preferably such as a high resolution computer monitor.
  • a conventional raster display 80 preferably such as a high resolution computer monitor.
  • separate input and output memories may be utilized, and the output memory may be read at a speed directly compatible with monitor inputs.
  • the image may also be presented on a conventional LCD display screen 82 or projector, although the necessary signal form may need to be created as required by the LCD display 82.
  • a database 84 is utilized to record an accession number, index, or address for the initial frame and size (or for each of the separate frames) associated with a specific document to permit cataloging and selective retrieval of any document stored on that medium.
  • the database 84 may be located in the mainframe 16 or fileserver, a separate CPU associated with a remote EIS interface 30 device, or be resident in the computer housing the bus structure 36.
  • each stored image will be identified by a volume number corresponding to the serial number of the specific disc or recording medium, and a frame number.
  • a single frame number will be satisfactory when all batch-processed images are stored using the same quantity of frames for each image, and the combination of the volume and frame numbers may be treated together as a single index, address, or accession number.
  • the database 84 may be an already-existing database used for processing transactions involving the source documents to which one or two fields are appended corresponding to the volume and frame numbers for the stored image, or may be a separate database 84 which provides a "look ⁇ up table" relating an identifying characteristic of the source document (such as the computer-readable MICR code on negotiable instruments or checks) with the corresponding serial and frame numbers of the stored image.
  • an infeed control interface 86 must be connected to the EIS interface 30 so that the EIS interface 30 can receive ready-state acknowledgements from the automatic document feeder and step or advance commands can be sent to the automatic document feeder, and a corresponding indexing or accession control interface 88 would be connected between the EIS interface 30 and the storage device 70 to correlate the volume serial numbers and frame numbers with the
  • a manual infeed control interface 86 would be used when documents are positioned manually by the operator.
  • a separate storage device 70' such as a second analog WORM optical laser disc recorder (LDR) may be utilized at a remote location for batch downloading or backup of images stored on the first storage device
  • LDR WORM optical laser disc recorder
  • Source Document Orientation The embodiments of the system 10 discussed herein have been specifically tailored to optimize the processes of capturing and storing electronic images from tangible source documents that are especially common to many financial and business transactions conducted in the United States, or for specialized applications that are considered document intensive.
  • tangible source documents include paper documents, as well as documents previously fixed in mediums such as microfilm and microfiche.
  • the following discussion of several paper-based source documents provides a sufficient basis for describing the particular modes of operation associated with the preferred embodiments.
  • Figure 3 is a diagrammatic depiction of a basic US letter-size page 90 generally approximating the horizontal and vertical dimensions or aspect ratio of a standard 8-1/2" x 11" sheet of paper (and similarly approximating an A-4 size page) in a vertical orientation.
  • Figure 4 is a diagrammatic depiction of the same page 90 shown in Figure 3 in a horizontal orientation.
  • the page 90 is divided along an imaginary vertical centerline 92 into two half-page segments 94, 96 having dimensions of approximately 8-1/2" x 5-1/2" each.
  • FIG. 5 is a diagrammatic depiction of the page 90 of Figure 3 showing the normal orientation of type written lines 100 of text on that page 90.
  • Figure 6 is a diagrammatic depiction of a drawing sheet 102 having dimensions greater than twice a basic page 90, with horizontal and vertical phantom lines 104 showing the drawing sheet 102 divided into four equal quadrants or segments along both horizontal and vertical seam lines.
  • Figure 7 is a diagrammatic depiction of a section of a large-scale document 106 such as a geophysical survey.
  • the section 106 has dimensions on the order of 36" x 48" and may correspond to about 4 miles
  • Figure 9 is a diagrammatic depiction of a single capture device 32 such as an area array CCD or Vidicon tube type camera disposed a predetermined distance or height above a source document such as a basic page 90 oriented horizontally, with a phantom line 92 identifying an imaginary centerline 92 dividing the basic page 90 into two half-page (one frame) segments A, B.
  • Figure 10 is a diagrammatic depiction of a pair of capture devices 32 disposed above a source document 108 such as a basic page 90 oriented vertically or two-page drawing sheet 102 oriented horizontally, with a phantom line 110 identifying an imaginary centerline or seam line dividing the source document 108 into two segments A, B (of two frames each).
  • Figure 11 is a diagrammatic depiction of a pair of capture devices 32 disposed above and below a source document 112 such as a check, with one capture device 32 capturing a segment A of the resulting half-page electronic image corresponding to the front face of the check or source document 112, and the other capture device 32 capturing a segment of the resulting half-page (one frame) electronic image corresponding to the opposing face (not shown).
  • Figure 12 is a diagrammatic depiction of a plurality of capture devices 32 disposed in a two dimensional (vertical and horizontal) array above a large-size source document 114, with each capture device 32 capturing a segment A-F of the resulting (multi-frame) electronic image which adjoin one another along both vertical and horizontal seam lines 116.
  • Figure 13 is a diagrammatic depiction of a capture devices 32 of the line array type disposed above a large-size source document 114, with the capture device 32 sequentially capturing a segment A-C of the resulting (multi-frame) electronic image which adjoin one another along parallel seam lines 116.
  • Modes A and “Mode “B” are particularly designed around document processing involving tangible source documents such as a US letter-size page 90 or smaller, 8-bit grayscale informational content, and wherein "normal” system resolution is suitable.
  • "normal” resolution refers to an arbitrary resolution as defined by the particular system mode and the application of that mode to a specific operating environment. In other applications, normal resolution might refer to fractions or multiples of the "normal” resolution as defined by Modes A and B.
  • bypassing the bandwidth filters or bandwidth limiters in conventional analog WORM-type LDRs 70 to operate with the "extended" bandwidth and additional lines of image content results in an approximately 30% increase in the effective resolution or storage capacity of the storage medium, without affecting its storage density.
  • Mode A refers to capturing and storing one half-page image of a US letter-size source document as a single frame
  • Mode B refers to capturing and storing the full-page image of a US letter-size source document as two frames.
  • Mode A can be considered a system bypass that does not require complex seaming to retrieve and reconstitute the electronic image
  • the same control signals including the pilot signal and calibration pulses as discussed below are applied to documents processed in Mode A, since those control signals are also useful for maintaining electronic image integrity throughout batch-processed source documents and between different operating environments or platforms.
  • Normal fast-scan television provides 30 frames per second with 525 horizontal lines swept at a 60 hz vertical rate and scanned at a 15,734 hz horizontal rate with a 4:3 aspect ratio, with two interlaced scanned fields
  • the image is sent as an amplitude-modulated (AM) signal, while audio is frequency-modulated (FM).
  • AM amplitude-modulated
  • FM frequency-modulated
  • European television (PAL standard) utilizes 625 lines, however the aspect ration remains approximately 4:3.
  • the capture device 52 produces a camera image of 1114 progressive (non-interlaced) lines refreshed every 70 milliseconds.
  • this will correspond to two images of 500 lines each with the excess lines accommodating the control signals as described.
  • the lines of the image are therefore being scanned at 14 hz in the vertical direction (approximately one quarter the normal sweep rate) and scanned horizontally at 15 khz.
  • a Dage-81 camera manufactured by Dage-MTI Incorporated of Michigan City, Indiana, provides a suitable capture device capable of being driven at the 14 hz vertical scan rate.
  • more accumulated charge may be discharged as useable signal by lengthening the time during which a document is being scanned using a capture device in which the accumulated charge on the target is time-dependent on incident source light such as a Vidicon tube type camera.
  • a capture device in which the accumulated charge on the target is time-dependent on incident source light
  • Tube type cameras are therefore advantageous in applications where a CCD type camera would not provide sufficient resolution or fast enough speeds given other practical considerations, or where the fixed pixel resolutions of current CCD cameras are otherwise inadequate.
  • the output signal from the capture device 52 is digitized at 31 Mhz and stored in a 1024 x 2048 x 8 input memory buffer 60.
  • the memory buffer 60 is preferably two banks of eight 128 kbit SRAMS with an 8 column by 9 row architecture and a corresponding video input latch.
  • the output signal is multiplexed into 8 segments which places 256 pixels in each row of memory. Any pixel can be identified by bank, row, column, and phase.
  • the configuration of the memory buffer 60 in Modes A and B can be made more efficient, however this configuration permits interchangeable
  • the EIS interface 30 circuitry may be divided into three groups.
  • the circuitry associated with the memory buffer 60 is one group.
  • the non-124 Mhz portion can be fabricated on a first integrated circuit board using transistor-transistor logic (TTL), whereas the 124 Mhz portion (including the digital-to-analog converter 74) can be fabricated as a third group using emitter-coupled logic (ECL) on a separate integrated circuit board.
  • the multiplexer 76 can be fabricated with the non-124 Mhz portion of the circuitry, or a remote multiplexer 76 may be connected to the non- 124 Mhz portion of the circuitry using sixty-four sets of twisted-pair wires.
  • the resultant analog signal associated with the electronic image may be stored on the storage device 70 in video format.
  • a 525 line 60 hz vertical scan rate WORM optical laser disc recorder (LDR) is conventional, and a Sony Model LVR-5000A (EIA Standard) laser videodisc recorder/player has proven suitable.
  • LDR compatible with the PAL (European) television and video recording standard may be preferred in situations where PAL- compatible LDRs are more readily accessible or in applications where the nature of the tangible source document makes 625 line capture the optimal alternative.
  • the increase in horizontal bandwidth from 4.2 Mhz to 6 Mhz may be compelling.
  • Such a conversion will either decrease the number of images storable on a conventional optical disc by 20% (from approximately 43,000 to 36,000) or increase the recording time by about 20% per frame,
  • the sync generator 56 can be modified to operate corresponding to the 625 line 50 hz vertical scan PAL standard.
  • the sync generator controls the drive frequency of the capture device 32 and supplies the timing waveforms for the input memory buffer 60. Consequently, selection of the appropriate capture device 32 and optimization of memory characteristics may be required.
  • a 525 line 60 hz vertical scan rate standard sync generator provides a composite synchronization train. After the first vertical synchronization pulse, the first 250 lines are read to the memory buffer 60. The read pauses to allow insertion of the second vertical interval, and then lines
  • the 251-500 are read.
  • the read pauses, and the vertical interval between the first and second frames is inserted, and the second frame is read in the same manner as the first frame.
  • the additional 50 hne times are consumed by the vertical blanking intervals.
  • the LDR begins recording the output from the digital-to-analog converter 74.
  • the image can be retrieved by reversing the storage process and reconstituting the two frames as a single electronic image document.
  • the tangible 8-1/2" x 11" original image is divided into four blocks or segments to be stored on two separate frames with two blocks per frame. These blocks or segments can be groups of sequentially adjacent lines, fractions or segments of adjacent lines, alternating or selected interlaced lines, or any other desired portion of the image.
  • An electronic image having a digital array composed of X lines of pixels would result in two frames each having X/2 lines of information, and the raster corresponding to those two frames would be composed of N horizontal scanning lines at a predetermined vertical scan rate plus a maximum time interval dictated by the remaining or excess 2N-X horizontal scanning lines and the predetermined vertical scan rate which is utilized to add the raster synchronization to the analog signal for each frame.
  • the retrieved electronic image can be processed in two ways. It can be mapped at 3.9 Mhz onto the bus structure 36 of the host processor and swapped to the video display RAM on the computer's motherboard or on a video/graphics interface card, stored in digital form on magnetic medium, transmitted over conventional transmission pathways, or downloaded to an
  • the signal may be up converted by the frequency converter 72 to correspond to the appropriate dot clock equivalent for a high resolution gray scale or color monitor.
  • Mode C Operation Modes A and B operation are considered biased in the horizontal direction.
  • Mode C operation is effective where either "square" resolution or a vertical bias are desired.
  • Mode C operation may be considered “high” resolution compared with Modes A or B, and provides twice the "normal" resolution of those modes.
  • the acquisition of the signal in Mode C is the same as in Modes A and B, however the image is dissected into 8 blocks and recorded as 4 frames.
  • the resolution of the tangible source document image (using the 8-1/2" x 11" example) becomes a 1024M X-Y pixel product (1248 pixels in the 11" inch direction and 1000 pixels in the 8.5" direction) while only requiring twice the capture and storage time.
  • Mode C There are three alternatives for operation in Mode C.
  • the horizontal line is split in half.
  • the read from the memory buffer 60 is performed at half the write speed (using a 7.5 khz horizontal sweep rate controlled by the read clock) to effectively expand or stretch the 12 Mhz bandwidth signal into a 6 Mhz bandwidth signal, which causes the half of the horizontal line segment to expand from 32 microseconds to 64 microseconds in duration, which appears normal to an LDR expecting a 6
  • Mhz analog signal with 64 microsecond line duration Each of the three alternatives to Mode C may be understood by considering a grid overlying a 1000 line raster image in which each line has a left and a right half.
  • the grid has one vertical column of eight horizontal rows. Each row of the grid therefore corresponds to one field of a frame. Each segment is therefore one vertical row consisting of 125 left halves alternating with 125 right halves of each line.
  • the segments are stored in ascending order, SI through S8, so that frame Fl contains segments SI and S2 as fields 1 and 2, frame F2 contains segments S3 and S4 as fields 1 and 2, and so forth.
  • This mode is the least expensive since it only requires a line delay, and has the advantage of providing a security function by "scrambling" the appearance of the stored images in the event an unauthorized individual attempts to access the medium using an incompatible EIS system or view the image on an interlaced monitor.
  • the grid has two vertical columns of four horizontal rows. Each segment therefore consists of either 125 left halves or 125 right halves of the lines.
  • the segments are again stored in ascending order, SI through S8, so that frame Fl contains
  • frame F2 contains segments S3 and
  • This mode is the more expensive since it requires a field delay, and also has the advantage of providing a security function by scrambling the appearance of the stored images.
  • the security feature of Mode C2 would produce significantly more flicker because of the difference between the horizontal sweep and vertical scan rates.
  • each segment therefore consists of either 125 left halves or 125 right halves of the lines.
  • the segments are not stored in ascending order. Instead, in Mode C3 the left halves of the lines corresponding to two segments SI and S2 are stored as the first and second fields in frame Fl, and the right halves of the lines corresponding to two segments S5 and S6 are stored as the first and second fields in frame F2.
  • the remaining segments S3, S4, S7, S8 are similarly stored as frames F3 and F4.
  • Mode C4 the left halves of the lines corresponding to two segments SI and S2 are stored as the first and second fields in frame Fl, and the left halves of the remaining lines corresponding to segments S3 and
  • S4 are stored as the first and second fields in frame F2.
  • the right halves of the lines corresponding to segments S5 and S6 are stored as frame F3, and the right halves of the lines corresponding to segments S7 and S8 are stored as frame F4.
  • Modes C3 and C4 have the advantages of allowing the direct display of a quadrant (two adjacent segments) of the image on a conventional sequential scan (non-interlaced) monitor, and in the event of discrepancies in or uncertainty about the information in the overlapping regions between quadrants, the adjacent quadrants may be viewed separately for comparison.
  • Mode C3 presents the disadvantage of requiring a one frame delay in order to seam the quadrants properly, and Mode C4 requires a two frame delay. Mode C3 is therefore more expensive than Mode C2, and
  • Mode C4 more expensive than Mode C3.
  • Mode C4 may provide an advantage in simultaneously viewing two vertically adjacent quadrants which represent a strip of an electronic image or tangible document which has a extremely long length equivalent to a continuous roll of paper.
  • Mode C2 is to place each half of the stretched line sequentially one after another.
  • the first vertical block or field would therefore have 256 lines of active video comprising 128 first halves alternating with 128 second halves. This continues for 8 blocks or fields, at which point 4 frames have been stored.
  • the added sync signals are removed and the second halves are delayed and joined to form continuous lines having a 12 Mhz bandwidth.
  • One technique for seaming horizontally adjacent quadrants is overscanning, in which the first halves each line segment extend 2% beyond the midpoint of the individual line segment to include a leading portion of the second half of the same line (in another segment and possibly in another frame), and the second halves begin 2% before the midpoint to include a trailing portion of the first half of the same line (also in another segment and possibly in another frame).
  • the overlapping or redundant information may be compared in dc or ac content, time, and amplitude to match the seam, with servo loops being employed to provide the necessary degree of precision required in the manner discussed below. Higher frequency content and increasing grayscale depth will dictate the type of servo loops used.
  • Mode N refers generally to any operating mode which employs one or more capture devices 32 to capture, dissect, and seam together or reconstitute an electronic image corresponding to a source document larger than a basic US letter-size page at "normal" resolution, or to a source document of any size that is captured and stored as more than four frames and more than eight segments. It may be readily appreciated from this discussion that it various embodiments may be designed around the use of a single capture device 32 with the source document being moved or advanced to present different regions that would correspond to different segments of a larger electronic image or document, or that several capture devices 32 could be utilized as shown in Figures 10 or 12, either with or without movement or advancing the source document.
  • a line-array type capture device 32 as shown in Figure 13 may be more practical for some continuous feed applications in which the documents have a fixed width but variable length.
  • an array of two capture devices 32 such as shown in Figure 11 are utilized to capture an images relating to the front and back faces of the source document, and those two images are subsequently placed together as a single half-page segment or frame. It may also be appreciated that several segments from several different capture devices 32 can be seamed together without regard to whether each
  • the raster synchronization discussed above that is added to the analog signal in order to define frames corresponding to the selected storage medium is a conventional format that may be recognized by commercial and consumer video equipment, however such a format is only a "coarse" timing reference compared to the degree of accuracy or precision necessary to dissect and reconstitute electronic image documents and still maintain the requisite level of qualitative integrity for the informational content described.
  • the vertical and horizontal synchronization pulses embedded in standard RS-170 formatted signal (used with standard television display and recording) are unsuitable for seaming adjacent segments of an electronic image.
  • Four types of image control signals are therefore utilized with the embodiments of the system 10 disclosed herein.
  • the first two sets of signals are the horizontal and vertical raster synchronization pulses (and corresponding blanking intervals) corresponding to the camera output and frame formats discussed above.
  • a 50 microsecond sampling of a 12 Mhz information signal 118 is shown bracketed by a pair of 13.5 microsecond blanking intervals 120 and a pair of 5 microsecond negative-going synchronization pulses 122.
  • the line thus has a duration of approximately 63.5 microseconds.
  • the third type of image control signal are calibration pulses 128 embedded as a part of the video signal just before and after the active video portions of the composite signal.
  • the calibration pulses are positive- going pulses inserted immediately before and after the synchronization pulses for each line (or line segment).
  • Each calibration pulse preferably has a width (duration) on the order of 750 nanoseconds and a height
  • the calibration pulses ensure matching of the DC levels and amplitudes of adjacent segments, incremental gain calibration between adjacent lines (or
  • Gain calibration is accomplished by subtracting black from gray, with true black being clamped at zero. If a calibration pulse is read at .4 V, for example, a servo correction brings that line down to .35 V to provide an accurate gray level for each "pixel" within the line.
  • the calibration pulse at the end of any line may be directly compared with the calibration pulse at the beginning of any adjacent line along the corresponding seam. Any divergence from the normal calibration amplitude results in shifting the level of the corresponding line so that each line exactly matches the adjacent lines and is set relative to a fixed base level, and the servo loops used for the calibration adjustments are therefore completely independent of informational content in the image.
  • the calibration pulses 128 provide reference to a predetermined "absolute gray” that also corresponds to a similar value for monitors and other devices, with the focus of the embodiments discussed being on a predetermined area of interest or range of grayscale levels that are commonly encountered in tangible source documents of the type used for business records, financial transactions, and so forth.
  • the amplitude of the calibration pulses 128 may be set at any desired value to provide control over the location of the examining area within the entire grayscale range by shifting the median grayscale of the image upward or downwardly compared to an "absolute gray” value expected by the monitor or other device, while still permitting "on the fly” correction around the calibration pulses 128 for line-to-line nd segment-to- segment precision.
  • a conventional negative-going synchronization pulse 130 is then inserted between the calibration pulses 128, as shown in Figure 14f.
  • the fourth type of image control signal is a low level (CW) pilot signal 132 or carrier tone that extends continuously throughout the stored analog signal, is synchronous with the calibration pulses 128, and is harmonically related to the clock speed.
  • the pilot signal 132 must be high enough frequency to permit harmonization with all other synchronizing or timing signals and pulses, and therefore compatible with all divisors of the main system clock rate, and is preferably at or near one half of the write clock frequency.
  • the pilot signal 132 should also be a frequency just above the predetermined bandwidth of the storage medium, but sufficiently distinguishable that a bandpass filter can be used to strip the pilot signal 132 without clipping active video content 118 from the signal. Since the operational spectrum for conventional laser disc medium falls off rapidly above the 6 Mhz bandwidth, a low level pilot signal 132 on the order of 6.89 Mhz has proven suitable for use with conventional LDRs, and may be
  • the pilot signal 132 therefore provides many times more vernier than the standard synchronization pulses for time- based corrections in positioning and aligning adjacent segments of the image when seaming those segments together along horizontal seam lines (parallel with raster lines) or vertical seam lines (perpendicular to raster lines).
  • the pilot signal 132 is also necessary to provide a time-based correction capability to compensate for timing errors in conventional LDRs, and the use of the recovered pilot signal 128 which is retrieved as a part of the stored signal to generate the write clock as data is written to the memory buffer 60 allows the use of this modality in connection with other storage and communications systems that produce time-based errors or which do not regulate absolute timing relative to an external reference or source.
  • the composite signal 134 of Figure 14h is retrieved from the storage medium, and a square wave from the write clock at 15.5 Mhz (derived from a recovered 6.89 Mhz pilot signal) is used to quantitize or digitize the signal and write the signal to the memory buffer
  • the processed signal does not correspond to a 1:1 quantization that would produce a true 256 level grayscale range for the electronic image. Instead, it has proven suitable in the embodiments discussed to incorporate an approximately 20% margin to provide overhead for calibration adjustments and offset. As such, the effective grayscale range would be on the order of 200 to 210 levels, which accommodates the vast majority of interactive document processing applications including high resolution medical imaging for X-rays and MRIs screwand is state-of-the-art for commercially available LDRs. Applications requiring enhanced grayscale differentiation may result in sacrificing a portion of the margin, or increasing the bit depth of the system.
  • the transmission of an electronic image as an analog signal provides significant improvement in transmission rates compared with even the fastest conventional digital transmission by modem or facsimile or over network lines.
  • segmenting of the electronic image in the memory buffer 60 and conversion to a resultant analog signal of appropriate bandwidth permits additional increases in transmission rates over conventional transmission pathways having limited bandwidths, as well as high speed transmission pathways having larger bandwidths.
  • the Nyquist frequency of the analog signal from the capture device 32 and from the initial digital-to- analog conversion is on the order of 12 Mhz, whereas the sampling rate uses a 31 Mhz clock rate.
  • the actual bandwidth of the analog signal may be reduced to a lower bandwidth that corresponds to a digital clock rate at or below the maximum transmission clock rate of the digital transmission pathway, and then transmitted at that speed (which would be slower than if transmitted at the original bandwidth over a line having the same effective bandwidth or clock speed.)
  • the electronic image may be divided into a plurality of segments each having an effective bandwidth corresponding to the maximum transmission clock rate of a particular digital pathway, and then transmitted in parallel and reconstituted.
  • a transmission pathway having more than one parallel lines or channels such as a conventional ISDN transmission pathway comprising three parallel channels of which two are allocated for digital transmission
  • the segments of the electronic image in the memory buffer 60 can be read in parallel and transmitted simultaneously on the separate
  • Subsequent frequency conversion of the type obtained using a line multiplexer may also be applied in applications such as fiber-optic transmission, permitting a multiplicity of segments of an electronic image to be transmitted simultaneously.
  • the analog signal may also be divided accordingly and transmitted over an analog transmission pathway at the maximum bandwidth permitted.
  • the high speed network 28 and transmission pathway 26' are broadband cables capable of transmitting television-type signals, utilizing a conventional handshake recognition and latch to lock out non-requesting nodes from the communication procedure once a request is received by the mainframe or controller and an instruction to retrieve and transmit an image is received and completed by the electronic image server 30 and mass storage device 34.
  • Image requests, sequencing or cataloging information, and ready-state or other control signals may be transmitted over a conventional digital network such as a Novell or Ethernet system.
  • the system 10 may be optimized to permit transmission on these existing communication lines, including satellite and microwave transmission, multichannel RF television, as well as transmission over home-broadcast cable television systems.
  • the transmission operation is also completely compatible with and transparent to any conventional communications- related security technology, such as those employing modulated line scrambling devices and signal encryption algorithms.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)

Abstract

A method and apparatus for high speed conversion of tangible source documents to electronic images, and subsequent transmission o r storage and retrieval of images, utilizing hybrid signal processing. The system employs a higher bandwidth analog signal for image capture and lower effective bandwidth analog signal for transmission or storage and retrieval, with an intervening digital memory utilized to construct a bitmap of the image to facilitate various dissection and seaming schemes which optimize image content and processing time. The system is designed around a conventional bus structure, and the memory serves as a junction with conventional personal computers, networks, and peripheral devices.

Description

METHOD AND APPARATUS FOR THE TRANSMISSION. STORAGE. AND RETRIEVAL OF DOCUMENTS IN AN ELECTRONIC DOMAIN
BACKGROUND OF THE INVENTION
This invention relates generally to interactive document processing in an electronic domain, and particularly to a new modality incorporating hybrid (digital and analog) signal processing for the transmission, storage, and retrieval of documents to optimize informational content and processing time.
BRIEF SUMMARY OF THE INVENTION It is an object of this invention to provide a method for capturing, transmitting, storing, and retrieving documents created in or converted to the electronic image domain which overcomes the obstacles imposed by the inherent speed limitations of the digital domain and the low resolution and perceived imprecision of the analog domain, yet which permits subsequent use of digital interfaces for interactive document processing.
It is a related object of this invention to design the above method
such that it utilizes hybrid signal processing to accomplish the dissection of an electronic image into a progressively increasing number of segments and the after-the-fact reconstruction of a complex electronic image or a multi- image document from those segments.
It is thus another object of this invention to design the above method such that it permits the unrestricted deconstruction or disassembly of a source document in order to optimize the informational content and processing time needed to accomplish a particular document processing operation using specified equipment to achieve a desired end result, and further permits the subsequent seaming together of a virtually unlimited number of related segments (or unrelated image memory maps) to reconstitute or create documents having extensive physical dimensions.
It is accordingly an additional object of this invention to design the above method such that it employs both digital and analog signal processing techniques at predetermined points to achieve the particular advantages associated with the respective signal processing domain, and minimize or eliminate the adverse characteristics of the converse domain.
It is an object of this invention to provide a system for processing documents created in or converted to the electronic image domain which treats the electronic image in a "fundamental" form independent of any transformation or manipulation, and which is therefore universally compatible with any existing or later established standard or format for digital input, output, transformation (including compression), presentation, or representation.
It is an associated object of this invention to facilitate the transparent integration of such a system into current interactive document processing environments.
It is yet another object of this invention to design the above system so as to introduce virtually unlimited scalability for capture, storage and retrieval, and transmission capacities to relatively large document processing systems and databases, particularly for networks in which the fϊleserver is a mainframe computer.
It is a unique object of this invention to design a system for the capture of electronic images from tangible source documents, and the subsequent transmission, storage, and retrieval of those electronic images, which permits complete decentralization of document processing operations among remote networks, and permits remote operators to transmit, store, retrieve, and receive documents with the same capabilities and access available to a central document processing or coordination facility.
It is a related object of this invention to increase the modularity of a document processing environment by linking storage and retrieval functions performed by peripheral devices with the processors responsible for
document transformation and presentation, thus enhancing the operational capabilities of the entire system compared with existing technologies, and to further increase the modularity of the system by linking components by both conventional and high speed networks.
It is a further object of this invention to design the above system such that it may be constructed using currently available recording technologies and established frame formats, as well as subsequently developed technologies and formats for recording electronic images including but not limited to those for optical laser disc recorders utilizing blue-green lasers, greater bit depths, and multiple substrates.
It is a related object of this invention to design embodiments of the above system incorporating time-based corrections to allow the invisible seaming of segments in an image and correcting time-based errors that are introduced by conventional recording devices such as analog optical laser disc recorders, as well as incorporating calibration controls that permit "on the fly" adjustment of grayscale levels between lines or segments, maintain grayscale consistency and precision throughout all frames, and permit selective viewing enhancement by displaying a range of grayscale levels corresponding to a desired amplitude examining area within the image at the optimal base level for an existing display device and for a particular application (similar to the effects created by adjusting "brightness" and
"contrast" to optimize a grayscale range within a displayed image.)
It is a specific object of this invention to design several embodiments of the above system for capturing, storing, and retrieving electronic images from within an interactive document processing network which permits electronic images corresponding to US letter-sized pages (or smaller) to be captured and stored in at least 8-bit grayscale at batch processing rates of 5 to 30 source documents per second or greater (depending upon the image size and informational content), and transmitted at rates of 18,000 to 108,000 documents per hour or greater.
It is a related object of this invention to design the above system such that it may be utilized to establish separate high speed network and facsimile transmission protocols for transmitting documents at equivalent speeds, as well as integrated with existing networks and communications systems in a manner that would increase the transmission rates which may be achieved using conventional transmission pathways.
It is an object of this invention to design the above system such that transmission operations will be compatible with traditionally non-document based communications systems, including such alternatives as multichannel RF television transmission, broadcast cable television transmissions, microwave and satellite transmission, and be compatible with conventional communications-based security techniques such as line scramblers and
encryption algorithms.
It is a distinct object of this invention to design the above system such that it may be immediately implemented in existing document processing environments (such as financial institutions, medical centers, universities, businesses, and research facilities) using conventional interactive document processing hardware (personal computers, networks, and mainframes), and commercially available equipment for image capture and mass storage which adhere to existing uniform standards and formats. It is therefore a related object of this invention to design embodiments of the system such that they may be interfaced with conventional personal computers and local area network systems operating with existing commercial capabilities, one representative example being a personal computer having an ISA bus, an Intel 486 processor, a clock speed on the order of 33-66 Mhz, 70 nanosecond RAM, and interfaced with a conventional Novell or Ethernet network.
It is another object of this invention to design embodiments of the system wherein each image may be stored on a unit of storage medium and addressed by a volume and frame number, and wherein a field may be added to established databases in order to correlate batch-processed documents with their original source documents or transactions, or conversely a separate database may be utilized as a "look-up table" to identify or retrieve the volume and frame number of the stored image corresponding to a specific source document or transaction.
It has been proposed that breakthroughs in the operational capabilities of five technological areas will be necessary to convert the majority of existing business and technical document processing environments from "primarily tangible" to "primarily electronic," thus achieving an effectively "paperless" document processing environment
(irrespective of source document form.) Those basic technologies are storage/retrieval servers comprising file storage and indexing capabilities, transformation servers to permit complete or universal compatibility of document formats, communication servers that provide transmission interfaces for both networks and remote transmissions (i.e., satellite, fiber optic, telephone), recognition servers capable of capturing and preserving the fundamental information from tangible documents, and document managers to track the location, flow, and transformation of documents.
It is therefore an object of this invention to design the method and system of this invention such that it achieves the goal of providing sufficient hardware capabilities in each of the five basic technological areas that would permit a primarily electronic or "paperless" document processing environment for business and technical applications.
It is a related object of this invention that the system facilitate the retention of electronic images corresponding to the "original" tangible source documents which contain and preserve significantly more usable
information than can be appreciated or recognized by human visual perception of the source document, and which further may provide an audit trail and security capabilities to ensure and verify the authenticity of the fundamental electronic image.
It is a further object of this invention to design the hardware components necessary to establish an electronic publishing and archive system (such a system having previously been postulated to maintain every "original" document in storage on only one of a plurality of file servers that may each be accessed independently by any operator within the system, and in which distinct documents may be connected to one another using hypertext pointers) within existing time and expense parameters for users of conventional business and technical informational databases.
Briefly described, the invention comprises a method and apparatus for the high speed conversion of tangible source documents to the electronic image domain, and the subsequent transmission or storage and retrieval of those electronic images, utilizing hybrid (analog and digital) signal processing. The system employs a higher bandwidth analog signal for image capture and lower bandwidth analog signal for transmission or storage and retrieval, with an intervening digital memory buffer utilized to construct a bitmap of the image to facilitate various dissection and seaming schemes which optimize image content and processing time depending upon the size of the source document, the informational content or "resolution" necessary for the particular application, and the particular storage medium or transmission pathway being considered.
The system is designed around a conventional bus structure, and the memory buffer may also serves as a transparent and universal junction with conventional interactive document processing systems including personal computers, networks, transmission systems, and various types of peripheral input/output devices. The system also processes electronic images in a manner that provides complete compatibility with formats and standards for digital storage, image transformation and compression, local area networks, and communications systems.
In a representative embodiment, the electronic image corresponding to a tangible source document such as an 8-1/2" x 11" page is captured using a camera producing an analog output signal with conventional raster synchronization. The vertical and horizontal synchronization pulses are stripped from the analog signal, which is then digitized in 8-bit grayscale and multiplexed to the memory buffer where the image exists as a digital array or bitmap that may be divided into a plurality of segments. The digital content is read from the memory buffer according to this dissection scheme, converted to an analog signal, and control signals are added. The control signals include horizontal and vertical synchronization pulses (and interval blanking), a pilot signal to maintain alignment along the seams between adjacent segments of the electronic image when it is reconstituted,
and calibration pulses to permit instantaneous adjustment of the base grayscale level for each line of the electronic image to maintain a consistent grayscale level. The resultant analog signal is stored on a randomly accessible storage medium such as a conventional analog optical laser disk recorder (LDR) as one or more frames (each frame corresponding to a segment of the electronic image), or the resultant signal may alternately be transmitted to a remote location and reassembled, or up converted and displayed on a conventional monitor. The primary advantages of the technology disclosed herein are therefore speed, increased qualitative integrity, enhanced image content, and universality or translatability of image content. The most compelling rationale for application of this modality in present business or commercial environments is the increased speed in document processing. There is a lesser demand to increase or enhance image content or qualitative integrity, however the inherent increase in stored image content that may be achieved without increasing storage densities or introducing undue expense or complexity to the overall system does have the effect of making this modality optimal for processing certain tangible documents as electronic images (such as written records of financial transactions, medical imaging, and damaged or unreadable originals) where preservation and reproducibility of all fundamental information in the tangible document and the corresponding certification of security and authenticity permit electronic document processing to be applied where it was previously too costly, complex, volatile, or susceptible to challenges of unfitness or impropriety.
BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a diagrammatic depiction of an interactive document processing network utilizing the electronic document transmission, storage, and retrieval system of this invention for the capture, transmission, storage, and retrieval of electronic image documents;
Figure 2 is a schematic diagram showing the components of an embodiment of the electronic document transmission, storage, and retrieval system of this invention particularly adapted for the capture, transmission, storage, and retrieval of electronic image documents;
Figure 3 is a diagrammatic depiction of an 8-1/2" x 11" tangible source document oriented in the upright or vertical position; Figure 4 is a diagrammatic depiction of the source document of
Figure 3 oriented in the sideways or horizontal position, with a phantom line showing the source document divided corresponding to two horizontally adjacent image segments, and further showing two sub-sections corresponding to the front and back of a conventional negotiable instrument (check) superimposed over the right segment of the source document; Figure 5 is a diagrammatic depiction of the source document of
Figure 3 oriented in the sideways or horizontal position showing the orientation of typed lines;
Figure 6 is a diagrammatic depiction of a source document such as a C-size drawing, with phantom lines showing the source document divided into four horizontally and vertically adjacent regions corresponding approximately in size to the source document of Figure 3;
Figure 7 is a diagrammatic depiction of a source document (such as a seismic tracing) corresponding approximately in size to several of the source documents of Figure 3;
Figure 8 is a diagram showing three grayscale gradients in which 8A is a 4-bit grayscale gradient printed at 300 dpi showing 12 gray levels including black and white, 8B is 8-bit grayscale printed at 300 dpi resolution showing the dithering pattern appearing as dots of progressively increasing diameter from top to bottom, and 8C is the same 8-bit grayscale printed at
3360 dpi with a 150 line screen showing the same dithering pattern with approximately 58 gray levels appearing as horizontal banding;
Figure 9 is a diagrammatic depiction of a single capture device utilized to capture an image associated with the source document of Figures 4 or 5, with a phantom line showing the source document divided corresponding to two horizontally adjacent image segments; Figure 10 is a diagrammatic depiction of a plurality of capture devices utilized to capture an image associated with a source document greater in size than the source document of Figure 3, with a phantom line showing the source document divided corresponding to two adjacent image segments;
Figure 11 is a diagrammatic depiction of a plurality of capture devices utilized to capture an image associated with both the front and back faces of a source document such as the negotiable instrument (check) shown in Figure 4; Figure 12 is a diagrammatic depiction of a plurality of linear array type capture devices configured in an array utilized to capture an image associated with a source document greater in size than the source document of Figure 3, with phantom lines showing the source document divided corresponding to an equal plurality of adjacent image segments; Figure 13 is a diagrammatic depiction of a line array type capture device utilized to capture an image associated with a source document, with phantom lines showing the source document divided corresponding to an image segment;
Figure 14 is a waveform diagram in which 14a shows synchronization pulses and blanking intervals on opposing sides of a segment of analog signal; 14b shows the analog signal of Figure 14a after digitization; 14c shows the digital signal split and expanded to form two digital segments; 14d shows the two digital segments of Figure 14c converted to analog
signals; 14e shows two positive-going calibration pulses; 14f shows a negative-going synchronization pulse; 14g shows a low level pilot signal; 14h shows a composite waveform of the two active signals of Figure 14d summed with the signals of Figures 14e-14g overlaid over the sum of the
signals of Figures 14e-14g; and 14i is a square wave corresponding to the clock speed utilized to reconstruct the electronic image represented by the analog signal of Figure 14a;
Figure 15 is a diagram showing the arrangement of segments and frames in Mode Cl (line delay) overlying a raster image composed of horizontal scanning lines;
Figure 16 is a diagram showing the arrangement of segments and frames in Mode C2 (field delay) overlying a raster image composed of horizontal scanning lines; Figure 17 is a diagram showing the arrangement of segments and frames in Mode C3 (one frame delay) overlying a raster image composed of horizontal scanning lines; and
Figure 18 is a diagram showing the arrangement of segments and frames in Mode C4 (two frame delay) overlying a raster image composed of horizontal scanning lines. DESCRIPTION OF THE PREFERRED EMBODIMENTS
The electronic document transmission, storage, and retrieval system of this invention is represented in Figures 1-14 and referenced generally therein by the numeral 10. Referring particularly to Figure 1, an interactive document processing environment is shown which includes a low speed local area network (LAN) 12 such as a Novell or Ethernet network or a peer-to-peer network system linking a plurality of nodes which may be occupied by personal computers 14, terminals, or workstations. The network 12 is optionally linked to a mainframe 16 or file server along a conventional digital communications pathway. Each computer 14 on the network 12 is linked to various peripheral devices including a digital document input device 18 such as a document scanner, an output or representation device 20 such as a laser printer or film recorder, and a transmission interface 22 such as a modem or facsimile machine. Each computer 14 or terminal preferably has various input and output devices for the operator including a keyboard, mouse, trackball, or pressure sensitive tablet, storage mediums such as a magnetic or optical disk, tape cartridge, or compact disc drive, and at least one presentation system such as a raster display or LCD projection screen associated therewith.
Each of the computers 14 in the network 12 are simultaneously connected to a separate high speed network 28 which includes an interface module (not shown) installed in or linked to each of the computers 14.
The interface module will preferably have the capability for at least retrieval and transmission of documents utilizing the high speed network 28, and may optionally include storage capability. The network 12 may also be connected to a remote network 24 through a conventional transmission pathway 26 such as telephone lines or a dedicated cable system, and a "high-speed" transmission pathway 26' capable of transmitting electronic documents at rates equivalent to the faster operating speeds of the high speed network 28 of the system 10. The high speed network 28 is linked to an electronic image server
30, which is in turn connected to a capture device 32 and a mass storage device 34. The mass storage device 34 is connected to the electronic image server 30 by both a conventional digital communication pathway and a high speed pathway. The mainframe 16 is also connected to the electronic image server 30 along a digital communications pathway.
The electronic image server 30 may be self-contained within its own housing and include the necessary ancillary components such as a power supply, operator interface, and the like, or may be fabricated on a separate interface module mounted in a host processor such as a personal computer or workstation. It is understood that each computer 14 in the network 12 that is linked to the high speed network 28 will also include a separate EIS interface 30 which has some or all of the processing capabilities of the electronic image server 30. Thus, for purposes of clarity, the term electronic image server 30 will be used to refer to the separate unit as shown in Figure 1 that is used primarily for capture and batch processing operations, and the term EIS interface 30 will be used to refer to a computer-based interface associated with each computer 14 or workstation.
Each EIS interface 30 may include some or all of the components necessary for storage, retrieval, transmission, or presentation depending on the number and extent of document processing operations that will be performed at that station or node. As such, the EIS interface 30 is hereafter assumed to have the full functional capabilities of, and be functionally indistinguishable from, the separate electronic image server 30 unless otherwise noted, and the schematic shown in Figure 2 will therefore delineate the relationships of both the separate electronic image server 30 and the computer-based EIS interface 30 as being mounted on a host processor such as a personal computer or workstation.
In normal operations, images from tangible source documents will be captured using the capture device 32 and stored on the mass storage device 34. A volume and frame number for each image will be written to a database in the mainframe 16 using the conventional digital communications pathway. An operator at a computer 14 on the network
12 will issue a retrieval command to the mainframe 16 for a particular document image, and the mainframe 16 will access the database to determine the correct volume and frame numbers for the image. The
mainframe 16 will issue an instruction through the digital communication pathway (and electronic image server 30) to the mass storage device 34, which will retrieve the appropriate number of frames from the storage medium in the mass storage device 34 and transmit those frame over the high speed network 28 to the requesting computer 14. The EIS interface
30 within the receiving computer 14 will reconstruct the electronic image for the operator to view, and the operator may process that electronic image as desired. Alternately, an image may be retrieved from the mass storage device 34, reconstituted in the electronic image server 30, and transmitted along the digital network 12 through the mainframe 16 and to the requesting computer 14.
If the operator working at one of the computers 14 or workstations makes a transformation to the electronic image and wishes to store that derivative image or a newly created electronic image, there are two alternatives. First, the operator could issue a store command which would cause the electronic image to be transmitted over the high speed network 28 to the mass storage device 34, with a corresponding instruction being sent to the mainframe 16 over the conventional communications pathway which would update the database with any information concerning the processing history of the electronic image, and also initiate the appropriate subroutine in the mainframe 16 to instruct the mass storage device 34 to receive and store the correct number of frames, and obtain the volume and frame numbers from the mass storage device 34 to be placed in the database. Alternately, the operator could send the electronic image in digital form through the mainframe 16 to the electronic image server 30 using the conventional digital communication pathways, where the image would be converted to frames and stored on the mass storage device 34 with the database in the mainframe 16 being similarly updated.
The remote network 24 will ordinarily be associated with a separate mainframe 16' or fileserver, and a separate high speed network 28' with a separate mass storage device 34' as well as at least one separate electronic image server (not shown) and the associated peripherals and components. If an operator wishes to transmit an electronic image to the remote network 24, the electronic image 24 may be transmitted over the high speed transmission pathway 26' to a high speed network 28' linking the nodes of the remote network 24, where it may be saved on a separate mass storage device 34' and a database in the remote mainframe 16' will perform the necessary cataloging and indexing functions. As discussed in greater detail below, it may be appreciated that images may be downloaded in batches directly from one mass storage device 34 to another 34' using the associated high speed networks 28, 28' and the high speed transmission pathway 26', with the corresponding database information being transmitted from one mainframe 16 to the other mainframe 16' along the conventional digital
transmission pathway 26.
The capture device 32 could be any conventional high speed image capture device, although as discussed herein the capture device 32 and electronic image server 30 are preferably designed, structured, and tuned to match the particular document processing applications for which the high speed network 28 will be utilized.
Referring particularly to Figure 2, the various components associated with the EIS interface 30 and interconnections between the EIS interface 30 and the host processor are shown.
The host processor includes a communications pathway such as a bus structure 36 which may be of any conventional type defining or defined by the architecture of the 1. Although an external bus of the type utilized for real time data acquisition and control systems could be utilized, it has proven suitable to design the embodiments discussed herein around the main bus structure 36 of the host processor. It is understood that the bus structure 36 of most personal computers and work stations is hierarchical, including a backbone or system bus, and one or more subsystems such as an instruction exchange bus, a data exchange bus, an arbitration bus to allocate access among competing devices, and an interrupt bus to accept attention request signals from devices. The bus architecture also dictates such features as the motherboard, slot, and card dimensions, grouping and cooling of components, power distribution, and connector configurations and arrangements.
There are currently believed to be twelve accepted full standards for bus structures 36 recognized by the Institute of Electrical and Electronic Engineers (IEEE), and over fourteen proposed standards. There are also many bus standards that have been designed by special interest groups with the cooperation of other organizations to satisfy particular applications, and there are several proprietary bus standards that remain unpublicized.
Adapters may also be attached to the system bus to access specialized interface buses such as the Small Computer System Interface (SCSI) for disk drives, scanners, and most other input/output devices, and the General Purpose Instrumentation Bus (GPIB) for measurement and control devices. Some of the bus structures contemplated for use with the electronic document transmission, storage, and retrieval system 10 include PCBus (IBM PC class), ISA (IBM AT class), MicroChannel (IBM 32-bit OS/2 class), STD Bus, EISA (Compaq 32-bit), S-100 and SBus (Sun Microsystems), VME (Motorola), open Unibus and QBus (Digital/DEC), and MultiBus and MultiBus II (Intel). It may be readily appreciated that since any component connected to a personal computer bus structure 36 must operate with the host processor and all other peripheral devices, the bus structure 36 of the host processor will dictate many of the design characteristics of the EIS interface 30 and related components. The
embodiments subsequently discussed are suited for applications utilizing the
ISA bus on IBM compatible computer systems incorporating Intel 386 or
486 processors. The bus structure 36 of the host processor is preferably equipped for connection to a digital capture device 38 such as a document scanner through a peripheral interface 40, a local area network 12 or peer-to-peer network through a separate network interface 42, an on board or external device capable of image compression 44 using any conventional compression standard such as JPEG, and an output device 46 such as a laser printer of film recorded connected through a serial or parallel output interface 48.
The bus structure 36 may of course be connected to many other types of peripheral devices, however these are the basic devices utilized in the capture, representation, and transmission of electronic image documents over existing networks 12 adapted for interactive document processing.
The operator will have direct command access to both the bus structure 36 and the interface for the EIS interface 30 through a keyboard 50 or other devices such as a mouse, trackball, tablet, or the like, as well as through any input/output and peripheral devices connected to the bus structure 36. High speed document capture is accomplished using a capture device 52 which provides an analog output signal timed with synchronization and blanking pulses corresponding to individual frames following the normal fast-scan television system standards of 30 frames per second with two interlaced fields or switchable to one progressively scanned field per frame, as modified according to the provisions discussed subsequently herein. The capture device 52 may be any conventional charge-coupled device (CCD) or Vidicon tube type camera, but preferably has a progressive or sequential scan, horizontally and vertically synchronized analog output signal that is switchable between conforming to the fast-scan television system standards producing 30 frames per second and slower vertical sweep rates as required by high resolution modes of operation. An alternative would be to have two cameras to switch between. It may be appreciated that conventional CCD cameras having from less than 512 x 512 to greater than 2048 x 2048 pixel arrays will be suitable for many applications employing the modality disclosed herein, and that non-square, larger and small arrays, and linear array cameras or scanners may be equally suited for some applications.
The analog output signal from the capture device is processed through an analog-to- digital converter 54 timed using an input sync-generator 56, with the system being driven by a 124 Mhz clock speed oscillator (crystal) with input to the analog-to-digital converter 54 divided by four to achieve a 31 Mhz conversion clock speed. Since the resultant output signal is still a time-division multiplexed signal, a 31 Mhz to 3.9 Mhz demultiplexer 58 may be used to strip the timing and synchronization pulses from the output signal and distribute the remaining image signal to an input memory buffer 60 with a 3.9 Mhz clock rate that is compatible with a broader spectrum of suitable memory devices that are currently commercially available.
It may be appreciated that in the embodiments discussed an 8-bit analog-to-digital converter 54 is used to obtain digital content corresponding to an 8-bit grayscale bitmap, however the continuous analog signal output from the capture device 32 would permit any the use of an analog-to-digital converter 54 that would produce any selected bit level in either grayscale or color depending upon the particular application being considered and informational content desired. The image input memory 60 is preferably an SRAM semiconductor memory. It should be noted for purposes of this discussion that classification of semiconductor memory usually includes dynamic and static random access memory (DRAM and SRAM), read-only memory (ROM), as well as programmable ROMs (PROM), erasable ROMs (EPROM, EEPROM), nonvolatile RAM (NVRAM), and flash-memory such as charge-coupled devices (CCD) and magnetic bubble memory. Each type of memory may be classified as dynamic or static, read/write or read-only, random or serial access, volatile or nonvolatile, and erasable using magnetic or ultraviolet radiation. Because a CCD sensor chip is properly categorized as a type of serial access semiconductor memory, it is important to distinguish between the bitmap or digital array corresponding to an electronic image formed on the CCD sensor chip of a linear imaging device
(LID) such as a line-array scanner or an area imaging device (ADD) camera, and the digital array or bitmap associated with the corresponding image once the digital information has been read from the capture device
32, converted and multiplexed for analog television output, interlaced if necessary for video, and subsequently digitized by a frame-grabber or similar device and deposited in active memory which may or may not be user-interactive memory. Consequently, the memory buffer 60 connotes digital semiconductor memory other than the image sensor itself which permits interactive addressing and manipulation of pixels or swapping of information into memory from which pixels may be interactively addressed and manipulate, and which may be configured as an interactive junction with a bus structure 36 or similar interfaces.
The digital array associated with a particular electronic image may be stored to or retrieved from a conventional digital storage device 62 such as a magnetic or optical disk drive, or transmitted to or through any conventional peripheral, through the bus structure 36. It should also be noted that a previously stored electronic image document may be recaptured using the analog capture pathway by substituting an alternate
image input source 64 such as a write-once/read-many-times (WORM) optical laser disc player (LDP) connected through a mechanical or electronic switch 66 to the input channel of the analog-to-digital converter 54. A Sony Model LDR-5000A optical disc recorder/player (EIA Standard)
has proven suitable.
The switch 66 also provides a suitable junction for linking the input of the analog-to-digital converter 54 to the high speed network 28, and it may therefore be appreciated that an electronic switching device such as a latch controllable by the EIS interface 30 or the mainframe 16 is desired for switching between the capture device 52, laser disc player 64, and high speed network 28 so that electronic images transmitted on the high speed network 28 will not be obstructed or delayed awaiting manual switching. A manual switch 66 would preferably have a default setting to the high speed network 28, with user-selected switching to the capture device 52 or laser disc player 64 intended only for intermittent operation.
At this point on the image processing pathway, the electronic image document exists as a digital array or bitmap in active memory. The digital array or bitmap may not have the same physical X-Y coordinate array as was present on a CCD sensor chip. In fact, for the applications subsequently discussed, it has proven preferable to divide or section the image into blocks or segments, and to further deposit portions of each block or segment in distinct banks of memory. However, each pixel remains mapped to a specific memory location by bank, row, column, and phase by a matrix or formula in the memory control module 68, and a set digital array or bitmap is preserved and recognized even though it may require calculation to correlate a pixel's location in memory to its position on a raster line or LCD display.
The electronic image document may then be stored on an analog storage device 70 such as an analog WORM optical laser disk recorder
(LDR) by dumping the digital array from memory 60 as a conventional 4 Mhz clock speed digital transmission signal and processing that signal through the first step of a sequential frequency converter 72 (up converter) to achieve a 16 Mhz bandwidth, an 8-bit digital-to-analog converter 74, and multiplexer 76 producing a 6 Mhz bandwidth output and the appropriate timing and synchronization pulses expected by the storage device 70. A switching device 66 may also be utilized to provide a suitable junction for linking the output of the multiplexer 76 to the high speed network 28 for transmission of electronic images, and it may be appreciated that conversion of the signal to the appropriate bandwidth for the high speed transmission pathway may require that the up converter 72 or the multiplexer 76 be instructed by the EIS interface 30 to perform the appropriate signal conversion steps to match the bandwidth of the analog signal to the corresponding transmission pathway. The 16 Mhz clock rate signal from the first step of the frequency
converter 72 may also be processed in a second step to achieve a 124 MHz clock rate signal, converted to analog using a digital-to-analog converter 78, and presented on a conventional raster display 80, preferably such as a high resolution computer monitor. In some applications subsequently discussed, separate input and output memories may be utilized, and the output memory may be read at a speed directly compatible with monitor inputs. The image may also be presented on a conventional LCD display screen 82 or projector, although the necessary signal form may need to be created as required by the LCD display 82.
Since each electronic image document is stored on the storage device 70 in the form of one or more frames (depending upon the operational mode being used and the size of the image), a database 84 is utilized to record an accession number, index, or address for the initial frame and size (or for each of the separate frames) associated with a specific document to permit cataloging and selective retrieval of any document stored on that medium. The database 84 may be located in the mainframe 16 or fileserver, a separate CPU associated with a remote EIS interface 30 device, or be resident in the computer housing the bus structure 36. In many applications involving high speed batch processing on the order of several million tangible source documents per day (such as checks or similar negotiable instruments processed by a financial institution, for example) each stored image will be identified by a volume number corresponding to the serial number of the specific disc or recording medium, and a frame number. A single frame number will be satisfactory when all batch-processed images are stored using the same quantity of frames for each image, and the combination of the volume and frame numbers may be treated together as a single index, address, or accession number. The database 84 may be an already-existing database used for processing transactions involving the source documents to which one or two fields are appended corresponding to the volume and frame numbers for the stored image, or may be a separate database 84 which provides a "look¬ up table" relating an identifying characteristic of the source document (such as the computer-readable MICR code on negotiable instruments or checks) with the corresponding serial and frame numbers of the stored image.
Because the speeds at which tangible documents may be captured exceeds the rate at which an operator can manually position the document, it is anticipated that automatic document feeders (not shown) will be utilized particularly with paper, film, and microfiche documents. Consequently, an infeed control interface 86 must be connected to the EIS interface 30 so that the EIS interface 30 can receive ready-state acknowledgements from the automatic document feeder and step or advance commands can be sent to the automatic document feeder, and a corresponding indexing or accession control interface 88 would be connected between the EIS interface 30 and the storage device 70 to correlate the volume serial numbers and frame numbers with the
appropriate images that are stored, and provide sequencing and control
signals to the storage device 70. A manual infeed control interface 86 would be used when documents are positioned manually by the operator.
A separate storage device 70' such as a second analog WORM optical laser disc recorder (LDR) may be utilized at a remote location for batch downloading or backup of images stored on the first storage device
70, with the corresponding indexing or cataloging information from the database 84 being supplied to a separate database that is connected to the second storage device 70'.
Source Document Orientation The embodiments of the system 10 discussed herein have been specifically tailored to optimize the processes of capturing and storing electronic images from tangible source documents that are especially common to many financial and business transactions conducted in the United States, or for specialized applications that are considered document intensive. Those tangible source documents include paper documents, as well as documents previously fixed in mediums such as microfilm and microfiche. The following discussion of several paper-based source documents provides a sufficient basis for describing the particular modes of operation associated with the preferred embodiments.
Referring particularly to Figures 3-7, several of these source documents are shown. Figure 3 is a diagrammatic depiction of a basic US letter-size page 90 generally approximating the horizontal and vertical dimensions or aspect ratio of a standard 8-1/2" x 11" sheet of paper (and similarly approximating an A-4 size page) in a vertical orientation. Figure 4 is a diagrammatic depiction of the same page 90 shown in Figure 3 in a horizontal orientation. The page 90 is divided along an imaginary vertical centerline 92 into two half-page segments 94, 96 having dimensions of approximately 8-1/2" x 5-1/2" each. Two blocks 98 each representing the front or back face of a standard check (negotiable instrument) having dimensions of approximately 2-3/4" x 6" are superimposed on the right half 96 of the page 90. Figure 5 is a diagrammatic depiction of the page 90 of Figure 3 showing the normal orientation of type written lines 100 of text on that page 90.
Figure 6 is a diagrammatic depiction of a drawing sheet 102 having dimensions greater than twice a basic page 90, with horizontal and vertical phantom lines 104 showing the drawing sheet 102 divided into four equal quadrants or segments along both horizontal and vertical seam lines.
Figure 7 is a diagrammatic depiction of a section of a large-scale document 106 such as a geophysical survey. The section 106 has dimensions on the order of 36" x 48" and may correspond to about 4 miles
of survey data with 50 samples per mile along the horizontal axis, with the entire document encompassing 70 or more miles of survey data and having a total length of many feet.
Capture Device Arrays
Referring particularly to Figures 9-13, it may be seen that the processes of capturing and storing electronic images from the types of source documents 90, 94, 98, 102, 106 discussed above may be accomplished in several manners depending upon the corresponding size of the source document 90, 94, 98, 102, 106 and the degree of informational content desired to be captured and stored.
Figure 9 is a diagrammatic depiction of a single capture device 32 such as an area array CCD or Vidicon tube type camera disposed a predetermined distance or height above a source document such as a basic page 90 oriented horizontally, with a phantom line 92 identifying an imaginary centerline 92 dividing the basic page 90 into two half-page (one frame) segments A, B. Figure 10 is a diagrammatic depiction of a pair of capture devices 32 disposed above a source document 108 such as a basic page 90 oriented vertically or two-page drawing sheet 102 oriented horizontally, with a phantom line 110 identifying an imaginary centerline or seam line dividing the source document 108 into two segments A, B (of two frames each).
Figure 11 is a diagrammatic depiction of a pair of capture devices 32 disposed above and below a source document 112 such as a check, with one capture device 32 capturing a segment A of the resulting half-page electronic image corresponding to the front face of the check or source document 112, and the other capture device 32 capturing a segment of the resulting half-page (one frame) electronic image corresponding to the opposing face (not shown). Figure 12 is a diagrammatic depiction of a plurality of capture devices 32 disposed in a two dimensional (vertical and horizontal) array above a large-size source document 114, with each capture device 32 capturing a segment A-F of the resulting (multi-frame) electronic image which adjoin one another along both vertical and horizontal seam lines 116. Figure 13 is a diagrammatic depiction of a capture devices 32 of the line array type disposed above a large-size source document 114, with the capture device 32 sequentially capturing a segment A-C of the resulting (multi-frame) electronic image which adjoin one another along parallel seam lines 116. "Mode A" and "Mode B" Operation
Different operational modes for the electronic document transmission, storage, and retrieval system 10 may be designed to achieve particular goals or meet certain requirements, limitations, or constraints associated with the document or the system 10. Two modes termed "Mode
A" and "Mode "B" are particularly designed around document processing involving tangible source documents such as a US letter-size page 90 or smaller, 8-bit grayscale informational content, and wherein "normal" system resolution is suitable. It should be noted that "normal" resolution refers to an arbitrary resolution as defined by the particular system mode and the application of that mode to a specific operating environment. In other applications, normal resolution might refer to fractions or multiples of the "normal" resolution as defined by Modes A and B. It should also be noted that bypassing the bandwidth filters or bandwidth limiters in conventional analog WORM-type LDRs 70 to operate with the "extended" bandwidth and additional lines of image content results in an approximately 30% increase in the effective resolution or storage capacity of the storage medium, without affecting its storage density. These modifications are possible because the LDRs were designed around color broadcast specifications which differ from the optimal performance arrangement for document legibility. Modes A and B are particularly adapted for a 1-frame 30 hz or
2-frame near 14 hz (i.e., less than 15 hz or approximately 70 millisecond) record time, capturing informational content in 8-bit grayscale from a horizontally-oriented 8-1/2" x 11" tangible document. This orientation is believed preferable for documents containing typewritten characters, because readability of a typewritten characters requires more resolution in the "horizontal" direction than in the "vertical" direction. It may be noted that the frame rate of Mode B is deliberately not one half the frame rate of
Mode A, since tube type cameras require a minimum vertical retrace time and it the necessity of achieving 1000 plus useable lines.
Mode A refers to capturing and storing one half-page image of a US letter-size source document as a single frame, whereas Mode B refers to capturing and storing the full-page image of a US letter-size source document as two frames. Although Mode A can be considered a system bypass that does not require complex seaming to retrieve and reconstitute the electronic image, the same control signals including the pilot signal and calibration pulses as discussed below are applied to documents processed in Mode A, since those control signals are also useful for maintaining electronic image integrity throughout batch-processed source documents and between different operating environments or platforms.
Normal fast-scan television provides 30 frames per second with 525 horizontal lines swept at a 60 hz vertical rate and scanned at a 15,734 hz horizontal rate with a 4:3 aspect ratio, with two interlaced scanned fields
per frame. The image is sent as an amplitude-modulated (AM) signal, while audio is frequency-modulated (FM). European television (PAL standard) utilizes 625 lines, however the aspect ration remains approximately 4:3.
In Modes A and B, the capture device 52 produces a camera image of 1114 progressive (non-interlaced) lines refreshed every 70 milliseconds. When recorded using the method discussed herein on a conventional laser disc recorder 70 which expects a 525 line format, this will correspond to two images of 500 lines each with the excess lines accommodating the control signals as described. The lines of the image are therefore being scanned at 14 hz in the vertical direction (approximately one quarter the normal sweep rate) and scanned horizontally at 15 khz. A Dage-81 camera manufactured by Dage-MTI Incorporated of Michigan City, Indiana, provides a suitable capture device capable of being driven at the 14 hz vertical scan rate. It should be noted that more accumulated charge may be discharged as useable signal by lengthening the time during which a document is being scanned using a capture device in which the accumulated charge on the target is time-dependent on incident source light such as a Vidicon tube type camera. This results in enhanced image capture capabilities by effectively increasing the number of "pixels" that are contained in each scan line, although the number of scan lines that may be treated as a "frame" is reduced proportionately because each scan line is longer in duration, and the image therefore occupies more frames. Tube type cameras are therefore advantageous in applications where a CCD type camera would not provide sufficient resolution or fast enough speeds given other practical considerations, or where the fixed pixel resolutions of current CCD cameras are otherwise inadequate. While this scan rate reduction would normally produce a visible flicker if the images being captured were viewed directly from the camera output, the scan rate reduction is compensated for by subsequent frequency conversions that are interposed immediately prior to any display, projection, or other visible presentation operation. Progressive scanning is preferred since it provides a Kell factor as high as .9 over the traditional .7 value for interlaced scanning, thus producing advantages in acquisition and display, and since interlaced scanning results in greater information loss caused by inaccuracies in tracking adjacent sweeps and the time factor for decay occurring between interlaced sweeps.
The output signal from the capture device 52 is digitized at 31 Mhz and stored in a 1024 x 2048 x 8 input memory buffer 60. The memory buffer 60 is preferably two banks of eight 128 kbit SRAMS with an 8 column by 9 row architecture and a corresponding video input latch. The output signal is multiplexed into 8 segments which places 256 pixels in each row of memory. Any pixel can be identified by bank, row, column, and phase. The configuration of the memory buffer 60 in Modes A and B can be made more efficient, however this configuration permits interchangeable
application to other modes and is simple to construct.
It may be appreciated from this discussion that the true potential of the 1024 x 2048 memory buffer 60 configuration is not necessarily being fully utilized in the embodiments which employ currently available state-of- the-art LDRs, however use of this configuration of the memory buffer 60 provides a suitable margin to permit the use of these embodiments with improved LDRs currently under development with a minimum of adaption. As noted above, there is also a rationale for having separate input (capture) and output (display or storage) memory buffers, with each separate memory buffer being optimized for its intended purpose. Since the output from the input memory to the storage device is analog and the input to the output memory is also analog for retrieval, commonality of the digital characteristics of input and output memory is unnecessary. Separate memory buffers also facilitate simplicity in designing the interface modules to have retrieve-only capabilities, thus reducing the cost and complexity per node for network systems having a centralized high speed capture and storage process.
The EIS interface 30 circuitry may be divided into three groups. The circuitry associated with the memory buffer 60 is one group. The non-124 Mhz portion can be fabricated on a first integrated circuit board using transistor-transistor logic (TTL), whereas the 124 Mhz portion (including the digital-to-analog converter 74) can be fabricated as a third group using emitter-coupled logic (ECL) on a separate integrated circuit board. The multiplexer 76 can be fabricated with the non-124 Mhz portion of the circuitry, or a remote multiplexer 76 may be connected to the non- 124 Mhz portion of the circuitry using sixty-four sets of twisted-pair wires.
The resultant analog signal associated with the electronic image may be stored on the storage device 70 in video format. A 525 line 60 hz vertical scan rate WORM optical laser disc recorder (LDR) is conventional, and a Sony Model LVR-5000A (EIA Standard) laser videodisc recorder/player has proven suitable.
Storing a 1024 line image in two standard frames produces 26 excess lines, for which the LDR would "see" approximately one fourth the normal number of horizontal synchronization pulse durations during the vertical interval instead of the 21 expected, and this could affect the LDR's servo lock or otherwise result in inoperability of the LDR. There are two immediately available options for resolving this situation. First, the LDR could be adapted to expect the narrow line vertical intervals. However, since the use of unmodified standard LDRs is desired, the preferred embodiment utilizes a standard vertical interval signal with a 1000 line video image, which necessarily results in an image that is 24 lines short of binary "pure." It may be readily appreciated that a system utilizing a 625 line 50 hz
vertical scan rate LDR compatible with the PAL (European) television and video recording standard may be preferred in situations where PAL- compatible LDRs are more readily accessible or in applications where the nature of the tangible source document makes 625 line capture the optimal alternative. In some applications, the increase in horizontal bandwidth from 4.2 Mhz to 6 Mhz may be compelling. Such a conversion will either decrease the number of images storable on a conventional optical disc by 20% (from approximately 43,000 to 36,000) or increase the recording time by about 20% per frame, In such an event, the sync generator 56 can be modified to operate corresponding to the 625 line 50 hz vertical scan PAL standard. However, it should also be remembered that the sync generator controls the drive frequency of the capture device 32 and supplies the timing waveforms for the input memory buffer 60. Consequently, selection of the appropriate capture device 32 and optimization of memory characteristics may be required.
A 525 line 60 hz vertical scan rate standard sync generator provides a composite synchronization train. After the first vertical synchronization pulse, the first 250 lines are read to the memory buffer 60. The read pauses to allow insertion of the second vertical interval, and then lines
251-500 are read. The read pauses, and the vertical interval between the first and second frames is inserted, and the second frame is read in the same manner as the first frame. The additional 50 hne times are consumed by the vertical blanking intervals. At the same time the read starts for the beginning of the first frame, the LDR begins recording the output from the digital-to-analog converter 74. The image can be retrieved by reversing the storage process and reconstituting the two frames as a single electronic image document.
It may be appreciated that the tangible 8-1/2" x 11" original image is divided into four blocks or segments to be stored on two separate frames with two blocks per frame. These blocks or segments can be groups of sequentially adjacent lines, fractions or segments of adjacent lines, alternating or selected interlaced lines, or any other desired portion of the image. An electronic image having a digital array composed of X lines of pixels would result in two frames each having X/2 lines of information, and the raster corresponding to those two frames would be composed of N horizontal scanning lines at a predetermined vertical scan rate plus a maximum time interval dictated by the remaining or excess 2N-X horizontal scanning lines and the predetermined vertical scan rate which is utilized to add the raster synchronization to the analog signal for each frame.
The retrieved electronic image can be processed in two ways. It can be mapped at 3.9 Mhz onto the bus structure 36 of the host processor and swapped to the video display RAM on the computer's motherboard or on a video/graphics interface card, stored in digital form on magnetic medium, transmitted over conventional transmission pathways, or downloaded to an
output device such as a printer. Alternately, for high resolution display the
signal may be up converted by the frequency converter 72 to correspond to the appropriate dot clock equivalent for a high resolution gray scale or color monitor.
"Mode C" Operation Modes A and B operation are considered biased in the horizontal direction. Mode C operation is effective where either "square" resolution or a vertical bias are desired. Mode C operation may be considered "high" resolution compared with Modes A or B, and provides twice the "normal" resolution of those modes.
The acquisition of the signal in Mode C is the same as in Modes A and B, however the image is dissected into 8 blocks and recorded as 4 frames. The resolution of the tangible source document image (using the 8-1/2" x 11" example) becomes a 1024M X-Y pixel product (1248 pixels in the 11" inch direction and 1000 pixels in the 8.5" direction) while only requiring twice the capture and storage time.
There are three alternatives for operation in Mode C. In each case the horizontal line is split in half. The read from the memory buffer 60 is performed at half the write speed (using a 7.5 khz horizontal sweep rate controlled by the read clock) to effectively expand or stretch the 12 Mhz bandwidth signal into a 6 Mhz bandwidth signal, which causes the half of the horizontal line segment to expand from 32 microseconds to 64 microseconds in duration, which appears normal to an LDR expecting a 6
Mhz analog signal with 64 microsecond line duration. Each of the three alternatives to Mode C may be understood by considering a grid overlying a 1000 line raster image in which each line has a left and a right half.
In the first alternative (Mode Cl in Figure 15) the grid has one vertical column of eight horizontal rows. Each row of the grid therefore corresponds to one field of a frame. Each segment is therefore one vertical row consisting of 125 left halves alternating with 125 right halves of each line. The segments are stored in ascending order, SI through S8, so that frame Fl contains segments SI and S2 as fields 1 and 2, frame F2 contains segments S3 and S4 as fields 1 and 2, and so forth. This mode is the least expensive since it only requires a line delay, and has the advantage of providing a security function by "scrambling" the appearance of the stored images in the event an unauthorized individual attempts to access the medium using an incompatible EIS system or view the image on an interlaced monitor. In the second alternative (Mode C2 in Figure 16) the grid has two vertical columns of four horizontal rows. Each segment therefore consists of either 125 left halves or 125 right halves of the lines. The segments are again stored in ascending order, SI through S8, so that frame Fl contains
segments SI and S2 as fields 1 and 2, frame F2 contains segments S3 and
S4 as fields 1 and 2, and so forth. This mode is the more expensive since it requires a field delay, and also has the advantage of providing a security function by scrambling the appearance of the stored images. The security feature of Mode C2 would produce significantly more flicker because of the difference between the horizontal sweep and vertical scan rates.
In the third and fourth alternatives (Mode C3 and Mode C4 in
Figures 17 and 18, respectively) the grid is the same as for Mode C2, and each segment therefore consists of either 125 left halves or 125 right halves of the lines. In Mode C3 and Mode C4, however, the segments are not stored in ascending order. Instead, in Mode C3 the left halves of the lines corresponding to two segments SI and S2 are stored as the first and second fields in frame Fl, and the right halves of the lines corresponding to two segments S5 and S6 are stored as the first and second fields in frame F2.
The remaining segments S3, S4, S7, S8 are similarly stored as frames F3 and F4.
In Mode C4, the left halves of the lines corresponding to two segments SI and S2 are stored as the first and second fields in frame Fl, and the left halves of the remaining lines corresponding to segments S3 and
S4 are stored as the first and second fields in frame F2. The right halves of the lines corresponding to segments S5 and S6 are stored as frame F3, and the right halves of the lines corresponding to segments S7 and S8 are stored as frame F4.
Modes C3 and C4 have the advantages of allowing the direct display of a quadrant (two adjacent segments) of the image on a conventional sequential scan (non-interlaced) monitor, and in the event of discrepancies in or uncertainty about the information in the overlapping regions between quadrants, the adjacent quadrants may be viewed separately for comparison. Mode C3 presents the disadvantage of requiring a one frame delay in order to seam the quadrants properly, and Mode C4 requires a two frame delay. Mode C3 is therefore more expensive than Mode C2, and
Mode C4 more expensive than Mode C3. Mode C4 may provide an advantage in simultaneously viewing two vertically adjacent quadrants which represent a strip of an electronic image or tangible document which has a extremely long length equivalent to a continuous roll of paper. In the second alternative (Mode C2) is to place each half of the stretched line sequentially one after another. The first vertical block or field would therefore have 256 lines of active video comprising 128 first halves alternating with 128 second halves. This continues for 8 blocks or fields, at which point 4 frames have been stored. To retrieve an image stored in this mode, the added sync signals are removed and the second halves are delayed and joined to form continuous lines having a 12 Mhz bandwidth. When an image is retrieved in Mode B, the blocks or segments
corresponding to adjacent lines will seam together naturally because the separation between blocks is equivalent to a normal horizontal or vertical synchronization pulse. In the case of line segments, the top quadrants will seam together with their adjacent bottom quadrants, however a more complex seaming technique is preferably utilized between horizontally adjacent quadrants.
One technique for seaming horizontally adjacent quadrants is overscanning, in which the first halves each line segment extend 2% beyond the midpoint of the individual line segment to include a leading portion of the second half of the same line (in another segment and possibly in another frame), and the second halves begin 2% before the midpoint to include a trailing portion of the first half of the same line (also in another segment and possibly in another frame). The overlapping or redundant information may be compared in dc or ac content, time, and amplitude to match the seam, with servo loops being employed to provide the necessary degree of precision required in the manner discussed below. Higher frequency content and increasing grayscale depth will dictate the type of servo loops used. "Mode N" Operation
Mode N refers generally to any operating mode which employs one or more capture devices 32 to capture, dissect, and seam together or reconstitute an electronic image corresponding to a source document larger than a basic US letter-size page at "normal" resolution, or to a source document of any size that is captured and stored as more than four frames and more than eight segments. It may be readily appreciated from this discussion that it various embodiments may be designed around the use of a single capture device 32 with the source document being moved or advanced to present different regions that would correspond to different segments of a larger electronic image or document, or that several capture devices 32 could be utilized as shown in Figures 10 or 12, either with or without movement or advancing the source document. A line-array type capture device 32 as shown in Figure 13 may be more practical for some continuous feed applications in which the documents have a fixed width but variable length.
In some applications, such as the example provided above relating to negotiable instruments or checks, an array of two capture devices 32 such as shown in Figure 11 are utilized to capture an images relating to the front and back faces of the source document, and those two images are subsequently placed together as a single half-page segment or frame. It may also be appreciated that several segments from several different capture devices 32 can be seamed together without regard to whether each
of the segments represents a portion of a larger source document, thus allowing new documents to be created by assembling segments of other images together as though reconstituting and original electronic image.
Seaming and Image Control Signals
The raster synchronization discussed above that is added to the analog signal in order to define frames corresponding to the selected storage medium is a conventional format that may be recognized by commercial and consumer video equipment, however such a format is only a "coarse" timing reference compared to the degree of accuracy or precision necessary to dissect and reconstitute electronic image documents and still maintain the requisite level of qualitative integrity for the informational content described.
The vertical and horizontal synchronization pulses embedded in standard RS-170 formatted signal (used with standard television display and recording) are unsuitable for seaming adjacent segments of an electronic image. Four types of image control signals are therefore utilized with the embodiments of the system 10 disclosed herein.
The first two sets of signals are the horizontal and vertical raster synchronization pulses (and corresponding blanking intervals) corresponding to the camera output and frame formats discussed above. Referring to Figure 14a, a 50 microsecond sampling of a 12 Mhz information signal 118 is shown bracketed by a pair of 13.5 microsecond blanking intervals 120 and a pair of 5 microsecond negative-going synchronization pulses 122. The line thus has a duration of approximately 63.5 microseconds. When digitized or quantitized at a 31 Mhz conversion clock rate this produces a
50 microsecond digital signal as shown in Figure 14b, which may be segmented and stretched into two halves which are each 51.5 microseconds in length by reading from the memory buffer 60 at 15.5 Mhz, thus producing two spaced-apart signals as shown in Figure 14c and an intervening dead zone 124. The two spaced-apart signals are converted to analog signals as shown in Figure 14d, with a portion constituting approximately 2% of each half line situated directly adjacent to the dead zone 124 accounting for the overlap 126 created by and utilized for overscanning. The third type of image control signal are calibration pulses 128 embedded as a part of the video signal just before and after the active video portions of the composite signal. The calibration pulses are positive- going pulses inserted immediately before and after the synchronization pulses for each line (or line segment). Each calibration pulse preferably has a width (duration) on the order of 750 nanoseconds and a height
(amplitude) of .35 volts DC when a .714 volt active video signal is utilized. The calibration pulses ensure matching of the DC levels and amplitudes of adjacent segments, incremental gain calibration between adjacent lines (or
line segments) of the image and against a set level for each line throughout the subject image and prior or subsequent images, and also provide an intermediate timing reference that has a resolution greater than the conventional synchronization signals but less that the pilot signal.
Gain calibration is accomplished by subtracting black from gray, with true black being clamped at zero. If a calibration pulse is read at .4 V, for example, a servo correction brings that line down to .35 V to provide an accurate gray level for each "pixel" within the line. The calibration pulse at the end of any line may be directly compared with the calibration pulse at the beginning of any adjacent line along the corresponding seam. Any divergence from the normal calibration amplitude results in shifting the level of the corresponding line so that each line exactly matches the adjacent lines and is set relative to a fixed base level, and the servo loops used for the calibration adjustments are therefore completely independent of informational content in the image.
It may be appreciated that the calibration pulses 128 provide reference to a predetermined "absolute gray" that also corresponds to a similar value for monitors and other devices, with the focus of the embodiments discussed being on a predetermined area of interest or range of grayscale levels that are commonly encountered in tangible source documents of the type used for business records, financial transactions, and so forth. The amplitude of the calibration pulses 128 may be set at any desired value to provide control over the location of the examining area within the entire grayscale range by shifting the median grayscale of the image upward or downwardly compared to an "absolute gray" value expected by the monitor or other device, while still permitting "on the fly" correction around the calibration pulses 128 for line-to-line nd segment-to- segment precision.
A conventional negative-going synchronization pulse 130 is then inserted between the calibration pulses 128, as shown in Figure 14f. The fourth type of image control signal is a low level (CW) pilot signal 132 or carrier tone that extends continuously throughout the stored analog signal, is synchronous with the calibration pulses 128, and is harmonically related to the clock speed. The pilot signal 132 must be high enough frequency to permit harmonization with all other synchronizing or timing signals and pulses, and therefore compatible with all divisors of the main system clock rate, and is preferably at or near one half of the write clock frequency. The pilot signal 132 should also be a frequency just above the predetermined bandwidth of the storage medium, but sufficiently distinguishable that a bandpass filter can be used to strip the pilot signal 132 without clipping active video content 118 from the signal. Since the operational spectrum for conventional laser disc medium falls off rapidly above the 6 Mhz bandwidth, a low level pilot signal 132 on the order of 6.89 Mhz has proven suitable for use with conventional LDRs, and may be
filtered out prior to display of the electronic image to prevent visual disruption of the displayed image. The pilot signal 132 therefore provides many times more vernier than the standard synchronization pulses for time- based corrections in positioning and aligning adjacent segments of the image when seaming those segments together along horizontal seam lines (parallel with raster lines) or vertical seam lines (perpendicular to raster lines). The pilot signal 132 is also necessary to provide a time-based correction capability to compensate for timing errors in conventional LDRs, and the use of the recovered pilot signal 128 which is retrieved as a part of the stored signal to generate the write clock as data is written to the memory buffer 60 allows the use of this modality in connection with other storage and communications systems that produce time-based errors or which do not regulate absolute timing relative to an external reference or source.
When the pilot signal 132, calibration pulses 128, and synchronization pulses 130 of Figures 14e-14g are summed with the active signal portion of Figure 14d, a composite analog waveform 134 results. As shown in Figure 14h, that waveform generally follows and oscillates about the summed control signals 128, 130, 132.
To reconstitute the image, the composite signal 134 of Figure 14h is retrieved from the storage medium, and a square wave from the write clock at 15.5 Mhz (derived from a recovered 6.89 Mhz pilot signal) is used to quantitize or digitize the signal and write the signal to the memory buffer
60 in the same form as shown in Figure 14c. The "left hand" segment of the digitized signal is delayed to overlap with the "right hand" segment, and the two segments are seamed together as shown in Figure 14b, and the digital array is converted to an analog signal with raster synchronization and blanking intervals added as shown in Figure 14a, thus permitting the storage, transmission, or display of the electronic image. In the four versions of Mode C operation, the delay will be a line, field, or frame delay depending upon the mode.
For an 8-bit grayscale image, the processed signal does not correspond to a 1:1 quantization that would produce a true 256 level grayscale range for the electronic image. Instead, it has proven suitable in the embodiments discussed to incorporate an approximately 20% margin to provide overhead for calibration adjustments and offset. As such, the effective grayscale range would be on the order of 200 to 210 levels, which accommodates the vast majority of interactive document processing applications including high resolution medical imaging for X-rays and MRIs„and is state-of-the-art for commercially available LDRs. Applications requiring enhanced grayscale differentiation may result in sacrificing a portion of the margin, or increasing the bit depth of the system. Transmission Pathways
The transmission of an electronic image as an analog signal provides significant improvement in transmission rates compared with even the fastest conventional digital transmission by modem or facsimile or over network lines. However, it may be appreciated that the segmenting of the electronic image in the memory buffer 60 and conversion to a resultant analog signal of appropriate bandwidth permits additional increases in transmission rates over conventional transmission pathways having limited bandwidths, as well as high speed transmission pathways having larger bandwidths.
It is important to note when considering conversion of an analog signal for transmission that the parameters for transmission over a digital transmission pathway are traditionally specified in Mhz clock speeds. According to the Nyquist theorem, a perfect system free of filtering imperfections would permit the transmission of an analog signal having a frequency (R) referred to as the Nyquist frequency at no less than twice (2R) the clock rate which is referred to as the sampling or Nyquist rate. In the preferred embodiments discussed above, the Nyquist frequency of the analog signal from the capture device 32 and from the initial digital-to- analog conversion is on the order of 12 Mhz, whereas the sampling rate uses a 31 Mhz clock rate. Consequently, this produces a Nyquist ratio of approximately 2.6 between the clock rate and analog Nyquist frequency. This conversion ratio also provides an estimate for the effective analog bandwidth that may be allotted to a specific digital pathway. As such, if one were transmitting a 12 Mhz analog signal over a 4 Mhz clock rate transmission pathway in a perfect system (where the Nyquist ratio is 2 and the maximum bandwidth is 2), it would be necessary to either slow the analog signal down by a factor of 6 times and transmit continuously, or divide the signal into six components and transmit in parallel.
Utilizing the system 10 of this invention, it is possible to accomplish either of these processes in a way that is optimal for the particular application and transmission pathway. The actual bandwidth of the analog signal may be reduced to a lower bandwidth that corresponds to a digital clock rate at or below the maximum transmission clock rate of the digital transmission pathway, and then transmitted at that speed (which would be slower than if transmitted at the original bandwidth over a line having the same effective bandwidth or clock speed.) Alternately, the electronic image may be divided into a plurality of segments each having an effective bandwidth corresponding to the maximum transmission clock rate of a particular digital pathway, and then transmitted in parallel and reconstituted. In a transmission pathway having more than one parallel lines or channels (such as a conventional ISDN transmission pathway comprising three parallel channels of which two are allocated for digital transmission), the segments of the electronic image in the memory buffer 60 can be read in parallel and transmitted simultaneously on the separate
digital channels or lines. Again, the bandwidth of the analog signal for each channel is optimized according to the operating parameters of that channel.
Subsequent frequency conversion of the type obtained using a line multiplexer may also be applied in applications such as fiber-optic transmission, permitting a multiplicity of segments of an electronic image to be transmitted simultaneously. The analog signal may also be divided accordingly and transmitted over an analog transmission pathway at the maximum bandwidth permitted. In their simplest embodiments, the high speed network 28 and transmission pathway 26' are broadband cables capable of transmitting television-type signals, utilizing a conventional handshake recognition and latch to lock out non-requesting nodes from the communication procedure once a request is received by the mainframe or controller and an instruction to retrieve and transmit an image is received and completed by the electronic image server 30 and mass storage device 34. Image requests, sequencing or cataloging information, and ready-state or other control signals may be transmitted over a conventional digital network such as a Novell or Ethernet system. Because the transmission bandwidths and number of available channels or pathways are fixed for conventional communications networks, the system 10 may be optimized to permit transmission on these existing communication lines, including satellite and microwave transmission, multichannel RF television, as well as transmission over home-broadcast cable television systems. The transmission operation is also completely compatible with and transparent to any conventional communications- related security technology, such as those employing modulated line scrambling devices and signal encryption algorithms.
It may be readily appreciated that the various embodiments and modes of operation discussed above constitute only representative examples of the optimization of the disclosed method to: (1) a specific size and type of source document; (2) a particular operating environment; (3) a predetermined level of informational content or resolution for the electronic image; and (4) the utilization of selected devices and equipment for initial image capture, CPU bus and interface, storage medium, and transmission pathways based upon existing commercial availability and cost. It is understood that the systems for practicing the disclosed method may be optimized according to many different parameters beyond informational content and processing time, however it is expected that these two parameters will remain most significant for practical commercial applications. It is further understood that many factors will affect the design of alternate modes of operation or further embodiments of the system, such as: the selection of alternate devices or equipment; the continuing refinement and introduction of new capture, storage, and transmission technologies; the operational guidelines imposed for
accomplishing specified tasks for certain applications; the nature and limitations of the operating environment; the modifications or adaptations involved in applying this method to electronic content; the transition between different television, video, and communications standards in this and other countries; as well as the peculiar emphasis that individuals or users may be placed on etherial considerations such as cost, complexity, security, or other aesthetic values affecting basic design features.
While the preferred embodiments of the above electronic document transmission, storage, and retrieval system 10 has been described in detail with reference to the attached drawing Figures, it is understood that various changes and adaptations may be made in the electronic document transmission, storage, and retrieval system 10 without departing from the spirit and scope of the appended claims.
What is claimed is:

Claims

1. A method for the transmission or storage and retrieval of a two- dimensional electronic image expressible as a digital array or bitmap for the purpose of interactive document processing, said method being utilized in association with a transmission pathway operatively connected to a remote location or a storage device having a storage medium, said method comprising the steps of: writing at least a portion of the digital array or bitmap corresponding to the two-dimensional electronic image to an output memory; reading said digital content from said output memory; converting said digital content to a first analog signal as said digital content is read from said output memory; adding a plurality of image control signals to said first analog signal to define a format, said format defining a frame; selectively transmitting said first analog signal over the transmission pathway to the remote location or storing said first analog signal as at least one said frame on the storage device, the storage device being capable of receiving and storing said first analog signal on the storage medium along with a multiplicity of like frames, the storage device further being capable of randomly accessing and selectively retrieving and outputting a separate analog signal corresponding to said first analog signal stored as at least one said frame from among said multiplicity of like frames, said separate analog signal including said plurality of image control signals; receiving the transmission of said first analog signal including said plurality of image control signals at the remote location, or retrieving said separate analog signal including said plurality of image control signals from the storage device; stripping said plurality of image control signals from said first analog signal at the remote location or from said separate analog signal retrieved from the storage device; converting said first analog signal transmitted to the remote location or said separate analog signal retrieved from the storage device to a digital signal; writing said digital signal to an input memory such that the digital array or bitmap corresponding to the two-dimensional electronic image is reconstituted in said input memory, whereby the electronic image may subsequently be utilized in one or more document processing operations including the transformation, presentation, representation, transmission, or storage and retrieval of the electronic image.
2. The method of claim 1 wherein the plurality of image control signals includes a plurality of raster synchronization pulses and corresponding blanking intervals, at least one pilot signal, and at least one set of calibration pulses.
3. The method of claim 2 wherein the storage medium has a predetermined bandwidth and wherein the frequency of the pilot signal is at or slightly above said predetermined bandwidth of the storage medium.
4. The method of claim 3 wherein the predetermined bandwidth of the storage medium is on the order of 6 Mhz and the pilot signal is on the order of 7 Mhz.
5. The method of claim 2 wherein the pilot signal is a continuous signal which extends through the first analog signal and throughout the separate analog signal.
6. The method of claim 2 wherein the format defining the frame is a raster composed of N scanning lines at a predetermined scan rate, each of said scanning lines having an active portion corresponding to an informational content of the two-dimensional electronic image, and further wherein the at least one set of calibration pulses include a first calibration pulse inserted before the active portion of each of the scanning lines and a second
calibration pulse inserted after the active portion of each of the scanning lines.
7. The method of claim 6 wherein the first calibration pulse and the second calibration pulse each have a duration and an amplitude, such that said amplitude of the first calibration pulse of a first scanning line may be compared with either said amplitude of the first calibration pulse or said amplitude of the second calibration pulse of a like scanning line or with a fixed amplitude.
8. The method of claim 7 wherein each of the scanning lines has a gain associated therewith, and wherein said gain of a selected scanning line may be adjusted in response to a comparison between the first calibration pulse of said selected scanning line and the second calibration pulse of a like scanning line or with a fixed amplitude.
9. The method of claim 7 wherein the duration of the first calibration pulse and the second calibration pulse is on the order of 750 nanoseconds.
10. The method of claim 7 wherein the amplitude of the first calibration pulse and the second calibration pulse is on the order of .35 volts.
11. The method of claim 2 wherein the at least one set of calibration pulses provides an intermediate timing reference that has a resolution greater than the plurality of raster synchronization pulses and corresponding blanking intervals and less than the pilot signal.
12. The method of claim 1 wherein the first analog signal has an initial bandwidth, and wherein the method further comprises the steps of: ^ converting the initial bandwidth of the first analog signal to a resultant bandwidth prior to storing or transmitting the first analog signal; and converting said resultant bandwidth to the initial bandwidth subsequent to retrieving the separate analog signal or receiving the first analog signal.
13. The method of claim 1 wherein the initial bandwidth is on the order of 12 Mhz or greater and the resultant bandwidth is on the order of 6 Mhz or less.
14. The method of claim 1 wherein the digital array or bitmap corresponding to the two-dimensional electronic image is composed of X lines, and wherein the format defining the frame is a raster composed of N scanning lines at a predetermined scan rate.
15. The method of claim 14 wherein the frame is composed of X/2 lines,
and a time interval dictated by a quantity of 2N-X excess scanning lines and the predetermined scan rate is utilized for containing the plurality of image control signals.
16. The method of claim 15 wherein X is on the order of 1024, N is on the order of 525, and the predetermined scan rate is on the order of 60 hz.
17. The method of claim 1 wherein both the output memory and the input memory are defined by one semiconductor memory.
18. The method of claim 1 wherein the method further comprises the step of: sectioning the digital array or bitmap corresponding to the two- dimensional electronic image into a plurality of segments prior to or during the step of writing the digital content to the output memory.
19. The method of claim 18 wherein the number of the frames is one, and the number of the plurality of segments is two.
20. The method of claim 18 wherein the number of the frames is two, and the number of the plurality of segments is four.
21. The method of claim 20 wherein the digital array or bitmap corresponding to the two-dimensional electronic image is composed of X lines, and wherein each segment corresponds to a block of X/4 adjacent lines.
22. The method of claim 21 wherein the plurality of segments includes a first segment, a second segment, a third segment, and a fourth segment, said first segment being adjacent to said second segment and said third segment being adjacent to said fourth segment, and wherein the number of the frames includes a first frame and a second frame, said first segment and said second segment being stored in said first frame and said third segment and said fourth segment being stored in said second frame.
23. The method of claim 18 wherein the portion of the digital array or bitmap is written to the output memory at a write speed, and the digital content from the output memory is read at a read speed, said read speed being generally equal to one half said write speed.
24. The method of claim 23 wherein the number of the frames is four, and
the number of the plurality of segments is eight.
25. The method of claim 24 wherein the digital array or bitmap corresponding to the two-dimensional electronic image is composed of X lines, and wherein each one of the plurality of segments corresponds to X/8 lines.
26. The method of claim 24 wherein the digital array or bitmap corresponding to the two-dimensional electronic image is composed of X lines, each of said lines having a first half and a second half, and wherein each one of the plurality of segments corresponds to X 8 of said first halves of said lines or X/8 of said second halves of said lines.
27. The method of claim 26 wherein the plurality of segments includes a first segment, a second segment adjacent to said first segment, a third segment adjacent to said first segment, a fourth segment adjacent to said third segment and said second segment, a fifth segment adjacent to said third segment, a sixth segment adjacent to said fifth segment and said fourth segment, a seventh segment adjacent to said fifth segment, and an eighth segment adjacent to said seventh segment and said sixth segment, each of said first segment, said third segment, said fifth segment, and said seventh segment being composed of X/8 of the first halves, each of said second segment, said fourth segment, said sixth segment, and said eighth segment being composed of X/8 of the second halves, wherein the number of the frames includes a first frame, a second frame, a third frame, and a fourth frame, said first segment and said second segment being stored in said first frame, said third segment and said fourth segment being stored in said second frame, said fifth segment and said sixth segment being stored in said third frame, and said seventh segment and said eighth segment being stored in said fourth frame.
28. The method of claim 26 wherein the plurality of segments includes a first segment, a second segment adjacent to said first segment, a third segment adjacent to said second segment, a fourth segment adjacent to said third segment, a fifth segment adjacent to said first segment, a sixth segment adjacent to said fifth segment and said second segment, a seventh segment adjacent to said sixth segment and said third segment, and an eighth segment adjacent to said seventh segment and said fourth segment, each of said first segment, said second segment, said third segment, and said fourth segment being composed of X/8 of the first halves, each of said fifth segment, said sixth segment, said seventh segment, and said eighth segment being composed of X/8 of the second halves, wherein the number of the frames includes a first frame, a second frame, a third frame, and a fourth frame, said first segment and said second segment being stored in
said first frame, said third segment and said fourth segment being stored in said second frame, said fifth segment and said sixth segment being stored in said third frame, and said seventh segment and said eighth segment being stored in said fourth frame.
29. The method of claim 28 wherein the first frame and the second frame are located in sequence and adjoining one another on the storage medium.
30. The method of claim 28 wherein the first frame and the third frame are located in sequence and adjoining one another on the storage medium.
31. The method of claim 18 wherein the method further comprises the step of: seaming the plurality of segments together prior to or during the step of writing the corresponding digital content to the input memory such that the digital array or bitmap corresponding to the two-dimensional electronic image is reconstituted in the input memory.
32. The method of claim 31 wherein the digital array or bitmap corresponding to the two-dimensional electronic image is composed of a plurality of lines, an individual line of said plurality of lines including a first half and a second half, and wherein seaming the plurality of segments together comprises: reading either the first half of said individual line plus a leading portion of said second half of said individual line or said second half of said individual line plus a trailing portion of said first half of said individual line; comparing said leading portion of said second half of said individual line with said trailing portion of said first half of said individual line to determine an offset between said first half and said second half of said individual line; and adjusting said first half or said second half to eliminate said offset.
33. The method of claim 32 wherein the leading portion and the trailing portion of the individual line are disposed in two different ones of the plurality of segments and in one of the frames.
34. The method of claim 32 wherein the leading portion and the trailing portion of the individual line are disposed in two different ones of the plurality of segments and two different ones of the frames.
35. The method of claim 1 wherein the two-dimensional electronic image is captured from a tangible document and converted to the digital array or bitmap, said method further comprising the steps of: capturing an initial image in a capture device, said initial image corresponding to a camera raster composed of X scanning lines having a predetermined scan rate, said capture device producing an analog output signal corresponding to sequentially outputting said X scanning lines at one half said predetermined scan rate, said analog output signal including a camera raster synchronization; stripping said camera raster synchronization from said analog output signal; converting said analog output signal to a digital input signal; and writing said digital input signal to a capture memory to form the digital array or bitmap corresponding to the two-dimensional electronic image, said digital array being composed of 2X lines.
36. The method of claim 35 wherein the analog output signal from the capture device has an initial bandwidth, and wherein the method further comprises the steps of: converting the initial bandwidth of the analog output signal to a resultant bandwidth prior to storing or transmitting the first analog signal; and converting said resultant bandwidth to the initial bandwidth subsequent to retrieving the separate analog signal or receiving the first analog signal.
37. The method of claim 36 wherein the initial bandwidth is on the order of 12 Mhz or greater and the resultant bandwidth is on the order of 6 Mhz.
38. The method of claim 35 wherein the capture device is a camera having a normal operating scan rate for producing the camera raster composed of the X scanning lines having the predetermined scan rate, and wherein the method further comprises the step of: driving the camera at an actual scan rate generally equal to one half the normal operating scan rate.
39. The method of claim 35 wherein the method further comprises the step
of: multiplexing the digital input signal prior to or during the step of writing the digital input signal to the capture memory.
40. The method of claim 35 wherein the capture memory and the input memory are defined by one semiconductor memory,
41. The method of claim 35 wherein the initial image is composed of 1024 pixels in a vertical direction by 1000 pixels in a horizontal direction, and wherein the capture memory is a 1024 by 2048 bit memory.
42. The method of claim 35 wherein the capture memory is composed of two banks of eight 128 kbit memory.
43. An apparatus for the transmission or storage and retrieval of a two- dimensional electronic image existing as a digital array or bitmap in a memory for the purpose of interactive document processing by a user, said apparatus comprising: a computer, said computer including a communications pathway, an electronic image processing interface operatively connected to said communications pathway, and the memory, the memory being operatively connected to said communications pathway; a storage device, said storage device being operatively connected to said electronic image processing interface and including a storage medium capable of receiving and storing an analog signal in a designated form in a predetermined format defining a frame; and said electronic image processing interface being capable of either: selectively storing the two-dimensional electronic image to the storage device by converting the digital array or bitmap in the memory to a first analog signal as said digital content is being read from the memory, and adding a plurality of image control signals to said first analog signal in the predetermined format corresponding to at least one of the frames, or selectively retrieving the two-dimensional electronic image from the storage device by retrieving the at least one of the frames as a separate analog signal including said plurality of image control signals from said storage device, stripping said image control signals from said separate analog signal, converting said separate analog signal to a digital signal, and writing said digital signal to the memory such that the digital array or bitmap
corresponding to the two-dimensional electronic image is reconstituted in the memory.
44. The apparatus of claim 43 wherein the electronic image processing interface is capable of both selectively storing the two dimensional electronic image to the storage device and selectively retrieving the two- dimensional electronic image from the storage device.
45. The apparatus of claim 43 wherein the storage device is operatively connected to the electronic image processing interface through the communications pathway.
46. The apparatus of claim 43 further comprising: a transmission network, said transmission network being operatively connected to the electronic image processing interface.
47. The apparatus of claim 44 wherein the transmission network is capable of transmitting the first analog signal including the plurality of image control signals to a remote location whereby the first analog signal may be received by a second computer having an second electronic image processing interface and a second memory, said second electronic image processing interface being at least capable of stripping said plurality of image control signals from said first analog signal, converting said first analog signal to a digital signal, writing said digital signal to said second memory associated with said second electronic image processing interface such that the digital array or bitmap corresponding to the two-dimensional electronic image is reconstituted in the second memory of the second computer.
48. The apparatus of claim 47 wherein the electronic image processing interface is further capable of sectioning the digital array or bitmap corresponding to the two-dimensional electronic image in the memory into a plurality of segments.
49. The apparatus of claim 48 wherein the transmission network includes a plurality of transmission pathways and each one of the plurality of segments may be transmitted in parallel over said plurality of transmission pathways.
50. The apparatus of claim 48 wherein the transmission network includes at least one transmission pathway having a transmission bandwidth, and wherein the number of the plurality of segments is determined such that the first analog signal corresponding to each of said plurality of segments is within said transmission bandwidth.
51. The apparatus of claim 47 wherein the first analog signal has an initial
bandwidth, and wherein the electronic image processing interface is further capable of converting said initial bandwidth to a resultant bandwidth.
52. The apparatus of claim 51 wherein the transmission network includes at least one transmission pathway having a transmission bandwidth, and wherein the resultant bandwidth is within said transmission bandwidth.
53. The apparatus of claim 46 wherein the transmission network is operatively connected to the electronic image processing interface through the communications pathway.
54. The apparatus of claim 43 wherein the designated form in which the analog signal is stored is on a digital medium such as an optical laser disc.
55. An apparatus for the transmission or storage and retrieval of a two- dimensional electronic image for the purpose of interactive document processing by a user, said apparatus comprising: a first computer, said first computer including a first communications pathway, a first electronic image processing interface operatively connected to said first communications pathway, and a first memory, said first memory being operatively connected to said communications pathway; a second computer, said second computer including a second communications pathway, a second electronic image processing interface operatively connected to said second communications pathway, and a second memory, said second memory being operatively connected to said second communications pathway; a transmission network operatively connecting said first communications pathway of said first computer with said second communications pathway of said second computer; such that said first electronic image processing interface reads the two-dimensional electronic image existing as a first bitmap in said first memory from said first memory as a first digital content, converts said first digital content to a first analog signal, adds a plurality of image control signals to said first analog signal, and transmits said first analog signal to said second computer using said transmission network, and such that said second electronic image processing interface receives said first analog signal, strips said plurality of image control signals from said first analog signal, converts said first analog 28 signal to a second digital content, and writes said second
29 digital content to said second memory as a second bitmap.
PCT/US1993/007968 1992-08-24 1993-08-23 Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain WO1994005113A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU50899/93A AU5089993A (en) 1992-08-24 1993-08-23 Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US93362592A 1992-08-24 1992-08-24
US07/933,625 1992-08-24

Publications (1)

Publication Number Publication Date
WO1994005113A1 true WO1994005113A1 (en) 1994-03-03

Family

ID=25464250

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1993/007968 WO1994005113A1 (en) 1992-08-24 1993-08-23 Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain

Country Status (2)

Country Link
AU (1) AU5089993A (en)
WO (1) WO1994005113A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2282725A (en) * 1993-10-07 1995-04-12 Julien Snell Facsimile information library
WO1995024794A1 (en) * 1994-03-11 1995-09-14 Sietec Systemtechnik Gmbh & Co. Ohg Process and apparatus for electronically filing computer-processed documents
EP1353492A2 (en) * 1996-11-20 2003-10-15 Fuji Photo Film Co., Ltd. System for storing and utilizing picture image data recorded by digital camera

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0007655A1 (en) * 1978-07-20 1980-02-06 EASTMAN KODAK COMPANY (a New Jersey corporation) Method for copying documents using a rotatable recording medium and a recording disc used therefor
EP0122094A2 (en) * 1983-04-08 1984-10-17 Ampex Systems Corporation Electronic still store with high speed sorting and method of operation
WO1990004837A1 (en) * 1988-10-24 1990-05-03 Empire Blue Cross/Blue Shield Method and apparatus for converting documents into electronic data for transaction processing
US5111306A (en) * 1990-04-18 1992-05-05 Olympus Optical Co., Ltd. Endoscope image filing system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0007655A1 (en) * 1978-07-20 1980-02-06 EASTMAN KODAK COMPANY (a New Jersey corporation) Method for copying documents using a rotatable recording medium and a recording disc used therefor
EP0122094A2 (en) * 1983-04-08 1984-10-17 Ampex Systems Corporation Electronic still store with high speed sorting and method of operation
WO1990004837A1 (en) * 1988-10-24 1990-05-03 Empire Blue Cross/Blue Shield Method and apparatus for converting documents into electronic data for transaction processing
US5111306A (en) * 1990-04-18 1992-05-05 Olympus Optical Co., Ltd. Endoscope image filing system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
IBM SYSTEMS JOURNAL, vol.29, no.3, 1990, Armonk, US, page 371-383; H.M. MORRIS et al.: 'Image system communications' *
IMAGE TECHNOLOGY (JOURNAL OF THE BKSTS), vol.72, no.6, June, 1990, London, GB, page 216-219; A. CANNON: 'Storage and management of still pictures and *
MEDICAL PROGRESS THROUGH TECHNOLOGY, vol.18, no.3, 1992, Dordrecht, NL, page 165-179;S.K. MUN et al.: 'An image management and communications (IMAC) system for radiology' *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2282725A (en) * 1993-10-07 1995-04-12 Julien Snell Facsimile information library
WO1995024794A1 (en) * 1994-03-11 1995-09-14 Sietec Systemtechnik Gmbh & Co. Ohg Process and apparatus for electronically filing computer-processed documents
US5940584A (en) * 1994-03-11 1999-08-17 Oce Printing Systems Gmbh Method and apparatus for electronically filing documents prepared by a computer
EP1353492A2 (en) * 1996-11-20 2003-10-15 Fuji Photo Film Co., Ltd. System for storing and utilizing picture image data recorded by digital camera
EP1353492A3 (en) * 1996-11-20 2004-05-12 Fuji Photo Film Co., Ltd. System for storing and utilizing picture image data recorded by digital camera

Also Published As

Publication number Publication date
AU5089993A (en) 1994-03-15

Similar Documents

Publication Publication Date Title
US5502576A (en) Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain
EP0479508B1 (en) Video display apparatus including display device having fixed two-dimensional pixel arrangement
US4210936A (en) Method and apparatus for reproducing an original gray scale image
US4148070A (en) Video processing system
US4754487A (en) Picture storage and retrieval system for various limited storage mediums
US5029228A (en) Image data filing system
US3685039A (en) Video data display system
GB1532752A (en) Apparatus for picture processing
DE2336405A1 (en) METHOD AND DEVICE FOR STORING IMAGE INFORMATION
US4500908A (en) Method and apparatus for standardizing nonstandard video signals
KR930017434A (en) Digital Modulator for Use in Sub-Nyquist Sampling of Raster-Scanned Samples of Image Signal Intensity
Hill Jr et al. Interactive image query system using progressive transmission
EP0351062A1 (en) Method and apparatus for generating composite images
EP0260997B1 (en) Improvements in and relating to the processing of video image signals
WO1994005113A1 (en) Method and apparatus for the transmission, storage, and retrieval of documents in an electronic domain
CA1165912A (en) Facsimile to video converter
EP0336764A3 (en) Pixel and line enhancement method and apparatus
EP0319976A3 (en) Method of and apparatus for recording image in the form of pixel array
DE3337544A1 (en) ADDRESS SIGNAL GENERATION CIRCUIT FOR A MEMORY CIRCUIT
EP0399136B1 (en) Display apparatus
CA1054274A (en) Image digital memory
JPS61285578A (en) Filing system
US5107342A (en) System and a process for recording cartographic information on a videodisk
US4789856A (en) Display apparatus with interface cable for transfering image data to CRT in parallel format
EP0687994B1 (en) Contour-information extraction apparatus and method

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AT AU BB BG BR BY CA CH CZ DE DK ES FI GB HU JP KP KR KZ LK LU MG MN MW NL NO NZ PL PT RO RU SD SE SK UA US VN

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

NENP Non-entry into the national phase

Ref country code: CA