WO2001001670A1 - Recording of information - Google Patents

Recording of information Download PDF

Info

Publication number
WO2001001670A1
WO2001001670A1 PCT/SE2000/001367 SE0001367W WO0101670A1 WO 2001001670 A1 WO2001001670 A1 WO 2001001670A1 SE 0001367 W SE0001367 W SE 0001367W WO 0101670 A1 WO0101670 A1 WO 0101670A1
Authority
WO
WIPO (PCT)
Prior art keywords
coding pattern
information
symbols
information carrier
image
Prior art date
Application number
PCT/SE2000/001367
Other languages
French (fr)
Inventor
Petter Ericson
Original Assignee
Anoto Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from SE9902436A external-priority patent/SE517058C2/en
Application filed by Anoto Ab filed Critical Anoto Ab
Priority to KR1020017016798A priority Critical patent/KR20020033111A/en
Priority to AU60384/00A priority patent/AU752626B2/en
Priority to CA002377187A priority patent/CA2377187A1/en
Priority to MXPA02000110A priority patent/MXPA02000110A/en
Priority to BR0011955-5A priority patent/BR0011955A/en
Priority to EP00946659A priority patent/EP1197065A1/en
Priority to RU2002101922/09A priority patent/RU2002101922A/en
Priority to JP2001506218A priority patent/JP2003503905A/en
Publication of WO2001001670A1 publication Critical patent/WO2001001670A1/en
Priority to HK03100438.7A priority patent/HK1048216A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/047Detection, control or error compensation of scanning velocity or position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/04Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
    • H04N1/10Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces
    • H04N1/107Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using flat picture-bearing surfaces with manual scanning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/024Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof deleted
    • H04N2201/02406Arrangements for positioning elements within a head
    • H04N2201/02439Positioning method
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/047Detection, control or error compensation of scanning velocity or position
    • H04N2201/04701Detection of scanning velocity or position
    • H04N2201/0471Detection of scanning velocity or position using dedicated detectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/047Detection, control or error compensation of scanning velocity or position
    • H04N2201/04701Detection of scanning velocity or position
    • H04N2201/04715Detection of scanning velocity or position by detecting marks or the like, e.g. slits
    • H04N2201/0472Detection of scanning velocity or position by detecting marks or the like, e.g. slits on or adjacent the sheet support
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/047Detection, control or error compensation of scanning velocity or position
    • H04N2201/04701Detection of scanning velocity or position
    • H04N2201/04734Detecting at frequent intervals, e.g. once per line for sub-scan control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/047Detection, control or error compensation of scanning velocity or position
    • H04N2201/04753Control or error compensation of scanning position or velocity
    • H04N2201/04758Control or error compensation of scanning position or velocity by controlling the position of the scanned image area
    • H04N2201/04787Control or error compensation of scanning position or velocity by controlling the position of the scanned image area by changing or controlling the addresses or values of pixels, e.g. in an array, in a memory, by interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/04Scanning arrangements
    • H04N2201/047Detection, control or error compensation of scanning velocity or position
    • H04N2201/04753Control or error compensation of scanning position or velocity
    • H04N2201/04794Varying the control or compensation during the scan, e.g. using continuous feedback or from line to line

Definitions

  • the present invention relates to a method of electronic recording of information. Furthermore, the invention relates to a product intended to be used in connection with electronic recording of information from an information carrier, which product comprises at least one sheet-shaped portion which is provided with a position- coding pattern. In addition, the invention relates to a computer-readable medium, a system, and a device for recording information. Background of the Invention It often happens that a user has text and images in paper form, but would like to convert them to electronic form in order to be able to process them in a computer or to send them electronically, for example in a fax or an e-mail message. GB 2,288,512 discloses a handheld scanner which can be used for recording images.
  • the scanner comprises a line sensor, two wheels arranged on the ends of the line sensor, and sensors for detecting the rotation of the wheels.
  • the scanner is passed back and forth across an image or a piece of text which the user wishes to record.
  • the relative position of the line sensor is recorded with the aid of the sensors and the wheels.
  • the recorded position is then used to determine where the image data recorded by the line sensor should be stored in an image memory.
  • One drawback associated with the scanner is that it contains moving parts.
  • Another drawback is that the wheels only permit the scanner to be moved in certain directions .
  • the Applicant's O98/20446 describes another type of handheld scanner or reading pen which is intended for selective recording of text. It comprises a light-sensitive area sensor, which is adapted to record images with partially overlapping content. A signal -processing unit utilises the partially overlapping content of the images to put them together into a composite image. OCR software converts the characters in the composite image to character-coded format.
  • This scanner has the advantage that it does not require any moving parts for position determination. However, it is only designed for recording character sequences along one row of text at a time.
  • US 5,852,434 describes an arrangement for recording handwritten text by determining absolute positions on a writing surface.
  • the arrangement comprises a writing surface provided with a position code, a pen-like device with a pen point and a detector capable of detecting the position code, as well as a computer which is capable of determining the position of the device in relation to the writing surface on the basis of the detected position code.
  • a user writes on the writing surface the position code is continuously recorded along the path of pen point with the aid of the detector.
  • the recorded position code is transferred to the computer for analysis. Finally, the result is outputted to a display or a printer.
  • this arrangement is not suitable for recording existing text or images.
  • US 5,852,434 describes three examples of a position code.
  • the position code is made up of dots, each of which is made up of three concentric circles.
  • the outermost circle represents an X-coordinate and the middle circle represents a Y-coordinate .
  • the two outermost circles are divided into 16 parts, which depending upon whether they are filled in or not indicate different numbers. This means that each pair of coordinates X, Y is coded with a dot with a specific appearance .
  • This object is achieved by a method of recording information according to claim 1, a product intended to be used in connection with electronic recording of information according to claim 12, a computer-readable medium according to claim 23, a device according to claim 27, and a system according to claim 29.
  • a method of electronic recording of information from an information carrier comprises the steps of placing a sheet with a position-coding pattern and the information carrier such that one superimposes the other; imaging the infor- mation on the information carrier and the position-coding pattern with the aid of a plurality of partial images; and using the position-coding pattern for putting together the partial images into a composite image of the imaged information.
  • a position-coding pattern is thus applied to the information carrier by placing the position-coding pattern on top of or under the information carrier. Accordingly, the information carrier is not provided with a position-coding pattern from the beginning. Instead, the pattern is applied, temporarily or permanently, at a later stage. This means that any image or text can be recorded with the aid of the position-coding pattern.
  • the position-coding pattern is used for put- ting together the partial images, no special or separate position sensors are required. Moreover, it does not matter in which order or relationship the partial images are recorded because their respective positions are determined by the position-coding pattern. For example, the recordings of the partial images can overlap and the recording can start anywhere on the information carrier. The important thing is that the partial images together comprise all the information which is to be recorded because this makes it possible to put together the partial images into a composite image with the aid of the position-coding pattern. Furthermore, the putting-together of the partial images to a composite image can be carried out efficiently with the aid of the position-coding pattern. It requires much less processing capacity than the putting- together of partial images by means of the partially overlapping contents thereof. Moreover, the accuracy and the predictability of the assembly of the partial images are not dependent on the information per se on the information carrier.
  • the position-coding pattern can be projected as a pattern of light on the information carrier, be copied in a copying machine on to the information carrier or be placed on top of or under the information carrier in any other suitable way.
  • the step of placing comprises placing a sheet with the position- coding pattern on top of or under the information carrier. This way of placing the position-coding pattern is at the moment the easiest and most inexpensive way of placing the position-coding pattern and the information carrier such that one superimposes the other.
  • the sheet with the position-coding pattern is furthermore transparent except for the position-coding pattern and is placed on top of the information carrier.
  • This embodiment makes it possible to image both the information on the information carrier and the position-coding pattern simultaneously in every partial image. Then the position-coding pattern can be used for unambiguously determining a position for the part of information imaged in each partial image so that the par- tial images can be put together without any distortion. It would, however, also be conceivable to record every second time a partial image of only the information on the information carrier and every second time a partial image of only the position-coding pattern.
  • the information and the position- coding pattern may be imaged by electromagnetic radiation of dif- ferent wavelengths and may have different wavelength characteristics.
  • the sheet and the position-coding pattern should, in this embodiment, be transparent to the electromagnetic radia- tion by which the information is imaged, but non-transparent to the electromagnetic radiation by which the position-coding pattern is imaged. If the sheet is placed under the information carrier, the information carrier and the information should, on the other hand, be trans- parent to the electromagnetic radiation by which the position-coding pattern is imaged, and non-transparent to the electromagnetic radiation by which the information is imaged. Since a device for recording information in this embodiment need to be able to send out electromagnetic radiation of different wavelengths, it will be more complex and thus more expensive.
  • the position-coding pattern and the information to be recorded are imaged by different partial images, there will be a displacement between the partial image from which a position is determined and the next (or previous) partial image including the information for which the ' position is used to put together the partial image with other partial images of the information.
  • the method according to the invention comprises the further step of filtering out the position-coding pattern.
  • the final, composite image of the information will essentially constitute an image of the information on the information carrier without the position-coding pattern.
  • the filte- ring out can be carried out in the composite image or, preferably, in the partial images.
  • the filtering out of the position-coding pattern is preferably effected by replacing pixel values representing the position-coding pattern with pixel values which are obtained by averaging pixel values representing the information.
  • the averaging is preferably carried out on pixels located close to the pixel which is to be replaced. In this context, averaging also comprises averaging with weighting of the pixel values .
  • the position-coding pattern can be made up of symbols.
  • the filtering out preferably com- prises the steps of, for each symbol, calculating the average of the pixel values of pixels adjacent to the periphery of the symbol and replacing pixel values representing the symbol with said average of the pixel values.
  • the position-coding pattern makes it possible to put together the images into a composite image of the information.
  • the putting together of the images preferably comprises the substeps of determining one position for each partial image of the information on the basis of the position-coding pattern in the same or adjacent partial image and determining where the partial image of the information should be stored in a memory area on the basis of the determined position.
  • the position obtained from the position-coding pattern represents the location of the same or adjacent partial image on the information carrier it is possible to recreate the information on the information carrier.
  • the partial images will overlap to some degree. This can be used for improving the image: if a pixel in the partial image which is to be stored in the memory area overlaps a pixel in a previously stored image in the memory area, the average of the pixel values of these overlapping pixels is preferably calculated and the previously stored pixel value is replaced with said average .
  • the method comprises the steps of imaging the information on the information carrier with a first resolution, if a first part of the position-coding pattern on the sheet is detected, and imaging the information on the information carrier with a second resolution, if a second part of the position- coding pattern is detected.
  • a user may to some extent select the speed with which the information on the information carrier is recorded, so that a faster recording can be made when a lower resolution is sufficient.
  • the different parts of the position-coding pattern may e.g. be parts with different graphical appearances or parts which code co-ordinates from different co-ordinate intervals or areas.
  • a product designed to be used in connection with electronic recording of information from an information carrier, which product comprises at least one sheet- shaped portion provided with a position-coding pattern which extends across the sheet and codes a plurality of positions on the sheet.
  • the sheet-shaped portion is transparent except for the position-coding pattern, the sheet-shaped portion being adapted to be placed on top of the information carrier for recording information from the same .
  • the product can, for example, consist of the sheet- shaped portion or of a plastic folder, whose front is provided with the position-coding pattern and in which an information carrier in the form of a sheet of paper with text and images can be placed.
  • each position of said plurality of positions is coded by a specific part of the position-coding pattern and each such part of the position-coding pattern also contributes to the coding of adjacent positions.
  • each position is coded with its own individual code or symbol, which is "isolated” from the codes or symbols of the surrounding positions.
  • the position resolution is thus limited by the partial surface occupied by the symbol (s) or code(s) of a position.
  • a specific part of the position-coding pattern is used for coding several positions. In this way, a "floating" transition between positions is obtained, making it possible to increase the position resolution.
  • the position-coding pattern can be any arrangement of lines, figures, surfaces or the like which enable unambiguous coding of positions.
  • the position-coding pattern is preferably made up of a plurality of symbols of at least a first type. In the most basic embodiment there are symbols of the first type only and the positions are coded with the aid of the distance between these symbols.
  • the coding can be binary, the existence of a symbol representing a one and the absence of a symbol representing a zero.
  • the position-coding pattern is made up of a plurality of symbols of a first and a second type or appearance only.
  • Such a pattern can be used for binary coding. It is easy to apply to a surface since the symbols can be very simple, for example consisting of two dots of different colours or diameters. The product having a surface with this pattern is thus easy to manufacture since the information content of each symbol is small. Furthermore, it facilitates image processing.
  • the symbols are preferably uniformly distributed across the surface, making it particularly easy to create and interpret the pattern.
  • each position of said plurality of positions is preferably coded with the aid of a plurality of symbols.
  • the symbols coding a position it is advantageous for the symbols coding a position to be distributed in two dimensions in such a way that the same position resolution can be achieved in two perpendicular directions on the surface.
  • Each of the symbols preferably contributes to the coding of more than one of said plurality of positions. However, there may be edge effects preventing this from being fulfilled in the case of a very few symbols.
  • the position-coding pattern is optically readable so that both the position-coding pattern and the information can be recorded with the same sensor.
  • the pattern should thus be capable of reflecting, emitting or absorbing light. However, the light need not be in the visible range.
  • the pattern may also be fluorescent, the fluorescence being activated by electromagnetic radiation from the device which is used for recording information from the information carrier.
  • the symbols in the pattern can be of any suitable type. They are preferably graphic so that it will not be necessary to carry out character recognition (OCR) rr P. TJ 0 CD TJ cu Hj TJ H- ⁇ 3 H- Hi cr ⁇ rr H rt ⁇ s: ⁇ TJ H ⁇ rt H- ⁇ H-
  • each of said plurality of positions can be defined by a first and a second coordinate which can be determined by means of the part of the position- coding pattern which is located on the associated partial surface, the position-coding pattern representing the address of the location where the first and second coordinates are stored.
  • a position-coding pattern made up in this way requires a great deal of memory space .
  • the position-coding pattern is structured in such a way that the position-coding pattern coding a certain position contains inherent information about that position.
  • the position-coding pattern is preferably based on a first string of symbols, which contains a first predetermined number of symbols and which has the characteristic that if a second predeter- mined, preferably successive, number of symbols are taken from the first string of symbols, the location of these symbols in the first string of symbols is unambiguously determined, the first string of symbols being used for determining the position of the partial image in a first dimension on the information carrier. Since the position code is based on a string of symbols with a finite number of symbols arranged in a predetermined order, it is possible to define a "formula" for determining the position in a first dimension on the surface.
  • the invention thus relates to a computer- readable medium which stores a computer program for recording information, which computer program comprises instructions for processing a plurality of partial images which together comprise the information to be recorded and a position-coding pattern, the processing comprising the step of using the position-coding pattern for putting the partial images of the information together into a composite image of the information.
  • the computer program can be designed to be used in the device which records the information or in another device to which the images are transferred for processing .
  • the computer-readable medium with the computer pro- gram has essentially the same advantages as the above method.
  • the invention relates to a device for recording information, comprising a sensor for recording partial images of an information car- rier and a position-coding pattern; image-processing means for processing the partial images recorded by the sensor, which image-processing means are adapted to use the position-coding pattern in the partial images to determine where each partial image should be stored in a memory area.
  • the invention relates to a system comprising a product and a device of the type described above.
  • the device and the system have essentially the same advantages as the product and the method. Features described above with respect to the method and the product may also be found in the device and the system.
  • the invention can be used for recording information from any type of information carrier on top of which or under which a position-coding pattern can be placed so that both the information on the information carrier and the position-coding pattern can be recorded either simultaneously or in an alternating manner.
  • Fig. 1 is a schematic illustration of an example of a product having a sheet -shaped portion with a position- coding pattern
  • Fig. 2 is a schematic illustration of an example of how the symbols can be designed in one embodiment of the position-coding pattern
  • Fig. 3 is a schematic view of an example of 4x4 symbols that are used to code a position
  • Fig. 4 is a schematic illustration of an embodiment of a device according to the invention.
  • Fig. 5 is a schematic illustration of an example of the order in which partial images can be recorded from an information carrier
  • Fig. 6 is a flowchart showing how partial images are processed
  • Fig. 7 is a schematic illustration of a sheet with a position-coding pattern according to a further embodiment of the invention.
  • Fig. 8 is a schematic illustration of a second embodiment of the device.
  • Fig. 1 shows a part of a transparent sheet 1 having a surface 2 on which an optically readable position-coding pattern 3 has been applied.
  • the sheet 1 can be a part of a product, for example a plastic folder, but in this case the sheet constitutes the entire product.
  • the position-coding pattern 3 is made up of symbols 4 of a first and second type 4a, 4b and more specifically of dots of two different appearances, the dots 4a having a black centre dot with a white ring around it representing
  • the five-bit group thus provides an unambiguous coding of the location in the series .
  • the first five bits in the above number series i.e. 00001, constitute the code for position 0 in the number series
  • the next five bits i.e. 00010
  • the positions in the x-number series as a function of the five-bit groups are stored in a first table. Naturally, position 31 only exists in the 32-bit series. Table 1 below shows the position coding for the example described above.
  • the coding in the Y-direction is based on the same principle.
  • a number series is created, hereinafter called the Y-number series, which consists of p numbers, the series being made up in such a way that if r successive numbers are taken from the series, these r numbers will code the position in the series and thus the position in the Y-direction unambiguously.
  • the numbers in the Y-number series are coded in the pattern on the sheet as a difference between the positions in the X-direction in two rows, which is calculated in a special way.
  • the series are written using the two different sizes of dots.
  • the rows start in different positions in the X-number series. More specifi- cally, one begins two successive rows in such a way that if one determines the difference modulo 32 between two position numbers located one above the other, expresses the difference by means of a five-bit binary number, and takes the two most significant bits of said five-bit binary number, this number shall be the same regardless of where one is in the row.
  • the maximum displacement is 31 positions or bits and the minimum displacement is 0 positions or 0 bits.
  • the displacements along each pair of rows is then within one of the intervals 0-7, 8-15, 16-23, or 24-31 positions/bits.
  • the series are written as follows (expressed as position numbers) :
  • the difference is determined in the above way, it will be 0 between rows 1 and 2, 0 between rows 2 and 3, 1 between rows 3 and 4, and 3 between rows 4 and 5. Take, for example, 26-18 in rows 3 and 4, which equals 8, which is 01000 in binary code. The two most significant numbers are 01. If instead one takes 0 - 23 in the same rows, which modulo 32 equals 9, the two most significant numbers are 01 just like in the previous example. In this example, four difference numbers 0,0,1,3 are obtained.
  • the device translates these five- bit groups into positions with the aid of Table 1. The following positions are obtained: 26 (11010) 26 (11010)
  • the magnitude of the displacement between the position numbers in the different rows is determined by taking the difference modulo 32.
  • the two most significant numbers of the differences determined in this manner expressed as five-bit binary numbers are 0, 1, 0, 0. According to Table 2, this difference number equals position 3 in the Y-direction.
  • the coordinate of the second dimension on the sheet is 3.
  • a third table stores the starting position of each row, i.e. the position in the X-numbers series where each row starts.
  • the y-coordi- nate 3 it is possible to look up the starting positions of the rows from which the recorded five-bit groups have been taken. Knowing the starting positions of the rows from which the two uppermost five-bit groups have been taken and the X-positions to which these two five-bit groups correspond, i.e. positions 26 and 26, it is possible to determine the x-coordinate, or the position in the first dimension, of the recorded image. For example, suppose that the starting positions of the two uppermost rows are 21 and 20 respectively. In this case, the two rows from which the two uppermost five-bit groups in the recorded image are taken will thus look as follows:
  • Row 3 21 22 23....29 30 31 0 1 2...25 26 27..
  • Row 4 20 21 22....28 29 30 0 1 2...25 26 27.. It follows from the fact that the y-coordinate is 3 that the two first five-bit groups are taken from rows 3 and 4. It follows from the fact that odd rows are made up of the 32 -bit number series and even rows are made up of the 31 -bit number series that row 3 is made up of a 32 -bit number series while row 4 is made up of a 31-bit number series .
  • the accuracy of the position determination can be further increased by determining the location of the middle dot in the 5 x 5 group in relation to the centre of the image.
  • the position resolution can thus be better than the distance between two symbols.
  • the position-coding pattern can also be used for determining the position in a third dimension in relation to the surface, i.e. in the Z-direction. This is achieved by determining the size of the symbols in the recorded image and comparing it to a reference value representing the size of the symbols when they are imaged by means of an information-recording device which is held next to the surface on which the position-coding pattern is located. In this way, the device can thus automatically determine whether the device is close to the surface, in which case images shall be recorded, or spaced from the surface, in which case images shall not be recorded, and trigger image recording depending on this.
  • the above description relates to an example and can thus be generalised. There need not be 32 numbers in the first X-number series.
  • the same type of reasoning applies to the Y-number series.
  • the bases of these number series can thus be different and the number of symbols which code a position, and consequently also the number of positions coded by the number series, can vary.
  • the series can be based on symbols other than numbers and can therefore be described as strings of symbols.
  • the symbols can be of many dif- ferent kinds. They can also be numbers, but in that case OCR software is required for carrying out the position determination, which makes the device for image recording more expensive and more complicated. It also leads to increased error sensitivity.
  • OCR software is required for carrying out the position determination, which makes the device for image recording more expensive and more complicated. It also leads to increased error sensitivity.
  • the above method of coding positions on a surface and of carrying out the position determination on the surface is advantageous in that it only requires a very small amount of memory and processor capacity. In the above example, it is only necessary to store Table 1 with 32 rows, Table 2 with 256 rows, and Table 3 with
  • the position determination can be carried out by means of three table look-ups and a simple calculation.
  • the method of coding positions on the surface is also advantageous because the image upon which the position determination is based can be captured at any rotation in relation to the surface upon which the position is to be determined.
  • an image contains a number of rows which shall be horizon- tal . This means that there are only four possible orientations. In 98% of cases, only one of the four orientations gives a position. In the cases where there is doubt, it can be removed by recording two adjacent images and determining the positions on the basis of these images at all possible orientations of the symbols in the images, the criterion being that the position determination shall result in two adjacent positions.
  • position determination can also be carried out in ways other than those described above .
  • the recorded image of a partial surface of the posi- tion-coding pattern can be matched with an image of the whole position-coding pattern.
  • this requires a great deal of processor capacity.
  • This second position-coding pattern comprises a virtual raster, which thus neither is visible to the human eye nor can be detected directly by a device which is to determine positions on the surface, and a plurality of symbols 104, which each are capable of assuming one of four values "i"-"4" as will be described below.
  • Figs 2a-d show an embodiment of a symbol which can be used in the position-coding pattern according to the invention.
  • the symbol comprises a virtual raster point 106 which is represented by the intersection between the raster lines, and a marking 107 which has the form of a dot .
  • the value of the symbol depends on where the marking is located. In the example in Fig. 2, there are four possible positions, one on each of the raster lines extending from the raster points. The displacement from the raster point is equal to all values.
  • the symbol in Fig. 2a has the value 1, in Fig. 2b the value 2, in Fig. 2c the value 3 and in Fig. 2d the value 4. Expressed in other words, there are four different types of symbols.
  • Each symbol can thus represent four values "1-4".
  • This means that the position-coding pattern can be divid- ed into a first position code for the x-coordinate, and a second position code for the y-coordinate .
  • the division is effected as follows:
  • each symbol is translated into a first digit, in this case bit, for the x-code and a second digit, in this case bit, for the y-code.
  • the patterns can be combined to a common pattern, which is coded graphically by means of a plurality of symbols according to Fig. 2.
  • Each position is coded by means of a plurality of symbols.
  • the position code is made up by means of a number series of ones and zeros which have the characteristic that no sequence of four bits appears more than once in the series.
  • the number series is cyclic, which means that the characteristic also applies when one connects the end of the series to the beginning of the series .
  • a four-bit sequence always has an unambiguously determined position in the number series.
  • the series can maximally be 16 bits long if it is to have the above-described characteristic for sequences of four bits.
  • This series contains seven unique sequences of four bits which code a position in the series as follows:
  • the number series is written sequentially in columns across the entire surface that is to be coded.
  • the coding is based on the difference or position displacement between numbers in adjoining columns.
  • the size of the difference is determined by the position (i.e. with which sequence) in the number series, in which one lets the column begin. More specifically, if one takes the difference modulo seven between on the one hand a number which is coded by a four-bit sequence in a first column and which thus can have the value (position) 0-6, and, on the other hand, a corresponding number (i.e. the sequence on the same "level") in an adjoining column, the result will be the same independently of where along the two columns one makes the comparison.
  • each position on the surface is coded with 4x4 symbols in this example, three differences (having the value 0-6) as stated above are available to code the x-coordinate. Then the coding is carried out in such manner that of the three differences, one will always have the value 1 or 2 and the other two will have values in the range 3-6. Consequently no differences are allowed to be zero in the x-code.
  • the x-code is structured so that the differences will be as follows: (3-6) (3-6) (1-2) (3-6) (3-6) (1-2) (3-6) (3-6) (1-2)...
  • Each x-coordinate thus is coded with two numbers between 3 and 6 and a subsequent number which is 1 or 2. If three is subtracted from the high numbers and one from the low, a number in mixed base will be obtained, which directly yields a position in the x-direction, from which the x-coordinate can then be determined directly, as shown in the example below.
  • the y-coordinates are coded according to the same principle as used for the x-coordinates.
  • the cyclic number series is repeatedly written in horizontal rows across the surface which is to be position-coded. Just like in the case of the x-coordinates, the rows are allowed to begin in different positions, i.e. with different sequences, in the number series.
  • y-coordinates one does not use differences but codes the coordinates with numbers that are based on the starting position of the number series on each row.
  • the most significant digit is determined by letting this be the only one that has a value in a specific range.
  • this row In this example, one lets one row of four begin in the position 0-1 in the number series to indicate that this row relates to the least significant digit in a y-coordinate, and the other three begin in the position 2-6.
  • y- direction there is thus a series of numbers as follows: (2-6) (2-6) (2-6) (0-1) (2-6) (2-6) (2-6) (0-1) (2-6)...
  • Each y-coordinate thus is coded with three numbers between 2 and 6 and a subsequent number between 0 and 1.
  • Fig. 3 shows an example of an image with 4x4 symbols which are read by a device for position determination.
  • the vertical x- sequences code the following positions in the number series: 2 0 4 6.
  • the position of the uppermost left corner for the 4x4 symbol group is (58,170) .
  • the numbers 0-19 are coded in the mixed base, and by adding up the representations of the numbers 0-19 in the mixed base, one obtains the total difference between these columns.
  • a naive algorithm to do so is to generate these twenty numbers and directly add up their digits. The resulting sum is called s.
  • the sheet of paper or writing surface will then be given by (5-s) modulo7.
  • each position is coded with 4 x 4 symbols and a number series with 7 bits is used.
  • Positions can be coded with a larger or smaller number of symbols.
  • the number of symbols need not be the same in both directions.
  • the number series can be of different length and need not be binary, but may be based on another base. Different number series can be used for coding in x-direction and coding in y-direction.
  • the symbols can have different numbers of values .
  • the marking is a dot but may, of course, have a different appearance.
  • it may consist of a dash which begins in the virtual raster point and extends therefrom to a predetermined position.
  • it may consist of the above-described dot with an inner circle filled with a first colour and an outer circle filled with a second contrasting colour up to the edge of the inner circle.
  • the symbols within a square partial surface are used for coding a position.
  • the partial surface may have a different form, such as hexagonal .
  • the symbols need not be arranged in rows and columns at an angle of 90° to each other but can also be arranged in some other manner.
  • the virtual raster For the position code to be detected, the virtual raster must be determined. This can be carried out by studying the distance between different markings. The shortest distance between two markings must derive from two neighboring symbols having the value 1 and 3 so that the markings are located on the same raster line between two raster points. When such a pair of markings has been detected, the associated raster points can be determined with knowledge of the distance between the raster points and the displacement of the markings from the raster points. When two raster points have once been located, additional raster points can be determined by means of measured distances to other markings and with knowledge of the relative distance of the raster points.
  • a nominal spacing of 0.3 mm between the raster lines has been used. If each position is coded by 6 x 6 symbols, an area of 1.8 mm x 1.8 mm is required for each position.
  • a position can be calculated with a resolution of 0.03 mm.
  • FIG. 4 An embodiment of a device for recording information is schematically shown in Fig. 4. It comprises a casing 11 having approximately the same shape as a pen. In one short side of the casing there is an opening 12. The short side is intended to abut against or be placed a short distance from the information carrier from which information is to be recorded.
  • the casing essentially contains an optics part, an electronic circuitry part, and a power supply.
  • the optics part comprises at least one light-emitting diode (LED) 13 for illuminating the surface which is to be imaged and a light-sensitive area sensor 14, such as a CCD or CMOS sensor, for recording a two-dimensional image, in colour, black and white, or greyscale.
  • the device may also comprise an optical system such as a mirror system or a lens system. It should be noted that the sensor 14 should be designed in such a way that it can capture an image of the information carrier and the superimposed position-coding pattern at the same time.
  • the light-emitting diode may be a IR-diode emitting light of about 880 nm.
  • the power supply to the device is obtained from a battery 15, which is mounted in a separate compartment in the casing.
  • the electronic circuitry part comprises image-processing means 16 comprising a processor unit with a processor which is programmed to read a partial image from the sensor, identify the position-coding pattern in the partial image, determine a position on the basis of the identified position-coding pattern, and store the partial image in a location in a memory forming part of the image-processing means which is indicated by the position determined from the position-coding pattern.
  • the device comprises buttons 18 by means of which the user activates and controls the device. It also comprises a transceiver 19 for wireless transfer, e.g. using IR light or radio waves, of information to and from the device.
  • the device can also comprise a display 20 for showing recorded information.
  • the Applicant's Swedish patent No. 9604008-4 describes a device for recording text. This device can be utilised for recording information using the method according to the invention if programmed in a suitable way.
  • the device can be divided into different physical casings, a first casing containing components required for capturing images of information carrier with the superimposed position-coding pattern and for transferring them to components which are located in a second casing and which carry out the position determi- nation and the storing of the images in the memory. Operation
  • a user has an information carrier in the form of a sheet of paper with text and an image which he wishes to send in an e-mail message to another person.
  • he places the above-mentioned transparent sheet 1 with the first position-coding pattern 3 (example 1) on top of the sheet of paper.
  • he turns on the above-mentioned device for recording information, places the device so that the opening 12 abuts against the information carrier and passes the device back and forth across the area on the information carrier containing the text and the image which he wishes to record. It is important for the user to "scan" the whole area which is of interest to him so that the partial images recorded by the device together cover the whole area. However, as will be seen below, it does not matter if several partial images cover the same area.
  • Fig. 5 schematically shows an example of how partial images can . be recorded from an information carrier.
  • the information on the information carrier is shown as a sun and a cloud in broken lines.
  • Partial images 30-33 are recorded in such a way that they overlap using a left-to-right motion.
  • the user lifts the device and puts it down slightly to the right of partial image 33, after which partial images 34-39 are recorded using a back-and-forth motion.
  • the user continues to pass the device across the information carrier until the whole area that he wishes to record has been scanned.
  • the device records images at a predetermined frequency, the LED 13 generating strobe pulses at the same frequency, e.g. 100 Hz.
  • the sensor When the sensor has recorded a partial image it is read by the image-processing means 16 and is processed immediately or subsequent to buffering in the memory.
  • the partial images are preferably recorded at a frequency such that they partially overlap, making it easier to scan the area from which information is to be recorded.
  • Each recorded image is processed as follows by the software in the device, see the flowchart in Fig. 6. First, a partial image is fetched, step 40. This image is scanned, step 41, in a first pass where the processor searches for symbols 4a having a black centre dot with a white ring around it. When it has found the first such dot the searching becomes simpler because it knows the distance between the dots in the position-coding pat- tern.
  • the partial image is scanned again, step 42, in a second pass where the processor searches for symbols having a white centre dot with a black ring around it.
  • An identified position of a black dot can be used as a starting-point for this search, the processor again utilising the known distance between the dots.
  • the processor determines, in the above manner, which position the position-coding pattern in the partial image represents, step 43.
  • the position can be indicated as a pair of co-ordinates.
  • the rotation of the partial image in relation to the information carrier can be determined based on knowledge of the arrangement of symbols in the position-coding pattern.
  • the position of the partial image can be determined more exactly by determining the position of the position-coding pattern on the sensor.
  • step 44 the position-coding pattern is filtered out of the partial image. This is effected by the processor determining, for each dot forming part of the position-coding pattern, the value of the pixels closest to the periphery of the dot. The processor then restores the image by replacing, for each symbol, i.e. dot, all the pixels in the partial image which constitute the dot with the average of the pixel values of the pixels adjacent to the periphery of the dot. Alternatively, the processor can replace sectors in the dot with pixels with the average of the pixel values of the pixels adjacent to the sector arc.
  • the partial image is stored, step 45, in a location in the memory which is determined by the position coordinates.
  • the partial image completely or partially overlaps a previously stored partial image.
  • the average value of overlapping pixels is calculated and the average value is stored in the location for each overlapping pair of pixels .
  • the location in the memory where the partial image is stored need not be determined exclusively on the basis of the position co-ordinates. More particularly, the position coordinates can be used for carrying out a rough positioning, whereas a fine positioning is carried out by registering (aligning) the partial image with previously stored partial images by using the overlapping content of the partial images.
  • the memory contains a composite digital image of the area on the information carrier which has been scanned using the device.
  • This digital image can be incorporated into a fax, a document, an e-mail message, or the like.
  • the image could also be used as an input signal to OCR or ICR software which interprets the text in the image and stores it in character-coded format.
  • the stored partial images can be shown on the display 20 in order to help the user see the areas on the information carrier which he has not covered.
  • a pixel on the display 20 may correspond to a certain area on the transparent sheet and be turned on as soon as the corresponding area has been covered.
  • the information recorded from the information carrier can be displayed on a screen of a stationary computer to which the partial images are sent successively so that the user can see how the composite image of the information on the information carrier develops .
  • the information and the position-coding pattern are recorded simultaneously with the aid of the electromagnetic radiation from one or more LED.s.
  • the pattern and the information can be recorded in an alternating manner such that every second partial image comprises the pattern and every second partial image the information.
  • the information and the pattern must be recorded by electromagnetic radiation of different wavelengths.
  • This embodiment has the advantage that the position-coding pattern may be placed under the information carrier and thus need not be transparent. Another advantage is that there is no position-coding pattern in the partial images of the information that need to be filtered out.
  • Fig. 7 shows an embodiment according to which information can be recorded with different resolution.
  • the sheet 70 in Fig. 7 has a large image recording area 71 covered by a position-coding pattern like in Fig. 1 (for ease of illustration, the coding pattern is only showed by some dots) , and two small resolution- indicating boxes 72,73, which are also covered by a position-coding pattern.
  • the pattern in the boxes codes specific co- ordinates, which have been dedicated for the indication of different degrees of resolution.
  • the user wants to record information with a 100 dpi resolution he puts the recording device in box 71.
  • the device recognises the co-ordinates coded by the pattern in box 71 as indicating a resolution of 100 dpi and then carries out the recording with this resolution.
  • Fig. 8 shows schematically an alternative embodiment of the device for recording information, where the sensor for recording partial images is accomodated in a first casing 80 and the image-processing means are accomodated in a second casing 81.
  • the first casing can be the same as that shown in Fig. 4 and include substantially the same components.
  • the recorded partial images are not processed in the first casing 80 but transferred to the second casing 81, e.g. a stationary personal computer which has image-processing means 82, schematically shown with broken lines, for carrying out the processing of the recorded partial images.

Abstract

In a method of electronic recording of information from an information carrier, a position-coding pattern (3) is placed on top of or under the information carrier. The information on the information carrier and the position-coding pattern (3) are imaged with the aid of a plurality of partial images. The position-coding pattern is used to determine where the partial images should be stored in a memory area. The partial images in the memory area together constitute an image of the information on the information carrier. The position-coding pattern is filtered out of the partial images. A product, a device, and software used for implementing the method are also described.

Description

RECORDING OF INFORMATION
Field of the Invention
The present invention relates to a method of electronic recording of information. Furthermore, the invention relates to a product intended to be used in connection with electronic recording of information from an information carrier, which product comprises at least one sheet-shaped portion which is provided with a position- coding pattern. In addition, the invention relates to a computer-readable medium, a system, and a device for recording information. Background of the Invention It often happens that a user has text and images in paper form, but would like to convert them to electronic form in order to be able to process them in a computer or to send them electronically, for example in a fax or an e-mail message. GB 2,288,512 discloses a handheld scanner which can be used for recording images. The scanner comprises a line sensor, two wheels arranged on the ends of the line sensor, and sensors for detecting the rotation of the wheels. The scanner is passed back and forth across an image or a piece of text which the user wishes to record. The relative position of the line sensor is recorded with the aid of the sensors and the wheels. The recorded position is then used to determine where the image data recorded by the line sensor should be stored in an image memory. One drawback associated with the scanner is that it contains moving parts. Another drawback is that the wheels only permit the scanner to be moved in certain directions .
The Applicant's O98/20446 describes another type of handheld scanner or reading pen which is intended for selective recording of text. It comprises a light-sensitive area sensor, which is adapted to record images with partially overlapping content. A signal -processing unit utilises the partially overlapping content of the images to put them together into a composite image. OCR software converts the characters in the composite image to character-coded format. This scanner has the advantage that it does not require any moving parts for position determination. However, it is only designed for recording character sequences along one row of text at a time.
US 5,852,434 describes an arrangement for recording handwritten text by determining absolute positions on a writing surface. The arrangement comprises a writing surface provided with a position code, a pen-like device with a pen point and a detector capable of detecting the position code, as well as a computer which is capable of determining the position of the device in relation to the writing surface on the basis of the detected position code. When a user writes on the writing surface the position code is continuously recorded along the path of pen point with the aid of the detector. The recorded position code is transferred to the computer for analysis. Finally, the result is outputted to a display or a printer. However, this arrangement is not suitable for recording existing text or images.
US 5,852,434 describes three examples of a position code. According to one example, the position code is made up of dots, each of which is made up of three concentric circles. The outermost circle represents an X-coordinate and the middle circle represents a Y-coordinate . Furthermore, the two outermost circles are divided into 16 parts, which depending upon whether they are filled in or not indicate different numbers. This means that each pair of coordinates X, Y is coded with a dot with a specific appearance . Summary of the Invention
It is an object of the present invention to com- pletely or partly obviate the above-mentioned drawbacks of the prior art devices for electronic recording of text and images .
This object is achieved by a method of recording information according to claim 1, a product intended to be used in connection with electronic recording of information according to claim 12, a computer-readable medium according to claim 23, a device according to claim 27, and a system according to claim 29.
More specifically, according to a first aspect of the invention, it relates to a method of electronic recording of information from an information carrier, which method comprises the steps of placing a sheet with a position-coding pattern and the information carrier such that one superimposes the other; imaging the infor- mation on the information carrier and the position-coding pattern with the aid of a plurality of partial images; and using the position-coding pattern for putting together the partial images into a composite image of the imaged information. According to the invention, a position-coding pattern is thus applied to the information carrier by placing the position-coding pattern on top of or under the information carrier. Accordingly, the information carrier is not provided with a position-coding pattern from the beginning. Instead, the pattern is applied, temporarily or permanently, at a later stage. This means that any image or text can be recorded with the aid of the position-coding pattern.
Since the position-coding pattern is used for put- ting together the partial images, no special or separate position sensors are required. Moreover, it does not matter in which order or relationship the partial images are recorded because their respective positions are determined by the position-coding pattern. For example, the recordings of the partial images can overlap and the recording can start anywhere on the information carrier. The important thing is that the partial images together comprise all the information which is to be recorded because this makes it possible to put together the partial images into a composite image with the aid of the position-coding pattern. Furthermore, the putting-together of the partial images to a composite image can be carried out efficiently with the aid of the position-coding pattern. It requires much less processing capacity than the putting- together of partial images by means of the partially overlapping contents thereof. Moreover, the accuracy and the predictability of the assembly of the partial images are not dependent on the information per se on the information carrier.
The position-coding pattern can be projected as a pattern of light on the information carrier, be copied in a copying machine on to the information carrier or be placed on top of or under the information carrier in any other suitable way.
However, in a preferred embodiment, the step of placing comprises placing a sheet with the position- coding pattern on top of or under the information carrier. This way of placing the position-coding pattern is at the moment the easiest and most inexpensive way of placing the position-coding pattern and the information carrier such that one superimposes the other.
In a preferred embodiment the sheet with the position-coding pattern is furthermore transparent except for the position-coding pattern and is placed on top of the information carrier. This embodiment makes it possible to image both the information on the information carrier and the position-coding pattern simultaneously in every partial image. Then the position-coding pattern can be used for unambiguously determining a position for the part of information imaged in each partial image so that the par- tial images can be put together without any distortion. It would, however, also be conceivable to record every second time a partial image of only the information on the information carrier and every second time a partial image of only the position-coding pattern. In this embodiment the information and the position- coding pattern may be imaged by electromagnetic radiation of dif- ferent wavelengths and may have different wavelength characteristics. If the sheet with the position-coding pattern is placed on top of the information carrier, the sheet and the position-coding pattern should, in this embodiment, be transparent to the electromagnetic radia- tion by which the information is imaged, but non-transparent to the electromagnetic radiation by which the position-coding pattern is imaged. If the sheet is placed under the information carrier, the information carrier and the information should, on the other hand, be trans- parent to the electromagnetic radiation by which the position-coding pattern is imaged, and non-transparent to the electromagnetic radiation by which the information is imaged. Since a device for recording information in this embodiment need to be able to send out electromagnetic radiation of different wavelengths, it will be more complex and thus more expensive. Furthermore, since the position-coding pattern and the information to be recorded are imaged by different partial images, there will be a displacement between the partial image from which a position is determined and the next (or previous) partial image including the information for which the 'position is used to put together the partial image with other partial images of the information.
In a preferred embodiment, the method according to the invention comprises the further step of filtering out the position-coding pattern. In this way, the final, composite image of the information will essentially constitute an image of the information on the information carrier without the position-coding pattern. The filte- ring out can be carried out in the composite image or, preferably, in the partial images. When the position-coding pattern is superimposed on the information on the information carrier it will hide some of the information. In order as far as possible to recreate the original information, the filtering out of the position-coding pattern is preferably effected by replacing pixel values representing the position-coding pattern with pixel values which are obtained by averaging pixel values representing the information. The averaging is preferably carried out on pixels located close to the pixel which is to be replaced. In this context, averaging also comprises averaging with weighting of the pixel values .
The position-coding pattern can be made up of symbols. In that case, the filtering out preferably com- prises the steps of, for each symbol, calculating the average of the pixel values of pixels adjacent to the periphery of the symbol and replacing pixel values representing the symbol with said average of the pixel values. As mentioned above, the position-coding pattern makes it possible to put together the images into a composite image of the information. The putting together of the images preferably comprises the substeps of determining one position for each partial image of the information on the basis of the position-coding pattern in the same or adjacent partial image and determining where the partial image of the information should be stored in a memory area on the basis of the determined position. Since the position obtained from the position-coding pattern represents the location of the same or adjacent partial image on the information carrier it is possible to recreate the information on the information carrier. In most cases, the partial images will overlap to some degree. This can be used for improving the image: if a pixel in the partial image which is to be stored in the memory area overlaps a pixel in a previously stored image in the memory area, the average of the pixel values of these overlapping pixels is preferably calculated and the previously stored pixel value is replaced with said average .
In a preferred embodiment the method comprises the steps of imaging the information on the information carrier with a first resolution, if a first part of the position-coding pattern on the sheet is detected, and imaging the information on the information carrier with a second resolution, if a second part of the position- coding pattern is detected. In this way, a user may to some extent select the speed with which the information on the information carrier is recorded, so that a faster recording can be made when a lower resolution is sufficient.
The different parts of the position-coding pattern may e.g. be parts with different graphical appearances or parts which code co-ordinates from different co-ordinate intervals or areas.
All the steps of the above method with the exception of placing the position-coding pattern on top of or under the information carrier are advantageously carried out "automatically" by a device which records images and which has a processor with software for processing the images as described above .
According to a second aspect of the invention, it relates to a product designed to be used in connection with electronic recording of information from an information carrier, which product comprises at least one sheet- shaped portion provided with a position-coding pattern which extends across the sheet and codes a plurality of positions on the sheet. The sheet-shaped portion is transparent except for the position-coding pattern, the sheet-shaped portion being adapted to be placed on top of the information carrier for recording information from the same . The product can, for example, consist of the sheet- shaped portion or of a plastic folder, whose front is provided with the position-coding pattern and in which an information carrier in the form of a sheet of paper with text and images can be placed.
The advantages of the product are evident from the above discussion of the method. In a preferred embodiment of the invention, each position of said plurality of positions is coded by a specific part of the position-coding pattern and each such part of the position-coding pattern also contributes to the coding of adjacent positions. In the prior art, each position is coded with its own individual code or symbol, which is "isolated" from the codes or symbols of the surrounding positions. The position resolution is thus limited by the partial surface occupied by the symbol (s) or code(s) of a position. However, according to the invention, a specific part of the position-coding pattern is used for coding several positions. In this way, a "floating" transition between positions is obtained, making it possible to increase the position resolution. Furthermore, it is possible to reduce the relation- ship between, on the one hand, the size of the part of the position-coding pattern which must be read in order to enable position determination and, on the other hand, the size of the specific part of the position-coding pattern which codes a position. The position-coding pattern can be any arrangement of lines, figures, surfaces or the like which enable unambiguous coding of positions. However, as mentioned above, the position-coding pattern is preferably made up of a plurality of symbols of at least a first type. In the most basic embodiment there are symbols of the first type only and the positions are coded with the aid of the distance between these symbols. Alternatively, the coding can be binary, the existence of a symbol representing a one and the absence of a symbol representing a zero. How- ever, this type of coding can lead to problems in positions which are coded only or primarily with zeros. In the most preferred embodiment, the position-coding pattern is made up of a plurality of symbols of a first and a second type or appearance only. Such a pattern can be used for binary coding. It is easy to apply to a surface since the symbols can be very simple, for example consisting of two dots of different colours or diameters. The product having a surface with this pattern is thus easy to manufacture since the information content of each symbol is small. Furthermore, it facilitates image processing. Moreover, the symbols are preferably uniformly distributed across the surface, making it particularly easy to create and interpret the pattern.
In order to enable the creation of the pattern from only a few different types of symbols, while still per- mitting coding of a large number of positions, each position of said plurality of positions is preferably coded with the aid of a plurality of symbols. In this case, it is advantageous for the symbols coding a position to be distributed in two dimensions in such a way that the same position resolution can be achieved in two perpendicular directions on the surface.
Each of the symbols preferably contributes to the coding of more than one of said plurality of positions. However, there may be edge effects preventing this from being fulfilled in the case of a very few symbols.
The position-coding pattern is optically readable so that both the position-coding pattern and the information can be recorded with the same sensor. The pattern should thus be capable of reflecting, emitting or absorbing light. However, the light need not be in the visible range. The pattern may also be fluorescent, the fluorescence being activated by electromagnetic radiation from the device which is used for recording information from the information carrier. The symbols in the pattern can be of any suitable type. They are preferably graphic so that it will not be necessary to carry out character recognition (OCR)
Figure imgf000011_0001
rr P. TJ 0 CD TJ cu Hj TJ H- < 3 H- Hi cr Ω rr H rt Ω s: Ω TJ H Φ rt H- Ω H-
0 Φ j 0 l-h c 0 cr 0 H- CU g Φ Φ g H- Φ 0 rr n 0 O rr O Hi rr CQ rr n 0 n cu u CD H{ CD o g Φ rt cu Hi Ω TJ Φ M Φ M H- M φ Φ CO Φ C
LQ M s: H- ft l-h H- e Hi rt CQ ^ Φ 0 Hi o rr rr 0 rt 0 Hi ^ Φ CD M Ω
Φ cr rt rr rr rt CD Φ Φ CD CD H- c Ω rr rr c φ £ Φ 3 CD rr 0
3 0 υ H- φ o H- 0 Hj CD C CD H] φ 0 CD Hi H- cu Φ Hi > Hi s Hi Ω ft ^ cu •n rs
Φ Hh o 0 φ 0 rt rr 3 Φ cu rr P rt Hi rr 0 CD 0 J fu H- TJ C u rs
HJ ? 3 φ 3 rr rt φ C M Hi Φ 0 Ω Φ cυ CD Hi Hi cr 3 cu φ Hi M Φ cu TJ 3 g Φ rr cu Hi M H- s; Hi H c . 3 ^-3 £ φ M - M 0 rt CD Ω rt h rr 0 r c O PJ TJ 3 Φ M J rr rt rr M cu CQ g Hi H- 0 ^ M M rr 0 rt
Φ 0 3" l-h H- CD 0 TJ rt 0 cr ^ cr P- Φ H- cu Φ cr Φ rt < - Hi ^ O TJ φ H- o cυ l-i rt Ci 0 CD u Φ 0 Ω CD Hi ^ cu 0 fi rr Φ O H| Hi Ω 0 cu φ rt rt φ H- CD H- H- 0 M cr <J rr 0 3 M Hi Ω HJ H- Ω φ 3 0 n
CD 3J cr 3 M rt Hh rt c φ Φ cr H- cr rt Hi cu øj ^ H- D cu Hh 0 3
TJ CD rr Φ CD Φ CQ rt H- φ CD rt ^ CL, o rr 0 rr 3 Hi Φ 3 Φ Hi CO s
0 0 r c H- 0 rt Hi Φ TJ i rr Φ Hi Φ rt C cu Ω rr Ω X Φ Hi Φ H- H-
CO HJ Φ TJ Hj g TJ o 0 3 rr 3 M Φ Φ rt 3 rr rr <l O rr υ TJ cr cu ^ CQ ft
H- cυ Hti u cu 3 Φ Φ cu cu CD rr rt Φ CD Φ Φ H- IQ 3 Φ M g Φ φ cr ft rr rr O TJ Hi CU rt rt CD CD Ω rt 0 Ω Ω TJ Φ M Hi << Hi 3 Hi rr CU TJ 3 M rt
H- CU o rt O O rr O H- H- 3 Φ Hi 0 Hl M H- LQ φ Hi CD Hi M H- ^ rr 0 rt
0 TJ CD H- Φ rr Φ H- 3 D, 3 <! α H- D H- M- H- cr 3 Ω φ cu ^ Φ Φ φ Hi rr
3 CU H- cυ Φ Hi rt 0 H- Hi φ u σ H- n Ω 3 0 3 μ- cu 3 CD 3 Φ Hi Φ
O rr M rt C-. 3 rt 3 o M 0 φ Hh u Φ M Φ Hi 3 • rt cr ft 3 0 CO 3 n H- H- 0 O CQ H{ •<; 3 3 -b P- 0 rt Hi Ω H- o cr M rt ft "< C TJ
0 0 CD s: £ 0 H- g 0 0 H H- cr Ω M H- 3 M Φ ^ H- cu g 0 ϋ ; 3 C Φ H- rr 3 TJ cu Hi 3 cu TJ 3 g 0 Φ fu Ω Φ 3 CQ O Hh ft cr O
H- Hi 3 rt H- φ cu rt Φ tu JU 3 rt rs h1- P D 0 H- H- 0 φ H-
3 l-h U rr Ω CD H- rt H- Ω rt rt rt Ω rt s: Hi Hi Φ Φ u Λ Hi Φ 0 M Hi ft tQ φ cu cr rr - rt rt 0 0 Hi Hi rt 0 H- H- Φ cr Ω H- ii Hi Hi c Q, 3 O CD H- I"--
3 O M rt CD Φ 3 Hi cu cu Φ α- 0 CD Φ Φ M M Hi Φ cu ft ΪU 0 °
TJ Φ Φ Φ rr H- cr Φ Hi 3 n Hi H- n 3 Φ M Ω φ Hi rr H- M u 0 n
CU CD • Φ CD c M 3 0 Φ CD CD n 3 Hi H- Φ H- Ω CD Φ φ 3 M Hi Hi rt α. g rt rt Hh 3 TJ TJ CQ o Φ rr H- Hj rr c CD ^ Φ rt H- X TJ M Ω cu cu 0 3 M rr Φ O Ω - H- Hi ft Ω Φ
Φ H- a 0 Φ 0 0 Hi Ω t rt 0 Hi Hi Hh TJ μ- Φ n s: M rt 0 rr CD CO rr rt
Hi rt cυ s: D n cu 0 3 rr Hh Φ Φ cu rr u rt Φ H- Φ CD cu TJ rt Φ ^ c cu Φ
3 H- rr Φ α u rt 3 Φ 3 3 CD rt rr cr Hh H- CD rt c cr 0 u g cr Hi Hj
0 H- <! Φ rt rt rr r cr rt rt rt k_- rt φ M H- Hh TJ rr Hi Ω M M ft TJ g CO cu g
£ 3 0 Φ rt H- Φ Φ u Φ H- rr Φ Φ Hi H- Φ H- rr ^ ^ H- cu Φ ft Ω H-
H- • 3 Hi φ 0 α, H{ H- r> Φ CD CD u Hi H- CD Φ Ω u M CQ 0 Hi rt u rt rr 3
- Hi 3 n g Hi rr rr 0 3 3 CD rr H- M u Ω O r Hi 3 Φ u rr 3
H- g o r cu O TJ φ φ M Hh M- cu CD Φ CD O 3 H- H- rt Hj ft
0 rr Φ rt H- Ω 3 rr cu 0 φ φ CD rr 0 a cu ≤ M Φ g CO 0 u Ω H- CO H- c Λ 3^ 3 0 Φ n Φ g CD rt rt u Hi Ω n P- M Ω cr TJ ^ Hh M u fu 0 rt M- C H- cu l u ^ 0) H- • 3 O g Φ rt < 0 s: M 0 M M 3
CD H- cα rr H- TJ c rt rt s: φ cu rr 3 H- CU CD M ft H- ^ M
JU n H- 3 TJ u H- TJ H- rr H φ cr rt H- rt TJ α rt Ω Φ H- rr g ^ φ 3J 0 IQ u Hi
§ n 0 O Φ rt Φ H- rt rr rt Hi rr
M CD CU ? P- 3 Φ cu CD cr
3 H| rt l-h u 3 3 3 Φ O Φ rr Φ Ω Φ CQ O HJ c
H- H CD TJ rt 0 rt g 3 3 3 Ω Φ Hi 0 u u o CD H- φ Φ rt
113 Hi 0) 0 cu H- o Hi Ω Ω TJ cu 0 cu CD Φ M 3 Hh
H- rt g CD rt c CQ
Hi rt υ Hh g Hi u 0 u ^ rt CD Ω 3 Φ cu H 0 Hi fx 0 cu " c rt
H- n IQ rr rt M u CU Hi P. H{ C u 3 Ω H- Hj C- H- ft { CQ rt c u M
Φ rt Φ r rt 3 H- rt cu TJ Hi rr
0 0 Φ Hi Hi φ rt cu
H- M φ rr Hi rr H- Φ
3 H- M φ rt rs CD 0 Hj φ rr CD φ 3 Φ 0 ^
CQ u CD H| 0 r c rt
CD r 3 M 0 Hh TJ
at random, unless one accepts a considerable amount of redundancy.
Alternatively, each of said plurality of positions can be defined by a first and a second coordinate which can be determined by means of the part of the position- coding pattern which is located on the associated partial surface, the position-coding pattern representing the address of the location where the first and second coordinates are stored. However, a position-coding pattern made up in this way requires a great deal of memory space .
Accordingly, in a preferred embodiment, the position-coding pattern is structured in such a way that the position-coding pattern coding a certain position contains inherent information about that position.
More specifically, the position-coding pattern is preferably based on a first string of symbols, which contains a first predetermined number of symbols and which has the characteristic that if a second predeter- mined, preferably successive, number of symbols are taken from the first string of symbols, the location of these symbols in the first string of symbols is unambiguously determined, the first string of symbols being used for determining the position of the partial image in a first dimension on the information carrier. Since the position code is based on a string of symbols with a finite number of symbols arranged in a predetermined order, it is possible to define a "formula" for determining the position in a first dimension on the surface. In this way, only a small amount of memory space is required for storing the string of symbols and the position determination can be carried out quickly and easily. The position in the first dimension can, for example, be indicated as a coordinate in a Cartesian or a polar coordinate system. As mentioned above, several of the steps of the method according to the invention are carried out with the aid of a suitably programmed processor. According to a third aspect, the invention thus relates to a computer- readable medium which stores a computer program for recording information, which computer program comprises instructions for processing a plurality of partial images which together comprise the information to be recorded and a position-coding pattern, the processing comprising the step of using the position-coding pattern for putting the partial images of the information together into a composite image of the information. The computer program can be designed to be used in the device which records the information or in another device to which the images are transferred for processing .
The computer-readable medium with the computer pro- gram has essentially the same advantages as the above method.
According to a fourth aspect, the invention relates to a device for recording information, comprising a sensor for recording partial images of an information car- rier and a position-coding pattern; image-processing means for processing the partial images recorded by the sensor, which image-processing means are adapted to use the position-coding pattern in the partial images to determine where each partial image should be stored in a memory area.
According to a fifth aspect, the invention relates to a system comprising a product and a device of the type described above. The device and the system have essentially the same advantages as the product and the method. Features described above with respect to the method and the product may also be found in the device and the system.
The invention can be used for recording information from any type of information carrier on top of which or under which a position-coding pattern can be placed so that both the information on the information carrier and the position-coding pattern can be recorded either simultaneously or in an alternating manner. Brief Description of the Drawings
The present invention will be described in more detail below by way of a presently preferred embodiment with reference to the accompanying drawings, in which
Fig. 1 is a schematic illustration of an example of a product having a sheet -shaped portion with a position- coding pattern;
Fig. 2 is a schematic illustration of an example of how the symbols can be designed in one embodiment of the position-coding pattern;
Fig. 3 is a schematic view of an example of 4x4 symbols that are used to code a position;
Fig. 4 is a schematic illustration of an embodiment of a device according to the invention;
Fig. 5 is a schematic illustration of an example of the order in which partial images can be recorded from an information carrier;
Fig. 6 is a flowchart showing how partial images are processed;
Fig. 7 is a schematic illustration of a sheet with a position-coding pattern according to a further embodiment of the invention; and
Fig. 8 is a schematic illustration of a second embodiment of the device.
Description of Preferred Embodiments The Product
Fig. 1 shows a part of a transparent sheet 1 having a surface 2 on which an optically readable position-coding pattern 3 has been applied. The sheet 1 can be a part of a product, for example a plastic folder, but in this case the sheet constitutes the entire product. The position-coding pattern 3 is made up of symbols 4 of a first and second type 4a, 4b and more specifically of dots of two different appearances, the dots 4a having a black centre dot with a white ring around it representing
Figure imgf000015_0001
series to the beginning of the series. The five-bit group thus provides an unambiguous coding of the location in the series .
An example of a 32 -bit number series having the above characteristic is "00001000110010100111010110111110". If the last zero is removed from this number series, a 31 -bit number series having the same characteristic is obtained.
The first five bits in the above number series, i.e. 00001, constitute the code for position 0 in the number series, the next five bits, i.e. 00010, constitute the code for position 1, etc. The positions in the x-number series as a function of the five-bit groups are stored in a first table. Naturally, position 31 only exists in the 32-bit series. Table 1 below shows the position coding for the example described above.
Table 1:
Position Five-bit Group
0 00001
1 00010
2 00100 3 01000
4 10001
5 00011
6 00110
7 01100 8 11001
9 10010
10 00101
11 01010
12 10100 13 01001
14 10011
15 00111
16 O H I O Position Five-bit Group
17 11101
18 11010
19 10101 20 01011
21 10110
22 01101
23 11011
24 10111 25 01111
26 11111
27 11110
28 11100
29 11000 30 10000
31 00000
It is only possible to code 32 positions, i.e. positions 0-31, with the aid of the 32-bit series. However, if one writes the 31-bit series 32 times in succession on a first row and the 32-bit series 31 times in succession on a second row below the first row, the series will be displaced in relation to each other in such a way that two five-bit groups written one above the other can be used to code 31 x 32 = 992 positions in the direction of the rows.
For example, suppose that the following code is written on the sheet :
000...11111000001000110010100111010110111110... 000...11111000010001100101001110101101111100... If the five-bit groups are translated into positions according to Table 1, the following positions of the 32- and 31-bit series are indicated on the sheet. 0 1 2 ...30 31 0 1 2...29 30 31 0 1 2 0 1 2 ...30 0 1 2 3...30 0 1 2 3 4 The coding in the X-direction is thus based on using a number series consisting of n bits which is made up in such a way that if m successive numbers are taken from the series, these m numbers will code the position in the series unambiguously. The number of codable positions is increased by using a second number series, which is a subset of the first number series and which is thus of a different length than first series. In this way, a displacement between the series is obtained in the longitudinal direction of the rows.
The coding in the Y-direction is based on the same principle. A number series is created, hereinafter called the Y-number series, which consists of p numbers, the series being made up in such a way that if r successive numbers are taken from the series, these r numbers will code the position in the series and thus the position in the Y-direction unambiguously. The numbers in the Y-number series are coded in the pattern on the sheet as a difference between the positions in the X-direction in two rows, which is calculated in a special way.
More specifically, alternate rows of the 31-bit series and the 32-bit series are written as follows:
Row 1 (31) (31) (31) (31) Row 2 (32) (32) (32) (32) Row 3 (31) (31) (31) (31) Row 4 (32) (32) (32) (32) Row 5 (31) (31) (31) (31)
Naturally, on the sheet, the series are written using the two different sizes of dots. The rows start in different positions in the X-number series. More specifi- cally, one begins two successive rows in such a way that if one determines the difference modulo 32 between two position numbers located one above the other, expresses the difference by means of a five-bit binary number, and takes the two most significant bits of said five-bit binary number, this number shall be the same regardless of where one is in the row. In other words, one starts the series in such a way that the displacements between the series in two successive rows remain within a specific interval along the entire row. In this example, the maximum displacement is 31 positions or bits and the minimum displacement is 0 positions or 0 bits. The displacements along each pair of rows is then within one of the intervals 0-7, 8-15, 16-23, or 24-31 positions/bits. For example, suppose that the series are written as follows (expressed as position numbers) :
Row 1 0 1 2 3 4 5 6 7 30 0 1 2 3 Row 2 0 1 2 3 4 5 6 7 30 31 0 1 2 Row 3 25 26 27 28 29 30 0 1 24 25 26 27 28 Row 4 17 18 19 20 21 22 23 24. 16 17 18 19 20 Row 5 24 25 26 27 28 29 30 0. 23 24 25 26 27
If the difference is determined in the above way, it will be 0 between rows 1 and 2, 0 between rows 2 and 3, 1 between rows 3 and 4, and 3 between rows 4 and 5. Take, for example, 26-18 in rows 3 and 4, which equals 8, which is 01000 in binary code. The two most significant numbers are 01. If instead one takes 0 - 23 in the same rows, which modulo 32 equals 9, the two most significant numbers are 01 just like in the previous example. In this example, four difference numbers 0,0,1,3 are obtained. Now, if in same way as for the X-direction, one has created a Y-number series from the numbers 0, 1, 2, and 3 which has the characteristic that if four successive numbers are taken from the series, the position in the series will be determined unambiguously, it is possible by looking up the number 0013 in a table to unambiguously determine the position in the Y-direction. In this way, it is possible to determine 256 unique positions in the Y-direction.
The following is an example of the beginning and the end of a Y-number series containing the numbers 0-3: Table 2 :
0 0000
1 0001
2 0010
3 0100
4 1000
5 0002
6 0020
7 0200
8 2000
9 0003
10 0030
251 2333 252 3333
253 3330
254 3300
255 3000
The following is a description of how the position determination is carried out. Suppose that one has a sheet as described above which across its surface has a pattern made up of a first symbol representing a one and a second symbol representing a 0. The symbols are arranged in rows and columns and in 32-bit and 31-bit series as described above. Furthermore, suppose that one wishes to determine the position on the sheet where one places a device equipped with a sensor which can record an image containing 5 x 5 symbols.
Suppose that the image recorded by the sensor looks as follows:
1 1 1 1 1 1 1 1 1 1 0 1 0 1 0 0 0 1 0 1 0 0 1 0 1 In a first step, the device translates these five- bit groups into positions with the aid of Table 1. The following positions are obtained: 26 (11010) 26 (11010)
11 (01011) 10 (01010) 05 (00101) Subsequently, the magnitude of the displacement between the position numbers in the different rows is determined by taking the difference modulo 32. The two most significant numbers of the differences determined in this manner expressed as five-bit binary numbers are 0, 1, 0, 0. According to Table 2, this difference number equals position 3 in the Y-direction. Thus, the coordinate of the second dimension on the sheet is 3.
A third table stores the starting position of each row, i.e. the position in the X-numbers series where each row starts. In this case, with the aid of the y-coordi- nate 3, it is possible to look up the starting positions of the rows from which the recorded five-bit groups have been taken. Knowing the starting positions of the rows from which the two uppermost five-bit groups have been taken and the X-positions to which these two five-bit groups correspond, i.e. positions 26 and 26, it is possible to determine the x-coordinate, or the position in the first dimension, of the recorded image. For example, suppose that the starting positions of the two uppermost rows are 21 and 20 respectively. In this case, the two rows from which the two uppermost five-bit groups in the recorded image are taken will thus look as follows:
Row 3: 21 22 23....29 30 31 0 1 2...25 26 27.. Row 4: 20 21 22....28 29 30 0 1 2...25 26 27.. It follows from the fact that the y-coordinate is 3 that the two first five-bit groups are taken from rows 3 and 4. It follows from the fact that odd rows are made up of the 32 -bit number series and even rows are made up of the 31 -bit number series that row 3 is made up of a 32 -bit number series while row 4 is made up of a 31-bit number series .
On the basis of this information, it is possible to determine that the x-coordinate is 35. This can be verified by repeating the above steps for the remaining pairs of five-bit groups in the recorded image. There is thus a certain amount of error tolerance .
The accuracy of the position determination can be further increased by determining the location of the middle dot in the 5 x 5 group in relation to the centre of the image. The position resolution can thus be better than the distance between two symbols.
Naturally, the above steps are carried out by soft- ware, which in this example gives the coordinates 3 and 35 as its output signal.
The position-coding pattern can also be used for determining the position in a third dimension in relation to the surface, i.e. in the Z-direction. This is achieved by determining the size of the symbols in the recorded image and comparing it to a reference value representing the size of the symbols when they are imaged by means of an information-recording device which is held next to the surface on which the position-coding pattern is located. In this way, the device can thus automatically determine whether the device is close to the surface, in which case images shall be recorded, or spaced from the surface, in which case images shall not be recorded, and trigger image recording depending on this. The above description relates to an example and can thus be generalised. There need not be 32 numbers in the first X-number series. The number depends on how many different symbols are to be used in the pattern in combination with the number of symbols which are recorded in the X-direction in connection with the position determination. For example, if the number of different symbols is 3 and the number of recorded symbols is 3, the maximum number of numbers in the X-number series will be 3x3x3=27 instead of 32. The same type of reasoning applies to the Y-number series. The bases of these number series can thus be different and the number of symbols which code a position, and consequently also the number of positions coded by the number series, can vary. Moreover, the series can be based on symbols other than numbers and can therefore be described as strings of symbols.
As mentioned above, the symbols can be of many dif- ferent kinds. They can also be numbers, but in that case OCR software is required for carrying out the position determination, which makes the device for image recording more expensive and more complicated. It also leads to increased error sensitivity. The above method of coding positions on a surface and of carrying out the position determination on the surface is advantageous in that it only requires a very small amount of memory and processor capacity. In the above example, it is only necessary to store Table 1 with 32 rows, Table 2 with 256 rows, and Table 3 with
256 rows. The position determination can be carried out by means of three table look-ups and a simple calculation.
Furthermore, the method of coding positions on the surface is also advantageous because the image upon which the position determination is based can be captured at any rotation in relation to the surface upon which the position is to be determined. In the first place, an image contains a number of rows which shall be horizon- tal . This means that there are only four possible orientations. In 98% of cases, only one of the four orientations gives a position. In the cases where there is doubt, it can be removed by recording two adjacent images and determining the positions on the basis of these images at all possible orientations of the symbols in the images, the criterion being that the position determination shall result in two adjacent positions. On the basis of the above-mentioned code, position determination can also be carried out in ways other than those described above .
The recorded image of a partial surface of the posi- tion-coding pattern can be matched with an image of the whole position-coding pattern. However, this requires a great deal of processor capacity.
Alternatively, the symbols in the image can be translated into an address in a table in which the coor- dinates are stored. However, this requires a great deal of memory capacity. Position-coding pattern - example 2
Below a second example of a position-coding pattern is described. It has substantially the same properties as the above-described pattern.
This second position-coding pattern comprises a virtual raster, which thus neither is visible to the human eye nor can be detected directly by a device which is to determine positions on the surface, and a plurality of symbols 104, which each are capable of assuming one of four values "i"-"4" as will be described below.
Figs 2a-d show an embodiment of a symbol which can be used in the position-coding pattern according to the invention. The symbol comprises a virtual raster point 106 which is represented by the intersection between the raster lines, and a marking 107 which has the form of a dot . The value of the symbol depends on where the marking is located. In the example in Fig. 2, there are four possible positions, one on each of the raster lines extending from the raster points. The displacement from the raster point is equal to all values. In the following, the symbol in Fig. 2a has the value 1, in Fig. 2b the value 2, in Fig. 2c the value 3 and in Fig. 2d the value 4. Expressed in other words, there are four different types of symbols.
Each symbol can thus represent four values "1-4". This means that the position-coding pattern can be divid- ed into a first position code for the x-coordinate, and a second position code for the y-coordinate . The division is effected as follows:
Figure imgf000025_0001
Thus, the value of each symbol is translated into a first digit, in this case bit, for the x-code and a second digit, in this case bit, for the y-code. In this manner, two completely independent bit patterns are obtained. The patterns can be combined to a common pattern, which is coded graphically by means of a plurality of symbols according to Fig. 2.
Each position is coded by means of a plurality of symbols. In this example, use is made of 4x4 symbols to code a position in two dimensions, i.e. an x-coordinate and a y-coordinate.
The position code is made up by means of a number series of ones and zeros which have the characteristic that no sequence of four bits appears more than once in the series. The number series is cyclic, which means that the characteristic also applies when one connects the end of the series to the beginning of the series . Thus a four-bit sequence always has an unambiguously determined position in the number series.
The series can maximally be 16 bits long if it is to have the above-described characteristic for sequences of four bits. In this example, use is, however, made of a series having a length of seven bits only as follows:
"0 0 0 1 0 1 0". This series contains seven unique sequences of four bits which code a position in the series as follows:
Figure imgf000026_0001
For coding the x-coordinate, the number series is written sequentially in columns across the entire surface that is to be coded. The coding is based on the difference or position displacement between numbers in adjoining columns. The size of the difference is determined by the position (i.e. with which sequence) in the number series, in which one lets the column begin. More specifically, if one takes the difference modulo seven between on the one hand a number which is coded by a four-bit sequence in a first column and which thus can have the value (position) 0-6, and, on the other hand, a corresponding number (i.e. the sequence on the same "level") in an adjoining column, the result will be the same independently of where along the two columns one makes the comparison. By means of the difference between two columns, it is thus possible to code an x-coordinate which is constant for all y-coordinates .
Since each position on the surface is coded with 4x4 symbols in this example, three differences (having the value 0-6) as stated above are available to code the x-coordinate. Then the coding is carried out in such manner that of the three differences, one will always have the value 1 or 2 and the other two will have values in the range 3-6. Consequently no differences are allowed to be zero in the x-code. In other words, the x-code is structured so that the differences will be as follows: (3-6) (3-6) (1-2) (3-6) (3-6) (1-2) (3-6) (3-6) (1-2)... Each x-coordinate thus is coded with two numbers between 3 and 6 and a subsequent number which is 1 or 2. If three is subtracted from the high numbers and one from the low, a number in mixed base will be obtained, which directly yields a position in the x-direction, from which the x-coordinate can then be determined directly, as shown in the example below.
By means of the above described principle, it is thus possible to code x-coordinates 0,1,2..., with the aid of numbers representing three differences. These differences are coded with a bit pattern which is based on the number series above. The bit pattern can finally be coded graphically by means of the symbols in Fig. 2.
In many cases, when reading 4x4 symbols, it will not be possible to produce a complete number which codes the x-coordinate, but parts of two numbers. Since the least significant part of the numbers is always 1 or 2 , a complete number, however, can easily be reconstructed.
The y-coordinates are coded according to the same principle as used for the x-coordinates. The cyclic number series is repeatedly written in horizontal rows across the surface which is to be position-coded. Just like in the case of the x-coordinates, the rows are allowed to begin in different positions, i.e. with different sequences, in the number series. However, for y-coordinates one does not use differences but codes the coordinates with numbers that are based on the starting position of the number series on each row. When the x-coordinate for 4x4 symbols has been determined, it is in fact possible to determine the starting positions in number series for the rows that are included in the y-code in the 4x4 symbols. In the y-code the most significant digit is determined by letting this be the only one that has a value in a specific range. In this example, one lets one row of four begin in the position 0-1 in the number series to indicate that this row relates to the least significant digit in a y-coordinate, and the other three begin in the position 2-6. In y- direction, there is thus a series of numbers as follows: (2-6) (2-6) (2-6) (0-1) (2-6) (2-6) (2-6) (0-1) (2-6)... Each y-coordinate thus is coded with three numbers between 2 and 6 and a subsequent number between 0 and 1.
If 1 is subtracted from the low number and 2 from the high, one obtains in the same manner as for the x-direction a position in the y-direction in mixed base from which it is possible to directly determine the y-coordinate.
With the above method it is possible to code 4 x 4 x 2 = 32 positions in x-direction. Each such position corresponds to three differences, which gives 3 x 32 = 96 positions. Moreover, it is possible to code 5 x 5 x 5 x 2 = 250 positions in y-direction. Each such position corresponds to 4 rows, which gives 4 x 250 = 1000 positions. Altogether it is thus possible to code 96000 positions. Since the x-coding is based on differences, it is, however, possible to select in which position the first number series begins. If one takes into consideration that this first number series can begin in seven different positions, it is possible to code 7 x 96000 = 672000 positions. The starting position of the first number series in the first column can be calculated when the x-coordinate has been determined. The above-mentioned seven different starting positions for the first series may code different sheets of paper or writing surfaces on a product.
With a view to further illustrating the position- coding pattern according to this embodiment, here follows a specific example which is based on the described embodiment of the position code.
Fig. 3 shows an example of an image with 4x4 symbols which are read by a device for position determination.
These 4x4 symbols have the following values:
4 4 4 2
3 2 3 4
4 4 2 4 1 3 2 4
These values represent the following binary x- and y-code : x-code : γ-code :
0 0 0 0 0 0 0 1
1 0 1 0 0 1 0 0
0 0 0 0 0 0 1 0
1 1 0 0 1 0 1 0
The vertical x- sequences code the following positions in the number series: 2 0 4 6. The differences between the columns will be -2 4 2 , which modulo 7 gives: 5 4 2, which in mixed base codes position (5-3) x 8 + (4-3) x 2 + (2-1) = 16 + 2 +1 = 19. Since the first coded x-position is position 0, the difference which is in the range 1-2 and which is to be seen in the 4x4 symbols is the twentieth such difference. Since furthermore there are a total of three columns for each such difference and there is a starting column, the vertical sequence furthest to the right in the 4x4 x-code belongs to the 61st column in the x-code (3 x 20 + 1 = 61) and the one furthest to the left belongs to the 58th.
The horizontal y-sequences code the positions 0 4 1 3 in the number series. Since these series begin in the 58th column, the starting position of the rows are these numbers minus 57 modulo7, which yields the starting positions 6 3 0 2. Translated into digits in the mixed base, this will be 6-2, 3-2, 0-0, 2-2 = 4 1 0 0 where the third digit is the least significant digit in the number at issue. The fourth digit is then the most significant digit in the next number. In this case, it must be the same as in the number at issue. (An exceptional case is when the number at issue consists of the highest possible digits in all positions. Then one knows that the beginning of the next number is one greater than the beginning of the number at issue.)
The position of the four-digit number will then in the mixed base be 0x50 + 4x10 + 1x2 + 0x1 = 42.
The third row in the y-code thus is the 43rd which has the starting position 0 or 1 , and since there are four rows in all on each such row, the third row is number 43x4=172.
Thus, in this example, the position of the uppermost left corner for the 4x4 symbol group is (58,170) .
Since the x- sequences in the 4x4 group begin on row 170, the x-columns of the entire pattern begin in the positions of the number series ((2 0 4 6) - 169) modulo 7 = 1 6 3 5. Between the last starting position (5) and the first starting position, the numbers 0-19 are coded in the mixed base, and by adding up the representations of the numbers 0-19 in the mixed base, one obtains the total difference between these columns. A naive algorithm to do so is to generate these twenty numbers and directly add up their digits. The resulting sum is called s. The sheet of paper or writing surface will then be given by (5-s) modulo7.
In the example above, an embodiment has been described, in which each position is coded with 4 x 4 symbols and a number series with 7 bits is used. Of course, this is but an example. Positions can be coded with a larger or smaller number of symbols. The number of symbols need not be the same in both directions. The number series can be of different length and need not be binary, but may be based on another base. Different number series can be used for coding in x-direction and coding in y-direction. The symbols can have different numbers of values . In the example above, the marking is a dot but may, of course, have a different appearance. For example, it may consist of a dash which begins in the virtual raster point and extends therefrom to a predetermined position. Preferably, it may consist of the above-described dot with an inner circle filled with a first colour and an outer circle filled with a second contrasting colour up to the edge of the inner circle.
In the example above, the symbols within a square partial surface are used for coding a position. The partial surface may have a different form, such as hexagonal . The symbols need not be arranged in rows and columns at an angle of 90° to each other but can also be arranged in some other manner.
For the position code to be detected, the virtual raster must be determined. This can be carried out by studying the distance between different markings. The shortest distance between two markings must derive from two neighboring symbols having the value 1 and 3 so that the markings are located on the same raster line between two raster points. When such a pair of markings has been detected, the associated raster points can be determined with knowledge of the distance between the raster points and the displacement of the markings from the raster points. When two raster points have once been located, additional raster points can be determined by means of measured distances to other markings and with knowledge of the relative distance of the raster points. In a real implementation of the second position- coding pattern a nominal spacing of 0.3 mm between the raster lines has been used. If each position is coded by 6 x 6 symbols, an area of 1.8 mm x 1.8 mm is required for each position. By determining the position of the 6 x 6 symbols on a sensor of a recording device which is used for recording information, a position can be calculated with a resolution of 0.03 mm. Device for Recording Information
An embodiment of a device for recording information is schematically shown in Fig. 4. It comprises a casing 11 having approximately the same shape as a pen. In one short side of the casing there is an opening 12. The short side is intended to abut against or be placed a short distance from the information carrier from which information is to be recorded.
The casing essentially contains an optics part, an electronic circuitry part, and a power supply. The optics part comprises at least one light-emitting diode (LED) 13 for illuminating the surface which is to be imaged and a light-sensitive area sensor 14, such as a CCD or CMOS sensor, for recording a two-dimensional image, in colour, black and white, or greyscale. The device may also comprise an optical system such as a mirror system or a lens system. It should be noted that the sensor 14 should be designed in such a way that it can capture an image of the information carrier and the superimposed position-coding pattern at the same time. The light-emitting diode may be a IR-diode emitting light of about 880 nm.
The power supply to the device is obtained from a battery 15, which is mounted in a separate compartment in the casing. The electronic circuitry part comprises image-processing means 16 comprising a processor unit with a processor which is programmed to read a partial image from the sensor, identify the position-coding pattern in the partial image, determine a position on the basis of the identified position-coding pattern, and store the partial image in a location in a memory forming part of the image-processing means which is indicated by the position determined from the position-coding pattern.
Moreover, the device comprises buttons 18 by means of which the user activates and controls the device. It also comprises a transceiver 19 for wireless transfer, e.g. using IR light or radio waves, of information to and from the device. The device can also comprise a display 20 for showing recorded information.
The Applicant's Swedish patent No. 9604008-4 describes a device for recording text. This device can be utilised for recording information using the method according to the invention if programmed in a suitable way.
As mentioned above, the device can be divided into different physical casings, a first casing containing components required for capturing images of information carrier with the superimposed position-coding pattern and for transferring them to components which are located in a second casing and which carry out the position determi- nation and the storing of the images in the memory. Operation
Suppose that a user has an information carrier in the form of a sheet of paper with text and an image which he wishes to send in an e-mail message to another person. In this case, he places the above-mentioned transparent sheet 1 with the first position-coding pattern 3 (example 1) on top of the sheet of paper. Subsequently, he turns on the above-mentioned device for recording information, places the device so that the opening 12 abuts against the information carrier and passes the device back and forth across the area on the information carrier containing the text and the image which he wishes to record. It is important for the user to "scan" the whole area which is of interest to him so that the partial images recorded by the device together cover the whole area. However, as will be seen below, it does not matter if several partial images cover the same area.
Fig. 5 schematically shows an example of how partial images can. be recorded from an information carrier. For the sake of clarity, the position-coding pattern is not shown. The information on the information carrier is shown as a sun and a cloud in broken lines. Partial images 30-33 are recorded in such a way that they overlap using a left-to-right motion. Subsequently, the user lifts the device and puts it down slightly to the right of partial image 33, after which partial images 34-39 are recorded using a back-and-forth motion. The user continues to pass the device across the information carrier until the whole area that he wishes to record has been scanned. During the scanning, the device records images at a predetermined frequency, the LED 13 generating strobe pulses at the same frequency, e.g. 100 Hz.
When the sensor has recorded a partial image it is read by the image-processing means 16 and is processed immediately or subsequent to buffering in the memory. The partial images are preferably recorded at a frequency such that they partially overlap, making it easier to scan the area from which information is to be recorded. Each recorded image is processed as follows by the software in the device, see the flowchart in Fig. 6. First, a partial image is fetched, step 40. This image is scanned, step 41, in a first pass where the processor searches for symbols 4a having a black centre dot with a white ring around it. When it has found the first such dot the searching becomes simpler because it knows the distance between the dots in the position-coding pat- tern.
Subsequently, the partial image is scanned again, step 42, in a second pass where the processor searches for symbols having a white centre dot with a black ring around it. An identified position of a black dot can be used as a starting-point for this search, the processor again utilising the known distance between the dots.
When the part of the position-coding pattern which is located in the partial image has been identified in this way, the processor determines, in the above manner, which position the position-coding pattern in the partial image represents, step 43. The position can be indicated as a pair of co-ordinates. The rotation of the partial image in relation to the information carrier can be determined based on knowledge of the arrangement of symbols in the position-coding pattern. Furthermore, the position of the partial image can be determined more exactly by determining the position of the position-coding pattern on the sensor.
In the next step, step 44, the position-coding pattern is filtered out of the partial image. This is effected by the processor determining, for each dot forming part of the position-coding pattern, the value of the pixels closest to the periphery of the dot. The processor then restores the image by replacing, for each symbol, i.e. dot, all the pixels in the partial image which constitute the dot with the average of the pixel values of the pixels adjacent to the periphery of the dot. Alternatively, the processor can replace sectors in the dot with pixels with the average of the pixel values of the pixels adjacent to the sector arc.
When the position-coding pattern has been filtered out, the partial image is stored, step 45, in a location in the memory which is determined by the position coordinates. In this connection, it may happen that the partial image completely or partially overlaps a previously stored partial image. In that case, the average value of overlapping pixels is calculated and the average value is stored in the location for each overlapping pair of pixels .
The location in the memory where the partial image is stored need not be determined exclusively on the basis of the position co-ordinates. More particularly, the position coordinates can be used for carrying out a rough positioning, whereas a fine positioning is carried out by registering (aligning) the partial image with previously stored partial images by using the overlapping content of the partial images.
When all the partial images have been stored, the memory contains a composite digital image of the area on the information carrier which has been scanned using the device. This digital image can be incorporated into a fax, a document, an e-mail message, or the like. The image could also be used as an input signal to OCR or ICR software which interprets the text in the image and stores it in character-coded format.
Furthermore, the stored partial images can be shown on the display 20 in order to help the user see the areas on the information carrier which he has not covered. For this purpose, a pixel on the display 20 may correspond to a certain area on the transparent sheet and be turned on as soon as the corresponding area has been covered. As another alternative, the information recorded from the information carrier can be displayed on a screen of a stationary computer to which the partial images are sent successively so that the user can see how the composite image of the information on the information carrier develops . Alternative embodiments In the example above, the information and the position-coding pattern are recorded simultaneously with the aid of the electromagnetic radiation from one or more LED.s. As an alternative the pattern and the information can be recorded in an alternating manner such that every second partial image comprises the pattern and every second partial image the information. In this case, the information and the pattern must be recorded by electromagnetic radiation of different wavelengths. This embodiment has the advantage that the position-coding pattern may be placed under the information carrier and thus need not be transparent. Another advantage is that there is no position-coding pattern in the partial images of the information that need to be filtered out.
Furthermore, Fig. 7 shows an embodiment according to which information can be recorded with different resolution. The sheet 70 in Fig. 7 has a large image recording area 71 covered by a position-coding pattern like in Fig. 1 (for ease of illustration, the coding pattern is only showed by some dots) , and two small resolution- indicating boxes 72,73, which are also covered by a position-coding pattern. The pattern in the boxes codes specific co- ordinates, which have been dedicated for the indication of different degrees of resolution. When the user wants to record information with a 100 dpi resolution, he puts the recording device in box 71. The device recognises the co-ordinates coded by the pattern in box 71 as indicating a resolution of 100 dpi and then carries out the recording with this resolution.
Fig. 8 shows schematically an alternative embodiment of the device for recording information, where the sensor for recording partial images is accomodated in a first casing 80 and the image-processing means are accomodated in a second casing 81. The first casing can be the same as that shown in Fig. 4 and include substantially the same components. However, the recorded partial images are not processed in the first casing 80 but transferred to the second casing 81, e.g. a stationary personal computer which has image-processing means 82, schematically shown with broken lines, for carrying out the processing of the recorded partial images.

Claims

1. A method of electronic recording of information from an information carrier, c h a r a c t e r i s e d by the steps of placing a position-coding pattern and the information carrier such that one superimposes the other; imaging the information on the information carrier and the position-coding pattern with the aid of a plurality of partial images; and using the position-coding pattern for putting together the partial images into a composite image of the imaged information. 2. A method according to claim 1, wherein the step of placing comprises placing a sheet with the position- coding pattern on top of or under the information carrier .
3. A method according to claim 2, wherein the sheet with the position-coding pattern is transparent except for the position-coding pattern and is placed on top of the information carrier.
4. A method according to claim 1, 2 or 3 , wherein both the information on the information carrier and the position coding pattern are imaged in every partial image .
5. A method according to any one of claims 1-4, further comprising the step of filtering out the position-coding pattern. 6. A method according to claim 5, wherein the step of filtering out the position-coding pattern comprises replacing pixel values representing the position-coding pattern with pixel values obtained by averaging pixel values representing the information. 7. A method according to claim 5 or 6 , wherein the position-coding pattern is made up of symbols and where- in the step of filtering out the position-coding pattern > O to to μ> o LΠ o LΠ o LΠ
H{ μ- Ω TJ 0 CX μ- TJ TJ TJ cu Hi rt μ- TJ μ- rt μ- TJ 3 TJ CQ 3 3 μ- TJ Ω TJ Hi 0 Ω
Φ 3 M μ- < Φ 3 rr Hi cu 0 Hi μ- 3 cu 3 μ- 3 c rr φ Cυ cu cυ μ- 3 cu M μ- Φ Hi 0
CD Hi CU X Φ rt μ- μ- rt CO M o O Hi rt CU Hh Cυ rt Φ 3 Hi 3 rr 3 cu ft cυ X TJ
0 0 μ- Φ Hi Φ cu Ω D rt μ- G 3 3 0 rt LQ : LQ rt H| 0 rt φ μ- μ- LQ ft μ- Φ M TJ TJ
M 3 M M Hj rr μ- Φ rt Ω Hi Φ Φ μ- Φ μ- Φ Hi μ- 0 rs φ φ 3 M CU μ- Hi
C 3 CD M cu 3 TJ rs μ- ri μ- Cυ rt Ω 3 Hi ^« rs rs μ- CO ^ cu 0 rs LQ Hi CD co Ω X μ- rt cu ^ H < TJ μ- cu μ- LQ o ) 0 rt rr Cυ cu 3 LQ 0 LQ rs • M Hi 0 3 - • < μ- Φ co μ- rt • CU TJ 3 Hi CD 3 μ- φ H| rt •> CX Hi CU 0 0 Hi CU rs M Φ
0 μ- Hh M μ- μ- ft rt 0 Hi μ- φ rt rt rt > Hi μ- Cu P rs H 3 M LQ CD O
3 0 C > c 3 rs μ- rt rr > CX 3 TJ μ- 0 cu rt rr rt 0 rr Φ 3 ex Φ ft 0 rr c -
3 Hi φ LQ LQ cυ 0 φ Φ cu Φ 3 Φ Φ rr LQ Φ 3 CU cu l_l. rt rr Hi Φ 3 φ TJ CU μ- ft 3 M g rt μ- H| Hi TJ Hi Φ Φ φ LQ Cu rr TJ Φ Hj φ CD μ- ex Hi
Hi 0 rr φ s- TJ CU cr CO Φ Φ 3 rt •-. μ- 0 3 TJ rt CO rt 0 φ Ω φ o TJ Φ rt • X 0
3 φ rt μ- μ- 3 μ- Φ rt rt Hi μ- 3 CD μ- 0 μ- rr rt rr 3 φ CD μ- μ- rr φ CU Hj cu Hj rr rt X 3 Φ rr g cu cυ Hh CU μ- n CQ 3 Φ Φ 0 0 rs cr μ- 3 ft 3 0 M Ω rr 0 rr Φ cu Cυ CD TJ o μ- M μ- LQ rt μ- μ- Hi Hi TJ ex rt Hh rt CU rt Hi ft CX CD Φ Φ
H rr Ω ex M <; LQ rt CO ex 3 3 M φ μ- rs rt o rr CD μ- 0 μ- rt rs Cu μ- φ 0 CD CD Φ φ 0 Φ φ μ- ft ex 0 LQ μ- Hi r 0 CU φ rt TJ μ- 0 Hj n rr cu μ- rt Ω
H| 3 cu cυ - Hi Hi 0 cu ex 3 3 Φ 3 » 0 3 rr Hi Ω rr cυ D 3 3 LQ φ Ω n rr
CD μ- TJ Ω μ- cu TJ φ Hh Ω 0 cυ Hi μ- 3 cu Φ Ω cr Φ Hi Cu Ω rt rt 3 Hi Ω ex CU LQ Hi CX - Ω Hi LQ μ- 3 Hi rt c 0 cu rt 0 Hi rt rt CD o rt 0 CQ
H μ- o 3 Φ Φ 0 μ- ^ Φ 3 φ μ- Ω μ- TJ CO Hi CD μ- μ- Hι 0 μ- 0 rt Hj rr ^
TJ 0 10 Hi cυ CX <! μ- μ- Hi rt -• LQ rt TJ rt 0 0 cυ μ- CX μ- 3 cu Hi O LQ Φ ex φ rt
Cυ μ- ex <! < μ- 3 H ex rr cu rr Hi rr ex 3 H| 3 μ- D Hi M ft 3 Φ TJ μ- rr ζf
Hi 3 3 μ- Φ Hi cu 0 μ- Hi Cu 0 Φ Φ μ- (t LQ 3 0 rr Φ rt rs CD φ 0 rt cu LQ 3 Hi Φ M c rt cυ 3 rt Φ rs C CD rt rs Ω μ- LQ 0 Hi μ- Φ CU Ω rr 0 LQ ^ M rt LQ Cυ TJ c CQ rr LQ rr CU ex rt T Φ rr LQ 0 Cυ rt Hh 3 3 Ω 0 Φ Hi TJ -
O μ- rt LQ M φ M Φ TJ Φ cu 3 Φ 3 M rr rt cu cu TJ rr 3 Hi rt c φ
H 0 rr rt Φ cυ μ- rt ≤ CD rt Hi rt TJ TJ Φ 0 (t ft LQ 0 TJ c 0 0 Hj
3 Φ 0 Ω 0 g X 0 CU rr rt rr rt μ- cu cu Hi μ- rr μ- φ CD TJ H rt CD M μ- <; co rt <; μ- Hh CD φ μ- μ- 0 Φ μ- 3 H- rt μ- 3 TJ cu Φ 0 μ- cυ μ- rr μ- Cυ TJ Φ rr Ω CD cu cυ 3 ft g M Ω cx Ω Hi cu LQ ex rt CQ Cυ 0 rs 3 Cu rt Hi O Φ rs rs s: rr Hi
Φ cu rt 3 M LQ ft 0 0 M rr μ- TJ M Φ Φ LQ O " ex rs μ- rt φ LQ ^ μ- Φ CU
Hi φ ^ c rr Hi Hi μ- cu 0 π 0 rt 0 Hi CD Φ μ- Φ CO ex 0 μ- O μ- rt Hi LQ
TJ H| TJ φ rt Φ Φ ^ rs μ- Hi μ- LQ CD μ- rr Hh 3 O rt 0 rt rr 3 Cυ 3 rt 0 rr μ-
0 μ- CD 0 • rr CX g CQ μ- 3 Φ rt μ- 3 Φ 0 CX M rt cu rr 3 3
CD φ 3 Φ TJ CU rt rt rt rt Cυ rt μ- rr μ- O Φ Hi c φ Ω rr LQ Φ Φ CQ 0 LQ μ- Hi 0 Φ μ- μ- Hi rr CD rr ex rr μ- LQ TJ rr 3 Φ 3 rs 3 M rt 0 μ- Φ Φ cu Hh rt Hi TJ X 3 Φ Φ Φ Φ Φ 0 Φ 0 Φ rt 0 μ- ex Φ ex 3 CO TJ 0 μ- ft μ- £ 0 Hi Φ cu 0 rt rs CD Φ CO 0 Ω Hi rs Hj μ- Cu O 0 Hi cx rt rr
O μ- μ- Hi Φ M rt TJ Hi TJ Φ TJ 0 μ- TJ cu c O φ cr 3 3 LQ c μ- CD rr Φ
3 rr 3 < rr o cu 0 Hi Cu Ω 3 rt 0 Ω cr cu CX Ω ex Φ μ- LQ φ cr 3 μ- rt Cu Φ rr cu rt μ- < Φ < Hi CD CQ 3 Hi 0 μ- CD rr CQ μ- M 3 CD rt rt rr TJ
Ω LQ rr 0 cu φ rt * μ- μ- rt CX rt 0 μ- rt Ω 3 cu TJ CO μ- TJ 0 rt 0 μ- φ Φ CO μ-
0 cu μ- Φ C M 3 Hi μ- rt 3 μ- μ- rr rs ft TJ Φ 0 LQ μ- 0 rt rs CU Hh Φ 0 Hj "< X
CX n CD C Φ M cu Hh μ- Φ Cu n Φ μ- cu T 3 3 CO 0 LQ rt TJ CU 3 TJ CU φ μ- Hi LQ T M Φ 3 cu M C 0 ex M LQ o 0 Hi CO TJ TJ CD μ- Hi rt ft CD Hj CQ ξf M
3 μ- Hi *< CD 0 TJ H{ 3 μ- Hi n rt 0 u rt Φ Ξ Φ rr Ω Ω Φ φ o
LQ Hi rt Φ Hi O μ- ft cr μ- TJ 3 μ- 0 CO rt μ- ex rr Hj Φ 0 O 0 Ω M <:
CD rr Ω CQ o ^ g rr Ω : 3 cu Hh rt Ω cυ Hh μ- rt 0 Φ 3 Hi 3 CX φ 0 Cυ
TJ rt φ Φ rt Hi cu cu Φ O cu rt 0 rr 0 M rt Φ φ. 3 μ- Hj μ- cu J μ- ex CX Hh
CU Cυ M
0 LQ Hi CX rt LQ rt Hi φ ex μ- Φ Hi - rt - rs Φ μ- 3 ex 0 rs μ- P μ c
Hi ft Hi TJ Φ μ- rr Φ Φ 3 μ- cx 3 rt 3 Hi φ O LQ
3 rs ft φ rr Φ μ- Ω CX φ
3 Φ ii cu n φ CU rt 0 rt μ- LQ
Φ LQ rr CD
CX Φ cυ X 0 LQ μ- rs LQ rs Hh rr rt H{ Φ rt
Hi Φ
CD ^ φ g 3 O Φ rr Hj Φ
3 Φ M Hi Φ
on the sheet is detected, and imaging the information on the information carrier with a second resolution if a second part of the position-coding pattern is detected.
12. A product intended to be used in connection with electronic recording of information from an information carrier, which product comprises at least one sheet- shaped portion (1) provided with a position-coding pattern (3) which extends across the sheet and codes a plurality of positions on the sheet, c h a r a c t e r - i s e d in that the sheet-shaped portion (1) is transparent except for the position-coding pattern (3), the sheet -shaped portion being adapted to be placed on top of the information carrier for recording the information from the same. 13. A product according to claim 12, wherein each position of said plurality of positions is coded by a specific part (5a, 5b) of the position-coding pattern, and each such part of the position-coding pattern also contributes to the coding of adjoining positions. 14. A product according to claim 12 or 13, wherein the position-coding pattern is made up of a plurality of symbols (4a, 4b) of at least a first type.
15. A product according to claim 14, wherein the position-coding pattern is made up of a plurality of symbols (4a, 4b) of a first and a second type only.
16. A product according to claim 14 or 15, wherein each position of said plurality of positions is coded with the aid of a plurality of symbols (4a, 4b) .
17. A product according to any one of claims 14-16, wherein each of said symbols (4a, 4b) contributes to the coding of more than one of said plurality of positions.
18. A product according to any one of claims 12-17, wherein the position-coding pattern is based on a first string of symbols which contains a first predetermined number of symbols and which has the characteristic that if a second predetermined number of symbols are taken from the first string of symbols, the location of these symbols in the first string of symbols is unambiguously determined, the first string of symbols being used for determining the position of the partial image in a first dimension on the information carrier. 19. A product according to any one of claims 14-18, wherein the symbols are regular in shape, preferably rotationally symmetrical.
20. A product according to any one of claims 14-19, wherein the symbols are composed of two colours with a contrasting effect.
21. A product according to any one of claims 14-18, wherein each symbol comprises a raster point (5) and at least one marking (6) ; the raster point is included in a raster which extends across the surface; and the value of each symbol is indicated by the position of said marking in relation to a raster point.
22. A product according to any one of claims 12-21, further comprising a first area with a first part of the position-coding pattern which is dedicated for the re- cording of the information with a first resolution, and a second area with a second part of the position-coding pattern which is dedicated for the recording of the information with a second resolution.
23. A computer-readable medium, which stores a computer program for recording information, which computer program comprises instructions for bringing a general purpose computer to process a plurality of partial images, which together comprise the information to be recorded and a position-coding pattern, the pro- cessing comprising the step of using the position-coding pattern for putting the partial images of the information together into a composite image of the information.
24. The computer-readable medium according to claim
23, wherein the processing also comprises the step of filtering out the position-coding pattern.
25. The computer-readable medium according to claim
24, wherein the step of filtering out the position-coding pattern comprises replacing pixel values representing the position-coding pattern with pixel values obtained by averaging pixel values representing the information.
26. The computer-readable medium according to claim 24 or 25, wherein the position-coding pattern is made up of symbols and wherein the step of filtering out the position-coding pattern comprises, for each symbol, averaging the pixel values of pixels adjacent to the periphery of the symbol, and replacing pixels in the symbol which hides the information with the average of the pixel values.
27. A device for recording information, comprising at least one sensor (14) for recording partial images of an information carrier and a position-coding pattern (3) which are superimposed the one on the other; image-processing means (16) for processing the partial images recorded by the sensor, which image-processing means are adapted to use the position-coding pattern to determine where at least some of the partial images should be stored in a memory area.
28. The device according to claim 27, wherein the sensor (14) for recording partial images is accomodated in a first casing and the image-processing means for processing the partial images is accomodated in a second casing.
29. A system comprising a product according to any one of claims 12-22 and a device according to claim 27 or 28.
PCT/SE2000/001367 1999-06-28 2000-06-28 Recording of information WO2001001670A1 (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
KR1020017016798A KR20020033111A (en) 1999-06-28 2000-06-28 Recording of information
AU60384/00A AU752626B2 (en) 1999-06-28 2000-06-28 Recording of information
CA002377187A CA2377187A1 (en) 1999-06-28 2000-06-28 Recording of information
MXPA02000110A MXPA02000110A (en) 1999-06-28 2000-06-28 Recording of information.
BR0011955-5A BR0011955A (en) 1999-06-28 2000-06-28 Recording information
EP00946659A EP1197065A1 (en) 1999-06-28 2000-06-28 Recording of information
RU2002101922/09A RU2002101922A (en) 1999-06-28 2000-06-28 RECORDING INFORMATION
JP2001506218A JP2003503905A (en) 1999-06-28 2000-06-28 Recording information
HK03100438.7A HK1048216A1 (en) 1999-06-28 2003-01-17 Recording of information

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
SE9902436A SE517058C2 (en) 1999-06-28 1999-06-28 Scanning method for recording text
SE9902436-6 1999-06-28
US14471699P 1999-07-20 1999-07-20
US60/144,716 1999-07-20

Publications (1)

Publication Number Publication Date
WO2001001670A1 true WO2001001670A1 (en) 2001-01-04

Family

ID=26663604

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2000/001367 WO2001001670A1 (en) 1999-06-28 2000-06-28 Recording of information

Country Status (12)

Country Link
EP (1) EP1197065A1 (en)
JP (1) JP2003503905A (en)
KR (1) KR20020033111A (en)
CN (1) CN1359587A (en)
AU (1) AU752626B2 (en)
BR (1) BR0011955A (en)
CA (1) CA2377187A1 (en)
HK (1) HK1048216A1 (en)
MX (1) MXPA02000110A (en)
RU (1) RU2002101922A (en)
TW (1) TW492242B (en)
WO (1) WO2001001670A1 (en)

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001061449A2 (en) * 2000-02-16 2001-08-23 Telefonaktiebolaget Lm Ericsson (Publ) Specially formatted paper based applications of a mobile phone
US6340118B1 (en) 1999-12-16 2002-01-22 Xerox Corporation Exclusive or cross-coupled framing codes for self-clocking glyphs
WO2002075628A1 (en) * 2001-03-21 2002-09-26 Anoto Ab Method and device for issuing and redeeming gift certificates on an e-commerce site
US6678425B1 (en) 1999-12-06 2004-01-13 Xerox Corporation Method and apparatus for decoding angular orientation of lattice codes
US6714677B1 (en) 1999-12-17 2004-03-30 Xerox Corporation Use of correlation histograms for improved glyph decoding
US6783069B1 (en) 1999-12-06 2004-08-31 Xerox Corporation Method and apparatus for implementing a camera mouse
US6880755B2 (en) 1999-12-06 2005-04-19 Xerox Coporation Method and apparatus for display of spatially registered information using embedded data
US6993655B1 (en) 1999-12-20 2006-01-31 Xerox Corporation Record and related method for storing encoded information using overt code characteristics to identify covert code characteristics
US7079667B2 (en) 2000-12-19 2006-07-18 Xerox Corporation Method and apparatus for implementing occlusion glyph code tilings
EP1681621A1 (en) 2005-01-12 2006-07-19 Leapfrog Enterprises, Inc. Device with user interface having interactive elements on a writable surface
US7281664B1 (en) 2005-10-05 2007-10-16 Leapfrog Enterprises, Inc. Method and system for hierarchical management of a plurality of regions of an encoded surface used by a pen computer
US7374087B1 (en) 2005-07-29 2008-05-20 Leapfrog Enterprises, Inc. Method, apparatus and system for conveying cartridge notification
US7428990B1 (en) 2004-12-22 2008-09-30 Leapfrog Enterprises, Inc. Capacitive sensing of media information in an interactive media device
US7453447B2 (en) 2004-03-17 2008-11-18 Leapfrog Enterprises, Inc. Interactive apparatus with recording and playback capability usable with encoded writing medium
EP1269396B1 (en) * 2000-03-21 2008-12-10 Anoto AB Apparatus and methods relating to images
US7493250B2 (en) 2000-12-18 2009-02-17 Xerox Corporation System and method for distributing multilingual documents
US7549596B1 (en) 2005-07-29 2009-06-23 Nvidia Corporation Image bearing surface
US7562822B1 (en) 2005-12-30 2009-07-21 Leapfrog Enterprises, Inc. Methods and devices for creating and processing content
US7621441B1 (en) 2004-12-22 2009-11-24 Leapfrog Enterprises Interactive device using capacitive sensor array for joint page identification and page location determination
US7661592B1 (en) 2005-06-08 2010-02-16 Leapfrog Enterprises, Inc. Interactive system including interactive apparatus and game
US7698640B2 (en) 2004-08-04 2010-04-13 Leapfrog Enterprises, Inc. User interactive journal
US7792365B2 (en) 2003-09-10 2010-09-07 Hewlett-Packard Development Company, L.P. Methods and apparatus for generating images
US7831933B2 (en) 2004-03-17 2010-11-09 Leapfrog Enterprises, Inc. Method and system for implementing a user interface for a device employing written graphical elements
US7847942B1 (en) 2006-12-28 2010-12-07 Leapfrog Enterprises, Inc. Peripheral interface device for color recognition
US7853193B2 (en) 2004-03-17 2010-12-14 Leapfrog Enterprises, Inc. Method and device for audibly instructing a user to interact with a function
US7865043B2 (en) 2003-12-16 2011-01-04 Anoto Ab Method, apparatus, computer program and storage medium for recording a movement of a user unit
US7922099B1 (en) 2005-07-29 2011-04-12 Leapfrog Enterprises, Inc. System and method for associating content with an image bearing surface
US7936339B2 (en) 2005-11-01 2011-05-03 Leapfrog Enterprises, Inc. Method and system for invoking computer functionality by interaction with dynamically generated interface regions of a writing surface
US7950588B2 (en) * 2004-06-28 2011-05-31 Anoto Ab Coding and decoding of data
US8269720B2 (en) 2005-02-18 2012-09-18 Finger System, Inc. Input device having the function of recognizing hybrid coordinates and operating method of the same
US8270775B2 (en) 2004-12-13 2012-09-18 Finger System, Inc. System and method of detecting absolute coordinates
US8692212B1 (en) 2012-10-29 2014-04-08 3M Innovative Properties Company Optical digitizer system with position-unique photoluminescent indicia
US8952887B1 (en) 2001-06-20 2015-02-10 Leapfrog Enterprises, Inc. Interactive references to related application
US9068845B2 (en) 2011-12-16 2015-06-30 3M Innovative Properties Company Optical digitizer system with position-unique photoluminescent indicia
US9958954B2 (en) 2012-12-13 2018-05-01 3M Innovative Properties Company System and methods for calibrating a digitizer system
US10753746B2 (en) 2012-11-29 2020-08-25 3M Innovative Properties, Inc. Multi-mode stylus and digitizer system

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60322123D1 (en) * 2003-03-17 2008-08-21 Kenji Yoshida INFORMATION INPUT / OUTPUT METHOD WITH A POINT PATTERN
JP4810918B2 (en) * 2005-08-01 2011-11-09 富士ゼロックス株式会社 Code pattern image generating apparatus and method, code pattern image reading apparatus and method, and code pattern image medium
JP5504525B2 (en) * 2013-05-07 2014-05-28 健治 吉田 Dot pattern
CN103744541B (en) * 2014-01-26 2017-07-04 上海鼎为电子科技(集团)有限公司 Lettering pen, electric terminal and writing system
CN108665040A (en) * 2017-04-02 2018-10-16 田雪松 Coding method based on label
CN108665039B (en) * 2017-04-02 2021-06-11 北京拓思德科技有限公司 Information recording method and medium for information recording

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4330712A (en) * 1979-02-01 1982-05-18 Hajime Industries Ltd. Inspection apparatus for defects on patterns
US5852434A (en) * 1992-04-03 1998-12-22 Sekendur; Oral F. Absolute optical position determination

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4330712A (en) * 1979-02-01 1982-05-18 Hajime Industries Ltd. Inspection apparatus for defects on patterns
US5852434A (en) * 1992-04-03 1998-12-22 Sekendur; Oral F. Absolute optical position determination

Cited By (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6678425B1 (en) 1999-12-06 2004-01-13 Xerox Corporation Method and apparatus for decoding angular orientation of lattice codes
US6783069B1 (en) 1999-12-06 2004-08-31 Xerox Corporation Method and apparatus for implementing a camera mouse
US6880755B2 (en) 1999-12-06 2005-04-19 Xerox Coporation Method and apparatus for display of spatially registered information using embedded data
US6935562B2 (en) 1999-12-06 2005-08-30 Xerox Corporation Operations on images having glyph carpets
US6340118B1 (en) 1999-12-16 2002-01-22 Xerox Corporation Exclusive or cross-coupled framing codes for self-clocking glyphs
US6714677B1 (en) 1999-12-17 2004-03-30 Xerox Corporation Use of correlation histograms for improved glyph decoding
US6993655B1 (en) 1999-12-20 2006-01-31 Xerox Corporation Record and related method for storing encoded information using overt code characteristics to identify covert code characteristics
WO2001061449A2 (en) * 2000-02-16 2001-08-23 Telefonaktiebolaget Lm Ericsson (Publ) Specially formatted paper based applications of a mobile phone
WO2001061449A3 (en) * 2000-02-16 2002-03-14 Ericsson Telefon Ab L M Specially formatted paper based applications of a mobile phone
EP1269396B1 (en) * 2000-03-21 2008-12-10 Anoto AB Apparatus and methods relating to images
US7925495B2 (en) 2000-12-18 2011-04-12 Xerox Corporation System and method for distributing multilingual documents
US7493250B2 (en) 2000-12-18 2009-02-17 Xerox Corporation System and method for distributing multilingual documents
US7079667B2 (en) 2000-12-19 2006-07-18 Xerox Corporation Method and apparatus for implementing occlusion glyph code tilings
WO2002075628A1 (en) * 2001-03-21 2002-09-26 Anoto Ab Method and device for issuing and redeeming gift certificates on an e-commerce site
US8952887B1 (en) 2001-06-20 2015-02-10 Leapfrog Enterprises, Inc. Interactive references to related application
US7792365B2 (en) 2003-09-10 2010-09-07 Hewlett-Packard Development Company, L.P. Methods and apparatus for generating images
US7865043B2 (en) 2003-12-16 2011-01-04 Anoto Ab Method, apparatus, computer program and storage medium for recording a movement of a user unit
US7453447B2 (en) 2004-03-17 2008-11-18 Leapfrog Enterprises, Inc. Interactive apparatus with recording and playback capability usable with encoded writing medium
US7853193B2 (en) 2004-03-17 2010-12-14 Leapfrog Enterprises, Inc. Method and device for audibly instructing a user to interact with a function
US7831933B2 (en) 2004-03-17 2010-11-09 Leapfrog Enterprises, Inc. Method and system for implementing a user interface for a device employing written graphical elements
US7950588B2 (en) * 2004-06-28 2011-05-31 Anoto Ab Coding and decoding of data
US7698640B2 (en) 2004-08-04 2010-04-13 Leapfrog Enterprises, Inc. User interactive journal
US8270775B2 (en) 2004-12-13 2012-09-18 Finger System, Inc. System and method of detecting absolute coordinates
US8267309B1 (en) 2004-12-22 2012-09-18 Leapfrog Enterprises, Inc. Interactive device using capacitive sensor array for joint page identification and page location determination
US7621441B1 (en) 2004-12-22 2009-11-24 Leapfrog Enterprises Interactive device using capacitive sensor array for joint page identification and page location determination
US7428990B1 (en) 2004-12-22 2008-09-30 Leapfrog Enterprises, Inc. Capacitive sensing of media information in an interactive media device
EP1681621A1 (en) 2005-01-12 2006-07-19 Leapfrog Enterprises, Inc. Device with user interface having interactive elements on a writable surface
US8269720B2 (en) 2005-02-18 2012-09-18 Finger System, Inc. Input device having the function of recognizing hybrid coordinates and operating method of the same
US7661592B1 (en) 2005-06-08 2010-02-16 Leapfrog Enterprises, Inc. Interactive system including interactive apparatus and game
US7922099B1 (en) 2005-07-29 2011-04-12 Leapfrog Enterprises, Inc. System and method for associating content with an image bearing surface
US7549596B1 (en) 2005-07-29 2009-06-23 Nvidia Corporation Image bearing surface
US7374087B1 (en) 2005-07-29 2008-05-20 Leapfrog Enterprises, Inc. Method, apparatus and system for conveying cartridge notification
US7281664B1 (en) 2005-10-05 2007-10-16 Leapfrog Enterprises, Inc. Method and system for hierarchical management of a plurality of regions of an encoded surface used by a pen computer
US7936339B2 (en) 2005-11-01 2011-05-03 Leapfrog Enterprises, Inc. Method and system for invoking computer functionality by interaction with dynamically generated interface regions of a writing surface
US7562822B1 (en) 2005-12-30 2009-07-21 Leapfrog Enterprises, Inc. Methods and devices for creating and processing content
US7847942B1 (en) 2006-12-28 2010-12-07 Leapfrog Enterprises, Inc. Peripheral interface device for color recognition
US9068845B2 (en) 2011-12-16 2015-06-30 3M Innovative Properties Company Optical digitizer system with position-unique photoluminescent indicia
US9557827B2 (en) 2011-12-16 2017-01-31 3M Innovative Properties Company Optical digitizer system with position-unique photoluminescent indicia
US8692212B1 (en) 2012-10-29 2014-04-08 3M Innovative Properties Company Optical digitizer system with position-unique photoluminescent indicia
WO2014070478A1 (en) * 2012-10-29 2014-05-08 3M Innovative Properties Company Optical digitizer system with position-unique photoluminscent indicia
US9075452B2 (en) 2012-10-29 2015-07-07 3M Innovative Properties Company Optical digitizer system with position-unique photoluminescent indicia
US9836164B2 (en) 2012-10-29 2017-12-05 3M Innovative Properties Company Optical digitizer system with position-unique photoluminescent indicia
US10753746B2 (en) 2012-11-29 2020-08-25 3M Innovative Properties, Inc. Multi-mode stylus and digitizer system
US9958954B2 (en) 2012-12-13 2018-05-01 3M Innovative Properties Company System and methods for calibrating a digitizer system

Also Published As

Publication number Publication date
HK1048216A1 (en) 2003-03-21
KR20020033111A (en) 2002-05-04
TW492242B (en) 2002-06-21
BR0011955A (en) 2002-03-12
EP1197065A1 (en) 2002-04-17
MXPA02000110A (en) 2003-07-21
JP2003503905A (en) 2003-01-28
CN1359587A (en) 2002-07-17
AU6038400A (en) 2001-01-31
AU752626B2 (en) 2002-09-26
RU2002101922A (en) 2003-08-10
CA2377187A1 (en) 2001-01-04

Similar Documents

Publication Publication Date Title
EP1197065A1 (en) Recording of information
US6666376B1 (en) Calendar
US6570104B1 (en) Position determination
US7422154B2 (en) Apparatus and methods relating to image coding
US6529645B2 (en) Recording method and apparatus
US6502756B1 (en) Recording of information
CA2374811C (en) Position determination
US6548768B1 (en) Determination of a position code
US7600693B2 (en) Information code including redundant information providing copy protection
WO2001071643A1 (en) Position information
AU5263500A (en) Recording of information
EP1913526A1 (en) Method and system for combining a position and information code
AU2568001A (en) Charge card purchase
EP1269396B1 (en) Apparatus and methods relating to images
SE517058C2 (en) Scanning method for recording text

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 00809739.9

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ CZ DE DE DK DK DM DZ EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 60384/00

Country of ref document: AU

WWE Wipo information: entry into national phase

Ref document number: 2377187

Country of ref document: CA

Ref document number: 2000946659

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: PA/a/2002/000110

Country of ref document: MX

WWE Wipo information: entry into national phase

Ref document number: 1020017016798

Country of ref document: KR

ENP Entry into the national phase

Ref document number: 2002 2002101922

Country of ref document: RU

Kind code of ref document: A

WWP Wipo information: published in national office

Ref document number: 2000946659

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 1020017016798

Country of ref document: KR

WWG Wipo information: grant in national office

Ref document number: 60384/00

Country of ref document: AU

WWW Wipo information: withdrawn in national office

Ref document number: 2000946659

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1020017016798

Country of ref document: KR