CN100565432C

CN100565432C - The orientation sensor device

Info

Publication number: CN100565432C
Application number: CNB018194753A
Authority: CN
Inventors: 保罗·拉普斯顿; 卡·西尔弗布鲁克
Original assignee: Silverbrook Research Pty Ltd
Current assignee: Silverbrook Research Pty Ltd
Priority date: 2000-11-25
Filing date: 2001-11-26
Publication date: 2009-12-02
Anticipated expiration: 2021-11-26
Also published as: EP1350220A1; ZA200404947B; AU2328902A; JP2004530957A; KR20030061408A; ZA200304230B; JP3844736B2; WO2002042993A1; SG128483A1; KR100552018B1; IL156085A; IL156085A0; CN101187839B; CN1498389A; AU2002223289B2; CN101187839A; EP1350220A4

Abstract

The invention provides a kind of sensing equipment, this sensing equipment can produce directional data at it when placing or moving with certain surface; Described directional data can be indicated the direction of sensing equipment with respect to described surface; Has the coded data of arranging on the described surface with ad hoc fashion; When described coded data during by above-mentioned sensing equipment sensing, can direction indication; Described sensing equipment comprises: shell, be configured to use at least a portion coded data to produce the direction sensing device of directional data and the communicator that is configured to directional data is sent to a computer system.

Description

The orientation sensor device

Technical field

The present invention usually about with the mthods, systems and devices of computer interactive.The present invention is especially in regard to a kind of its sensor device with respect to self orientation on surface of when being moved or placing with respect to surface sensing that is used for.

The present invention has been mainly used in by development and has allowed a large amount of users that distribute mutual by printed matter and optical sensor and networked information, thereby obtains mutual printed matter as required by the high color printer.Though the present invention mainly with reference to the such use explanation, should be noted that the present invention is not limited in above-mentioned field and uses in this article.

Common pending application

The whole bag of tricks relevant with the present invention, system and device disclose in following common pending application/granted patent that applicant of the present invention or procurator and this statement are declared simultaneously:

09/721,895，09/721,8944，09/722,174，

09/721,896，09/722,148， 09/722,146，

09/721,861，6,741,871， 09/722,171，

09/721,858，09/722,142， 09/722,087，

09/722,141，09/722,175， 09/722,147，

09/722,172，09/721,893， 09/722,088，

09/721,862，6,530,339， 6,631,897，

The announcement of these common pending applications in mutual ginseng mode comprehensively at this.Each is used and all adopts its case temporary mark.

The whole bag of tricks relevant with the present invention, system and device disclose in the following common pending application/granted patent of declaring on October 20th, 2000 applicant of the present invention or procurator:

09/693,415，09/693,219，09/693,280，

09/693,515，09/693,705，09/693,647，

09/693,690，09/693,593，6,474,888，

6,627,870， 6,724,374， 09/696,514，

6,454,482， 09/693,704，6,527,365，

6,474,773， 6,550,997

The whole bag of tricks relevant with the present invention, system and device disclose in the following common pending application/granted patent of declaring on September 15th, 2000 applicant of the present invention or procurator:

6,679,420，09/669,599，09/663,701，

6,720,985

The whole bag of tricks relevant with the present invention, system and device disclose in the following common pending application/granted patent of declaring on June 30th, 2000 applicant of the present invention or procurator:

09/609,139，09/608,970，6678,499， 09/607,852，09/607,656，6,766,942，

09/607,843，09/607,605，09/608,178，09/609,553，09/609,233，09/609,149，

09/608,022，09/607,844，6,457,883， 09/608,920，09/607,985，6,398,332，

6,394,573， 6,622,923

The whole bag of tricks relevant with the present invention, system and device disclose in the following common pending application/granted patent of declaring on May 23rd, 2000 applicant of the present invention or procurator:

09/575,197，09/575,195，09/575,159，09/575,132，

09/575,123，09/575,148，09/575,130，09/575,165，

09/575,153，09/575,118，09/575,131，09/575,116，

09/575,144，09/575,139，09/575,186，6,681,045，

6,728,000， 09/575,145，09/575,192，09/575,181，

09/575,193，09/575,183，09/575,160，09/575,150，

09/575,169，6,644,642， 6,502,614， 6,622,999

6,669,385， 6,549,935， 09/575,187，6,727,996，

6,591,884， 6,439,706， 6,760,119， 09/575,198，

6,290,349， 6,428,155， 6,785,016， 09/575,174，

09/575,163，6,737,591， 09/575,154，09/575,129，

09/575,124，09/575,188 09/575,189，09/575,162，

09/575,172，09/575,170，09/575,171，09/575,161，

6,428,133， 6,526,658， 6,315,699， 6,338,548，

6,540,319， 6,328,431， 6,328,425， 09/575,127，

6,383,833， 6,464,332， 6,390,591， 09/575,152，

6,328,417， 6,409,323， 6,281,912， 6,604,810，

6,318,920， 6,488,422， 09/575,108，09/575,109，

09/575,110.

Background technology

At present, the user of computer system uses the monitor of display message and keyboard and/or the mouse and the system interaction of input information usually.Though this interface is very powerful, it is huger, and is not portable.The information of printing on paper is easier to read, and is also more portable than the information that shows on computer monitor.But different with keyboard or mouse is that the pen on the paper lacks the ability mutual with computer software usually.

Summary of the invention

Goal of the invention

An object of the present invention is the pen on the paper and the combination of advantages of computer system.

The present invention is about a kind of sensor device that is used for producing orientation data when moving or placing with respect to the surface, orientation data indication sensor device is with respect to the orientation on surface, described surface has coded data disposed thereon, described coded data is orientation-indicating when sensed apparatus senses, and described sensor device comprises:

Shell;

Be configured to use at least some described coded datas to produce the orientation sensing apparatus of orientation data; With

Be configured to orientation data is sent to the communicator of computer system.

In preferred embodiment of the present invention, orientation data indication shell is with respect to deflection, inclination and/or the rolling on described surface.

Preferably, described sensor device comprises the moving sensing device that is used for producing mobile data when it is mobile with respect to described surface, is configured to mobile data is sent to the communicator of computer system.

Also be preferred, described sensor device also comprises a kind of area identification sensing apparatus, this area identification sensing apparatus is configured to use the area identification data of at least some coded data sensing indicating area signs when this equipment moves or places with respect to the zone on described surface, described communicator is configured to computer system transit area identification data.

Described orientation sensing apparatus preferably dynamically detects the orientation of shell with respect to described surface when described shell moves.Described shell can be elongated shape, and it can be by user's handling.In an example of the present invention, shell is the shape of pen.Described shell can provide a label nib, be used for the described surface of label, but this is dispensable.

By catching orientation and mobile data simultaneously, this system can be used for verifying the idiograph.Replacedly, the oriented signal of kinetic measurement can enable described shell and is used as control lever (joystick).For example, this control lever can be used for the three-dimensional software application.It should be noted that described orientation sensing apparatus must be with the orientation of all three-dimensional sensing shells.Only detecting tilts may be fully, because some application may not need 3 D tropism information.For example, described shell can be used to an aspect of opertaing device linearly, for example by change the volume that tilts to control light intensity or loudspeaker between 0 °-90 °.

Described rolling, inclination and deflection can be calculated by the perspective distortion and the rotation that detect coded data.

At first, described equipment can be used for determining when this device at first puts on described surface and when leave the surface, applies and mobile " stroke " that be defined as in Freehandhand-drawing of strength between removing in strength.The strength data message can add timestamp.

Described evaluation method selecting optimal equipment is the independent utensil that comprises above-mentioned appropriate device.It can be an Any shape, but preferably contact pilotage or lip pencil.

This device be used for the described surface of Freehandhand-drawing information labels, but this not necessarily preferably in conjunction with a label point.

This device expects preferably and is used for computer system alternately that described computer system can Be Controlled and the Freehandhand-drawing information (can be figure or literal) can interpreting user imported by described equipment.Preferably, described sensor device is configured to the equipment identification information that the described equipment of unique identification is provided.Therefore, described computer system can use this information to identify described equipment.

Only be the description of the embodiment of the invention with reference to the accompanying drawings for example from following, the features and advantages of the present invention are with apparition.

Description of drawings

Described herein now preferred embodiment of the present invention and other example are only to pass through nonrestrictive example, be described with reference to the accompanying drawings, wherein:

Fig. 1 is netpage and its online page of synoptic diagram that concerns between describing that sampling is printed.

Fig. 2 is the mutual synoptic diagram between netpage pen, netpage printer, netpage page or leaf server and the netpage application server.

Fig. 3 has shown by the netpage server of the network interconnection and the set of printer.

Fig. 4 is the netpage of printing and the synoptic diagram of the higher structure that its online page or leaf is described.

Fig. 5 a is the planimetric map that shows the netpage label construction.

Fig. 5 b is the planimetric map of the relation between the visual field of one group of label shown in the displayed map 5a and netpage pen type netpage sensor device.

Fig. 6 a is the planimetric map that shows the another kind of structure of netpage label.

Fig. 6 b is the planimetric map of the relation between the visual field of one group of label shown in the displayed map 6a and netpage pen type netpage sensor device.

Fig. 6 c is the planimetric map of the arrangement of 9 labels among the displayed map 6a, and target is wherein shared between adjacent label.

The planimetric map of Fig. 6 d has shown the alternation sum rotation of the symbol of 4 code words of label shown in Fig. 6 a.

Fig. 7 is the process flow diagram of label image processing and decoding algorithm.

Fig. 8 is the skeleton view of the netpage pen tag senses visual field cone relevant with it.

Fig. 9 is the perspective exploded view of the netpage pen shown in Fig. 8.

Figure 10 is the schematic block diagram of a controller that is used for the netpage pen of Fig. 8 and Fig. 9.

Figure 11 is the skeleton view of wall-hanging netpage printer.

Figure 12 is the section by the length of the netpage printer among Figure 11.

Figure 12 a is the partial enlarged drawing of Figure 12, and it has shown the part of duplexing print engine and rubber tire assembly.

Figure 13 is the detailed view of the print engine of the netpage printer in print cartridge, China ink, air and glue path and Figure 11 and 12.

Figure 14 is the schematic block diagram that is used for the printer controller of the netpage printer shown in Figure 11 and 12.

Figure 15 is duplexing print engine controller and the Memjet relevant with the printer controller shown in Figure 14 ^TMThe schematic block diagram of printhead.

Figure 16 is the schematic block diagram of the print engine controller shown in Figure 14 and 15.

Figure 17 is to use the single Memjet in the netpage of for example Figure 10-12 printer ^TMThe skeleton view of type element.

Figure 18 is Memjet ^TMThe a fraction of skeleton view of arrays of printing elements.

A series of skeleton views of Figure 19 have shown the Memjet among Figure 13 ^TMThe working cycle of type element.

Figure 20 is page width Memlet ^TMThe skeleton view of one short section of printhead.

Figure 21 is the synoptic diagram of a user class diagram.

Figure 22 is the synoptic diagram of a printer class diagram.

Figure 23 is the synoptic diagram of a class figure.

Figure 24 is the synoptic diagram of an application class figure.

Figure 25 is the synoptic diagram that a document and page or leaf are described class figure.

Figure 26 is the synoptic diagram of a document and page or leaf entitlement class figure.

Figure 27 is the synoptic diagram of an element terminal specialization class figure.

Figure 28 is the synoptic diagram of a static elements specialization class figure.

Figure 29 is the synoptic diagram of a hyperlink element class figure.

Figure 30 is the synoptic diagram of a hyperlink element specialization class figure.

Figure 31 is the synoptic diagram of a hyperlink category figure.

Figure 32 is the synoptic diagram of a list class figure.

Figure 33 is the synoptic diagram of a black class figure of numeral.

Figure 34 is the synoptic diagram of a field element specialization class figure.

Figure 35 is the synoptic diagram of a check box field class figure.

Figure 36 is the synoptic diagram of the text field class figure.

Figure 37 is the synoptic diagram of a signature field class figure.

Figure 38 is the process flow diagram of an input Processing Algorithm.

Figure 38 a is the detail flowchart of a step of the process flow diagram among Figure 38.

Figure 39 is the synoptic diagram of a page or leaf server command element class figure.

Figure 40 is the synoptic diagram of a resource description class figure.

Figure 41 is the synoptic diagram of the favorites list class figure.

Figure 42 is the synoptic diagram of a history list class figure.

Figure 43 is a synoptic diagram of subscribing to delivering protocol.

Figure 44 is the synoptic diagram of hyperlink request class figure.

Figure 45 is the synoptic diagram of hyperlink activation agreement.

Figure 46 is the synoptic diagram of list committing protocol.

Figure 47 is a synoptic diagram of service charge payment arrangement.

Figure 48 is one group of synoptic diagram that constitutes the radial wedge of symbol.

Figure 49 is the synoptic diagram of ring A and ring B allocation of symbols scheme.

Figure 50 is the synoptic diagram of first ring C and ring D allocation of symbols scheme.

Figure 51 is the synoptic diagram of second ring C and ring D allocation of symbols scheme.

Figure 52 is the synoptic diagram of triangle label packing.

Figure 53 is an icosahedral skeleton view.

Figure 54 is that a frequency is 20 geodesic skeleton views of 3.

Figure 55 is a minimum label synoptic diagram at interval.

Figure 56 is the minimum label synoptic diagram at interval that can avoid overlapping.

Figure 57 is the synoptic diagram that first label inserts situation.

Figure 58 is the synoptic diagram that second label inserts situation.

Figure 59 is the synoptic diagram that the 3rd label inserts situation.

Figure 60 is the synoptic diagram that the 4th label inserts situation.

Figure 61 is the synoptic diagram with respect to the pen orientation on surface.

Figure 62 is the synoptic diagram of an inclined geometric shapes.

Figure 63 is a synoptic diagram of rolling geometric configuration.

Figure 64 is the synoptic diagram of a coordinate space, and this coordinate space has shown the physical axis and the optical axis of pen.

Figure 65 is the synoptic diagram of bent tip geometric configuration.

Figure 66 is the mutual synoptic diagram between sample frequency and the label frequency.

Figure 67 is the synoptic diagram of the light path of pen.

Figure 68 is the process flow diagram of pen stroke capture algorithm.

Figure 69 is the synoptic diagram of original figure China ink class figure.

Figure 70 is the table that comprises the equation that is numbered 1-10.

Figure 71 is the table that comprises the equation that is numbered 11-20.

Figure 72 is the table that comprises the equation that is numbered 21-26.

Figure 73 is the table that comprises the equation that is numbered 27-34.

Figure 74 is the table that comprises the equation that is numbered 35-41.

Figure 75 is the table that comprises the equation that is numbered 42-44.

Figure 76 is the table that comprises the equation that is numbered 45-47.

Figure 77 is the table that comprises the equation that is numbered 48-51.

Figure 78 is the table that comprises the equation that is numbered 52-54.

Figure 79 is the table that comprises the equation that is numbered 55-57.

Figure 80 is the table that comprises the equation that is numbered 58-59.

Figure 81 is the table that comprises the equation that is numbered 60-63.

Figure 82 is the table that comprises the equation that is numbered 64-74.

Figure 83 is the table that comprises the equation that is numbered 75-86.

Figure 84 is the table that comprises the equation that is numbered 87-99.

Figure 85 is the table that comprises the equation that is numbered 100-111.

Figure 86 is the table that comprises the equation that is numbered 112-120.

Figure 87 is the table that comprises the equation that is numbered 121-129.

Figure 88 is the table that comprises one group of degeneracy form of equation 64 to 71.

Figure 89 has shown the first that comprises the table that is used for zero inclination and zero condition of rolling and special processing.

Figure 90 is the second portion of the table among Figure 89.

Embodiment

Annotate: Memjet ^TMIt is the trade mark that Australian Silverbrook studies company limited.

In a preferred embodiment, the present invention is configured to work with the netpage networked computer system, and the netpage networked computer system will be described in more detail below.It will be appreciated that, be not that each implements all must to adopt following relevant with ultimate system all or even most specific detail and expansion.But in this article, we illustrate this system in most complete mode, like this, when the reader attempts to understand the context of preferred embodiment that work of the present invention is wherein arranged and aspect, reduce the demand to external reference.

Generally speaking, the preferred form of netpage system utilizes a kind of computer interface that shines upon format surface, that is to say, comprises the physical surface to the reference of the mapping on the surface of safeguarding in the computer system.Mapping reference can be by suitable sensor device inquiry.Depend on specific enforcement, described mapping reference can be encoded visibly or invisibly, and be defined as such mode be the lip-deep local inquiry of described mapping in mapping with different mapping in the clear and definite mapping reference of generation.Described computer system can comprise about shining upon the information of lip-deep feature, and this information can be retrieved according to the mapping reference that the sensor device that uses with the mapping surface provides.Therefore, the information of retrieval can be taked to represent the form of the action of operator's initiation to come the mutual of operation response person and surface characteristics by computer system.

In a kind of preferred form, the netpage system depends on the mutual of the generation of netpage and people and netpage.These are the pages or leaves that are printed on text, figure and image on the common paper, but it is worked as mutual webpage.Information on each page is used the sightless substantially China ink coding of naked eyes.But, thereby China ink and described coded data can and send to the netpage system by an optical imagery sensing.Base material beyond the paper can use.Coded message in the preferred embodiment is that a kind of infrared absorption China ink is realized, and therefore can use a kind of optical sensor to infrared-sensitive.If necessary, can also use other wavelength or optics sensing detection technology in addition; A selection is to use magnetic China ink and sensor.

In a preferred form of the invention, can use active button and hyperlink on described each page of pen click, to send the preferential signal of selecting from network requests information or to the webserver.In an example of the present invention, the handwritten text on the netpage is automatically recognized and is converted to computer version in the netpage system, allows list to be filled.In other embodiments of the invention, the signature that writes down on netpage is automatically verified, allows e-commerce transaction to be authorized safely.

As shown in Figure 1, the netpagel of printing can represent by user's mutual list that physics is filled on the page or leaf of printing or by the communication between pen and the netpage system with " electronics " the mutual list of filling.Following example has shown " request " list that comprises a name and address field and a submit button.This netpage comprises the graph data 2 that uses visible China ink printing and uses invisible China ink to print to the coded data 3 of the set of label 4.The page or leaf description 5 of the correspondence of storing on the netpage network has illustrated each element of netpage.Particularly, it has described the type and the spatial dimension (zone) of each interactive elements (being textview field or the button in this example), thereby allows the netpage system correctly to explain input by netpage.For example, submit button 6 has a zone 7, and this zone is corresponding to the corresponding spatial dimension of Fig. 8 of correspondence.

As shown in Figure 2, netpage pen 101 (this a preferred form is describing in detail shown in Fig. 8 and Fig. 9 and hereinafter) can operate in combination with netpage printer 601, and this printer is the printing device that is used for family, office or moves the Internet connection of using.This pen is wireless, and can communicate by letter safely by a short-range wireless link 9 with the netpage printer.If desired, can also use line or infrared transmitter that this pen and described system are coupled together, although both yes-no decision ground limit usability.

A preferred form of Netpage printer 601 is describing in detail shown in Figure 11-13 and hereinafter.Netpage printer 601 can be termly or is transmitted personalized newspaper, magazine, catalogue, pamphlet and other publication when needed, being printed with the same high quality with mutual netpage of these publications.Different with personal computer is, the netpage printer be a kind of for example can wall-be installed near the morning news zone of at first being consumed (as in user's kitchen, by the breakfast table or near the start position of housework work every day).It also has desktop type, various ways such as desk-top, portable and miniature.

The Netpage that prints at its place, consumption place has made up the ease for use of paper and the promptness and the interactivity of interactive media.

As shown in Figure 2, netpage pen 101 is mutual with the coded data on the netpage 1 that prints, and also sends this to netpage printer alternately by short-range wireless link 9.Printer 601 is used for explaining sending to relevant netpage page or leaf server 10 alternately.In appropriate circumstances, the page or leaf server sends corresponding message to the appliance computer software that operates on the netpage application server 13.Application server can in turn be sent in the response of printing on the origin printer.

In preferred embodiment of the present invention, by described netpage system and ink-jet (Memjet based on high speed Micro Electro Mechanical System (MEMS) ^TM) the printer coupling, thereby make the netpage system convenient significantly.In a kind of preferred form of this technology, high speed and high-quality printing become and more allow the consumer afford relatively.In its preferred form, the netpage publication has the light page or leaf of traditional journalistic physical characteristics as one group of letter size printing with full color on two-sided, and they are convenient to navigate easily and comfortable processing by stapled together.

The Netpage printer has utilized the availability of the growth of broadband internet access.95% family in the U.S. can use cable service, provide wire line MODEM service that broadband the Internet inserts for wherein 20% be available.The Netpage printer can also use slower connection, but this connection has long delivery time or lower picture quality or both.In fact, the netpage system can use existing consumer's ink-jet and laser printer to be enabled, although described system will be slowlyer operate and will be more unacceptable from consumer's viewpoint therefore.In other example of the present invention, it is online that the netpage system is in charge of special inside.Still in other example, the netpage system is in charge of on the single computing machine or on the computer enabled equipment such as printer.

Netpage publisher server 14 on the Netpage network is configured to transmit print quality to the netpage printer and announces.Periodically announce the netpage printer that automatically passes to reservation by program request and multicast Internet protocol.Personalized announcement is filtered and formats according to each user profiles.

Can be the Netpage printer configuration to support the pen of any amount, and one-pen can be worked with the netpage printer of any amount.In preferred realization of the present invention, every netpage pen all has unique identifier.One family can have the set of coloured netpage pen, and every pen is distributed to each member of family.Suppose that the pen that is assigned with is only used by corresponding kinsfolk, this allows each user to safeguard the different profile of announcing server or application server about netpage.But, described in hereinafter, can also use other device to come identifying user.

The netpage pen can also be registered to netpage registrar 11, and links with one or more payment card account.Like this, allow to use the netpage pen to authorize electronic payment safely.The Netpage registrar compares the signature of signature of being caught by the netpage pen and registration in the past, and this allows it to verify the identity of user for e-commerce server.Other bio-identification also can be used to identity verification.A kind of netpage pen of version comprises finger scan, and it is verified in a similar fashion by the netpage registrar.

Though the netpage printer can transmit periodical such as morning newspaper under the situation that does not have the user to get involved, it can be configured to always not transmit uncalled spam.In its preferred form, its transmission is from the periodical in sources that subscribe or other mandates.In this respect, the netpage printer is different with facsimile recorder or email account, and it is visible for any spam mailer who knows telephone number or e-mail address.To external user as seen yes-no decision ground also can make total system, and perhaps each user also can be provided the ability that the printer of oneself is exposed to external user.This can realize by the external user of selecting to allow to send spam.

1.NETPAGE system architecture

Each object model in the system uses unified modeling language (UML) class figure to describe.Class figure is made up of the set of the object class that connects by relation, and is interested in two kinds of relations here: related and extensive.Certain relation between the related representative object (being the example of class).Extensive and actual class is relevant, can enough following manner understand: if class is considered to the set of such all objects, and class A is the extensive of class B, and B is the subclass of A simply so.

Each class is depicted as the rectangle that mark has such title.It comprises the attribute list (and separating with a horizontal line between the title) of class, and generic operation tabulation (and separating with a horizontal line between the attribute list).But, among the class figure below never to the operation modeling.

Association is depicted as the lines that connect two classes, and it has this related multiplicity at arbitrary end place mark alternatively.The multiplicity of acquiescence is one.Asterisk (*) indication multiplicity " some ", promptly zero or more.Each association has marked its title alternatively, and the role of corresponding class is also arranged at arbitrary end place mark alternatively.Open rhombus represent the polymerization association (" be ... a part (is-part-of) "), and be depicted in the polymerizer end place of related lines.

Extensive relation (" being a kind of ... (is-a) ") is depicted as the solid line that connects two classes, has arrow (open leg-of-mutton form) at extensive end place.

When class figure was divided into a plurality of figure, in all figure (define such master map except), any class that is replicated illustrated with dotted outline.It is sentenced attribute and illustrates being defined.

1.1NETPAGE

Netpages is the basis of setting up the netpage network on it.They for release news and interactive services a kind of user interface based on paper is provided.

Netpage comprises type face (or other surf zone), and this type face invisibly is equipped with the label to the reference of the online description of page or leaf.Label can be printed on the surface of page or leaf, also can be printed in the surface of page or leaf, can be in the sublayer of page or leaf or on, perhaps may be incorporated in the page or leaf.Online page or leaf is described and is safeguarded incessantly by netpage page or leaf server.Page or leaf is described the visible layout and the content of explanation page or leaf, comprises text, figure and image.It also describes the input element on the page or leaf, comprises button, hyperlink and input field.Though netpage (and relevant page or leaf is described) is obviously different, the page or leaf of different netpage is described and can be shared assembly, as image.The page or leaf of each netpage is described and can be comprised quoting these common components.The mark that Netpage allows to use the netpage pen to make is in its surface caught simultaneously and is handled by the netpage system.

A plurality of netpage can share identical page or leaf and describe.But in order to allow to be distinguished by the input of other same page, each netpage is assigned with unique page identifiers.This page or leaf ID has enough precision, to distinguish between the whole netpage that are used for environment for use in imagination.If environment is little, so described precision do not need with overall situation in the same big.

Each is quoted in the label that is coded in printing for page or leaf is described.This tag identifier its thereon unique page or leaf appears, thereby and indirectly the sign page or leaf describe.In preferred embodiment, described label also identifies himself position on described page or leaf.The characteristic of described label illustrates in greater detail hereinafter.

Label is any substrate that is printed on infrared external reflection with the infrared absorption China ink, on for example common paper.Near-infrared wavelength is sightless to human eye, but can be by the solid state image sensor that has suitable wave filter sensing easily.Can use sensor, not need to use wave filter in this case relevant wavelength or a plurality of wavelength sensitive.Other wavelength is used in the time of can be with suitable substrate and sensor.

Label is by the zone in the netpage pen (area) imageing sensor sensing, and is decoded, and is sent to netpage system (preferably by nearest netpage printer) by the data of described label coding.Pen is wireless, and by short-range wireless link and netpage printer communication.Label is for fully little and be provided with thick and fast, though make when on page or leaf, clicking described pen can ground at least one label of imaging reliably.Importantly owing to be stateless alternately, with shown in page or leaf each mutual, described identification label and extract page or leaf ID page or leaf and position.But label is by error correction ground coding, so that they partly tolerate surface distress.

Netpage page or leaf server is that the netpage page or leaf of each printing is safeguarded unique page or leaf example, and this allows the different set of the value that the input field maintenance customer of its page or leaf for the netpage page or leaf of each printing in describing provide.

Pass between page or leaf description, page or leaf example and the printing netpage ties up among Fig. 4 and illustrates.In a preferred embodiment, page or leaf example and the netpage printer of printing it and ask its netpage user's (if knowing) both are relevant.For the work of the present invention with its citation form, the page or leaf example is not basic with the netpage printer of printing corresponding Physical Page or with page or leaf requested page or described for the netpage user of its printing is associated.

1.2NETPAGE label

1.2.1 label data content

In a preferred form, it comes across wherein zone and the position of label in the zone each tag identifier.Label can also comprise relevant with zone as a whole or relevant with this label flag (flag).One or more flag bits can for example send signals to tag senses equipment so that feedback to be provided, the function that this feedback expression is associated about the immediate area of this label, and do not need the description of sensor device with reference to (refer to) this zone.For example, when a netpage pen was in a hyperlink zone, it can illuminate " zone of action " LED.

Hereinafter we will explain in more detail, and in a preferred embodiment, each label comprises the constant structure that is easy to discern, and this structure can help initial detecting, and help to minimize the influence of any distortion (warp) that is caused by surface or detection process.This label (tile) whole page or leaf that preferably tiles, and for enough little, and being set to thick and fast: even when on page or leaf, clicking, still can be reliably with at least one label imaging.Importantly, owing to be stateless alternately, with page or leaf each mutual the time, identifying page ID and position.

In preferred embodiment, the zone of label institute reference is consistent with whole page or leaf, and therefore the area I D that is coded in the label is synonym with page ID that page or leaf thereon appears in label.In other embodiments, the zone of label reference can be any one subarea on page or leaf or other surface.For example, what it can be with interactive elements is regional consistent, and area I D can directly identify interactive elements in this case.

Each label comprises 16 label ID, at least 90 area I D usually, and many flag bits.Suppose that maximum label density is 64 per square inch, 16 label ID support the area size of 1024 square inches of as many as.Can shine upon bigger zone continuously by using neighboring region and shining upon simply, and need not increase label ID precision.Difference between area I D and the label ID mainly is a kind of convenience.In most of the cases, the two connection can be considered as a kind of overall unique tags ID.On the contrary, it also can introduce structure easily in label ID, for example defines the x coordinate and the y coordinate of label.90 area I D allow 2 ⁹⁰(～10 ²⁷Perhaps ten million 100,000,000) individual different zone is identified uniquely.The all right containing type information of label, and the regional label that can also be marked with the mixing of tag types.For example, a zone can label with the label of a group coding x coordinate and the label of another group and the described first coding y coordinate that interlocks.It should be understood that the precision of area I D and label ID can be higher or lower than above-mentioned precision according to the environment of wanting using system.

1.2.2 label data coding

In one embodiment, each label comprises 120 information.120 label datas use (15,5) REED-SOLOMON sign indicating number by redundancy encoding.Produce 360 bits of coded like this, comprise 6 code words that each all is 15 4 bit signs.The mistake that (15,5) sign indicating number supports each code word to reach 5 symbols is corrected, and that is to say that it allows that each code word reaches 33% symbol error rate.

Each 4 bit sign mode with spatial coherence in label is expressed, and the symbol of 6 code words is interlocked by ground, space in label.This guarantees the symbol of the minimum number that burst error (influencing the mistake at phase ortho position, a plurality of space) destruction is overall and the symbol of the minimum number in any code word, thus the possibility maximization that burst error can be proofreaied and correct fully.

Can adopt any suitable error-correcting code sign indicating number to replace (15,5) REED-SOLOMON sign indicating number, for example has more or less redundancy, REED-SOLOMON sign indicating number with identical or different symbol and codeword size, another block code (block code) or different types of sign indicating number are as convolutional code, (for example see, Stephen B.Wicker, Error Control Systems for Digital Communicationand Storage, Prentice-Hall 1995, and its content is combined in this by cross reference).

1.2.3 the label construction of physics

The physical representation of the label shown in Fig. 5 comprises fixed

target structure

15,16,17 and variable data zone 18.The fixed target structure allows sensor device (as the netpage pen) tags detected and infers its 3 D tropism with respect to sensor.The data area comprises each expression of the label data of coding.

In order to realize that correct label reproduces, and reproduces label with the resolution of 256 of 256X.When with per inch 1600 dot printings, it is 4 millimeters label that this generation has about diameter.Under this resolution, label be designed to by radius be 16 points " dead zone " around.Because this dead zone also is made of adjacent label, so it has only increased by 16 points to the effective diameter of label.

Label comprises 6 object constructions.Detection ring 15 allows sensor device tags detected initially.Because this ring is an invariable rotary, and because the influence of most of perspective distortion is removed in the simple correction of its aspect ratio, so described ring detects easily.Because the deflection of sensor, axis of orientation 16 allow sensor device to determine the approximate planar orientation of label.Axis of orientation tilts, to produce unique orientation.4 perspective targets 17 allow the two-dimentional accurately perspective transforms of sensor device inference tag, and thus label with respect to the three-dimensional position accurately and the orientation of sensor.

All object constructions all are that redundant ground is big, to improve their insensitivities to noise.

The overall label shape is circular.This optimum label of supporting as wrapping on the irregular triangular lattice is used to tile a non-planar surfaces arbitrarily as being required in other thing.But, also can be arranged in label on the summit of the arbitrary polygon that has n summit, n scope wherein from 3 to infinity, as required.With 15 combinations of circular detection ring, this has made the circular arrangement the best of the data bit in the label.As shown in figure 48, in order to maximize its size, each data bit is by 510 expressions of a radial wedge, described wedge shape be in two radial line 512, one radially inner arc 514 and one radially outer arc 516 be the form in the zone on border.At 1600dpi, each wedge shape 510 has 8 points of minimum dimension, and is designed so that its substrate (being its inner arc 514) equals this minimum dimension at least.The radial height of wedge shape 510 equals minimum dimension all the time.Each 4 bit data symbol is by array 518 expressions of 2 wedge shapes 510 of 2x, as illustrating best among Figure 48.

15 4 bit data symbols of each code word in 6 code words are configured among four concentric symbol ring 18a-18d, as shown in Figure 5, are in the staggered mode as shown in Figure 49-51.The symbol of first to the 6th code word 520-525 is alternately being disposed in the circle of described label is advanced.

Mean space distance between described staggered any two symbols that are designed to maximize same code word.Other arrangements of code word or their data symbol can be used.

The shape of the data symbol in the physical layout of label or each label and/or arrangement are not basic to work of the present invention.Necessary only is that each label is the enough information of wanting of use coding.Redundant use is preferred in the label, but on its basic horizontal, is not real basic to work of the present invention.Similarly can use other label to arrange.The example of other label constructions is described in United States Patent (USP) 5,625,412,5,661,506,5,477,012 and 5,852,434 and PCT application PCT/US98/20597 in, its each content is combined in this in the reference mode.

Mutual in order to support with " the clicking " in the zone that labels by sensor device, no matter sensor device be positioned in the zone where or be in what orientation, sensor device must " be seen " at least one the complete label in its visual field.Therefore, the diameter in the visual field of needed sensor device is necessary for the size and the function at interval of label.

Suppose circular label shape, when label is tiled on the equilateral triangle lattice, can obtain the minimum diameter in the sensor visual field, as shown in Figure 6.

1.2.4 label image is handled and decoding

The label image of the label shown in Fig. 5 is handled and decoding is undertaken by sensor device (netpage pen as shown in Figure 7).When the image that obtains from imageing sensor to catch, the dynamic range of image is determined (20).Then, the center of scope is chosen as the scale-of-two threshold value of image 21.Image is subsequently by fixed limit and be split in the pixel region (being shape 23) of connection (22).Too little and can't represent the shape of label object construction to be abandoned.The size of each shape and barycenter (centroid) are also calculated.

Then, for each shape is calculated (at 24 places) binary shape squares (moment) 25, and these provide foundation for later localizing objects structure.Middle heart shape square is determined and location independent by their person's character, and can easily become and convergent-divergent (scale), aspect ratio and irrelevant to rotation.

Annular object construction 15 is (26) that at first will locate.Annular has the good advantage of work when perspective distortion.Carry out orientation (aspect) standardization and rotate standardization mating by square to each shape.In case its second moment is by standardization, though have an X-rayed abnormal significantly, ring is identification easily also.The reference azimuth of ring and rotation 27 provide useful being similar to for perspective transform together.

Axle object construction 16 is that the next one will be located (28).By the ring standardization be applied to each shape square and the rotation standardization as a result square mate.In case its second moment is by standardization, the axle target is easily discerned.It should be noted that for the ambiguity of two possible orientations eliminating (disambiguate) axle, also need a third moment.Described shape by deliberately to lopsidedness, so that this becomes possibility.It is also to be noted that, after the standardization of having used ring, can only be rotated standardization to the axle target, because perspective distortion may be hidden the axle of a target.Because a deflection 29, the original rotation of axle target provide the useful approximate of label rotation.

Four perspective object constructions 17 are (30) that will locate at last.At this moment, can calculate the good estimation of their position according to they known rotations with spatial relationship, direction of loop and rotation ring and axle target and axle.Mate by the square that the standardization of ring is applied to each shape.In case their second moment is by standardization, circular perspective target is discerned easily, and is used as coupling with the nearest target in each estimated position.The original barycenter of four perspective targets is used as the corner 31 of the foursquare perspective distortion of known dimensions in the Label space, and four Label space are found the solution the perspective transform 33 of inferring (32) eight degrees of freedom with the image space point to the equation of relevant fine understanding (see Heckbert based on finding the solution, P., Fundamentals of Texture Mapping and Image Warping, Master Thesis, Dept.of EECS, U.of California at Berkeley, Technical ReportNo.UCB/CSD 89/516, June 1989, and its content is combined in this by cross reference).

The Label space of being inferred is used for each known data bit positions projection (36) of Label space in image space to the perspective transform of image space, shown in the image space, real-valued (real-valued) position is used to that four relevant neighbors in the input picture are carried out bilinearity and inserts (36).The image threshold 21 that calculated in the past is used for described fixed limit as a result, to obtain final place value 37.

In case obtained 37,6 60 Reed-Solomon code words of whole 360 data bit each decoded (38) in this mode, to produce 20 decoded bit 39, perhaps whole 120 decoded bit.It should be noted that code-word symbol is that order with code word is sampled, thus code word in sampling process by deinterleave impliedly.

As mentioned above, physical tag structure or coded system are not basic to the present invention, and can adopt other physical arrangement of each label.Will be understood that identification and decoding label image depend on the physical arrangement and the system that is used for redundant ground coded data of label with the process of retrieve encoded data.

15 of targets of ring are sought in the subarea of image, and the relation of it and image can guarantee that its (if found) is the part of complete label.If complete label does not have found and successfully decoding, can not be the position of present frame recording pointer so.If the enough processing poweies and the non-ideally minimum visual field 193 are arranged, another kind of strategy relates to seeks another label in present image.

The label data indication that obtains comprises the sign and the position of this label in the zone in the zone of this label.Then, the known spatial relationship between the optical axis of the physical axis of the perspective transform 33 of the observation from label and pen and pen is inferred the exact position 35 of (34) nib the zone and the overall orientation 35 of pen.

1.2.5 another kind of label construction

Above-mentioned label construction be designed to allow the rule tiling of plane surface and non-planar surfaces irregular tiling both.Usually the rule tiling is impossible on non-planar surfaces.Be possible more common plane surface promptly as in the situation on the surface of paper etc. in the tiling of the rule of label, can use the effective label construction of the regular character of utilizing tiling.

Another kind is more suitable for label construction in rule tiling shown in Fig. 6 a.Described another kind of label 4 is foursquare, and has 4 perspective targets 17.It is structurally similar at the label described in the United States Patent (USP) 5051746 to people such as Bennett.This label is represented 60 4 Reed-Solomon symbols 47, is total up to 240.This label is shown a little 48 to each bit table, and each zero-bit is by the representative that lacks of corresponding point.Described perspective target is designed to share between adjacent label, shown in Fig. 6 b and 6c.Fig. 6 b has shown the square tiling and the corresponding minimum visual field 193 of 16 labels, and the diagonal line of two labels must be crossed in this visual field.Fig. 6 c has shown the square tiling of 9 labels, comprises an all position that is used for illustration purpose.

Use (15,7) Reed-Solomon sign indicating number, 112 label datas are encoded redundantly, to produce 240 bits of coded.4 code words are interlocked by ground, space in label, so that the recuperability of burst error is maximized.That suppose employing is foregoing 16 label ID, and this allows to reach 92 area I D.

Because the Data-carrying point 48 of label is designed to not cover consecutive point, so set of tags can not produce and structure like the target class.This is economy also.Therefore described perspective target allows tags detected, so do not need other target.Label image handle as top 1.2.4 described in and carry out, different is that

step

26 and 28 has been omitted.

Though can in label, comprise orientation characteristic to allow the eliminating ambiguity of label, also can in label data, embed orientation data with respect to 4 of sensor possible orientations.For example, 4 code words can be arranged as and make each label orientation comprise a code word that is positioned on this orientation, and shown in Fig. 6 d, wherein each symbol all marks number (1-4) and the position (A-O) of symbol in code word of its code word.Then, the label decoding is included in each orientation and goes up code word of decoding.Each code word can comprise indication, and whether it is the single position of first code word, and it is two of which code word perhaps to comprise indication.The advantage of a kind of method in back is: if, for example, only needing the data content of a code word, so maximum two code words need decoded to obtain required data.Therefore only when in a stroke, not needing to change area I D and when stroke begins this area I of place's decoding D, this situation may occurring.The code word that in a stroke, only need comprise label ID then.And, because the rotation change of sensor device is slow and be predictable in stroke, so, only need usually to a codeword decoding for each frame.

Can save all perspective targets, and rely on data representation from registration.In this case, each place value (or multidigit value) is typically by a clear and definite font (glyph) representative, and promptly vacant value is represented by lacking font.Guarantee that like this data lattice are filled well, thereby allow to identify reliably lattice, and its perspective distortion is detected and be repaired during data sampling subsequently.In order to detect the border of label, each label data must comprise indicia patterns, and must encode these to realize reliable detection redundantly.The expense of the expense of this mark pattern and clear and definite perspective target is similar.A kind of such scheme uses the spot of placing with respect to the various points on lattice summit to represent different fonts, thereby represents different multidigit value (seeing Anoto Technology Description, Anoto April2000).

1.2.6 label mapping

Label decoded to produce area I D, label ID and with respect to a conversion of label.Can be converted at label ID with respect to a position of label before the absolute position in the label area, must know the position of label in the zone.This is provided by label mapping, and the label mapping is that label each label ID in the zone of a handle is mapped to the function of correspondence position.Figure is shown in Figure 22 for the label mapping class, and it is the part of netpage printer class diagram.

Label mapping reflection is with the scheme of label tiling surf zone, and it can change according to surface type.When identical tiling scheme was shared in a plurality of zones that label with identical tag number scheme, they also can share identical label mapping.

The label mapping in zone must be by area I D retrieval.Therefore, given area ID, label ID and a conversion can the Checking label mappings.Label ID can be converted into the absolute label position in the zone, and can be added on the label position with respect to a position of label, to produce an absolute position in the zone.

1.2.7 the scheme of labelling

Two kinds of distinct encoded surface schemes are interesting, and the both uses previously described label construction in this section.Preferred encoding scheme is used " position indication " label as already discussed.Another kind of encoding scheme is used " object indication " label.

The position indicating label comprises label ID, when this label ID is converted by the label mapping relevant with label area, produces unique label position in the zone.Pen is added on this label position with respect to the position of label, to produce the position of pen in the zone.And the position of pen can be used to determine the position of pen with respect to user interface elements, and described user interface elements is in the page or leaf relevant with the zone described.Not only user interface elements itself is identified, and is also identified with respect to the position of user interface elements.Therefore, the position indicating label usually is supported in catching of absolute style footpath in the zone of particular user interface element.

The object indicating label comprises a label ID, and this label ID directly identifies the user interface elements in the page or leaf description relevant with the zone.Therefore all labels in the zone of user interface elements are the identifying user interface element all, and this makes them all identical and can not distinguish.So the object indicating label is not supported catching of absolute style footpath.But they support catching of relative style footpath really.As long as the position sampling frequency exceeds more than 2 times of label frequency that run into, just can determine clearly in a stroke from a position that is sampled to Next displacement.

In any scheme that labels, label and the last relevant visual element collaborative work of netpage as user interaction elements, like this, the user can use suitable sensor device and type face mutual, thereby produces appropriate responsive by the sensor device reading tag data and in the netpage system.

1.3 document is described with page or leaf

In Figure 25 and 26, shown the preferred embodiment of document with page or leaf description class figure.

In the netpage system, document is described three levels.On abstract level, document 836 has a kind of hierarchical structure, and its element terminal 839 is associated with content object 840 (for example text object, text style object, image object etc.).In case document is by with specific page size and when preferably printing on the printer according to specific user's zoom factor, document is coupled with the page number and formatted in addition.In some cases, formative element terminal 835 is relevant with content object, and these content objects are different with the content object of the counterpart terminal element that is relevant to them, is under the relevant situation of style at content object particularly.Each print example of document and page or leaf also is separated to describe, thereby the input that allows to catch by specific page example 830 separates with the input of catching by other example of same page description and is recorded.

Owing on the page or leaf server, have the most abstract document description, allow the user to ask the document copy, and be not compelled to accept the specific format of source document.For example, the user can ask copy by having not the printer of same page size.On the contrary, the existence at the formative document description on the page or leaf server allows the page or leaf server to explain user action on specific type face effectively.

Formative document 834 comprises one group of formative page or leaf and describes 5, and wherein each page description comprises one group of formative element terminal 835.Each formative element has a spatial dimension or zone 58 on page or leaf.This defines the zone of action of input element (as hyperlink and input domain).

Document examples 831 is corresponding with formative document 834.It comprises one group of page or leaf example 830, and it is 5 corresponding that each page example and a page or leaf of formatted document are described.Each page example 830 is described the netpage l of single unique printing, and writes down the page or leaf ID50 of this netpage.If the copy that is requested page or leaf that its representative is isolated, the page or leaf example is not the part of document examples so.

A page or leaf example comprises one group of element terminal example 832.The element example only exists when the situation of its record instance customizing messages.Therefore, there is the hyperlink example, because its record is specific issued transaction ID55 to the page or leaf example for the hyperlink element; There is field instance for field element, because its record is specific input to the page or leaf example.But, do not have the element example for static elements (as text flow).

An element terminal can be static elements 843, hyperlink element 844, field element 845 or page or leaf server command element 846, as shown in figure 27.Static elements 843 can be style element 847, the text flow element 848 that has relevant stylized text object 855, the pictorial element 849 that has relevant pictorial element 856, the graphic element 850 that has relevant Drawing Object 857, the video clipping element 851 that has relevant video clipping object 858 that have relevant style object 854, have the audio clips element 852 of relevant audio clips object 859 or have the script element 853 of relevant scripting object 860, as shown in figure 28.

The page or leaf example can have background field 833, and this background field is used to be recorded in catches on the page or leaf, shall not be applied to any numeral China ink of specific input element.

In a preferred form of the invention, label mapping 811 is by related with each page example, can be converted into position on the page or leaf to allow label on the page or leaf.

1.4NETPAGE network

In a preferred embodiment, a netpage network comprises by the distribution setting of network 19 as netpage page or leaf server 10, netpage registrar 11, netpageID server 12, netpage application server 13, netpage publisher server 14 and the netpage printer 601 of the Internet connection, as shown in Figure 3.

Thereby Netpage registrar 11 be one between recording user, pen, printer, application and the issue relation and to the movable server of authorizing of diverse network.In applied transaction was handled, it carried out authentication and represents the user's of authentication signature agency as one the user.If desired, it also provides the handwriting recognition service.As mentioned above, netpage page or leaf server 10 is being safeguarded with page or leaf and is being described and the relevant permanent message of page or leaf example.The Netpage network comprises the page or leaf server of any amount, a subclass of each page server process page or leaf example.Because the page or leaf server also is each page example maintenance customer input value, client computer (as the netpage printer) can directly send the netpage input to suitable page or leaf server.Pair any this input relevant with corresponding page or leaf description of page or leaf server makes an explanation.

NetpageID server 12 distributes document id 51 as required, and the load balancing of page server is provided by its ID allocative decision.

The distributed name system of Netpage printer internet usage (DNS), or similarly netpage page or leaf ID50 is resolved to the netpage page or leaf network address of server of handling corresponding page or leaf example.

Netpage application server 13 is to administer the server that (host) mutual netpage uses.Netpage publisher server 14 is application servers, and it is to netpage printer issue netpage document.They go through in second joint.

The Netpage server can be in charge of on the multiple network server platform from manufacturer such as IBM, Hewlett-Packard and Sun.A plurality of netpage servers can move on individual host simultaneously, and individual server also can be distributed on a plurality of main frames.Part or all of function that is provided by the netpage server and the function that is particularly provided by ID server and page or leaf server can also or directly provide on LAN (Local Area Network) in netpage equipment such as netpage printer, computer workstation.

1.5NETPAGE printer

Netpage printer 601 is to be registered to the netpage system and as required and by subscribing the equipment print the netpage document.Every printer has unique printer ID 62, and via the network as the Internet, is to be connected to the netpage network via broadband connection ideally.

Except identity and security set in nonvolatile memory, the netpage printer does not need to comprise any permanent storage.With regard to the user, " network is a computing machine ".Under the help of distributed netpage page or leaf server 10, Netpage crosses over the space and the time is alternatively moved, and is independent of specific netpage printer.

The Netpage printer receives the netpage document of subscribing from netpage publisher server 14.Each document is distributed in two parts: page or leaf layout and the actual text and the image object of filling page or leaf.Because personalized, particular subscription person is distinctive typically for a page or leaf layout, and thereby arrived subscriber's printer by program request by suitable page or leaf server.On the other hand, text and image object are normally shared with other subscribers, and are multicasted to all subscribers' printer and suitable page or leaf server.

The Netpage publisher server is optimized for program request and multicast to the segmentation of document content.After the program request of receiving the documentation page layout, printer is known monitoring which multicast (if any).

In case printer has received when limiting the complete page or leaf layout treat document printing and object, it just can document printing.

Printer rasterizing, and while prints odd and verso on the both sides of paper.For this reason, it comprises doubles seal engine controller 760 and utilizes Memjet ^TMThe print engine of printhead 350.

Print procedure comprises the stage of two uncouplings: the rasterizing that page or leaf is described, and the expansion and the printing of page or leaf image.Grating image processor (RIP) is made of the standard DSP 757 of one or more parallel runnings.Doubles seal engine controller is made of client processor, and these processor real-time ground expansion, shake and type face image are synchronized with the operation of the printhead in the print engine.

The printer that is used for invisible IR printing that is not enabled has the tusche Print Label of option to use IR-to absorb, although this is restricted to label other clear areas of described page or leaf.Though the page or leaf that this page or leaf is printed than sightless IR-has more limited functional, they still are classified as netpage.

Common netpage printer is printed netpage on paper.Relatively more special-purpose netpage printer can printed on as ball or plastic plate on the more special-purpose surface.Each printer is supported at least a surface type, and supports to be used at least a label tiling scheme and the mapping of label thus of each surface type.The label mapping 811 that description is actually used in the label tiling scheme of document printing becomes related with the document, thereby the label of described document can correctly be explained.

Fig. 2 has shown the netpage printer class diagram, and this figure has reflected by 11 information that safeguard, relevant with printer of the registrar on the netpage network.

In the 6th joint, we serve as with reference to a preferred embodiment that describes the netpage printer in detail with Figure 11 to 16.

1.5.1Memjet ^TMPrinthead

The Netpage system can use the figure punch technology by wide range to comprise hot ink-jet, piezoelectric ink jet, and electronic laser is taken a picture and the printer of other manufacturings is operated.But, for consumer's acceptance widely, need the netpage printer to have following properties:

The photographic quality colour print

High-quality text is printed

High reliability

Low printer cost

Low black cost

Low paper cost

Simple operations

Near noiseless printing

High print speed

The while duplex printing

Compact shape factor

Low-power consumption

At present, the printing technique that does not have commerce to obtain has all these characteristics.

In order to enable to produce the printer with these characteristics, the applicant has invented new printing technique, is called Memjet ^TMTechnology.Memjjet ^TMBe the drop-on-demand ink-jet technology, it combines the page width printing head that uses MEMS (micro electro mechanical system) (MEMS) technology to make.Figure 17 has shown Memjet ^TMThe single type element 300 of printhead.Netpage wall type printer is in conjunction with 168960 type elements 300, to constitute the page width duplex printer of 1600dpi.This printer is printed green grass or young crops, magenta, Huang, black and infrared China ink and paper correctives (conditioner) and black fixing agent simultaneously.

Type element 300 is approximately 110 microns long, and 32 microns wide.The array of these type elements forms on silicon substrate 301, combines CMOS logic, data transmission, sequential and driving circuit (not shown) on the silicon substrate 301.

The main element of type element 300 is nozzle 302, nozzle limit 303, nozzle box 304, fluid-tight 305, black raceway groove limit 306, lever arm 307, active driver beam to 308, passive driver beam to 309, active driver anchor 310, passive driver anchor 311 and China ink inlet 312.

Active driver beam is mechanically engaged engaging 319 places 309 with passive driver beam 308.Two beams are to being anchored at their corresponding anchor points 310 and 311.Element 308,309,310,311 and 319 the crooked actuator 320 of the electric heating that is combined to form cantilever.

Figure 18 has shown the sub-fraction of type element 300 arrays, comprises the cross section 315 of type element 300.Cross section 315 is shown as does not have China ink, to be shown clearly in the China ink inlet 312 by silicon wafer 301.

Figure 19 (a), 19 (b) and 19 (c) have shown Memjet ^TMThe working cycle of type element 300.

Figure 19 (a) has shown the rest position of black meniscus 316 before printed dot.China ink is retained in the nozzle box by the surface tension at fluid-tight 305 places that form at black meniscus 316 and between nozzle box 304 and black raceway groove limit 306.

When printing, the printhead cmos circuit will latch this data from the data distribution of printing engine controller to correct type element, and cushion these data to drive active driver beam to 308 electrode 318.This cause electric current by beam to 308 about microseconds, cause joule heating.The temperature rising that is produced by the joule heating makes beam expand to 308.Because passive driver beam is not heated 309, it does not expand, cause described two beams between stress difference.Cantilever end by the crooked driver 320 of electric heating bends towards substrate 301, and this stress difference is partly eliminated.Lever arm 307 moves this and is delivered to nozzle box 304.Nozzle box 304 moves the position shown in about 2 microns Figure 19 (b).This has increased black pressure, forces China ink 321 to deviate from nozzle 302, and causes black meniscus 316 to protrude.Nozzle limit 303 can prevent that black meniscus 316 from stretching the surface of crossing nozzle box 304.

When described beam equated 308 and 309 temperature, driver 320 turned back to its original position.This helps the China ink 321 of ink droplet 317 from described nozzle box to disconnect, as shown in Figure 19 (c).Described nozzle box is re-filled by the surface tension effects at black meniscus 316 places.

Figure 20 has shown a section of printhead 350.In the netpage printer, the length of printhead is the whole width (typical case 210 millimeter) of paper on direction 351.Shown in section grow (whole printhead about 0.2%) for 0.4mm.When printing, paper is moved through described fixing printing head in direction 352.Described printhead has the cross one another type elements 300 of 6 row, and the 6 kinds of looks being provided by China ink inlet 312 or the China ink of type are provided.

For the surface of the fragility of protecting printhead during operation, nozzle guard wafer 330 is attached to head substrate 301.Have corresponding nozzle guard hole 331 for each nozzle 302, ink droplet is launched by it.In order to prevent nozzle guard aperture 331 by paper fiber or other clogged with fragments, in print procedure, filtered air comes out by air intake 332 suctions and from described nozzle guard hole.In order to prevent that China ink 321 from becoming dry, when printer was idle, described nozzle guard was sealed.

1.6Netpage pen

The active sensing apparatus of Netpage system typically is pen 101, and it uses the controller 134 of its embedding, can be by imageing sensor from the page or leaf IR location tags of catching and decode.Imageing sensor is solid-state device, provides suitable wave filter, to allow only near infrared wavelength place sensing.As following more detailed description, described system can sensing when point contact with the surface, and described can be with the speed sensing label of abundance to catch people hand-written (promptly at 200dpi or bigger and 100Hz or faster).By the encrypted and wireless printer (or base station) that is delivered to of information that pen is caught, explain and the relevant data of (known) page or leaf described printer or base station, perhaps in a preferred embodiment, transmits described information and be used for explaining to the netpage server.

The preferred embodiment of described Netpage pen serve as a mark writing brush and as the non-marked contact pilotage both come work.But when the netpage system is used as browing system (as when using as Internet circles' face), the mark aspect not necessarily.Each netpage pen is registered to the netpage system and has a unique ID61.Figure 23 has shown netpage class figure, the information relevant with pen that reflection is safeguarded by the registrar on the netpage network 11.

When arbitrary point touched netpage, described pen determined that it is relevant to the position and the orientation of described page or leaf.Described point is attached to force transducer, and the power on the described point is by being explained about a threshold value, with stylus be " on " or D score.Interactive elements on the described page or leaf of this permission is quilt ' click ' by the pressure of described nib, with the information of asking for example to come automatic network.In addition, described masterpiece is that a successive value is hunted down, with completely dynamically being verified of allowing for example to sign.The power that is subjected to when nib is higher than when normally writing used power, and nib can move.When " click ", the power that the user applies should be enough to mobile nib.Compare with immovable nib, can provide the feedback that more needs for the user like this.

By near the page or leaf zone 193 in the described point of imaging in INFRARED SPECTRUM, described pen is determined position and the orientation of its point on netpage.It is decoded to immediate label, and according to the observation to the perspective distortion of image tag and the known geometries of the optical devices of pen calculate the position that nib is relevant to label.Though the position resolution of label may be low, because label density and tag size on the page or leaf are inversely proportional to, the position resolution of adjustment is quite high, surpasses the required minimum resolution of accurate handwriting recognition.

Pen is captured as a series of strokes with respect to the action of netpage.Stroke comprises the position that the sequence on the page or leaf is stamped timestamp, is started and is finished by pen-up event subsequently by the incident of starting writing.Stroke also is coupled with the label of netpage page or leaf ID50, and no matter when described page or leaf ID changes, it under normal circumstances is when described stroke begins.

Each netpage pen has relative current selection 826, allows the user to copy and operation such as stickup.This selection is beaten timestamp and is abandoned it to allow described system after the period of regulation.The territory of page or leaf example has been described in described current selection.It comprises the digital writing brush of the most recent of the background area with respect to described page of catching by described pen and draws.In case it is submitted to an application by selecting hyperlink activation, it is explained to use specific mode.

Each pen has when paracone 824.This is a point of being given system by the last announcement of described pen.Under the situation of above-mentioned acquiescence netpage pen, or the black point of mark or cold contact pilotage point are current.Each pen also has one when paracone type 825.This nib type be by application examples as the response user from palette select color and with the last related pen type of pen.The sharp type of acquiescence is and works as the relevant sharp type of paracone.The stroke of catching by pen is coupled with the label when the paracone type.When described stroke was reproduced subsequently, they were reproduced by tagged sharp type with them.

In described pen is in scope with its printer that can communicate by letter whenever, described pen its " online " LED that glimmers lentamente.When pen failed to decode stroke about described page or leaf, it activated its " mistake " LED at once.When pen had successfully been decoded stroke about described page or leaf, it activated its " ok " LED at once.

The captive stroke of one sequence is called as the numeral China ink.The numeral China ink is the basis of figure and the exchange of hand-written numeral, be used for hand-written ONLINE RECOGNITION and be used to sign at X-ray inspection X.

Pen is wireless, and by short-range wireless link digital China ink is sent to the netpage printer.The numeral of described transmission is black for privacy and safe and encrypted, and is grouped in order to transmit efficiently.But, always when pen-up event takes place, refresh, to guarantee the timely processing in the printer.

When described pen was in outside the scope of printer, it is the buffer digital China ink in internal storage, and described storer has the capacity of the continuous writing that surpasses ten minutes.When pen was in the scope of printer once more, it transmitted any numeral China ink that is cushioned.Impact damper can provide either large or small buffer capacity.

Pen can be registered to the printer of any amount, and still, because all status datas are present among the netpage on paper and the network, therefore in any specific time, what communicate by letter with pen is which printer is unessential.

In the 6th joint, serve as with reference to the preferred embodiment that describes described pen in detail with Fig. 8 to 10.

1.7NETPAGE it is mutual

When pen is used for netpage l when mutual, netpage printer 601 receives the data relevant with stroke from pen 101.When pen was used for carry out moving as stroke, the coded data of label 43 was read by label.Described data allow the sign of described specific page and relevant interactive elements to be determined and the pen obtained with respect to the relative positioning of page or leaf.Designation data is sent to printer, by DNS the page or leaf ID50 of described stroke is resolved to the network address of netpage page or leaf server 10 in this place designation data, and netpage page or leaf server 10 is being safeguarded corresponding page or leaf example 830.It is sent to described page or leaf server to stroke then.If page or leaf is identified in stroke early recently, so described printer may have the address of described related pages server in its high-speed cache.Each netpage comprises the page or leaf layout of forever being safeguarded the compactness of (face as follows) by netpage page or leaf server.Described page or leaf layout refers to object such as image, font and text bar, is typically stored in other places on the netpage network.

When the page or leaf server when pen receives stroke, it is retrieved the page or leaf that described stroke is applied to and describes, and determines which element that described stroke and page or leaf are described intersects.It can explain the described stroke in the context of type of described coherent element then.

" click " be a stroke normally, and distance between position and the pen-up position subsequently of starting writing and time both are less than some little maximal values.Typically need to click being activated by the object that click to activate, and therefore long stroke will be left in the basket.The fault of the pen action of writing down as " undiscipline " click by lack from as described in " ok " LED respond and indicate.But, if netpage comprises button, so when start to write and pen-up position all in button area the time " click " can be registered.

Two kinds of input elements in describing, the netpage page or leaf are arranged: hyperlink and form fields.Also can trigger the activation of relevant hyperlink by the input of form fields.

1.7.1 hyperlink

Hyperlink is a kind of method of message that sends to remote application, and causes the printing response in the netpage system usually.

The application 71 of the activation of the described hyperlink of hyperlink element 844 identification process, the described link ID54 that is hyperlinked to described application of sign, Request System are included in " desired another name " flag in the hyperlink activation to user's application another name ID65, and the description that is used when hyperlink is registered as hobby (favorite) or appear in user's the history.Hyperlink element class figure has been shown among Figure 29.

When hyperlink was activated, the application in page or leaf server somewhere on network sent request.Application identifies by using ID64, and described application ID is resolved with normal mode by DNS.Three class hyperlink are arranged: ordinary hyperlinks 863, list hyperlink 865 and selection hyperlink 864, as shown in figure 30.Ordinary hyperlinks can be carried out the request to chaiming file, perhaps can simply preference (preference) be sent signals to server.The list hyperlink is submitted to application to corresponding list.Select hyperlink that current selection is submitted to application.If current selection comprises for example individual character text bar, application can be returned the single page document that provides the meaning of this word in the context that it occurs, and perhaps it is translated as different language.Each hyperlink type is submitted to described should being used for by what information and characterizes.

The hyperlink example 862 record issued transaction ID55 of described correspondence, its page or leaf example that can occur thereon described hyperlink example is specific.Issued transaction ID can be identified to user's particular data of described application, is for example used " shopping cart " of the unsettled purchase of being safeguarded by the purchase of representative of consumer.

Described system comprises the current selection 826 of selecting the described pen in the hyperlink activation.System comprises the content of relevant form instance 868 in the list hyperlink activation, although if described hyperlink has its " submission delta " attribute setting, only had the input since last list is submitted to be comprised.Described system comprises the effective return path in all hyperlink activations.

Hyperlink group 866 is group elements 838, and it has relevant hyperlink, as shown in figure 31.When importing by any field element in this group, the hyperlink 844 relevant with this group is activated.The hyperlink group can be used to the hyperlink behavior is associated with field such as check box.It also can be used in combination with " submission delta " attribute of list hyperlink, so that continuous input to be provided to application.Therefore, it can be used for supporting " blackboard " interactive mode, in case promptly this place input be hunted down and so its generation promptly be shared.

1.7.2 list

Form definition gathering of relevant input field, be used for catching relevant input group by the netpage of or more printings.List allows the user to submit to one or more parameter to the Application Software Program that operates on the server.

List 867 is the group elements 838 in the document level.It finally comprises one group of terminal field element 839.Form instance 868 is represented the example of the printing of list.It comprises a group field example 870, and it is corresponding to the field element 845 of described list.Each field instance has relevant value 871, and its type depends on the type of the field element of described correspondence.Each field value is by the specific form instance that is printed, promptly by one or the netpage record input that more is printed.Described list class figure is illustrated among Figure 32.

Each form instance has state 872, and it indicates whether described list is movable, freeze, submission, sky or overdue.List is movable when being printed for the first time.It becomes and freezes in case list is signed.In case one of submission hyperlink of list is activated then it becomes submission, unless described hyperlink has its " submission delta " attribute setting.List becomes sky when the user calls empty list, replacement list or the order of copy table single page.List expires when the time that described list is in active state surpasses life-span of appointment of described list.When described list is activity, allow the list input.Input by inactive list is alternatively caught in the background field 833 of related pages example.When described list is movable or freezes, allow list to submit to.The trial of any submission form is not rejected when list is not movable or freezes, and replaces and draw a list status report.

Each form instance preferably is associated (59) with any form instance from its derivation, and vncsion history is provided thus.This allows all eliminatings from search of all except that the final version of list in certain period of time.

All inputs all are hunted down as the numeral China ink.Numeral China ink 873 comprises one group of group of strokes 874 of stamping timestamp, its each comprise the stroke 875 of one group of stylization.Each stroke comprises one group of position 876 that has timestamp, its each comprise that also the orientation and the point of pen put forth effort.Shown digital black class figure among Figure 33.

Field element 845 can be check box field 877, the text field 878, figure field 879 or signature field 880.The class of field element shown in Figure 34 figure.Any digital China ink of catching in the zone 58 of field will be assigned to this field.

The check box field has relevant Boolean 881, as shown in figure 35.Any mark of catching in the zone of check box field (collude, cross, stroke, filling (fill zigzag) etc.) in a zigzag causes true value to be assigned to the value of described field.

The text field has a relevant textual value 882, as shown in figure 36.Any numeral China ink of catching in the zone of the text field automatically is converted to text by online handwriting recognition, and described text will be assigned to the value of this field.Online handwriting recognition is that fine understanding (is seen, for example, Tappert, C., C.Y.Suen and T.Wakahara, " The State ofthe Art in On-Line HandwritingRecognition ", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.12, No.8, August 1990, and its content is bonded to here for cross reference).The specialization of the text field comprises date and numeric field.

Signature field has relevant digital signature value 883, as shown in figure 37.Any numeral China ink of catching in the zone of signature field is about the owner's of pen sign and check automatically, and field is produced and be assigned to the value of described field for the digital signature of the list content of its part.Described digital signature is to use described user's private signature key to produce, and described key is specifically designed to the application that has this list.The on-line signature check is (seeing of fine understanding, for example, Plamondon, R.and G.Lorette, " Automatic Signature Verification and Writer Identification-The Stateof the Art ", Pattern Recognition, Vol.22, No.2,1989, its content is bonded to here for cross reference).

If " hiding " attribute of field element is set up, then it is hidden.The field element of hiding does not have the input area on the page or leaf, does not accept input yet.When the list that comprises described field was submitted, it can have the related words segment value that is included in the described form data.

In form fields, can also discern leave out (strikethrough) of " editor " order as indication deletion.

Because handwriting recognition algorithm " online " work (promptly having the dynamic access that pen is moved), rather than " off-line " work (promptly only having visit) to the bitmap of a mark, it can discern the discrete character of writing that carries out with high relatively precision, does not write the training stage that the person relies on.The pattern that the hand-written person of writing relies on is produced in time automatically, but also can produce in advance where necessary.

Digital as has been stated China ink comprises the stroke of a sequence.Any stroke that starts from the element-specific zone all is affixed to the numeral China ink stream of this element, prepares to be used for explaining.Any stroke that is not affixed to the numeral China ink stream of object is affixed to the numeral China ink stream of background field.

The digital China ink of catching in the background field is interpreted as selecting posture.The boundary of one or more objects is interpreted as the selection of confined object usually, although actual explanation is an application specific.

Table 2 has gathered these various mutual with netpage.

Mutual the gathering of table 2-pen and netpage

This system maintenance is used for the current selection of each.Select to be included in simply the nearest stroke of catching in the background field.Described selection is eliminated to guarantee predictable behavior after non-activity is overtime.

The original figure China ink of catching in each field is retained on the netpage page or leaf server, and when list being submitted to application, this digital China ink can selectively be transmitted with form data.Like this, if when use suspecting the conversion of initial conversion such as handwritten text, allow described application queries original figure China ink.This can be for example introduces people's intervention at the application layer place, described application layer is used to fail by the list of the consistency check of certain application specific.As extension, can also be appointed as the drawing field to the whole background area of list to this.Like this, suppose that the user may be indicated to modification the field that is filled outside those fields, described application can be arrived the operator based on the described list of existence decision route of the numeral China ink outside the clear and definite field of described list subsequently.

Figure 38 has shown the process flow diagram flow chart of handling with respect to the pen input of netpage.This process comprises from pen reception (884) stroke; The page or leaf example 830 of the page or leaf ID50 indication in sign (at 885 places) described stroke, retrieval (at 886 places) page or leaf describes 5; Sign (at 887 places) formative element 839 (intersect with described stroke in its district 58); Determine whether (at 888 places) formative element is corresponding with field element, if, the numeral China ink of the stroke that receives additional (at 892 places) to field value 871, explain the numeral China ink of the accumulation of (893) this field, and determine whether (at 894 places) this field is the part of hyperlink group 866, if activate (at 895 places) relevant hyperlink; Determine selectively whether (at 889 places) formative element is corresponding with the hyperlink element, if activate (at 895 places) corresponding hyperlink; Selectively, when lacking input field or hyperlink, the stroke that additional (at 890 places) are received is to the numeral China ink of background field 833; And the stroke that received of copy (at 891 places) is to the current selection 826 of current pen, and the current selection of current pen is safeguarded by registrar.

Figure 38 a shows the detail flowchart of the step 893 in the process shown in Figure 38, and the numeral China ink of the accumulation of wherein said field is explained according to the type of field.This process comprises: determine whether (at 896 places) described field is that check box and (at 897 places) determine whether digital China ink represents check mark, if distribute (at 898 places) true value to described field value so; Determine selectively whether (at 899 places) this field is the text field, if, in following numeral China ink conversion of the help of suitable registrar (at 900 places) is computer version, and distributes the computer version that conversion gets (at 901 places) to described field value; Determine selectively whether (at 902 places) this field is signature field, if, check (at 903 places) is as the described numeral China ink of an owner signature under the help of suitable registrar, also under the help of this registrar, and use an owner private signature key (relevant) with application corresponding, produce the digital signature of (at 904 places) described corresponding list content, and distribute digital signature (at 905 places) to described field value.

1.7.3 page or leaf server command

The page or leaf server command is by the local order of handling of page or leaf server.It is directly operated on list, page or leaf and document examples.

Page or leaf server command 907 can be sky list order 908, copy table single command 909, replacement list order 910, obtain list status command 911, duplicate page command 912, the page or leaf order 913 of resetting, obtain page status order 914, duplicate document command 915, replacement document command 916 or obtain document status order 917, see shown in Figure 39.

Empty list order makes corresponding form instance for empty.The copy table single command makes corresponding form instance for empty, and produces the printed copies of the activity of the current form instance that field value is saved then.Comprise in the copy and described original identical hyperlink issued transaction ID, therefore for using and described original can't the differentiation.The order of replacement list makes corresponding form instance for empty, and produces the printed copies of the activity of the form instance that field value is dropped then.Comprise in the copy and described original identical hyperlink issued transaction ID.Obtain the printed report that the list status command produces the state of corresponding form instance, comprise that who has announced it, it be when be printed, it for whom is printed and the list state of form instance.

Because list hyperlink example comprises issued transaction ID, therefore use and to participate in producing the new table example.Therefore, the button of request new table example typically is embodied as hyperlink.

Duplicate page command produces the printed copies of the maintained corresponding page or leaf example of background field value.If page or leaf comprises the part of list or list, duplicate page command is interpreted as the copy table single command so.The printed copies of the corresponding page or leaf example that the page or leaf order generation background of resetting field value is dropped.If page or leaf comprises the list or the part of list, the replacement page or leaf is ordered the list order that is interpreted as resetting so.Obtain the page status order and produce printed report about corresponding page or leaf example state, comprise who issue it, it be when be printed, it is for Whom and that print and that it comprises or it is as the state of any list of part.

The netpage sign that each netpage go up to occur in the preferred embodiment of the present invention is usually with to duplicate page element relevant.

When the page or leaf example was replicated with the maintenance field value, field value was printed with their natural form, that is, check mark appears as the check mark figure of standard, and text appears as the composing text.Have only the primitive form of drawing and signing to occur, have the signature of preferably following, or have the signature that selectively replaces, the successful signature verification of described test pattern indication by test pattern by test pattern with them.

Duplicate the printed copies of the maintained corresponding document examples of document command generation background field value.If document comprises any list, duplicate document command so and duplicate described list in the identical mode of copy table single command.The printed copies of the corresponding document examples that replacement document command generation background field value is dropped.If document comprises any list, the document command of resetting so is with the mode identical with the order of the replacement list list of resetting.Obtain the printed report that the document status order produces the state of corresponding document examples, comprise who announced it, it be when be printed, it for whom is printed and the state of any list that it comprises.

If " selected " attribute of page or leaf server command is set up, so described order operation on the page or leaf that the current selection by pen identifies, rather than comprising on the page or leaf of described order.This allows the menu of page or leaf server command to be printed.If page object does not comprise the page or leaf server command element of the page or leaf server command that is used to specify, this order is left in the basket so.

By embed relevant page or leaf server command element in the hyperlink group, application can provide the processing of application specific.The page or leaf server activates the hyperlink relevant with the hyperlink group, rather than carries out described page or leaf server command.

If " hiding " attribute of page or leaf server command element is set up, this element is hidden so.The command element of hiding does not have the input field and therefore can not directly be activated by the user on page or leaf.But if a page or leaf server command has its " selecteed " attribute setting, it can be activated by a page or leaf server command that is embedded in the same page not so.

1.8NETPAGE standard feature

In described preferred list, it is that therefore netpage also has interaction characteristic in its bottom to indicate it that each netpage is printed the netpage sign.This sign also can be used as copy button.In most of the cases, " click " this sign can produce the copy of described page or leaf.In the situation of list, this button produces the copy of whole list.And in the situation of security document such as ticket or bill, this button is drawn indicative note or advertising page.

The single page copy function of acquiescence is directly handled by relevant netpage page or leaf server.Special copy function should be used for handling by this sign button is linked to.

1.9 user aid system

In a preferred embodiment, the netpage printer has a single button that is labeled as " help ".When pressing this button, can draw a single page or leaf that comprises following message, comprising:

The state that printer connects

The state of printer material consumption

Top help menu

The document function menu

Top netpage network directory

Help menu provides the handbook of classification how to use the netpage system.

The document function menu comprises following function:

The copy of document printing

Print the clean copy of list

The state of document printing

The document function is by starting by described button and any page or leaf of contacting described document subsequently.The state of document indicate who issued it and when, who and it it be passed to and when be used as list subsequently and submit to and whom submits to.

The Netpage network directory allows the hierarchical structure of user's operation issue and service on network.In addition, the user can also call out netpage network " 900 " number " Yellow Page " and seek help to the operator.The operator can find required document, and the document is routed to user's printer.Depend on Doctype, publisher or user need pay little " Yellow Page " service fee.

If printer can't be printed, page or leaf so obviously can't get help.In this case, " mistake " lamp is lighted and the user can ask remote diagnosis by network.

2. Ge Xinghua release model

In the following description, the news example that is used as the issue of standard illustrates the personalized mechanism of netpage system.Though news often is used with the limited meaning of newspaper and news magazine news, the scope that means in this context is a broad.

In the netpage system, the content of edit of news briefing is used different mechanism personalizations with ad content.Described content of edit according to the reader clearly state and imply catch the interest general picture and by personalized.Ad content is according to reader's place and demographic and by personalized.

2.1 editor is personalized

The subscriber can use two kinds of news sources: transmit the news sources of news briefing and transmit the news sources that news flows.News briefing is gathered by the publisher and edits, and news stream gathers by the news publisher or by the news collection person of specialization.News briefing is usually corresponding to traditional newspaper and news magazine, and news stream can much and be different: from " unprocessed " news, comic strip, free-lancer's special column, friend's bulletin board or reader's oneself the Email of press service.

Delivering of the news briefing that the support of Netpage publisher server is edited and gathering of a plurality of news stream.By handling the format of the described news stream that gathers and therefore directly selected by the reader, described server can be placed on advertisement on the page or leaf, it otherwise not to its editor's control.

The subscriber can select one or more news briefings of working to set up daily paper and set up each personalized version.Editor's every day of result is printed and is bonded together becomes single newspaper.The various members of family are usually by selecting different every day of issue and customize them then, thereby express their different interest and taste.

For each issue, the reader selectively selects specific joint (section).Some joints occur every day, and other joints occur weekly.For example can comprise " additional page one (Page One Plus) ", " domestic ", " international ", " suggestion ", " commercial affairs ", " art/life ", " technology " and " motion " the online described every day that obtains from the New York Times.The set pair of available joint is specific in issue, as the subclass of acquiescence.

The reader can expand described daily paper by setting up the customization joint, and each of described customization joint extracted the news stream of any amount.The customization joint can be established for Email and friend's bulletin (" individual's "), perhaps is used to monitor the news supply of specific title (" alarm " or " montage ").

For each joint, the reader selectively specifies its size, (for example short, in, long) or two amount ground the restriction of its number of pages (promptly to) perhaps qualitatively, and the ratio of required advertisement, (for example high, normal, low, do not have) or quantity ground (being percentage) perhaps qualitatively.

The reader also can randomly express a large amount of than short essay chapter or a spot of preference than the long article chapter.Each article is write as (or editor) with short and long two kinds of forms ideally, to support this preference.

Article can also be write as (or editor) with different versions, with the reader's of coupling expection complicacy, for example is used to offer child and the version adult.Suitable version is selected according to reader's age.The reader can specify " reading age " of the physiological age that has precedence over them.

The article that constitutes each joint is selected by the editor and is determined priority.And each is assigned with the useful life-span.They are delivered to all relevant subscribers according to priority acquiescently, submit to the space constraint in described subscriber's version.

In it was suitable joint, the reader can randomly enable collaborative filtering.This is applied to then has abundant long-life article.Qualified each article that is used for collaborative filtering is printed the grade button in the ending of article.Described button can provide and be easy to select (for example " liking " or " disliking "), more may make the reader bothersome to the article classification.

Have that therefore high priority and short-life article thought to read by the editor effectively and be passed to most of relevant subscribers.

The reader randomly specifies an accidentalia, perhaps qualitatively (it is surprised for example to make or do not make me) or quantity ground.High accidentalia has reduced be used to the threshold value of mating during collaborative filtering.High factor more likely makes corresponding joint will be filled into the capacity of described reader's appointment.Can specify different accidentalia for the different sky in week.

The reader can also randomly specify interested specific title in the joint, and this has changed the priority of being distributed by the editor.

Reader's Internet connection speed influences the quality and quantity of transitive graph picture.The reader randomly specifies less image or less image or both preferences.If do not reduce the quantity or the size of image, so may be with lower mass transfer image (for example with lower resolution or bigger ratio of compression).In addition, the quantity of transitive graph picture, size and quality can be adjusted.

On global level, how reader's specified quantity, date, time and monetary value are by localization.This relates to specifies unit whether to comprise translation or note on the spot in made in Great Britain or metric system, local time zone and time format and local currency and the localization.These preferences are to obtain by the place of acquiescence from described reader.

Read difficulty in order to reduce by what bad eyesight caused, the reader can randomly specify the global preference of bigger expression.All both are therefore scaled for text and image, and less information is accommodated on each page or leaf.

The language that is published of news briefing with and corresponding text code be the characteristic of described issue, and be not the preference of expressing by the user.But the automatic translation service that provides in the various outward appearances can be provided in described netpage system.

2.2 advertisement localization and targeted

The personalized of described content of edit directly influences ad content, because advertisement is typically placed to utilize described editor's context.For example, tourist promotion more likely appears at tourist festival rather than other places.Therefore the value to advertizer's's (and to described publisher) content of edit is present in its ability, described ability is used for attracting a large amount of readers with correct demography.

Effectively advertisement is placed with demography based on the place.The place is determined to the approaching of specific service, retailer etc., and special interests and the concern relevant with environment with the community of this locality.Demographic definite general interest and prejudice and possible consumption mode.

News briefing person's most of profitable product is advertisement " space ", by the geography covering of issue, the size of its Readership, the demography of its Readership and the next multidimensional entity of determining in page or leaf zone that can be used for advertisement.

In the netpage system, the netpage publisher server is that basic calculation is issued vendible advertising space multidimensional size roughly with every joint, the geography of considering described issue covers, the size of the Readership of this joint, each reader's joint version, each reader's advertisement ratio and each reader's demography.

Compare with other medium, the netpage system allows described advertising space to be defined in more detail, and allows the less piece of advertising space to be separated to sell.Therefore it allows by to be sold near its actual value.

For example, identical advertisement " gap " can be sold to several advertizers with the ratio that changes, and each reader's page or leaf receives an advertizer or another advertizer's advertisement, comprehensive space proportion that is sold to each advertizer that keeps randomly.

This Netpage system allows advertisement directly to be linked to detailed product information and online purchase.Therefore, promoted the inherent value of advertising space.

Because personalized and localization is handled automatically by the netpage publisher server, so the advertisement tabulator can provide geography and demographic wide covering arbitrarily.So follow-up going gathers being is effective automatically.It is more effective than directly catching advertising cost that this makes that the publisher handles the advertisement tabulator.Even the advertisement tabulator has obtained the advertising income of a ratio, because the greater efficiency that gathers, the publisher can find that this variation is profit neutrality (profit-neutral).The advertisement tabulator is taking on the intermediary between advertizer and the publisher, and can arrange identical advertisement in a plurality of issues.

It should be noted that the advertisement layout in the netpage issue may be more complicated than the advertisement in traditional corresponding form, this is because the advertising space of issue is complicated.Although ignored the complete complexity of the negotiation between advertizer, advertisement tabulator and the publisher, the preferred form of netpage system comprises the support for the automated auction of advertising space for these negotiations provide the support of some robotization.Robotization is desirable especially for advertisement that produces a small amount of income such as layout small-sized or the highly advertisement of localization.

In case consult layout, the tabulator catches and edit advertisement, and it is recorded on the netpage Advertisement Server.Correspondingly, the publisher will arrange on relevant netpage publisher server in the record advertisement.When the netpage publisher server was arranged each user's personalization issue, it picked up relevant advertisement from the netpage Advertisement Server.

2.3 user profiles

2.3.1 information filtering

The personalization of news and other issue is depended on the classification of the peculiar profile information of user, comprising:

Publishing of customized

The collaborative filtering vector

Contact detail

Present preference

The customization of issue is normally issued distinctive, and therefore, customized information is safeguarded by relevant netpage publisher server.

The collaborative filtering vector is made of the grading (rating) of many news item the user.It is used for the interest of different user is associated, the purpose that is used to recommend.Safeguard that single collaborative filtering vector is useful though be independent of any specific issue, issue for each and safeguard that two comparatively feasible reasons of independent vector are: might be more overlapping what exist between than vector between the subscriber's of same issue the vector the subscriber of difference issue; And issue might want its user's collaborative filtering vector is rendered as the part of its brand value that can not find in other places.Therefore, the collaborative filtering vector is also safeguarded by relevant netpage publisher server.

Contact detail comprises name, street address, ZIP sign indicating number, state, country, telephone number, is overall in itself, and is safeguarded by the netpage registrar.

Presenting preference, comprise quantity, date and time, is overall equally, and safeguards in the same manner.

The place of indicating in user's the contact detail is depended in the localization of advertisement, and the target of advertisement depends on personal information such as date of birth, sex, marital status, income, occupation, education or derives as the range of age and income range qualitatively.

Select to show that for those personal information is used for the user of advertising goal, this information is safeguarded by relevant netpage registrar.When lacking such information, can determine advertising objective according to the demographics relevant so with user's ZIP or ZIP+4 sign indicating number.

Each user, pen, printer, application supplier and application are assigned with its oneself unique identifier, and the netpage registrar safeguarding the relation between them, shown in Figure 21,22,23 and 24.For the purpose of registering, the publisher is the application supplier of Special Category, and issue is the application of Special Category.

Each user 800 can be authorized to be and use any amount of printer 802, and each printer can allow the user of any amount to use it.Each user has single default printer (at 66 places), and periodically issue is delivered to this printer acquiescently; Simultaneously, the page or leaf that prints on demand is delivered to the user by its mutual printer.Server remembers which publisher the user has authorized print to the printer of user's acquiescence.The publisher does not write down the ID of any particular printer, but resolves described ID when needed.

When the user subscribes to 808 issues 807 the time, publisher 806 (promptly using supplier 803) is authorized to print to the printer of appointment or user's default printer.The user can at any time recall this mandate.Each user can have several pens 801, but pen is specific for unique user.If certain user is authorized to use specific printer, this printer is discerned any one of user's pen so.

ID is used for locating the respective user profile of being safeguarded by specific netpage registrar with normal mode by DNS.

Web terminal 809 can be authorized to print on specific netpage printer, and like this, Web page or leaf that runs in the web browsing process and netpage document are printed on the nearest netpage printer easily.

For, the netpage system can represent expense and the commission of printer supplier collection to earning by the issue of the printing on supplier's printer.This income can comprise advertising fee, click (click-through) expense, ecommerce commission and transaction cost.If printer is owned by the user, the user is exactly the printer supplier so.

Each user also has: netpage account 820, and the account is used for accumulating little borrow and borrow (for example the preceding paragraph describe those); Contact detail 815 comprises title, address and telephone number; Global preferences 816 comprises privacy, sends and the localization setting; The biometric record 817 of any amount comprises user's coding signature 818, fingerprint 819 etc.; By the automatic hand-written model of safeguarding 819 of system; And SET payment card account 821, utilize it can carry out electronic payment.

2.3.2 favorites list

Netpage user can safeguard the link of " hobby " tabulation 922-useful document to the netpage network etc.This tabulation is that the user safeguards by system.It is organized as a classification of file 924.Illustrate a preferred embodiment of this classification among Figure 41 with class.

2.3.3 history list

Optimum system choosing ground is each user's maintenance history tabulation 929, comprises by the link of user by the document of netpage system visit in the history list etc.History list is the tabulation of in order of dates organizing, and Figure 42 illustrates the preferred embodiment of history list with class.

2.4 intelligence page or leaf layout

The page or leaf of Netpage publisher server each user's of autoplacement on the basis of pursuing joint (section-by-section) personalization issue.Because most of advertisements are in the form of the rectangle of preformatting, so they are being placed on the page or leaf before the content edited.

The advertisement ratio of one joint can be realized by means of the advertisement ratio of the variation on each page in this joint, and the layout algorithm has utilized this point.This algorithm is configured to attempt contact is edited closely and ad content is put together, and such as the special feature of repairing owing to self-service roof, the advertisement specific placement that will be used for roof Material is within issue.

Then, coming layout according to various aesthetic rules is the content of edit that the user selects, and comprises text and relevant image and figure.

In case this layout converges, whole process comprises that the selection of advertisement and the selection of content of edit must be repeated, to attempt comparatively closely to realize the joint size preference of user's appointment.But the joint size preferences can be mated fifty-fifty along with the time, thereby allowed sizable variation day by day.

2.5 document format

In case document is by layout, then it is encoded and is used for effectively distribution and lasting storage on the netpage network.

Primary efficiency mechanism is that Sharing Information between the distinctive information of the version of unique user and a plurality of users' the version is separated.Described peculiar information is made of the page or leaf layout.The object that the information of sharing is quoted by the page or leaf layout constitutes, and comprises image, figure and text bar.

Text object comprises complete formative text, and it adopts Extensible Stylesheet Language (XSL) (XSL) to represent with extend markup language (XML).Be independent of text and be set to wherein zone, XSL provides the accurate control to text formatting, and it is provided by layout in the case.Text object comprises the embedded language sign indicating number that enables translation automatically and is used for the formative embedded hyphen connection prompting of auxiliary paragraph.

Image object preferably with JPEG 2000 based on the compressed image form of small echo to picture coding.Drawing Object preferably with scalable vector graphics (SVG) form to the 2D encoding of graphs.Other form also can be used for text, image and figure.

Layout itself is made up of the text object flow (text object flows by it) of a series of image of placing and Drawing Object, link, above-mentioned hyperlink and input field and watermark region.These layout objects are summarised in the table 3.This layout is used the compact schemes that are suitable for efficient distribution and storage.

Fig. 3-netpage layout object

2.6 document distribution

As mentioned above, for the effective purpose of distribution and persistent storage on the netpage network, distinctive page of layout of user separated by the shared object of quoting with it.

When the issue of subscribing was ready to be distributed, the netpage publisher server distributed unique ID, page or leaf example, document and the document examples of each page under the help of netpageID server 12.

Server calculates the majorized subset's of content shared set, and creates multicast channel for each subclass, labels for the distinctive layout of each user with the title of multicast channel then, and these passages will carry the content shared that this layout is used.Then, server by suitable page or leaf server each user's layout program request to user's printer, and when program request is finished on the passage of appointment the multicast content shared.After receiving program request, each page server and printer are subscribed the multicast channel of appointment in the page or leaf layout.During multicast, each page server and printer extract those objects of being quoted by its page layout from multicast data flow.Page or leaf layout and content shared that the page or leaf server files enduringly and receives.In addition, also can use other technology distributing data.

In case printer has been received all objects of being quoted by its page layout, printer is created the layout of complete filling again, then rasterizing and print it.

Under normal circumstances, printer is printed page or leaf faster than sending them.Suppose that 1/4th of each page is coated with image, so average page or leaf has the size less than 400KB.Therefore, printer can be stored page or leaf such more than 100 in its 64MB storer, thereby allows adhoc buffer etc.Printer is printed with the speed of per second one page.This is equivalent to the page data of per second 400KB or about 3Mbit, this to broadband network on to send the maximum prefetch phase speed of page data similar.

Even under abnormal conditions, during as printer paper-out, the user can replenish the paper supply before 100 pages of interior storage capacity of printer are depleted.

But if the internal storage of printer fills up really, printer can't use multicast in occurring for the first time at multicast so.Therefore, the netpage publisher server allows printer to submit to for the request of multicast again.When the request of receiving critical mass or occur when overtime, server is the shared object of multicast correspondence again.

In case document is printed, by retrieval its page layout and content from relevant page or leaf server, printer can produce copy accurately at any time.

2.7 document as required

When asking the netpage document as required, it can with the roughly the same mode of periodical by personalized and send.But,, under the situation of not utilizing multicast, be directly to sending of request printer owing to there is not content shared.

When asking non-netpage document as required, it is by personalization, and sends by the netpage formatting server of appointment, and this server will be reformatted as the netpage document to the document.The Netpage formatting server is the particular instance of netpage publisher server.The Netpage formatting server has the knowledge of various internets document form, comprises Portable Document format (PDF) and the HTML(Hypertext Markup Language) of Adobe.If html document, it can use higher type face resolution, presents the Web page or leaf with the multiple row form with contents table.It can automatically comprise all Web pages or leaves that directly are linked to the page or leaf of being asked.The user can regulate the behavior by preference.

The Netpage formatting server carries out Standard N etpage behavior available on any internet document, comprises interactivity and persistence, no matter the origin and the form of internet document.It hides the knowledge from the different document form of necpage printer and netpage page or leaf server, also hides the knowledge from the netpage system of Web server.

3. security

3.1 cryptology

Cryptology is used to protect sensitive information in storage and in transmission, and the each side of issued transaction is carried out authentication.The cryptology of two classes in being extensive use of arranged: Private Key Cryptography art and Public key cryptology.The Netpage network uses this two classes cryptology.

The Private Key Cryptography art is also referred to as symmetric cipher, uses same key to come encryption and decryption message.Wish that the both sides that exchange messages must at first arrange exchanging secrets key safely properly.

Public key cryptography is also referred to as the asymmetric cryptography art, uses two encryption keys.These two keys are correlated with on mathematics under such mode: use any message of a secret key encryption can only use another secret key decryption.One of these keys are published then, and another key is held privately owned.Public keys is used for encrypting planning to offer any message of holding the private cipher key holder.In case after being used public-key encryption, then message can only use private cipher key that it is deciphered.Like this, both sides can exchange messages safely, and exchanging secrets key at first.In order to guarantee that private cipher key is safe, to produce described key right for the holder of private cipher key under the normal condition.

Public key cryptography can be used for producing digital signature.The holder of private cipher key can create the hash (hash) of known message, uses this hash of private key encryption then.Then, anyone can be by the following hash of checking the encryption of " signature " that constitute the private cipher key holder about described particular message: utilize Public key to decipher encrypted hash, and contrast this message and check this hash.If signature is affixed to this message, message recipient can be checked the authenticity of message so, can check this message not to be modified in transmission again.

In order to make public key cryptography work, a kind of mode that prevents the distribution public keys palmed off must be arranged.Normally certificate of utility and certificate organ of power finish for these.Certificate organ of power is reliable third party, and it carries out authentication to the relation between public keys and someone identity.Certificate organ of power verifies this people's identity by checking identity document, sets up and sign the identification details that comprises this people and the digital certificate of public keys then.Anyone of trust certificate organ of power can use the public keys in the certificate when be sure oing that highly it is true.They only need authentication certificate really by certificate authority signs, and the public keys of described certification authority agent is known.

In most of transaction processing environments, public key cryptography only is used to produce digital signature and exchanging secrets session key safely.The Private Key Cryptography art is used to every other purpose.

In the following discussion, when security information when transmission of mentioning between netpage printer and the server, what reality took place is: printer obtains the certificate of server, with reference to certificate organ of power certificate is carried out authentication, use public key exchange key and the secret session key of server interaction in the certificate, use secret session key encrypting messages data then.According to definition, session key can have the life-span of any weak point.

3.2NETPAGE printer security

Each netpage printer is designated during fabrication to have a pair of unique identifier, these identifiers to be stored in the ROM (read-only memory) in the printer and in the netpage registrar database.The one ID62 is public, and identifies the printer on the netpage network uniquely.The 2nd ID is secret, and is used when this printer is registered on network for the first time.

When printer was connected to the netpage network for the first time after installation, it is right that it creates the public/private cipher key of signature.It is sent to the netpage registrar safely to secret ID and public keys.Server compares secret ID and the secret ID that is recorded in the printer in its database, accepts registration if ID is complementary.It creates and signs the public ID that comprises printer and the certificate of public signature key then, and this certificate is stored in the registration database.

The Netpage registrar is as the certificate organ of power of netpage printer, because it has the access right to secret information, thereby allows its checking printer identity.

When the user subscribes issue, in netpage registrar database, create record, it authorizes the publisher that issue is printed to user's the default printer or the printer of appointment.Send to the directed specific user of each document of printer by the page or leaf server, and use publisher's private signature key to sign by the publisher.The page or leaf server verifies that by registration database the publisher is authorized to issue is delivered to designated user.The page or leaf server uses publisher's public keys certifying signature, and the publisher certificate of publisher's public keys from be stored in registration database obtains.

The Netpage registrar is accepted to authorize the request of adding database to printing, as long as these requests are to start by the pen that is registered to printer.

3.3NETPAGE the security of pen

Each netpage pen is designated during fabrication a unique identification, and it is stored in the ROM (read-only memory) in the pen and in the netpage registrar database.ID61 identifies this pen uniquely on the netpage network.

The netpage pen can " be known " many netpage printers, and printer can " be known " many pens.When it was in the scope of printer, pen was by radiofrequency signal and printer communication.In case pen and printer are registered, they are the exchange session key termly.Whenever pen when printer transmits the numeral China ink, the numeral China ink always is used suitable session key.The numeral China ink is never by (in the clear) transmission in the clear.

Each printer store session key that pen is known for it is by the printer ID index; And each store session key that printer is known for it, by an ID index.But the two has big the limited memory capacity that is used for session key, but will forget session key on the basis of use the most at a specified future date where necessary.

When pen entered within the scope of printer, pen and printer found whether their are familiar with mutually.If they are not familiar with mutually, then printer determines whether it is assumed that this pen of understanding.This may be because for example this belongs to and is registered to use the user of this printer.If printer is wanted to be familiar with this pen but is not familiar with, then it starts automatic registration process.If printer does not want to be familiar with this pen, then it is reached an agreement to ignore it with pen, is placed in the charging cup (charging cup) up to this pen, and at this moment it starts registration procedure.

Except its common ID, this pen also comprises privacy key-interchange key.Key-interchange key also is recorded in the database of netpage registrar during fabrication.At period of registration, pen is sent to printer to its ID, and printer is sent to the netpage registrar to an ID.Server is produced as the session key that printer and pen use, and with this conversation key safety be sent to printer.It also transmits the copy of key-interchange key encrypted session key of using pen.Printer ground is stored by a session key of ID index, and encrypted session key is sent to pen.Pen is internally stored the session key by the printer ID index.

Though counterfeit pen can be pretended to be pen in a log-in protocol, have only true pen can decipher the session key that printer transmits.

When previous unregistered pen the was registered first, its use was restricted, and is linked to the user up to it.Registered but pen " not had " only is permitted for request and fills a netpage user and an enrollment form, to register the new user that new pen automatically links to, perhaps adds new pen to existing user.

Because the constraint of the hardware performance in the pen, pen uses privacy key but not public-key encryption.

3.4 confidential documents

The Netpage system supports sending of confidential documents such as ticket and ticket.The Netpage printer comprises in order to print the equipment of watermark, still only just does like this by the publisher's of proper authorization request the time.The publisher indicates in its certificate that print can be by the watermark of printer authentication.

" watermark " print procedure uses optional dither matrix in appointment " watermark " zone of page or leaf.Back-to-back page or leaf has comprised the mirror image watermark region that overlaps when printing.Used dither matrix is designed to when these zones are checked together to produce interference effect in the watermark region of odd and even number page or leaf, and it is opening to watch and realizing of printing by seeing through.

The similarity of this effect and watermark is that it is sightless when only checking the one side of page or leaf, and is lost when this page or leaf is copied by normal means.

The page or leaf of confidential documents can't utilize the built-in netpage described in top 1.9 joints to copy mechanism and copy.This expands on the photoprinter that netpage discovers and copies netpage.

Confidential documents typically produces as the part that electronic commerce transactions is handled.Therefore, they can comprise user's photo, and this photo is caught when the netpage registrar is registered biometric information the user, described in the 2nd joint.

When being presented secret netpage document, the recipient can verify its authenticity by its state of request under mode usually.Unique ID of confidential documents only is effectively in the lifetime of document, and confidential documents ID distributed non-adjacently, to prevent the expectation of opportunism adulterator to it.Can develop confidential documents checking pen with the built-in feedback of relevant authentication failed, to support to be easy to present the check of point (point-of presentation) document.

On the meaning of password, obviously watermark and user's photo is not safe.They provide the remarkable obstacle of forging accidental simply.Particularly use the online document of verifying pen to verify the increase level of the security that provides required, but still not to forging complete immunity.

3.5 it is undeniable

In the netpage system, the list that the user submits to is sent to the list processor reliably, and is archived in enduringly on the netpage page or leaf server.Therefore, the recipient can not deny transmitting.

The collector also can not deny the electronic payment that is undertaken by as the described system of the 4th joint.

4. e-business model

4.1 Secure Electronic Transaction is handled (SET)

Netpage system electronic transaction safe in utilization is handled (SET) system as one of its payment system.SET by MasterCard and Visa exploitation is organized around Payment Card, and this is reflected in the term.But the major part of system is independent of the type of employed account.Other payment system also can be used.

In SET, holder and businessman register to certificate organ of power, and are sent to the certificate that comprises its public signature key.Certificate organ of power suitably verifies the registration details of holder to the card issuer, and suitably verifies the registration details of businessman to assignee (acquirer).Holder and businessman are stored in private signature key separately on its computing machine safely.In payment process, these certificates are used to mutual authentication businessman and holder, and both equal authentications are arrived payment gateway.

SET is not widely adopted as yet, in part because the holder thinks that the maintenance of key and certificate is a trouble.Holder's key and certificate on the maintenance server, and obtained some success by the interim solution that password gives holder visit.

4.2SET payment

In the netpage system, the netpage registrar is used as the agency of netpage user's (being the holder) in the SET payment transaction is handled.

The Netpage system uses bio-identification that the user is carried out authentication and authorizes the SET payment.Because system is based on pen, used bio-identification is the user's online signature, comprises time dependent position and pressure.Although higher cost is arranged, also can use the fingerprint bio-identification in the pen by fingerprint sensor is designed into.The type of used bio-identification only influences catching of bio-identification, rather than the mandate aspect of system.

The first step that can carry out the SET payment is the bio-identification to netpage registrar registered user.This is for example to finish in bank at controlled environment.Can in identifying user identity, catch bio-identification here.Bio-identification is hunted down and stores in the registration database, and is linked to user's record.Described record is randomly caught and be linked to user's photo also.SET holder's registration process is done, and the private signature key that is obtained and certificate are stored in the database.User's payment card information also is stored, thereby gives the enough information of netpage registrar with the user agent in handling as any SET payment transaction.

When the user finally for example provided bio-identification to pay to finish by signature netpage order form, printer sent to the netpage registrar safely with ordering information, an ID and biometric data.Server is verified bio-identification at a user who is identified by an ID, and from that time as the user agent who finishes in the SET payment transaction is handled.

4.3 micropayments

The Netpage system comprises that the mechanism that is used for micropayments prints on demand low-cost document and copies document protected by copyright and charged easily to permit a user to, and the expense that might allow the user to be repaid to take place in the print ad material.The latter depends on the level of the subsidy that offers the user.

When the user registers ecommerce, add up to the network account of micropayments to be established.The user receives form on regular basis, and can use the payment mechanism of standard to settle accounts any unpaid debit surplus.

Network account can be expanded adding up to the subscription fee of periodical, itself otherwise also will be presented to the user with the form of each form.

4.4 issued transaction (Transaction)

When the user asked netpage in application-specific context (context), this application can embed the specific issued transaction ID55 of user in page or leaf.Input subsequently by this page is labelled with issued transaction ID, and described application can be set up the suitable context that is used for user's input thus.

But, when input takes place by the specific page or leaf of non-user, use and must use unique identity of user to set up context.Typical example comprises and will add user virtual " shopping cart " to from the project of sorted table (catalog) page or leaf of pre-printing.But in order to protect user's privacy, the known unique user ID 60 of netpage system is not preferably revealed to give to be used.This is to prevent the different application suppliers behavioral data of related independent accumulation easily.

On the contrary, the anonymity relation of netpage registrar and between using by unique another name ID65 maintenance customer, as shown in figure 24.When the user activated the hyperlink that usefulness " registered " attribute labels, the application ID64 that netpage page or leaf server requests netpage registrar will be correlated with changed into another name ID65 together with an ID61.This another name ID is submitted to the application of hyperlink then.

Applicating maintenance is by the status information of another name ID index, and can the specific status information of retrieval user, and needn't know user's overall identity.

System also safeguards and is used for independent certificate and the private signature key that each user uses, and handles thereby allow it only to use the application information specific to sign applied transaction with user's name.

For help system routing product bar code (UPC) " hyperlink " activates, system writes down the application of hobby with user's name at the product type of any amount.

Each is used all with to use the supplier related, and system safeguards account with each name of using the supplier, is to click credits such as expense and debit supplier thereby allow it.

Using the supplier can be the publisher of periodical subscription content.The system log (SYSLOG) user receives the wish of subscribing issue, and the expected frequency of issue.

4.5 resource description and copyright

Figure 40 has shown the preferred embodiment of resource description class figure.

Each document and content object can be illustrated by one or more resource descriptions 842.Resource description preferably uses Dublin Core associated metadata elements collection, and it is designed to be convenient to the discovery of e-sourcing.Dublin Core metadata meets w3c (W3C) resource description framework (RDF).Other associated metadata elements collection also can use.

Resource description can identify power holder 920.When the user printed content protected by copyright, the netpage system can automatically transmit copyright royalty from the user to the power holder.

5. communication protocol

Communication protocol limits the orderly exchange of the message between the entity.In the netpage system, utilize one group of agreement that limits to come the user interactions of collaboration process and netpage system as the entity of pen, printer and server.

Each agreement illustrates that by precedence diagram in precedence diagram, horizontal dimensions is used to indicate message flow and vertical dimensions is used to indicate the time.Each entity is represented by the vertical row of rectangle that comprises the entity title and presentation-entity lifeline.In the time that entity exists, lifeline is shown as dotted line.In entity was in the movable time, lifeline was shown as two-wire.Owing to do not create or destroy entity in the agreement of this consideration, in case lifeline just is interrupted when normally entity stops participation agreement.

5.1 reservation delivering protocol

Shown the preferred embodiment of subscribing delivering protocol among Figure 43.

A large number of users can be subscribed to the periodical issue.Each user's version (edition) can be by layout differently, but many users' version will be shared common content, as text object and image object.Subscribe delivering protocol and therefore come the delivery document structure to each printer, but send the shared content object by multicast (multicast) by program request.

Use (being the publisher) at first obtains to be used for each document from ID server 12 document id 51.Then, it sends each file structure to the page or leaf server 10 of the new ID of distribution that is responsible for document, comprises its document id and page or leaf description.It comprises the application ID64 of oneself, subscriber's another name ID65 and the relevant episode of multicast channel title.It uses its private signature key to sign message.

ID is used in the use of page or leaf server and another name ID obtains the printer ID 62 (it can be selected to be used for using clearly, perhaps can be user's default printer) of respective user ID60, user's selection and the certificate of using from registrar.

The certificate of using allows page or leaf server authentication information signature.Identify reservation 808 not together if use ID and call ID, so the request failure to registrar of page or leaf server.

Then, a page or leaf server-assignment document and a page or leaf example ID, and page or leaf described comprise that a page ID50 is transmitted to printer.It comprises the relevant episode that is used for the multicast channel title that printer listens to.

It turns back to newly assigned page or leaf ID then and uses so that reference in the future.

In case use by relevant page of server all file structures be distributed to subscriber's selected printer, then each subset of multicast shared object on its formerly selected multicast channel.Page or leaf server and printer both monitor suitable multicast channel and receive its required content object.Then, they can move into the file structure of (populate) previous program request.This allows the page or leaf server to add complete document to its database, and it allows the printer prints document.

5.2 hyperlink activation agreement

Figure 45 has shown the preferred embodiment of hyperlink activation agreement.

When the user used the netpage pen to click on netpage, pen sent click to nearest netpage printer 601.Position on described page or leaf of described click sign and the page or leaf.Printer has been learnt the ID61 of pen from a connection protocol.

Printer is determined the network address of the page or leaf server 10a of processing specific page ID50 by DNS.If the user is mutual with identical page or leaf in the recent period, so described address may be in its high-speed cache.Then, printer is transmitted to a page server to an ID, its own printer ID 62, page ID and click location.

The loading of page or leaf server describes 5 by the page or leaf of page or leaf ID sign, and determines which input element district 58 click is positioned at, if any.Suppose that relevant input element is a hyperlink element 844, the page or leaf server obtains related application ID64 and link ID54 then, and determines to administer the network address of using 71 application server by DNS.

The page or leaf server uses an ID61 to obtain respective user ID60 from registrar 11, and distributes the unique hyperlink request ID52 of the overall situation then, and makes up hyperlink request 934.Hyperlink request class figure has been shown among Figure 44.The ID of hyperlink request record request user and printer, and definite hyperlink example of being clicked 862.Then, the page or leaf server is to use to send its own server ID 53, hyperlink request ID and link ID.

Application produces response document according to using specific logic, and obtains document id 51 from ID server 12.Then, it sends to document the page or leaf server 10b of the new distribution ID that is responsible for document together with the ID of requested page server and hyperlink request ID.

Second page of server sends hyperlink request ID and uses ID to first page of server, to obtain respective user ID and printer ID 62.If the hyperlink request has expired or has been used for different application, first page of server refused this request so.

A second page of server-assignment document examples and a page or leaf ID50 turn back to application with newly assigned page or leaf ID, and full document is added to its own database, and finally send the page or leaf description to the printer of request.

The hyperlink example can comprise significant issued transaction ID55, and first page of server comprises the issued transaction ID in the message that sends to application in the case.This allows to use the specific context of issued transaction that foundation is used for hyperlink activation.

If hyperlink needs user alias, being it, " " attribute is set up to need another name, first page of server sends to registrar 11 with the application ID64 of an ID61 and hyperlink so, not only to obtain corresponding to the user ID of an ID and corresponding to the another name ID65 that uses ID and user ID.It comprises the another name ID in the message that sends to application, thereby allows to use the specific context of user that foundation is used for hyperlink activation.

5.3 handwriting recognition agreement

When the user drew stroke on netpage with the netpage pen, pen sent this stroke to nearest netpage printer.Path on described page or leaf of stroke sign and the page or leaf.

Printer is transmitted to page server 10 in common mode with an ID61, its printer ID 62, page or leaf ID50 and stroke path.

The page or leaf server loads by the page or leaf of page or leaf ID sign and describes 5, and definite stroke is crossing with which input element district 58, if any.Suppose that relevant input element is the text field 878, the page or leaf server appends to stroke in the digital China ink of the text field so.

In the text field district inertia after a period of time, the page or leaf server sends an ID and unsettled stroke so that explain to registrar 11.Registrar distinguishes and the corresponding user of pen, and the hand-written model of use user's accumulation 822 is interpreted as handwritten text to stroke.In case it is converted to text with stroke, then registrar turns back to text the page or leaf server of request.The page or leaf server appends to the text textual value of the text field.

5.4 signature verification agreement

Suppose that its district and the input element that stroke intersects are signature fields 880, page or leaf server 10 appends to described stroke in the digital China ink of signature field so.

In the district of signature field inertia after a period of time, the page or leaf server sends an ID61 and unsettled stroke so that checking to registrar 11.It also sends with signature field is the related application ID64 of the list of its part and the current data content of form ID 56 and list.Registrar is distinguished the user corresponding with pen, and use user's dynamic signature bio-identification 818 is verified as stroke user's signature.In case it has verified described signature, then registrar uses application ID64 and user ID 60 to distinguish user's the specific private signature key of application.Then, it uses described key to produce the digital signature of form data, and this digital signature is turned back to the page or leaf server of request.The page or leaf server is assigned to signature field with this digital signature, and the state of related list is arranged to freeze.

Digital signature comprises the another name ID65 of respective user.This allows single list to catch a plurality of users' signature.

5.5 list committing protocol

Figure 46 shows the preferred embodiment of list committing protocol.

List list hyperlink activation for ratification carries out.Therefore, it follows the agreement that limits in 5.2, and the specific interpolation of some lists is arranged.

Under the situation of list hyperlink, also comprise the current data content of form ID 56 and list to the hyperlink activation message of using 71 transmissions by page or leaf server 10.If list comprises any signature field, use so by extracting the another name ID65 related and obtaining corresponding certificate and verify each from registrar 11 with corresponding digital signature.

5.6 service charge payment arrangement

Figure 47 has shown the preferred embodiment of service charge payment arrangement.

In e-commerce environment, use expense from sale to the publisher and commission that the supplier can pay click, transaction and.The publisher also can pay to the supplier of printer about the commission of taking and the commission of commission.

Hyperlink request ID52 is used for expense or commission funds on account (credit) are sent to source application supplier 70b (being the publisher) and send printer supplier 72 to from source application supplier 70b from intended application supplier 70a (being businessman).

When activating hyperlink for the first time, intended application can receive hyperlink request ID from page or leaf server 10, as described in 5.2.When intended application need be used the supplier when paying the bill to the source, its sends to former page or leaf server together to the letter of credit of using the supplier and hyperlink request ID.The page or leaf server uses hyperlink request ID identification sources to use, and the letter of credit and source application ID64, oneself server ID 53 and hyperlink request ID are sent to relevant registrar 11 together.Registrar sends to application corresponding supplier account 827 to funds on account.Notice is used the supplier simultaneously.

If application provider need be to printer supplier payment, it sends to former page or leaf server together to printer supplier's funds on account and hyperlink request ID.The page or leaf server uses hyperlink request ID sign printer, and funds on account is sent to relevant registrar together with printer ID.Registrar sends to funds on account corresponding printer supplier's account 814.

Source application supplier randomly is apprised of intended application supplier's identity and source and uses supplier's printer supplier's identity.

6.Netpage pen is described

A 6.1 structure

With reference to figure 8 and Fig. 9, summarize the housing 102 that the pen of representing comprises the plastic mold form by reference number 101, it has the wall 103 that is defined for the inner space 104 that a parts is installed.Top 105 is rotatably installed in an end 106 of housing 102 at work.Translucent covering 107 is fastened onto the opposite end 108 of housing 102.Cover 107 also by molded plastics, and form so that the user can observe the state that is installed in the LED in the housing 102 by trnaslucent materials.Cover 107 and comprise major part 109, it centers on the end 108 of housing 102 basically, and extension 110, and it is stretched back from major part 109, and is matched with in the corresponding groove 111 that forms in the wall 103 of housing 102.Wireless antenna 112 is installed in after the extension 110 in housing 102.Be configured to receive the metal end-piece 114 that comprises corresponding screw thread 115 around the screw thread 113 that covers the hole 113A on 107.Metal end-piece 114 is dismountable to enable replacing ink cartridge.

Three look state LED 116 on covering the Flexible PCB 117 in addition of installing in 107.Antenna 112 also is installed on the Flexible PCB 117.State LED116 is installed in the top of pen 101 so that good observability on every side.

Described pen can be used as the normal labeled writing brush and both come work as non-marked contact pilotage (stylus).Writing brush box 118 with point 119 is installed in the housing 102 side by side with the contact pilotage 120 with contact pilotage point 121.By the top 105 of rotation pen, print cartridge point 119 or contact pilotage point 121 can propose by the openend 122 of metal end-piece 114.

Corresponding slide block

123 and 124 is respectively installed to print cartridge 118 and contact pilotage 120.Rotatable cam bucket (rotatable cambarrel) 125 is fastened onto a top 105 at work and is configured to its rotation.Cam bucket 125 comprises the cam 126 of the flute profile formula in the wall 181 of cam bucket.The

cam follower

127 and 128 that stretches out from

slide block

123 and 124 is matched with in the cam path 126.When 125 rotations of cam bucket,

slide block

123 or 124 relative to each other moves so that nib 119 or contact pilotage point 121 are stretched out by the hole in the metal end-piece 114 122.Pen 101 has three duties.By the step of rolling top 105 through 90 °, described three states are:

Contact pilotage 120 points 121 go out;

Print cartridge 118 points 119 go out; And

Print cartridge 118 points 119 do not go out, and contact pilotage 120 points 121 do not go out yet.

Second Flexible PCB 129 is installed on the electrical backplane 130 in housing 102.Second Flexible PCB 129 has been installed infrared LED 131, is used to infrared radiation is provided so that project the surface.On second Flexible PCB 129, provide imageing sensor 132, be used to receive from described surface through radiation reflected.Second Flexible PCB 129 is also installed radio frequency chip 133, and it comprises RF transmitter and RF receiver, and controller chip 134, is used to control the work of pen.Optical device piece 135 (being formed by molded transparent plastic) is seated in and covers in 107, and infrared beam is projected the surface goes up and image is received on the imageing sensor 132.Power lead 136 is connected to battery contact 137 with the parts on second Flexible PCB 129, and it is installed in the cam bucket 125.Terminal 138 is connected to battery contact 137 and cam bucket 125.Dog days' rechargeable battery 139 is seated in cam bucket 125 interior contacts with battery and contacts.Inductive charging coil 140 is installed, to enable by induction recharging to battery 139 around second Flexible PCB 129.Second Flexible PCB 129 has also been installed infrared LED 143 and infrared photodiode 144, be used for when contact pilotage 120 or print cartridge 118 are used to write, detecting the displacement in the cam bucket 125, so that enable the power that definite nib 119 or contact pilotage point 121 are applied to described surface.IR photodiode 144 detects via by being installed in reflecting body (not shown) on slide block 123 and 124 from the light of IR LED143.

Rubber is grabbed

pad

141 and 142 and is provided to towards the end 108 of housing 102 help to catch pen, and top 105 also comprises anchor clamps 142, is used for pen clip to pocket.

A 6.2 controller

Pen 101 is configured to by near the surf zone imaging the point being determined the position of its point (contact pilotage point 121 or print cartridge point 119) in INFRARED SPECTRUM.Its record is from the position data of nearest location tags, and is configured to utilize optical device 135 and controller chip 134 to calculate

point

121 or 119 and the distance of tick lables (tab).Controller chip 134 comes the orientation of calculating pen and point to arrive label (nib-to-tag) distance according to the perspective distortion of observing on the label of imaging.

(this is actually a pattern of three-color LED 116 can to comprise the control bit that stylus activates its " zone of action " LED from the control data of location tags, when pen was " zone of action " according to the zone that control data is specified to picture, three-color LED 116 was with yellowing).Therefore, can encode to zone corresponding on the surface, so that activate this LED, like this with the zone of action of button or hyperlink, when pen 101 moves past the zone of action of button or hyperlink, can provide button or hyperlink to be in movable visible feedback for the user of pen.Control data can also be indicated pen to catch continuous pen and be puted forth effort reading.Therefore, can encode, put forth effort to catch continuous pen to zone corresponding on the surface with the signature input field.

Pen can comprise a series of strokes with respect to the action on described surface.Stroke is made of the position that a lip-deep sequence has timestamp, and stroke finishes to pen-up event from pen down event.It should be noted that and to understand putting forth effort of pen according to a threshold value, thereby stylus is " mentioning " or " falling ", and can also for example when pen is caught signature, understand according to successive value.The stroke sequence of catching constitutes so-called " numeral China ink ".The numeral China ink can be used for forming and draw and the basis of hand-written digital, interactive by computing system so that hand-written ONLINE RECOGNITION, and sign at X-ray inspection X.

By utilizing RF chip 133 and antenna 112, pen 101 can send to digital inking data (its encrypted be used for safe and packaged to be used for high efficiency of transmission) computing system.

When pen was in the scope of receiver, digital inking data was sent out when it forms.When pen shifted out scope, digital inking data was buffered in pen interior (circuit comprises impact damper, and it is configured to the digital inking data of approximate 12 minutes pen motion on the storage surface) and can be sent out afterwards.

Controller chip 134 is installed on second Flexible PCB 129 of pen.Figure 10 is the block diagram that describes the architecture of controller chip 134 in detail.Figure 10 has also shown the expression of RF chip 133, imageing sensor 132, three look state LED 116, IR illumination LED 131, IR force transducer LED143 and force sensor photodiode 144.

Controller chip 134 comprises processor controls 145.Bus 146 enables the exchanges data between the parts of controller chip 134.Flash memory 147 and 512KB DRAM148 are also comprised.Simulation-to-digital quantizer 149 be configured to the to rely on oneself future analog signal conversion of sensor light electric diode 144 is a digital signal.

Image sensor interface 152 docks with imageing sensor 132.Transceiver controller 153 and baseband circuit 154 also are included to dock with RF chip 133, and described RF chip comprises RF circuit 155 and RF resonator that is connected with antenna 112 and inductor 156.

Processor controls 145 is caught from the surface by imageing sensor 132 and is decoded from the position data of label, monitors force sensor photodiode 144, control LED116,131 and 143, and handle the short-range radio communications that passes through radio transceiver 153.It is medium-performance (～40MHz) general risc processor.

Processor 145, digital transceiver parts (transceiver controller 153 and baseband circuit 154), image sensor interface 152, flash memory 147 and 512KB DRAM 148 are integrated among the single controller ASIC.Analog RF parts (RF circuit 155 and RF resonator and inductor 156) are provided in the RF chip separately.

Imageing sensor is that resolution is that (this sensor is made by Matsushita electronics corporation for CCD about the 215x215 pixel, it is at IEEE Transaction on Electronic Devices, the 1st phase the 47th of January in 2000 volume by Itakura, K T Nobusada, N Okusenya, R Nagayoshi, close description to some extent among " the A 1mm 50k-Pixel IT CCD Image Sensor for MiniatureCamera System " that writes with M Ozaki, this paper in the reference mode comprehensively at this), and have an Infrared filter.

When pen 101 did not contact described surface, after a period of time, controller ASIC 134 entered stationary state in inertia.It combines special circuit 150, and it monitors force sensor photodiode 144, and when starting writing incident, wakes controller 134 up by power supervisor 151.

Radio transceiver is in the no license 900MHz band that is normally used by wireless phone, or replacedly in unlicensed 2.4GHz industry, science and medical treatment (ISM) in-band communications, and frequency of utilization is beated and collision detection provides interference-free communication.

6.3 the optical device of pen

As mentioned above, Bi optical device is to be realized by molded optical device 135.Schematically shown the optical device of realizing by optical device body 135 among Figure 67.This optical device comprises first lens 157 (being used for the luminous of infrared LED 131 focused on), mirror 158, beam separator 159, object lens 160 and second lens 161 (being used for image focusing to imageing sensor 132).Axial ray 162 has shown optical path.

Optical path is designed to bore with the visual field picture rich in detail (seeing below) of the part 193 of 192 imaging surfaces that intersect in imageing sensor 132 is provided at necessary slant range.The prime focus element is object lens 160.These object lens also are used for from oppositely the illumination from IR illumination LED 131 being projected surface in the visual field.Owing to can't be placed on imageing sensor 132 and IRLED 131 simultaneously the focus place of target, thus use beam separator 159 separately this path and in each path independently relay

lens

157 and 161 respectively imageing sensor 132 and IR LED 131 are focused on again.This also allows to apply different holes on two paths.

The limit of imageing sensor 132 can be used as a field limiter of catching, and catches the path and be designed so that and obtain object space angular field (that is, for the application of this example, just being lower than 20 °) as required.The illumination path is designed to produce the object space visual field identical with catching the path, makes this illumination with the highest power and homogeneity filling material body space visual field.

The stroboscopic of IR LED 131 and the speed synchronization of frame-grab.Use the illumination that focuses on to allow short time shutter and little hole, the short time shutter prevents motion blur (motion blur), thereby allows catch position label data in a moving process.The enough depth of field of aperture permission is used for the case depth by the gamut that tilts to produce.This is caught the path and comprises that external hole eliminator 191 is used for this purpose.

Because the visible and near infrared part of 132 pairs of spectrum of imageing sensor all has stronger response, so in catching the path, front at imageing sensor increases Infrared filter 163, so that make imageing sensor capture the picture rich in detail of lip-deep flag data, can not be subjected to the interference of lip-deep other figure, these other figures can adopt China ink transparent under near infrared to print.

6.4 the processing of pen

When the contact pilotage of pen point 121 or print cartridge point 119 during with surperficial the contact, pen is determined its position and orientation with respect to the surface with 100Hz, thereby allow accurately handwriting recognition (to see IEEE Transactions onPatent Analysis and Machine Intelligence, " the TheState of the Art in On-Line Hand Writing Recognition " that the 8th phase the 12nd of August nineteen ninety rolls up, author: Tappert, C, CY Suen and T Wakahara, the announcement of this article in mutual ginseng mode comprehensively at this).It is in " mentioning " or " falling " that force sensor photodiode 144 is used for respect to the threshold value stylus.As mentioned above, can also be masterpiece that successive value is caught, so that the whole of signature dynamically can be verified.

By with infrared spectrum near the surf zone imagings of point 119,121, pen can be determined its point 119,121 position and orientation from the teeth outwards.It is decoded to nearest label data, and according to the observation to the perspective distortion of imaging label and the known geometric form of the optical device 135 of pen calculate point 119,121 positions (seeing below) with respect to location tags.Though the position resolution of label may be lower, adjusted position resolution is quite high, just can surpass easily and be used for the required 200dpi resolution (reference that sees above) of handwriting recognition accurately.

Pen is captured as a series of strokes with respect to the action on surface.Stroke comprises the position that a lip-deep sequence has timestamp, from pen down event, to pen-up event end subsequently.When area I D changed, when promptly under normal circumstances stroke had just begun, stroke was also indicated the area I D on surface.As mentioned above, each location tags comprises the area data in the zone that this label was positioned in the data of indicating its position from the teeth outwards and the indication surface.

Figure 68 has shown the location tags and the stroke process of carrying out in pen.Controller 134 is gesticulated beginning (164) from sky.Then, it constantly puts forth effort sampling (at 165 places) to point by force sensor photodiode 144, with the inspection state (at 166 places) of starting to write.If pen is in the state of starting to write, controller 134 is caught the image (at 167 places) on surface, label (at 168 places) in the image that catch the location, from these label tag decoder data (169), infer position and the orientation (at 170 places) of pen, and position data is appended to current stroke data (at 171 places) with respect to the surface.When detecting pen-up event, promptly by behind the represented state of starting to write of the appearance of non-NULL stroke, during detected pen-up state (at 172 places), 134 pairs of stroke datas of controller are encrypted (at 173 places), and stroke data is sent to computing system (at 174 places) by RF chip 133 and antenna 112, begin (at 164 places) with another sky stroke then.

Suppose quickish 8 multiplication (3 circulation), so when being in activity, the time that this Processing Algorithm (seeing below) will be used the processor about 80%.

Transmit if pen exceeds the scope of computing system, it is buffered in digital China ink in its internal storage so.When in the scope that next time is in computing system, it transmits the numeral China ink of all buffer memorys.When the internal storage of pen was full of, pen stopped to catch numeral China ink, and when the user attempts to write with this pen, the wrong LED on this will glimmer.

Table 4 has been listed from the composition of pen to the original figure China ink of computing system transmission.Figure 69 has shown the figure of the structure of original figure China ink.When pen worked offline, the numeral China ink of buffer memory stored with identical form with the numeral China ink that is sent to described system in pen.

The composition of table 4. original figure China ink

The composition of original figure China ink	Unit	Precision (position)	Scope
The composition of original figure China ink	Unit	Precision (position)	Scope	ID	-	128	-
Point ID	-	128	-	ID	-	128	-
Point ID	-	128	-	Absolute time	ms	64	-
Last system time	ms	64	-	Absolute time	ms	64	-
Last system time	ms	64	-	Area I D	-	100	-
Time offset	ms	32	49.7 my god	Area I D	-	100	-
Time offset	ms	32	49.7 my god	Label ID	-	16	-

The x biasing	20um	S9	±10mm
The x biasing	20um	S9	±10mm	The y biasing	20um	S9	±10mm
X rotates (inclination)	Degree	S7	±90°	The y biasing	20um	S9	±10mm
X rotates (inclination)	Degree	S7	±90°	Y rotates (rolling)	Degree	S7	±90°
Z rotates (deflection)	Degree	S7	360°	Y rotates (rolling)	Degree	S7	±90°
Z rotates (deflection)	Degree	S7	360°	Z power	-	8	255

When pen 101 is connected to computing system, controller 134 with the form of original figure China ink title 182 to a notifications ID, sharp ID, current absolute time and the last absolute time that before off-line, obtains from system.This makes any deviation of the clock that system can calculating pen, and any digital China ink that receives from pen is carried out corresponding time migration.Then, synchronous its real-time clock of the accurate real-time clock of a using system.As more than one-pen and computing system operation the time, an ID makes computing system can identify this pen.For example identifying an owner and with specific oriented approach and this owner in the mutual system, an ID may be very important with pen.In other embodiments, this can not be required.What point ID made that computing system can identify current use is which point, stylus tip 121 or print cartridge point 119.Which point computing system can be used for changing its operation according to.For example, if what using is print cartridge point 119, computing system can be postponed and be produced feedback output so, because immediate feedback is to be provided by the black mark that produces from the teeth outwards.If contact pilotage point 121 is being used, computing system just can produce immediate feedback output so.

When stroke begins, a controller 134 will be recorded in the raw stroke title 183 by elapsed time since the last absolute time of notifying system.For each position in the stroke, controller 134 is with original position 177 form writing points 119,121 putting forth effort apart from x, y, z rotation and the point of the x of current label and y biasing, pen.If label ID (be used for identified areas in label) changes, controller only can change 178 forms record label ID with label so.Because label frequency is more much lower than typical position sample frequency, so for several continuous positions, label ID is constant, and if stroke is shorter, so for whole stroke, label ID can be constant.

Because to its position and orientation sampling, so the position in the stroke impliedly come clock with 100Hz to pen, do not need clear and definite timestamp with 100Hz.If pen is failed the calculating pen position, as because it fails tag decoder, so pen also must the recording pointer position so that keep implicit clock.Therefore, pen is described location records " the unknown " with the form of a unknown position 179, allows computing system can insert this position according to adjacent samples where necessary later on.

Because be limited in scope (promptly 49.7 days) of 32 bit times of stroke biasing, so pen is a stroke record absolute time with the form of time change 176 randomly.This becomes absolute time, and the time offset of later stroke is measured with respect to this absolute time.

Because for several continuous strokes, area I D is constant, thus pen only when area I D changes with the form posting field ID of area change 180.This becomes the area I D with a later position implicit associations.

Because the user can change point 119,121 between a stroke and the next one, so pen is that stroke writes down sharp ID with the form of point change 175 randomly.This become with later stroke implicit associations sharp ID.

Each composition of stroke all has a prefix by entropy coding, and is as shown in table 5.

Table 5. raw stroke composition prefix

The raw stroke composition	Prefix
The raw stroke composition	Prefix	Original position	0
A unknown position	10	Original position	0
A unknown position	10	Label changes	1100
Stroke finishes	1101	Label changes	1100
Stroke finishes	1101	Area change	11100
Point changes	11101	Area change	11100
Point changes	11101	Time changes	11110

1 second by a definite date 10mm stroke strides across two or three labels, comprises 100 position samplings, and therefore has about 5500 size.Therefore, on-line continuous numeral China ink is caught the high transmission speed that requires 5.5Kbps, and off-line continuous number China ink is caught and required the about 40K byte of per minute memory buffer.So the 512KB DRAM 48 of pen can keep the continuous number China ink more than 12 minutes.Time, zone and point change rare, therefore can ignore the influence of required transmission speed and buffering storer.The other compression of position can further reduce transmission speed and buffering storage requirement.

Before being sent to computing system, each raw stroke all adopt the Triple-DES algorithm for encryption (see Schneier, B, Applied Cryptography, Second Edition, Wiley 1996, the announcement of this book in mutual ginseng mode comprehensively at this).For this purpose, pen and computing system exchange session key on the basis of rule.By 50 round-robin conservative estimations of each encrypted bits, a second 5500 strokes encryption consume processor 45 times 0.7%.

6.5 other a embodiment

In interchangeable embodiment, pen is combined with Infrared Data Association (IrDA) interface, is used for carrying out junction service with base station or netpage printer.

In this another embodiment, pen 101 comprises the pair of orthogonal accelerometer, and this accelerometer is installed in the normal plane of pen axle.Shown accelerometer 190 with empty frame among Fig. 9 and Figure 10.

The providing of accelerometer enables this embodiment sense movement of this pen, and needn't the reference surface location tags, makes the location tags can be sampled with lower speed.Each location tags ID can identify the object of care then, rather than lip-deep position.For example, if to liking user interface input element (for example order button), the label ID of each location tags in this input element zone can directly identify input element so.

The acceleration of being measured in each of X and Y direction by accelerometer was integrated to produce instantaneous velocity and position about the time.

Because the reference position of stroke is unknown, therefore can only calculate the relative position in the stroke.Though the position integration is accumulated in the error in the acceleration of sensing, accelerometer typically has high resolution, and the duration of stroke, i.e. the error accumulation time is short.

The 7Netpage printer is described

7.1 the structure of printer

Vertically the netpage wall type printer of installing 601 is assembled fully in Figure 11 and is illustrated.It uses duplex 8 ¹/ ₂" Memjet ^TMPrint engine 602 and 603 is printed netpage on the medium of letter/A4 size, shown in Figure 12 and 12a.It uses straight paper path, and wherein paper 604 is by duplexing

print engine

602 and 603, and described engine is printed one two sides simultaneously with panchromatic and hemorrhage entirely (full fleed).

Become whole binding assembly 605 and use adhesive tape, thereby when it is exerted pressure, make it adhere to first toe-out along each edge opening of printing.Produce final bookbinding document 618 thus, its thickness range can be opened to hundreds of from one.

The changeable ink box 627 with duplexing print engine coupling shown in Figure 13 has capsule or chamber, is used to store fixing agent, adhesive and green grass or young crops, fuchsin, Huang, black and infrared China ink.Described box also comprises the microvoid air filter in the base module.This microvoid air filter docks by the interior pneumatic pump 638 of flexible pipe 639 and printer.Provide filtered air to printhead thus, enter into Memiet to prevent particulate ^TMIn the printhead 350, otherwise it may block print-head nozzle.By in described box in conjunction with air strainer, the mission life of filtrator by contact (linked) effectively to life-span of box.But print cartridge is the product of complete recycle, and it has printing and bonding 3000 pages (1500 s') ability.

With reference to Figure 12, vehicularized medium pick-up roller assembly 626 is opened the top directly from the medium pallet from being pulled through the paper sensor of first print engine 602, draws in duplexing Memjet ^TMIn the print head assembly.Two Memjet ^TMPrint engine 602 and 603 is mounted with (in-line) arranged in order on the opposite line along straight paper path.Paper 604 is whole by becoming, power-actuated (powered) pick-up roller 626 is moved in first print engine 602.Sensed and the complete hemorrhage printing of the position of paper 604 and size begins.Fixing agent is printed simultaneously to help at the shortest possible time inner drying.

Paper withdraws from a Memiet by one group of power-actuated spike wheel (spike wheel) (along straight paper path alignment) that withdraws from ^TM Print engine 602, described spike wheel acts on the roller of gluing.These spikes wheel contact " wet " print surface, and will open 604 continuously and be fed to the 2nd Memiet ^TMIn the print engine 603.

With reference to Figure 12 and 12a, paper 604 is delivered to the attachment means assembly 605 from duplexing print engine 602 and 603.The page or leaf of being printed is transmitted to the power-actuated spike wheel shaft 670 with fiber support roller and has between another movable axle of spike wheel and snap action rubber tire (glue wheel).Movable axle/glue assembly 673 is installed in the metallic support support, and it transports forward under the effect of camshaft, docks with Power Available Shaft 670 by gear.Independent motor provides power for this camshaft.

Rubber tire assembly 673 comprises the empty axle 679 of part, and it has the rotation coupling that is used to glue together from the supply flexible pipe 641 of print cartridge 627.Axle 679 is connected with rubber tire, and rubber tire absorbs adhesive by hole radially by capillary action.Molded shell 682 wherein forwardly has opening around rubber tire.Pivot side form spare and (sprung) external door on the spring be attached to metal support and when the remainder of assembly 673 is pushed ahead the hinge produce by (sideway).This action exposes rubber tire by the front of housing 682.The tension spring closing assembly and effectively between craticular stage in cover rubber tire.

When opening 604 when being delivered in the rubber tire assembly 673, when it is transported down in the binding assembly 605, adhesive be applied to the front (with first of document away from) on a vertical edge.

7.2 printer controller architecture

The Netpage printer controller comprises that processor controls 750, producer install or the DRAM 657 of field erected Network Interface Module 625, radio transceiver (transceiver controller 753, baseband circuit 754, RF circuit 755 and RF resonator and inductor 756), double grid table images processor (RIP) DSP 757, duplexing

print engine controller

760a and 760b, flash memory 658 and 64MB, as shown in Figure 14.

The processor controls processing is communicated by letter with network 19 and local wireless netpage pen 101, sensing help button 617, and control user interface LED 613-616, and present and synchronous RIP DSP757 and print engine controller 760.It is made of medium-performance general purpose microprocessor.Processor controls 750 is communicated by letter with print engine controller 760 by high-speed serial bus 659.

RIP DSP rasterizing and page compression are described to the page compression form of netpage printer.Each print engine controller all in real time (promptly with per minute more than 30 pages) expansion, shake and type face image to its related Memjet ^TMPrinthead 350 type face images.The duplex print engine controller is printed one two sides simultaneously.

Master print engine controller 760a controls paper in conjunction with main QA chip 665 and print cartridge QA chip 761 and transports and monitor that China ink uses.

The flash memory 658 of printer controller holds software and the configuration data that is used for processor 750 and DSP757.It is copied into primary memory 657 when guiding.

Processor 750, DSP 757 and digital transmitting and receiving machine parts (transceiver controller 753 and baseband circuit 754) are integrated among the single controller ASIC 656.Analog RF parts (RF circuit 755 and RF resonator and inductor 756) are provided in the independent RF chip 762.Network Interface Module 625 is independent, is that producer is selected or on-the-spot the selection because the netpage printer allows network to connect.Flash memory 658 and 2X256Mbit (64MB) DRAM 657 also is that chip is outer.Print engine controller 760 is provided among the independent ASIC.

Diverse network interface module 625 is provided, and each all provides netpage network interface 751 and optional local computer or network interface 752.Netpage network interconnection network interface comprises the POTS modulator-demodular unit, mixes fine one coaxial (HFC) cable modem, isdn modem, DSL modulator-demodular unit, satellite transceiver, cellular telephone transceiver current and of future generation and wireless local loop (WLL) transceiver.Local interface comprises IEEE 1284 (parallel port), 10Base-T and 100Base-T Ethernet, USB and USB 2.0, IEEE 1394 (live wire) and various emerging home networking interface.If Internet connection is available on local network, local network interface can be used as the netpage network interface so.

Radio transceiver 753 is in the no license 900MHz band that is normally used by wireless phone, and perhaps replacedly in unlicensed 2.4GHz industry, science and medical science (ISM) in-band communications, and frequency of utilization is beated and collision detection provides interference-free communication.

Printer controller randomly in conjunction with Infrared Data Association (IrDA) interface so that receive from equipment " (squirted) of ejection " data as the netpage camera.In interchangeable embodiment, printer use the IrDA interface so that with the short haul connection of the netpage pen of suitable configuration.

7.2.1 rasterizing and printing

In case the page or leaf layout and the page or leaf object of document have been received and verified to primary processor 750, it is at the suitable RIP software that just moves on the DSP 757.

Description of DSP 757 each pages of rasterizing and compression are through the page or leaf image of rasterizing.Primary processor is stored each compressed page or leaf image in storer.The plain mode of a plurality of DSP of load-balance is the page or leaf that makes each DSP rasterizing independent.Owing to can in storer, store the page or leaf through rasterizing of any amount usually, so DSP can be held busy all the time.When rasterizing short essay shelves, this strategy only causes the DSP of potential difference to utilize.

Watermark region during page or leaf is described is tiled into continuous tone-resolution diadic bitmap, and it nondestructively is compressed to insignificant size and it forms the part of compressed page or leaf image.

Infrared (IR) layer of type face comprises the encoded netpage label of the density that is in 6 of about per inchs.Each label all encode a page ID, label ID and control bit.And the data content of each label is produced and is stored in during grating is formatted in the compressed page or leaf image.

Primary processor 750 is arriving duplexing print engine controller 760 back to the back page image transfer.Each print engine controller 760 is the compressed page or leaf image of storage in its local storage all, and the beginning page or leaf launches and print streamline.Page or leaf launches and prints is pipelining, and this is because the whole 114MB diadic CMYK+IR page or leaf images of storage are unpractiaca in storer.

7.2.2 print engine controller

Page expansion of print engine controller 760 and printing streamline comprise High Speed I EEE 1394 serial line interfaces 659, standard jpeg decoder 763, standard Group 4 fax decoder devices 764, customization shadow tone device/compositor unit 765, custom tag encoder device 766, row loader/formatter unit 767 and arrive Memjet ^TMThe custom interface 768 of printhead 350.

Print engine controller 360 is worked in the double buffering mode.When a page or leaf was loaded among the DRAM 769 by HSSI High-Speed Serial Interface 659, the previous page or leaf that loads was read and is transmitted by the print engine controller streamline from DRAM 769.In case described page or leaf has been printed and finished, the page or leaf that has just loaded is printed, and another page or leaf is loaded simultaneously.

The phase one of streamline (763) is launched the continuous tone CMYK layer of JPEG compression, (at 764 places) launch the black layer of diadic of Group 4 fax compressions, and reproduce (766) diadic netpage label layer according to the tag format that in the 1.2nd joint, limits, walk abreast all.Subordinate phase (765) shake continuous tone CMYK layer is (765) black layer of synthetic diadic on resulting diadic CMYK layer also.The diadic CMYK+IR point data that is obtained cushions and formats (767) so that at Memjet by one group of line buffer ^TMPrint on the printhead 350.These row bufferings of great majority are stored among the outer DRAM of chip.Final stage is passed through print head interface 768 to Memjet ^TMPrinthead 350 is printed the diadic point data (comprising fixing agent) of 6 passages.

When as in duplex configuration, several print engine controllers 760 are united when using, they come synchronization by the line synchronizing signal of sharing 770.Only print engine 760 of selecting by the master/slave stitch 771 in outside produces line synchronizing signal 770 on common lines.

Print engine controller 760 comprises low speed processor 772, is used for page or leaf expansion synchronously and reproduces streamline, comes configurable print head 350 by low-frequency serial bus 773, and control step motor 675,676.

At 8 of netpage printer ¹/ ₂" in the version, two print engines each all along the long yardstick of page or leaf (11 ") 30 letter pages or leaves of printing per minute, thereby provide the scanning frequency rate of 8.8kHz at 1600dpi.The netpage printer 12 " in the version, two print engines each all along the short-scale (8 of page or leaf ¹/ ₂") print 45 letter pages or leaves of per minute, thus the scanning frequency rate of 10.2kHz provided.These scanning frequency rates are fully at Memjet ^TMIn the frequency of operation of printhead, it surpasses 30kHz in current design.

8.Netpage label

8.1 label tiling

8.1.1 planar tags tiling

Mutual with " the clicking " in the zone that labels in order to support by sensor device, no matter sensor device positioned area or orientation are how, sensor device must be able to be seen at least one the complete label 4 in its visual field.Therefore, the visual field diameter of needed sensor device is the size and the function at interval of label 4.

If label shape is circular, as the preferred tag of describing earlier 4, when the diameter that tiles is the label 500 of k, can obtain the minimum diameter m in the sensor visual field so on the equilateral triangle lattice, shown in Figure 52 and be defined in the equation 1.When center-to-center label is identical with label diameter k at interval, can realize this situation.

For 256 label diameter k (is about 4 millimeters at 1600dpi), therefore m is 552 points (～8.8 millimeters).For 16 dead zone, promptly effectively label diameter k is 272 points (～4.3 millimeters), and m is increased to 587 points (～9.3 millimeters).

When label 4 is removed apart from s (s is the same with k at least big), the then minimum visual field is provided by formula 2.

(for example be easier to) when existing between the label 500 of not wishing continuous row in the horizontal direction when overlapping, must remove the distance that provides by formula 3 at least to label so for label is reproduced.For the label of 256 spot diameters, therefore u is 40 points (being～0.6 millimeter at 1600dpi).Because this has surpassed the required dead zone of label, and is not overlapping if row of labels is reproduced as, and can ignore the dead zone so.

S=k+u is set in equation 2 can gets equation 4.For the label of 256 spot diameters, therefore s is 296 points (being～4.7 millimeters at 1600dpi), and m is 598 points (～9.5 millimeters).

8.1.2 sphere label tiling

Usually adopt regular icosahedron to be used to produce the approximate rule triangle tiling of ball as the basis.Icosahedron 526 among regular icosahedron such as Figure 53 is made of 20 equal-sized equilateral triangle faces 528, and these gores are shared 30

limits

530 and 12 summits 532, wherein has 5 limits 530 to intersect on each summit 532.

In order to realize required tiling, need be meeting (inscribe) in the icosahedron 526 in the target sphere, and each triangle 528 of icosahedron 526 is subdivided into the equal-sized equilateral segmentation of equal amount (subdivision) triangle, to produce the triangle of required total quantity.If icosahedral each limit 530 is divided into v line segment that equates, along fixed one group of v-1 the point of each margin, every pair of corresponding point along any two adjacent edges are connected by the line that is parallel to another adjacent edge of sharing, the line of drawing so like this intersects on required equal and opposite in direction and equilateral segmentation vertex of a triangle, thereby will produce V on each gore 528 of icosahedron 526 ²Individual triangle, perhaps 20V altogether ²Individual triangle.10V in the result ²In+2 summits, have five gores to intersect, and six gores intersect on remaining each summit at each place of 12 original vertices of icosahedron 526.12 original vertices 532 have been on the sphere, and remaining summit is positioned at ball.Heart projection (project) provides required tiling in the summit of each generation so the quilt to sphere.

The sphere that adopts aforesaid way to approach by regular polygon is called geodesic line (geodesic), and parameter v is called geodesic frequency.Figure 54 has shown icosahedral geodesic line 534, and wherein v=3 promptly, has 180 faces 528.

The face center of segmentation triangle and icosahedron 526 is near more, and it and sphere are far away more, and is therefore, also just big more when projecting to sphere.For the variation of the leg-of-mutton size of segmentation that makes projection is minimized, before projection, the segmentation summit can be by (the Tegmark that systematically is shifted, M., " An Icosahedron-BasedMethod for Pixelizing the Celestial Sphere ", ApJ Letters, 470, L81, October14,1996).If v=1 can not produce the summit so, and on a fixed point, the angle that gore faces toward still is 60 °.But, along with the increase of v, become more and more flat, and the drift angle of each gore concentrates on 72 ° (promptly 360 °/5) by the surface that limits around 5 gores of each original fixed point.This defines the worst case of label tiling on the sphere.In one 72 ° isosceles triangle, base length is 1.18 times of dual-side length.Therefore, the maximum label interval s that is used for the calculating sensor visual field approaches 1.18k.When the label diameter is 256 and dead zone when being at 16, promptly effectively label diameter k is 272 points (～4.3 millimeters), and according to equation 2, therefore m is 643 points (～10.2 millimeter).

Be positioned at external sphere centre icosahedral each limit right angle provide by equation 5.

For radius is the sphere of r, and the arc length on each central projection limit is r θ.Suppose that label diameter K is identical with the unit of r, cover the required number of labels n of sphere so and provide by equation 6.

For given n, r is by equation 7 restrictions.

If n is limited to 2 ¹⁶, needn't cover spheres with a plurality of zone in order to allow to use 16 label ID, and K is taken as above-mentioned 4.3mm, so r be restricted to～310 millimeters.

The radius of common terrestrial globe (globe) is 160 millimeters.Its～177 millimeters projection arc length cooperates 41 evenly spaced labels with insignificant additional spacer.The One Earth One Family instrument uses 16812 labels altogether like this.

8.1.3 arbitrary surface label tiling

Adopt triangle gridding can approach the surface of random appearance and topological structure, and can not introduce discontinuous or singular point.The local proportion of grid (local scale) depends on the local curvature and the error range on surface.Suppose to exist the triangle gridding be used for particular surface, as long as each mesh triangles shape is noted the requirement of minimum drift angle and bond length, just can realize the effective irregular tiling of label so.If the visual field of sensor device is guaranteed to comprise at least one complete label of the optional position that is in the above sensor device of described surface, the tiling about specific sensor device is considered to effective so.

The tiling process is placed label from each summit at grid, and like this bond length is identical with label diameter k.The tiling process is undertaken by inserting label in length above the midpoint on all limits of maximum label distance s.As shown in Figure 9, maximum label distance s is calculated, if so that the distance between two adjacent label 4a and the 4b is s+ ε, be useful on the space of another label 4c so between them, promptly equation 8.

But, if the item angle between the limit that two length is s+ ε less than 60 °, the label of Cha Ruing is with overlapping so.

Overlapping for the label that prevents to insert, introduce minimum label spacing t, wherein t 〉=k.So minimum apex angle becomes the function of k and t, as shown in equation 9.

Clearly, when t=k, β is confined to 60 °, and promptly grid is confined to equilateral.But shown in Figure 56, when t＞k, β can be overlapping for not inserting label less than 60 °.

According to formula 10, maximum label distance s must be based on new minimum label spacing t.

When considering specific mesh triangles shape, there are four kinds of different labels to insert situation.By supposing that minimum drift angle is not less than 30 ° (i.e. half of 60 °), we can find that when mesh triangles shape had at least one its length to be less than or equal to the limit of s, the length on all the other two limits was less than 2s.In fact, minimum drift angle is normally at least 45 °.

Under first kind of situation (Figure 57), triangle 546 does not have length to surpass the limit of s.So leg-of-mutton labelling finished.

Under second kind of situation (Figure 58), the length on a limit 548 of triangle 550 surpasses s, and 548 mid point inserts label 552 to finish labelling of triangle 550 on the limit.

Under the third situation (Figure 59), two limits 554 of

triangle

558 and 556 length surpass s, and each the mid point on two long limits 554,556 inserts label 560 and 562, and this can finish labelling of triangle 558.Two summits 564,566 of the minor face 568 of two centers of inserting

label

560 and 562 and original triangle 558 constitute one trapezoidal.If described trapezoidal any cornerwise length surpasses s, insert a final label 570 to finish described leg-of-mutton labelling at described trapezoidal center so.

Under the 4th kind of situation (Figure 60), the length on all three limits 572 of triangle 573 all surpasses s.The summit 574 that labels is inserted in the mid point and 574 limits 576, described three new summits on every limit 572 and links up.The described program loop that labels is applied to four results' triangle 577,578,579 and each of 580.It should be noted that new triangle observes the minterm angle, because they have the shape identical with original triangle 573.

Label tiling variable is summarised in the table 4.

Table 4. label tiling variable

Variable	Meaning
Variable	Meaning	β	Minimum drift angle
k	The label diameter	β	Minimum drift angle
k	The label diameter	m	The minimum diameter in the upper sensor visual field, surface
s	Center of maximum-to-center label spacing	m
s	Center of maximum-to-center label spacing	t	Minimum center-to-center label spacing

8.2 tag senses

8.2.1 pen orientation

In order to allow a class sensor device to be used as comfortable writing implement, must support a scope of pen orientation.Because nib is confined to described surface and contacts, the pen orientation is characterised in that deflection (z rotation), tilts (x rotation) and rolls (y rotation), shown in Figure 61.Though the deflection of pen must be unrestricted, the inclination of limit pen and rolling and by the combination of tilting and roll cause overall tilt be rational.

Deflection normally is employed after inclination, so that for example it limits reversing of a direction in physical axis rather than the surface under the situation of an equipment.But in having the pen of mark point, the axle that imageing sensor leaves pen is mounted, therefore, unless pen is held approximately perpendicular state, otherwise the image sensing ability of pen (with and the deflection sensing function) therefore will be restricted, as mentioned below.Therefore deflection should be employed before tilting, and allowed by specifying its whole range of deflection to keep simultaneously tilting with respect to described surface rotation pen and rolling constant.

Tilt and roll and be defined as y rotation and x rotation usually respectively.Because they are that wherein when watched by the user, the y axle is the longitudinal axis of nature with respect to the definition of the x-y coordinate system on surface, the x axle is the transverse axis of nature, therefore tilts and roll to be defined as the x rotation respectively and y rotates at this.In right hand 3D coordinate system, rolling when counterclockwise just is generally defined as, and inclination and deflection just are generally defined as when clockwise.Here all rotations all just are defined as when counterclockwise.

According to equation 11, total inclination angle (θ) of pen is relevant with roll (ψ) with its inclination (φ).

Therefore the imaging ratio of the surface characteristics in the inclination effect visual field of pen on the difference influences the resolution of imageing sensor.Because the sensing directly zone below nib is unpractiaca, therefore the inclination angle of pen also influences the distance of point to the imaging region center.In order to allow accurate sharp position to derive from the position of being determined by label, this distance must be known.

8.2.2 image sensing

When optical axis when being vertical, the visual field can be modeled as a cone (cone) of being determined by real half-angle α (providing the dihedral visual field of 2 α) and described lip-deep apex height D.Though imageing sensor is rectangle normally, the maximum oval subregion that has only described imageing sensor, is quantized as the front by imaging relevant for the enough major part that guarantees described surface.

Visual field circular cone and described surface crossing determined lip-deep oval window.When optical axis when being vertical, this window is circular.

Figure 62 has shown for the given of an optical axis and the relevant inclination angle [theta] that tilts, the point (A point) of pen, the optical axis (CE) of pen and the geometric relationship between the window visual field (FH).The inclination angle is defined as from described vertical edge clockwise to just.Following equation is applicable to positive rake and negative incidence.

When pen is not tilted, and the window diameter (promptly | BD|) provide by equation 12.

When pen is not tilted, if nib to the distance on the limit of window (promptly | AB|) be T, so nib to the distance of window center (promptly | AC|) S is provided by equation 13.

When the inclination angle of pen is θ, along the distance of optical axis from the viewpoint to the surface be reduced to d (promptly | GE|), provide by equation 14.

The width of described window (promptly | FH|) provide by equation 15 subsequently.

D and α must be selected so that in the inclination angle scope that all is supported enough big zone by imaging.The required minimum diameter m in described zone is provided by equation 4, and the width in actual imaging zone is provided by equation 15.This provides equation 16 subsequently.

In case D and α are determined, must select image sensor resolutions so that imaging region is sufficiently sampled, that is, maximal characteristic frequency is with Nyquist rate or higher and be sampled.

During imaging, the ratio on surface is along with from the increase of the distance of described viewpoint and along with reducing with respect to the increase of the degree of tilt of viewing ray.For positive rake, the influence of these two factors reaches maximum at a F; For negative incidence, their influence reaches maximum at a H, that is to say, in window apart from viewpoint point place farthest.It should be noted that when the inclination angle when negative, the reference to F in the following discussion is applied to H.

Point F to the distance of viewpoint (promptly | EF|) provide by equation 17.

The convergent-divergent that causes because of the inclination on the surface that is relevant to the viewing ray by F (EF) is provided by equation 18.

If the characteristic frequency on surface is f, the angled surface characteristic frequency ω (promptly with respect to the visual field) at F that causes because of two factors is provided by equation 19 so.

When not having the object plane inclination angle (θ=0), this becomes equation 20.

By definition, imageing sensor must be at least to the visual field imaging of whole dihedral.Because the picture element density of imageing sensor is uniformly, so it must be with highest frequency to the whole visual field imaging.Suppose that the dihedral visual field is in the image space of 2 α ', the imageing sensor inclination angle (being plane of delineation inclination angle) that is relevant to optical axis is θ ', sampling rate is n (wherein according to a Nyquist's theorem, n 〉=2), and minimum image sensor resolution q is provided by equation 21 and equation 22.

The identical reasoning of the cosine square item of the denominator of the cosine square Xiang Congyu equation 19 of the molecule in the equation 22 and obtaining.

When there not being plane of delineation inclination angle (being θ '=0), and the dihedral visual field of image space and object space equates (to be that α '=α), equation 23 and equation 24 are concluded in this variation.

When not having the object plane inclination angle (θ=0), this further is changed to equation 25.

Equate (be θ '=θ), and the dihedral visual field of image space and object space to equate (to be that α '=α), equation 22 becomes equation 26 when image planes inclination angle and object plane inclination angle.

Therefore, compare, make as inclination angle, plane and object plane inclination angle coupling and therefore produce less required image sensor size, and eliminate perspective distortion from catching image with the imageing sensor inclination angle that is fixed as 0.But in practice, variable image sensor inclination angle is relatively costly option, and requires the bigger depth of field.

Figure 63 shows the given rolling-relevant inclination angle [theta] for the optical axis of described pen, the point of pen (some A), the optical axis (CE) of pen and the geometric relationship between the visual field window (FH).Described inclination angle still is defined as from described vertical clockwise for just.Except that formula 13, above-mentioned formula is applied to the inclination angle of rolling and producing comparably.For the inclination angle that produces because of rolling, nib and window center apart from S (promptly | be 0 AC|), rather than determine by equation 13.

For the inclination angle that causes because of inclination, by selecting to have minimum (bearing) inclination angle and maximum (just) inclination angle of the requirement of identical image sensor, the size of described inclination angle scope is maximized.Because for the inclination angle that inclination causes, described surface is compared to onesize positive rake for negative incidence and wants far away, and described minimum value has the quantity littler than described maximal value.For the inclination angle that causes because of rolling, they have identical size.

As mentioned above, the minimal characteristic of label 4 is structures of coded data bit, and these structures have the minimum diameter of 8 points.This has provided the maximal characteristic frequency f at the every mm in 1600dpi place about 7.9.

As calculating, require lip-deep minimum visual field window diameter to be at least 598 points in the equilateral triangle tiling that does not have continuously 256 overlapping spot diameter labels between the row of labels, or be about 9.5mm at 1600dpi according to above-mentioned equation 4.

Most of people are so that approximately+30 ° inclination and 0 ° of rolling hold a pen.Surpass approximately+50 ° when tilting (from 40 ° of described level) on described surface, the Mo Zhu (inking ball) that goes out of ball-point pen tip loses with the effective of described surface and contacts.Therefore the reasonable target slant range be-10 ° to+50 °, and reasonably rolling scope is-30 ° to+30 °, and what should remember is, the higher restriction such as the equation 11 of the combination of inclination and rolling provided.

(the 1.5mm of highly compact ²) Matsushita ccd image sensor (Matsushita electronics corporation, and be described in Itakura, K T Nobusada, N Okusenya, the paper of R Nagayoshi and MOzaki " A 1mm 50k-Pixel IT CCD Image Sensor for Miniature CameraSystem " IEEE Transactions on Electronic Devices, Volt 47, and number 1, January2000) are suitable for use in compact devices such as the pen.It has the available resolution of about 215X 215 pixels.Suppose the equal picture and the object space dihedral visual field, not as the inclination angle, plane, and pen is 4mm to window apart from T, use equation 16 and the described geometric configuration of equation 24 optimizations to realize required above-mentioned inclination and rolling scope, it is 30mm that generation has sighting distance D, and the dihedral visual field is-16 ° of rolling scopes to slant range and-28 ° to+28 ° (56 °) of+48 ° (64 °) of 18.8 ° (α=9.4 °).Available slant range is actual to be-21 ° to+43 °, and it is by tilting optical axis-5 ° to be mapped near required scope with respect to physical axis.It should be noted that by the non-zero inclination angle of optimization, can expand the inclination angle scope slightly as the plane.

Therefore, a total inclination angle is limited in the oval circular cone, and its reflex angle in clinoplane is that 64 ° and its bad angle in the rolling plane are 56 °.

The image sensing variable is summarised in the table 5.

Table 5. image sensing variable

Variable	Meaning
Variable	Meaning	α	Object space visual field half-angle
α’	The visual field, image space half-angle	α	Object space visual field half-angle
α’	The visual field, image space half-angle	γ	Deflection
θ	Object plane inclination angle (that is, total an inclination angle)	γ	Deflection
θ		θ’	Picture inclination angle, plane
φ	Pen tilts	θ’	Picture inclination angle, plane
φ	Pen tilts	ψ	Pen rolls
ω	The angular frequency in the visual field	ψ	Pen rolls
ω	The angular frequency in the visual field	D	Normal sighting distance
d	The sighting distance that tilts	D	Normal sighting distance
d	The sighting distance that tilts	f	The surface characteristics frequency
n	Sampling rate	f	The surface characteristics frequency
n	Sampling rate	q	Image sensor resolutions
S	Distance from point to center, the lip-deep visual field (when θ=0)	q	Image sensor resolutions
S		T	Distance from point to edge, the lip-deep visual field (when θ=0)

8.3 label decoding

8.3.1 label image is handled and decoding

Label image is handled and is described in the 1.2.4 joint.Culminate aspect the knowledge of the label data of its two-dimentional perspective transform on label and decoding.

8.3.2 infer a conversion

As mentioned above, in case the two-dimentional perspective transform of the perspective distortion of the label in the explanation image of catching is obtained, the discrete 3D label conversion of correspondence that is relevant to the optical axis of pen can be inferred, as described in following 8.4 joints.

In case discrete 3D label conversion is known, and can infer 3D corresponding conversion, that is, the physical axis of pen is relevant to the conversion on described surface.The physical axis of pen is the axle that is embedded in the shape of pen, and by the user experience of pen.It is by described point.Relation between physical axis and the optical axis is shown in Figure 64.

Defining three coordinate spaces is easily.In the sensor space, the described optical axis that overlaps with Z axle and described viewpoint is positioned at initial point.In a space, the physical axis that overlaps with Z axle and described point is positioned at initial point.In Label space, label 4 is positioned at the x-y plane, and its center is at described initial point.The label conversion transforms to the sensor space to label 4 from Label space.

The sensor space is shown in Figure 64.Mark at Figure 64 mid point is consistent with the mark of Figure 62.Viewpoint is at E, and sensing points is at G, and point is at A.Intersection point G between optical axis and the surface is called sensing points.The geometric configuration that is regarded as a little with nib shown in Figure 62 differs widely, and point described here is regarded as bead.If point is crooked, the inclination angle of physical axis can influence the skew between the contact point between sensing points and nib and the surface so.Described physical axis is called as pivotal point around the central point K of the described spherical point of its pivot.

When optical axis when being vertical, described point carries out contacting of nominal at the A point with the surface.KA is defined as parallel with optical axis.But when pen was tilted, contact was at a L, as shown in Figure 65.The radius of supposing point is R, and the distance on pivotal point K and described surface for example at A or L, is always R so.

The discrete tags conversion comprises the translation of described tag hub from the translation (translation) of described sensing points, the rotation of 3D label and described sensing points from described viewpoint.

In the discrete tags conversion, suppose that described sensing points is d from the translation of viewpoint, and according to equation 14, described sensing points is provided by equation 27.

Because physical axis only differs y translation and X rotation (promptly tilting) with optical axis, so physical axis is positioned at the y-z plane.Please refer to Figure 64, wherein | AC|=S and | EC|=D (identical) with Figure 62.Clearly, in the sensor space, the position of described pivotal point is provided by equation 28.

Therefore, the vector from the sensing points to the pivotal point is provided by equation 29.

Vector from the pivotal point to the contact point is defined as the surface normal (surface normal) of length R.It carries out standardization to the result, and is established with the R convergent-divergent, as shown in equation 30 and equation 31 by the Label space surface normal being applied 3D label rotation M.

Described vector from the sensing points to the contact point draws according to equation 32 subsequently.

According to equation 33, this vector is transformed in the Label space by applying reverse label conversion 3D rotation, and be added to the described vector from the tag hub to the sensing points subsequently, to produce (being on the surface) vector from the tag hub to the contact point in the Label space.

It is added to the absolute position as the label that is hinted by its label ID at last, with label the zone in the generation described point required absolute position: see equation 34.

Last step is to infer the 3D orientation of pen from the 3D orientation of label.The discrete rotation of pen is discrete rotation contrary of label simply, and the inclination of pen comprises that also optical axis is relevant to the inclination (φ of pen axle _Sensor) effect, as defined in equation 35, equation 36 and the equation 37.

8.4 inference tag conversion

The image of the label 4 of being caught by imageing sensor comprises by imageing sensor and is relevant to the position of label and the perspective distortion that orientation is produced.In case the perspective target of label is found in the image space, based on finding the solution the equation that four Label space and image space point is tied to fine understanding to linking, the perspective transform of eight degrees of freedom is inferred.The discrete transform step that produces the picture of label couples together in the symbol mode, and by making item corresponding in connecting conversion and perspective transform equate to obtain the nonlinear equation of one group of simultaneous.These equations are found the solution produce described discrete transform step, wherein comprise required label skew, the rotation of 3D label and from the viewpoint skew on described surface from described point.

8.4.1 to label conversion modeling

The conversion of label 4 from the Label space to the image space can be modeled as the connection of following shift step:

X-y translation (by the skew of label) to viewpoint

Z rotates (by label deflection)

X rotation (tilting) by label

Y rotation (rolling) by label

Z translation (by the skew of label) to viewpoint

Perspective projection (adopting specific focal length)

X-y convergent-divergent (to the viewport size)

These are connected single transformation matrix with the label conversion that exerts an influence in the symbol mode.The discrete transform variable and each range of variables that are used for following part have been summed up in the table 7.

Table 7. discrete transform variable and their scope

Variable	Abbreviation	Meaning	Unit transformation	Scope
Variable	Abbreviation	Meaning	Unit transformation	Scope	γ	-	Deflection	0	0≤γ≤2π
Φ	-	Tilt	0	-π/2＜φ＜π/2	γ	-	Deflection	0	0≤γ≤2π
Φ	-	Tilt	0	-π/2＜φ＜π/2	Ψ	-	Roll	0	-π/4＜ψ＜π/4
t _x	A	Label is to the x skew of viewpoint	0	-	Ψ	-	Roll	0	-π/4＜ψ＜π/4
t _x	A	Label is to the x skew of viewpoint	0	-	t _y	B	Label is to the y skew of viewpoint	0	-
COSγ	C	The cosine of deflection	1	-1≤C≤1	t _y	B	Label is to the y skew of viewpoint	0	-
COSγ	C	The cosine of deflection	1	-1≤C≤1	sinγ	D	The sine of deflection	0	-1≤D≤1
COSΦ	E	The cosine that tilts	1	0＜E≤1	sinγ	D	The sine of deflection	0	-1≤D≤1
COSΦ	E	The cosine that tilts	1	0＜E≤1	sinΦ	F	The sine that tilts	0	-1＜F＜1

COSΨ	G	The cosine that rolls	1	0＜G≤1
COSΨ	G	The cosine that rolls	1	0＜G≤1	sinΨ	H	The sine that rolls	0	-1＜H＜1
t _z	I	Label is to the z skew of viewpoint	-	I＜0	sinΨ	H	The sine that rolls	0	-1＜H＜1
t _z	I	Label is to the z skew of viewpoint	-	I＜0	1/λ	J	The inverse of focal length	-	J＞0
S	-	The vision area ratio	-	S＞0	1/λ	J	The inverse of focal length	-	J＞0

In the x-y plane according to equation 42 translation t _xAnd t _y(A=t wherein _xAnd B=t _y).

(wherein C=cos (γ) and D=sin (γ)) rotates γ around z according to equation 43, provides equation 44.

(wherein E=cos (Φ) and F=sin (Φ)) rotates Φ around x according to equation 45, provides equation 46.

(wherein G=cos (Ψ) and H=sin (Ψ)) rotates Ψ around y according to equation 47, provides equation 48, and wherein K and L are determined by equation 49 and equation 50.

According to equation 51 (I=t wherein _z) along z translation t _z, provide equation 52.

With focal length λ with in the projection plane perspective projection at z=0 place, provide equation 54 according to equation 53 (wherein J=1/ λ).

Zoom to viewport (viewport) according to equation 55 with S, provide equation 56.

According to the point of equation 57 conversion in x-y plane (z=0), provide equation 58.

At last, expansion K and L provide equation 59.

8.4.22D perspective transform

Suppose in the 2D perspective transformation matrix of 8 degree of freedom being inferred such as the equation 60 definedly, the i that multiply by a unknown is to obtain the matrix of 9 common degree of freedom forms, as shown in equation 61.

According to equation 62 conversion 2D points, provide equation 63.

8.4.3 inference tag conversion

8.4.3.1 trim coefficient

Use the coefficient in the coefficient trim equation 59 in the equation 63 to produce equation 64 to equation 72, they are 9 nonlinear equations that have in 11 the unknowns.

These equatioies are as being expanded by the requirement of the trigonometric identity (trigonometric identity) relevant with the sine at angle and cosine (be in deflection, inclination and the rolling any one sine and cosine), as shown in equation 73.

Behind the sine and cosine at given angle, use the arc tangent of two variablees as shown in equation 74 can obtain corresponding angle.

8.4.3.2 find the solution the X-Y skew

Use equation 64 and equation 65 and to provide equation 75 and equation subsequently 76 equation 66 simplification.

Use equation 67 and equation 68 and to provide equation 77 and equation subsequently 78 equation 69 simplification.

Use equation 70 and equation 71 can simplify equation 72 to provide equation 79 and equation subsequently 80.

Equation 76 can be rewritten as equation 81, and equation 78 can be rewritten as equation 82.

To equation 81 and equation 82 trims (equate) and find the solution B and produce equation 83 to equation 85, and the final equation 86 that limits B that produces.

The value substitution equation 82 of B and simplification are produced equation 87 to equation 90, and the final equation 91 that produces qualification A.

This has provided the x-y skew of label 4 apart from viewpoint, and reason is A=t _x, B=t _y

8.4.3.3 find the solution inclination

From equation 68, can obtain equation 92.

From equation 67, can obtain equation 93.

Can obtain equation 94 from equation 64, equation 92 and equation 93.

Can obtain equation 95 from equation 65, equation 92 and equation 93.

Can obtain equation 96 from equation 70, equation 92 and equation 93.

Can obtain equation 97 from equation 71, equation 92 and equation 93.

Can obtain equation 98 from equation 94.

Can obtain equation 99 from equation 95.

Can obtain equation 100 from equation 96.

Can obtain equation 101 from equation 97.

Can obtain equation 102 and equation subsequently 103 from equation 98 and equation 99.

Can obtain equation 104 and equation subsequently 105 from equation 100 and equation 101.

Can obtain equation 106 and equation subsequently 107 from equation 103 and equation 105.

If G and H are non-zeros, equation 107 has only effective basis.Because | ψ |＜pi/2, therefore the cosine (G) that rolls be always on the occasion of, and be non-zero therefore.Be non-zero if roll, the sine of Gun Donging (H) only is a non-zero so.The special processing that is used for zero inclination and rolls is described in the 6.7.3.10 joint.

According to equation 108, therefore this provide the size of the sine of described inclination because F=sin (φ), thereby and the cosine of described inclination (E) provide by equation 73.

Because | φ |＜pi/2, the cosine of inclination (E) just is always, and therefore, does not have uncertainty when making even root.But the symbol of sinusoidal (F) must be determined by other method, as described in the 6.7.3.9 joint.

According to equation 109, behind given E and the F, obtain described inclination subsequently.

8.4.3.4 find the solution rolling

Can obtain equation 110 from equation 103.

Can obtain equation 111 and equation subsequently 112 from equation 73.

According to equation 113, therefore this provided the size of the sine that rolls because H=sin (ψ), thereby and the cosine (G) that rolls can provide by equation 73.

Because | ψ |＜π/4, the cosine of rolling (G) be always on the occasion of, therefore when making even root, do not have uncertainty.But the symbol of sinusoidal (H) must be determined by other method, as described in the 6.7.3.9 joint.

Given G and H obtain described rolling subsequently according to equation 114.

8.4.3.5 find the solution deflection

From equation 73, equation 92 and equation 93, can obtain equation 115 and equation subsequently 116.

From equation 92 and equation 116, can obtain equation 117 and equation subsequently 118.

From equation 92 and equation 116, can obtain equation 119 and equation subsequently 120.

In equation 116 and equation 118 and equation 120, subduplicate symbol provides equation 121 by determining from the symbol of the i that determines of equation 80.

Because, I (t _z) for negative, J (1/ λ) is being for just, and IJ＜-1 (because of | t _z|＞λ), equation 122 keeps.

Given C and D can obtain deflection subsequently according to equation 123.

8.4.3.6 find the solution the viewport ratio

According to definition, the cosine of deflection (C) and sinusoidal (D) are 0 never simultaneously.Because the cosine (E) that tilts is not 0 all the time, can adopt equation 67 or equation 68 to determine viewport ratio (S) so all the time.

If D is a non-zero, can obtain equation 124 from equation 67 so.

Otherwise,, can obtain equatioies 125 from equation 68 so if C is non-0.

8.4.3.7 find the solution focal length

Similarly, because the cosine (G) that rolls is 0 never, so, just can use equation 70 or equation 71 to determine the inverse (J) of focal length as long as inclination or rolling are non-zero.But the symbol (F and H) of the sine of inclination and rolling may be unknown.The symbol of long-pending (FH) but of the sine of described inclination and rolling is provided by equation 103, as shown in equation 126.

Described symbol can at random be assigned to F, because the symbol of J is known as priori.If gi is non-, can obtain equation 127 from equation 70 so.

If hi is a non-zero, can obtain equation 128 from equation 71 so.

Under actual conditions, the selection between equation 127 and the equation 128 be based on gi and hi which have bigger amount.If gi and hi both are 0, all be 0 if promptly tilt and roll, the inverse of focal length is unknown so.

8.4.3.8 find the solution the z skew

In case the inverse of focal length (J) is known,, can obtain z skew (I) from equation 80 according to equation 129.

In addition, if the inverse of focal length (J) is unknown, if i.e. inclination and rolling both are 0, z skew (I) is unknown so.

8.4.3.9 determine inclination and the direction of rolling

The symbol of long-pending (FH) of the sine that tilts and roll is provided by equation 126.Because-π/4＜ψ π/4, the rolling adjustment of+π/4 can be introduced into guaranteeing that described rolling just is always, and can not make any other hypothesis invalid.In case described rolling adjustment is introduced into, equation 126 provides the symbol of the sine (F) of described inclination separately.

The adjustment of rolling is introduced into as follows.The inverse (J) of viewport ratio (S), focal length and z skew (I) are all calculated as described.The 3D transformation matrix produces from the 2D perspective transformation matrix.In reverse order the inverse of viewport ratio, focal length projection and z shift applied are arrived the 3D matrix.Then, by on this matrix, taking advantage of (pre-multiplying) π/4y rotation matrix to apply described rolling adjustment in advance.Rolling, inclination and deflection are calculated as described.Because roll to just, the direction of inclination is present to be known.At last, roll to adjust and deducted from described rolling in described π/4, to provide actual rolling.

When rolling and inclination both when being 0, focal length and z skew both are unknown as mentioned above.Rolling but there is no need in this case to adjust, is known because tilt and roll.

8.4.3.10 handling zero tilts and zero the rolling

When tilting or roll when being 0, it is invalid to become based on the general solution of equation 107.Table among Figure 85 has shown 12 degenerated form of equation 64 to equation 71, its be described deflection differently at 0 (or π), pi/2 (or 3 pi/2s) and be non-zero, and tilt and rolling differently be 0 and non-zero) time the result.Figure 86 and 87 table have provided that to be used to detect and handle its medium dip and/or rolling be 0 the needed logic of situation, and each situation is excited by 0 in the table that appears at Figure 85.Various situations in the table of Figure 85 indicate the situation number of the table of Figure 86 and Figure 87.

Sum up

The present invention is described with reference to a preferred embodiment and many optional specific embodiments.But the people who is familiar with association area will be understood that, and also will be dropped in the spirit and scope of the present invention by specifically described those different many other embodiment herein.Therefore, it will be appreciated that the present invention is not intended to be limited to the specific embodiment described in this instructions (comprising as the document that suitably passes through the combination of cross reference institute).Scope of the present invention only is subjected to the restriction of appended claim.

Claims

1. one kind is used for respect to the surface and location or produce the sensor device of orientation data when mobile, this orientation data is indicated the orientation of this sensor device with respect to this surface, this surface has setting a plurality of code tags thereon, each code tag comprises the annular object construction and the coded data district of axis of orientation, perspective object construction, invariable rotary, to indicate this orientation by this sensor device sensing the time, this sensor device comprises by relevant configuration for this axis of orientation and this perspective object construction:

Housing;

The orientation sensing apparatus, be configured to produce this orientation data by the axis of orientation one of at least and the perspective object construction of this code tag of sensing, this orientation data is represented at least one with respect to this surperficial deflection and in tilting of this housing, and this orientation sensing apparatus annular object construction of being arranged to this invariable rotary by this at least one code tag of sensing axis of orientation of coming this at least one code tag of sensing with have an X-rayed object construction; And

Communicator is configured to this orientation data is sent to computer system so that know the orientation of this sensing apparatus with respect to this surface.

2. sensor device as claimed in claim 1, wherein this orientation data is indicated the rolling of this shell with respect to this surface.

3. sensor device as claimed in claim 1 further comprises the motion sensing apparatus that is used for producing mobile data when this sensor device is mobile with respect to this surface, and this communication device configuration is for to send this mobile data to this computer system.

4. sensor device as claimed in claim 3, further comprise the area identification sensing apparatus, it is configured to use when this sensor device is located with respect to the zone on this surface or be mobile at least some the predetermined information of position of the code tag of institute's sensing to come sensing to indicate the area identification data of the sign in this zone, and this communicator is configured to these area identification data are sent to this computer system.

5. sensor device as claimed in claim 4, wherein this motion sensing apparatus be configured to use this code tag at least some produce this mobile data.

6. sensor device as claimed in claim 5, wherein this code tag is also indicated a plurality of label positions in this zone, and this motion sensing apparatus is configured to produce this mobile data according to this sensor device with respect to moving of at least one described label position.

7. sensor device as claimed in claim 6, wherein this motion sensing apparatus is configured to take a sample with respect to the position of this at least one label position for this sensor device, thereby produces this mobile data.

8. sensor device as claimed in claim 7 further comprises controller, and it is configured to estimate from this at least one label position the distance between two tips of this sensor device.

9. sensor device as claimed in claim 8, wherein this communication device configuration is that this range data is indicated this distance to these computer system transmission range data.

10. sensor device as claimed in claim 8, wherein this motion sensing apparatus is configured to use the distance by this controller estimation to find the solution than the position of sensor device more accurately of being indicated alone by this at least one label position.

11. sensor device as claimed in claim 3, wherein this motion sensing apparatus comprises at least one acceleration sensing device, this acceleration sensing device is configured to by the code tag of following the tracks of institute sensing come sensing its acceleration with respect to this surf zone when mobile at this sensor device, and this motion sensing apparatus is configured to produce this mobile data by regularly acceleration being taken a sample.

12. sensor device as claimed in claim 11, wherein this acceleration sensing device is configured to the component of acceleration of at least two basic quadratures of sensing.

13. sensor device as claimed in claim 4 further comprises timer device, it is configured to, and generation time stabs when this sensor device moves with respect to this surf zone.

14. sensor device as claimed in claim 13, wherein this communication device configuration is to these computer system transmitting time data, and this time data is represented the timestamp as the mobile data of this timer device generation.

15. sensor device as claimed in claim 1, wherein this communicator is a radio communication device.

16. sensor device as claimed in claim 1 further comprises the power sensing apparatus, it is configured to sensing and is applied to this surperficial power by this sensor device.

17. sensor device as claimed in claim 16, wherein this communication device configuration is that this force data is indicated this power to these computer system conveying capacity data.

18. sensor device as claimed in claim 16, further comprise the stroke pick-up unit, it is configured to detect this sensor device by this power and when is applied to this surface and leaves from this surface, thereby determines the duration of the stroke that this sensor device applies to the surface.

19., further comprise being used for the mark tip that mark should the surface as claim 4,5 or 11 described sensor devices.

20. sensor device as claimed in claim 19, wherein this sensor device is the form of contact pilotage or pen.

21. sensor device as claimed in claim 1, wherein this code tag is sightless substantially for naked eyes.

22. sensor device as claimed in claim 21, wherein this code tag is to use infrared China ink to print, and this sensor device has response to infrared spectrum.

23. sensor device as claimed in claim 6, wherein each code tag indicate this label region sign and should the zone in label position, this zone is associated with this surface, this label position is indicated the position of this label in this zone.

24. sensor device as claimed in claim 1, wherein this orientation sensing apparatus is configured to infer this orientation from least some perspective distortion of this code tag.