WO2004084134A1 - Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion - Google Patents

Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion Download PDF

Info

Publication number
WO2004084134A1
WO2004084134A1 PCT/US2003/007857 US0307857W WO2004084134A1 WO 2004084134 A1 WO2004084134 A1 WO 2004084134A1 US 0307857 W US0307857 W US 0307857W WO 2004084134 A1 WO2004084134 A1 WO 2004084134A1
Authority
WO
WIPO (PCT)
Prior art keywords
binary
predicting
resulting set
prediction
binary process
Prior art date
Application number
PCT/US2003/007857
Other languages
French (fr)
Inventor
Alexander Raykhman
Ilya Vinarskiy
Original Assignee
Inesa, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inesa, Inc. filed Critical Inesa, Inc.
Priority to PCT/US2003/007857 priority Critical patent/WO2004084134A1/en
Priority to EP03716569A priority patent/EP1609118A1/en
Priority to AU2003220271A priority patent/AU2003220271A1/en
Publication of WO2004084134A1 publication Critical patent/WO2004084134A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/12Computing arrangements based on biological models using genetic models
    • G06N3/126Evolutionary algorithms, e.g. genetic algorithms or genetic programming

Definitions

  • the present invention relates to methods and systems of prediction.
  • the main object of the present invention is an extension of cognitive predicting methods on non-stationary processes.
  • Every process can be viewed as a product of some entity's functioning. From that position, we may look at the process as the entity's output. We also may use the term object of prediction meaning the entity whose output shall be predicted. The binary process is frequently used for a representation of any other process that permits such mapping. All further descriptions will be done in view of the binary process prediction.
  • the entity's properties are described in the form of various types of mathematical models such as sets of algebraic, differential, integral, stochastic equations, and their combinations.
  • the predicting systems that employ the entity's model spans the wide range between the first attempts for extrapolation by Newton, Lagrange, etc. [G.A.Korn, 1961], and modern adaptive predictors [US Patent 5,424,942, 07/1995, 364#164, Dong,].
  • the degree of complexity of prediction rises continuously.
  • a Genetic Algorithm Representative Schema is a set of predicting solutions that are functions of the process ' argument . Every generation of such schema is a product of a multi-step optimization procedure that includes the Natural Selection Algorithm for an appropriate selection of the predicting solutions; Evolutionary Operators such as crossover, mutation, permutation, proportional reproduction, inversion, etc., for the new solutions generation; and a Fitness Function to be a measure of performance for each of those solutions;
  • the representative schema optimization procedure acts on the specified interval of the binary process history to train the predicting system in recognizing the specifics of the process that is subjected to prediction; and • The predicting system produces a prediction of the forthcoming process element via calculating an output of the optimal predicting function at the next value of its argument.
  • J. Koza A powerful extended genetic algorithm developed by J. Koza [US Patent 5,136,686, 08/1992] is good material for a discussion of strengths and weaknesses of the genetic algorithm approach in the context of non-stationary process prediction.
  • the J. Koza's genetic algorithm is nonlinear. It not only includes the natural selection method and evolutionary operators, but also breaks down a problem into a hierarchy of subordinating sub-problems . This algorithm is free of the uniformity constraint that requires keeping the same size for all members of the population of predicting solutions.
  • the J. Koza's genetic algorithm was not specifically designed for prediction. In the most general form given in the patent disclosure, this algorithm has the following description: "The process of the present invention operates upon a population of entities, which accomplish tasks and can vary in size and shape.
  • Each iteration of the process comprises activating, selecting, choosing, performing, and adding.
  • each entity activates to accomplish its goal and produces a result.
  • a value is associated with the result of each activation and assigned to the corresponding entity.
  • at least one entity having a relatively high associated value is selected.
  • an operation is chosen from crossover, fitness proportionate reproduction, mutation, or permutation. If crossover is chosen, then the selected entity performs the crossover operation.
  • Crossover creates new entities by combining portions of at least one selected entity with portions of at least one another entity.
  • Fitness proportionate reproduction retains the selected entity in the population. Mutation randomly alters a small random part of an entity. Permutation reorders the parts of an entity without a net gain or loss.
  • This procedure is used at the stage of genetic algorithm representative schema optimization. When the actual predicting procedure is active, it means that the forthcoming element of the binary process is really unknown.
  • the discrete argument % of the binary process x( ⁇ ) is not necessarily a time variable.
  • Each predicting function is made up of binary tokens, and may be considered as a chromosome;
  • the predicting system initiates training until it finds the optimal predicting function pf 0 (X/ t q , t r ) , ⁇ e[t q ,t r ]; and,
  • the fitness operator ⁇ of equation (1.2) may have a different view. However, each fitness function shares a common feature. Each fitness function in the predicting system provides an integral evaluation of the system's predicting ability. This evaluation is calculated on the interval [t q ,t r ] where (t r -t q )»l.
  • the form of the fitness operator presented in expression (1.2) reflects the fact that the efficiency of prediction is higher as more correct predictions are produced with respect to the amount of incorrect predictions if both are observed on the same interval [t g ,t r ].
  • the PFS - operator of equation (1.2) is responsible for changes in the population of pf - functions .
  • This operator involves evolutionary operations to modify pf - functions from the previous iteration. It also produces a selection of those pf - functions which satisfy to the "good fit" selection condition.
  • the "good fit" pf - functions are the source of new members in the PFj + i.
  • the fitness function ⁇ ( ⁇ ) serves in this predicting algorithm as a measure of how successfully any pf - function returns predictions exclusively on the interval [t q ,t r ].
  • the method described above possesses a distinctive peculiarity of genetic algorithms if viewed from the position of prediction. That is a utilization of the iterative optimization procedure for achieving the optimal predicting function.
  • the optimization procedure is defined on certain interval of the binary process's "past" such that the search for the optimal predicting solution and the actual prediction are separated from each other.
  • Adaptation is considered the ability of a system to modify its parameters and structure in response to changes to the system's environment.
  • the role of the environment belongs to the object of prediction.
  • the second property is an assumption about the existence of a representative set of solutions.
  • a desired solution or solutions may be obtained by applying the Natural Selection Algorithm to the representative set of solutions .
  • the third property is the idea that the existence of atomic elements (genes) combined to construct members (chromosomes) of the representative set of solutions (population of chromosomes) .
  • the present invention solves the problem of sequential prediction of a binary element's state in a binary process.
  • One object of the present invention is to provide a mathematical method and a computer algorithm to perform predictions of binary processes including non- stationary processes.
  • a further object of the present invention is to provide the structure of the cognitive system for a sequential prediction of a binary element's state in a binary process that increases efficacy of functioning of any entity that includes this system as a subsystem.
  • the present invention relates to methods and systems of prediction.
  • the present invention provides the method for a sequential prediction of a binary element's state in a binary process and the system for the method embodiment.
  • the binary processes are frequently used as a representation of a wide range of other processes that can be observed at outputs of various types of objects of prediction.
  • the present invention is based on a representation of the chaotic nature as a "neighboring" order regularity whose separate parts preserve some order.
  • the binary process was decomposed and specific atomic binary structures of minimal length were distinguished. A propagation of those structures in both directions of the binary process domain returns a stable, regular image. Such formations were denoted as the Elementary Behavioral Functions.
  • dom[b k ( ⁇ , t , ⁇ k) ) ] [t k - ⁇ , t k ]
  • ⁇ k is a period of the k-th elementary behavioral function
  • dom[bk( ⁇ , t k , ⁇ k) ] is a domain of the function bk( ⁇ ,t k , ⁇ k ) [R- Elmasri and S. Navathe, 1994]. If taken with satisfaction to a condition of orthogonality, these functions become behavioral genes of the binary process, and constitute a genotype BG of the binary process ' behaviors .
  • the present invention states that the genotype BG* is quasi-stationary relative to a character of change of two adherent elementary behavioral functions in expression (2.1) . Every binary process has its inherent behavioral genotype. In the case of a multi-dimensional system, each component x( ⁇ ) of a vectorial binary process x ( ⁇ ) has its inherent behavioral genotype.
  • the process of prediction is recursive. It includes the following basic steps:
  • the procedure is non-iterative and cyclic. Each cycle may contain several predictions .
  • the PFk - set exists in various alternate versions.
  • composition of this set is controlled by a function ⁇ ( ⁇ ) .
  • This function is responsive to the current level of the binary process instability. It is fulfilled in the present invention that a cardinality of a set of predicting functions is inversely related to the evaluated instability level of the binary process, so that, for explicitly non- stationary processes the following statement is competent:
  • the second stage is for prediction directly.
  • the output of the prediction f ( ⁇ ) depends on prediction error's status of each PF k -set's member, current efficiency of prediction, and a set of binary indicators modifying a predicting algorithm.
  • the retrospective prediction and the actual prediction both employ the Natural Selection Algorithm in a manner that each member of PF k participates in the current prediction cycle until this member produces an incorrect prediction.
  • Each predicting function may again participate in prediction only in the next predicting cycle; and, 4. Updating the behavioral genotype membership and re- estimating the binary process instability level.
  • the prediction method presented above is used in a predicting system that is the method's embodiment.
  • the system is comprised of two subsystems - subsystem SSi, and subsystem SS 2 .
  • the main objective of subsystem SSi is to determine a composition of the behavioral genotype set.
  • Subsystem SSi provides these determinations on a periodical basis.
  • Subsystem SSi is comprised of the following: a Binary Process Mapping Block (BM) , a Binary Process History Storage Block (H) , a Behavioral Genotype Creator (BG) , a Sampling Block (S) , and a Binary Process Shortest History Storage Block (HS) .
  • the BM block quantifies, if necessary, the signal u(t) from an output of the object of prediction.
  • the quantification may be performed by time and/or by level of the input signal.
  • Every component of x( ⁇ ) is processed by a separate identical tract in SSi, and then the processed data from that tract come to a corresponding tract in SS 2 .
  • a single component x( ⁇ )ex( ⁇ ) A block diagram of the one-dimensional predicting system is shown in Fig.6. The following conventions are present in the above illustration: SSi - Subsystem #1 SS - Subsystem #2
  • V l , 2 , ... , n
  • the H-block memorizes each sequential element of the process x( ⁇ ) that comes from the BM-block, and forms a binary string [x( ⁇ ) , t q , t p ] ⁇ h[x( ⁇ ) ] .
  • the string h[x( ⁇ )] goes to an input of the BG-block and to an input of the HS-block.
  • the latter creates a binary string hs [x( ⁇ ) , t ⁇ , t p ] ⁇ hs [x( ⁇ ) ] , s ⁇ q.
  • the BG-block makes a decomposition (2.1) of the string h[x( ⁇ )] on the interval [t ⁇ r - ⁇ j) / t r ] , t r ⁇ t p .
  • the ordering number j of the sample's length ⁇ is linked to the value t r when the decomposition has been initiated.
  • the Sampling Block in the SSi-subsystern's local feedback controls the value of the ⁇ -j according to a criterion of statistical stability (e.g., the stability of the arithmetic average or both the arithmetic average and the standard deviation) of the biggest elementary behavioral function's period, taken from the sample.
  • the ⁇ j ax variable defines a cardinal number of the BG—set.
  • the BG - block generates members of the BG*j-set.
  • the j-index in the behavioral genotype notation points to the fact that this set is going to be updated according to some schedule.
  • the BG*-set's composition data is a main output of subsystem SSi- Information about the BG*-set membership comes to an input of each Selector of Predicting Functions of subsystem SS 2 .
  • the binary string hs [x( ⁇ ) , t ⁇ , t p ] goes from an output of the HS-block to another input of the PFS-block of SS 2 .
  • the BG-block receives a feedback signal from SS . This signal controls the schedule for updating the BG*-set.
  • subsystem SS 2 The main objective of subsystem SS 2 is selecting the set of predicting functions from the BG*-set and then, performing a prediction.
  • Subsystem SS 2 has some distinctive singularities :
  • the subsystem involves a cyclic, non-iterative, and non-optimizing method of prediction
  • the subsystem employs evaluation of the binary process instability. This evaluation is performed for selection of an appropriate set of predicting functions at the initial moment of a predicting cycle; and,
  • Subsystem SS 2 is comprised of two contours .
  • the first contour is the main contour of SS 2 .
  • the PF k -set is an output of the PFS-block.
  • the actual prediction f ( ⁇ ) is the first output of the P-block of the same contour.
  • the second contour evaluates the binary process instability level.
  • the second contour is comprised of several parallel channels. These channels have an identical structure such as PFSi -4 Pj -> Ej. Each channel generates a respective component of the estimating vector-function ⁇ ( ⁇ , t e , ⁇ e ) .
  • the evaluation is performed by the application of the retrospective predicting procedure to some interval [t q ,t r ], t r ⁇ t p of the binary process history.
  • t e is an evaluation schedule point
  • ⁇ e (tq-t r ) denotes the length of the evaluation window.
  • the second output of the P-block of the main contour is an indicator er( ⁇ ) of the error of prediction.
  • This indicator signals to the exterior of SS 2 about the end of the current cycle of actual prediction.
  • the BG-block of SSi takes into account the state of such "End-of-Cycle" indicator and uses this information for scheduling of the next update of the BG*-set.
  • the er( ⁇ ) signal is also used by SS to perform the next instability evaluation of the binary process.
  • a link between the P-block of SS 2 and the BG-block of SSi closes the global feedback in the predicting system.
  • a human operator of the predicting system may update the schedules, as well as the setup parameters for the binary process decomposition and subsequent statistical analysis of the elementary behavioral f nctions .
  • Predictions performed during a predicting cycle are independent of the evaluation procedure.
  • Each of the three main procedures in the system the determination of the behavioral genotype, the evaluation of the binary process instability, or process' transients effect on predictability, and the selection of the set of predicting functions, which are active in the current predicting cycle) can be performed independently and do not affect the system' s speed.
  • the prediction method described above increases the efficiency of the binary process prediction.
  • This method extends the applicability of cognitive predicting systems in the field of non-stationary processes.
  • the principal advantage of the method is a more intensive use of the most recent development in the binary process domain.
  • the present invention does not demand to be in the zone [t p ,t p+w ], (w»l) of the guaranteed binary process stability.
  • the iterative optimizing "Errors and Trials" genetic algorithm is not included in the predicting procedure of the present invention. This fact makes it possible for the application of the present invention to a population of real-time systems .
  • the present invention can be incorporated in any system that permits mapping of at least one of the system's outputs on the space of binary processes.
  • Fig.l depicts a block diagram of a modern predicting system based on the genetic algorithm approach
  • Fig.2 is a generalized algorithm of a method for a sequential prediction of a binary element's state in a binary process
  • Fig.4 presents examples of Embodiment 1 and Embodiment 2 of a predicting algorithm of the present invention
  • Fig.5 is an illustration of a binary process mapping on the space of binary processes
  • Fig.6 depicts the block diagram of a predicting system for a sequential prediction of a binary element's state in a binary process
  • Fig.7 depicts an original measuring system block diagram
  • Fig.8 depicts a block diagram of a measuring system with a signal-to-noise ratio prediction
  • Fig.9 illustrates a measurement with a signal-to-noise ratio prediction
  • Fig.10 illustrates the compensation of a measuring system's filter saturation by means of prediction
  • Fig.11 depicts a fragment of the output of a three-point moving average function of a time series SPREAD
  • Fig.12 illustrates a mapping of the econometric time series SPREAD on the space of binary processes
  • Fig.13 illustrates a prediction of the econometric time series SPREAD elements .
  • the present invention describes a method for a sequential prediction of a binary element's state in a binary process and a system for this method embodiment.
  • numerous specific details are set forth in order to prove a thorough understanding of the present invention. Mathematical notation is frequently used to keep the description as accurate as possible. It will be obvious, however, to one skilled in the art that the present invention may be practiced without using these specific details. In other instances, well-known methods, structures, and representations have not been described in detail so as not to unnecessarily obscure the present invention.
  • the generalized algorithm of the new method of prediction of a binary process element's state is shown in Fig.2. The following conventions are present in the above illustration:
  • Block 1 Begin
  • Block 4 Evaluation of the binary process instability Level or process ' transients effect on predictability
  • Block 6 Updating the behavioral genotype membership and re-estimating of the binary process instability level
  • Block 7 Block 8: Output
  • the method of prediction is recursive. It includes the following basic steps that must be fulfilled for every single binary process or for each component of a vectorial binary process :
  • the corner stone of the present invention is the concept of a binary process behavioral genotype .
  • a definition of the behavioral genotype is based on a representation of the chaotic nature in the form of a "neighboring order" regularity whose separate parts preserve some order. This assumption allows a decomposition of the binary process into specific atomic binary structures of a minimal length. A propagation of those structures in both directions of the binary process' discrete argument domain returns a stable, regular order.
  • ⁇ k is the elementary behavioral function's period; dom[b ( ⁇ , t k , ⁇ k ) ] is a domain of the function b k ( ⁇ ,t k , ⁇ k ) [R. Elmasri and S. Navathe, 1994]. If taken with satisfaction to an orthogonality condition, these functions become behavioral genes of the binary process and constitute a genotype BG of the binary process ' behaviors :
  • a behavioral gene of the BG - set is a binary periodical function of a discrete argument ⁇ .
  • ⁇ i is a period of the i-th gene, and 5 is its current phase;
  • ⁇ max (t r , ⁇ ) is the biggest statistically stable period among the periods of the elementary behavioral functions.
  • the ⁇ max (t r , ⁇ ) serves as a parameter of the set BG.
  • the ⁇ max (t r , ⁇ ) is determined as a result of statistical analysis performed on the binary process decomposition (3.1) . This decomposition is defined on a representative interval [t q ,t r ], ( ⁇ »l) . Every binary process has its inherent behavioral genotype. In the case of a multi-dimensional system, each component of a vectorial binary process has its inherent behavioral genotype.
  • P ⁇ x(ti) ,x(t ⁇ + ⁇ ) ⁇ is a probability of the existence of two particular sequential elements x(ti) , x(t ⁇ + ⁇ ) in the binary process x( ⁇ ) .
  • a normal form for a behavioral gene is when the positive part is observed first.
  • the gene's current phase 05 is the amount of elements counted on the interval between its first positive element and the element that corresponds to the value of the gene's argument designated as a point of observation (t*) .
  • He(z) is the Heaviside's Step Function
  • Int(z) is the Integer Function of the real argument zeR
  • Each member of the C-set has the same range as the members of the BG-set.
  • the BG-set identification can be either a stage of the predicting system design, or can be included in an algorithm of the automated predicting system.
  • model (1.2) in the present invention is used for the binary process instability evaluation. That procedure is incorporated in the evaluating function ⁇ ( ⁇ , t q , t r ,PF) ⁇ ( ⁇ ) .
  • This function directly provides the quantitative information about the efficiency of prediction performed on the interval [t q ,t r ], t r ⁇ t p .
  • the evaluating function's output depends on the composition of the PF-set that is directly involved in prediction. Therefore, the function ⁇ ( ⁇ ) measures how unstable the binary process was if observed before the cycle of actual predictions .
  • ⁇ ⁇ ( ⁇ ) ⁇ ( ⁇ ,t e , ⁇ e ) , ⁇ 2 ( ⁇ , t e , ⁇ e ) ,..., ⁇ n ( ⁇ ,te, ⁇ e ) ⁇ (3.6)
  • t e is an evaluation schedule point
  • parameters t e , and ⁇ e may have different values for each component of the vector-function ⁇ ( ⁇ ) .
  • a determination of the ⁇ -vector's composition is a system design task. The formulas presented below, are the embodiments the authors of the present invention have used for the implementation of the method:
  • each component of the ⁇ -vector is obtained by applying a non-iterative retrospective predicting procedure F(PF, ⁇ ).
  • F(PF, ⁇ ) the retrospective predicting procedure's algorithm does not substantially differ from the algorithm for the actual predicting procedure.
  • the difference between these algorithms includes two points. The first point is the value of the argument ⁇ of the process x( ⁇ ) at the beginning moment of the prediction.
  • the second point is the retrospective predicting procedure (serving the binary process stability evaluation) employs an assignment of the PF-set's composition at the beginning of each predicting cycle.
  • the actual predicting procedure employs a selection of the PF- set's composition at the beginning of each predicting cycle.
  • One component of the ⁇ (x) may also be estimating function (3.7) where the PF- set is a singleton ⁇ pf op t (x. t q , t r ) ⁇ .
  • the PF-set might be a product of prior art system (1.2) .
  • the predicting method of the present invention can be implemented without the involvement of the binary process instability evaluation. In that case, a designer must be aware of the expected degree of binary.process instability or non-stationarity. Therefore, the initial composition of the PF-set in the cycle of the actual predicting procedures must be predetermined.
  • ti is the beginning point of performing the prediction
  • t p is the latest observed value of the binary process discrete argument.
  • the PF k -set exists in multiple alternate versions, so that PF k cPFS(BG*j) .
  • the composition of the PF k -set is controlled by a function ⁇ ( ⁇ k ) . This function is responsible for analysis of the current stability evaluation data. The selection law is as follows
  • the MAX - function here is the relational algebra aggregate function returning a maximum value from a sequence of values [R. Elmasri and S. Navathe, 1994].
  • the proposed selection law allows a predetermination of the set PF by requiring ⁇ k ,i> ⁇ °.
  • the following rule controls the PF-set selection if the process x(t) is explicitly non-stationary:
  • Vpfi( ⁇ ,G5i, ⁇ i)ePF (3.12)
  • Vl (l,2,...,I k )
  • Property expression (3.11) points at the fact that each predicting function used for a non-stationary process prediction belongs to this process' behavioral genotype.
  • the specific part of the PF-set selection condition depends on the peculiarities of the object of prediction. A determination of this specific part is a system design task. The authors of the present invention have found effective the following embodiments of the specific part of the PF-set selection condition for non-stationary binary processes:
  • the PF-set includes each element gi of the BG*-set that can be selected on the binary process historical interval ⁇ and:
  • a predicting function is called, respectively, the Pair Predicting Function, or the- Triple Predicting Function.
  • Embodiment 2 is a diagrammatic representation of Embodiment 1 :
  • the PF-set includes each element gi of the BG*-set that can be selected on the binary process historical interval ⁇ and:
  • each predicting function characterized by a corresponding identified sequence parameter ⁇ or ⁇ belong to the PF-set.
  • the second stage is for prediction directly.
  • the prediction f (ti + i) of the k h predicting cycle is returned by the operator F acting upon the set PF k of predicting functions such that:
  • Expression (3.13) includes a model x' (ti+i) of a state of the binary process' forthcoming element, and it also includes a binary indicator y(t ⁇ + ⁇ ) that permits the prediction.
  • the expression (3.14) reveals a structure of the model x' (ti + i) .
  • the model x' (t p+ ⁇ ) of the binary process' forthcoming element employs the Natural Selection Algorithm in the way that each member of PFk participates in the current prediction cycle until this member produces an incorrect prediction.
  • the model x' (ti + i) is a product of a nonlinear transformation of a fundamental model x°(ti + ⁇ ), so that
  • the prediction f (ti + i) can be halted or the fundamental model ' s output can be inverted depending on the values of ⁇ (t p + ⁇ ) , ⁇ (t p+ ⁇ ) , and ef(t p ).
  • the complete mathematical description of the second stage of the predicting algorithm is presented below in the form of recurrent operator equations of Boolean variables.
  • Each PF k -set member is also shown beginning with the sequence's eighth element. This drawing makes a clear vision of the mechanism of prediction. Prediction is not allowed until a conjunction of the predicting functions has released the prediction. Then, the Natural Selection Algorithm is applied to the PF k -set.
  • the function pf ⁇ [ ⁇ , ⁇ ] ⁇ (lpln) which is the winner in the first cycle of prediction, becomes the outsider in the next cycle.
  • the leader in the second cycle is pfi 5 [ ⁇ , ⁇ i 5 ] ⁇ (5pln) .
  • Each member of the PF-set has its own initial phase 05 (t c ) that is calculated at the beginning moment of the predicting cycle.
  • the behavioral genotype (BG*) itself can not be used as the set of predicting functions in many cases with non- stationary binary processes.
  • the replacement of identical functions b 3 , b 4 as well as the replacement of function be, which is almost identical to b 5 makes the selection for this example, BG*- set, inapplicable for a prediction.
  • the PF-set having an abundant number of members causes a frequent blocking of the prediction with an absence of correct predictions in the predicting cycle.
  • neglecting most of the elements in the composition of the behavioral genotype leads to an increase in the number of prediction errors with simultaneous contraction of the predicting cycle.
  • the first stage of the predicting algorithm designed for the determination of the PF-set' s composition at the initial point of the predicting cycle is of great importance.
  • a convincing example of applying Embodiment 1 and Embodiment 2 to the prediction of the sequence of a binary game random outcome is depicted in Fig.4.
  • the following conventions are present in the above illustration: inv. - inversion predicting mode and dir. - direct predicting mode.
  • the end-point of a k th current predicting cycle and the beginning-point of the next predicting cycle is the same point.
  • two actions might be taken.
  • the first action is a re-estimating of the binary process instability level .
  • the second action is a recalculating of the BG-set membership. Both actions are subordinate to some schedule.
  • the schedule is a part of the method's implementation algorithm.
  • the same algorithm re-estimates the binary process instability level accordingly with a schedule that is functionally dependent on the beginning of a predicting cycle.
  • the particular schedule selection depends on the object of prediction and may be determined during the method's implementing system design or to be a product of an adaptive scheduling subsystem incorporated in such an implementing system.
  • the method of prediction described above increases the efficacy of the binary process prediction.
  • This method expands the applicability of cognitive predicting systems in the field of non-stationary processes.
  • the principal advantage of the method is a more intensive use of the most recent developments in the binary process domain.
  • the present invention does not demand to be in the zone [t p/ t p+w ], (w»l) of the guaranteed binary process stability.
  • the iterative optimizing "Errors and
  • Trials genetic algorithm is not included in the predicting procedure of the present invention. This fact makes it possible for the application of the present invention to a population of real - time systems.
  • the present invention can be incorporated in any system that permits mapping of at least one of the system's outputs on the space of binary processes.
  • the predicting system has a two level hierarchy.
  • the first level is a subsystem (SSi) for the behavioral genotype identification.
  • the second level is a subsystem (SS 2 ) for the sequential prediction of a binary element's state in the binary process.
  • the global input of the predicting system is an output of the object of prediction.
  • the real object of prediction may have a continuous output. Let this output be denoted as u(t)eU.
  • the binary process x( ⁇ )eX is a result of a mapping of the set U of continuous functions into the set X of discrete binary functions.
  • the BM-block quantifies, if necessary, the signal u(t). The quantification may be performed through a time sampling procedure and/or an amplitude qualification.
  • the value u° is a single quantizing level.
  • each component of the vector x( ⁇ ) is a product of this two-step (3.31, 3.32) procedure.
  • B ⁇ B( ⁇ ,u°) u(t) ⁇ x(x) .
  • the parameter ⁇ defines the sampling rate of the quantification.
  • Subsystem SSi The main objective of subsystem SSi is to determine a composition of the behavioral genotype set. The SSi-subsystem provides such determination on a periodical basis.
  • Subsystem SSi is comprised of a Binary Process Mapping Block (BM) , a Binary Process History Storage Block (H) , a Behavioral Genotype Creator (BG) , a Sampling Block (S) , and a Binary Process Shortest History Storage Block (HS).
  • BM Binary Process Mapping Block
  • H Binary Process History Storage Block
  • BG Behavioral Genotype Creator
  • S Sampling Block
  • HS Binary Process Shortest History Storage Block
  • the H-block memorizes the state of each sequential element of the process x(x) that comes from the BM-block, and forms a binary string h[x( ⁇ ) , t q , t p ] ⁇ h[x( ⁇ ) ] .
  • the storage space of the H-block depends on the object of prediction's peculiarities and must be determined during the system design.
  • the string h[x( ⁇ ) ] goes to an input of the BG-block and to an input of the HS-block. The latter creates a binary string hs [x( ⁇ ) , t s , t p ] ⁇ hs [x( ⁇ ) ] , s ⁇ q.
  • the BG-block makes a decomposition expression (3.1) of the string h[x( ⁇ )] on the interval [t( r _ ⁇ ) , t r ] , t r ⁇ t p .
  • the ordering number j of the sample's length ⁇ j is linked to the value t r when the decomposition has been initiated.
  • the Sampler in subsystem SSi local feedback controls the value of ⁇ j according to a criterion of robustness, (e.g., the stability of the sample mean, or both the mean and the standard deviation) of the biggest elementary behavioral function's period ⁇ max (t r , ⁇ j ) ⁇ j max taken from the sample.
  • the ⁇ j max variable is a substantial parameter of the predicting system. It follows from expression (3.4), that T
  • the BG-block generates members of the BG*j-set by formulas (3.4), (3.5).
  • the j- index in the behavioral genotype notation points to the fact that this set is going to be updated according to some schedule.
  • the BG*j-set's composition data is a main output of subsystem SSi. Information about the BG*j-set's membership comes to the inputs of each Selector of the Predicting Functions of subsystem SS 2 .
  • the binary string hs [x( ⁇ ) , t s , t p ] goes from an output of the HS-block to another input of the PFS-block of SS 2 .
  • the BG-block receives a feedback signal from SS 2 - This signal controls the updating schedule for the BG*-set.
  • Subsystem SS 2 The main objective of subsystem SS 2 is selecting the set of predicting functions from the BG*-set and then, performing a prediction. Subsystem SS 2 has some distinctive singularities :
  • the subsystem involves a cyclic, non-iterative, and non-optimizing method of prediction.
  • the subsystem employs the binary process instability evaluation for a selection of an appropriate set of predicting functions at the initial moment of a predicting cycle.
  • the evaluation may, but not necessarily involve traditional genetic algorithm schemes .
  • the subsystem insures that the cardinality of the set of predicting functions is inversely related to the evaluated binary process instability level, or_transient effects on predictability, so that, for the explicitly non- stationary processes PF k - ⁇ BG*j .
  • Subsystem SS 2 is comprised of two contours.
  • the first contour is the main contour of SS 2 .
  • the PF k -set is an output of the PFS-block.
  • the actual prediction f ( ⁇ ) is the first output of the P-block of the main contour.
  • the second contour evaluates the binary process instability level.
  • the second contour is comprised of several parallel channels . These channels have an identical structure such as PFSi — Pi — Ei. Each channel generates a respective component of the estimating vector-function ⁇ ( ⁇ ,t e ), which is defined by expressions (3.6)-(3.8). Evaluation is performed by application of the retrospective predicting procedure to some interval [t q ,t r ], t r ⁇ t p of the binary process history.
  • t e is an evaluation schedule point.
  • the second output of the P-block of the main contour is the indicator er( ⁇ ) defined by expression (3.20).
  • This indicator signals to the exterior of subsystem SS 2 about the end of the current cycle of actual prediction.
  • the BG-block of the subsystem SSi takes into account the state of such "End-of-Cycle" indicators and uses this information for scheduling of the next update of the BG*-set.
  • the er( ⁇ ) signal is also used by SS 2 to perform the next instability evaluation of the binary process .
  • a link between the P-block of the SS-subsystem and the BG-block of the SSi-subsystem closes the global feedback in the predicting system.
  • a human operator of the predicting system may update the schedules, as well as the setup parameters for the binary process decomposition and subsequent statistical analysis of the elementary behavioral functions.
  • the possibility of the human operator's involvement is reflected in the block diagram of the predicting system as the second input of the BG-block in SSi-subsystem and as the first input of the PFS-block in SS 2 - subsystem.
  • Predictions performed during a predicting cycle are independent of the evaluation procedure.
  • Each of the three main procedures in the system the determination of the behavioral genotype, the evaluation of the binary process instability, and the selection of the set of predicting functions, which are active in the current predicting cycle) can be performed independently and do not affect the system's speed.
  • the method allows performing real time predictions of binary processes, including non-stationary processes, regardless of possible speed and memory limitations of computing resources.
  • the predicting system that implements the method increases efficiency of any entity that includes this system as a subsystem.
  • u(t) is an unknown useful signal that reflects the value ⁇ (t) .
  • the signal y(t) is an additive noise.
  • the vector of the filter's parameters consists of a gain factor Kf and a vector T f of time-dimensional constants characterizing the filter's dynamics, so that The remaining part of the system might be described in general by a nonlinear operator Q[D, ⁇ , s f (t) ] , D ⁇ d/dt.
  • a multiplicative disturbance also might exist in the system.
  • the low p(t) indicates that the system is unable to produce an accurate measurement.
  • a traditional approach for the noise rejection is filtration. However, no filter of any kind can produce a total noise rejection. Thus, the system's filtering ability bounds the accuracy and the precision of the measurement.
  • the present invention provides a new powerful solution for a problem of additive noise rejection and for a problem of multiplicative disturbances compensation in measuring systems. The new approach works well in those cases where the traditional methods fail.
  • the solution is based on a measuring algorithm that returns each resulting measurement Vj ⁇ v(tj, ⁇ j) by an aggregation of a string of controllable sub-measurements.
  • the tj is the j th moment of the discrete time when the resulting measurement is done; the ⁇ j indicates the length of such measurement.
  • the sub-measurement ⁇ j,i ⁇ (tj,i, ⁇ j, ⁇ ) of the measurement v(tj, ⁇ j) is a specifically selected output of a measuring block-procedure.
  • the measuring block-procedure ⁇ ,is ⁇ (t,i, ⁇ , ⁇ ) is a completed measurement associated with an index number (i) of each repetition of the measuring algorithm.
  • the evaluation formula is similar to formula (3.32) where u(t) and u°(t) are substituted respectively with p(t) and p°.
  • the j th outcome measurement v(tj, ⁇ j) needs to be organized as an aggregate function A of a sequence of those sub-measurements, i.e.,
  • the measuring block-procedure ⁇ j, ⁇ is executed regularly at each moment tj,i and does not depend on the process x( ⁇ ) .
  • Parameter ⁇ j,i is the duration of the procedure ⁇ (tj,i, ⁇ j, ⁇ ) .
  • the sub-measurement Vj, ⁇ accepts a value of the measuring block-procedure ⁇ j,i only if such action is permitted by control function %j,i ⁇ % .t-j.i) .
  • the measuring block-procedure may have a rather complex algorithm. However, it follows expression (3.35), that an interval between two adjacent measurements (V , Vj +i ) is defined by a sum of the duration of each measuring block- procedure that is involved in the current measurement. Number m of such procedures can be predetermined or can be calculated by the system itself based on a criterion of a desired accuracy, and so forth. The same approach is used for the multiplicative disturbance rejection. Once the prediction of the signal-to-noise ratio has indicated “low", the measuring system automatically switches to a multiplicative disturbance compensation mode. Information about measured value ⁇ (t) is locked in " this mode. A testing noiseless signal goes to the system's input instead of signal s(t). This signal is used for the adjustment of the system's drifting parameters. Thus, the measuring system with the signal-to-noise ratio prediction mostly accumulates data with a low noise component.
  • the system is comprised of a Measuring Block-Procedure Subsystem (MBP) , an Aggregation Block (AGB) , a Signal-to- Noise Ratio Predictor (P) , and a Measuring Process Control Block (MCB) .
  • MBP Measuring Block-Procedure Subsystem
  • AGB Aggregation Block
  • P Signal-to- Noise Ratio Predictor
  • MB Measuring Process Control Block
  • the input of subsystem MBP is either informative signal s(t) (if the system. orks in the measuring mode), or testing noiseless signal u st (t) (if the system works in the adjustment mode) .
  • Another output of subsystem MBP is binary process x(T) or binary vector- process x( ⁇ ) , which is the binary evaluation of the signal- to-noise ratio.
  • Signal x( ⁇ ) goes to an input of the predictor.
  • Predictor P generates a prediction f ( ⁇ ) of element x( ⁇ ) corresponding to a forthcoming result ⁇ ( ⁇ ) of the measuring block-procedure.
  • the MCB-block produces output signal ⁇ (t) that simultaneously controls sub-measurement's value ⁇ ( ⁇ ) . If the forecasted level of the p( ⁇ ) is high, the sub-measurement ⁇ ( ⁇ ) has some value and is accounted in the j th measurement Vj . If the forecasted level of p( ⁇ ) is low, sub-measurement ⁇ (t) is not accounted in the j th measurement Vj.
  • the static accuracy (A) of the measuring system may be evaluated as follows:
  • Signal s(t) and S f (t) in expression (3.38) are accessible.
  • Signal p(t) can also be obtained by measuring the noise component involving a separate channel of MBP. In that case, the noiseless testing signal is employed, and a correlation between the actual noise y(t) and the noise measured at the separate channel must be proved.
  • er( ⁇ ) is the prediction method's error described in expression (3.20).
  • Discrete time ⁇ characterizes sub- measurements of the j th measurement.
  • Expression (3.46) shows that by having the effective predictor in the measuring system, the possible low noise component in the current measurement, is ⁇ times greater than the possible high noise component, ⁇ >1. The approach explained above was proven experimentally.
  • the sample of digital output of an ultrasonic distance meter was used in a computer simulation of the predictor.
  • the receiving stage of such a system is comprised of a preamplifier and a filter.
  • the mathematical model of these devices may contain the following expressions :
  • value V is the filter's power supply voltage
  • value K a is the preamplifier's amplification factor.
  • the method of the present invention can be employed for a prediction of the moment of the possible filter's saturation. Then, the sub-measurement containing saturated filter would not be accounted for in the current measurement similar to what was presented in expressions (3.33) - (3.35). To get that algorithm suitable to the current problem, the multiple-level quantification should be involved.
  • process x 3 ( ⁇ ) of the lower quantizing level s ax ⁇ ) can be used for the prediction.
  • the elementary behavioral functions of process x 3 ( ⁇ ) encircle the moment of saturation observed in binary process 4 ( ⁇ ). Therefore, to work out the effect of substantial non-linearity, we need to use a multidimensional predicting algorithm has to be invoked.
  • the art of design is the establishment of the sufficient amount of quantizing levels in such a measuring system.
  • a multiplicative disturbance can be rejected by switching the system's input from signal s(t) to a testing signal in order to adjust the system's unstable parameters. This switching has to be accomplished at the moment of prediction of the filter's saturation.
  • the multi-dimensional version of the present invention can be used in econometrics known as the time series analysis.
  • Let there be a time series which is a 3-point moving average of the difference between the stock price "High” and the stock price “Low” . These variables are very popular in the field of stock market.
  • the procedure B( ⁇ ,u°) of expressions (3.31 and 3.32) should be applied.
  • the time series Spread is already defined on the discrete time domain, i.e., the sampling rate ⁇ is predetermined.
  • the process Spread( ⁇ ) ⁇ u. ( ⁇ ) >0 of the present example has the following mapping on the vector x( ⁇ ) :
  • the object of the econometric analysis is to determine whether or not the particular time series belongs to some interval on its range. Define each quantizing level of (3.48) as such interval's upper/lower bound so that:
  • every process u( ⁇ ) is linked to two binary processes Xj ( ⁇ ) and Xj+ ⁇ ( ⁇ ) according to statement (3.50).
  • a forthcoming element of a binary process j ( ⁇ ) will be "+”can not be determined with sufficient predictability.
  • the predicting method's efficiency evaluation (3.7), it means that ⁇ j (t/ t q , t r ) ⁇ * , ⁇ *>l.
  • the predictability of the fact that the next element of the same process XJ ( ⁇ ) will be "-" is much greater than ⁇ * .
  • the ⁇ Locating Condition> is the following selection condition:
  • evaluation function ⁇ [R l ( ⁇ , t q , t r ) ,W l ( ⁇ , t q , t r ) ] is defined by formula (3.7) .
  • a data acquisition system which is basically comprised of several sources of data, transmitters that deliver data over some media or through an interface, receivers, and signal/data processing devices.
  • Each informative channel experiences some interference existing in the form of additive and/or multiplicative disturbance.
  • one or more channels demonstrate a lesser level of disturbance in comparison with other channels of the system if observed at any moment in time.
  • a prediction of the next channel free of disturbance can be performed by the method of the present invention.
  • the approaches presented in the description of Application 1 and Application 2 are useful in accomplishing this objective.
  • the data processing device may be switched to receive information that will be coming through the less disturbed informative channel .
  • the method of the present invention allows a simplification of the error correction algorithms, and increases the memory capacity and the system's speed.
  • the cases that correspond with this application relate to those categories where the content of a message carries priority over the moment when the communication takes place.
  • An example could be a communication under a disaster condition.
  • the content of the message is vitally important, and the value of time spent for the setup of communication arrangement has a survival meaning as well.
  • Another example could be a problem of a remote control of an object (a space ship, a nuclear power station, a chemical plant, etc.) with random failures.
  • Providing a high quality cellular phone communication is also that kind of problem.
  • the predicting method of the present invention is a possible solution for the problems listed above.
  • the following sketch-algorithm is an illustration of how the method of a binary process prediction can be used for improving the quality of the cellular phone conversation. This is accomplished by predicting and subsequently advising the user about the moment of best physical conditions of communications. Assume that there is a cellular phone network where each user is linked to the host station:
  • Each telephone automatically responds to a time scheduled check-signal on the reserve frequency generated by the station.
  • the responses are binary-classified by the good communication quality criterion and the users are respectively separated into two groups. Then, the forthcoming membership for both groups is predicted.
  • a user may expect to receive an appropriate notifying message when attempting to contact any member of the "bad communication quality group" .
  • a continuous check - response dialog takes place between the host station and each communicator. This dialog is accompanied by the communication quality prediction. If a failure of some communication is predicted, then both participants may receive the notifying message.
  • the present invention may be viewed as a computer- based game's algorithm where the human intelligence and the artificial intelligence compete.
  • a human-player generates a binary string of elements of a finite length where a computer program must predict the forthcoming element ' s state. The number of correct and incorrect predictions is evaluated on at least one binary string length so that the human wins and respectively the artificial mind loses if some predetermined threshold is exceeded by the evaluation.
  • a set of such evaluating thresholds and the predicting algorithm's internal parameters can be established by a human player to set a game to different levels of complexity. Thus, a different result in this game is expected depending on how skilled the human player is.

Abstract

The method for a sequential prediction of a binary element's state in a binary process and the system for the method implementation are based on the binary process (Block BM) representation by a unique sequence of binary elementary behavioral functions. These elementary behavioral functions are used for building a genotype of the binary process’ behaviors. The behavioral genotype is periodically updated through the analysis of the binary process history (Block H). The behavioral genotype set defines a set of predicting functions with respect of an evaluation of the binary process’ current instability level generated in the behavioral genotype creator (Block BG). The natural selection algorithm that operates upon the set of predicting functions is used in predicting procedures for a non-iterative determination of a state of the forthcoming binary process’ element. If the binary process is non-stationary, then a cardinal number of the set of predicting functions is equal or less than a cardinal number of the behavioral genotype set.

Description

METHOD FOR A SEQUENTIAL PREDICTION OF BINARY ELEMENTS STATE IN A BINARY PROCESS AND THE SYSTEM FOR THE METHOD IMPLEMENTATION
BACKGROUND OF THE INVENTION Field of the Invention
The present invention relates to methods and systems of prediction. The main object of the present invention is an extension of cognitive predicting methods on non-stationary processes.
The Prior Art
Every process can be viewed as a product of some entity's functioning. From that position, we may look at the process as the entity's output. We also may use the term object of prediction meaning the entity whose output shall be predicted. The binary process is frequently used for a representation of any other process that permits such mapping. All further descriptions will be done in view of the binary process prediction.
The majority of known methods, algorithms, and systems, which are capable of prediction of the entity's output, use a priori knowledge of that entity's properties. Typically, the entity's properties are described in the form of various types of mathematical models such as sets of algebraic, differential, integral, stochastic equations, and their combinations. The predicting systems that employ the entity's model spans the wide range between the first attempts for extrapolation by Newton, Lagrange, etc. [G.A.Korn, 1961], and modern adaptive predictors [US Patent 5,424,942, 07/1995, 364#164, Dong,]. The degree of complexity of prediction rises continuously. The development of cognitive predicting algorithms was inspired by a problem of an accurate prediction for an entity that is not able to provide complete information about its varying parameters and structure. These algorithms use cloning of evolutionary principals of biological systems. They belong to a set of genetic algorithms whose theory Dr. J. Holland developed in 1975. There are important features that describe uniqueness of the predicting systems utilizing a genetic algorithm approach [J. Holland, 1975, J. R. Koza, 1992, US Patent 5,136,686, 08/1992, Koza, K. De Jong and W. Spears , 1993]:
• Object of prediction is stationary or quasi - stationary;
• The process to be predicted, employs a binary string as its internal representation;
• A Genetic Algorithm Representative Schema is a set of predicting solutions that are functions of the process ' argument . Every generation of such schema is a product of a multi-step optimization procedure that includes the Natural Selection Algorithm for an appropriate selection of the predicting solutions; Evolutionary Operators such as crossover, mutation, permutation, proportional reproduction, inversion, etc., for the new solutions generation; and a Fitness Function to be a measure of performance for each of those solutions;
• The representative schema optimization procedure acts on the specified interval of the binary process history to train the predicting system in recognizing the specifics of the process that is subjected to prediction; and • The predicting system produces a prediction of the forthcoming process element via calculating an output of the optimal predicting function at the next value of its argument.
A powerful extended genetic algorithm developed by J. Koza [US Patent 5,136,686, 08/1992] is good material for a discussion of strengths and weaknesses of the genetic algorithm approach in the context of non-stationary process prediction. The J. Koza's genetic algorithm is nonlinear. It not only includes the natural selection method and evolutionary operators, but also breaks down a problem into a hierarchy of subordinating sub-problems . This algorithm is free of the uniformity constraint that requires keeping the same size for all members of the population of predicting solutions. The J. Koza's genetic algorithm was not specifically designed for prediction. In the most general form given in the patent disclosure, this algorithm has the following description: "The process of the present invention operates upon a population of entities, which accomplish tasks and can vary in size and shape. Each iteration of the process comprises activating, selecting, choosing, performing, and adding. First, each entity activates to accomplish its goal and produces a result. Second, a value is associated with the result of each activation and assigned to the corresponding entity. Third, at least one entity having a relatively high associated value is selected. Next, an operation is chosen from crossover, fitness proportionate reproduction, mutation, or permutation. If crossover is chosen, then the selected entity performs the crossover operation. Crossover creates new entities by combining portions of at least one selected entity with portions of at least one another entity. Fitness proportionate reproduction retains the selected entity in the population. Mutation randomly alters a small random part of an entity. Permutation reorders the parts of an entity without a net gain or loss. Finally, the newly produced entities are added to the population. "Many seemingly different problems can be reformulated into a problem requiring discovery of mathematical expression or computer program that produces some desired output for particular inputs. When viewed in this way, the process of solving these seemingly different problems becomes equivalent to searching a space of possible mathematical expressions or computer programs for a most fit individual mathematical expression or computer program. " Naturally, Dr. Koza suggested to use this algorithm for prediction of "...the future elements of a sequence of numbers from a sampling of early numbers from the sequence [US Patent 5,136,686, 08/1992, p. 221]."
A possible binary process element predicting system that corresponds to the genetic algorithm described above is depicted in a block diagram in Fig.l. The following conventions are present in the above illustration:
H - Binary Process Storage
PFG - Predicting Functions Generator
F - Predictor φ - Fitness Function Operator x(τ) - binary process; τ- (ti, t2, ..., tp) - discrete argument h[x(τ) , tq, tr] ~ Binary string of the binary process history PF - Set of predicting functions pfopt(X/tq,tr) - optimal predicting function f (t)=f (ti+i) ~ the state of an i+1 element in the binary process prediction; i<p - retrospective prediction i≥p - actual prediction There are two types of predicting procedures in the system. The first procedure is an actual predicting procedure. The second procedure is a retrospective predicting procedure. An operator F that has the following definition provides both procedures .
Vτ=(tι,t2,...,tp) , τ=tι => F[x(τ)]sf(ti+ι) (l.l) f ( i+i) =x(ti+ι) => "correct prediction" f (ti+i) - actual prediction ti<tp => f (ti+i) - retrospective prediction
Here tp is a value of the latest existing discrete argument, t=(tι, t2,..., tp) , of the binary process x(τ) . When the retrospective predicting procedure is active, it is assumed that the forthcoming element of the binary process is unknown.
This procedure is used at the stage of genetic algorithm representative schema optimization. When the actual predicting procedure is active, it means that the forthcoming element of the binary process is really unknown. The discrete argument % of the binary process x(τ) is not necessarily a time variable.
One binary process predicting system that is based on the genetic algorithm described above operates as follows: Each element of the binary process x(τ) goes to the storage (H) where it becomes a binary string h[x(τ),tι] element; ti is an observer's position point, i=l,2,...,p;
- The system selects an interval [tq,tr], tq<tr<tp on that binary string;
- Then, the Predicting Functions Generator (PFG) inserts an initial population of the binary process' predicting functions pfk.τ, tq, tr) ePFi, k=l,2,...,K; - Each predicting function is made up of binary tokens, and may be considered as a chromosome;
- Then, the predicting system initiates training until it finds the optimal predicting function pf0 (X/ tq, tr) , τe[tq,tr]; and,
- The following recursive expressions give a formal description of a search for the optimal predicting function:
Figure imgf000007_0001
(An iteration index j is omitted further in order to simplify notations)
Vτ=(t1,t2,...,tp) , τ=tι => F[x(τ)]≡f (ti+i) φ(τ,tq,tr)=Φ[R(τ) ,w(τ)] =∑ [R(τ)] Σ_1[W(τ) ] ,φ(τ, tq, tr)>0
Figure imgf000007_0002
,w2(τ) ,...,wN(τ) }
3pf0t(τ/ tq, tr)ePF, φ(τ) ->max (perfect fit)
3pfm(τ, tq, tr)ePF, φ(τ)-φ°>0, φ°>0, m=l,2,...,M (good fit) f (ti+i) =x(ti+ι) => Ri(τ)=l - correct prediction f (ti+1) ≠χ(ti+i) => Rι(τ)=0 - incorrect prediction, i=l,2,...,N
Figure imgf000007_0003
The fitness operator Φ of equation (1.2) may have a different view. However, each fitness function shares a common feature. Each fitness function in the predicting system provides an integral evaluation of the system's predicting ability. This evaluation is calculated on the interval [tq,tr] where (tr-tq)»l. The form of the fitness operator presented in expression (1.2) reflects the fact that the efficiency of prediction is higher as more correct predictions are produced with respect to the amount of incorrect predictions if both are observed on the same interval [tg,tr]. The number N≡Nj of components of the vectors Rj and j is equal to the cardinal number of the PFj- set for each iteration j=l,2,...,J. The PFS - operator of equation (1.2) is responsible for changes in the population of pf - functions . This operator involves evolutionary operations to modify pf - functions from the previous iteration. It also produces a selection of those pf - functions which satisfy to the "good fit" selection condition. The "good fit" pf - functions are the source of new members in the PFj+i. Thus, we can see that the fitness function φ(τ) serves in this predicting algorithm as a measure of how successfully any pf - function returns predictions exclusively on the interval [tq,tr].
The method described above possesses a distinctive peculiarity of genetic algorithms if viewed from the position of prediction. That is a utilization of the iterative optimization procedure for achieving the optimal predicting function. In this connection, the optimization procedure is defined on certain interval of the binary process's "past" such that the search for the optimal predicting solution and the actual prediction are separated from each other.
K. De Jong and W. Spears (1993) concluded in their review on genetic algorithms, that the operational domain of the algorithm developed by J. Koza (1992) and the similar algorithms and systems [Us Patents 4,697,242, 09/1987,
Holland; 5,222,192, 07/1993, Shaefer; 5,255,345, 10/1993, Shaefer] are limited by a stationary state constraint . This constraint requires for every system that involves the genetic algorithm for prediction, to be stationary, or in some particular cases, to be quasi-stationary.
It is possible to support Dr. De Jong's opinion with the help of the following reasoning: Assume that the optimal predicting function has been found as a result of training on the interval [tq,tr]. The next step is the actual prediction, when τ goes farther than the [tq,tr]- However, so long as the arbitrary fitness function is only able to evaluate performance of the pf - functions if (tr-tq)»l, then a possible error in the actual prediction at τ = tr+i, can not affect the PF - set's membership. It is necessary to carry out several predictions using the pfopt (T/ tq, tr) before the new optimal predicting function pfopt (Ε, ts, tr+w) , w»l can be determined and the system can use it for prediction. Therefore, that kind of predicting system may work efficiently only if such interval [tr,tr+w], w»l exists where the binary process does not change one's properties. In other words, the object of prediction must be stationary or quasi-stationary in order for the genetic algorithm-based predicting system to work efficiently. This description is a projection of the genetic algorithm's natural limitation on the problem of binary process prediction.
It is known that differential, integral, stochastic, or any other mathematical models can not entirely represent a non-stationary process. Hence, any methods based on traditional mathematical models are not feasible for non- stationary process prediction. Some typical non-stationary processes are listed below for the purpose of illustration:
1. Signal-to-noise ratio in a discrete measuring system if at every particular moment of measuring a value of this ratio needs to be predicted;
2. Sequential prediction of elements of an econometric time series;
3. Game whose random outcome must be predicted at every step and the number of steps are limited; and, 4. Prediction of an object's failure according to a pre- assigned check-up schedule. The list above along with similar processes do not have the interval [tr,tr+w], w»l where their steadiness or stationarity can be confirmed. Hence, it appears that a predicting system utilizing any genetic algorithm is unable to manage an alteration to the non-stationary process' behavior. Moreover, there are a few fundamental features of genetic algorithms that definitely resist the solving of the problem of non-stationary process prediction. Those features are:
• Generating new predicting functions through the application of the evolutionary operators such as crossover, mutation, proportional reproduction, etc., to the existing members of the population of predicting functions;
• Separation of the optimal predicting function pfopt (τ, tq, tr) determination process from the process of actual prediction such ' that the optimal predicting function can be defined only on the antecedent interval [tq,tr], (tr-tq)»l, tr<tp.
In addition, the cognitive predicting system utilizing multi-step optimization for the system's training requires powerful computing sources. This is also a substantial limitation of the genetic algorithm paradigm. Genetic algorithms do, however, carry several significant properties that are vital for the solution of the non-stationary process prediction problem.
First, is the idea of adaptation [J. H. Holland, 1975] .
Adaptation is considered the ability of a system to modify its parameters and structure in response to changes to the system's environment. In view of the process' prediction, the role of the environment belongs to the object of prediction.
The second property is an assumption about the existence of a representative set of solutions. A desired solution or solutions may be obtained by applying the Natural Selection Algorithm to the representative set of solutions .
The third property is the idea that the existence of atomic elements (genes) combined to construct members (chromosomes) of the representative set of solutions (population of chromosomes) .
The last of these properties is a conjecture that chromosomes of different sizes may exist in the same population of solutions [J. Koza, 1992] .
The following items must be determined when developing a method for a sequential prediction of a binary element's state in the binary process :
• A structure and an algorithm of a predicting system that is enabled to adapt to a fast altering behavior of the non-stationary object of prediction;
• A predicting procedure that employs the Natural Selection Algorithm;
• A generator of predicting functions and an algorithm for these functions to update; and, • The composition, size, and property of the set of predicting functions . No solutions have been found in scientific literature for these items. The present invention solves the problem of sequential prediction of a binary element's state in a binary process. One object of the present invention is to provide a mathematical method and a computer algorithm to perform predictions of binary processes including non- stationary processes. A further object of the present invention is to provide the structure of the cognitive system for a sequential prediction of a binary element's state in a binary process that increases efficacy of functioning of any entity that includes this system as a subsystem.
SUMMARY OF THE INVENTION
The present invention relates to methods and systems of prediction. The present invention provides the method for a sequential prediction of a binary element's state in a binary process and the system for the method embodiment. The binary processes are frequently used as a representation of a wide range of other processes that can be observed at outputs of various types of objects of prediction. The present invention is based on a representation of the chaotic nature as a "neighboring" order regularity whose separate parts preserve some order. The binary process was decomposed and specific atomic binary structures of minimal length were distinguished. A propagation of those structures in both directions of the binary process domain returns a stable, regular image. Such formations were denoted as the Elementary Behavioral Functions. It is observed in the present invention that every binary process x(τ) , %=t , t2,..., tp can be uniquely represented by a sequence of its elementary behavioral functions bk(x, tk,ηι.) , (k=l, 2, ...,K) ,
Vτe ( tι, t2 , ..., tp) , x (τ)
Figure imgf000012_0001
(2 . 1)
dom[bk (τ, t , ηk) ) ] = [tk-ι, tk] Here ηk is a period of the k-th elementary behavioral function; dom[bk(τ, tk,ηk) ] is a domain of the function bk(τ,tkk) [R- Elmasri and S. Navathe, 1994]. If taken with satisfaction to a condition of orthogonality, these functions become behavioral genes of the binary process, and constitute a genotype BG of the binary process ' behaviors . The behavioral genotype set is defined on a representative interval [tq, tr] ,λ=(tr-tq)»l. Then, the set BG is transformed into a generalized genotype BG* by a union with the set C={c+(τ) ,c"(τ) } . Each member of the C-set is a countable sequence of identical states of binary process elements under the condition of c+(τ)
Figure imgf000013_0001
.
The present invention states that the genotype BG* is quasi-stationary relative to a character of change of two adherent elementary behavioral functions in expression (2.1) . Every binary process has its inherent behavioral genotype. In the case of a multi-dimensional system, each component x(τ) of a vectorial binary process x (τ) has its inherent behavioral genotype.
The process of prediction is recursive. It includes the following basic steps:
1. Determination of the set BG*j of behavioral genes at the moment τ=tr. The set BG*j modifies the previous set BG*j_ι which was determined at x=tri , λje , where N denotes the set of natural numbers. If τe [tr_λj, tr) , then the set BG*j_ i is still active;
2. Evaluation of the binary process instability level, or process ' transients effect on process ' predictability, through a calculation of an estimating vector-function (τ, te,λei) ,φ2j (τ, tee2) ,...,φnj (τ,teen) } by applying a retrospective predicting procedure; te - evaluation schedule indicator; λe - evaluation window; 3. Performing an actual dual-stage predicting procedure at τ=tp≥tr. This procedure produces a prediction of a forthcoming binary element's state x(tp+ι) in the binary process x(t) . The procedure is non-iterative and cyclic. Each cycle may contain several predictions . The starting point (tc) for the next cycle is when an error er(tc) of prediction occurs, i.e., 3tceτ, f (tc)≡f (tp+ι)≠χ(tp+ι) → er(tc)=true, (tc=tcι, tc2, tc3,...) . The first stage is for a selection of the set
Figure imgf000014_0001
] , (k=l,2,...) of predicting functions, which are active at the beginning of the k-th cycle of prediction. The PFk - set exists in various alternate versions. The composition of this set is controlled by a function υ(φ) . This function is responsive to the current level of the binary process instability. It is fulfilled in the present invention that a cardinality of a set of predicting functions is inversely related to the evaluated instability level of the binary process, so that, for explicitly non- stationary processes the following statement is competent:
The second stage is for prediction directly. The prediction f (τ)=f (tp+ι) is returned by a logical operator F acting upon the set PFk of predicting functions . The output of the prediction f (τ) depends on prediction error's status of each PFk-set's member, current efficiency of prediction, and a set of binary indicators modifying a predicting algorithm. The retrospective prediction and the actual prediction both employ the Natural Selection Algorithm in a manner that each member of PFk participates in the current prediction cycle until this member produces an incorrect prediction. Each predicting function may again participate in prediction only in the next predicting cycle; and, 4. Updating the behavioral genotype membership and re- estimating the binary process instability level.
The prediction method presented above is used in a predicting system that is the method's embodiment. The system is comprised of two subsystems - subsystem SSi, and subsystem SS2. The main objective of subsystem SSi is to determine a composition of the behavioral genotype set. Subsystem SSi provides these determinations on a periodical basis. Subsystem SSi is comprised of the following: a Binary Process Mapping Block (BM) , a Binary Process History Storage Block (H) , a Behavioral Genotype Creator (BG) , a Sampling Block (S) , and a Binary Process Shortest History Storage Block (HS) . The BM block quantifies, if necessary, the signal u(t) from an output of the object of prediction. The quantification may be performed by time and/or by level of the input signal. In total, the output of the BM-block is a vector-function x(τ) of the discrete argument τ= (ti, t2, t3,..., tp) , where tp is the latest observed value of τ. Every component of x(τ) is processed by a separate identical tract in SSi, and then the processed data from that tract come to a corresponding tract in SS2. For the sake of simplicity, all descriptions from here on in will be provided for a single component x(τ)ex(τ). A block diagram of the one-dimensional predicting system is shown in Fig.6. The following conventions are present in the above illustration: SSi - Subsystem #1 SS - Subsystem #2
BM - Binary Process Fy ~ prediction Block, V=l , 2 , ... , n
Transforming Block H - Binary Process Ev - Binary Process Instability
History Storage Estimator ,
Block
V=l , 2 , ... , n
BG - Behavioral Genotype u ( t ) - Output of an Obj ect of
Creator Prediction
S - Sampling Block x (t) - Binary Process
HS - Binary Process f ( τ) - prediction, X=
Shortest History , . . . . . ,
Storage Block . ti , t2 , t3 , ... , tp , Zp+1 )
The H-block memorizes each sequential element of the process x(τ) that comes from the BM-block, and forms a binary string [x(τ) , tq, tp]≡h[x(τ) ] . The string h[x(τ)] goes to an input of the BG-block and to an input of the HS-block. The latter creates a binary string hs [x(τ) , tΞ, tp]≡hs [x(τ) ] , s≤q. The BG-block makes a decomposition (2.1) of the string h[x(τ)] on the interval [t<r-λj) / tr] , tr≤tp. The ordering number j of the sample's length λ is linked to the value tr when the decomposition has been initiated. The Sampling Block in the SSi-subsystern's local feedback, controls the value of the λ-j according to a criterion of statistical stability (e.g., the stability of the arithmetic average or both the arithmetic average and the standard deviation) of the biggest elementary behavioral function's period,
Figure imgf000016_0001
taken from the sample. The ηjax variable defines a cardinal number of the BG—set.
All methods of statistical analysis are allowed at this stage. A human operator may also set up the value λj . The BG - block generates members of the BG*j-set. The j-index in the behavioral genotype notation points to the fact that this set is going to be updated according to some schedule. The BG*-set's composition data is a main output of subsystem SSi- Information about the BG*-set membership comes to an input of each Selector of Predicting Functions of subsystem SS2. The binary string hs [x(τ) , tΞ, tp] goes from an output of the HS-block to another input of the PFS-block of SS2. The BG-block receives a feedback signal from SS . This signal controls the schedule for updating the BG*-set.
The main objective of subsystem SS2 is selecting the set of predicting functions from the BG*-set and then, performing a prediction. Subsystem SS2 has some distinctive singularities :
• The subsystem involves a cyclic, non-iterative, and non-optimizing method of prediction;
• The subsystem employs evaluation of the binary process instability. This evaluation is performed for selection of an appropriate set of predicting functions at the initial moment of a predicting cycle; and,
• The subsystem insures that the cardinality of the set of predicting functions is inversely related to the evaluated binary process instability level so that, for the explicitly non-stationary processes PFC=BG* .
Subsystem SS2 is built from Selectors of Predicting functions (PFSi) , Prediction Blocks (P±) , and Binary Process Instability Estimators (Ei) , i=l,2,...,m. Subsystem SS2 is comprised of two contours . The first contour is the main contour of SS2. This contour includes a tract PFS — > P that is responsible for the selection of the set PFk≡PF(tCk) =PF (BG*j) of predicting functions. These functions are only active in the current predicting cycle. The PFk-set is an output of the PFS-block. The actual prediction f (τ) is the first output of the P-block of the same contour. The second contour evaluates the binary process instability level. The second contour is comprised of several parallel channels. These channels have an identical structure such as PFSi -4 Pj -> Ej. Each channel generates a respective component of the estimating vector-function φ(τ, tee) . The evaluation is performed by the application of the retrospective predicting procedure to some interval [tq,tr], tr≤tp of the binary process history. Here, te is an evaluation schedule point, and λe=(tq-tr) denotes the length of the evaluation window.
The second output of the P-block of the main contour is an indicator er(τ) of the error of prediction. This indicator signals to the exterior of SS2 about the end of the current cycle of actual prediction. The BG-block of SSi takes into account the state of such "End-of-Cycle" indicator and uses this information for scheduling of the next update of the BG*-set. The er(τ) signal is also used by SS to perform the next instability evaluation of the binary process. A link between the P-block of SS2 and the BG-block of SSi closes the global feedback in the predicting system. Depending on the system's embodiment, a human operator of the predicting system may update the schedules, as well as the setup parameters for the binary process decomposition and subsequent statistical analysis of the elementary behavioral f nctions .
Predictions performed during a predicting cycle are independent of the evaluation procedure. Each of the three main procedures in the system (the determination of the behavioral genotype, the evaluation of the binary process instability, or process' transients effect on predictability, and the selection of the set of predicting functions, which are active in the current predicting cycle) can be performed independently and do not affect the system' s speed.
The prediction method described above increases the efficiency of the binary process prediction. This method extends the applicability of cognitive predicting systems in the field of non-stationary processes. The principal advantage of the method is a more intensive use of the most recent development in the binary process domain. Contrary to prior art, the present invention does not demand to be in the zone [tp,tp+w], (w»l) of the guaranteed binary process stability. The iterative optimizing "Errors and Trials" genetic algorithm is not included in the predicting procedure of the present invention. This fact makes it possible for the application of the present invention to a population of real-time systems .
The present invention can be incorporated in any system that permits mapping of at least one of the system's outputs on the space of binary processes.
DESCRIPTION OF THE DRAWINGS
Fig.l depicts a block diagram of a modern predicting system based on the genetic algorithm approach;
Fig.2 is a generalized algorithm of a method for a sequential prediction of a binary element's state in a binary process; Fig.3 illustrates a prediction by the PF-set = BG-set, #(BG)=15;
Fig.4 presents examples of Embodiment 1 and Embodiment 2 of a predicting algorithm of the present invention;
Fig.5 is an illustration of a binary process mapping on the space of binary processes;
Fig.6 depicts the block diagram of a predicting system for a sequential prediction of a binary element's state in a binary process;
Fig.7 depicts an original measuring system block diagram;
Fig.8 depicts a block diagram of a measuring system with a signal-to-noise ratio prediction;
Fig.9 illustrates a measurement with a signal-to-noise ratio prediction;
Fig.10 illustrates the compensation of a measuring system's filter saturation by means of prediction;
Fig.11 depicts a fragment of the output of a three-point moving average function of a time series SPREAD;
Fig.12 illustrates a mapping of the econometric time series SPREAD on the space of binary processes; and,
Fig.13 illustrates a prediction of the econometric time series SPREAD elements . DETAILED DESCRIPTION OF THE INVENTION
The present invention describes a method for a sequential prediction of a binary element's state in a binary process and a system for this method embodiment. In the following description, numerous specific details are set forth in order to prove a thorough understanding of the present invention. Mathematical notation is frequently used to keep the description as accurate as possible. It will be obvious, however, to one skilled in the art that the present invention may be practiced without using these specific details. In other instances, well-known methods, structures, and representations have not been described in detail so as not to unnecessarily obscure the present invention. The generalized algorithm of the new method of prediction of a binary process element's state is shown in Fig.2. The following conventions are present in the above illustration:
Block 1 : Begin
Block 2: X:= tr
Block 3 : Determination of the set BG*j of the behavioral genes at τ=tr
Block 4: Evaluation of the binary process instability Level or process ' transients effect on predictability Block 5 : Performing the two - stage actual prediction procedure at τ=tp tr Block 6 : Updating the behavioral genotype membership and re-estimating of the binary process instability level
Block 7:
Figure imgf000021_0001
Block 8: Output
The method of prediction is recursive. It includes the following basic steps that must be fulfilled for every single binary process or for each component of a vectorial binary process :
1. Determination of the set BG*j of behavioral genes at moment τ=tr. The set BG*j modifies the previous set BG*j_1 which was determined at
Figure imgf000022_0001
λj=var. If τe [tr-λj, tr) , then the set BG*j_! is still active;
2. Evaluation of the binary process instability level through a calculation of an estimating vector-function
Figure imgf000022_0002
tee) ,φ2j(τ,tee) ,..., φnj (t, tee) } by applying the retrospective predicting procedure; te - evaluation schedule point; λe - evaluation window;
3. Performing a two - stage actual predicting procedure at This procedure produces a prediction of a forthcoming binary element's state x(tp+ι) in the binary' process x(τ) . The procedure is non-iterative and cyclic. Each cycle may contain several predictions; and,
4. Updating the behavioral genotype membership and re- estimating the binary process instability level .
All these steps are described below in detail.
1. Determination of the set BG*-j of behavioral genes : The corner stone of the present invention is the concept of a binary process behavioral genotype . A definition of the behavioral genotype is based on a representation of the chaotic nature in the form of a "neighboring order" regularity whose separate parts preserve some order. This assumption allows a decomposition of the binary process into specific atomic binary structures of a minimal length. A propagation of those structures in both directions of the binary process' discrete argument domain returns a stable, regular order. Such formations have been denoted as elementary behavioral functions. It is observed in the present invention that every binary process x(τ) , x=tι, t2,..., tp can be uniquely represented by a sequence of its elementary behavioral functions :
Vτe(tι#t2....,tp),
Figure imgf000023_0001
(3.1) dom[bk(τ, tk,ηk) ) ] = [tk_ι,t ]
Here, ηk is the elementary behavioral function's period; dom[b (τ, tkk) ] is a domain of the function bk(τ,tkk) [R. Elmasri and S. Navathe, 1994]. If taken with satisfaction to an orthogonality condition, these functions become behavioral genes of the binary process and constitute a genotype BG of the binary process ' behaviors :
Figure imgf000023_0002
3i≠j,
Figure imgf000023_0003
Vτedom(x(τ) ) i=l,2,...,N[ηmax(tr,λ)], j=l, 2,...,N[ηmax(tr,λ) ] N[ηmax(tr,λ)]=#BG
max(tr,λ)>2 =Φ N[ηmax(tr,λ)]=l+2+3+...+ηmax(tr,λ)-l Vηmax(tr,λ)=2 => N[ηmax(tr,λ)]=l
Figure imgf000023_0004
A behavioral gene of the BG - set is a binary periodical function of a discrete argument τ. Here ηi is a period of the i-th gene, and 5 is its current phase; ηmax(tr,λ) is the biggest statistically stable period among the periods of the elementary behavioral functions. The ηmax(tr,λ) serves as a parameter of the set BG. The ηmax(tr,λ) is determined as a result of statistical analysis performed on the binary process decomposition (3.1) . This decomposition is defined on a representative interval [tq,tr], (λ»l) . Every binary process has its inherent behavioral genotype. In the case of a multi-dimensional system, each component of a vectorial binary process has its inherent behavioral genotype.
The most important fact about the set of behavioral genes is that this set is quasi-stationary relative to a character of change of two adjacent elementary behavioral functions in expression (3.1). Hence, the following expressions are competent:
x(τ)=x(tι),x(t2),...,x(tp) (3.3) V{x(ti)≡gj(ti),x(ti+ι)sgk(ti+ι)} => P{x(ti) ,x(ti+ι) }≥p° V{x(ti)≡gj(ti),x(ti+ι)≡bι(ti+1)} = P{x(tι) ,x(ti+1)}<p° gveBG, v=(i,k), bι£BG
Here, P{x(ti) ,x(tι+ι) } is a probability of the existence of two particular sequential elements x(ti) , x(tι+ι) in the binary process x(τ) . Consider the following fragment of the binary sequence.
Sequence Si: - +- +— +++- +- ++++- +- ++— +- +--
Here, the "+" and the "-" sign substitutes the traditional "0" and "1" language elements. We can observe 9 elementary behavioral functions in Si accordingly with expression (3.1) . For better visualization, the behavioral functions in sequence Si are separated from each other with a blank space. A sum of positive elements of the elementary- behavioral function represents the length of its "positive" part. A sum β of negative elements of the elementary behavioral function represents the length of its "negative" part. Hence, a variable η=α+β is a period of this function. The peculiarity of the BG-set is that the period of each member of this set belongs to the set of natural numbers beginning from the number 2.
The following notation is used in the present invention for a member of the BG-set:
Figure imgf000025_0001
i=l,2,...,N; N=#(BG) , where p corresponds to the positive part and n to the negative.
Thus, the following behavioral genes constitute the sequence Sι:
Figure imgf000025_0002
A normal form for a behavioral gene is when the positive part is observed first. The gene's current phase 05 is the amount of elements counted on the interval between its first positive element and the element that corresponds to the value of the gene's argument designated as a point of observation (t*) . For example, the gene 3p2n with the phase 05=1 has a normal view +++--. The same gene with the phase 05=2 has a different view ++—+. The complete mathematical description of the binary process behavioral genotype is as follows . gi(τ,σ5i,αi,βi,ηi)=He{αi-[τ+05i-l-ηiint( (d+τ+G5i-l) /η ] }- (3.4)
-He{βι- [τ+05i-l-αi-.ηilnt ( (d+τ+GSi-l-αi) /ηi) ] } i=l,2,...,N[ηmax(tr,λ)], N[ηmax(tr,λ)]=#(BG)
max(tr,λ)>2 => N[ηmax(tr,λ)]=l+2+3+...+ηmax(tr,λ)-l
Figure imgf000026_0001
Vz>0 =»He(z)=l, Vz≤O ==»He(z)=0, zeR de(0,l)
In expression (3.4), He(z) is the Heaviside's Step Function;
Int(z) is the Integer Function of the real argument zeR
[Mathcad3-0] .
Analysis of the binary process representation (3.1) and the properties of its behavioral genotype (3.3), (3.4) allows a conclusion that searching for an elementary- behavioral function containing a forthcoming binary process element must be performed among the members of the BG-set. It is observed in the present invention, that the probability P{x(tι) ,x(tι+ι) } of the existence of two particular sequential elements x(tι) , x(tι+ι) in the binary process x(τ) substantially increases if the BG-set transforms into a generalized genotype BG*. This increase is obtained by a union of the BG-set with the set C={c+(τ) , c" (τ)}:
BG* = BG C (3.5)
Each member of the C-set has the same range as the members of the BG-set. Each C-set member is a countable sequence of an identical element's state of the binary process under the condition of c+ (τ) =—ιc~ (τ) .
Identification of the behavioral genotype is a mandatory operation that executes prior to any predicting procedure. The BG-set identification can be either a stage of the predicting system design, or can be included in an algorithm of the automated predicting system.
2. Evaluation of the binary process instability level: Both retrospective and actual predicting procedures operate upon a set PF of predicting functions . This set is a product of a nonlinear operation PFS performed on the BG*-set. Hence, PF=PFS(BG*). For a correct selection of the PF-set members, the predicting method requires either the evaluation or the predetermination of the binary process instability level . It is maintained in the present invention that the cardinality of the set of predicting functions is inversely related to the evaluated binary process instability level; so that, for explicitly non-stationary processes it is true that PFcBG* . The retrospective predicting procedure is used for this evaluation. Unlike the prior art methods where model (1.2) of the retrospective predicting procedure is necessary for determination of the optimal predicting function, model (1.2) in the present invention is used for the binary process instability evaluation. That procedure is incorporated in the evaluating function φ(τ, tq, tr,PF)≡φ(τ) . This function directly provides the quantitative information about the efficiency of prediction performed on the interval [tq,tr], tr<tp. In addition, the evaluating function's output depends on the composition of the PF-set that is directly involved in prediction. Therefore, the function φ(τ) measures how unstable the binary process was if observed before the cycle of actual predictions . During the investigation of predicting methods, the authors of the present invention discovered that the more stationary the binary process is, the better the traditional genetic algorithms perform on prediction. Thus, the evaluating vector-function
φ≡ φ(τ)={φι(τ,tee) ,φ2(τ, tee) ,...,φn(τ,te,λe) } (3.6)
is used in the method; te is an evaluation schedule point, and ,λe=tr-tq is the length of the evaluation window. In general, parameters te, and λe may have different values for each component of the vector-function φ(τ) . A determination of the φ-vector's composition is a system design task. The formulas presented below, are the embodiments the authors of the present invention have used for the implementation of the method:
V∑[w(τ)]>0, φ(τ,tq,tr)≡φ(τ,te,PF)=Φ[R(τ) ,w(τ)], tr≤tp_ι (3.7)
Φ[R(τ) ,w(τ) ]=∑[R(τ) ]∑_1[w(τ) ]
V∑[w(τ)]=0 ==> φ(τ,tq,tr)=φ°
Vτ=(tι,t2,...,tp_ι), τ=ti => F(PF ti)=f (t+ι) (3.8) w(τ)=-.R(τ) f (τ)=x(τ) => R(τ)=l - correct prediction f (τ)≠x(τ) => R(τ)=0 - incorrect prediction.
It follows from expression (3.8) that each component of the φ-vector is obtained by applying a non-iterative retrospective predicting procedure F(PF,τ). According to definition (1.1), the retrospective predicting procedure's algorithm does not substantially differ from the algorithm for the actual predicting procedure. The difference between these algorithms includes two points. The first point is the value of the argument τ of the process x(τ) at the beginning moment of the prediction.
The second point is the retrospective predicting procedure (serving the binary process stability evaluation) employs an assignment of the PF-set's composition at the beginning of each predicting cycle. At the same time, the actual predicting procedure employs a selection of the PF- set's composition at the beginning of each predicting cycle. As an example of a possible embodiment, it is proposed that the first component φι(τ, te) in expression (3.6) estimates the efficiency of prediction when PF=BG* . One component of the φ(x) may also be estimating function (3.7) where the PF- set is a singleton {pfopt (x. tq, tr) } . In this case, the PF-set might be a product of prior art system (1.2) . In addition, the predicting method of the present invention can be implemented without the involvement of the binary process instability evaluation. In that case, a designer must be aware of the expected degree of binary.process instability or non-stationarity. Therefore, the initial composition of the PF-set in the cycle of the actual predicting procedures must be predetermined.
3. Performing the predicting procedure :
According to definition (1.1), the predicting procedures have the following mathematical representation: Vτ=(tι,t2,...,tp) , τ=tι = F[x(τ)]≡f (ti+ι) f (ti+i)
Figure imgf000029_0001
"correct prediction" f(ti+ι) - actual prediction ti<tp => f (ti+i) - retrospective prediction
Here, ti is the beginning point of performing the prediction; tp is the latest observed value of the binary process discrete argument. For the purpose of generalization, t* will further denote the beginning point of performing the prediction. If t*<tp then the retrospective predicting procedure is active; if t*=tp then the actual predicting procedure is active.
It was stated in the method's general description, that the procedure has a cyclic nature and includes two stages . A starting point (tc) for the next kth cycle is when an error er(tck) of prediction occurs, i.e., 3tck≡t*eτ, f (tck+ι)≠x(tck+ι) => er (tck) =true. The first stage is for selection of the set
Figure imgf000030_0001
, (k=l,2,„.) of active in the kth cycle predicting functions pfι,k(τ,05ι,ηι,k) ePFk. Here, G5ι is the current phase, (1=1, 2,..., Ik) , Ik=#(PFk) , (j=l,2,...). The PFk-set exists in multiple alternate versions, so that PFkcPFS(BG*j) . The composition of the PFk-set is controlled by a function υ(φk) . This function is responsible for analysis of the current stability evaluation data. The selection law is as follows
3υ(φk)sυk m = Z-X((pk,i,(pk,2,...,<pk,n) , ψic-≥O, (i=l,2,...,n) , (3.9) VPFk,iClPFS(BG*j), υk m = φk,i =* PFk=PFkri
The MAX - function here is the relational algebra aggregate function returning a maximum value from a sequence of values [R. Elmasri and S. Navathe, 1994]. The proposed selection law allows a predetermination of the set PF by requiring φk,i>φ°. The following rule controls the PF-set selection if the process x(t) is explicitly non-stationary:
k m = φk,g(PFk,g=BG*j)
Figure imgf000031_0001
(k,g)>(BG*j) (3.10) Here, the symbol σ<Coπdition> ( ) denotes a relational algebra operator "SELECT" [R. Elmasri and S. Navathe, 1994] . An interval Δτ= [t(C_λ») , tc] , (λ'≤λ, tc - the starting point of the kth cycle of predictions) , is a space marked on the binary process history for the determination of the PF-set elements . This interval must cover at least one elementary behavioral function in binary process decomposition (3.1) . The selection condition includes a common part and a specific part. The common part is that:
PFk≤BG*j, Ik≤Nj, Ik=#(PFk) , Nj=#(BG*j) (3.11)
Vpfi(τ,G5i,ηi)ePF ,
Figure imgf000031_0002
(3.12) Vl= (l,2,...,Ik) , tck≡t* 3tckeτ, τ=tck => er(tck)=true
Property expression (3.11) points at the fact that each predicting function used for a non-stationary process prediction belongs to this process' behavioral genotype. Property expression (3.12) declares that at the beginning (X=tc) of the predicting cycle, the state of each predicting function is the same as the state of the binary process' element x(tc) .
The specific part of the PF-set selection condition depends on the peculiarities of the object of prediction. A determination of this specific part is a system design task. The authors of the present invention have found effective the following embodiments of the specific part of the PF-set selection condition for non-stationary binary processes:
Embodiment 1
1. The set C={c+,c"> always belongs to the PF-set;
2. In addition, the PF-set includes each element gi of the BG*-set that can be selected on the binary process historical interval Δτ and:
• Whose period ηi is equal to the parameter ηmax of the BG*- set. Such predicting function is called the Senior
Predicting Function;
• That can be distinguished as a completed elementary behavioral function, i.e., 3η, τeΔτ = b(τ,η)=gι. Such predicting function is called the Explicit Predicting Function;
• If any explicit predicting function can be described by a code ( pβn) where α=(2,3) and/or β=(2,3), then all other predicting functions with such combination of α and β are added to the initial one and all of them belong to the PF- set. Such a predicting function is called, respectively, the Pair Predicting Function, or the- Triple Predicting Function. Therefore, for any binary element's state denoted by s, it is true that (ls2—is) ==> (2s2-.s) , (2s2-ιs) = (2sl-ιs) , (ls3-.s) => (2s3-ιS) v (3s3->s) , (2s3-ιs) = (ls3-.s) v (3s3-.s), (3s3-,s) => (ls3-<s) v (2s3-ιS) ;
• If there is a sequence of two or three identical binary process elements adjoining to the beginning point of a predicting cycle, then each predicting function characterized by a corresponding identified sequence parameter α or β belongs to the PF-set; • If b(τ,η) =gι≡(lpln) , then such a predicting function is called the Unit Predicting Function.
Embodiment 2 :
(This is a more "risky" solution) 1. The set C={c+,c~} always belongs to the PF-set;
2. In addition, the PF-set includes each element gi of the BG*-set that can be selected on the binary process historical interval Δτ and:
• Can be recognized as an explicit predicting function; • Can be recognized as a pair or triple predicting function;
• If there is a sequence of two or three identical binary process elements adjoining to the beginning point of a predicting cycle, then each predicting function characterized by a corresponding identified sequence parameter α or β belong to the PF-set.
It should be noted that many variants may be found when synthesizing a composition of the PF-set. The present invention pretends to the fact that every PF-set realization being employed for the prediction of a non-stationary binary process must posses the described above common expressions (3.11) and (3.12) and some specific properties.
The second stage is for prediction directly. The prediction f (ti+i) of the kh predicting cycle is returned by the operator F acting upon the set PFk of predicting functions such that:
Vτ=(tι,t2,...,tp) , τ=t*≡t± = F[x(τ) ,tι]=f (ti+ι) (3.13) F[x(τ) ,ti]≡F(PFk,ti)=f [x' (ti+1) ,y(ti+ι)] y(ti+ι)=l => f (ti+x)=x' (ti+ι) y(ti+ι)=0 => f (ti+ι)="nof" - no forecast x' (ti+ι)= F[x0(ti+1)]=Fx[PFkk(ti),ef (ti),ε(ti),φ(ti+ι)] (3.14) y(ti+ι)= Fy(PFk)
Expression (3.13) includes a model x' (ti+i) of a state of the binary process' forthcoming element, and it also includes a binary indicator y(tι+ι) that permits the prediction. The expression (3.14) reveals a structure of the model x' (ti+i) . Here, Ek(ti) is a predictions error vector. This vector contains information about the error status of each member of the PFk-set at the point tι=t*; ef (ti) is a current efficiency of prediction; φ(tι+ι)= {ξ(tι+ι) , ζ(tι+ι) } is a vector of binary indicators modifying the predicting algorithm.
The model x' (tp+ι) of the binary process' forthcoming element employs the Natural Selection Algorithm in the way that each member of PFk participates in the current prediction cycle until this member produces an incorrect prediction. Each pfj (τ,G5j,η-j)ePFk, (j=l,2,...,J) , J=#(PFk) , may again participate in the prediction only in the next predicting cycle. The model x' (ti+i) is a product of a nonlinear transformation of a fundamental model x°(ti+ι), so that
Figure imgf000034_0001
The prediction f (ti+i) can be halted or the fundamental model ' s output can be inverted depending on the values of ξ(tp+ι) , ζ(tp+ι) , and ef(tp). The complete mathematical description of the second stage of the predicting algorithm is presented below in the form of recurrent operator equations of Boolean variables.
Figure imgf000035_0001
Figure imgf000036_0001
The most important case where the present invention might be embedded, is a non-stationary (chaotic) binary process sequential prediction. Therefore, such case needs a more detailed description.
Let there be a binary sequence S2 wherein,
10 12 14 16 18 20 22 24 26 S : - + - - - - + - + - + - + + + + - + + + + + - + + - .
1 2 3 4 5 6 1 8 9 11 13 15 17 19 21, 23 25
In this case, it is assumed that at the initial point τ=tck of the kth predicting cycle, the set of predicting functions PFk=BG*, # (PFk) =15. It is also given that the moment tck corresponds to the seventh element of sequence S2. To make the predicting procedure observable, each member of the PFk-set is placed in its own line right under sequence S . This illustration is depicted in Fig.3.
The following conventions are present in the above illustration. Prediction by the PF-set = BG-set, #(BG)=15; R - Correct Prediction, W - Incorrect Prediction. Each PFk-set member is also shown beginning with the sequence's eighth element. This drawing makes a clear vision of the mechanism of prediction. Prediction is not allowed until a conjunction of the predicting functions has released the prediction. Then, the Natural Selection Algorithm is applied to the PFk-set. The function pfι[τ,ηι]≡(lpln) , which is the winner in the first cycle of prediction, becomes the outsider in the next cycle. The leader in the second cycle is pfi5[τ,ηi5]≡(5pln) . Each member of the PF-set has its own initial phase 05 (tc) that is calculated at the beginning moment of the predicting cycle. It is possible to see that the behavioral genotype (BG*) itself can not be used as the set of predicting functions in many cases with non- stationary binary processes. For example, the binary sequence S consists of the following 6 completed elementary behavioral functions: bι=(lp4n), b2=b3=b= (lpln) , bs=(4pln), and b6=(5pln). The replacement of identical functions b3, b4 as well as the replacement of function be, which is almost identical to b5, makes the selection for this example, BG*- set, inapplicable for a prediction. The PF-set having an abundant number of members causes a frequent blocking of the prediction with an absence of correct predictions in the predicting cycle. On the other hand, neglecting most of the elements in the composition of the behavioral genotype leads to an increase in the number of prediction errors with simultaneous contraction of the predicting cycle. The first stage of the predicting algorithm designed for the determination of the PF-set' s composition at the initial point of the predicting cycle is of great importance. A convincing example of applying Embodiment 1 and Embodiment 2 to the prediction of the sequence of a binary game random outcome is depicted in Fig.4. The following conventions are present in the above illustration: inv. - inversion predicting mode and dir. - direct predicting mode.
4. Updating the behavioral genotype membership and re- estimating of the binary process instability level; The end-point of a kth current predicting cycle and the beginning-point of the next predicting cycle is the same point. At this moment, two actions might be taken. The first action is a re-estimating of the binary process instability level . The second action is a recalculating of the BG-set membership. Both actions are subordinate to some schedule. The schedule is a part of the method's implementation algorithm. One possible embodiment the authors of the present invention used for prediction of the explicitly non- stationary binary processes updates the BG-set after several adjacent behavioral functions appeared in decomposition expression (3.1). The same algorithm re-estimates the binary process instability level accordingly with a schedule that is functionally dependent on the beginning of a predicting cycle. The particular schedule selection depends on the object of prediction and may be determined during the method's implementing system design or to be a product of an adaptive scheduling subsystem incorporated in such an implementing system.
The method of prediction described above increases the efficacy of the binary process prediction. This method expands the applicability of cognitive predicting systems in the field of non-stationary processes. The principal advantage of the method is a more intensive use of the most recent developments in the binary process domain. Contrary to the prior art, the present invention does not demand to be in the zone [tp/tp+w], (w»l) of the guaranteed binary process stability. The iterative optimizing "Errors and
Trials" genetic algorithm is not included in the predicting procedure of the present invention. This fact makes it possible for the application of the present invention to a population of real - time systems. The present invention can be incorporated in any system that permits mapping of at least one of the system's outputs on the space of binary processes.
Each step of the predicting algorithm is associated with a certain block or with a combination of blocks in the predicting system's block diagram. The predicting system that represents the method's embodiment is described in detail below. The predicting system has a two level hierarchy. The first level is a subsystem (SSi) for the behavioral genotype identification. The second level is a subsystem (SS2) for the sequential prediction of a binary element's state in the binary process. The global input of the predicting system is an output of the object of prediction.
The real object of prediction may have a continuous output. Let this output be denoted as u(t)eU. In that case, the binary process x(τ)eX is a result of a mapping of the set U of continuous functions into the set X of discrete binary functions. The system includes a Binary Process Mapping Block (BM) that transforms output u(t) of the object of prediction into the binary sequence x(τ) , τ=tι,t2,.... The BM-block quantifies, if necessary, the signal u(t). The quantification may be performed through a time sampling procedure and/or an amplitude qualification. In total, the output of the BM-block is a binary vector-function x(τ) of the discrete argument τ= (ti, t2, ..., tp) , where tp is the latest observed value of τ.
Consider some typical examples . Assume that an analog positive signal u(t) is an output of the object of prediction. Obtaining a single binary process x(t) from the signal u(t) includes the following steps:
• Quantification by-time of the signal u(t) ; Vu(t)>0, u(t)eU = u(τ)=u(tι) ,u(t2) ,...,u(tp) (3.31) ti+ι=ti+λ, i=l,2,...,p
• Set up a value u°>0 , u°eU so that :
Vu°, [u (ti) -u°] >0 = x (ti) ="l" v " + " (3 .32 )
Vu°, [u (ti) -u°] <0 => x(ti) =" 0" v "-"
The value u° is a single quantizing level. An assignment of a vector u°= (u°ι,u°2, ...,u°m) , u°c-U of such levels makes possible to get several binary processes x(τ) for the same input signal u(t). Here, each component of the vector x(τ) is a product of this two-step (3.31, 3.32) procedure. Let us denote this procedure by B ≡ B(λ,u°) : u(t) → x(x) . Here, the parameter λ defines the sampling rate of the quantification. The examples of such mappings are shown in Fig.5. Every component of x(τ) is processed by a separate identical tract in SSi, and then the data from that tract come to a corresponding tract in SS2. With a view of a simplification, all descriptions will be further provided for a single component of the vector x(τ) . A block diagram of the one-dimensional predicting system is shown in Fig.6. Subsystem SSi: The main objective of subsystem SSi is to determine a composition of the behavioral genotype set. The SSi-subsystem provides such determination on a periodical basis. Subsystem SSi is comprised of a Binary Process Mapping Block (BM) , a Binary Process History Storage Block (H) , a Behavioral Genotype Creator (BG) , a Sampling Block (S) , and a Binary Process Shortest History Storage Block (HS).
The H-block memorizes the state of each sequential element of the process x(x) that comes from the BM-block, and forms a binary string h[x(τ) , tq, tp]≡h[x(τ) ] . The storage space of the H-block depends on the object of prediction's peculiarities and must be determined during the system design. The string h[x(τ) ] goes to an input of the BG-block and to an input of the HS-block. The latter creates a binary string hs [x(τ) , ts, tp]≡hs [x(τ) ] , s≤q. The BG-block makes a decomposition expression (3.1) of the string h[x(τ)] on the interval [t(r_λ) , tr] , tr≤tp. The ordering number j of the sample's length λj is linked to the value tr when the decomposition has been initiated. The Sampler in subsystem SSi local feedback controls the value of λj according to a criterion of robustness, (e.g., the stability of the sample mean, or both the mean and the standard deviation) of the biggest elementary behavioral function's period ηmax(trj)≡ηj max taken from the sample. The ηjmax variable is a substantial parameter of the predicting system. It follows from expression (3.4), that T|jmax defines a cardinal number of the BGj-set. Any methods of statistical analysis are allowed at this stage. A human operator may also set up the value λj . The BG-block generates members of the BG*j-set by formulas (3.4), (3.5). The j- index in the behavioral genotype notation points to the fact that this set is going to be updated according to some schedule. The BG*j-set's composition data is a main output of subsystem SSi. Information about the BG*j-set's membership comes to the inputs of each Selector of the Predicting Functions of subsystem SS2. The binary string hs [x(τ) , ts, tp] goes from an output of the HS-block to another input of the PFS-block of SS2. The BG-block receives a feedback signal from SS2 - This signal controls the updating schedule for the BG*-set.
Subsystem SS2: The main objective of subsystem SS2 is selecting the set of predicting functions from the BG*-set and then, performing a prediction. Subsystem SS2 has some distinctive singularities :
First, the subsystem involves a cyclic, non-iterative, and non-optimizing method of prediction.
Second, the subsystem employs the binary process instability evaluation for a selection of an appropriate set of predicting functions at the initial moment of a predicting cycle. The evaluation may, but not necessarily involve traditional genetic algorithm schemes .
Third, the subsystem insures that the cardinality of the set of predicting functions is inversely related to the evaluated binary process instability level, or_transient effects on predictability, so that, for the explicitly non- stationary processes PFk-ΞBG*j .
Subsystem SS2 is built from the Selectors of Predicting functions (PFSi) , Predicting Blocks (Pi) , and Binary Process Instability Estimators (Ei) , i=l,2,...,m. Subsystem SS2 is comprised of two contours. The first contour is the main contour of SS2. This contour includes a tract PFS —» P that is responsible for the selection of the set PFk≡PF(tc,k) =PF(BG*j) of predicting functions. These functions are only active in the current kth predicting cycle. The PFk-set is an output of the PFS-block. The actual prediction f (τ) is the first output of the P-block of the main contour.
The second contour evaluates the binary process instability level. The second contour is comprised of several parallel channels . These channels have an identical structure such as PFSi — Pi — Ei. Each channel generates a respective component of the estimating vector-function φ(τ,te), which is defined by expressions (3.6)-(3.8). Evaluation is performed by application of the retrospective predicting procedure to some interval [tq,tr], tr≤tp of the binary process history. Here, te is an evaluation schedule point.
The second output of the P-block of the main contour is the indicator er(τ) defined by expression (3.20). This indicator signals to the exterior of subsystem SS2 about the end of the current cycle of actual prediction. The BG-block of the subsystem SSi takes into account the state of such "End-of-Cycle" indicators and uses this information for scheduling of the next update of the BG*-set. The er(τ) signal is also used by SS2 to perform the next instability evaluation of the binary process . A link between the P-block of the SS-subsystem and the BG-block of the SSi-subsystem closes the global feedback in the predicting system. Depending on the system's embodiment, a human operator of the predicting system may update the schedules, as well as the setup parameters for the binary process decomposition and subsequent statistical analysis of the elementary behavioral functions. The possibility of the human operator's involvement is reflected in the block diagram of the predicting system as the second input of the BG-block in SSi-subsystem and as the first input of the PFS-block in SS2- subsystem.
Predictions performed during a predicting cycle are independent of the evaluation procedure. Each of the three main procedures in the system (the determination of the behavioral genotype, the evaluation of the binary process instability, and the selection of the set of predicting functions, which are active in the current predicting cycle) can be performed independently and do not affect the system's speed. The method allows performing real time predictions of binary processes, including non-stationary processes, regardless of possible speed and memory limitations of computing resources.
The predicting system that implements the method increases efficiency of any entity that includes this system as a subsystem.
To further demonstrate the efficiency of the predicting system, we embedded the subject system into several systems. Each of these systems represents their class type. The utilization of the present invention as a subsystem of any of the "client systems" returns a substantial immediate effect.
Application 1.
The Measuring System with Prediction of the Signal-to- Noise Ratio.
Let there be a measuring system that measures a value φ(t) . The system's block diagram is shown in Fig.7. The following conventions are present in the above illustration: f (D. ξe) - Filter's Operator Q [D, ξ, Sf (t) ] - The Operator of the Remaining Part of the Measuring System u (t) - useful input signal y (t) - additive noise v (t) - output signal
There is a signal s (t) =u(t) +y(t) at the system's global input. Here, u(t) is an unknown useful signal that reflects the value φ(t) . The signal y(t) is an additive noise. The signal v(t) is the measuring system's global output. For example, let us assume that the system is comprised of an analog filter represented by a polynomial Wf(D,ξ£) of a linear differential operator D=d/dt. The vector of the filter's parameters consists of a gain factor Kf and a vector Tf of time-dimensional constants characterizing the filter's dynamics, so that
Figure imgf000045_0001
The remaining part of the system might be described in general by a nonlinear operator Q[D,ξ, sf (t) ] , D≡d/dt. The signal sf(t) is the filter's output sf (t) =Wf (D,ξf) s (t) . A multiplicative disturbance also might exist in the system. In that case, the vectors ξ, and ξ of the system's elements should be time domain functions, so that ξf=ξf(t), ξ=ξ(t) .
A common way of how measuring systems evaluate an extraneous disturbance is to estimate a signal-to-noise ratio defined as p(t)= (output due to signal) / (output due to noise) [B. G. Kuo, 1991]. The low p(t) indicates that the system is unable to produce an accurate measurement. A traditional approach for the noise rejection is filtration. However, no filter of any kind can produce a total noise rejection. Thus, the system's filtering ability bounds the accuracy and the precision of the measurement. The present invention provides a new powerful solution for a problem of additive noise rejection and for a problem of multiplicative disturbances compensation in measuring systems. The new approach works well in those cases where the traditional methods fail. The solution is based on a measuring algorithm that returns each resulting measurement Vj≡v(tj,λj) by an aggregation of a string of controllable sub-measurements. The tj is the jth moment of the discrete time when the resulting measurement is done; the λj indicates the length of such measurement. The sub-measurement μj,i≡μ(tj,i,λj,ι) of the measurement v(tj,λj) is a specifically selected output of a measuring block-procedure. The measuring block-procedure θ,isθ(t,i,λ,ι) is a completed measurement associated with an index number (i) of each repetition of the measuring algorithm.
In general, the measuring algorithm performs transformation of the continuous signal-to-noise ratio value p(t) into a binary process x(τ) according to formulas (3.31 and 3.32) so that x(τ) =B(p(t) ) . Each element x(tι)ex(τ) is an evaluation of the signal-to-noise ratio taken at a moment ti of the discrete time τ=tι,t2, The evaluation formula is similar to formula (3.32) where u(t) and u°(t) are substituted respectively with p(t) and p°. Then, to get the noise rejected, the jth outcome measurement v(tj,λj) needs to be organized as an aggregate function A of a sequence of those sub-measurements, i.e.,
v(tj,λj)=A[μ(j,i),μ(j,2),..., μ{j,m)] (3.33)
Vi=l,2,...,m => μ(tj,i,λj,i)=χ(tj,i)-θ(tj,i,λj,i) (3.34)
Figure imgf000046_0001
Here, the measuring block-procedure θj,ι is executed regularly at each moment tj,i and does not depend on the process x(τ) . Parameter λj,i is the duration of the procedure θ(tj,i,λj,ι) . Function χ(tj,ι) is a numerical conversion of the prediction f (τ) of the binary process x(τ) at the moment τ=tj,ι. Thus, the sub-measurement Vj,ι accepts a value of the measuring block-procedure μj,i only if such action is permitted by control function %j,i% .t-j.i) .
The measuring block-procedure may have a rather complex algorithm. However, it follows expression (3.35), that an interval between two adjacent measurements (V , Vj+i) is defined by a sum of the duration of each measuring block- procedure that is involved in the current measurement. Number m of such procedures can be predetermined or can be calculated by the system itself based on a criterion of a desired accuracy, and so forth. The same approach is used for the multiplicative disturbance rejection. Once the prediction of the signal-to-noise ratio has indicated "low", the measuring system automatically switches to a multiplicative disturbance compensation mode. Information about measured value φ(t) is locked in "this mode. A testing noiseless signal goes to the system's input instead of signal s(t). This signal is used for the adjustment of the system's drifting parameters. Thus, the measuring system with the signal-to-noise ratio prediction mostly accumulates data with a low noise component.
Here is a justification of such a measuring system. The block diagram of this system is depicted in Fig.8. The following conventions are present in the above illustration:
IS - Input Switch
MBP - Measuring Block-Procedure Subsystem
MCB - Measuring Process Control Block
P - Signal-to-Noise Ratio Predictor
AGB - Aggregation Block u(t) - useful input signal utst(t) - Noiseless testing signal y(t) - Additive noise
Vj(t) - j-th measurement x(τ) - signal-to-noise ratio binary evaluation process f (x) - Prediction of an element of the signsl-to- noise ratio binary evaluation process θ(t) - Measuring Block-Procedure output μ(τ) - Sub-measurement's output χ(τ) ~ Working mode control signal
The system is comprised of a Measuring Block-Procedure Subsystem (MBP) , an Aggregation Block (AGB) , a Signal-to- Noise Ratio Predictor (P) , and a Measuring Process Control Block (MCB) . The input of subsystem MBP is either informative signal s(t) (if the system. orks in the measuring mode), or testing noiseless signal ust(t) (if the system works in the adjustment mode) . The subsystem MBP produces a measurement θ(τ), τ=tι, t2, ..., tm which is an output of the measuring block-procedure. Another output of subsystem MBP is binary process x(T) or binary vector- process x(τ) , which is the binary evaluation of the signal- to-noise ratio. Signal x(τ) goes to an input of the predictor. Predictor P generates a prediction f (τ) of element x(τ) corresponding to a forthcoming result θ(τ) of the measuring block-procedure. The MCB-block produces output signal χ(t) that simultaneously controls sub-measurement's value μ(τ) . If the forecasted level of the p(τ) is high, the sub-measurement μ(τ) has some value and is accounted in the jth measurement Vj . If the forecasted level of p(τ) is low, sub-measurement μ(t) is not accounted in the jth measurement Vj.
The static accuracy (A) of the measuring system may be evaluated as follows:
3φ*≡constant, Vφ(t)=φ* = A=d2/vav 2 (3.36) Here, d denotes the standard deviation from a sample of the measuring system's discrete output v(τ) ; vav denotes this sample's mean. With an assumption that the aggregation function A in formula (3.33) is the relational algebra AVERAGE-Function, formula (3.36) can be rewritten in a way that:
Figure imgf000049_0001
sn"^{[mj-^x(tj,i)-0(tj,iA,i)]-vav}2/vav 2, (j=l,2,..., n)
It follows the system block diagram that the signal p (t) can be determined by the formul :
Figure imgf000049_0002
s(t)=u(t)+y(t)
sf(t)=Wf(D,ξf)s(t) (3.39)
u(t)eϋ, φ(t)eΨ, U~Ψ (3.40) D≡d/dt Both signal s(t) and Sf(t) in expression (3.38) are accessible. Signal p(t) can also be obtained by measuring the noise component involving a separate channel of MBP. In that case, the noiseless testing signal is employed, and a correlation between the actual noise y(t) and the noise measured at the separate channel must be proved.
In order to calculate the system's static accuracy, the value of the measured variable φ(t) should be constant, so that φ(t)=φ*≡constant => u(t) =u*≡constant. Therefore, formula (3.39) transformes to:
Figure imgf000050_0001
Therefore, the ih sub-measurement of the jth measurement can be described as follows :
Figure imgf000050_0002
θj,isθ(tj,i,λj,i)=δ(t-i-λj,i)-θ(t)
e(t)=Q[D^,Wf(0,^)u*+Wf(D,^)y(t)]=- (3.43) ≡vav+Q[D,ξ,Wf(D,ξf)y(t)]≡Vav+Q[γ(t)]
3λeR, t-i-λ=0 δ(t-iλ)=l, i=l,2,... Dsd/dt
The Congruent Sign, w≡" , in expression (3.43) appears only in cases of a strong non-linearity of operator Q[D,ξ, Sf (t) ] , which represents the post-filter part of the MBP-block of the measuring system.
It is observed in every effective measuring system that Wf(0,ξf)u* → Kfu* and Wf (D,ξf)y(t) « Kfu* . Hence, it follows from expressions (3.38), (3.41) that: p(t)=p' (t)=u*/y(t) (3.44)
For the purpose of coarse evaluation of the measuring system's accuracy, Congruent Sign will be further substituted with Equal Sign. Substitution of expression (3.43) by expression (3.44) allows, in combination with expressions (3.37) - (3.42), seeing how the Signal-To-Noise Ratio influences the system's measuring accuracy:
V|p'(t)|>0 =» θ(t)=vav+Q[u*/p' (t)]
Figure imgf000051_0001
ω ,i≡ω,i[u*,p' (t) ]=l+δ(t-i-λj,i)Q' [u*/p' (t) ] Q' [u*/p' (t)
Figure imgf000051_0002
(t) ] V|vav|>0
It follows from expressions (3.31) and (3.32) representing the binary process x(τ) , that each time when the prediction of indicator p' (τ) is correct, the absolute value of variable ©j,i is less than ω°>0; and when the prediction of indicator p' (τ) is incorrect, the absolute value of variable α>,i is greater or equal to ω°>0. Mark the former case with (ω°-g) , g>0. Respectively, the mark for the later case is (ω°+g) . Now it is possible to see how the efficiency of the Signal-To-Noise Ratio prediction relates with the accuracy of the measuring system:
A=n_1∑[(l/1+Φj) (ω°+g) + (Φj/l+Φj) (ω°-g)+l]2 (3.46)
Φj≡Φ(er(τ) ,ιrij) =∑-,er (τ) /∑. er (τ) V∑er(τ)≠0 Φ(er(τ) ,mj)=φ° V∑er(τ)=0 τ=(tj,ι, tj,2,...,tj,k) , k=mj; j=l,2,...,n
Here, er(τ) is the prediction method's error described in expression (3.20). Discrete time τ characterizes sub- measurements of the jth measurement.
Expression (3.46) shows that by having the effective predictor in the measuring system, the possible low noise component in the current measurement, is Φ times greater than the possible high noise component, Φ>1. The approach explained above was proven experimentally.
The sample of digital output of an ultrasonic distance meter was used in a computer simulation of the predictor.
Illustrations of the results for this trial are shown in
Fig.9. The graphical material presented herein is self- explanatory and does not require comments .
Application 2.
The System with a Compensation of Nonlinear Effects by Means of Prediction:
There are many measuring, control,- data transferring, audio/video, etc., systems that suffer from harmful nonlinear effects. For example, a measuring system with a receiving filter that loses its ability to transfer signals each time when an input signal exceeds some threshold. This is called a Filter's Saturation. The receiving stage of such a system is comprised of a preamplifier and a filter. The mathematical model of these devices may contain the following expressions :
Vsmax>0 , | s (t) | <smax => sf (t) =KaWf (D, ^) s (t) (3 .47 )
Vsmax>0 , | s ( t) | >smax => sf ( t) =V s ( t) =u (t) +y(t)
Here, value V is the filter's power supply voltage; value Ka is the preamplifier's amplification factor. The method of the present invention can be employed for a prediction of the moment of the possible filter's saturation. Then, the sub-measurement containing saturated filter would not be accounted for in the current measurement similar to what was presented in expressions (3.33) - (3.35). To get that algorithm suitable to the current problem, the multiple-level quantification should be involved.
Consider the following example: The fragment of the s(t) oscillogram is shown in Fig.10. Signal s(t) is a continuous function of time. This signal is quantified by 5 amplitude levels s(I)<s( ι:)<s<:ι: ι:)<s(IV)<s(v) . Assume that the saturation threshold smx is associated with the fourth quantizing level s(IV). The quantification of the signal s(t) at these levels is performed according to procedures (3.31 and 3.32) where u° is substituted with respect to each quantizing level. The result of such actions is five binary processes xk(τ) , k= (1, 2, ..., 5) .
The analysis of these processes allows an observation that if there is no chance to predict a moment when the continuous signal s(t) exceeds the saturation threshold Smaχ≡s(IV> , process x3 (τ) of the lower quantizing level s axι) can be used for the prediction. The elementary behavioral functions of process x3(τ) encircle the moment of saturation observed in binary process 4(τ). Therefore, to work out the effect of substantial non-linearity, we need to use a multidimensional predicting algorithm has to be invoked. The component with the highest predictability can be distinguished by evaluating each binary process xk(τ) , k= (1, 2, ..., 5) . The art of design is the establishment of the sufficient amount of quantizing levels in such a measuring system. Like in the previous application, a multiplicative disturbance can be rejected by switching the system's input from signal s(t) to a testing signal in order to adjust the system's unstable parameters. This switching has to be accomplished at the moment of prediction of the filter's saturation.
Application 3. The Technical Method for the Econometric Time Series Analysis:
The multi-dimensional version of the present invention can be used in econometrics known as the time series analysis. Let us show, for example, how to apply the method for technical analysis of the stock market time series . Let there be a time series, which is a 3-point moving average of the difference between the stock price "High" and the stock price "Low" . These variables are very popular in the field of stock market. The illustration is presented in Fig.11. There, Spread = (High - Low) . To get the time series ready for prediction by the method of the present invention, the procedure B(λ,u°) of expressions (3.31 and 3.32) should be applied. The time series Spread is already defined on the discrete time domain, i.e., the sampling rate λ is predetermined. Finally, the process Spread(τ) ≡u. (τ) >0 of the present example has the following mapping on the vector x(τ) :
Figure imgf000055_0001
Vtieτ => λ=ti-tι-ι ° = {u(1),u(2),...,u(n)> (3.49)
The object of the econometric analysis is to determine whether or not the particular time series belongs to some interval on its range. Define each quantizing level of (3.48) as such interval's upper/lower bound so that:
Vtieτ => u(tι)e (u<d),u(:i+:L)), j=l, 2, ...,n-l (3.50)
Therefore, every process u(τ) is linked to two binary processes Xj (τ) and Xj+ι(τ) according to statement (3.50). On the other hand, we could see in the previous example that there are cases when the fact that a forthcoming element of a binary process j (τ) will be "+"can not be determined with sufficient predictability. In terms of the predicting method's efficiency evaluation (3.7), it means that φj (t/ tq, tr) <φ* , φ*>l. At the same time, the predictability of the fact that the next element of the same process XJ (τ) will be "-" is much greater than φ* . Having this reasoning, we may state that there are opposite cases when the fact that a forthcoming element of a binary process Xj (τ) will be "-"can not be determined with sufficient predictability, and the predictability of the fact that the next element of the same process j (τ) will be "+" is much greater than φ* . In that instance, a set -j°={q(1) ,q(2) , ...,qtk)}oi° of quantizing levels needs to be created so that:
Q. =^<Locating Condition--* , (3.51) χ(τ)=
Figure imgf000056_0001
2(τ) ,...,xk(τ)}
Here, the <Locating Condition> is the following selection condition:
Figure imgf000056_0002
,W+(τ,tq,tr)]>φ* (3.52)
φ(-»v+1 (τ, tq, tr) =Φ [R- (τ, tq, tr) , W~ (τ, tq, tr) ] >cp* (3.53)
Rl(τ,tq,tr) - Number of correct retrospective predictions of the fact that the process x(τ)="i"
Wl(τ,tq,tr)=^Rl(τ,tq,tr), ι=("+","-"), φ*>l, v=l,2,...,k-l
Here, evaluation function Φ[Rl(τ, tq, tr) ,Wl(τ, tq, tr) ] is defined by formula (3.7) . Returning to the econometric example, in order to obtain a prediction of the event that the forthcoming value of econometric process u(τ) is going to lie in some of the intervals defined in statement (3.50), we should require the following:
Vtieτ → f[u(ti+ι)e(q(v),q(v+1))]=f+(ti+ι)& f"(ti+ι) (3.54) q(v)eq° fl(ti+ι)=x(ti+ι)="l" <=> "correct prediction"
!=(" +","-") , V=l,2,...,k-1 Quantizing levels q(v) or q(v+1) and corresponding binary processes xv or xv+ι in statement (3.54) are determined by expressions (3.52) or (3.53). In the case of evaluating the efficiency of prediction of the explicitly non-stationary time series, expressions (3.51, 3.52, and 3.53) may not be effective. Hence, algorithm (3.54) should be changed as follows :
Vtieτ => f[u(ti+ι)e(u(v),u(v+1))]=f+(ti+1)& f(ti+ι) (3.55) u(v)eu°
f x(ti+i) =x(ti+i) ="l" <=> "correct prediction" 1= («+","-") , V=l,2,...,n-1
Regarding the present example, six levels of quantification were established, and respectively six binary processes were created. The fragments of these processes are depicted in Fig.12. The protocol of predictions of the time series Spread(τ) being in the corridor ($1.25, $2.00), is shown in Fig.13. Estimation of such event's predictability was made by evaluation functions φ<+) (τ, tq, tr) and φ(_) (τ, tq, tr) for (tr-tq)=65. They have revealed the upper bound, φ(_)=18.7; and the lower bound, φ<+)=3.18.
Application 4.
The Multi-Channel Data Acquisition System with the Most Informative Channel Prediction:
Consider a data acquisition system, which is basically comprised of several sources of data, transmitters that deliver data over some media or through an interface, receivers, and signal/data processing devices. Each informative channel experiences some interference existing in the form of additive and/or multiplicative disturbance. Typically, one or more channels demonstrate a lesser level of disturbance in comparison with other channels of the system if observed at any moment in time. In case of a necessity of receiving the correct data with each transaction, a prediction of the next channel free of disturbance can be performed by the method of the present invention. The approaches presented in the description of Application 1 and Application 2 are useful in accomplishing this objective. The data processing device may be switched to receive information that will be coming through the less disturbed informative channel . The method of the present invention allows a simplification of the error correction algorithms, and increases the memory capacity and the system's speed.
Application 5.
The Algorithm for Predicting the Quality of Schedule-Based Communication:
The cases that correspond with this application relate to those categories where the content of a message carries priority over the moment when the communication takes place. There are a number of such systems . An example could be a communication under a disaster condition. Here, the content of the message is vitally important, and the value of time spent for the setup of communication arrangement has a survival meaning as well. Another example could be a problem of a remote control of an object (a space ship, a nuclear power station, a chemical plant, etc.) with random failures. Providing a high quality cellular phone communication is also that kind of problem. The predicting method of the present invention is a possible solution for the problems listed above.
The following sketch-algorithm is an illustration of how the method of a binary process prediction can be used for improving the quality of the cellular phone conversation. This is accomplished by predicting and subsequently advising the user about the moment of best physical conditions of communications. Assume that there is a cellular phone network where each user is linked to the host station:
1. Before a connection.
Each telephone automatically responds to a time scheduled check-signal on the reserve frequency generated by the station. The responses are binary-classified by the good communication quality criterion and the users are respectively separated into two groups. Then, the forthcoming membership for both groups is predicted. A user may expect to receive an appropriate notifying message when attempting to contact any member of the "bad communication quality group" .
2. During a communication.
A continuous check - response dialog takes place between the host station and each communicator. This dialog is accompanied by the communication quality prediction. If a failure of some communication is predicted, then both participants may receive the notifying message.
We intentionally omitted, in the above algorithm, any details insignificant to the matter of the present invention. Such details include varying the "testing" and the "master" frequencies, type of massages, etc. This requires the proficiency in the technique of cellular phone communication.
However, an actual experiment was conducted in order to prove the idea. It is a known fact that a deterioration of the radiotelephone communication depends on landscape peculiarities and on the concentration of electrical lines. The typical urban area landscape details are buildings, road intersections with a number of electrical line nodes, and high voltage electrical transmitting lines . A car with one communicator talking via a cellular phone with his steady standing assistant was moving through the City of Boston, USA. The car's trajectory was traced on a map according to some sampling schedule. If at any discrete moment of the schedule a good quality of communication was observed, then the "+" sign was marked on the trace. If at any discrete moment of the schedule a poor quality of communication was observed, then the "-" sign was marked on the trace. An analysis of the observed data leads to a conclusion that an urban landscape may generate well predictable binary processes that can be used for the improvement of the quality of radiotelephone communication.
Application 6. The Computer-based Game Algorithm:
The present invention may be viewed as a computer- based game's algorithm where the human intelligence and the artificial intelligence compete. A human-player generates a binary string of elements of a finite length where a computer program must predict the forthcoming element ' s state. The number of correct and incorrect predictions is evaluated on at least one binary string length so that the human wins and respectively the artificial mind loses if some predetermined threshold is exceeded by the evaluation. In addition, a set of such evaluating thresholds and the predicting algorithm's internal parameters can be established by a human player to set a game to different levels of complexity. Thus, a different result in this game is expected depending on how skilled the human player is.
We can continue listing the examples unconditionally. Generally speaking, the present invention is applicable to any case where
• The mapping of some entity's characteristic on the space of binary processes is allowable
• The knowledge of the forthcoming element's state of that binary process is useful for making a conclusion or for performing an action.

Claims

CLAIMS :Having described our invention we therefore claim:
1. A method for predicting a state of a binary element in a binary process, said method being performed with the aid of computing means, said method comprising the steps of: providing a computer-readable medium including instructions for: forming a binary string for said binary process to obtain a history storage so that each new element of said binary process is an element of said binary string;
decomposing said binary string into structures of a minimal length to uniquely represent said binary string, said structures are built from opposed to each other adjacent sequences of identical states of said binary process element, such that a propagation of every said structure in both directions of said binary process domain returns a regular order;
selecting elements that are similar to said binary structures and may includes- said structures;
combining said elements into an initial set of elements;
evaluating said binary string instability level if said instability level is not pre evaluated;
generating a resulting set of elements which is built from said initial set of elements depending on the evaluated level of said binary string instability; sequentially predicting the state of forthcoming elements accumulating in a group in said binary string by applying an element vise predicting procedure acting upon said resulting set of elements;
updating said initial set of elements and reevaluating of said binary string instability level;
returning to the generating step of said method if additional predictions are needed;
whereby said sequential prediction of said binary element's state in stationary, quasi-stationary, and non stationary binary process is generated.
2. A method as claimed in claim 1, wherein:
said binary process may be a direct output of any entity, which is defined on a space of discrete binary processes; and
said binary process may be a mapping of any other than said binary process kind entity's output onto the space of discrete binary processes .
3. A method as claimed in claim 1, further including the step of:
generating said initial set of elements only if it is permitted by setting up an updating mode for said initial set to at least one of two binary components of a first permitting vector, said first permitting vector having a first component and a second component, said first component indicates a fact of said initial set predetermination, and said second component indicates a fact of beginning of creation of said initial set based on some schedule.
4. A method as claimed in claim 3, when at least one component of said first permitting vector is put to the updating mode for said initial set, further including the steps of:
determining a statistically stable said decomposing structures with a maximal period;
generating a first set containing all possible said decomposing structures including said maximal period structures, so that each element of said first set possesses the property of orthogonality; and
generating said initial set of elements via the union of said first set and a second set of two opposite to each other elements, whose composition is a countable sequence of the identical binary elements of said binary process.
5. A method as claimed in claim 1, wherein:
said element vise predicting procedure is a retrospective predicting procedure if said element vise predicting procedure is defined on an interval of said binary string domain which is antecedent to the latest observed element of said binary string; and
said element vise predicting procedure is an actual predicting procedure if said element vise predicting procedure is defined on an interval of said binary string domain which includes the latest observed element of said binary string; and
said predicting procedure is cyclic and each cycle is composed of two stages, and may contain several predictions.
6. A method as claimed in claim 5 , further including the steps of:
beginning each cycle of said predicting procedure at a starting point when an error of prediction occurs; and performing the first stage of each said predicting cycle through generation of a resulting set of elements by transforming said initial set into said resulting set, executed at the starting point of each said predicting cycle, so that a composition of said resulting set of elements depends on said evaluation of said current instability level of said binary string; performing the second stage of each said predicting cycle through a creation of a functional model of each forthcoming element of said binary process belonging to said current predicting cycle, and through a generation of a prediction permitting indicator, so that said prediction is an output of the Boolean conjunction of said model and said permitting indicator.
7. A method as claimed in claim 1 , further including the step of: evaluating said instability of said binary string only if it is permitted by setting up an evaluation updating mode to at least one of two binary components of a second permitting vector, whose first component indicates a fact of said evaluation predetermination, and whose second component indicates a fact of beginning of said evaluation based on some schedule.
8. A method as claimed in claim 7 , when at least one component of a second permitting vector is put to the evaluation updating mode further including the step of: performing said binary string instability evaluation through a calculation of an estimating vector function of predicting efficiency involving but not limited to a retrospective predicting procedure, which is specific for each component of said estimating vector function and is defined on said binary string domain.
9. A method as claimed in claim 8, wherein: said estimating vector function of predicting efficiency is a vector whose each component is an aggregation function of a sequence of outputs of said retrospective predicting procedure, which acts upon a specific for this component pre selected set of elements, which is a mapping of said initial set of elements; one of said pre selected sets can be said initial set itself; and any component of said estimating vector function of predicting efficiency can be predetermined to control the composition of said resulting set of elements .
10. A method as claimed in claim 6, further including the steps of:
determining the component of said estimating predicting efficiency vector function, that has an extreme value corresponding to the degree of the binary string stability; and selecting said resulting set of elements based on a composition of the set that corresponds to the extreme component of said estimating predicting efficiency vector function, such that each member of said resulting set possesses certain common and specific properties that depend on the object of prediction.
11. A method as claimed in claim 10 wherein:
said resulting set's common properties are
first, said resulting set is a mapping of said initial set;
second, the cardinal number of said resulting set is inversely related to the evaluated said binary string instability level; and
third, the state of each element of said resulting set is identical to the state of said binary string's element which is observed at the beginning of said predicting cycle.
12. A method as claimed in claim 10 wherein: said resulting set's specific property of any non stationary binary process is that said resulting set is a subset of said initial set.
13. A method as claimed in claim 10 wherein: said resulting set's specific property of some of non stationary binary process is that a resulting set ' s member is such a member of said initial set that can be observed on the interval closest to the beginning of the predicting cycle, and whose period is the maximal period among all members of said initial set observed on said interval; and
said resulting set's specific property of some of non stationary binary process is that a resulting set's member is such a member of said initial set that can be observed on the closest to the beginning of the predicting cycle interval, and can be distinguished as a periodic function containing its full period; and
said resulting set's specific property of some of non stationary binary process is that there is a relationship between at least one known member of said resulting set of elements and some other members of said resulting set related to said known member, such that for any binary element's state denoted by s, it is true that (ls2-.s) =>
(2s2-.s) , (2s2-ιs) => (2sl-.s) , (ls3->s) = (2s3-.s) v (3s3-ιs) , (2s3->s) => (ls3-ιs) v (3s3-ιs), (3s3-.s) => (ls3-.s) v (2s3-,s) , where the left part of each statement defines known member of said resulting set, and the right part of each statement defines all other members of said resulting set that are related to said known member; and said resulting set's specific property of some of non stationary binary process is that there is a relationship between a sequence of two or three identical binary process elements found on the binary process decomposition, which are adjoined to the beginning moment of a predicting cycle and some members of said resulting set related to said sequence of binary process elements, such that for any binary element's state denoted by s, it is true that 2s => (2s2-.s) v (2sl-ιs), 3s = (3s3-ιs) v (3s2-.s) v (3sl-.s) , where the left part of each statement defines said sequence of binary process elements, and the right part of each statement defines all members of said resulting set that are related to said sequence of binary process elements; and
said resulting set's specific property of some of non stationary binary process is that the first member of said initial set is a member of said resulting set, and both members of said second set are the members of said resulting set.
14. A method as claimed in claim 10 wherein: said resulting set's specific property of another non stationary binary process is that a resulting set's member is such a member of said initial set that can be observed on the interval closest to the beginning of the predicting cycle, and can be distinguished as a periodic function containing its full period; and
said resulting set's specific property of another non stationary binary process is that there is a relationship between at least one known member of said resulting set of elements and some other members of said resulting set related to said known member, such that for any binary element's state denoted by s, it is true that (ls2—is) = (2s2-ιs) , (2s2-ιs) = (2sl-ιs) , (ls3-.s) => (2s3-.s) v (3s3-.s) , (2s3-ιs) => (ls3-ιs) v (3s3-ιs), (3s3-ιs) => (ls3-.s) v (2s3-ιs), where the left part of each statement defines known member of said resulting set, and the right part of each statement defines all other members of said resulting set that are related to said known member; and
said resulting set's specific property of another non stationary binary process is that there is a relationship between a sequence of two or three identical binary process elements found on the binary process decomposition, which are adjoined to the beginning moment of a predicting cycle and some members of said resulting set related to said sequence of binary process elements, such that for any binary element's state denoted by s, it is true that 2s =>
(2s2-ιs) v (2sl-ιs) , 3s => (3s3-.s) v (3s2-,s) v (3sl-.s) , where the left part of each statement defines said sequence of binary process elements, and the right part of each statement defines all members of said resulting set that are related to said sequence of binary process elements; and
said resulting set's specific property of another non stationary binary process is that both members of said second set are the members of said resulting set.
15. A method as claimed in claim 6 wherein: said functional model of a forthcoming element of said binary process is a nonlinear transformation of a base model ;
said nonlinear transformation of the base model includes an inversion of said model's output based on a result of a conjunction of two binary components of a third permitting vector;
said first component of the third permitting vector is an indicator of the inversion mode initiation, and said second component of the third permitting vector indicates the beginning of said inversion when an output of a current predicting efficiency estimating function is within a specified distance of a predetermined threshold value, and the second component of said third permitting vector also indicates the end of said inversion if a new error of prediction is observed;
said base model is a union of those members of said resulting set that are allowed to participate in the base model; the allowance of participation in said base model includes that each member of said resulting set participates in the current cycle of predictions since the beginning of said cycle until this member produces an incorrect prediction, and this member may again participate in the prediction only in the next predicting cycle;
said prediction permitting indicator is a conjunction of three binary components of a fourth permitting vector;
said first component of the fourth permitting vector is an indicator of the prediction blocking mode initiation, and said second component of the fourth permitting vector reflects the fact of beginning of said prediction blocking mode when a value of said current predicting efficiency estimating function is within a specified distance of another predetermined threshold value, and the second component of said fourth permitting vector also indicates the end of said blocking if a new error of prediction is observed, and said third component of the fourth permitting vector is a conjunction of all members of said resulting set that participate in said base model.
16. A computing means implemented system for a sequential prediction of a binary element's state in a binary process, comprising:
a computer -readable medium residing in a computing means implemented system further comprising:
a first subsystem including means for determination of said initial set of elements;
a second subsystem including means for prediction of a binary element's state in a binary process;
computing and controlling means, which receive, process, transfer, and exchange information between said system' s elements and between said system and the environment thereof;
whereby said system implements a sequential prediction of any binary process and can be embedded in any entity that permits mapping of at least one of the entity's output onto the space of binary processes .
17. A system as claimed in claim 16 wherein:
said first subsystem is a plurality of channels, and each of said channels serves for the purpose of determination of said initial set of a corresponding single binary process;
said second subsystem is a plurality of channels, and each of said channels serves for the purpose of prediction of a binary element's state in a corresponding single binary process;
each single channel of said first subsystem transfers information about said initial set composition to each corresponding single channel of said second subsystem.
18. A system as claimed in claim 16 having said first subsystem further including:
means for mapping an output of an object of prediction into at least one binary sequence, means for binary process formation hereafter;
each single channel of said first subsystem comprising means for binary process history storage, means for creation of said initial set, means for data sampling, and means for binary process shortest history storage.
19. A system as claimed in claim 16 having said single channel of said first subsystem wherein:
said means for binary process history storage memorize each sequential element of said binary process coming to a first input thereof from said means for binary process formation; said means for binary process history storage, being controlled by an output of said means for data sampling, form a binary string at an output of said means for binary process history storage;
said binary string goes from said means for binary process history storage to a first input of said means for creation of said initial set, and said binary string also goes to a first input of said means for binary process shortest history storage, and a second input thereof receives information from the first output of said means for creation of said initial set, and said first output of said initial set is also connected to an input of said means for data sampling;
a second input of said means for creation of said initial set is a control input, that is external to the predicting system for a first component assignment of said first permitting vector;
a third input of said means for creation of said initial set receives information from said corresponding single channel of said second subsystem about the status of said error of prediction indicator to be used for the determination of a second component of said first permitting vector; and
said second output of said means for creation of said initial set is a second output of said single channel of said first subsystem, and the output of means for binary process shortest history storage is a first output of said single channel of said first subsystem.
20. A system as claimed in claim 16 having said second subsystem further including:
each single channel of said second subsystem comprising a main predicting contour including means for selection of main resulting set and means for actual prediction; and each single channel of said second subsystem comprising an auxiliary instability evaluating contour, which is a plurality of tracts connected to means for evaluating of the binary process current instability.
21. A system as claimed in claim 20 having said main predicting contour of said single channel of said second subsystem wherein:
a first input of said means for selection of main resulting set is utilized for determination of members of main resulting set, in case of external to the predicting system control;
the second input of said means for selection of main resulting set receives data from said means for binary process shortest history storage;
a third input of said means for selection of main resulting set receives data from said means for evaluating of said binary process current instability, so that said composition of the main resulting set depends on a value of said third input;
an output of said means for selection of main resulting set is connected to a third input of said means for actual prediction; a first input of said means for actual prediction is a control input for assignment of said first component of said third permitting vector in case of external to the predicting system control;
a second input of said means for actual prediction is a control input for assignment of said first component of said fourth permitting vector in case of external to the predicting system control;
a first output of said means for actual prediction is intrinsically a prediction of a binary element's state in the corresponding binary process;
a second output of said means for actual prediction is a binary indicator of said error of prediction that comes to said third input of said means for creation of said initial set of said corresponding channel in said first subsystem to be used for determination of said second component of said first permitting vector; and
said second output of said means for actual prediction also goes to each tract of said auxiliary instability evaluating contour.
22. A system as claimed in claim 20 having said auxiliary instability evaluating contour of said single channel of said second subsystem further including:
each said single tract comprising consecutively connected means for assigning an auxiliary resulting set, means for retrospective prediction, and means for analyzing of said binary process retrospective instability.
23. A system as claimed in claim 22 having said single tract of said auxiliary instability evaluating contour of said single channel of said second subsystem wherein:
a first input of said means for assigning an auxiliary resulting set receives information about the composition of said initial set of elements from said second output of said corresponding channel of said first subsystem;
a second input of said means for assigning an auxiliary resulting set is a control input for assignment of said first component of said second permitting vector in case of external to the predicting system control;
a third input of said means for assigning an auxiliary resulting set receives information about the status of said error of prediction indicator to be used for determination of said second component of said second permitting vector;
an output of said means for assigning an auxiliary resulting set contains information about a composition of said auxiliary resulting set, which is tract specific; and
said means for retrospective prediction performs said retrospective predicting procedure acting upon elements of said auxiliary resulting set, so that information about each correct and each incorrect prediction is aggregated by said means for analyzing of said binary process retrospective instability, whose output is a quantitative evaluation of said corresponding binary string instability, which is also an input of said means for evaluating of said binary process current instability.
24. A system as claimed in claim 20 having said auxiliary instability evaluating contour of said single channel of said second subsystem wherein:
said means for evaluating of said binary process current instability select a value among the values represented by the outputs of each of said tracts, where said value is the best indicator of said binary process current instability, and said means for evaluating of said binary process current instability reveal at an output thereof an ordering number of that tract at the output of which the best indicating value was found.
25. A system as claimed in claim 16 having computing and controlling means for receiving, processing, transferring, and exchange of information between the elements of said system and between said system and an environment thereof wherein including:
means for signal to data conversion and means for data to signal conversion;
means for mapping of any non binary process on the space of binary processes;
means for inserting, writing, reading, and modifying data represented by scalars, vectors, and matrices; means for storing a region of said binary process, forming a binary string so that each new element of said binary process is an element of said binary string;
means for numerical processing and for quantitative analysis of said binary string including means for decomposition, means for data sampling of said decomposition data, means for statistical analysis of said decomposition data, means for creating data sets having functional forms as members of said data sets, means for aggregating strings of values;
whereby said means aid accurate and stable functioning of said predicting system.
26. A system as claimed in claim 16 being embedded in a measuring system further including:
means for an input signal filtering;
means for performing measuring block procedures;
means for sequential prediction of a binary elements ' state in a binary process;
means for calculating a resulting measurement; and
means for controlling a system's working modes.
27. A system as claimed in claim 26 wherein: said input signal and a filtered input signal are used together for generating a signal to noise ratio signal;
said signal to noise ratio variable is considered a non binary process and converted to a binary process representing current level of disturbance evaluation in said system;
the signal to noise evaluation is predicted element by element through the utilization of said predicting subsystem;
each measuring block procedure is executed at a pace related to said signal to noise ratio evaluation, and only that measuring block procedure output is accounted in said resulting measurement, whose predicted signal to noise ratio evaluation indicates a low level of disturbance in said measuring system;
said resulting measurement is an aggregation of a number of permitted for said aggregation outputs of said measuring block procedure so that the part of disturbance in said system output becomes minimized;
said measuring system's input is switched to a noiseless testing signal when the high level of disturbance is predicted, so that said measuring system may provide compensation for a multiplicative disturbance;
whereby the accuracy of any measuring system can be significantly improved in those cases when further filtration of any kind is not effective.
28. A system as claimed in claim 16 being embedded in an another system with essential non linearity further including:
said system having essential nonlinear element;
means for said nonlinear element's input measurement;
means for a sequential prediction of a binary elements ' state in a binary process; and
means for performing any actions preventing harmful affection of said system's non linearity.
29. A system as claimed in claim 28 wherein:
said nonlinear element's input is measured and evaluated by comparison to a predetermined threshold value that is a parameter of said nonlinear element's snap condition; and
means for binary process formation of said predicting means generates said vectorial binary process whose each component characterizes certain distance to said threshold;
said predicting means provide a prediction of a forthcoming element of each component of said vectorial binary process; and
means for performing any actions preventing harmful affection of said system' s non linearity receive information about said forthcoming element ' s state of said vectorial binary process, analyses said forecast, and generates appropriate control actions .
30. A method as claimed in claim 1 being embedded in a method of time series analysis further including the steps of:
mapping a non binary time series into said vectorial binary process, such that each said component of vectorial binary process component is a product of said time series' quantification, such quantification is based on values of corresponding components of a vector of quantizing levels;
selecting a first group of components of said vectorial binary process that are suitable for a prediction of the event that a forthcoming element of each member of said first group of components will be located higher than some predetermined position on said time series range;
selecting a second group of components of said vectorial binary process that are suitable for a prediction of the event that a forthcoming element of each member of said second group of components will be located lower than some predetermined position on said time series range;
predicting the forthcoming element's state of each binary process in both groups; and
finding a pair of the most proximate, in terms of a location on said time series range, predictions such that the first element of said pair belongs to a binary process from said first group and the second element of said pair belongs to a binary process from said second group; whereby the position of said time series value in its range is predicted to be in a narrowed corridor, and said corridor is bound by functions of said time series discrete argument .
31. A method as claimed in claim 30 wherein:
selecting said groups of components of said vectorial binary process may involve evaluating predicting efficiency of each component by applying said retrospective predicting procedure;
predicting the forthcoming element's state of each binary process from both of the groups of components involves said actual predicting procedure.
32. A system as claimed in claim 16 being embedded in a multi channel data acquisition system providing a selection of a most informative channel further including:
several sources of data;
means for transmitting, receiving, and processing data over multiple informative channels;
means for generating an indicator, value of which is related to a signal to noise ratio appearing at an input of said receiving means of each said informative channel;
means for a sequential prediction of a binary elements ' state in a vectorial binary process; and means for selecting an informative channel of said multi channel data acquisition system.
33. A system as claimed in claim 32 wherein:
every said indicator, that is related to signal to noise ratio, is evaluated by at least one predetermined signal to noise ratio level, and a corresponding binary string is generated and stored in said means for a sequential prediction of a binary elements' state in a vectorial binary process;
a forthcoming element ' s state of each said binary string is predicted; and
the channel whose signal to noise ratio is predicted to be the highest among all said channels, is selected as a preferable channel for the next data transmission^
whereby with each moment of a transaction, said data acquisition system collects data with a lowest disturbance magnitude .
34. A method as claimed in claim 1 being embedded in an algorithm for predicting the quality of schedule based communication further including the steps of:
sending a schedule based test signal to each communicator;
receiving a response to said test signal from each communicator;
classifying and then distributing said communicators into two groups by a binary criterion of quality of communication having said responses as values for an independent variable, such that members of one group are classified as having a good quality of communication, and members of the other group are classified as having a bad quality of communication; and
predicting a forthcoming element's state in a binary process representing said quality of communication of each communicator;
generating a notifying message for any communicator attempting to contact a member of the group with predicted bad quality of communication;
generating a notifying message if said bad quality of communication is predicted for any of participants during communication.
35. A predicting algorithm as claimed in claim 1 being embedded in a computer based game wherein: said algorithm is a part of said game's background algorithm;
in said game the human intelligence and the artificial intelligence compete so that human tries to challenge a computer program by creating binary puzzles the computer program must solve;
in said game's background algorithm said binary puzzle is represented by a binary string of a finite length;
during the play, each element of said binary string is inserted sequentially into a computing device, whose artificial cognitive algorithm must predict the state of said binary element before said element has been inserted;
the number of correct and incorrect predictions is evaluated on at least one binary string length so that human wins and respectively artificial mind loses if some predetermined threshold is exceeded by said evaluation;
in said background algorithm different said evaluating thresholds and said algorithms internal parameters can be setup by a player to get a game with different levels of complexity;
whereby depending on how skilled the human player is, a different result of said competition is expected.
36. A method for predicting a state of a binary element in a binary process, said method being implemented within computer-readable medium of computing means, said method comprising the steps of:
converting a sequence of values of a variable related to a functioning entity into a plurality of binary processes by using a computing means;
forming a binary string of a finite length for each said binary process to obtain a history storage so that each new element of said binary process is an element of said binary string;
generating for each said binary string an initial set of predicting solutions; evaluating each said binary string's transients effect on said binary string's predictability if said transients effect is not pre evaluated;
generating for each binary string a resulting set of predicting solutions which is built from said initial set of predicting solutions depending on said evaluated binary string's transients effect;
sequentially predicting the state of each element in a temporal group of forthcoming elements in each said binary- string through the application of an element vise predicting procedure acting upon each said resulting set of predicting solutions;
updating each said initial set of predicting solutions and reevaluating each said binary string's transients effect, if necessary; and
returning to generating each said resulting set of predicting solutions;
whereby said sequential prediction of said binary element's state in each stationary, quasi-stationary, and non stationary binary process is generated for said functioning entity by said computing means .
37. A method as claimed in claim 36, wherein:
said binary process is a mapping of a process of said functioning entity on the space of discrete binary processes providing the process of said entity functioning internal representation in said computing system.
38. A method as claimed in claim 36, further including the steps of:
generating said initial set of elements only if it is permitted by setting up an updating mode of said initial set to at least one of two binary components of a first permitting vector, said permitting vector having a first component and a second component, said first component indicates that said initial set was predetermined, and said second component indicates whether to begin creation of said initial set based on some schedule.
39. A method as claimed in claim 38, when at least one component of said first permitting vector is put to the updating mode of said initial set, further including the steps of:
expanding each said binary string into uniquely representing said binary string functional structures of a minimal length, which are built from opposed to each other adjacent sequences of identical states of said binary process element, such that a propagation of every said structure in both directions of said binary process domain returns a binary periodical function, which is a prototype of said predicting solution;
determining a statistically robust said functional structures with a maximal period;
generating a first set of predicting solutions containing all possible said structures including said maximal period functional structures, so that each element of said first set possesses the property of orthogonality; and
generating said initial set of predicting solutions via the union of said first set and a second set of two opposite to each other predicting solutions, whose composition is a countable sequence of the identical binary elements of said binary process .
40. A method as claimed in claim 36, wherein:
said element vise predicting procedure is a retrospective predicting procedure if said element vise predicting procedure is defined on an interval of said binary string domain which is antecedent to the latest observed element of said binary string; and
said element vise predicting procedure is an actual predicting procedure if said element vise predicting procedure operates upon the latest observed element of said binary string; and
said predicting procedure is non iterative, is cyclic, and each cycle is composed of two stages, and may contain several predictions;
41. A method as claimed in claim 40, further including the steps of:
beginning each cycle of said predicting procedure at a starting point when an error of prediction occurs; performing the first stage of each said predicting cycle through generation of a resulting set of predicting solutions by mapping said initial set on said resulting set, executed at the starting point of each said predicting cycle, so that a composition of said resulting set of predicting solutions depends on said evaluation of said current transients effect of said binary string; and
performing the second stage of each said predicting cycle through generation of a functional model of each forthcoming element from a temporal group of said binary string's elements belonging to said current predicting cycle, and through a generation of a prediction permitting indicator, so that said element vise prediction is an output of the Boolean conjunction of said model and said permitting indicator.
42. A method as claimed in claim 36, further including the step of: evaluating said transients effect of said binary string only if it is permitted by setting up an evaluation updating mode to at least one of two binary components of a second permitting vector, whose first component indicates a fact of said evaluation predetermination, and whose second component indicates a fact of beginning of said evaluation based on some schedule .
43. A method as claimed in claim 42, when at least one component of said second permitting vector is set up to the evaluation updating mode further including the step of:
performing said binary string's transients effect evaluation through a calculation of an estimating vector function of predicting efficiency involving said retrospective predicting procedure, which is specific for each component of said estimating vector function and is defined on said binary string domain.
44. A method as claimed in claim 43, wherein:
said estimating vector function of predicting efficiency is a vector whose each component is an aggregation function of a sequence of outputs of said retrospective predicting procedure, which acts upon a specific for this component pre selected set of predicting solutions, which is a mapping of said initial set of predicting solutions; one of said pre selected sets can be said initial set itself; and any component of said estimating vector function of predicting efficiency can be predetermined controlling the composition of said resulting set of predicting solutions.
45. A method as claimed in claim 41, further including the steps of:
determining a component of said estimating predicting efficiency vector function, that has an extreme value; and selecting said resulting set of predicting solutions based on a composition of said specific set that corresponds to the extreme component of said estimating predicting efficiency vector function, such that each member of said resulting set possesses certain common and specific properties that depend on said entity's specificity.
46. A method as claimed in claim 45, wherein:
said resulting set's common properties are first, said resulting set is a mapping of said initial set;
second, the cardinal number of said resulting set is inversely relates to the evaluated said binary string's transients effect on predictability; and
third, if being observed at the beginning of said predicting cycle, the binary state of each member of said resulting set of predicting solutions is identical to the state of said binary string's element having observed at the beginning of the same predicting cycle.
47. A method as claimed in claim 45, wherein:
said resulting set's specific property of any non stationary binary process is that said resulting set is a subset of said initial set of predicting solutions .
48. A method as claimed in claim 45, wherein:
said resulting set's specific property of some of non stationary binary process is that a resulting set ' s member is such a member of said initial set of predicting solutions that can be observed on the interval next to the beginning of the predicting cycle, and whose period is the maximal period among all observed on said interval members of said initial set;
said resulting set's specific property of some of non stationary binary process is that a resulting set's member is such a member of said initial set that can be observed on the interval next to the beginning of the predicting cycle, and can be distinguished as a periodic function containing its full period;
said resulting set's specific property of some of non stationary binary process is that there is a relationship between at least one known member of said resulting set of predicting solutions and some other members of said resulting set related to said known member, such that for any binary element's state denoted by s, it is true that (ls2-.s) => (2s2-ιs) , (2s2-ιs) = (2sl-.s) , (ls3-ιs) => (2s3-ιs) v (3s3-ιs) , (2s3-.s) = (ls3-ιs) v (3s3-.s) , (3s3-.s) => (ls3-.s) v (2s3-ιs) , where the left part of each statement defines known member of said resulting set, and the right part of each statement defines all other members of said resulting set that are related to said known member;
said resulting set's specific property of some of non stationary binary process is that there is a relationship between a sequence of two or three identical binary process elements found on the binary process decomposition, which are adjoined to the beginning moment of a predicting cycle and some members of said resulting set related to said sequence of binary process elements, such that for any binary element's state denoted by s, it is true that 2s =* (2s2-.s) v (2sl-ιs), 3s = (3s3-ιs) v (3s2-ιs) v (3sl-ιs) , where the left part of each statement defines said sequence of binary process elements, and the right part of each statement defines all members of said resulting set that are related to said sequence of binary process elements; and
said resulting set's specific property of some of non stationary binary process is that the first member of said initial set of predicting solutions is a member of said resulting set, and both members of said second set are the members of said resulting set.
49. A method as claimed in claim 45, wherein:
said resulting set's specific property of another non stationary binary process is that a resulting set's member is such a member of said initial set that can be observed on the interval next to the beginning of the predicting cycle, and can be distinguished as a periodical function containing its full period;
said resulting set's specific property of another non stationary binary process is that there is a relationship between at least one known member of said resulting set of elements and some other members of said resulting set related to said known member, such that for any binary element's state denoted by s, it is true that (ls2—is) =» (2s2-.s), (2s2-ιs) => (2sl-.s) , (ls3-.s) => (2s3-.s) v (3s3-ιs) , (2s3-ιs) => (ls3-.s) v (3s3-ιs) , (3s3-.s) =Φ (ls3-ιs) v (2s3-,s) , where the left part of each statement defines known member of said resulting set, and the right part of each statement defines all other members of said resulting set that are related to said known member;
said resulting set's specific property of another non stationary binary process is that there is a relationship between a sequence of two or three identical binary process elements found on the binary process decomposition, which are adjoined to the beginning moment of a predicting cycle and some members of said resulting set related to said sequence of binary process elements, such that for any binary element's state denoted by s, it is true that 2s => (2s2-ιs) v (2sl-.s), 3s => (3s3-ιs) v (3s2-ιs) v (3sl-ιs) , where the left part of each statement defines said sequence of binary process elements, and the right part of each statement defines all members of said resulting set that are related to said sequence of binary process elements; and
said resulting set's specific property of another non stationary binary process is that both members of said second set are the members of said resulting set.
50. A method as claimed in claim 41, wherein:
said functional model of a forthcoming element of said binary process is a nonlinear transformation of a base model ;
said nonlinear transformation of the base model includes an inversion of said model's output based on a result of a conjunction of two binary components of a third permitting vector;
said first component of the third permitting vector is an indicator of the inversion mode initiation, and said second component of the third permitting vector indicates the beginning of said inversion when an output of a current predicting efficiency estimating function is within a specified distance of a predetermined threshold value, and the second component of said third permitting vector also indicates the end of said inversion if a new error of prediction is observed; said base model is a union of those members of said resulting set of predicting solutions that are allowed to participate in the base model; the allowance of participation in said base model includes that each member of said resulting set participates in the current cycle of predictions since the beginning of said cycle until this member produces an incorrect prediction, and this member may again participate in the prediction only in the next predicting cycle;
said prediction permitting indicator is a conjunction of three binary components of a fourth permitting vector; and
said first component of the fourth permitting vector is an indicator of the prediction blocking mode initiation, and said second component of the fourth permitting vector reflects the fact of beginning of said prediction blocking mode when a value of said current predicting efficiency estimating function is within a specified distance of another predetermined threshold value, and the second component of said fourth permitting vector also indicates the end of said blocking if a new error of prediction is observed, and said third component of the fourth permitting vector is a conjunction of all members of said resulting set that participate in said base model .
51. A computer program product for predicting of a state of a binary element in a binary process having a functioning entity or an improvement of said functioning entity, said product executable in a computer readable environment, said product having instructions for: converting an observable sequence of values of a variable related to said functioning entity into a plurality of binary processes providing for said sequence of values internal representation in said product;
forming a binary string of a finite length for each said binary process history storage so that each new element of said binary process is an element of said binary string;
generating for each said binary string an initial set of predicting solutions;
evaluating each said binary string's transients effect on said binary string's predictability if said transients effect is not pre evaluated;
generating for each binary string a resulting set of predicting solutions which is built from said initial set of predicting solutions depending on said evaluated binary string's transients effect;
sequentially predicting the state'of each element in a temporal group of forthcoming elements in each said binary string through the application of an element vise predicting procedure acting upon each said resulting set of predicting solutions;
updating each said initial set of predicting solutions and reevaluating each said binary string's transients effect; and returning to generating step for each said resulting set of predicting solutions if additional predictions are needed;
whereby said sequential prediction of said binary element's state in each stationary, quasi-stationary, and non stationary binary process providing said internal representation of said sequence of values for said functioning entity or for said improvement of said functioning entity by said product is generated.
52. A product as claimed in claim 51, wherein:
said observable sequence of values of a variable denoted u(t) and related to said entity's functioning is converted into said plurality of binary processes by an application of a quantizing procedure denoted B(λ,u°), whose one possible realization for continuous u(t) is described by formulas :
x(τ) = B(λu°)u(t) (1)
Figure imgf000099_0001
V u°>0, [|u(ti)| - u°]>0 = x(t ) = bi (3)
V u°>0, [|u(ti)| - °]< 0 → x(ti) = b2 (4) bi = -.b2 u° c U wherein λ denotes sampling rate, τ denotes discrete time and u° denotes a vector of quantizing levels .
53. A product as claimed in claim 52, wherein:
formula (2) defines a vectorial time sampling procedure; and
formulas (3) , (4) define an amplitude quantification procedure .
54. A product as claimed in claim 52, further including:
performing a two stage quantification procedure according to the formula (1) such that said continuous variable u(t) is mapped onto the space of discrete processes, and then said variable experiences said amplitude quantification;
whereby, said continuous variable u(t) becomes converted into said plurality of binary processes x(τ) suitable for processing by said product.
PCT/US2003/007857 2003-03-14 2003-03-14 Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion WO2004084134A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/US2003/007857 WO2004084134A1 (en) 2003-03-14 2003-03-14 Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion
EP03716569A EP1609118A1 (en) 2003-03-14 2003-03-14 Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion
AU2003220271A AU2003220271A1 (en) 2003-03-14 2003-03-14 Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2003/007857 WO2004084134A1 (en) 2003-03-14 2003-03-14 Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion

Publications (1)

Publication Number Publication Date
WO2004084134A1 true WO2004084134A1 (en) 2004-09-30

Family

ID=33029244

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/007857 WO2004084134A1 (en) 2003-03-14 2003-03-14 Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion

Country Status (3)

Country Link
EP (1) EP1609118A1 (en)
AU (1) AU2003220271A1 (en)
WO (1) WO2004084134A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5991340A (en) * 1996-06-25 1999-11-23 Seiko Epson Corporation Method and system for encoding and decoding data using run prediction
US6055273A (en) * 1996-09-02 2000-04-25 Seiko Epson Corporation Data encoding and decoding method and device of a multiple-valued information source
US6581047B1 (en) * 1999-04-07 2003-06-17 Inesa, Inc. Method for a sequential prediction of binary element's state in a binary process and the system for the method implementation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5991340A (en) * 1996-06-25 1999-11-23 Seiko Epson Corporation Method and system for encoding and decoding data using run prediction
US6055273A (en) * 1996-09-02 2000-04-25 Seiko Epson Corporation Data encoding and decoding method and device of a multiple-valued information source
US6581047B1 (en) * 1999-04-07 2003-06-17 Inesa, Inc. Method for a sequential prediction of binary element's state in a binary process and the system for the method implementation

Also Published As

Publication number Publication date
EP1609118A1 (en) 2005-12-28
AU2003220271A1 (en) 2004-10-11

Similar Documents

Publication Publication Date Title
CN110490717B (en) Commodity recommendation method and system based on user session and graph convolution neural network
Palacios et al. Genetic tabu search for the fuzzy flexible job shop problem
Paliwal et al. Reinforced genetic algorithm learning for optimizing computation graphs
Västberg et al. A dynamic discrete choice activity-based travel demand model
Gero et al. An exploration‐based evolutionary model of a generative design process
Freyman et al. Application of fuzzy logic for decoding and evaluation of results within the process of information system components diagnosis
Yamada et al. Feature-selection based data prioritization in mobile traffic prediction using machine learning
Tang et al. Dynamic games among teams with delayed intra-team information sharing
He et al. Cooperative-competitive reinforcement learning with history-dependent rewards
US6581047B1 (en) Method for a sequential prediction of binary element&#39;s state in a binary process and the system for the method implementation
Ozbay et al. Modeling route choice behavior with stochastic learning automata
Li et al. Rate-optimal contextual online matching bandit
Gosavi Solving Markov decision processes via simulation
CN111832817A (en) Small world echo state network time sequence prediction method based on MCP penalty function
González-Rodríguez et al. A genetic solution based on lexicographical goal programming for a multiobjective job shop with uncertainty
WO2004084134A1 (en) Method for a sequential prediction of binary elements state in a binary process and the system for the method implementaion
Dursun et al. Data pooling for multiple single-component systems under population heterogeneity
Kumar et al. Transfer Learning based GDP Prediction from Uncertain Carbon Emission Data
Crone et al. Feature selection of autoregressive neural network inputs for trend time series forecasting
Wall Emergence of coordination in growing decision-making organizations: The role of complexity, search strategy, and cost of effort
AbAziz et al. Voltage stability prediction by using artificial immune least square support vector machines (AILSVM)
Ratitch On characteristics of Markov decision processes and reinforcement learning in large domains
Lücke et al. Learning interpretable collective variables for spreading processes on networks
CN112383965B (en) Cognitive radio power distribution method based on DRQN and multi-sensor model
Bashir et al. Adaptive-Greedy Exploration for Finite Systems

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003716569

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003716569

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP