WO2004083996A2 - Apparatus for providing access to software applications and hardware applications to visually impaired persons - Google Patents

Apparatus for providing access to software applications and hardware applications to visually impaired persons Download PDF

Info

Publication number
WO2004083996A2
WO2004083996A2 PCT/NL2004/000191 NL2004000191W WO2004083996A2 WO 2004083996 A2 WO2004083996 A2 WO 2004083996A2 NL 2004000191 W NL2004000191 W NL 2004000191W WO 2004083996 A2 WO2004083996 A2 WO 2004083996A2
Authority
WO
WIPO (PCT)
Prior art keywords
application
indication
line
type
type object
Prior art date
Application number
PCT/NL2004/000191
Other languages
French (fr)
Dutch (nl)
Other versions
WO2004083996A3 (en
Inventor
Roderik Gerrit Frederik Erens
Original Assignee
Tieman Development B.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tieman Development B.V. filed Critical Tieman Development B.V.
Publication of WO2004083996A2 publication Critical patent/WO2004083996A2/en
Publication of WO2004083996A3 publication Critical patent/WO2004083996A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202—Constructional details or processes of manufacture of the input device
    • G06F3/0219—Special purpose keyboards
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G06F3/04895—Guidance during keyboard input operation, e.g. prompting
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/006—Teaching or communicating with blind persons using audible presentation of the information
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/007—Teaching or communicating with blind persons using both tactile and audible presentation of the information

Definitions

  • a function of the application or sub -application can be activated.
  • the user interface further comprises at least one fourth-type object of which at least a part can be presented in the line, with the fourth object comprising a vertical menu comprising a number of indications to be selected placed one below the other, in the form of input fields, for instance with an input cursor, while one input field at a time can be presented in the line, while it can be selected by means of the input element which input field from the vertical menu is presented in the line, and while, by means of the input element, information can be inputted into a selected input field.
  • a fourth-type object can be used to bundle a number of fields by means of which text can be inputted or a value can be selected. So, the fourth-type object enables input into an application.
  • the indications of the fourth-type object may relate to a common function in an application, for instance for inputting a name for the purpose of saving a file. Another possibility is selecting a folder or directory in which the file can be saved.
  • This fifth-type object can be used for presenting notifications, warnings and questions to the user.
  • Fig. 7 shows an example of a part of the user interface which is provided with a first-type object, a second-type object, a fourth-type object, and a fifth-type object; and Fig. 8 shows a possible embodiment of an apparatus according to the invention comprising a user interface according to one or more of Figures 1-8.
  • the apparatus 1 is also provided with a computer. It is also possible for the apparatus 1 to be provided with a hardware application such as a mobile telephone, an electronic calendar, etc.
  • the apparatus is designed to communicate with a computer or a computer network.
  • the apparatus is, for instance, provided with a connection 26 by means of which the apparatus can be connected with an external computer or an external computer network.
  • the apparatus 1 replaces the keyboard, a mouse and a screen of a computer for the benefit of a visually impaired person.
  • the horizontal menu shown in Fig. 1 contains multiple menu items, that is, multiple indications .
  • an indication or menu item consists of a short term (one word). One of the items has been selected. In Fig. 1, this is indicated by underlining the word "file”. If the horizontal menu of Fig. 1 is represented on the Braille display, an extra tactile of a cell may indicate that the respective word of which the Braille cell 22 is part has been selected.
  • Selecting a menu item that is, selecting an indication of the horizontal menu of Fig. 1, can be carried out by means of the horizontal arrow keys 8a, 8c.
  • a selected indication such as, in this example, the word "file” can be confirmed by operation of the OK key 16.
  • a new item is activated by means of the OK or confirmation key 16.
  • a menu item is selected, with this selection being confirmed at the same time. For instance, by actuating one of the touch cursors which forms above one of the Braille •cells used for representing the word "edit”, the menu item "edit” can be selected, with the respective selection being confirmed at the same time.
  • each menu item of the vertical menu of Fig. 2 comprises the same indicator m. However, this is not necessary. Because, in this case, each menu item of the vertical menu of Fig. 2 comprises the letter m, the indicator m is, in fact, also an indicator of the nature of the vertical menu itself. The same holds true for the lowercase letter b of the horizontal menu. In this example, this is also an indication of the nature of the horizontal menu itself, that is, of the nature of the contents of the line in which the indication has been included. This is because all menu items of the horizontal menu have a common indication.
  • a first-type object of the respective application or sub-application can be returned to for presentation of the first-type object in the line (not shown in this example).
  • one of the menu items of the second-type object may, for instance, be a menu item which effects that, after selection and confirmation, the first-type object is returned to, in this example the horizontal menu of Fig. 1. As discussed, this may also be effected by activation of the key 10 of the apparatus. So, by operation of the input element, the first object of an application or sub-application which is active can be selected so that the first object is presented in the line.
  • the first object of an application or sub -application which is active can be selected so that the first object is presented in the line.
  • operating the input element in a predetermined manner comprises activating a predetermined key or collection of keys, in this case operation of the program key 12.
  • a "record list” can comprise three types of “records”: “new record”, “categories” and “titles".
  • “new notes” is a “new record” and the menu items “unfiled”, “archive” and “hobby” each are a “category”.
  • “new notes” is a “record” of the type “new record” and the menu items “record 1", “record 2” and “record 3” each are a "title”.
  • the third-type object presented by selection and confirmation of an indication of the type of "category” may comprise indications of the type of "title”, “new record”, or “category”, while, by selection and confirmation of an indication of the type of "new record", a new title can be created, with the latter category being a sub-category of the former category.
  • successive indications of the third-type object can be presented in the line, with the order of the indications respectively represented in the line which is traversed by operation of the input element is cyclic.
  • a fourth-type object can be selected for presentation in the line by selecting and confirming at least one indication of at least one of the first, second and/or third-type objects. More in particular, further, the input fields of the fourth -type object relate to a common function in the application or sub -application.
  • a fourth-type object can be selected and the selection can be confirmed from, for instance, a first-type object by selecting, in the usual manner, an indication in the first-type object which relates to the respective fourth-type object and then confirming the selection, for instance by means of the arrow keys 8a, 8c and the OK key, respectively. All this is dependent on the respective application. However, it is also possible that a fourth -type object is activated from a second-type object or a third-type object by selection and confirmation of an indication from the second -type or third-type object. This is also dependent on the structure of the respective application.
  • a topmost indication of the fourth-type object can be presented first in the line.
  • this would thus be the indication (label) SAVE NOTE.
  • the topmost input field is presented first in the line.
  • this is the indication "title: 1" with the indicator "e” in front of it.
  • the user interface further comprises at least one fifth-type object of Which at least a part can be presented in the line, while the fifth-type object can at least comprise an indication in the form of a remark, a question or a warning.
  • the application which is active at a given moment determines when a fifth-type object is activated.
  • the topmost indication in particular will be the very first to be presented in the line.
  • an indication of one of the first-type objects at the highest level of the user interface within the apparatus relates to one of the applications or sub -applications of the apparatus.
  • Such a first-type object comprises indications which relate to a particular application or sub-application. By selecting and confirming such an indication as discussed with reference to Fig. 1, a particular application or sub -application is activated.
  • the apparatus may particularly be provided with speech synthesis means for reading out the contents of the line.
  • the contents of the line may, for instance, be read out by actuating a particular key of the input element.
  • the apparatus may, for instance, also comprise a mobile telephone and/or an electronic calendar as one or more of the possible applications.
  • the apparatus comprises, for instance, the connect key 50 and disconnect key 52.
  • the apparatus may also be designed to communicate with a computer or a computer network via, in this example, the input and output 26.
  • the apparatus may also be provided with wireless technology such as Bluetooth technology for making connections with other machines.

Abstract

An apparatus for providing access to software applications such as a word processor or a spreadsheet and/or hardware applications such as a telephone to visually impaired persons, at least by presenting information on a line, provided with at least one Braille display and/or speech synthesis means for conveying the contents of at least a part of the line to the visually impaired person and at least one input element for inputting information, wherein the apparatus is further provided with a user interface for presenting the information on the line and for processing information inputted by means of the input element.

Description

Title: Apparatus for providing access to software applications and hardware applications to visually impaired persons
The invention relates to an apparatus for providing access to software applications such as a word processor or a spreadsheet and/or hardware applications such as a telephone to visually impaired persons, at least by presenting information on a line, provided with at least one Braille display and/or speech synthesis means for conveying the contents of at least a part of the line to the visually impaired person and at least one input element for input of information, while the apparatus is further provided with a user interface for presenting the information on the line and for processing information inputted by means of the input element. In this application, providing access to software applications and/or hardware applications is understood to mean the supplying of information to the software applications and/or the hardware applications by a person and the obtaining information from the software application and/or the hardware application by a person. Such an apparatus is known per se.
The apparatus itself may comprise the software applications and/or the hardware applications. For instance, the apparatus may comprise hardware applications in the form of a mobile telephone or a computer. The apparatus may also comprise software applications such as a word processor or a spreadsheet. However, it is also possible for the apparatus to be designed to be connected with an external computer or an external computer network. In that case, the apparatus provides access to such an external computer and/or external network.
A problem is that existing software and hardware applications are often not suitable to be used by a visually impaired person. For instance, the information represented on a screen by a Windows-operated program is difficult to represent on a line of a Braille display. It is also difficult to operate the buttons of a Windows-oriented program by means of an input element of the apparatus such as a number of arrow keys, an enter key and a mouse.
It is, for instance, a problem that, with the known device, the user sometimes does not know anymore which part of the software application is operative. The line represented on the Braille display does not provide sufficient information for this purpose. In addition, it has been found that, for a visually impaired user, it is difficult to remember in what manner he can navigate through a software application and/or a hardware application. This is because a plurality of navigation possibilities of an application cannot be presented on one single line. Each time, the user needs to determine, by means of the input element, which information of a software and/or a hardware application is represented in the line and to determine (often from memory) to which part of the software application and/or the hardware application he can navigate. This has been found to be a source of mistakes. Therefore, the invention contemplates providing an apparatus which provides a solution for at least a number of the following objects: 1. the user interface provides a higher efficiency of working (more work in less time);
2. the user interface matches the need of the user in a natural manner;
3. the user interface gives confidence and invites the user to explore new functionality; and 4. the user learns, understands and uses the user interface within a short time.
For this purpose, the apparatus according to the invention is characterized in that the user interface is built up from at least one first-type object and at least one second-type object, while: each first-type object comprises a horizontal menu of which at least a part can presented in the line, while the horizontal menu comprises an number of indications to be selected placed next to one another, while one of the indications presented can be selected by means of the input element and while the user interface presents in the line which indication has been selected, and while a selected indication of the first-type object can be confirmed by means of the input element; each second-type object comprises a vertical menu provided with a number of indications to be selected placed next to one another, while, of the indications of the second object, only a selected indication can be presented in the line, while it can be inputted by means of the input element which indication is selected from the vertical menu and is presented in the line and while a selected indication of the second-type object can be confirmed by means of the input element, while an indication of the second -type object can relate to a particular function of an application or sub -application of an application; by selecting and confirming one of the indications from one of the first-type objects, one of the second-type objects can be selected for presentation in the line; and while - one first-type object of the first-type objects relates to a highest level of the user interface within an application or sub -application of an application, while the indications can at least relate to one second -type object of the second-type objects or while one first-type object of the first-type objects relates to a highest level of the user interface within the apparatus, while the indications relate to different applications or sub-applications of the apparatus.
Because the user interface is built up from at least the first-type object and the second-type object, with the first-type object comprising a horizontal menu and the second-type object comprising a vertical menu, and while, also, the first-type object relates to a highest level at which the user interface is organized within an application or sub -application, or the first object relates to the highest level at which the user interface is organized within the apparatus for, for instance, selecting and/or activating one of the applications or sub-applications and while one of the second -type objects can be selected by selecting and confirming an indication from a first -type object, a user can simply navigate through the applications. The user knows that he can move "downwards" from a first object to one of the second-type objects and vice versa. When a user observes that he has selected a first-type object, he also knows that this type of object relates to a highest level. Then, he also knows that, from this first-type object, he can possibly select second-type objects, which second-type objects do not comprise a horizontal, but a vertical menu structure.
In this manner, it is, for instance, possible to select, by means of the first-type object of a particular application or sub -application, a second-type object of the application or sub-application which comprises, for- instance, a collection of functions of the respective application. This collection of functions may be grouped such that they match, such as for instance creating and deleting files in a computer file. If other types of functions need to be carried out within a software application and/or a hardware application, it is possible to navigate from the respective second-type object back to the first-type object.
Then, from the first-type object, another second-type object with a particular collection of functions may be selected. These may then be functions which relate to adjusting text and the like. In particular, also, from a second-type object, no other second-type object can be selected. In that case, the user interface is "very flat" and can be explored by a user in a simple manner. Also, a user will soon know what the "lay-out" of the menu structure is.
In particular, by selection and confirmation of an indication of a first-type object which relates to the highest level of the user interface within an application or sub -application, with the indication relating to a second-type object of the application or sub -application of the second-type objects, the second-type object is selected for presentation in the line.
In particular, by selection and confirmation of an indication of a first-type object which relates to the highest level of the user interface within the apparatus, with the indication relating to an application or sub-application, the respective application or sub -application is activated.
Also, in particular, by selection and confirmation of one of the indications of a second-type object of an application or sub -application, a function of the application or sub -application can be activated.
Preferably, in particular, by selection and confirmation of an indication of a second-type object corresponding to an application, a sub-application of the application can be activated.
Above-mentioned preferred embodiments each provide that one or more of the objects mentioned are further met.
The user interface can further be simplified if, by operation of the input element in a predetermined manner, the first object of an application or sub -application which is active can be selected so that the first object is presented in the line. Preferably, by operation of the input element, in a predetermined manner, one of the first-type objects of a particular application or sub -application can be selected for presentation in the line when, in the line, one of the second-type objects is presented which relates to the latter application or sub -application. Also, in particular, by actuation of the input unit in a predetermined manner, one of the first-type objects which relates to the highest level of the user interface within the apparatus can be selected for presentation in the line.
The contents of a line of the first-type object may be longer than can be displayed on the Braille display. In that case, by means of the input element, it can be determined which part of a first-type object is presented in the line.
In particular, by operation of the input element, in horizontal direction, successive, possibly overlapping parts of the line can be selected for, for instance, representation on the Braille display or for conveyance through speech, with the order of the respectively selected parts of the line traversed by operation of the input element being cyclic.
According to a preferred embodiment, further, the user interface further comprises at least one third-type object of which at least a part can be presented in the line, with the third-object comprising a vertical menu comprising a variable number of variable indications to be selected placed one below the other, of which one at a time can be presented in the line, while it can be selected by means of the input element which indication from the vertical menu is presented in the line and while a selection of a presented indication can be confirmed by means of the input element.
Such a third-type object may preferably be used for traversing the directory structure of a computer. It can be used to show, for instance, a list of files which have been saved, a list of addresses from a database, a list of appointments in a calendar. It is clear that the list varies with regard to the number of items and the items themselves are variable as well.
Further, in particular, the user interface further comprises at least one fourth-type object of which at least a part can be presented in the line, with the fourth object comprising a vertical menu comprising a number of indications to be selected placed one below the other, in the form of input fields, for instance with an input cursor, while one input field at a time can be presented in the line, while it can be selected by means of the input element which input field from the vertical menu is presented in the line, and while, by means of the input element, information can be inputted into a selected input field. . Such a fourth-type object can be used to bundle a number of fields by means of which text can be inputted or a value can be selected. So, the fourth-type object enables input into an application. The indications of the fourth-type object may relate to a common function in an application, for instance for inputting a name for the purpose of saving a file. Another possibility is selecting a folder or directory in which the file can be saved.
Preferably, further, the user interface further comprises at least one fifth-type object of which at least a part can be presented in the line, while the fifth-type object may comprise at least one indication in the form of a remark, a question or a warning.
This fifth-type object can be used for presenting notifications, warnings and questions to the user.
As discussed hereinabove, in particular, a first-type object relates to the highest level at which the user interface within the apparatus is organized for selecting and/or activating a particular application or sub-application. Within the user interface, such a first-type object'is located above the other first-type objects. However, it is not an object which is bound to a particular application. Such a first-type object is unrelated to any application unless the application is an operating program such as for instance Windows or another operating program. The purpose of such a first-type object is precisely the selecting of a particular application or sub-application. By selecting and confirming a particular application, it is possible to navigate from such a first-type object to a software application and/or a hardware application, more in particular to a second-type object corresponding to the selected and confirmed application or sub-application or to a third-type object or a fourth-type object within the selected and confirmed (and/or activated) application or sub -application. Preferably, an object is then selected by means of a vertical menu. However, it is not precluded that a first-type object is selected. From one of the latter objects, the selected application can then further be used. In other words, by means of the latter objects, further access is provided to the respective application or sub-application.
The invention will be further elucidated with reference to the drawing, in which: Fig. 1 shows an example of a first-type object;
Fig. 2 shows an example of a second-type object;
Fig. 3a shows a first example of a third-type object;
Fig. 3b shows a second example of a third-type object which can be selected and confirmed from the third-type object according to Fig. 3a; Fig. 4 shows an example of a fourth-type object;
Fig. 5a shows a first example of a fifth-type object;
Fig. 5b shows a second example of a fifth-type object;
Fig. 5c shows a third example of a fifth-type object;
Fig. 6 shows an example of a part of the user interface according to the invention which is provided with a first-type object, a third-type object, and a fifth-type object;
Fig. 7 shows an example of a part of the user interface which is provided with a first-type object, a second-type object, a fourth-type object, and a fifth-type object; and Fig. 8 shows a possible embodiment of an apparatus according to the invention comprising a user interface according to one or more of Figures 1-8.
In Fig. 8, reference numeral 1 designates an apparatus for providing access to software applications such as a word processor or a spreadsheet and/or hardware applications such as a telephone to a visually impaired person.
The apparatus is intended for providing access to software applications such as a word processor or a spreadsheet and/or hardware applications such as a telephone to a visually impaired person. Providing access to an application is understood to mean providing information from an application to the user and providing information from the user to the application.
The access is inter alia provided by presenting information on a line. The apparatus is provided with a Braille display 2 for representing at least a part of the line and/or speech synthesis means for reading out the contents of the line in an electronic manner. The Braille display 2 and the speech synthesis means can be used alone (Braille display or speech synthesis means) or in combination (Braille display and speech synthesis means) as desired by the user. This can be adjusted by means of the input element. The apparatus further comprises an input element 4 for supplying information to the apparatus. In this example, the input element comprises a Braille keyboard 6 comprising the keys 1-8. In this example, the input element further comprises arrow keys 8a, 8b, 8c and 8d for selecting the directions left, right, up and down. In addition, the input element comprises the menu key 10, the program key 12, the cancel key 14, the OK key 16 and the left key 18 and right key 20 corresponding to the Braille display; 2. Here, the Braille display 2 is designed as a Braille reading line. In addition, the apparatus further comprises touch switches 21, with a touch switch 21 having been placed above each Braille cell 22 of the Braille reading line 2. The inpu element 4 further comprises a spacebar 24.
It is possible Tor a software application such as Windows, Word, Excel and/or other programs to be included in the apparatus 1. In that case, the apparatus 1 is also provided with a computer. It is also possible for the apparatus 1 to be provided with a hardware application such as a mobile telephone, an electronic calendar, etc.
It is further possible for the apparatus to be designed to communicate with a computer or a computer network. The apparatus is, for instance, provided with a connection 26 by means of which the apparatus can be connected with an external computer or an external computer network. In that case, the apparatus 1 replaces the keyboard, a mouse and a screen of a computer for the benefit of a visually impaired person.
The apparatus 1 is provided with a user interface for presenting the information on the line and for processing information inputted by means of the input element. By means of this user interface, a user can be provided with access to the software applications and/or the hardware applications. In other words, by means of this user interface, a visually impaired person can use the software applications and/or the hardware applications, including the operation thereof. So, the user interface is operative between the input element and the Braille display and/or the speech synthesis means on the one hand and the software applications and/or the hardware applications on the other hand.
The construction of the user interface will be discussed hereinbelow. The user interface is built up from at least one first-type object and at least one second-type object, while: each first-type object comprises a horizontal menu of which at least a part can be presented in the line, while the horizontal menu comprises a number of indications to be selected placed next to one another, while one of the presented indications can be selected by means of the input element and while the user interface presents in the line which indication has been selected and while a selected indication of the first -type object can be confirmed by means of the input element; each second-type object comprises a vertical menu provided with a number »f indications to be selected placed one below the other, while, of the indications of the second-type object, only a selected indication is presented in the line, while, by means of the input element, it can be inputted which indication is selected from the vertical menu and is presented in the line, and while, by means of the input element, a selected indication of the second-type object can be confirmed, while an indication of the second -type object can relate to a particular function of an application or to a particular sub-application of an application; by selecting and confirming one of the indications from one of the first-type objects, one of the second-type objects can be selected for presentation in the line; and while one first-type object of the first-type objects relates to a highest level of the user interface within an application or within a sub -application of an application, while the indications may at least relate to at least one second-type object of the second-type objects or while one first-type object of the first-type objects relates to a highest level of the user interface within the apparatus, while the indications relate to different applications or sub-applications of the apparatus.
A software application is understood to mean a program such as Word, Excel, Access, etc. A hardware application is understood to mean, for instance, a mobile telephone, an electronic calendar, etc. The function of the application is understood to mean a part of the application which carries out a particular task such as "find", "delete", "go to start", etc.
A sub-application of a software application is understood to mean a collection of associated functions of the application, such as for instance a spelling checker, a printer installation program, an address book of an e-mail program, etc.
A sub-application of a hardware application is understood to mean a collection of associated functions of the hardware application, such as a telephone directory, an address file, etc. Fig. 1 shows an example of a first-type object. This first-type object corresponds to a software application such as for instance a word processor. In Fig. 1, the indications are "file", "go", "edit" and "options". So, these are indications provided with characters, with, in this example, each indication forming a word formed by characters. Fig. 2 shows an example of a second-type object. Here, also, each indication is a word. In this example, the indications are "undo", "cut", "copy", "paste" and "delete all".
Here, each indication relates to a particular function of the application.
In this example, for the first object, the horizontal menu is the highest level at which the user interface is ordered for the present application. When a horizontal menu is presented in the line, the user knows that he is at the highest level, from which he can search for the ordered information in at least one of the second -type objects, that is, vertical menus. So, in this patent application, the line is an imaginary line which indicates which information has been selected for representation on the Braille display and/or for conveyance via the speech synthesis means. However, the line may comprise more characters than a line of the Braille display. So, in this example, the Braille display represents only a part of the line. As will be discussed hereinbelow, a user can determine which part of the line is then represented in the Braille display. The horizontal menu shown in Fig. 1 contains multiple menu items, that is, multiple indications . In this example, an indication or menu item consists of a short term (one word). One of the items has been selected. In Fig. 1, this is indicated by underlining the word "file". If the horizontal menu of Fig. 1 is represented on the Braille display, an extra tactile of a cell may indicate that the respective word of which the Braille cell 22 is part has been selected.
It is, as said, possible for the horizontal menu of Fig. 1 (that is, the information block presented in the line) to be wider, that is, to comprise more characters, than the Braille line 2 of the apparatus according Fig. 9. In that case, a part of the horizontal menu of Fig. 1 is represented on the Braille line 2. By means of the key 18, a left part of the horizontal menu can be selected while, by means of the key 20, a right part of the horizontal menu can be selected for presentation in the line and accordingly for representation, at least in part, in the Braille reading line. In other words, by operation of the key 18, by operation of the key 18, the representation window which is formed by the Braille reading line 2 moves to the left over the horizontal menu of Fig. 1 and by operation of the key 20, the representation window which is formed by the Braille reading line 2 moves to the right over, the horizontal menu of Fig. 1. In a similar manner, it can be selected which part of the horizontal menu is conveyed through speech. If, hereinbelow, reference is made to representing in the Braille display, this can also be understood to mean (additional or instead) conveying through speech by means of the speech synthesis means.
Selecting a menu item, that is, selecting an indication of the horizontal menu of Fig. 1, can be carried out by means of the horizontal arrow keys 8a, 8c. A selected indication such as, in this example, the word "file" can be confirmed by operation of the OK key 16. In this manner, a new item is activated by means of the OK or confirmation key 16. However, it is also possible that, by means of one of the touch switches 21, a menu item is selected, with this selection being confirmed at the same time. For instance, by actuating one of the touch cursors which forms above one of the Braille •cells used for representing the word "edit", the menu item "edit" can be selected, with the respective selection being confirmed at the same time.
By selection and confirmation of the menu item "edit", a second-type object is selected as shown in Fig. 2. In this example, the second -type object of Fig. 2 relates to the same application as the first-type object of Fig. 1.
The second object of Fig. 2 contains, in a structured manner, a number of indications, in this example menu items, which can activate a particular function of the application. Each indication in the vertical menu corresponds to a particular function. So, a menu item or indication may consist of multiple words. The indication may be longer than what is presented in the Braille reading line 2. By means of the keys 18 and 20, it can then be selected which part of the line is represented in the Braille reading line 2 and/or is conveyed via the speech synthesis means. In this example, a vertical menu can only be activated from a first-type object, that is, a horizontal menu as shown in Fig. 1. This can be carried out by selecting and confirming one of the horizontal menu items in the horizontal menu of Fig. 1, as described hereinabove. A vertical menu item directly serves to activate a function. In this example, a vertical menu item never serves to open another sub-menu. So, it does not occur that a second object can be opened from a previous second object.
The menu item represented on the line has also been selected. In other words, only the selected menu item (indication) of the vertical menu of Fig. 2 is represented in the line. As said, the contents of the line are at least in part represented on the Braille display 2. By means of the arrow Ikeys 8, in vertical direction, a menu item can be selected from the vertical menu of Fig. 2. When, for instance, the menu item "copy" is selected, the word "copy" is presented in the line and thus, in this example, represented as, a whole in the Braille reading line 2. When it is intended to select the function "paste", the arrow key 8c is operated.' The effect of this is that the menu item "paste" is selected. Then, the menu item "paste" is also selected in the line. Since at least a part of the line is represented in the Braille reading line 2, the result of this is that, iii this example, the whole word "paste" is represented in the Braille reading line 2. The function "paste" can then be confirmed, that is, be activated by the operation of the OK key 16.
If the menu item "paste" has been selected, with, in this example, the menu item "paste" being represented as a whole in the Braille reading line 2, in this example, the menu item "paste" can also be activated
(confirmed) by actuating one of the touch switches 21.
It is also possible to leave the vertical menu of Fig. 2 and to return to the horizontal menu of Fig. 1 by operation of the input element. This may, for instance, be carried out by operation of the menu key 10. In this example, operation of the menu key 10 each time results in returning to the horizontal menu of the application or, possibly, sub -application, when it is in use at that moment.
In order to increase the readability and the intuitiveness of the user interface, there is an indicator in front of an indication of a horizontal menu and a vertical menu. This indicator indicates the functions of the indications in the example of the text which is indicated further down the line. In the example of Fig. 1, the indicator is a lowercase letter b. The indicator may also have a particular graphical form. In this example, for each menu item of the vertical menu, an indicator is included in the form of a lowercase letter m. So, if the menu item "copy" is selected, the result of this is that, in the line, the character m followed by the word "copy" is presented. In this example, then, also, the whole line will be represented, including the lowercase letter m, in the Braille reading line 2. This example shows that each menu item of the vertical menu of Fig. 2 comprises the same indicator m. However, this is not necessary. Because, in this case, each menu item of the vertical menu of Fig. 2 comprises the letter m, the indicator m is, in fact, also an indicator of the nature of the vertical menu itself. The same holds true for the lowercase letter b of the horizontal menu. In this example, this is also an indication of the nature of the horizontal menu itself, that is, of the nature of the contents of the line in which the indication has been included. This is because all menu items of the horizontal menu have a common indication.
So, on the basis of what has been discussed hereinabove, it holds true that, by selection and confirmation of an indication of a first -type object corresponding to a particular application or sub -application, a second object corresponding to the same application or sub -application can be selected for presentation in the line.
By selection and confirmation of an indication of a first -type object which relates to the highest level of the user interface within an application or sub-application, with the indication relating to one second -type object of the application or sub -application of the second-type objects, the second-type object is selected for presentation in the line.
Also, by selection and confirmation of one of the indications of a second-type object of an application or sub -application, a function of the application or sub -application can be activated. Also, by selection and confirmation of an indication of a second-type object corresponding to an application, a sub -application of the application can be activated. Also, by operation of the input element, in a predetermined manner, when a sub-application is active, a first-type object of the sub-application which is active can be selected for presentation in the line. Also, upon activating the application, a second-type object of the application is presented in the line. Further, by selection and, possibly, confirmation of a predetermined indication from a second-type object (Fig. 2) of a particular application or sub-application, a first-type object of the respective application or sub-application can be returned to for presentation of the first-type object in the line (not shown in this example). For this purpose, one of the menu items of the second-type object may, for instance, be a menu item which effects that, after selection and confirmation, the first-type object is returned to, in this example the horizontal menu of Fig. 1. As discussed, this may also be effected by activation of the key 10 of the apparatus. So, by operation of the input element, the first object of an application or sub-application which is active can be selected so that the first object is presented in the line.
In particular, further, by selection and confirmation of an indication of one of the first-type objects corresponding to a particular application or sub-application, one of the second-type objects which correspond to the same application or sub -application can be selected for presentation in the line.
Also, in this example, each sub -application comprises only, one first-type object (Fig. 2). Further, in this example, by operation of the input element in a predetermined manner, one of the first-type objects of a particular application or sub -application can be selected for presentation in the line when, in the line, one of the second-type objects is presented which relates to this application or sub -application.
Also, by operation of the input element in a predetermined manner, the first object of an application or sub -application which is active can be selected so that the first object is presented in the line.
In this example, the operation of the input element in a predetermined manner comprises activating a predetermined key or collection of keys, for instance menu key 10.
Also, by operation of the input element in a predetermined manner, one of the first-type objects which relates to the highest level of the user interface within the apparatus can be selected for presentation in the line. In this example, also, operating the input element in a predetermined manner comprises activating a predetermined key or collection of keys, in this case operation of the program key 12.
Further, in this example, an indication of one of the first-type objects of a particular application relates to an indication of one of the second -type objects of the respective application. Further, an indication of a first -type object of a particular application (in this example file, go, edit or options) relates to an indication of a second-type object of the respective application (in this example for instance the vertical menu of Fig. 2 which corresponds to the indication "edit" of Fig. 1). Also, an indication of a second-type object relates to a function of an application or sub -application. In this example, these are the functions "undo", "cut", "copy", "paste" and "delete all".
Further, by means of the input element, it can be determined which part of the line is represented on the Braille display. This involves the keys 18 and 20 as discussed hereinabove. In particular, by operation of the input element, in horizontal direction, successive, possibly overlapping parts of the line can be selected for, for instance, representation on the Braille display, with the order of the respectively selected parts of the line traversed by operation of the input element being cyclic. This means in practice that, for instance, in this example, of the line of Fig. 1, only "b file go" is represented. By once operating the key 20, "file go edit" is then represented on the Braille display. By again operating the key 20, "go edit options" is then represented on the Braille display. By again operating the key 20, "b file go" is then again represented, which means that, in this example, overlapping parts of the line are traversed in a cyclic manner. Also, in this example, by operation of the input element, in this example, the keys 8a and 8c, in vertical direction, successive indications of the second object can be presented in the line, with the order of the indications respectively presented in the line which is traversed by operation of the input element being cyclic. This means that, upon operation of the key 8c, for instance, respectively, the following menu items are selected: "undo", "cut", "copy", "paste",, "delete all" and then again "undo", etc.
Of course, upon operation of the key 8a, this cycle is traversed in a reverse order. Also, by operation of the input element, the first object of an application which is active can be selected so that the first object is represented in the line. In other words, by operation of the key 10, the horizontal menu of Fig. 1 is, in this example, presented in the line and a part of this line is represented in the Braille reading line 2. Further, indications of the first-type object are fixed. In this example, this means that the horizontal menu of Fig. 1 always comprises the same menu items.
Also, the indications of the second-type object are fixed. In this example, this means that the menu items of the vertical menu of Fig. 2 are fixed.
In this example, further (see Fig. 3), the user interface further comprises at least one third-type object of which at least a part can be presented in the line, with the third object comprising a vertical menu comprising a variable number of variable indications to be selected placed one below the other, of which, one at a time can be presented in the line, while it can be selected by means of the input element which indication from the vertical menu is presented in the line and while a selection of a presented indication can be confirmed by means of the input element. In this example, also, by selection and confirmation of at least one indication of at least one of the first-type objects, second-type objects and/or third-type objects, one of the third-type objects can be selected for presentation in the line. Also, in this example, one of the third-type objects can comprise at least one of the following types of indications: "new record", "category" and "title", while, by selection of an indication of the type "title" and confirmation, a file is opened, by selection of an indication of the type "category" and confirmation, a folder/directory is opened and while! by selection and confirmation of an indication of the type "new record", a new file or a new folder/directory with corresponding indication can be created, which indication is included in the third object.
In particular, further, the indication of the type "new record" is included above the indications of the types "category" and "title" in the column of the third -type object.
Fig. 3 shows an example of such a third-type menu in the form of a "record list". In this example, the "record list" of Fig. 3 is a list of items (indications) which are variable with regard to number and contents. ,So, this is in contrast with a vertical menu according to Fig. 2. Here, the menus are defined by the developer with regard to content and with regard to number. A "record list" is, for instance, used to show a list of files which have been saved, to show a list of addresses from a database or to show a list of appointments in a calendar. It is clear that the list may vary with regard to the number of items and that the items themselves are variable. In this example, a "record list" can comprise three types of "records": "new record", "categories" and "titles". In the example of Fig. 3a, "new notes" is a "new record" and the menu items "unfiled", "archive" and "hobby" each are a "category". In the example of Fig. 3b, "new notes" is a "record" of the type "new record" and the menu items "record 1", "record 2" and "record 3" each are a "title".
In this example, "new record" is at the top of each "record" list and ensures that, without much searching and navigating in the "record" list, a "new record" of the type found in the list can always be created, for instance for creating a new note or for inputting a new telephone number. This increases the productivity and the readability for the user.
The "categories" can be compared to folders and directories on a PC. It then holds true that, for instance, a folder/directory comprises a collection of files. In the present exemplary embodiment, "categories" may also be found within another "category". However, the structure may also be kept flat which means that a "category" can only contain "titles". So, then, it is not possible to select, from a "record list" comprising "categories", another "record list" comprising "categories". But it is possible to select a "record list" comprising "titles". This also increases the learnability and a flat navigation structure is obtained which increases clarity and productivity. The "titles" are the files/"records" created by the user on this system.
These are, for instance, text files which have been saved, names of contacts in a database, appointments in a calendar.
Further, a number of things are included in the user interface to make clφar in which "record" one is working. First of all, at the very top of the "record" list, the name or description (label) of the list has been included. In this example, this is "NOTES CATEGORY LIST" (Fig. 3a) or "CATEGORY NAME" (see Fig. 3b). The use of capital letters makes this clear. By means of a key combination, for instance by actuating the key 24, this name is directly retrievable, that is, the name "NOTES CATEGORY LIST" is presented in the line by actuating the key 24 when the third-type object of Fig. 3a has been selected with the result that at least a part of this line is represented on the Braille reading line 2 and/or is conveyed through speech.
So, in this example, the topmost indication in the column of the third-type object provides a label (for instance the name or description) of the third-type object.
If a third-type object is selected and confirmed, it may be the case that, first of all, the topmost indication (label) of the third -type object is presented in the line. However, it is also possible that the indication below that is presented first in the line.
Also in this example, by means of a marking, it is indicated which function an indication (menu item) has. Thus, "n" indicates that it is a new record. The marking "c" indicates that it is a category and a "t" indicates that it is a title. In addition, in this example, the touch switch 21 located above the indicator "n", "c" or "t" can be pressed to retrieve which "record" list has been opened. This further increases the learnability and the intuitiveness of the user interface. Incidentally, also, by activating the touch cursor which is, at any moment, located, for instance, above the indicator b of Fig. 1 or the indicator m of Fig. 2, information can be obtained, that is, further information can be obtained about the nature of the contents of the line which is presented. This nature may, for instance, indicate that it is a horizontal menu, vertical menu, and, if so, which vertical menu, or a "record list", and if so, which "record list".
So, in this example, by selection and confirmation of an indication of the type of "category", one of the third-type objects is selected for presentation in the line.
Further, in this example, the third-type object presented by selection and confirmation of an indication of the type of "category" may comprise indications of the type of "title", "new record", or "category", while, by selection and confirmation of an indication of the type of "new record", a new title can be created, with the latter category being a sub-category of the former category.
Further, in this example, by operation of the input element, in particular the keys 8a and 8c, in vertical direction, successive indications of the third-type object can be presented in the line, with the order of the indications respectively represented in the line which is traversed by operation of the input element is cyclic.
In particular, further, the user interface further comprises at least one fourth-type object of which at least a part can be presented in the line, with the fourth object comprising a vertical menu comprising a number of indications to be selected placed one below the other, in the form of input fields, for instance with an input cursor, while, one input field at a time can be presented in the line, while it can be selected by means of the input element which input field from the vertical menu is presented in the line, and while, by means of the input element, information can be inputted into a selected input field.
Fig. 4 shows an example of such a fourth-type object. In this example, the fourth-type object is referred to as an input dialog. The input dialog (the fourth-type object) is used to bundle a number of fields by means of which text can be inputted or a value can be selected. So, the input dialog enables input into the application. The fields in the input dialog relate to a common function in the application, for instance for saving a file for which a name needs to be inputted and for which a folder needs to be selected in which the file can be saved. In particular, the input fields of the fourth-type object relate to one
(1) application or sub -application.
Further, in this example, a fourth-type object can be selected for presentation in the line by selecting and confirming at least one indication of at least one of the first, second and/or third-type objects. More in particular, further, the input fields of the fourth -type object relate to a common function in the application or sub -application.
Further, in this example, a fourth-type object can be selected for presentation in the line by selecting and confirming at least one indication of at least one of the first, second and/or third-type objects.
In this example, the fourth-type object can comprise at least one of the following types of input fields: "edit control", "selection control" or "multiline control", in which, by means of the input unit, with "edit control", a particular type of information such as a name or address can be inputted, with "selection control", an information unit from a predetermined collection of information units can be inputted and in which, with "multiline control" more than one line of text can be inputted.
Here, it is noted that, when an input field has been selected and is therefore presented in the line, the respective input field comprises a cursor which indicates where information can be inputted. From an input field, the inputted information is presented in the line (and thus at least in part represented on the Braille display and/or conveyed through speech). The cursor may be moved in the usual manner, for instance by means of the keys 8b and 8d. In particular, further, the fourth-type object comprising the input field "edit control" also comprises an indication in the form of a label which indicates what can be inputted and the fourth-type object which comprises the input field "selection control" also comprises an indication in the form of a label which indicates from which predetermined collection of information units, information units can be inputted. In this manner, an input field is represented in the line together with the label. So, by means of the Braille reading line 2, a user can read the label of the input field presented in the line so that the user knows with what type of input field he is dealing at that moment.
A fourth-type object can be selected and the selection can be confirmed from, for instance, a first-type object by selecting, in the usual manner, an indication in the first-type object which relates to the respective fourth-type object and then confirming the selection, for instance by means of the arrow keys 8a, 8c and the OK key, respectively. All this is dependent on the respective application. However, it is also possible that a fourth -type object is activated from a second-type object or a third-type object by selection and confirmation of an indication from the second -type or third-type object. This is also dependent on the structure of the respective application. When a fourth-type object is selected and the selection is confirmed so that the fourth-type object is activated, for instance, a topmost indication of the fourth-type object can be presented first in the line. In the example of Fig. 4 this would thus be the indication (label) SAVE NOTE. However, it is also possible that, for instance, the topmost input field is presented first in the line. In the case of Fig. 4, this is the indication "title: 1" with the indicator "e" in front of it. In particular, further, the user interface further comprises at least one fifth-type object of Which at least a part can be presented in the line, while the fifth-type object can at least comprise an indication in the form of a remark, a question or a warning.
Also, preferably, the input element comprises a Braille keyboard. An example of a fifth-type object is discussed with reference to
Figs. 5a, 5b and 5c.
In this example, a fifth-type object is also referred to as a message dialog. There are three types of message dialog. The first is, as said, the remark (an example of this is shown in Fig. 5a). There is no dangerous situation and it doesn't involve a question. The remark is presented in the line and the line is represented in the Braille display and/or conveyed through speech by means of the speech synthesis means. The Braille display makes the nature of this notification directly clear by showing colons in this example. So, the colons are again an indicator which indicates that it is a remark. The name of the dialog is given in capital letters in the topmost indication and makes clear what the purpose of the notification is. So, in this example, the remark also relates to a vertical menu with indications. The nature of the indication, that is, the name of the dialog relates to the topmost indication and the remark itself relates to one or more indications included below the topmost indication. The indications in the vertical menu can again be traversed by means of the keys 8a and 8c. Here, it also holds true that the respective indications can be traversed in a cyclic manner as described hereinabove.
With regard to a question, the following can be noted. A question as shown in Fig. 5b again relates to a vertical menu with, in this example, four indications. The topmost indication "EXISTING TITLE" is again a label. The four indications below this together form the question. These indications may also be traversed in a cyclic manner by means of the keys 8a and 8c. When an application asks a question to a user, also in this example, the topmost indication, that is, the label "EXISTING TITLE" will be presented first of all in the line, with the result that at least a part thereof is represented in the Braille display 2. The name of the message dialog (the fifth-type object) is indicated in capital letters on the topmost line and makes clear what the purpose of the question is. A user can then respectively represent the lower four indications on the Braille display by means of the keys 8a and 8c. The apparatus asks the user a question which is necessary to force a particular choice. The user can confirm or deny this question by means of particular keys. In this example, confirmation can take place by pressing the OK key 16; in the other case, thei CANCEL key 14 needs to be pressed. Also in this example, an indicator is present which indicates what the nature of the indication is; in this example the indicator is a question mark.
Fig. 5c shows an example of a fifth-type object in which a warning is given. Here, also, the topmost indication is a label with the name of the warning. in capital letters. This name makes the purpose of the warning clear. The indications included below the topmost indication form, in combination, the warning. The respective indications can again be traversed in a cyclic manner by means of the keys 8a and 8c. The point is that the apparatus warns the user. The user carries out a dangerous function or the system or the apparatus needs to take action before data are lost. Also, a warning can be given when particular functions desired by the user cannot be carried out at that moment. A warning may, for instance, comprise a notification that a battery is virtually empty. Again, an indicator is present, in this example an exclamation mark, which makes clear that it is a warning.
The application which is active at a given moment determines when a fifth-type object is activated. When a fifth-type object is activated, the topmost indication (label) in particular will be the very first to be presented in the line. In particular, further, an indication of one of the first-type objects at the highest level of the user interface within the apparatus relates to one of the applications or sub -applications of the apparatus. Such a first-type object comprises indications which relate to a particular application or sub-application. By selecting and confirming such an indication as discussed with reference to Fig. 1, a particular application or sub -application is activated. Depending on the application or sub -application started, within the application or sub -application started, generally, firstly, a first-type object, a second-type object, a third-type object or a fourth-type object will be selected. The application or sub-application may relate both to hardware and to software.
Preferably, the highest level of the user interface within the apparatus comprises only one (1) of the first objects.
As said, further, by operation of the input element in a predetermined manner, one of the first-type objects which relates to the highest level of the user interface within the apparatus can be selected for presentation in the line. In this example, this can be done by actuation of the program key 12.
In particular, further, a sub -application can be activated by selection and confirmation of an indication of a first, second, third and/or fourth -type object.
Also, as discussed, further, in particular, the at least one of the type objects also comprises, in addition to at least one indication, an indicator which provides information about the nature of the contents of the indication, with the indication being presented in the line when the corresponding at least one indication is presented in the line.
Here, preferably, by selection and, possibly, confirmation of the indicator, further information about this nature of the indication is presented in the line.
In this example, the indicator is included preceding an indication. Also, in this example, a horizontal menu is provided with one (1) indication and, in a vertical menu, each indication is provided with a corresponding indicator.
In particular, further, the input element also comprises speech recognition means. A user can then input information by means of speech instead of using the keyboard for this purpose.
Further, as said, the apparatus may particularly be provided with speech synthesis means for reading out the contents of the line. The contents of the line may, for instance, be read out by actuating a particular key of the input element. The apparatus may, for instance, also comprise a mobile telephone and/or an electronic calendar as one or more of the possible applications. For this purpose, the apparatus comprises, for instance, the connect key 50 and disconnect key 52. The apparatus may also be designed to communicate with a computer or a computer network via, in this example, the input and output 26. Of course, the apparatus may also be provided with wireless technology such as Bluetooth technology for making connections with other machines.
Fig. 6 shows an overview of an example of a possible application, namely notes. In Fig. 6, reference numeral 30 designated the first-type object which relates to the highest level of the user interface within the apparatus. So, it is shown that the apparatus is provided with two applications, namely "notes" and "phone". When the application "notes" is selected by means of the arrow keys 8 and when then the OK key is pressed, the application "notes" is started. After starting the application "notes", a third-type object 32 is activated, namely a "record list". How all this can be operated is indicated by means of arrows and corresponding keys. For instance, by selection of the indication "hobby" by means of the vertical arrow keys 8a and 8c, and by key combinations involving the arrow key 8d and the OK key, another third-type object 34 is can be selected. Completely analogously, Fig. 7 shows an example of. a sub-application of the application "notes". This sub -application, named "notes editor menu" in Fig. 7, is started from, for instance, a "record" list when the "multiline editor" has been selected and actuated. By operating the menu key 10, in this example, the first-type object 36 is started. The first-type object 36 relates to the highest level of the user interface within the sub -application "notes editor menu". Further operation of the "notes editor menu" follows directly from the drawing according to Fig. 7. It comprises second-type objects 40, fourth-type objects 42 and fifth-type objects 44. By actuation of the program key, for instance, the horizontal menu can directly be selected which is at the highest level of the user interface within the apparatus. By actuation of the menu key, the horizontal menu can be activated which is at the highest level within an application or sub -application. The apparatus may further be provided with a collection of second arrow keys 8a', 8b', 8c', 8d'. Thus, the apparatus can be designed such that the arrow keys 8a-8d are used for navigating between different programs, objects and the like, while the arrow keys 8a'-8d' are used for selecting an indication within a particular object.
The invention is by no means limited to the above-described exemplary embodiments. For instance, the Braille reading line of the Braille display may have a number of Braille cells different from 20. Also, the Braille display may comprise a number of horizontal Braille reading lines placed one above the other. Completely analogous to what was discussed hereinabove, on a Braille display, also, the line may be represented. If the line comprises more characters than a horizontal line of the Braille display, the line may be represented as a whole, distributed over multiple horizontal lines of the Braille display. So, single actuation of a switch 21 then, for instance, relates to a topmost Braille line of the Braille display and a double actuation of a switch 21 relates to a Braille line below that. Also, the input element may comprise a mouse and/or a touch screen. Such variants are each understood to be within the scope of the invention.

Claims

1. An apparatus for providing access to software applications such as a word processor or a spreadsheet and/or hardware applications such as a telephone to visually impaired persons, at least by presenting information on a line, provided with at least one Braille display and/or speech synthesis means for conveying the contents of at least a part of the line to the visually impaired person and at least one input element for inputting information, wherein the apparatus is further provided with a user interface for presenting the information on the line and for processing information inputted by means of the input element, characterized in that the user interface is built up from at least one first-type object and at least one second-type object, wherein: each first-type object comprises a horizontal menu of which at least a part can be presented in the line, wherein the horizontal menu comprises a number of indications to be selected placed next to one another, wherein one of the presented indications can be selected by means of the input element and wherein the user interface presents in the line which indication has been selected and wherein a selected indication of the first-type object can be confirmed by means of the input element; each second-type object comprises a vertical menu provided with a number of indications to be selected placed one below the other wherein, of the indications of the second object, only a selected indication is presented in the line wherein, by means of the input element, it can be inputted which indication is selected from the vertical menu and is presented in the line and wherein, by means of the input element, a selected indication of the second-type object can be confirmed, wherein an indication of the second-type object can relate to a particular function of an application or to a particular sub-application of an application; by selecting and confirming one of the indications from one of the first-type objects, one of the second-type objects can be selected for presentation in the line; and wherein one first-type object of the first-type objects relates to a highest level of the user interface within an application or within a sub -application of an application, wherein the indications can at least relate to at least one second-type object of the second-type objects or wherein one first-type object of the first-type objects relates to a highest level of the user interface within the apparatus, wherein the indications relate to different applications or sub-applications of the apparatus.
2. An apparatus according to claim 1, characterized in that, by selection and confirmation of an indication of a first-type object which relates to the highest level of the user interface within an application or sub -application, wherein the indication relates to a second-type object of the application or sub-application of the second-type objects, the second-type object is selected for presentation in the line.
3. An apparatus according to claim 1 or 2, characterized in that, by selection and confirmation of an indication of the first -type object which relates to the highest level of the user interface within the apparatus, wherein the indication relates to an application or sub -application, the respective application or sub -application is activated.
4. An apparatus according to any one of the preceding claims, characterized in that, by selection and confirmation of one of the indications of a second-type object of an application or sub -application, a function of the application or sub -application can be activated.
5. An apparatus according to claim 5, characterized in that, by selection and confirmation of an indication of a second-type object which corresponds to an application, a sub -application of the application can be activated.
6. An apparatus according to any one of the preceding claims, characterized in that, by operation of the input element in a predetermined manner when a sub-application is active, a first-type object of the sub-application which is active can be selected for presentation in the line.
7. An apparatus according to any one of the preceding claims, characterized in that, by selection and confirmation of an indication of one of the first-type objects which corresponds to a particular application or sub -application, one of the second-type objects which corresponds to the same application or sub-application can be selected for presentation in the line.
8. An apparatus according to any one of the preceding claims, characterized in that, by selection and confirmation of a predetermined indication from one of the second-type objects of a particular application or sub-application, one of the first-type objects of the respective application or sub-application can be returned to for presentation of the first-type object in the line.
9. An apparatus according to claim 3, characterized in that, upon activating the application, a second-type object of the application is presented in the line.
10. An apparatus according to any one of the preceding claims, characterized in that, by operation of the input element in a predetermined manner, the first object of an application or sub -application which is active can be selected so that the first object is presented in the line.
11. An apparatus according to any one of the preceding claims, characterized in that, by operation of the input element in a predetermined manner, one of the first-type objects of a particular application or sub-application can be selected for presentation in the line when, on the line, one of the second-type objects is presented which relates to the latter application or sub-application.
12. An apparatus according to any one of the preceding claims, characterized in that, by operation of the input element in a predetermined manner, one of the first-type objects which relates to the highest level of the user interface within the apparatus can be selected for presentation in the line.
13. An apparatus according to any one of the preceding claims, characterized in that each sub-application comprises only one (1) of the first-type objects:
14. An apparatus according to any one of the preceding claims, characterized in that the highest level of the user interface within the apparatus comprises only one (1) of the first objects.
15. An apparatus according to any one of the preceding claims, characterized in that, by means of the input element, it can be determined which part of the line is represented on the Braille display.
16. An apparatus according to claim 15, characterized in that, by operation of the input element, in horizontal direction, successive, possibly overlapping parts of the line can be selected for, for instance, representation on the Braille display or for conveyance through speech, wherein the order of the respectively selected parts of the line traversed by operation of the input element is cyclic.
17. An apparatus according to any one of the preceding claims, characterized in that, by operation of the input element, in vertical direction, successive indications of the second object can be presented in the line, wherein the order of the indications respectively presented in the line traversed by operation of the input element is cyclic.
18. An apparatus according to any one of the preceding claims, characterized in that the indications of the first -type object are fixed.
19. An apparatus according to any one of the preceding claims, characterized in that the indications of the second-type object are fixed.
20. An apparatus according to any one of the preceding claims, characterized in that the user interface further comprises at least one third-type object of which at least a part can be presented in the line, wherein the third object comprises a vertical menu comprising a variable number of variable indications to be selected placed one below the other of which one at a time can be presented in the line, wherein, by means of the input element, it can be selected which indication from the vertical menu is presented in the line and wherein, by means of the input element, a selection of a presented indication can be confirmed.
21. An apparatus according to claim 20, characterized in that, by selection and confirmation of at least one indication of at least one of the first-type objects, second-type objects and/or third-type objects, one of the third-type objects can be selected for presentation in the line.
22. An apparatus according to claim 20 or 21, characterized in that one of the third-type objects can comprise at least one of the following types of indications: "new record", "category" and "title", wherein, by selection of an indication of the type "title" and confirmation, a file is opened, by selection of an indication of the type "category" and confirmation, a folder/directory is opened and wherein, by selection and confirmation of an indication of the type "new record", an new file or a new folder/directory with correspondin indication can be created, which indication is included in the third object.
23. An apparatus according to claim 22, characterized in that the indication of the type "new record" has been included above the indication of the types "category" and "title" in the column of the third-type object.
24. An apparatus according to claim 22 or 23, characterized in that a folder/directory comprises a collection of files.
25. An apparatus according to claim 24, characterized in that, by ■ selection and confirmation of an indication of the type "category", one of the third-type objects is selected for presentation in the line.
26. An apparatus according to claim 25, characterized in that the third-type object presented by selection and confirmation of an indication of the type "category" can comprise indications of the types "title", "new record" or "category", wherein, by selection and confirmation of an indication of the type "new record", a new title can be created, wherein the latter category is a subcategory of the former category.
27. An apparatus according to any one of preceding claims 20-26, characterized in that, by operation of the input element, in vertical direction, successive indications of the third -type object can be presented in the line, wherein the order of the indications respectively presented in the line traversed by operation of the input element is cyclic.
28. An apparatus according to any one of preceding claims 20-27, characterized in that the topmost indication in the column of the third -type object gives a label (for instance the name or description) of the third-type object.
29. An apparatus according to any one of the preceding claims, characterized in that the user interface further comprises at least one fourtli-type object of which at least a part can be presented in the line, wherein the fourth object comprises a vertical menu comprising a number of indications to be selected placed one below the other in the form of input fields, for instance with an input cursor, wherein one input field at a time can be presented in the line, wherein, by means of the input element, it can be selected which input field from the vertical menu is presented in the line and wherein, by means of the input element, information can be inputted into a selected input field.
30. An apparatus according to claim 29, characterized in that the input fields of the fourth-type object relate to one (1) application or sub-application.
31. An apparatus according to claim 29 or 30, characterized in that a fourth-type object can be selected for presentation in the line by selecting and confirming at least one indication of at least one of the first, second and/or third-type objects.
32. An apparatus according to any one of claims 29-31, characterized in that the fourth-type object can comprise at least one of the following types of input fields: "edit control", "selection control" or "multiline control", wherein, by means of the input unit, with "edit control", particular types of information, such as a name or address, can be inputted, with "selection control", an information unit from a predetermined collection of information units can be inputted and wherein, with "multiline control", more than one line of text can be inputted.
33. An apparatus according to claim 32, characterized in that the fourth-type object which comprises the input field "edit control" also comprises an indication in the form of a label which indicates what can be inputted and that the fourth-type object which comprises the input field
"selection control" also comprises an indication in the form of a label which indicates from which predetermined collection of information units, information units can be inputted.
34. An apparatus according to any one of the preceding claims, characterized in that the user interface further comprises at least one fifth-type object of which at least a part can be presented in the line, wherein the fifth-type object can comprise at least one indication in the form of a remark, a question or a warning.
35. An apparatus according to claims 1, 2, 29 and/or 34, characterized in that a sub-application can be activated by selection and confirmation of an indication of a first, second, third and/or fourth -type object.
36. An apparatus according to any one of the preceding claims, characterized in that the at least one of the type objects also comprises, in addition to at least one indication, an indicator which provides information about the nature of the contents of the at least one indication, wherein the indication is presented in the line when the corresponding at least one indication is presented in the line.
37. An apparatus according to claim 36, characterized in that, by selection and, possibly, confirmation of the indicator, further information about this nature of the at least one indication is presented in the line.
38. An apparatus according to claim 36 or 37, characterized in that the indicator has been included preceding an indication.
39. An apparatus according to claim 38, characterized in that a horizontal menu is provided with one (1) indication.
40. An apparatus according to claim 38 or 39, characterized in that, in a vertical menu, each indication is provided with a corresponding indication.
41. An apparatus according to any one of the preceding claims, characterized in that the input element comprises a Braille keyboard.
42. An apparatus according to any one of the preceding claims, characterized in that the input element comprises a switching means which runs parallel to the Braille display.
43. An apparatus according to claim 42, characterized in that the switching means comprises a number of switches located next to one another which respectively correspond to Braille cells of the Braille display located next to one another.
44. An apparatus according to any one of the preceding claims, characterized in that the input element comprises speech recognition means and/or a touch screen for inputting information to the user interface by
, means of speech and/or touch.
45. An apparatus according to any one of the preceding claims, characterized in that the apparatus comprises an application in the form of a mobile telephone and/or an electronic calendar.
46. An apparatus according to any one of the preceding claims, characterized in that the apparatus is designed to communicate with a computer or a computer network.
47. An apparatus according to any one "of the preceding claims, characterized in that the apparatus comprises a computer.
48. An apparatus according to any one of the preceding claims, characterized in that an indication comprises a collection of characters.
49. An apparatus according to claim 6, 10, 11 or 12, characterized in that operating the input element in a predetermined manner comprises activating a predetermined key or collection of keys.
PCT/NL2004/000191 2003-03-17 2004-03-17 Apparatus for providing access to software applications and hardware applications to visually impaired persons WO2004083996A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NL1022954A NL1022954C2 (en) 2003-03-17 2003-03-17 Device for providing access to software applications and hardware applications for the visually impaired.
NL1022954 2003-03-17

Publications (2)

Publication Number Publication Date
WO2004083996A2 true WO2004083996A2 (en) 2004-09-30
WO2004083996A3 WO2004083996A3 (en) 2005-01-20

Family

ID=33029098

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NL2004/000191 WO2004083996A2 (en) 2003-03-17 2004-03-17 Apparatus for providing access to software applications and hardware applications to visually impaired persons

Country Status (2)

Country Link
NL (1) NL1022954C2 (en)
WO (1) WO2004083996A2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008000868A1 (en) 2007-03-28 2008-11-06 Ewald Kantner Electronic communication device
EP2194697A1 (en) * 2008-12-05 2010-06-09 Sony Ericsson Mobile Communications AB Mobile terminal having a touch panel with vibration areas and corresponding computer program

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6163280A (en) * 1995-10-24 2000-12-19 Alva B.V. Workstation comprising a braille reading line

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6163280A (en) * 1995-10-24 2000-12-19 Alva B.V. Workstation comprising a braille reading line

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DURRE K P: "BrailleButler: a new approach to non-visual computer applications" PROCEEDINGS OF THE ANNUAL SYMPOSIUM ON COMPUTER BASED MEDICAL SYSTEMS. CHAPEL HILL, JUNE 3 - 6, 1990, LOS ALAMITOS, IEEE COMP. SOC. PRESS, US, vol. SYMP. 3, 3 June 1990 (1990-06-03), pages 97-104, XP010033393 ISBN: 0-8186-9040-2 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102008000868A1 (en) 2007-03-28 2008-11-06 Ewald Kantner Electronic communication device
EP2194697A1 (en) * 2008-12-05 2010-06-09 Sony Ericsson Mobile Communications AB Mobile terminal having a touch panel with vibration areas and corresponding computer program
US8351991B2 (en) 2008-12-05 2013-01-08 Sony Mobile Communication AB Mobile terminal and computer program including a touch-sensitive internal state indicator

Also Published As

Publication number Publication date
WO2004083996A3 (en) 2005-01-20
NL1022954C2 (en) 2004-09-20

Similar Documents

Publication Publication Date Title
JP5456322B2 (en) How to attach metadata to documents and document objects using the operating system user interface
EP3084582B1 (en) Touch/gesture-enabled interaction with electronic spreadsheets
US5929851A (en) Grouping of operations in a computer system
JP4879983B2 (en) Keyboard accelerator
US6014135A (en) Collaboration centric document processing environment using an information centric visual user interface and information presentation method
EP1477892B1 (en) System, method, computer program product and article of manufacture for inputting data in a computer system
US20020126153A1 (en) Apparatus and method for navigating electronic files using an array display
US20140372932A1 (en) Filtering Data with Slicer-Style Filtering User Interface
US20070238488A1 (en) Primary actions menu for a mobile communication device
EP0620516A1 (en) Computer system using the notebook metaphol
US20070234235A1 (en) Activities/applications menu for a mobile communication device
WO2014200800A1 (en) Simplified data input in electronic documents
WO2007008524A2 (en) Rich drag drop user interface
EP1902354A2 (en) Rich drag drop user interface
EP1977340A2 (en) Application of metadata to documents and document objects via a software application user interface
KR20020060082A (en) Method of stroing data in a personal information terminal
US20100306706A1 (en) Visual-editing toolbar menu while using text editor
US20010004260A1 (en) Method, system, and graphic user interface for file system navigation
US9223901B2 (en) Method for selecting elements in textual electronic lists and for operating computer-implemented programs using natural language commands
JPH06242886A (en) Electronic mail system
CN106970899A (en) A kind of text handling method and device
EP2479647A9 (en) Active command line driven user interface
WO2004083996A2 (en) Apparatus for providing access to software applications and hardware applications to visually impaired persons
CN106126048B (en) Method and device for inquiring contact information of mobile equipment
KR20130083957A (en) Systems and methods for controlling communication module and performing tasks by virtual-dividable mouse pointer on the touch screen device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase