This application is a national stage filing under 35 U.S.C. §371 of International Application No. PCT/EP02/04206, filed Apr. 16, 2002, which published in the English language.
The present invention generally relates to a human interface of a data processing system and, more particularly, relates to computer-implemented methods and computer systems to interact with a computer through a human interface.
In prior art systems, human interfaces are described with a standardized human interface description language (SIDL). The term “human interface” as used hereinafter, describes any kind of application interface for a human to interact with application programs that run on a computer. Examples for human interfaces are graphical user interfaces (GUI) or voice user interfaces (VUI).
Typically the SIDL is a “Extensible Markup Language” (XML) based language that provides a set of layout components. A layout component comprises description instructions that describe a specific element of the human interface. These description instructions are called layout element (LE), hereinafter. A transformer program, comprising transformation rules, transforms the layout element into a browser compliant description.
A browser, as used hereinafter, is a computer program that “renders” a document which is written, in a markup language, such as “Hyper Text Markup Language” (HTML), “Wireless Markup Language” (WML) or “Voice Extensible Markup Language” (VXML), into a visual or audio presentation of this document. A browser can be device specific. For example, a browser that renders a HTML document on a personal computer screen differs from a browser that renders a WML document on a wireless application protocol (WAP) cell phone display.
The browser compliant description can be rendered by a conventional browser into corresponding visual or audio layout elements on an output device of a computer as part of the human interface. In a SIDL, the layout elements typically have an application independent character, such as “row,” “cell,” “table,” “grid,” etc. Such layout elements can be reused in any context of any application.
In prior art human interfaces, often, the human interface is re-rendered in its initial state after a user interaction occurred. For example, when a user interacts with a web application by inputting data via the human interface and submitting the data to the web application, typically, after the submission of data the human interface shows all input fields with their initial values (e.g. empty or preset with a default value). Sometimes this is inconvenient because the user simply wants to correct a single input out of a plurality of inputs already made. In this case all previous inputs have to be re-entered. Also when complementing inputs already made earlier by a further input, all previous inputs have to be re-entered.
Hence, the present invention provides computer-implemented methods, computer systems and computer program products, to solve the technical problem of prompting a user with a human interface after an interaction of the user with the computer, wherein the human interface “remembers” its status before the interaction. “Remember” in this context is used to describe the ability of the inventive computer system to keep the status of a layout element, such as the expansion status of a hierarchy.
For convenience of explanation and without the intention of limiting embodiments of the present invention, in the following description of the present invention it is assumed that the human interface is a graphical user-interface. However, the term “layout element,” as used hereinafter to describe a graphical layout element, also has a meaning in a voice human interface, where it corresponds to a sequence of sounds (e.g., spoken words) that follows a specific dialogue (interaction) schema.
A solution to the technical problem, according to a preferred embodiment of the present invention, may be provided by the following characteristics: The inventive computer system:
a) provides a human interface description to prompt an user for data input; and
b) receives data from the user, wherein the data comprise a status of at least one layout element of the human interface description.
Optionally, the inventive computer system
c) stores the data.
When providing a) the human interface description, in a preferred embodiment, the inventive computer system may
d) provide a layout template and a data description;
e) instantiate a data instance from the data description; and
f) merge the data instance with the layout template into an human interface description.
Therefore, it is a further advantage of the present invention that the user, upon inputting data through the human interface and submitting the data, may be prompted with an human interface that shows the same status as before the data submission occurred. For example, when the user has expanded a hierarchy to input data that relate to a certain node of the hierarchy, the expansion status of the hierarchy after data submission remains the same as of before data submission.
At any place in the description of the present invention where a style sheet language transformation, such as XSLT, is used to define transformation or conversion rules, alternatively, a person of skill in the art can implement these rules in any programming language, such as Java, as well.
The aspects of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. It is to be understood that both, the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as described.
Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. For convenience of explanation the reference number table at the end or the description lists the most important reference numbers and their descriptions.
Computers 900-902 are coupled via inter-computer network 990. Computer 900 comprises processor 910, memory 920, bus 930, and, optionally, input device 940 and output device 950 (I/O devices, user interface 960). As illustrated, the invention is present by computer program product 100 (CPP), program carrier 970 and program signal 980, collectively “program.”
In respect to computer 900, computer 901/902 is sometimes referred to as “remote computer,” computer 901/902 is, for example, a server, a router, a peer device or other common network node, and typically comprises many or all of the elements described relative to computer 900. Hence, elements 100 and 910-980 in computer 900 collectively illustrate also corresponding elements 10q and 91q-98q (shown for q=0) in computers 90q.
Computer 900 is, for example, a conventional personal computer (PC), a desktop and hand-held device, a multiprocessor computer, a pen computer, a microprocessor-based or programmable consumer electronics, a minicomputer, a mainframe computer, a personal mobile computing device, a mobile phone, a portable or stationary personal computer, a palmtop computer or the like.
Processor 910 is, for example, a central processing unit (CPU), a micro-controller unit (MCU), digital signal processor (DSP), or the like.
Memory 920 symbolizes elements that temporarily or permanently store data and instructions. Although memory 920 is conveniently illustrated as part of computer 900, memory function can also be implemented in network 990, in computers 901/902 and in processor 910 itself (e.g., cache; register), or elsewhere. Memory 920 can be a read only memory (ROM), a random access memory (RAM), or a memory with other access options. Memory 920 is physically implemented by computer-readable media, such as, for example: (a) magnetic media, like a hard disk, a floppy disk, or other magnetic disk, a tape, a cassette tape; (b) optical media, like optical disk (CD-ROM, digital versatile disk—DVD); (c) semiconductor media, like DRAM, SRAM, EPROM, EEPROM, memory stick, or by any other media, like paper.
Optionally, memory 920 may be distributed across different media. Portions of memory 920 can be removable or non-removable. For reaching from media and for writing in media, computer 900 may use devices well known in the art such as, for example, disk drives, tape drives.
Memory 920 stores support modules such as, for example, a basic input output system (BIOS), an operating system (OS), a program library, a compiler, an interpreter, and a text-processing tool. Support modules are commercially available and can be installed on computer 900 by those of skill in the art. For simplicity, these modules are not illustrated.
CPP 100 comprises program instructions and—optionally—data that cause processor 910 to execute method steps of the present invention. Method steps are explained with more detail below. In other words, CPP 100 defines the operation of computer 900 and its interaction in network system 999. For example and without the intention to be limiting, CPP 100 can be available as source code in any programming language, and as object code (“binary code”) in a compiled form. Persons of skill in the art can use CPP 100 in connection with any of the above support modules (e.g., compiler, interpreter, operating system).
Although CPP 100 is illustrated as being stored in memory 920, CPP 100 can be located elsewhere. CPP 100 can also be embodied in carrier 970.
Carrier 970 is illustrated outside computer 900. For communicating CPP 100 to computer 900, carrier 970 is conveniently inserted into input device 940. Carrier 970 is implemented as any computer readable medium, such as a medium largely explained above (cf. memory 920). Generally, carrier 970 is an article of manufacture comprising a computer readable medium having computer readable program code means embodied therein for executing the method of the present invention. Further, program signal 980 can also embody computer program 100. Signal 980 travels on network 990 to computer 900.
Having described CPP 100, program carrier 970, and program signal 980 in connection with computer 900 is convenient. Optionally, program carrier 971/972 (not shown) and program signal 981/982 embody computer program product (CPP) 101/102 to be executed by processor 911/912 (not shown) in computers 901/902, respectively.
Input device 940 symbolizes a device that provides data and instructions for processing by computer 900. For example, device 940 is a keyboard, a pointing device (e.g., mouse, trackball, cursor direction keys), microphone, joystick, game pad, scanner. Although the examples are devices with human interaction, device 940 can also operate without human interaction, such as, a wireless receiver (e.g., with satellite dish or terrestrial antenna), a sensor (e.g., a thermometer), a counter (e.g., goods counter in a factory). Input device 940 can serve to read carrier 970.
Output device 950 symbolizes a device that presents instructions and data that have been processed. For example, a monitor or a display, (cathode ray tube (CRT), flat panel display, liquid crystal display (LCD), speaker, printer, plotter, vibration alert device. Similar as above, output device 950 communicates with the user, but it can also communicate with further computers.
Input device 940 and output device 950 can be combined to a single device; any device 940 and 950 can be provided optional.
Bus 930 and network 990 provide logical and physical connections by conveying instruction and data signals. While connections inside computer 900 are conveniently referred to as “bus 930,” connections between computer 900-902 are referred to as “network 990.” Optionally, network 990 comprises gateways being computers that specialize in data transmission and protocol conversion.
Devices 940 and 950 are coupled to computer 900 by bus 930 (as illustrated) or by network 990 (optional). While the signals inside computer 900 are mostly electrical signals, the signals in network are electrical, magnetic, optical or wireless (radio) signals.
Networking environments (as network 990) are commonplace in offices, enterprise-wide computer networks, intranets and the internet (i.e., world wide web). The physical distance between a remote computer and computer 900 is not important. Network 990 can be a wired or a wireless network. To name a few network implementations, network 990 is, for example, a local area network (LAN), a wide area network (WAN), a public switched telephone network (PSTN), an Integrated Services Digital Network (ISDN), an infra-red (IR) link, a radio link, like Universal Mobile Telecommunications System (UMTS), Global System for Mobile Communication (GSM), Code Division Multiple Access (CDMA), or satellite link.
Transmission protocols and data formats are known, for example, as transmission control protocol/internet protocol (TCP/IP), hyper text transfer protocol (HTTP), secure HTTP, wireless application protocol. unique resource locator (URL), a unique resource identifier (URI), hyper text markup language (HTML), extensible markup language (XML), extensible hyper text markup language (XHTML), wireless application markup language (WML), etc.
Interfaces coupled between the elements are also well known in the art. For simplicity, interfaces are not illustrated. An interface can be, for example, a serial port interface, a parallel port interface, a game port, a universal serial bus (USB) interface, an internal or external modem, a video adapter, or a sound card.
Computers and programs are closely related. As used hereinafter, phrases, such as “the computer provides” and “the program provides,” are convenient abbreviations to express actions by a computer that is controlled by a program. Furthermore, the term “preferably” is nonexclusive and means “preferably, but not limited to.”
It is not important for the present invention, where computer programs, files or documents are stored in computer system 999. For convenience of explanation, they are stored in memory 920 of computer 900.
The human interface example that is used throughout the detailed description is a survey application example. The controller of a company wants to capture financial planning data for the fiscal year 2002 from other managers in the company. For this reason, the controller creates a survey questionnaire, comprising various question groups. Each question group refers to a specific field, such as “planned costs,” or “planned revenues.” Each question group can comprise various questions. The question used in this example belongs to the question group “planned costs” and captures “Planned travel costs 2002:”. Managers prompted with the questionnaire input their planning data next to the test of the question in a corresponding input field and submit the data after having filled in the relevant planning data.
All tables with program coding sections that are used in the description are exemplary and explanatory only and not intended to provide a fully functional computer program coding.
Preferably, method 400 may comprise the following steps a) and b):
a) providing 475 human interface description 160 to prompt an user for data input; and
b) receiving 480 data 170 from the user, wherein the data 170 comprise a status of at least one layout element 122, 123, 124-1, 124-2, 125, 126, 127 of human interface description 160.
In a preferred embodiment of method 400, the providing step 475 may comprise further the steps d) to f):
d) providing 450 layout template 140-1 and data description 140-2;
e) instantiating 460 data instance 150 from data description 140-2; and
f) merging 470 data instance 150 with layout template 140-1 into human interface description 160.
Method 400 further comprises the optional step
c) storing 485 (dashed line) data 170.
The steps are now explained in detail.
In the providing step 475, computer system 999 (cf.
When computer system 999 renders human interface description 160, the user may be prompted with a screen that has a structure similar to the layout elements shown in
In the receiving data step 480, a computer of computer system 999 (e.g. computer 900, cf.
Preferably, data 170 may be received in a format that comprises a name and a value for each data set of data 170 (cf., table 2). Preferably, the name of each data set may correspond to a XML Path Language (XPATH).
XPath is a language that describes a way to locate and process items in XML documents by using an addressing syntax based on a path through the document's logical structure or hierarchy. The XPath language is described in the “XPath W3C Recommendation Version 1.0, Nov. 16, 1999.” XPath also allows the application programmer to deal with the document at a higher level of abstraction. XPath is a language that is used by and specified as part of both, XSLT and XPointer (SML Pointer Language). It uses the information abstraction defined in the XML Information Set (Infoset). Since XPath does not use XML syntax itself, it could be used in contexts other than those of XML.
Table 2 illustrates data 170 in the survey example. Each row of table 2 corresponds to a data set of data 170. In the example, the name of each data set is a XPath.
A first data set (table 2, line 2) corresponds to the first input field instruction and represents the status information of layout element page 127 (cf. table 1, line 10;
In the optional storing data step 485 (dashed lines), data 170 may be stored in memory. Preferably, data 170 are stored in data instance 150. In the example, the XPath in the name column of table 2 is compliant with data instance 150 structure (cf. table 3) and indicates the storage location of the corresponding value of each data set.
The value=“/survey/planned_costs/travel” may be stored as value of page 127 attribute cursorPos (cf. table 3, line 7) at “state”-location <env:envelope><env:states><uicl:page . . . cursorPos=“ . . . ”> (cf. table 3, lines 6-9). Optionally, data 170 can also be stored elsewhere (e.g., in any memory 920, 920, 922 of computer system 999). When individual document description 160 is rendered at least a second time, function a) (cf. table I, line 4a) is executed to retrieve the page 127 layout element status information from data instance 150 and sets the cursor position accordingly.
Optionally, a second data set (cf. table 3, third row) of data 170 for the planned travel cost is stored in data instance 150 at the corresponding Location. In the survey example, the storage location in data instance 150 is implicitly known from the name column of table 2 (e.g. “//survey/planned_costs/travel”). The corresponding value (“5000”, line 13) was entered by the user as planned travel cost value.
Preferably, data instance 150 may be a markup language document, such as an XML document. Table 3 gives a XML example of data instance 150 in the survey example. The following line numbers refer to table 3. Table 3 illustrates an XML envelope (lines 2, 17) comprising runtime dependent data user name (“USER1”, line 4) in its header (lines 3, 5), whereas a data description (lines 11-13) forms its body (lines 10, 16). Layout element status information is stored in lines 6-9. The envelope name space is represented by the prefix “env:”.
Optionally, after having stored or before storing data 170, the data 170 can be processed by an application program (e.g. computer program 101, cf.
d) providing 450 layout template 140-1 (cf.
e) instantiating 460 data instance 150 (cf.
f) merging 470 data instance 150 with layout template 140-1 into human interface description 160 (cf.
The steps d) to f) are now explained in detail.
In the providing 450 step, computer system 999 may provide layout template 140-1 and data description 140-2. For example, layout template 140-1 and data description 140-2 may be retrieved from memory 920 (cf.
Preferably, layout template 140-1 is a style sheet language transformation, such as XSLT, that comprises XSL instructions with layout information. These instructions are applied to a XML document, such as data instance 150, that comprises data. Table 4 shows layout template 140-1 that is used in the survey example.
The function of layout template 140-1 is explained in detail in the merging step 470 description of
Preferably, data description document 140-2 is written in a markup language, such as XML. The data description 140-2 that is used in the survey example is shown in table 5. The following line numbers refer to table 5. Line 1 indicates a XML document. Lines 2-4 define the data path “//survey/planned_costs/travel” of default value “0.0” (line 4). The closing tags </ . . . > (lines 4 to 6) complete the definition of the data path.
In the instantiating step 460, computer system 999 may complement data description 140-2 by further runtime dependent data (data that are created or modified during runtime) resulting in data instance 150 (cf. table 3). By way of a non-limiting example, runtime dependent data include user name, document creating date, session ID, error messages, and layout element status, etc.
If required, data instance 150 may be modified, for example, by an application program (e.g., computer program 101 on computer 901). This may be achieved through interface 155. For example, computer system 999 (cf.
In the merging step 470, layout template 140-1 may be applied to data instance 150. Preferably, this may correspond to a style sheet transformation (cf. table 4) of data instance 150 where layout element information is merged with data. For convenience of explanation, resulting human interface description 160 is discussed by using the second input field instruction in line 19 of table 1 as an example, because it comprises both layout information and data. The following line numbers without explicit table reference refer to table 4 (layout template 140-1).
Lines 11-15 generate line 19 of table 1. Line 11 generates the second input field instruction with the name attribute “//survey/planned_costs/travel” and the type attribute “text”. Lines 12, 14 define the value attribute. Line 13 comprises an instruction to get the value of the value attribute from a location with “//env:envelope/env:body/survey/planned_costs/travel” as data path. When this instruction is applied to data instance 150, the corresponding value (cf. table 3, line 13) is retrieved as the value of the value attribute of the second input field instruction. When human interface description 160 is merged in the survey example with data instance 150 for the first time, the value would either be the default value “0.0” from data description 140-2 or a value that was modified by an application program through interface 155. When the merging is performed after the user submitted data 170, the value would be the user input “5000” stored in data instance 150 (cf. line 13 of table 3) or a value that was modified by an application program through interface 155.
The user may submit data 170 by using human interface description 160. Data 170 may comprise status information of at least one layout element 122, 123, 124-1, 124-2, 125, 126, 127 (cf.
In the survey example, XHTML instructions (cf. table 1) of individual document description 160 result in layout elements page 127, grid 122, row 123, cells 124-1, 124-2, TextOutput field 126, FieldInput 125 and attribute 125-1. Preferably, a conventional browser renders individual document description 160 to prompt a user with human interface 951 for data input into field 125 on output device 950 (cf.
Having described the present invention as computer-implemented method 400 the invention is now described as computer system 999.
The inventive computer system 899 provides and processes a human interface description.
It may be assumed that computer 900 (cf.
A preferred embodiment of computer system 999 may comprise the following:
a) means for providing 475 (cf.
b) means for receiving 480 (cf.
Preferably, means a) comprises a conventional browser program (not shown), such as the Microsoft Internet Explorer or the Netscape Navigator, executed by a processor of a computer (e.g. processor 910 of computer 900) and a computer program for retrieving human interface description 160 from memory 920. The browser may render human interface description 160 and display the result as human interface 951 (cf.
Preferably, means b) comprises the browser program and the basic input/output system (BIOS) of computer 900. The BIOS is receiving signals from input device 940 via bus 930 (cf.
Optionally, in the preferred embodiment, computer system 999 further comprises
c) means for sorting 485 (cf.
In a preferred embodiment, means further comprises means d), e) and f):
d) means for providing 450 layout template 140-1 and data description 140-2;
e) means for instantiating 460 (cf.
f) means for merging 470 (cf.
Preferably means d) is a computer program that retrieves layout template 140-1 and data description 140-2 from a storage location either inside (e.g. memory 920) or outside of computer system 999 and stores layout template 140-1 and data description 140-2 in a memory of computer system 999 (e.g. memory 920) that can be accessed by means e) and f).
Preferably, means e) is a computer program that reads data description 140-2 from memory 920 and creates data instance document 150 in a runtime portion of memory 920 (e.g., a RAM for storing runtime data) by adding runtime dependent data to the data of data description 140-2. Runtime dependent data may be created or modified, e.g., by an application program (e.g., 101 on computer 901, cf.
Preferably, means f) comprises layout template 140-1, which is a style sheet language transformation document (cf. table 4) in the example. Processor 910 may read layout template 140-1 from memory 920 and apply it to data instance 150. The result is individual human interface description 160 (cf. XHTML example in table 1), which may be a markup language document that is stored in a runtime portion of memory 920.
Having described the present invention as computer implemented method 400 and computer system 999, it is now described as a computer program product 100 (cf.
Computer program product 100 may have a plurality of instructions for causing a processor (e.g., processor 910) of a computer (e.g., computer 900) to create and process a human interface description. Computer program product 100 may cause computer 900 to execute the following steps a) and b):
a) providing 475 human interface description 160 to prompt an user for data input; and
b) receiving 480 data 170 from the user, wherein the data 170 comprise a status of at least one layout element 122, 123, 124-1, 124-2, 125, 126, 127 of human interface description 160.
Computer program product 100 may cause computer 900 to further execute the optional step of:
c) storing 485 the data 170.
In a preferred embodiment of the present invention, computer program product 100 may cause computer 900 to execute the providing step a) through the following sub-steps d) to f):
d) providing 450 layout template 140-1 and data description 140-2;
e) instantiating 460 data instance 150 from data description 140-2; and
f) merging 470 data instance 150 with layout template 140-1 into human interface description 160.
Computer program 100 steps a) to f) may be equivalent to method 400 steps a) to f) described in detail under
Computer program product 100 can be stored on computer readable data carrier (e.g. data carrier 970).
Number | Date | Country | Kind |
---|---|---|---|
01118304 | Jul 2001 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP02/04206 | 4/16/2002 | WO | 00 | 7/30/2004 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO03/012632 | 2/13/2003 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5860073 | Ferrel et al. | Jan 1999 | A |
5944781 | Murray | Aug 1999 | A |
6023714 | Hill et al. | Feb 2000 | A |
6083276 | Davidson et al. | Jul 2000 | A |
6192380 | Light et al. | Feb 2001 | B1 |
6226632 | Takahashi et al. | May 2001 | B1 |
6279015 | Fong et al. | Aug 2001 | B1 |
6429882 | Abdelnur et al. | Aug 2002 | B1 |
6516349 | Lieberman | Feb 2003 | B1 |
6582474 | LaMarca et al. | Jun 2003 | B2 |
6589290 | Maxwell et al. | Jul 2003 | B1 |
6603489 | Edlund et al. | Aug 2003 | B1 |
6651217 | Kennedy et al. | Nov 2003 | B1 |
6701308 | Chen et al. | Mar 2004 | B1 |
6701486 | Weber et al. | Mar 2004 | B1 |
6801224 | Lewallen | Oct 2004 | B1 |
6922810 | Trower et al. | Jul 2005 | B1 |
6928623 | Sibert | Aug 2005 | B1 |
6941510 | Ozzie et al. | Sep 2005 | B1 |
6968503 | Chang et al. | Nov 2005 | B1 |
6981028 | Rawat et al. | Dec 2005 | B1 |
7039863 | Caro et al. | May 2006 | B1 |
7058886 | Sulistio et al. | Jun 2006 | B1 |
7117429 | Vedullapalli et al. | Oct 2006 | B2 |
7143359 | Aggarwal et al. | Nov 2006 | B2 |
7222087 | Bezos et al. | May 2007 | B1 |
7234105 | Bezrukov et al. | Jun 2007 | B2 |
7324983 | Morris et al. | Jan 2008 | B1 |
7392468 | Igata et al. | Jun 2008 | B2 |
20010014900 | Brauer et al. | Aug 2001 | A1 |
20010056460 | Sahota et al. | Dec 2001 | A1 |
20020054081 | Mimoun | May 2002 | A1 |
20020093530 | Krothapalli et al. | Jul 2002 | A1 |
20020111963 | Gebert et al. | Aug 2002 | A1 |
20040003341 | alSafadi et al. | Jan 2004 | A1 |
20040039988 | Lee et al. | Feb 2004 | A1 |
20040083453 | Knight et al. | Apr 2004 | A1 |
20040205530 | Borg | Oct 2004 | A1 |
20040249487 | Ahlert et al. | Dec 2004 | A1 |
20050034066 | Ahlert et al. | Feb 2005 | A1 |
20050120043 | Lee et al. | Jun 2005 | A1 |
20060224397 | Morris et al. | Oct 2006 | A1 |
20070186150 | Rao et al. | Aug 2007 | A1 |
Number | Date | Country |
---|---|---|
0 812 088 | Dec 1997 | EP |
1100013 | May 2001 | EP |
WO 9917193 | Apr 1999 | WO |
WO 9963473 | Dec 1999 | WO |
WO 0033535 | Jun 2000 | WO |
WO 0034860 | Jun 2000 | WO |
WO 0052564 | Aug 2000 | WO |
WO 0052596 | Sep 2000 | WO |
WO 0072197 | Nov 2000 | WO |
WO 0118630 | Mar 2001 | WO |
WO 0118630 | Mar 2001 | WO |
WO 0129636 | Apr 2001 | WO |
Number | Date | Country | |
---|---|---|---|
20040249486 A1 | Dec 2004 | US |