Printing using secure pickup

COPYRIGHT NOTICE

[0001] This patent specification contains material that is subject to copyright protection. The copyright owner has no objection to the reproduction of this patent specification or related materials from associated patent office files for the purposes of review, but otherwise reserves all copyright whatsoever.

TECHNICAL FIELD OF THE INVENTION

[0002] The present invention relates generally to the field of remote printing, and in particular, to security thereof.

BACKGROUND ART

[0003] Self-configuring networks to which peripherals devices such as printers can be freely connected include, for example, the Apple Talk™ Network by manufactured by Apple Computers Inc. of USA. Such a network allows, for example, laser printers to be connected at will to the network.

[0004] The Internet Engineering Task Force has also made a number of developments aimed at making similar capabilities available in the TCP/IP environment. Such arrangements tend, however, to be relatively inflexible. Thus, for example, although new devices may be connected to a network and may be self-configuring to some degree, there are significant limitations in the variety of devices which can be so connected and which can interact to perform desired functions. Further, known arrangements generally support only point-to-point interoperability. In such a configuration, a new printer can be connected to a local area network (LAN), where personal computers (PC's) previously connected to the network will become aware of that printer. The PC's can thereafter use the printer in a straightforward manner. If, however, a particular PC does not have an appropriate driver matching the printer, that PC will be unable to use the printer to reproduce print jobs in spite of the PC user possibly being aware that a suitable driver was presently available on the network, possibly stored at different locations.

SUMMARY OF THE INVENTION

[0005] It is an object of the present invention to substantially overcome, or at least ameliorate, one or more disadvantages of existing arrangements.

[0006] According to a first aspect of the invention, there is provided a method of conducting a secure process between an originating device and a target device, said method comprising steps of:

[0007] inputting security key information into said originating device;

[0008] establishing said process between said originating device and said target device;

[0009] suspending said process at a stage prior to completion thereof; and

[0010] enabling the suspended process to proceed to completion dependent upon inputting corresponding key information into said target device.

[0011] According to another aspect of the invention, there is provided System for conducting a secure process between an originating device and a target device, said originating device and said target device being interconnected by a network, said method comprising steps of:

[0012] means for receiving security key information at said originating device;

[0013] means for establishing said process between said originating device and said target device;

[0014] means for suspending said process at a stage prior to completion thereof;

[0015] means for receiving corresponding key information at said target device; and

[0016] means for enabling the suspended process to proceed to completion dependent upon receipt of said corresponding key information.

BRIEF DESCRIPTION OF THE DRAWINGS

[0017] One or more embodiments of the present invention will now be described with reference to the drawings, in which:

[0018]
FIG. 1 illustrates a system in which embodiments of the invention can be practiced;

[0019]
FIG. 2 depicts devices connected in a system according to a one particular implementation;

[0020]
FIG. 3 illustrates minimum and backward compatibility between devices in the system of FIG. 2;

[0021]
FIG. 4 shows exemplary network protocols used in the system of FIG. 2;

[0022]
FIG. 5 illustrates direct acquisition of a target device;

[0023]
FIG. 6 shows a “pull service provision” using self-generating chaining for a single interposing device;

[0024]
FIG. 7 shows “push service provision” using self-generating chaining for a single interposing device;

[0025]
FIG. 8 shows “pull service provision” using local self-generating chaining for a plurality of interposing devices;

[0026]
FIG. 9 shows “pull service provision” using centralised self-generating chaining for a plurality of interposing devices;

[0027]
FIG. 10 illustrates a flow process for self-generating chaining;

[0028]
FIG. 11 depicts establishment of a communication session with a legacy device;

[0029]
FIG. 12 illustrates a configuration for the incorporation of security features;

[0030]
FIG. 13 illustrates use of a separate local display by an initiating device having a limited display capability;

[0031]
FIG. 14 illustrates an equivalence between devices and services;

[0032]
FIG. 15 depicts an extension of the capabilities of the described arrangements to an external network;

[0033]
FIG. 16 illustrates use of a server with multiple legacy devices;

[0034]
FIG. 17 shows an example of a preferred arrangement;

[0035]
FIG. 18 shows detail for a GUI in the example of FIG. 16;

[0036]
FIG. 19 depicts a print menu of a browser GUI;

[0037]
FIG. 20 is a flowchart showing the generating process of XML code fragment {10} after receiving XML code fragment {8} by a printer; and

[0038]
FIG. 21 is a schematic block diagram representation of a device useful in the arrangements described.

DETAILED DESCRIPTION INCLUDING BEST MODE

[0039] Where reference is made in any one or more of the accompanying drawings to steps and/or features, which have the same reference numerals, those steps and/or features have for the purposes of this description the same function(s) or operation(s), unless the contrary intention appears.

[0040]
FIG. 1 illustrates a telecommunications system 1701 formed about a communications network 1706. The network 1706 typically has associated therewith a server computer 1707. It can be assumed for the purposes of this description that the network 1706 supports the Internet suite of communication protocols commonly known as “IP”.

[0041] As seen, a user has connected a digital camera 1700 to the network 1706, with a desire to print a number of digital images stored in internal memory (not shown) of the camera 1700 via the network 1706. A digital camera is essentially an electronic camera and recorder device and is often termed a “camcorder”. Generic use of such devices often finds such devices simply referred to as “cameras”. Two printers 1702 and 1704 are also shown connected to the network 1706. In order for the images to be printed there must firstly be awareness by the user that the printers 1702 and 1704 are connected to, and thus accessible via, the network. Further, interworking must be possible between the camera 1700 and at least one of the printers 1702, 1704. For example if the images are to be printed with a resolution of 500 dpi (ie. dots per inch), at least one of the printers 1702, 1704 must support the required resolution.

[0042] For the purposes of the present description, each of the devices indicated in FIG. 1 may be considered as a variant of a general-purpose computer system 2100, such as that shown in FIG. 21, with the extent of variation depending upon the specifics of any function or functions the device is required to perform. Generally, the function(s) are interpreted and/or implemented using software, such as an application program, executing within the device and configured where appropriate to communicate with other devices in the system 1701. The software may be stored in a computer readable medium, including the storage devices described below, for example. The software is loaded into the computer from the computer readable medium, and then executed by the computer. A computer readable medium having such software or computer program recorded on it is a computer program product. The use of the computer program product in the computer preferably effects an advantageous apparatus for transparent telecommunications the subject of the present description.

[0043] As seen from FIG. 21, the generic computer system 2100 incorporates a computer module 2101, to which may be coupled input devices such as a keyboard 2102 and mouse 9103, and output devices such as a printer engine 2115 and a display device 2114. For example, in the camera 1700, the input devices would typically be supplemented by a lens and image capture arrangement, and the keyboard 2102 would typically be formed by a reduced function keypad. The mouse 2103 may be formed by a number of scroll keys, the display 2114 formed by an LCD screen, and the printer engine may be omitted. Conversely, in the printers 1702 and 1704, the mouse 2103 would typically not be present and the keyboard 2102 would typically be formed by a reduced function keypad. A status display may be formed by indicator lights or an LCD panel may be used. The printer engine 2115 would be incorporated thereby providing for the print function to be performed. In some instances, the computer system 2100 may be configured as a traditional desktop computer system, or as a server.

[0044] A network interface 2108 incorporating a modem is used by the computer module 2101 for communicating to and from a communications network 2120, for example connectable via a telephone line 2121 or other functional medium able to convey the TCP/IP communications. The network 2120 may be a Local Area Network (LAN) or a Wide Area Network (WAN), or the Internet.

[0045] The computer module 2101 typically includes at least one processor unit 2105, a memory unit 2106, for example formed from semiconductor random access memory (RAM) and read only memory (ROM), an input interface 2113 for any input components such as the keyboard 2102 and the mouse 2103, and an output interface 2107 for any output components such as the display 2114 or printer engine 2115. A mass storage system 2109 may be used depending on the desired function to be performed and where appropriate can include a hard disk drive 2110 and/or a floppy disk drive 2111. A CD-ROM drive 2112 may also provided as a non-volatile source of data to supplement the ROM within the memory 2106. A magnetic tape drive (not illustrated) may also be used.

[0046] The components 2105 to 2113 of the computer module 2101, typically communicate via an interconnected bus 2104 and in a manner which results in a conventional mode of operation of the computer system 2100 known to those in the relevant art. Examples of stand-alone computers on which the described arrangements can be practised include IBM-PC's and compatibles, Sun Sparcstations or alike computer systems evolved therefrom. It will be appreciated that functionally and structurally modified versions of the computer system 2100 may be configured to implement devices such as the printers 1702, 1704 and the camera 1700.

[0047] Typically, the application program is resident in the memory 2106 or 2109 where necessary and read and controlled in its execution by the processor 2105. Intermediate storage of the program and any data fetched from the network 2120 may be accomplished using the semiconductor memory 2106, possibly in concert with mass storage 2109. In some instances, the application program may be supplied to the user encoded on a CD-ROM or floppy disk and read via the corresponding drive 2112 or 2111, or alternatively may be read by the user from the network 2120 via the interface 2108. Still further, the software can also be loaded into the computer system 2100 from other computer readable media including magnetic tape, a ROM or integrated circuit, a magneto-optical disk, a radio or infra-red transmission channel between the computer module 2101 and another device, a computer readable card such as a PCMCIA card, and the Internet and Intranets including e-mail transmissions and information recorded on websites and the like. The foregoing is merely exemplary of relevant computer readable media. Other computer readable media may alternately be used.

[0048]
FIG. 2 depicts a system 101 for transparent telecommunications. A user has connected a camera 102 to a network 100, to which are also connected a number of other devices or services 104, 106 and 108. In the context of the present description, a “device” can provide or perform a “service”. Similarly, a “service” may be supported or performed by a “device”. As such, terms “devices” and “services” can be used interchangeably. The user wishes to print the images stored in the camera 102. Each device 102-108 is depicted as having an information type, a profile, and a discovery/announcement process (eg. 110, 112 and 126 respectively in relation to the device 102). As noted below, not all devices require discovery and announcement capabilities, and it is accordingly sufficient for certain devices to support an announcement capability only. The information 110, with respect to the device 102, represents the information type and/or the information itself, the intended interpretation being clear from the context.

[0049] In the present description, an information type is typically declared and/or defined in the device profile 112. In general, devices of interest transmit, receive, or process different types of information. For example, the camera 102 records visual images, stores the images in an internal memory as the “information” 110. When so commanded, the camera 102 transmits the stored information 110 on an output line to an external device such as a TV display monitor. The profile 112 characterises the information 110. Devices such as the camera 102 can typically operate in different communication modes. Accordingly, the camera 102 can, in a first mode of operation, record images in a compressed format, storing the resultant compressed data in internal memory to obtain the longest “filming time”. Alternatively, the camera 102 can in a second mode, operate in an uncompressed mode, storing uncompressed data with higher quality, but at a cost of providing less recording time. Each such mode has an associated profile 112 characterising service attributes of the associated information 110. Therefore, the camera 102 can have a number of different profiles 112.

[0050] Turning to the issue of “network awareness”, each of the devices 102-108 has a discovery/announcement capability designated 126-132 respectively. It is not necessary for every device to have both an announcement and a discovery capability, however preferably, devices should have at least an announcement capability.

[0051] Service Discovery is a process that provides for services to discover other nearby services on the network 100. Remote services, such as those services described later in more detail with reference to FIG. 14, need not be discovered this way. Almost any Service Discovery system, for example the Jini™ discovery service developed by Sun Microsystems Inc. of the USA, or the protocol referred to as “miniSLP” and described in RFC 2165 entitled “Service Location Protocol” can typically be used in the arrangement of FIG. 2. The service discovery service used in the described arrangements assumes that multicast data delivery is configured for the network 100 and a local-use multicast address is established to cover the local site in which the network 100 may operate.

[0052] Network services multicast an announcement as soon as they connect to the network 100. Such services also multicast at regular intervals, to handle lost packet situations. Services can also multicast whenever a new service appears on the network 100 that was previously unknown to “established” service. Accordingly, a network service learns of the new service, and the new service learns of the “old” service shortly after connection to the network 100. Multicast service announcements also list the services present on the network 100. Therefore, if a service detects an announcement which doesn't list the recipient, then the recipient knows to re-announce itself to the entire network 100.

[0053] The Service Discovery process described above can result in each service learning about any other service as soon as both are connected to the network 100. Such immediate discovery is however not mandatory, particularly in larger networks. The standard mode of operating for the arrangement of FIG. 2 is for every service to receive a Service Description of every other service. This is efficient for small local networks, however, in relation to large sites, it is preferable to make use of a Service Description Directory, such representing a repository of Service Descriptions for devices/services connected to the network 100. The Service Description Directory may for example reside in the server 1707, in the arrangement of FIG. 1.

[0054] Service Discovery is not a preferred place to transfer significant amounts of information about the service itself, such as the service aspects contained within the corresponding profile. The basic intent of Service Discovery is to tell other services the Universal Resource Indicator (URI) identifying the particular service. Other services can then contact that service to obtain the Service Description in a profile matching process. Some small amount of profile information may however be exchanged during the discovery/announcement process, thereby reducing the need for every service to seek or obtain the Service Description of every other service. In the protocol used in the present arrangement, two pieces of extra information are therefore provided, those being the “personality” and “type”. “Type” is a text string, such as “printer”, to describe the service and indicate default information if required, such as an icon for use with a browser service

[0055] If a service is shut down cleanly before removal from a network, then the service it will multicast is a Service Deletion message. If a service crashes or is otherwise removed from a network without being able to issue a Service Deletion message, then other services will notice that the former service ceases to send its regular multicast announcement and will delete their corresponding reference to the former service after testing for its presence.

[0056] After devices discover the presence of each other on the network 100, the devices preferably communicate using the Hypertext Transfer Protocol (HTTP). The devices can parse an XML message which is sent to the HTTP port of the device using the “POST” command of HTTP. A more detailed description of protocols used in the present arrangements is provided with reference to FIG. 8. Examples of XML syntax, commands, data, and service descriptions are found in the Appendix to this description.

[0057] As noted above, each device/service has a personality and a type. The “personality” describes the behaviour of the device/service in the network environment. The personality can be represented by one or more of the following descriptors:

[0058] NO_SERVICE. This descriptor is used when indicating that a service is being deleted from the local environment.

[0059] PASSIVE. This descriptor means that the service will not actively seek to use other services on the local network. As a practical matter, a PASSIVE service will not list other services in its service discovery announcements, nor is there any need for other services to ensure that a passive service knows about them.

[0060] ACTIVE. This is a normal network device or service that is interested in other services on the network.

[0061] COMPUTE. This is a service which provides a platform in which new services can be started.

[0062] REMOTE. A remote service provides services that are discovered in other ways than by service announcements. A REMOTE service need not advertise itself locally at all.

[0063] The “type” is a text string that describes the service offered in a simplified, and possibly coarse manner. Services can access the Service Description to obtain the detailed exact information.

[0064] Typical type names include “printer”, “camera”, “browser”, “DVC”, “DTV”, “control”, “compute”, and “service”. Any unknown name will be treated as a general undefined “service”. The following type names mentioned above deserve particular comment.

[0065] “control” means the device can act as a user control point for some external service.

[0066] Typically such may include a Graphical User Interface (GUI), generally associated with a pointing device such as a computer mouse. Voice or text based control are alternative/additional possibilities. As with printing, “control” does not specify what control protocols the device supports. It is necessary for other services to access the corresponding Service Description to obtain such detailed information.

[0067] “compute” means a device that can be used to start other services. For example, consider a printer that requires a conversion service but has insufficient memory requirements to run the conversion service itself. The printer can request the “compute” service to start the required conversion service.

[0068] Returning to FIG. 2, when the camera 102 is initially connected to the network 100, the associated discovery/announcement process 126 searches for and identifies other devices which are connected to the network 100. This is performed in cooperation between the respective discovery/announcement processes 126-132 in each device 102-108 as described above. The camera 102 thereby discovers the device 104, which is a low resolution printer, by means of respective discovery/announcement processes 126 and 130. The process of discovery/announcement is depicted by the dotted line 134. The camera 102 may also discover the low level printer 104 by means of another service, for example a browser 148 which is connected to the network 100 by a connection 150.

[0069] XML messaging is the communication protocol of preference used between the devices, as noted in the description relating to FIG. 4.

[0070] An example provided below makes use of discover/announcement protocol options, which include the protocol referred to as “miniSLP” mentioned above.

[0071] Like other Service Directory protocols, miniSLP assumes that multicast is configured for the local network 100 and services/devices use a local-use multicast address set up to cover the local site. In miniSLP, the services multicast an announcement as soon as they connect to the network. In the case of miniSLP, two pieces of extra information are provided: the personality (one of a small number of possibilities describing behaviour) and type, which is just a text string such as “printer” to describe the service and indicate a default icon to use if required, in the browser 148.

EXAMPLE 1

XML Sequence Illustrating Discovery/Announcement

[0072] When the browser 148 is informed via the service discovery protocol that the camera 102 has come on-line in the system 101 of FIG. 2, the browser 148 asks for the camera 102 to send its description, in a sequence as follows:

[0073] (i) the camera 102 comes on-line;

[0074] (ii) MiniSLP or Jini or other suitable discovery and/or announcement protocol informs the browser 148 of the presence and address of the camera 102;

[0075] (iii) the browser 148 sends an update request (describe command) to the camera 102 using XML code fragment {1} below:

1<Message from=“http://host/browser”{1}to=http://host/cameratime=“Tue Mar 23 14:12:10 EST 1999”><describe/></Message>

[0076] (iv) the camera 102 then answers with its description according to code fragment {2} below:

2< Message from=“http://host/camera”{2}to=“http://host/browser”time=“Tue Mar 23 14:12:11 EST 1999”><update><device url=“http://host/camera”xmlns=“http://dochost//”xmlns:camera=“http://dochost//camera.html”><identity name=“PowerShot” class=“camera”manufacturer=“Canon” model=“PS350”owner=“CMIS” version=“1.3c”/><location slot=“38a” room=“141” floor=“1”building=“e6b”/><comment comment=“Demo camera”/><content><camera:thumbnails base=“thumbs/”refbase=“images/”start=“301” end=“308”suffix=“.jpg” format=“JPEG”/><camera:images base=“images/”start=“301” end=“308”suffix=“.jpg” format=“JPEG”/></content></update><commands><getData><content><camera:thumbnails/></content></getData><getData><content><Camera:images/></content></getData></commands></Message>

[0077] The browser 148 can then display, as seen in FIG. 18 and later described in detail, the description directly. Alternatively, the browser 148 can wait for the user to select, using a mouse click for example, the camera icon 1602 (see FIG. 18) corresponding to the camera 102. In a further alternative, the browser 148 may take some other action with the newly obtained camera description.

[0078] The discovery/announcement processes of all devices 102-108 connected to the network 100 are sufficiently standardised and compatible to support a minimum level of communication to be established. Aspects of minimum compatibility and backward compatibility are described in further detail in regard to FIG. 3. A device can, in general, search for and discover other devices in a number of different ways. FIG. 2 in this regard illustrates a method based on cooperative search and discovery by all devices. Alternatively, a device need not actively “discover” other devices, but can instead be a passive “listener”, being informed by other devices of their presence. Further, a registry server can provide a Service Description Directory service which is accessible to other devices and services on the network 100.

[0079]
FIG. 3 depicts the aspects of minimum compatibility, and also forward and backward compatibility. This applies to both the discovery/announcement process, and to the profile matching process. In the description below in relation to FIG. 3 only therefore, the term “information” relates both to the information feature 110 and to the discovery/announcement process 126 in device 102 in FIG. 2. Considering a number of different devices connected to a network, a table 1200 as shown in FIG. 3 describes the relationship between the different devices in terms of their information type (in a column 1202), and their information version (in a column 1204). Different information types, in different versions, will generally be present in a system. For example, a device X (designated 1212) supports information type 1 (designated 1206) in version 1 (designated 1208). A device Y (designated 1214) also supports information type 1 (ie. 1206) however in version M (designated 1210). Version 1 represents for example the earliest and/or the most basic version of a particular information type. The arrangement illustrated provides that all devices supporting, for example, information type 1 (ie 1206), irrespective of the information version which they support, can establish communications at least at the version 1 level. Therefore, all devices supporting information type 1 (ie. 1206) can communicate at least at the version 1 (ie. 1208) level. Further, backward compatibility is provided to some extent, which means that a first device supporting information type 1 in version M (column 1210) and a second device supporting information type 1 in a later version N are, despite the apparent version incompatibility, nonetheless often able to communicate at the version M level. FIG. 4 illustrates a further arrangement, providing more detail about the individual elements in the system, and in particular, the preferred network protocols. The preferred protocol suite is, however, merely illustrative, and other protocol suites can be utilised. The present arrangement uses the Internet Protocol and related standards as detailed in the Internet Engineering Task Force Specification RFC 1122 entitled “Requirements for Internet hosts-communication layers”. The required network protocol is defined in the specification RFC 2068 entitled “Hypertext Transfer Protocol-HTTP/1.1”. One or more devices 800 and/or one or more services 802 are connected by physical connections (not shown, but which may be a mixture of wired and/or wireless connections) to a network 804. The network protocol is TCP/IP. Typically, the service 802 has an associated profile 806 which provides a description of the characteristics and attributes of the service 802.

[0080] The configuration of a network layer connection to the network 804 by a service 802 makes use of the DHCP protocol 808, this protocol being described in RFC 2131 entitled “Dynamic Host Configuration Protocol”. The discovery/announcement process by which services and devices identify each other is performed using the miniSLP protocol 810, discussed above. Information exchange between a device 800 and the service 802 depicted by the line 812 is performed using the HTTP protocol described in RFC 2608 entitled “Hypertext Transfer Protocol-HTTP/1.1”, while structured information exchange is performed using the XML protocol. Information on XML can be obtained from World Wide Web Consortium Recommendation REC-XML-19980210 entitled “Extensible Markup Language (XML)”. HTTP/XML communication is made up of commands 814, messages 816, and service/device descriptions 818.

[0081] Returning to FIG. 2, once all the devices 102-108 have discovered each other, thus having established network awareness between the camera 102 and the other devices 104-108, the next issue is interworking compatibility. The profile processes 112 and 138, which as noted are associated with respective information 110 and 136, establish whether the desired print job can be performed. As described in relation to FIG. 3, the profile processes 112, 138, 140 and 144 for all the devices 102-108 connected to the network 100 are sufficiently standardised to be capable of at least a minimum degree of communication. Therefore, an initiating device, such as the camera 102, can identify the population of devices connected to the network, and is, at least to some extent, aware of their attributes and capabilities. The user of the camera 102 is therefore aware, by means of the discovery/announcement process previously discussed, of the low resolution printer 104 which is attached to the network 100. The user is also aware, by virtue of the “personality” and “type” information received during announcement/discovery, of basic service attributes of the printer 104. This information may be sufficient to initiate a print command immediately, however in general, exchange of service description information is required. Therefore, when the user of the camera 102 commands the camera 102 to print the stored images 110 on the printer 104, the following process takes place. In the first instance, communication depicted by a line 114 is established between the profile processes 112 and 138 which are associated with the camera 102 and the printer 104 respectively.

[0082] Thus, for example, if the information 110 in the camera 102 is desired to be printed at a resolution 500 dpi, and the printer 104 is able to print at the desired resolution, then the respective profile processes 112 and 138 conclude that the two devices 102 and 104 are compatible. Once such a “match” between the respective profile processes 112 and 138 is established, communications as designated by the line 116 is established between the camera 102 the printer 104 respectively, and the images in the camera 102 are printed on the printer 104.

[0083] An XML messaging sequence, incorporating the browser 148 into the process, can now be described. Firstly, recall that the camera 102 has announced itself and sent profile information to the browser 148 according to the XML code fragments {1} and {2} provided above. The printing process continues with the user selecting a “thumbnails” icon in the camera description, after which the browser 148 sends the selected element to camera 102. The browser knows that thumbnails can be selected because of the commands element in the corresponding device description of the camera 102.

EXAMPLE 2

Sequence of a Browser Retrieving Thumbnail Images from a Camera

[0084] (i) The browser 148 sends a getData request for one or more elements to the camera 102 as shown in code fragment {3} below:

3<Message from=“http://host/browser”{3}to=“http://host/camera”time=“Tue Mar 23 14:13:05 EST 1999”><getData><camera:thumbnails base=“thumbs/”refbase=“images/” start=“301” end=“308” suffix=“.jpg”format=“JPEG”/></getData></Message>

[0085] (ii) The camera 102 answers as follows, noting that along with each thumbnail image, the camera 102 encapsulates a command which is to be used to retrieve the associated reference image (<getData>). This command will be typically retained by the browser 148 and associated with each retrieved thumbnail image. This is exemplified in code fragment {4} below:

4<Message from=“http://host/camera”{4}to=“http://host/browser”time=“Tue Mar 23 14:13:06 EST 1999”><data><image format=“JPEG” name=“thumbs/301.jpg”><BASE64>image data</BASE64><getData format=“JPEG” name=“images/301.jpg”/></image><image format=“JPEG” name=“thumbs/302.jpg”>etc. (8 images)</data></Message>

[0086] The browser 148 need not have any understanding of the command because the command is intended for the camera 102, not the browser 148. The browser 148 need merely send the command back to the camera 102 at an appropriate point, such as when a user selects a thumbnail for viewing, the browser 148 can then interpret that action as requiring it to send the associated getData command back to the camera, which then yields a larger version of the image for viewing. These associated commands sent with data to a host device or service can also include graphical user interface (GUI) elements and attributes. A GUI may be implicitly built around retrieved data and associated commands inside a host that need not have any comprehension of the commands or associations (the GUI elements and attributes will typically be understood by the host). It is further possible to link multiple devices or services and their various states or conditions into controlling the execution or transmission of associated commands, as well as introducing procedural or scripted code. These facilities can be supported without requiring the host device or service to have or require any understanding of the potential actions it might be hosting.

[0087] When the browser 148 receives the thumbnail image data from the camera 102, the browser 148 typically displays the thumbnail in a content pane of the browser 148, as seen in FIG. 18. There is no “print” command per se in the present arrangement, however instead the printer 104 receives a <data> command that it interprets as a print command. Instead of sending the actual image, the browser 148 sends an image reference to the printer 104. The browser 148 can send to the printer 104 the command to retrieve the image from the camera 102 (getData).

EXAMPLE 3

Sequence of a Browser Directing a Printer to Print an Image from a Camera

[0088] The user typically selects a thumbnail image 1610 displayed in the browser window 1508 and requests to print the related full size image by any reasonable means (including implicit means within the selection process). The browser 148 then sends the getData (or other) command of the camera 102 associated with that thumbnail image to the desired printer 104. The printer 104 and its capabilities or attributes have been previously identified to the browser 148 in the fashion described above. The camera 102 and its capabilities or attributes may or may not have been previously identified to the printer 104.

[0089] (i) The browser 148 sends an image reference to the printer 104. Instead of sending the actual image, the browser 148 sends to the printer 104 the associated command (getData) to retrieve the image from the camera 102. The browser 148 need not have any understanding of the associated command (getData) that the browser 148 had has sent to the printer 104. This is exemplified in code fragment {5} below:

5<Message from=“http://host/browser”{5}to=“http://host/printer”time=“Tue Mar 23 14:14:01 EST 1999”><data url=“http://host/camera”><getData format=“JPEG” name=“images/301.jpg”/></data></Message>

[0090] (ii) The printer 104 then sends a request for the image to the camera 102, the request being identified by the name space or URL in the command received by the printer 104. The printer 104 need not have any understanding of the command (getData) it sends to the camera 102. This is exemplified in code fragment {6}:

6<Message from=“http://host/printer”{6}to=“http://host/camera”time=“Tue Mar 23 14:14:02 EST 1999”><getData format=“JPEG” name=“images/301.jpg”/></Message>

[0091] (iii) The camera 102 sends the image to the printer 104, as seen in code fragment {7}:

7<Message from=“http://host/camera”{7}to=“http://host/printer”time=“Tue Mar 23 14:14:03 EST 1999”><data><image format=“JPEG” name=“images/301.jpg”><BASE64>image data</BASE64><getData format=“JPEG” name=“images/301.jpg”/></image></data></Message>

[0092] When the printer 104 receives the message of code fragment {7}, the printer 104 can recognise that on this occasion actual image data has been received. The printer 104 can then print the image data. Additional interaction with the user may be requested by the printer 104, by sending messages to the browser 148 for example, to present to the user a dialogue asking the user to specify the number of copies to be printed.

[0093] Communications of this type can be embedded into XML documents as references, or as URI's to data which is required to be included, before an operation can be completed. For example, an XML document intended for printing can reference camera images, using the message syntax indicated. The XML document also contains textual content for rendering. The image references can be resolved by the preceding method, prior to rendering.

[0094] Each network service has a service description used in the profile matching process. Such can be formed by an XML file describing substantially static information about the device. Tables A4 to A6 in the Appendix provide more details and examples of such a facility. Explicitly, the XML description covers information that changes on human time scales, such as seconds or preferably longer. A further file called “status” may be provided to contain more rapidly changing information.

[0095] The information in the Service Description is intended to allow other services to plan how to use the service. Examples of information that may appear include:

[0096] Supported resolution;

[0097] Physical location;

[0098] Supported commands (with version number);

[0099] Currently loaded paper tray;

[0100] Available images; and

[0101] Supported image formats.

[0102] Service Description information is available from at least four sources as follows:

[0103] Static information about the hardware or software provided by the manufacturer.

[0104] Information that is entered and updated by the owner of the device such as location, access control and owner's public key;

[0105] Information that the service generates during its operation by examining its own Internal state, for example loaded paper, error status, images or video available; and

[0106] Information that relates to the capabilities of the machine, such as personality; type; and supported commands.

[0107] One service can ask another to notify the former when the Service Description of the other service changes. This is particularly useful for a service like the browser 148 which presents information about the state of the service (eg. the printer 104) to a user. For example, the user can see what paper is currently loaded in the printer 104 or perhaps if a scanner is connected to the network at that point in time.

[0108] The Service Description of a printer specifies that it understands, for example, the “Line Printer Protocol (LPR)” described in IETF RFC 1179. Another service can use that to send print jobs to the printer. The service communication protocol uses TCP/IP.

[0109] Each service is identified by a Universal Resource Indicator (URI), in a manner corresponding to a web page on the World Wide Web (WWW). Just as on the WWW, preferred implementations of the present disclosure use HTTP for communication. HTTP has three basic communication mechanisms:

[0110] GET. This operation is used when a user selects a link in a web browser. The browser GETs the web page addressed by the link and displays the web page.

[0111] POST. This is commonly used on the web when a user enters data in a form and submits the form to the host page. The form data is sent and the web server returns a replacement page which typically reports the success of the submission.

[0112] PUT. This operation is sometimes used for file uploads.

[0113] The arrangements described herein use POST. However instead of sending web form data, the arrangement of FIGS. 2 and 4 sends an XML file that describes a network command. The response received is not a displayable web page but rather another piece of XML giving a response to the network command. Typically, the response merely indicates success or failure, but complex data can be also returned.

[0114] XML is a way of structuring information that looks very much like HTML used in web pages. In fact, well formed HTML is substantially a subset of XML designed to describe how to layout text and other information on a browser page.

[0115] Profile processes, including aspects of compatibility establishment, can be implemented in a number of ways, depending on system priorities. A simplest process is to seek an exact match with a profile name or type. Another option is to pre-grade partial matches (eg an exact resolution match but not a print-size match). A further option is to create profiles of profile matches. For example, meta-meta data can be used to describe the extent to which partial matches are preferable, one over another.

[0116] A number of criteria in accordance with which compatibility can be established are presented in Table 1. Many options exist for how a device or service or a consulted discovery or directory service may select a suitable intermediate service or services. The options can be selected statically or dynamically based on the priorities of the system or its implementors.

8TABLE 1IntermediateServiceSelectionIssues/ExamplesCriteriaExplanation(and/or combinations are possible)Static prioritySelection decisions areI/O matching, quality-matching, etc.based on permanentcriteria.DynamicSelection decisions canJob or media cost, speed, processingprioritychange. eg. could berequirements, storage requirements,based on the job details,quality, etc.user requirements,network and/or serviceactivity level, etc.I/O MatchingDevice/service attributesThis simple method can have drawbacksare compared. Thesuch as not controlling the length of asimplest model is tochain (or the time to build it); nocompare only the nearestguarantee of finding the best chain orport in the stream, ie.any complete chain; potential loss ofdon't check the service'squality or increase in job processingI/O function, only itstime with added intermediate services.nearest interface.Function & I/ODevice/services areThis method provides a better guaranteematchingmatched based on theirof matching a service to the local needs.nearest port in the streamIt still does not guarantee completion ofand another property sucha chain (eg. if a required service isas function or other portmissing then the constraints might bematching, etc.too tight to find an alternative & moreindirect chain)Semi-randomDevice/services areThis method might allow more optimalmatching ormatched based on partiallyselection of a best-match chain or aannealedconstrained data with thenear, best-match chain. Many methodsmatching, etclevel of constraint varyingare possible, and the intent is tounder some conditions.overcome the possibly undesirableeffect of local minima in the ‘chainspace’ of available services.Directory orProvision of lists ofA service can collect and/or provideDiscoveryavailable services,information about the network to anyservicesoptionally along withother service. It can also be used in aadditional informationglobal management capacity to allowsuggesting best fits forsome global control of the inherentlycurrent job criteria (speed,local nature of chain-building.cost, quality, etc).GroupedProvision of lists orA recommended strategy for any stableservicesservice structures ornetwork for providing optimal chain-conglomerates in which abuilding for predictable jobs with typicalsingle service is identifiedcost, quality and speed criteria. Thebut in reality the service islocalised chain-building method needa conglomerate.not know or care how a serviceconglomerate is constructed or what it isconstructed of because only itsinterfaces and external functionaldescription & attributes are relevant inthe chain-building process.Pre-selection orA device or service couldThis hard-coded chain-building methodmanualhave a preset chaincan fail easily if a specified device is notspecification.description encoded.available. A less brittle approach ispossible if some alternatives or onlypartial preselection is hard-coded, givingthe chain-building operation somelimited choices.

[0117] Devices are typically configured to establish sufficient communication to obtain information on operations supported by the device, and associated versions thereof. This is generally performed using a “get description” operation in XML, this operation fetching a description, in XML, of the device. In FIG. 2, the camera 102 has discovered the printer 106 which is, in fact, a “high resolution display”. The camera 102 does not know about such devices, however a “device description” in the high resolution display says that the display is equivalent to the printer 104. This tells the camera 102 enough to be able to use the printer 106.

[0118] The aforementioned description in relation to FIG. 2 related to establishment of direct communication between an initiating device, in that example the camera 102 and a target device, being the printer 104. In that example, therefore, the camera 102 succeeded in itself identifying a desired target device, in this case the printer 104.

[0119]
FIG. 2 further depicts a more complex scenario in which the camera 102 has also discovered that a high resolution printer 106 is available on the network 100. In addition to the compressed and normal recording modes previously described, the camera 102 is further capable of a high resolution recording mode using compressed data. The user wishes to make use of this high resolution printer 106, however when respective profile processes 112 and 140 of the camera 102 and high resolution printer 106 communicate, as depicted by the line 118, it is discovered that the information 110 in the camera 102 cannot, according to the information type 142, be directly processed by the high resolution printer 106. This is because the printer 106 cannot directly input the high resolution compressed data of the information 110.

[0120] At this point, however, the high resolution printer 106 does not merely reject the print job sent from the camera 102. Instead, the printer 106 directs a self generating chaining process by which the printer 106 searches for other devices on the network which can be interposed between the printer 106 and the camera 102, to provide the necessary interworking, if such is possible. The printer 106, by searching the network 100, identifies a decompressor device 108 also present on the network 100. This is an example of “pull service delivery”, as against “push service delivery”, both of which concepts will be described in further detail in relation to FIGS. 5 to 7. Taking into account the previous communication between the profile processes 112, 140 associated with the camera 102 and high resolution printer 106, subsequent communication between the respective profile processes 140 and 144 of the high resolution printer 106 and the decompressor device 108, are sufficient to establish that interworking is possible by use of a tandem communications arrangement. In the present “pull” example, the printer 106 requests the decompressor 108 to fetch data from the camera 102. This request is nested inside the request from the printer 106 to the decompressor 108 for the decompressed data, as will be described in the XML code fragments provided in Example 4 below. It is noted that Example 4 makes reference to an encoder/decoder, commonly referred to as a “codec”, instead of a mere “decompressor”. The tandem arrangement entails the camera 102 sending the print job depicted by information 110 to the decompressor 108. The decompressor 108 decompresses the received information 110 and sends the decompressed information 146 to the high resolution printer 106 which is able to print this decompressed information. The tandem communications established between the camera 102 and decompressor 108, and between the decompressor 108 and the high resolution printer 106 are depicted by dashed lines 122 and 124 respectively.

[0121] FIGS. 5 to 7 provide a more general description of the self generating chaining process applicable to the arrangement of FIG. 2 and introduced above. FIG. 5 illustrates the establishment of direct communication between an initiating camcorder 1000 and a target low resolution printer 1006. The camcorder 1000, via a user thereof, wishes to print information 1002, which is low resolution image information. The information 1002 has a profile “X” designated as 1004. The camcorder 1000 discovers a low resolution printer 1006 by means of a discovery/announcement process depicted by a dashed arrow 1010. The camcorder 1000 and printer 1006 exchange/negotiate respective profile information 1004, 1008 as depicted by a solid arrow 1012, concluding that both devices support profile feature X. It is noted that the profile 1008 of the printer 1006 also is “X” as shown in FIG. 5. Thereafter, the camcorder 1000 and low resolution printer 1006 establish communications as depicted by an arrow 1014 whereby the camcorder 1000 transmits its low resolution picture information 1002 to the low resolution printer 1006, which in turn prints the desired output. This is an example of direct acquisition by the camcorder 1000 of the desired target low resolution printer 1006, in this case, both devices having a common profile feature “X” designated as 1004, 1008 respectively. The profile features 1004, 1006 represent information types/versions as previously described in relation to FIG. 3, where the aspects of minimum and backward version compatibility were described.

[0122]
FIG. 6 shows the camcorder 1000, which in this case contains high resolution picture information 1112, which is associated with the profile feature “Y” 1114. The camcorder 1000 or an additional device (not shown), discovers, as depicted by the dashed arrow 1010, the low resolution printer 1006, which has a profile feature “X” (ie. 1008). The camcorder 1000 or other device (eg. a browser), commands the printer 1006 to retrieve picture information from the camcorder 1000 (in a “pull” service provision approach). At this juncture, there is an apparent mismatch between the camcorder 1000 and the low resolution printer 1006. However, the printer 1006 initiates a “self generating chaining ‘pull’ process” by which it discovers, as depicted by the dashed arrow 1104, a “resolution conversion device” 1108, which is capable of being interposed between the profile feature Y 1004 and the profile feature X 1008.

[0123] Criteria provided in Table 1 above can be used to establish chaining priorities and approaches. The device 1108 has an interworking profile feature “Y→X” (ie. 1108), which can be considered as having a “Y” profile at one interface, and an “X” profile at another interface. Therefore, the device 1108 can interwork between the two other devices 1000, 1006 having respective profiles “Y” and “X”. The “Y” profile of the camcorder 1000 thus matches the “Y” profile of the resolution conversion device 1108, and the “X” profile of the resolution conversion device 1108 matches the “X” profile of the printer 1006. The low resolution printer 1006 ascertains the profile feature 1110 by a process depicted by the arrow 1102. Having ascertained, by means of the self generating chaining, process described, that the resolution conversion device 1108 can be interposed between the camcorder 1000 and the printer 1006, the printer 1006 directs the camcorder 1000 and the resolution conversion device 1108 to establish communications denoted by the arrows 1106 and 1100, thus enabling the high resolution picture information 1112 to be transmitted to the resolution conversion device 1108 as depicted by a line 1106, after which the converted information (converted from high resolution to low resolution suitable for the printer 1006) is transmitted to the low resolution printer 1006 as depicted by a line 1100. The description provided above is directed to high and low resolution printers. The following example addresses a similar situation, however the example is directed in particular towards images in two different formats, namely a first format conforming to the Joint Photographic Experts Group (JPEG) standard and denoted by (.jpg), and secondly, to a bit-mapped format (BMP) generally denoted by (.bmp).

EXAMPLE 4

XML Code Sequence of Pull Service Provision with Camera/Printer Mismatch.

[0124] In an extension to Example 3, in which the browser 148 directed a printer 104 to retrieve and print an image from a camera 102, Example 4 depicts the situation where the printer 104 discovers that it does not have an input format compatible with the output format of the camera 102. It can be assumed that the printer 104 and its capabilities or attributes were previously identified to the browser 148. If the capabilities or attributes of the camera 102 were previously identified to the printer 104, then the printer 104 will be able to compare its input formats with the output formats of the camera 102 and decide if a direct match is available. In this example a direct match is not available. Alternatively, if the capabilities or attributes of the camera 102 were not previously identified or not previously fully identified to the printer 104 then the printer 104 might interrupt the example command sequence below with a describe request, discussed in Table A2 of the Appendix, to either the camera 102 or a similar information request about the camera 102 to an announcement/discovery service (if available). Thereafter, the printer 104 will make the comparison of input and output formats and decide if a direct match is available. This is depicted in the flowchart of FIG. 20 as a method 2000 for a pull service operation, where the method commences at step 2002. The code sequence associated with the method 2000 is as follows:

[0125] (i) Firstly the browser sends an image reference to the printer 104. Instead of sending the actual image, the browser 148 in step 2002 sends to the printer 104 the associated command (getData) to retrieve the image from the camera 102. The browser 148 need not have any understanding of the associated command (getData) it has sent to the printer 104. The XML code pertaining to this transfer is shown in code fragment {8}:

9<Message from=“http://host/browser”{8}to=“http://host/printer”time=“Tue Mar 23 14:14:01 EST 1999”><data url=“http://host/camera”><getData format=“JPEG” name=“images/301.jpg”/></data></Message>

[0126] (ii) The printer 104 then, in step 2006, parses the received XML to extract the attributes of the request. In this regard, the attributes of the request shown above are found in lines 4, 5 and 6 of code fragment {8}. In step 2008, the printer 104 then determines from the attributes if a direct 1/0 format match is available with the camera 102. The printer 104 need not have any understanding of the command (getData) it sends to the camera 102, although typically a device or service would check the format attribute value in the getData command for a match with its own input format capabilities. In this example, the only input format capability of the printer 104 is bitmap (.bmp) and so the printer 104 recognises a failed direct match between its input format and the output format of the camera 102. Accordingly, “NO” from step 2008 is asserted and step 2012 follows. Had there been a match determined in step 2008, the printer 104 according to step 2010 would then have executed the request and sent an XML code fragment {9} as follows:

10<Message from=“http://host/printer”{9}to=“http://host/camera”time=“Tue Mar 23 14:14:02 EST 1999”><getData format=“JPEG” name=“images/301.jpg”/></Message>

[0127] (iii) In step 2012 the printer 104 instead requests/identifies an intermediate service. The printer 104 either consults its own record of available services, or consults another service (typically a discovery and/or announcement service or directory service) for a list of available services that might operate as an intermediate step between the printer 104 and the camera 102. There are many options at this point for how the printer 104 or a consulted discovery or directory service might select a suitable intermediate service or services. The options can be selected statically or dynamically based on the priorities of the system or its implementors. Table 1 illustrates examples of intermediate service selection options. Table 1 also describes a role of a directory service in chaining.

[0128] The printer 104 accordingly identifies a service that has a .bmp output format compatibile with the input format of the printer 104. In this example, the printer 104 makes no check of the input format capabilities of the selected intermediate service. This behaviour is reasonable for a printer 104 that might normally have limited capability (for cost-reduction purposes). More capable selection and reasoning capability concerning intermediate services may be provided in other services or devices. In this example the discovered intermediate service is “http://host/codec”, which is the URL of a codec device/service.

[0129] (iv) Step 2014 follows where the printer 104 wraps the camera image request inside a request to the identified intermediate device 108, this being shown in code fragment {10}:

11<Message from=“http://host/printer”{10}to=“http://host/codec”time=“Tue Mar 23 14:14:03 EST 1999”><getData format=“BMP”><data url=“http://host/camera”><getData format=“JPEG” name=“images/301.jpg”/></data></getData></Message>

[0130] The printer 104 has requested a .bmp format image from the codec 108. The printer 104 has not specified a URL or filename within the codec 108 for the origin of the file that is desired. Rather, the printer 104 has provided a data statement containing a command for the camera 102.

[0131] Of the code shown in code fragment {10}, the following components thereof are generated by the printer 104:

12<Message from=“http://host/printer”{10A}to=“http://host/codec”time=“Tue Mar 23 14:14:03 EST 1999”>{enclosure}</Message>

[0132] The components of code fragment {10}, being a tag statement and indicated below as code fragment {10B}, are generated by the printer 104 from the received request by enclosing the extracted attributes within a new <getData></getData>XML entity, and inserting into the position labelled {enclosure} in code fragment {10A} above.

13<getData format=“BMP”>{10B}<data url=“http://host/camera”><getData format=“JPEG” name=“images/301.jpg”/></data></getData>

[0133] (v) Step 2016 follows where the printer 104 sends the request to the intermediate service (the codec) 108. The codec 108 then sends the image request to the camera 102. The codec service 108 need not understand the contents of the data statement, but only need forward the statement to the specified destination (the camera 102) and await the return of data. This is shown in code fragment {11}.

14<Message from=“http://host/codec”{11}to=“http://host/camera”time=“Tue Mar 23 14:14:04 EST 1999”><getData format=“JPEG” name=“images/301.jpg”/></Message>

[0134] (vi) The camera 102 sends the image to the codec 108, as shown in code fragment {12}:

15<Message from=“http://host/camera”{12}to=“http://host/codec”time=“Tue Mar 23 14:14:05 EST 1999”><data><image format=“JPEG” name=“images/301.jpg”><BASE64>image data</BASE64><getData format=“JPEG” name=“images/301.jpg”/></image></data></Message>

[0135] (vii) The camera 102 returns the requested data to the codec 108 and also (optionally) associates a getData command with the image.

[0136] (viii) The codec 108 processes the job and sends this to the printer 104. The codec 108 has an implied processing job to complete because of the discrepancy between the input and output formats of the data provided to it and requested from it. The codec 108 fulfils its obligation by understanding the implicit conversion command from the printer 104, and accordingly converts the (.jpg) format image from the camera 102 to a (.bmp) format image requested by the printer 104. Such implied commands can be controlled in more detail by external devices by attributes and parameters in the connecting device's/services interfaces or in explicit attributes or parameters in the commands and data provided to an intermediate device or service. Furthermore, explicit processing commands can be provided to an intermediate device or service.

[0137] The codec 108 returns the requested and processed camera data to the printer 104 as seen in code fragment {13} and also optionally associates a getData command with the image, as seen in code fragments {13A} or {13B}).

16<Message from=“http://host/codec”{13}to=“http://host/printer”time=“Tue Mar 23 14:14:06 EST 1999”><data><image format=“BMP” name=“images/301.bmp”><BASE64>image data</BASE64><getData format=“BMP” name=“images/301.bmp”/>{13A}OR<data url=“http://host/camera”>{13B}<getData format=“JPEG” name=“images/301.jpg”/></data></image></data><Message>

[0138] The example above optionally shows the codec 108 adopting the image path name of the camera 102, but changing the image type. This new codec path name is then provided as a handle to the printer 104. The codec 108 is under no obligation to retain any similarity between its image path name and the image path name of the camera 102. However there are benefits if a predictable naming similarity is retained, especially if unrelated commands can be multiplexed then the printer 104 might need naming similarities to aid it in sorting which response belongs to which original request. One solution would be for the codec 108 to return its arbitrary image pathname to the printer 104 and provide an attribute indicating the original pathname (and possibly device) from which the printer 108 requested the image.

[0139] The associated getData command within the image tags may be returned from the codec 108 to the printer in a number of ways. For instance, if the codec 108 retains a cache of the converted image then the codec 108 may replace the associated command of the camera 102 with a version generated by the codec 108, as seen in XML code fragment {13A}, thereby removing the involvement of the camera 102 from any future request for that image. Alternatively, the codec 108 may wrap the associated getData of the request of the camera inside a data command identifying to which device the request should be directed if transmitted in future, as seen in XML code fragment {13B}). Therefore, in future, the printer 104 may send the associated data command with a nested getData command to the codec 108 and the codec 108 would then be able to relay the getData command to the camera 102.

[0140] The above example can be extended substantially indefinitely where the codec 108 can represent any number of devices or services involved in the pull chaining process between printer 104 and camera 102. As each device or service is enrolled into the chain, the command(s) originally sent by the printer 104 to the camera 102 can be nested inside a wrapper intended for the next device or service in-line. Similarly, any associated getData command included by the camera 102 in its returned data can be wrapped by each device or service on return to the printer 104. This wrapping or nesting will preserve the shape and details of the chain for the printer 104 if the printer 104 desires to activate the associated command of the camera 102. The passage of the associated command from the camera 102 back to the printer 104, if nested by each intermediate device, provides a description of the complete chain to the printer 104, allowing expedited reactivation of the chain at a subsequent time.

[0141]
FIG. 7 illustrates a “push service provision” implementation, in contrast to the “pull service provision” implementation described in relation to FIG. 6. In FIG. 7, after the camcorder 1000 discovers and characterises the printer 1006, concluding that a profile mismatch exists, the camcorder 1000 discovers the resolution conversion device 1108 by a discovery announcement process depicted by a dashed arrow 1200. The camcorder 1000 ascertains the profile features 1110 of the resolution conversion device 1108 by a communication 1202, after which the camcorder 1000 directs the resolution conversion device 1108 and the printer 1006 to establish communications depicted by lines 1206 and 1208. Thereafter, the camcorder 1000 sends the high resolution picture information 1112 to the resolution conversion device 1108 as depicted by 1206, whereafter the information, having been resolution converted, is sent as depicted by 1208 to the printer 1006. An XML code example of a push service provision is now provided in Example 5 below.

EXAMPLE 5

XML Sequence of Push Service Provision for Camera/Printer Mismatch

[0142] The camera 102 has previously decided that a direct connection with the printer 106 is not possible and has discovered the codec 108 has a suitable JPEG input format. Similar discussion and explanation as provided in regard to Example 4 applies to the push-chaining sequence in this example.

[0143] (i) The camera 102 sends an image reference to the codec 108, according to code fragment {14}:

17<Message from=“http://host/camera”{14}to=“http://host/codec”time=“Tue Mar 23 14:14:00 EST 1999”><data url=“http://host/printer”><image format=“JPEG” name=“images/301.jpg”><BASE64>image data</BASE64><getData format=“JPEG” name=“images/301.jpg”/></image><data></Message>

[0144] (ii) The codec 108 processes the image, and then sends the image to the printer 106 according to code fragment {15}:

18<Message from=“http://host/codec”{15}to=“http://host/printer”time=“Tue Mar 23 14:14:01 EST 1999”><data><image format=“BMP” name=“images/301.bmp”><BASE64>image data</BASE64><getData format=“BMP” name=“images/301.bmp”/>OR<data url=“http://host/camera”><getData format=“JPEG” name=“images/301.jpg”/></data></image></data></Message>

[0145] In this example, the codec output format (.bmp), is expected. This is because either BMP is the only function provided by the codec 108, or alternatively, because the codec 1)8 will check the interface between the codec 108 with the printer 104. It is also possible for the camera 102 to imply, or alternatively, explicitly set an output format or a conversion function within the codec 108. One method of doing so is to add a file format attribute to the host printer URI which is provided in the fourth line of code fragment {14}. Accordingly, the host printer URI could take the alternate form

[0146] <data url=“http://host/printer” format=BMP>.

[0147] Such a URI implies a conversion process, or an interface selection, to the codec 108.

[0148] The “pull service provision” implementation described in relation to FIG. 6, and the “push service provision” implementation described in relation to FIG. 7, differ in relation to the entity which initiates and defines the direction of the self generating chaining process. In the pull process, it is the printer 1006 which initiates the required device chain building to service the requirements of the camcorder 1000. In the push process, it is the camcorder 1000 which initiates building of the necessary chain of devices.

[0149] Two self generating chaining processes are now described. A preferred method is termed “local” chaining, and another chaining method, termed “centralised” chaining is also described.

[0150]
FIG. 8 depicts a local self generating chaining process applied to a more general case, where a plurality of interposing devices must be found, and a corresponding device chain established. A camcorder 1800 wishes to print compressed high resolution picture information 1802 which has an associated profile feature “Z” 1804. The camcorder 1800 discovers a low resolution printer 1806 by a discovery announcement process 1818. Profile information is exchanged as depicted by 1820, and a profile mismatch between the feature “Z” 1804 of the camcorder 1800 and the feature “X” 1808 of the printer 1806 is identified.

[0151] A pull service provision implementation, directed by the printer 1806, can now described. The printer 1806 searches for, but is unable to discover a single device which, alone, can be interposed in order to establish compatibility between the printer 1806, having a profile “X” 1808, and the camcorder 1800 having the profile “Z” 1804. Accordingly, the printer 1806 searches for one or more suitable devices with profile “X”. Depending on a prevailing selection scheme, the printer 1806 will potentially select one of the discovered profile “X” devices to begin the chain building process. FIG. 8 shows that a device C, being a resolution converter 1810 is selected by the printer 1806, noting that the resolution converter 1810 has a profile with a conversion feature Y→X 1812. The printer 1806 passes an “image fetch” command to the resolution converter 1810, which proceeds to build the next link in the chain. This next link is built by the resolution converter 1810 by identifying devices with a compatible “Y” profile, to accord with the “Y” of the Y→X profile 1812. The resolution converter 1810 identifies and selects a device D, a decompressor 1814 as being suitable. The decompressor 1814 has a profile conversion feature Z→Y 1816. The decompressor 1814 now builds the next link in the chain after receiving the “image fetch” command from the printer 1806 via the resolution converter 1810. The decompressor 1814, recognising that its profile 1816 is compatible with that of the camcorder 1800, looks no further, and thus completes the chain with the camcorder 1800. This chain completion can be seen by considering the chain as follows:

[0152] the “X” of the “Y→X” profile 1812 of the resolution conversion device 1810 is compatible with the “X” profile 1808 of the printer 1806;

[0153] the “Y” of the “Z→Y” profile 1816 of the decompression device 1814 is compatible with the “Y” of the “Y→X” profile 1812 of the resolution conversion device 1810; and

[0154] the “Z” profile 1804 of the camcorder 1800 is compatible with the “Z” of the “Z→Y” profile 1816 of the decompression device 1814.

[0155] The printer 1806 discovered the resolution conversion device 1810 by means of a discovery/announcement process 1822. Profile feature information was exchanged and negotiated by profile communication 1824. Similarly, the resolution conversion device 1810 discovered the decompressor device 1814 by means of a discovery/announcement process 1830. Profile feature information was exchanged and negotiated by profile communication 1832.

[0156] Finally, the printer 1806 directs the camcorder 1800, the decompression device 1814, and the resolution conversion device 1810 to establish communication to support the flow of the information 1802 from the camcorder 1800 to the decompression device 1814 as depicted by 1834, from the decompression device 1814 to the resolution conversion device 1810 as depicted by 1828, and finally from the aforementioned resolution conversion device 1810 to the printer 1806 as depicted by 1826.

[0157]
FIG. 9 depicts a centralised self generating chaining process applied to a more general case, where a plurality of interposing devices must be found, and a corresponding device chain established. The camcorder 1000 wishes to print compressed high resolution picture information 1318 which has an associated profile feature “Z” 1320. The camcorder 1000 discovers the low resolution printer 1006 by the discovery announcement process 1010. Profile information is exchanged as depicted by 1012, and a profile mismatch between the camcorder profile “Z” 1320 and the printer profile “X” 1008 is identified. A pull service provision implementation, directed by the printer 1006, can now described. The printer 1006 searches for, however is unable to discover a single device which, alone, can be interposed in order to establish compatibility between itself, having a profile “X” 1008, and the camcorder 1000, having the profile “Z” 1320. Accordingly, the printer 1006 searches for a pair of suitable devices. The printer 1006 identifies two devices, namely the resolution conversion device 1108 and a decompression device 1300, which in tandem can establish the necessary chain of service interworking. This can be seen by considering the following chain:

[0158] the “X” of the “Y→X” profile 1110 of the resolution conversion device 1108 is compatible with the “X” profile 1008 of the printer 1006;

[0159] the “Y” of the “Z→Y” profile 1302 of the decompression device 1300 is compatible with the “Y” of the “Y→X” profile 1110 of the resolution conversion device 1108; and

[0160] the profile “Z” 1320 of the camcorder 1000 is compatible with the “Z” of the “Z→Y” profile 1302 of the decompression device 1300.

[0161] The printer 1006 discovered the resolution conversion device 1108 and the decompression device 1300 by means of discover/announcement processes 1304 and 1308 respectively. Profile feature information was exchange and negotiated by profile communication 1306 and 1310 respectively.

[0162] Finally, the printer 1006 directs the camcorder 1000, the decompression device 1300, and the resolution conversion device 1108 to establish communication as depicted by 1312, 1314, and 1316, to support flow of the information 1318 from the camcorder 1000 to the decompression device 1300 as depicted by 1312, from the decompression device 1300 to the resolution conversion device 1108 as depicted by 1314, and finally from the aforementioned resolution conversion device 1108 to the printer 1006 as depicted by 1316.

[0163]
FIG. 10 presents a process flow diagram by which the centralised self generating chaining process is performed in a push manner. The process is equally applicable to both pull and push service provision arrangements by exchanging actions of source and target devices. Commencing with a process 1400, a source device seeks a suitable target device. If the desired target device is found in a decision step 1402, the chaining process is directed to a further decision block 1404, where the profile compatibility is established. If profile compatibility, either exact or backward is established, the chaining process is directed in accordance with the “YES” arrow from the decision block 1404 to the connection establishment step 1406, and thereafter the chaining process ends at a step 1408. If a suitable target device is not found at the decision step 1402, the chaining process is directed in accordance with the “NO” arrow to the change requirements step 1410 which advises the source device that a change of requirements is in order, whereafter the chaining process returns to the initial process step 1400. If the decision step 1402 identifies a suitable target device, but profile compatibility is not found in the decision block 1404, the chaining process is directed in accordance with the “NO” arrow from the decision block 1404 to a process step 1412, where an index “L”, this being the length of the interposing device chain to be sought, is set to 1.

[0164] The chaining process is then directed to a process step 1414, which searches for a chain of devices “L” long (L=1 at this stage), which, if interposed between the source and target devices, will provide tandem profile compatibility. Thereafter, in a decision block 1416, if an appropriate device chain is found, the chaining process is directed, as indicated by the “YES” arrow from the decision block 1416 to the connection establishment process 1406, and thereafter to the “end” block 1408. If, on the other hand, a suitable device chain with a single interposing device is not found in the decision step 1416, the chaining process is directed in accordance with the “NO” arrow from the decision step 1416 to a process step 1418, where the interposing device chain length, ie. “L”, is incremented. Thereafter, a decision block 1420 tests that the length of the interposing chain of devices being sought is not longer than a predetermined maximum length “Q”. If the chain is too long in the step 1420, the chaining process is directed, in accordance with a “YES” arrow from the decision block 1420 back to the “requirements change” process step 1410. If, on the other hand, the interposing device chain length has not yet reached the maximum length permissible, the chaining process is directed in accordance with the “NO” arrow from the decision block 1420 to the process step 1414. In this situation, again a chain of interposing devices is sought with the required tandem compatibility, this time the chain of devices being sought having been incremented in relation to the previous chain which was sought. In this manner, the chaining process flow continues until either a suitable chain of interposing devices is found, or until the permissible length of the interposing device chain is exceeded.

[0165] Although the centralised chaining process as described in relation to FIGS. 9 and 10 can be used, a decentralised approach can also be adopted. Accordingly, in a pull service implementation, the printer 1006 can search for only a single interposing device having a profile “X”, and demand that such an interposing device interface with the camcorder 1000 which has a profile “Z”. If the interposing device is unable to interface directly with the camcorder 1000, the interposing device repeats the aforementioned process searching for only a single further interposing device, and demanding that the further interposing device interface with the camcorder 1000. This “local” search approach need not be aware of how many links there are in the chain and, from an XML coding perspective, commands are nested inside new commands for the interposing device just found. The flow in FIG. 10 is applicable in so much as each device in the chain successively obeys this flow with L=1 only in order to complete a chain.

[0166] Centralised chaining approaches can provide more optimal chaining solutions, however they make more demands on devices, and/or on central network control and management. For example, considering FIG. 9, the printer 1006 is expected to be able to manage the centralised building of a chain, which would constitute a significant processing load for this device. The local chain building example of FIG. 8 would probably be applied in this instance. Decentralised, or local, control may provide less optimal solutions, and in some cases may even fail to converge on a solution. This approach is, however much easier to deploy. Convergence of a local chaining process is generally guaranteed if (i) the device solution space is constrained, in that there are a finite number of devices in the available pool, and if (ii) a solution exists, and (iii) if corrections can be made to the chain building process.

[0167] Turning to FIG. 11, a “legacy” (or “dumb”) low resolution printer 200 having an information type 202 is associated with a “smart” “virtual device” 208. This association is depicted by the surrounding box 204. The virtual device 208 has no printing capability, but acts as the “intelligent” front end for the “dumb” printer 200. Thus when the camera 102 wishes to print the information 110, the profile processes 112, 210 of the camera 102 and virtual device 208 respectively conclude that the print job can proceed, whereafter communication is established as depicted by 206 between the camera 102 and the “dumb” printer 200 for printing. In this instance therefore, the intelligence and signalling communication capability are supplied by the virtual device 208, while the actual printing is supplied by the “dumb” printer 200. From a functional perspective therefore, the “dumb” legacy printer 200 has been incorporated into the system by means of the association with the virtual device 208 depicted by the box 204. Typically, the device 208 can provide an information channel (214, 218) and/or a processing step 216 to support the device 200, since the device 200 might be incapable of retrieving data directly from the camera 102.

[0168]
FIG. 12 depicts use of a physical security key 300 which is inserted into the initiating camera 102, the insertion depicted by a bar 302. The insertion of the security key 300 is accompanied, in some instances, by other control information (not shown). Insertion of the key 300 into the camera 102, allows the information 110 to be printed from the camera 102 to the printer 104, however, this does not permit the communications session to terminate. Thus, the process does not permit the printer 104 to output the printed pages until the security key 300 is equivalently inserted into the printer 104 as indicated by dashed line 304. This arrangement is termed “secure pickup”, and allows secure print jobs to be sent across the network 100. Such provides the initiating party with the assurance that the print job will not be output by the printer 104 until the print initiator (ie. the user) goes to the printer 104 and physically inserts the security key 300. Printing of the information 110 can be inhibited, requiring the security key 300 to be inserted at the destination printer 104 for enablement, and subsequent printing. Initial insertion of the key 300 is only required once, at setup of a sequence of print jobs, thereby avoiding a need to insert the key 300 for every print job. In another implementation, instead of inserting a physical key 300, cryptographic authorisation may be used whereby a public “inhibition” key can be sent openly to the camera 102, and a private “enablement” key embodied physically as the physical object 300, to be used only at the printer 104. Alternatively, or in addition, the data itself can be encrypted at the camera 102, using the public key prior to transmission across the network 100, and decryption at the printer 104 using the private key 300. This layered security approach provides for both encryption of the data within the network 100, and access security at the printer 104.

[0169]
FIG. 13 depicts a situation where an initiating device such as the camera 102 does not have sufficient display capability (eg. a GUI as previously described) to effectively inform the user about the devices and services populating the network 100. In this case, the camera 102 discovers a local display 400, using a discovery process 412. Profile matching between the camera profile 112 and the display profile 404 takes place as depicted by a line 410, whereafter if the profiles are found to be matching, either exactly or by backward compatibility, display communication 408 is set up between the camera 102 and the display 400. In this manner, the user of the camera 102 is able, using the relatively limited set of controls available on the camera 102, to observe a large display 400 which provides convenient and effective representation, and consequently control, of the various network resources so displayed. In the same manner, a control keypad associated with the display 400 can also be used instead of the relatively limited keypad functionality provided by the camera 102.

[0170]
FIG. 14 illustrates how the user of the camera 102 utilises a print shop service 508 in order to enhance the quality and attractiveness of the information 110, thereafter printing the information using a high resolution printer 104 of the print shop 528. The discovery/announcement processes previously described have been omitted for the sake of clarity. The camera 102 establishes profile matching with the print shop service 508, as depicted by a line 516. The camera 102 also provides the print shop service 508 with the desired service specifications and characteristics during the profile matching process. The print service 508 then performs profile matching 520 with the desired high resolution printer 104. The print shop service 508, having established profile matching, thereby determines that the service desired by the camera 102 is feasible, and then establishes communication 522 with the camera 102, pulling the information 110 to the print shop service 508. Thereafter, the print shop service 508 processes the camera information 110, and also incorporating title and descriptive textual information from its own archives (not shown). Once the print shop service 508 completes the processing as specified by the user of the camera 102, the service 508 establishes a communication session 526 with the high resolution printer 104, and sends the processed information to the printer 104, which produces the desired output. The foregoing description illustrates that services such as the print shop service 508 perform in the same manner as a physical device such as the high resolution printer 104 in the context of the present system. The user of the camera 102 can, providing a suitable display is available, view the population of devices (ie. 104) and services (ie. 508), and can formulate a command string or program to perform the set of desired services and actions. The user of the camera 102 does not need to adopt a different approach for devices and services. The distributed nature of the system architecture in the present arrangement enables services and virtual devices to reside in any convenient physical location. Indeed, the physical devices and their “intelligent” front ends need not necessarily reside in the same physical location.

[0171] Thus, for example, the print shop service 508 can, in principle, provide an intelligent front-end for all of the printers in a local network formed at the print shop 528, as it may, for instance, do so for the high resolution printer 104, which could be a legacy printer. In the event that the functionality provided by the limited set of camera control keys is insufficient, a control device 534 in the vicinity of the camera 102 (eg. a browser 530 running on a networked local computer 532) can be incorporated. Various options can be used for distributing functionality between the camera 102 and the local computer 532. For example, the local computer 532 can establish a dialogue with the print shop 528, to be followed by a command from the local computer 532 to the print shop 528 to commence a desired process. This command contains job details and a URI for the camera 102. The print shop 528 thereafter initiates a pull process with the camera 102, which supplies the required data.

[0172]
FIG. 15 illustrates how a remote device 600 which lies beyond a boundary 604 of the system previously described, can be accessed. Providing that the desired remote device, in this case a high resolution printer 600 resides at a known network address (eg. a Universal Resource Identifier or URI), communication as depicted by a line 602 can be established in order to send desired information 110 from the camera 102 to the printer 600. There need not be a discovery/announcement process in this case, nor need there be a profile matching process, and the information 110 is transmitted on the communication path 602 in an open-ended fashion to the printer 600. This mode of operation may or may not assume knowledge of the printer 600 capabilities, and an error in this regard may result in a failed print job if a profile matching method is not enabled. Security can be added in this scenario using public/private key inhibition/enablement, as described in relation to FIG. 12. Encryption can also be added as described.

[0173]
FIG. 16 illustrates how the virtual device concept depicted in FIG. 11 can be extended, in the event that the systems described herein have been only partially deployed. In this event, a server 700 contains a set of virtual devices 702 which are associated, on a one-for-one or other basis, with a set of legacy devices 704, the association being depicted by the arrow 716. The server 700 is also equipped with a display 718, connected by a line 720. The user of the camera 102 can discover the population of legacy devices 704 connected to the network 100 as exemplified by a discovery/announcement process 706. In a similar fashion, profile matching 710 can serve as the basis for establishing the capability of the population of devices 704. While it is the capability of the legacy devices 704 which is actually of interest to the user of the camera 102, as exemplified by an actual information path 712, the discovery/announcement and profile matching processes take place with the set of corresponding virtual devices 702. A dashed line 722 illustrates how the virtual devices can also provide data transfer and processing if required. The user of the camera 102 can use the server 700 and the associated server display 718 as a basis for constructing the desired services, and using the desired devices.

[0174]
FIG. 17 depicts a preferred implementation of the arrangements described above. A local network 1500 is shown, to which is connected a local printer 1502, and a remote printer 1504, the later being accessible via the Internet. A user connects a laptop computer 1512 into the local network 1500. Running on the laptop 1512 is a browser 1506. The browser 1506 provides a graphical user interface (GUI) 1508. The browser 1506 detects the printer 1502 on the local network 1500. A printer icon 1600, for example read from a device profile at discovery/announcement, appears at the top of the browser GUI 1508, as seen in FIG. 18. Next the user connects a digital camera 1510 to the network 1500. A camera icon 1602 appears on the browser window 1508. When the user selects the icon 1602, such causes a display of information 1604 about the camera 1510 in the left pane of the browser window 1508, such being a description of the camera 1510 in XML is displayed within a style sheet. Some of the items if information are visibly active. One item 1606, says “thumbnails”. The user may select this item and a right pane 1608 of the GUI 1508 operates to display thumbnail representations 1610 of the stored images.

[0175] Where the user desired to print one image corresponding to the thumbnail 1610, the user selects the appropriate thumbnail 1610, for example using a mouse pointer device, and drags the thumbnail 1610 to the printer icon 1600 in the icon bar. To give extra control of the operation, this may be performed using the right mouse button. A menu 1620 appears as shown in FIG. 19. The user leaves most options on the menu unchanged from the default, however a “secure pickup” checkbox 1622 can be activated, followed by “OK”. This sequence of events activates a print job whereby the selected image corresponding to the selected thumbnail 1610 is public-key encrypted, and sent to the printer 1502 for printing. The printing process is, however, suspended until the user later physically attend the printer 1502 and inserts a smartcard or Java Ring™ encoded with an appropriate matching private key, thus reinstating the print process by providing a corresponding private key in a secure manner ie only in his actual physical presence.

[0176] The described arrangement assumes that devices connect to a local IP network 1500. Before the browser 1506 can announce itself and look for other network services such as the printer 1502, the browser 1506 establishes itself on the network 1500. The browser 1506 does so by listening for incoming service requests on a port. Incoming service requests are HTTP requests, so a service is uniquely identified by an HTTP URL. For example, if the user's laptop 1512 upon which the browser 1506 is running has IP address 10.9.8.7 and the browser 1506 on the laptop 1512 listens on port 9090, then the URL HTTP://10.9.8.7:9090 identifies the browser 1506 so that other devices and/or services can make appropriate contact. Where multiple applications, or application instances, are running on one machine, and/or sharing the same ports, extensions can be added to a URL in order to uniquely identify the particulars of the case. For example, a file name-type of extension can be added to a URL in order to identify the application type. An example of such an extension is provided as follows:

[0177] http://10.9.8.7:9090/browser.exe

[0178] Each element in the URL extension, ie. “browser”, and “exe”, can identify details about the application name, and type, which are intended as a destination of a message.

[0179] Multiple instances of an application type can be uniquely identified by addition of an http query as a parameter-value pair. This is illustrated as follows:

[0180] http://10.9.8.7:9090/browser.exe?instance=1

[0181] The term “instance=1” represents a parameter and its associated value, these being used to identify a particular instance of an application. It is noted that the aforementioned methods may not, in a particular instance, all be required, depending on the particular application type or standardisation being employed.

[0182] Accordingly, a unique identity is assigned to each browser window.

[0183] The principles and arrangements described herein have general applicability to automatic network configuration and communication establishment. However, for ease of explanation, the implementations have been described with reference to a particular set of image devices and printers. However, it is not intended that the present invention be limited to the described implementations, and can be used to achieve interworking between other devices/services or groups of services/devices.

[0184] The aforementioned arrangements utilise particular methods of inter-device capability negotiation. Further, particular instances of discovery are described, where discovery relates to the ability of a device connected to a network to “discover” and identify other devices connected to the network. Variations of the described methods of inter-device negotiation, which use different negotiation processes may be implemented without departing from the scope of the present invention, which is defined in the appended claims. A similar comment applies to the aspects of security incorporation, and device discovery. Further, one or more of the steps of the described methods may be performed in parallel (ie. simultaneously) rather than sequentially.

INDUSTRIAL APPLICABILITY

[0185] It is apparent from the above that the arrangements described are applicable to the telecommunications, data processing and distributed computing industries.

[0186] The foregoing describes only some embodiments of the present invention, and modifications and/or changes can be made thereto without departing from the scope of the present invention. The described embodiments should be considered to be illustrative and not restrictive.

Printing using secure pickup

Information

Publication Number

Date Filed

Date Published

Inventors

CPC

US Classifications

International Classifications

Abstract

Description

Claims

Priority Claims (1)