The present invention relates to electronic devices and in particular, but not exclusively, to hand portable electronic devices such as cellular telephones, personal digital assistants (PDAs) and the like.
Hand portable electronic devices exist in many forms. Examples include cellular telephones, personal organisers and PDAs. It is becoming increasingly common for these devices to be used for storing and viewing images, particularly digital photographs. Cellular telephones are used to allow digital photographs to be shared between users. In addition, cellular telephones may include a digital camera or an interface for connection with a digital camera, to allow a telephone user to capture an image and store it or send it to another individual. Images which have been stored on the telephone may be downloaded to another device, particularly a home or office computer to which the user has access, allowing image archiving and cataloguing to be undertaken by appropriate application software on the computer.
The present invention provides an electronic device comprising:
Preferred features of this aspect of the invention are set out in the appended claims, to which reference should now be made.
In another aspect, the invention provides an image system comprising:
Preferred features of this aspect of the invention are set out in the appended claims, to which reference should now be made.
In a third aspect, the invention provides a document bearing a printed image and incorporating machine readable metadata associated with the image, the metadata representing an instruction for operation of an electronic device.
Preferred features of this aspect of the invention are set out in the appended claims, to which reference should now be made.
In a fourth aspect, the invention provides a method of creating a printed image in which:
Preferred features of this aspect of the invention are set out in the appended claims, to which reference should now be made.
In a fifth aspect, the invention provides a user interface by which a user instructs a device to print an image, the interface comprising:
Preferred features of this aspect of the invention are set out in the appended claims, to which reference should now be made.
Examples of the present invention will now be described in more detail, and by way of example only, with reference to the following drawings, in which:
User Device
The first example of the invention, to be described, is implemented by means of a hand portable electronic device 10, illustrated in
The telephone 10 includes a processor 12 which controls the functions of the telephone in accordance with software stored in memory 14, with which the processor 12 is in communication at 16. The memory 14 also includes data which the processor 12 may require during use, such as lists of telephone numbers. The processor 12 is in communication with radio transceiver apparatus 18 which, in use, establishes two-way communication between the telephone 10 and a cellular telephone network 19.
User operation of the telephone 10 is provided by a user interface 20 in communication with the processor at 22 and including at least a display 24 and appropriate input and output apparatus 26, such as a loudspeaker, microphone and keyboard.
Three further components are illustrated in
The image 36 is printed on an image carrier 38 to produce a printed document 40 from which the image 36 may be viewed.
The document 40 also incorporates metadata at 42. In this specification, the term “metadata” refers to data which has relevance to primary data (image data, in this example), but is not itself part of the primary data, or necessary for the primary data to be complete in relation to its principal purpose (in this example, the production of a viewable image).
The manner in which the document 40 is created will be described below. At this stage, it is sufficient to note that the metadata 42 consists of, or includes data which is sufficient to identify an instruction for operation of the telephone 10.
The term “image” is used throughout this specification, because the preferred manner of implementing the invention is in relation to visual images, particularly photographs. However, it is to be understood that the image 36 on the document 40 could, alternatively, be a passage of text, or other material.
Interaction with Printed Document
In accordance with the present invention, the telephone 10 can interact with the document 40, in a sequence of steps set out in
The process is initiated by a user at 43 issuing an appropriate instruction to the processor 12, by means of the interface 20. The telephone 10 and the document 40 are also brought together at 44. Although step 44 is illustrated in
The device 10 and document 40 are brought together to allow the appropriate device 28, 30, 32 to read the metadata 42. Thus, if the metadata 42 is in the form of a bar code, the bar code reader 30 is brought to an appropriate position to read the metadata. Alternatively, if the metadata 42 is in the form of an RFID tag, the RFID reader 32 is brought to an appropriate position to read the metadata contained within the tag 42.
In a further alternative, the camera 28 may be used to read metadata 42, either in bar code form or other visible form. Thus, an appropriate optical device, such as the camera 28 or bar code reader 30 is used if the metadata 42 is in visible form. Alternatively, the metadata 42 may be in invisible but machine readable form, such as data in an RFID tag, in which case, an alternative reader, such as the RFID reader 32 would be used. It will be readily apparent to the skilled reader that many other formats for the metadata 42 could be envisaged and that any could be used if the telephone 10 is equipped with an appropriate data reading device.
The metadata is read at step 46.
After receiving the metadata 42, the processor 12 executes appropriate software to function as an interpretation device to interpret the metadata (step 48). In particular, the processor 12 seeks to interpret the metadata 42 to identify an instruction for operation of the telephone 10. This interpretation may be achieved in various ways. For example, the metadata 42 may include sufficient data for the telephone 10 to identify an individual shown in the image 36, or to whom the image 36 is considered relevant. This may be by including the individual's name in the metadata 42, or an abbreviated name or other identifier.
Metadata which identifies an individual may be interpreted at 48 as an instruction to the telephone 10 to initiate communication with that individual, by making a telephone call by means of the transceiver 18.
The telephone call is initiated at step 50. Prior to that, if the metadata 42 identifies the individual but does not include the appropriate telephone number, it may be necessary for the processor 12 to interrogate information held in the memory 14 to retrieve the telephone number or alternatively, the processor 12 may initiate a telephone call through the transceiver 18 to retrieve an appropriate telephone number by interrogation of a database 54 at a remote location.
The sequence may also include an optional step 56 in which the processor 12 requests a confirmation instruction from the telephone user at 56, confirming that the telephone call should be initiated at 50. If communication in more than one manner is possible in the light of the interpretation of the metadata, such as a telephone call, text (SMS) message, e-mail etc., step 56 will preferably include a step in which the user selects the mode of communication to be used. This interaction with the user is achieved by means of the interface 20.
Thus, it can be seen that after reading the metadata 42, the processor 12 has operated to interpret the metadata to identify an instruction for operation of the telephone 10. In this example, the metadata is interpreted as an instruction to initiate a telephone call with the individual identified by means of the metadata. The processor 12 has then operated to cause the telephone 10 to execute the instruction, by initiating the telephone call at 50.
Alternative Arrangements
Many alternatives to the arrangements just described may be envisaged. The metadata 42 may include a complete telephone number, e-mail address or other contact details to be used at step 50, or an identifier which allows a telephone number to be obtained, either from the memory 14 or from the remote database 54. The former alternative is advantageous in allowing any telephone equipped as described to execute the instruction by recovering the appropriate telephone number from the metadata 42. The second alternative is advantageous in making additional use of information stored in the memory 14 or database 54. The metadata 42 is not required to incorporate all of the information which will be used to execute the instruction, but only sufficient information to allow the necessary further information to be retrieved when required.
The interpretation of the metadata, as described above, depends in part on the context in which the metadata is interpreted. Thus, as described above, the metadata is being interpreted by a telephone 10. Consequently, once a telephone number or other contact details have been recovered from the metadata, or sufficient information has been recovered to allow a telephone number or other contact detail to be obtained from previously stored information, this information is interpreted by the telephone as an instruction to initiate communication with the individual identified. The instruction is thus partially predetermined, requiring only the contact details of the individual to be provided, in order to complete the instruction. In the case of an alternative device being used, such as a PDA, in which communication functions are not necessarily incorporated, the metadata may be interpreted in other ways. For example, a PDA may interpret the identification of an individual from metadata as an instruction to display information included in the diary held by the PDA such as the next appointment with that individual, or all future appointments. Again, the instruction is partly predetermined, but requires the individual to be identified. In the case of other devices, different actions relevant to the particular device may be executed, once the metadata has been interpreted. Thus, in any of these cases, the metadata may include the complete instruction to the device, or alternatively, the metadata may include information to complete the formulation of an instruction which is partially predetermined. In a further alternative, the metadata may contain only an identifier, such as an identifier for the corresponding image, but no instruction or personal data. In this example, the identifier is used to interrogate information previously stored in the device or in the database 54. The identifier allows a corresponding instruction or personal data to be retrieved, for use as described above.
It will be readily apparent that the invention described above can also be implemented in a multi-function portable device, such as a device which can operate as a cellular telephone and a PDA, for example. In that case, it may be appropriate to use a user interface to allow a user to select an operation to be performed, such as one of a range of partially predetermined actions relevant to respective functions of the device.
Creation of Printed Documents
The remaining drawings can be used to describe the manner of production of a printed document of the type shown in
The system also includes a printer or other document creation device operable to create the document 40 on receiving data from the telephone 10 or computer 62.
One of the devices 10, 62 is first used to receive data representing images which are ultimately to be printed in the document 40. In the case of a telephone 10, the image data may be captured by the camera 28 or received by means of the transceiver 18 (not shown in
All of the metadata just described may be created automatically by operation of appropriate software within the telephone 10. Additional metadata may be created manually by a user using the interface. Manually created metadata may provide a title for the corresponding image 68, or identify a group to which it belongs, for example identifying the image as taken during a particular event or at a particular place, or with a particular person as subject. The user interface 20 preferably facilitates the entry of manual metadata by displaying existing group names or names of individuals drawn from information stored in the telephone memory 14, for selection by the user. Consequently, selection by the user of an appropriate individual will also allow the metadata 70 to include contact details such as a telephone number, e-mail address or the like, drawing this additional information from the telephone memory 14.
In the alternative example, using the computer 62, the computer 62 is used to receive data representing images 68A and to store these along with metadata 70A, in a manner similar to that just described. However, it is envisaged that the computer 62 will be able to receive image data from a wider range of sources, which may include images downloaded from databases or internet sites 76, or images downloaded from a camera or other image capture device 78. Furthermore, images 68A may be downloaded from the telephone 10, either with the metadata 70, or prior to the creation of metadata.
It is envisaged that a computer 62 will have more computing power available than a telephone, for running software for storing and organising images and collections of images, including the creation of additional metadata of the types mentioned above.
Thus, the devices 10, 62 are used to generate metadata and associate the metadata with the image data 68, 68A.
Additional metadata may be created by operation of the user interface 20, or an equivalent user interface provided on the computer 62. The interface may be configured particularly as illustrated in
When the user instructs the device 10, 62 to print an image, the user interface of
Data representing the image 68, 68A is then sent to the printer 64, along with the associated metadata 70, 70A, as modified through the dialog box 82.
In a further alternative, a two dimensional image may be produced by “electronic ink”, such as that produced by E Ink Corporation of Cambridge, Mass., USA, to allow the image on the document 40 to be dynamic rather than static.
The metadata 70, 70A may be updated when a change is made through the dialog box 82, for future use. It is also envisaged that a default setting may be incorporated within the user interface so that a default selection of one or more boxes 86 will be made, unless modified by the user. These features improve the ease with which printing is achieved on the first and subsequent occasions.
The printer 64 receives the image data and prints this at 36 onto the image carrier 38, in a conventional manner. In addition, the printer 64 incorporates the metadata (or a subset of it, as described above) into the document 40, as follows.
In one example, the printer 64 includes a bar code processor 88 which selects the metadata and processes it to form a bar code image which encodes the metadata. This bar code is then printed onto the document 40, to provide the metadata 42 at a position either within or outside the image 36. The bar code metadata may be printed on the reverse of the document 40, with an appropriately adapted printer. The bar code may be a one-dimensional or two-dimensional bar code.
This results in a document 40 which includes the printed image 36 and also includes the metadata 42 in bar code encoded form. The bar coded metadata can therefore be read by a device in the manner described in relation to FIGS. 1 to 3, in order to be interpreted as an instruction for the reading device, such as to initiate communication with the individual or telephone number identified by the metadata.
In an alternative arrangement, the printer 64 is adapted to incorporate metadata into the document 40 in invisible but machine readable form, by means of RFID tags. An RFID tag may be incorporated into the image carrier 38 on manufacture, such as by attachment to the surface or embedding within the material of the carrier 38. For this type of image carrier, a writer device 90 is incorporated within the printer 64 to allow the printer 64 to write the metadata to the RFID tag of the image carrier 38 on which the associated image 36 is printed.
The metadata is thereafter available for reading from the document 40 by an appropriate RFID reader, such as the reader 32 of the telephone 10.
In an alternative, the printer 64 may include a dispenser 92 for RFID tags, one of which is dispensed when a document 40 is printed. The RFID writer 90 is used to write the metadata to the RFID tag. The printer 64 may then automatically attach the RFID tag to the document 40 or alternatively, the RFID tag may be provided in the form of an attachable component for the user to affix to the document 40. For example, the RFID tag could be a self-adhesive component.
In a further alternative, the RFID tag may be manufactured with a unique identifier, such as an identifying number. In this alternative, the printer 64 will include an RFID tag reader 94 so that the identifying number of a dispensed tag can be read. This identifier is returned at 96 to the instructing device 10, 62 to be recorded as part of the metadata 70, 70A.
The result of any of these alternatives is a document 40 which bears a printed image 36 and also carries metadata 42, encoded in an RFID tag. Accordingly, a device such as a telephone 10 can read the RFID tag metadata in the manner described above in relation to FIGS. 1 to 3. If the complete metadata is incorporated in the RFID tag, the reading device can recover all of the data directly from the document 40. In an alternative, the reading device may recover only the identifier of the RFID tag or the image and use this to search for the associated metadata 70, 70A to which that identifier relates. Alternatively, the metadata, the identifier and the association between them may be recorded in the server 54. This has the advantage that any reader device having access to the server 54 can have access to the metadata identified by the identifier, without requiring access to the metadata stored in the device which instructed the printer 64.
It is envisaged that the cost of an RFID tag will be relatively high compared with the cost of suitable paper for use as the image carrier 38. Consequently, it is preferred that the operating sequence of the printer 64 results in the RFID tag being produced after the image 36 has been fully printed. This ensures that if paper jams in the printer, for example, a relatively expensive RFID tag is not wasted. It is preferred that the RFID tag is affixed to the reverse side of the image carrier 38, whether manually or automatically by the printer 64. In either alternative, the RFID tag is preferably designed so that it is not visually intrusive to a viewer of the image 36. In a further alternative, the RFID tag may be embedded within the paper during manufacture, but this will increase the cost of the paper and thus increase the cost of failed print operations. While it is envisaged that the whole of the metadata can be written to an RFID tag incorporated in the document 40, the alternative in which the metadata is stored at a server 54 has the advantage that the data at the server can be updated (for example if a telephone number changes) more readily than data within an RFID tag, so that the information contained within an RFID tag is less likely to become out of date. The server 54 will maintain a correct association with current personal data.
The description set out above has related primarily to 2 dimensional images. It is envisaged that the principles of the invention can also be applied to other information. In particular, it is envisaged that the image data may be in the form appropriate to generate a three dimensional object, rather than a 2 dimensional image. Thus, the document printer 64 would be replaced with a device for creating three dimensional objects (sometimes called a 3D printer, and manufactured, for example, by Z Corporation of Burlington, Mass., USA). Metadata would be incorporated into the three dimensional object, for subsequent use in ways which are the same as, or analogous with those described. Thus, terms such as “image”, “document”, “print”, which are commonly assumed to refer to two dimensional concepts, should be understood herein to include also at least three dimensional concepts.
Whilst endeavouring in the foregoing specification to draw attention to those features of the invention believed to be of particular importance it should be understood that the Applicant claims protection in respect of any patentable feature or combination of features hereinbefore referred to and/or shown in the drawings whether or not particular emphasis has been placed thereon.