Patent Application
20130120771
The above-identified patent applications are incorporated herein by reference in their entirety.
The present invention relates generally to printer technology, and more particularly to printing scented images and processing and storing image files with aroma information.
Traditional printer technology prints images in an image domain, either color or monochrome. In addition, prior-art methods include effects applied to paper to make images on paper more interesting. For example, some images are embossed so that people can touch and feel them, which might be referred to as the tactile domain. Some images have buttons behind them so that a music or a song will play if the buttons are activated, which may be referred to as the auditory domain. Some images will have perfume smell such as a cosmetic catalog to attract consumers, which we refer to herein as the aroma domain. U.S. Pat. No. 5,975,675 describes a printer that can spray perfume onto paper in addition to printing text characters and images. As described in U.S. Pat. No. 5,975,675 the type of perfume is pre-selected or user-input. The disclosure of this patent is incorporated herein by reference in its entirety.
Another U.S. Pat. No. 5,995,770, describes a system to allow a user to pre-select an applicable scent which is to be applied to an image. Then, at the photofinishing site the scent can be delivered to a print, or a set of prints, along with an image. The disclosure of this patent is incorporated by reference herein in its entirety.
The technology described in the prior art is useful for mass printing of identical brochures or catalogs for advertising. A limitation common to these prior art patents is that the scent is pre-selected and the region of the print where the scent is applied is pre-determined as well. Furthermore, there is no disclosure of ways to store and process scent information and scents in association with digital images.
Therefore, there is a need for a printing system that will intelligently detect image content and will print either the image alone or the image together with a selected scent applied to selected locations on the image receiver.
A preferred embodiment of the present invention includes a method comprising receiving a digital image file, reading the digital image file to obtain information identifying a scent and printing the digital image on a receiver medium including automatically applying the scent on the receiver medium. The reading includes reading the digital image file for information identifying an object in the digital image corresponding to the scent, whereby the printing comprises spatially printing the digital image on the receiver medium and applying the scent on the object as printed on the receiver medium. Coupled to a network, the digital image can be received from a remote device coupled to the network, such as a network server. Multiple scents and multiple objects detected in digital images can be matched before applying scents. The scents can also be mixed prior to application, and can be applied only in unprinted areas of the receiver medium.
Another preferred embodiment of the present invention includes an apparatus such as a printer comprising a wired or wireless input port for receiving a digital image file, a memory connected to the input port for storing the received digital image file, a processor for reading the digital image file to obtain information identifying a scent, wherein the information is stored in association with the digital image file. A marking device prints the digital image on the receiver medium including automatically applying the scent identified by the information stored in association with the digital image file. The marking device can spatially print the digital image on the receiver medium and apply the scent on the object as printed. Multiple scents can be processed similarly. A plurality of reservoirs including a mixing reservoir can be used for individually applying scents or for mixing the plurality of scents before application on the receiver medium. Unprinted or printed areas, including front and back surfaces, of the receiver medium can be selected as primary targets for scent application.
In the present patent application, the term “network” is intended to include a wired and a wireless network, such as either in a home, office, local area, or global, and is intended to include Wi-Fi, Wi-Max, Bluetooth and emerging technologies that may be interchangeable with currently known technologies. These, and other, aspects and objects of the present invention will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following description, while indicating preferred embodiments of the present invention and numerous specific details thereof, is given by way of illustration and not of limitation. For example, the summary descriptions above are not meant to describe individual separate embodiments whose elements are not interchangeable. In fact, many of the elements described as related to a particular embodiment can be used together with, and possibly interchanged with, elements of other described embodiments. Many changes and modifications may be made within the scope of the present invention without departing from the spirit thereof, and the invention includes all such modifications. The figures below are not drawn to any precise scale with respect to relative size, angular relationship, or relative position or to any combinational relationship with respect to interchangeability, substitution, or representation of an actual implementation.
Embodiments of the invention are better understood with reference to the following drawings. The elements of the drawings are not necessarily to scale relative to each other.
It is understood that the actual physical design of the printer can be flexible. For example, the ink cartridge 250 and scent reservoir 260 can be situated on separate carriage bars.
Methods of detecting other objects such as flowers are also described in the prior art. One example is “An automatic visual Flora—segmentation and classification of flower images” by Maria-Elena Nilsback, Robotics Research Group, Department of Engineering Science, University of Oxford, PhD Thesis, 2009, which describes methods to automatically recognize and classify different flowers in relatively reliable way. The object recognition algorithm is implemented in a form of a computer program loaded and saved in the printer memory 170. The object recognition algorithm identifies any objects of interest detected in the image (step S40) for which a scent is associated. If such an object is detected, the printer, under control of the program stored in the printer memory, generates information about the objects such as the type of object, location coordinates in the image relative to the image size, and the associated scent (step S50). This detection algorithm can be simply incorporated in a preferred embodiment of the present invention as a binary step of detecting whether an image of a flower exists in the digital image and, if so, applying a single scent to the image, wherein the scent fluid reservoir contains only the single scented fluid or perfume. Next the printer touch screen 150 displays the information related to the image including the objects which can be printed in the aroma domain (block S60). The printer can automatically apply a scent or request the user to select print scents for the detected objects through a pop-up window (step S70). For example, the printer analyzes an image and detects a flower. It displays the location of the flower, type of scent, etc. It asks the user for confirmation to print the scent. The user can either accept or reject the scent print. This option can prevent unwanted scented prints.
Optional preferred embodiments of the present invention are illustrated in the flowchart of
The printer 100 then controls the printer engine 180 to move the print medium to the right location and starts to print scent by controlling the print head of the scent reservoir 260 in the locations where the objects are located relative to the image (step S80) and starts to print the scent in the selected locations. When the printer finishes the scent print, it rolls back the print medium to the exact start position as before (step S90). The final step is to print the image in the normal course using the standard ink cartridge 260 (step S100) and the process is finished (block S110). The user can bypass the scent printing (step S70) so the printer returns directly to the block S100 to print the image in the image domain. If there are no objects detected corresponding to scented fluids in the printer, the printer prints the image directly as a normal printer does by jumping from step S40 to step S100 directly, and completes the printing process (step S110).
The print head can include a piezoelectric transducer to compress the volume of a scented fluid causing scent fluid ejection. Or the print head can include a heating element to vaporize a portion of the scent fluid and therefore cause ejection, both of which are commonly used in inkjet printers.
Much work has been done to classify scents, especially “good” or appealing scents such as a fragrance. For example, M. Edwards in 1983 developed a so-called “Fragrance Wheel” shown in
It is also understood that the scent location in
In the case of printing scent in a non-imaging region, the detection algorithm can record the region without any imaging content after performing the detecting step (step S35 to replace step S30 in
In the case of print scent on the back of a print, the printer 100 can be modified. Instead of having the ink print head and scent print head on the same carriage rail, the scent print head is located on the opposite side of the print medium.
Referring to
Referring to
Referring to the examples of
Referring to
Means for automatically detecting an object in one of the captured digital images can be provided using image-processing circuits having access to electronic storage circuits or devices, for example such as processor 755 with electronic storage memory 760 found in programmable digital computer circuits or in non-programmable digital circuits, e.g. such as gate arrays or other integrated circuits. Suitable programs for controlling programmable devices are known in the art and are described above. Such programs analyze the digital image to detect objects.
Likewise, image-processing circuits, for example as found in programmable or non-programmable digital computer circuits, such as processors 755 with electronic storage circuits 760 are useful for determining scents associated with an object found in a digital image. Computer programs, for example stored in the electronic memory 760 can access a database or library of image objects also stored in the electronic memory 760 or in a remote memory accessible through a network (not shown), wherein each image object is associated with one or more identified scents. Using the processor 755 and program, the detected object can be compared to each object in the database or library to determine a match and the scent identified with the matched object can be included with the matched object as object information. The object information can be stored in the electronic storage, e.g. a data retrieval system, for example volatile or non-volatile memory, rotating magnetic or optical memory, or solid-state memory. The object information can be stored in association with the captured digital image.
In various preferred embodiments of the present invention, the object detection and scent determination are performed using components of a processing system. In a preferred embodiment of the present invention, the printer includes a processor (e.g. 755) and memory (e.g. 760) that stores programs and a database including objects and associated scents. The digital image is transferred, e.g. through a network, from the digital camera to the printer. Other means of transfer include a smart disk (SD) and a universal serial bus (USB). The digital image is analyzed in the printer processor, one or more objects detected, a corresponding object found in the database, and a corresponding scent determined. The digital image can be printed with objects in the image overlaid with the determined scents. The determined scent information is stored with the detected object and the captured digital image in the electronic memory and can be available or transmitted to other devices connected to a network common to the printer.
In other preferred embodiments of the present invention, a computer separate from the printer, such as a desktop, notebook, net-book or laptop computer, includes a processor (e.g. 755) and memory (e.g. 760) that stores programs and a database including objects and associated scents. The digital image can be transferred, e.g. through a network or digital peripheral interface (e.g. a universal serial bus), from the digital camera to a separate computer if the programmed processing described herein is not provided on the processing device itself. The digital image is analyzed remotely in the network computer processor, one or more objects detected, a corresponding object found in the database, and a corresponding scent determined. The determined scent information is stored with the detected object and the captured digital image in the electronic memory and can be available or transmitted to other devices connected to a network common to the printer. The stored digital image with object and scent information is then transferred, for example through a network, to a printer for printing on a medium.
In another preferred embodiment of the present invention, the separate computer is a remote server computer accessed through a network. The remote server computer can be provided by an imaging services provider and can be a single processor or multi-processor server. The digital image is transferred to the remote server computer automatically, or through user selection, which user selection is input on a user device, through a network (e.g. the internet). The remote server computer includes a processor (e.g. 755
In another preferred embodiment of the present invention, a processor (e.g. 755) and memory (e.g. 760) that stores programs and a database including objects and associated scents can be provided within a digital camera or other digital imaging device that includes a digital camera, such as a cell-phone or smart-phone. The digital image is analyzed in the digital imaging device, one or more objects detected, a corresponding object found in the database, and a corresponding scent determined. The determined scent information is stored with the detected object and the captured digital image in the electronic memory and can be available or transmitted to other devices connected to a network common to the digital imaging device. The stored digital image with object and scent information is then transferred, for example through a network, to a compatible printer for interpreting the scent information stored with the digital image and printing on a medium.
In another preferred embodiment of the present invention a captured digital image is stored in an electronic storage device before it is analyzed for objects associated with scent identifiers, for example before (step 702
Thus, according to various preferred embodiments of the present invention, an object in a captured digital images can be automatically detected and a scent corresponding to the detected object automatically determined with a processor in a digital camera, a processor in a printer, a processor in a computer separate from a digital camera or printer, a processor in a portable computer, a processor in a cellular telephone, or a processor in a computer server accessible through a network. The detected object and associated information can be stored as metadata in a header associated with a digital image electronic file or with each digital image pixel as an additional image plane or channel in a digital image electronic file. The digital image can be stored in an electronic storage device without additional information or with the metadata or image channels or image planes.
In a preferred embodiment of the present invention, a plurality of objects can be automatically detected in a digital image. The plurality of objects can have different associated scents that can be printed with the different scents in the different image object areas. Thus, a first scent corresponding to a first detected object can be determined, a second scent corresponding to a second detected object can be determined, and the first scent and the second scent can be different scents.
Referring to
Referring to
In another preferred embodiment of the present invention, a first scent can be determined to be a chemical interaction of second and third scents rather than the simple combined presence of each of the second and third scents. The second and third scents can both be applied to a common object area on a printed-image medium where they chemically interact to provide the desired first scent. Alternatively, the second and third scents can be mixed in a reservoir where they chemically interact to provide the desired first scent and are applied together to a common object area on a printed-image medium.
Data systems 1509 can include any form of electronic or other. circuit or system that can supply digital data to processor system 1516 from which the processor can obtain digital images for identifying objects and corresponding scents. In this regard, the data files delivered from systems 1509 can comprise, for example and without limitation, programs, still images, image sequences, video, graphics, multimedia, and other digital image and audio programs such as slideshows. In the preferred embodiment of
Sensors 1507 are optional and can include light sensors, audio sensors, image capture devices, biometric sensors and other sensors known in the art that can be used to detect and record conditions in the environment of system 1500 and to convert this information into a digital form for use by processor system 1516. Sensors 1507 can also include one or more sensors 1508 that are adapted to capture digital still or video images. Sensors 1507 can also include biometric or other sensors for measuring human voluntary and involuntary physical reactions, such sensors including, but not limited to, voice inflection detection, body movement, eye movement, pupil dilation, and body temperature sensors.
Storage/Memory systems 1509 can include conventional memory devices such as solid state, magnetic, HDD, optical or other data storage devices, and circuitry for reading removable or fixed storage media. Storage/Memory systems 1509 can be fixed within system 1500 or can be removable, such as HDDs and floppy disk drives. In the embodiment of
In the embodiment shown in
Communication system 1515 can comprise for example, one or more optical, radio frequency or other transducer circuits or other systems that convert image and other data into a form that can be conveyed to a remote device such as remote server 1501 or remote display device 1506 configured with digital receiving apparatus, using an optical signal, radio frequency signal or other form of signal. Communication system 1515 can also be used to receive a digital image and other digital data from a host or server computer or network (not shown) or a remote server 1501. Communication system 1515 provides processor system 1516 with information and instructions from corresponding signals received thereby. Typically, communication system 1515 will be adapted to communicate with the remote server 1501, or output system 1506 by way of a communication network such as a conventional telecommunication or data transfer network such as the interne, a cellular, peer-to-peer or other form of mobile telecommunication network, a local communication network such as wired or wireless local area network or any other conventional wired or wireless data transfer system.
User input systems provide a way for a user of system 1500 to provide instructions, or selections via a customized user interface, to processor system 1516. This allows such a user to make a designation of digital image files to be used in identifying objects captured in the images and any corresponding scents such as stored in a look-up table. User input system 1502-1504 and 1518-1519 can also be used for a variety of other purposes including, but not limited to, allowing a user to select image files for transmission over a network to another user, or to a server that comprises features for identifying objects in a digital image, or for identifying scents corresponding to identified objects, or both, to enter metadata not otherwise extractable by the computing system, and to perform such other interactions with system 1500 as will be described herein.
In this regard user input systems 1502-1504 and 1518-1519 can comprise any form of transducer or other device capable of receiving an input from a user and converting this input into a form interpreted by processor system 1516. For example, user input system can comprise a touch screen input at 1506 and 1517, a touch pad input, a 4-way switch, a 6-way switch, an 8-way switch, a stylus system, a trackball system or mouse such as at 1503 and 1518, a joystick system, a voice recognition system such as at 1508, a gesture recognition system such as at 1507, a keyboard, a remote control 1502, cursor direction keys, on screen keyboards, or other such systems. In the embodiment shown in
Additional input or output systems 1521 are used for rendering images, text or other graphical representations in a manner that allows a digital image to be reproduced with an applied scent on an image medium. In this regard, input/output systems 1521 can comprise any conventional structure or system that is known for providing, printing or recording images, including, but not limited to, scent compatible printer 1523 and, for example, scanner 1522. Printer 1523 can record images on a tangible surface using a variety of known technologies including, but not limited to, conventional four color offset separation printing. Other contact printing such as silk screening can be performed or dry electrophotography such as is used in the NexPress 2100 printer sold by Eastman Kodak Company, Rochester, N.Y., USA, thermal printing technology, drop on demand ink jet technology, and continuous inkjet technology, or any combination of the above which is represented at 1522-1524. For the purpose of the preceding discussions, printer 1523 will be described as being of a type depicted in
In certain embodiments, the source of data files 1509, user input systems 1502-1504 and output systems 1506, 1517, and 1521 can share components. Processor system 1516 is capable of controlling system 1500 based upon signals from user input system 1502-1504 and 1518-1519, sensors 1507-1508, storage/memory 1509 and communication system 1515. Processor system 1516 can include, but is not limited to, a programmable digital computer, a programmable microprocessor, a programmable logic processor, multi-processing systems, a chipset, a series of electronic circuits, a series of electronic circuits reduced to the form of an integrated circuit, or a series of discrete components on a printed circuit board.
As will be described below, processing system 1500 can be configured as a workstation, laptop, kiosk, PC, and hand held devices such as cameras and smart phones. As an exemplary workstation, the computer system central processing unit 1516 communicates over an interconnect bus 1505. The CPU 1516 may contain a single microprocessor, or may contain a plurality of microprocessors for configuring the computer system 1500 as a multi-processor system, and high speed cache memory comprising several levels. The memory system 1509 may include a main memory, a read only memory, mass storage devices such as tape drives, or any combination thereof. The main memory typically includes system dynamic random access memory (DRAM). In operation, the main memory stores at least portions of instructions for executions by the CPU 1516. For a workstation, for example, at least one mass storage system 1510 in the form of an HDD or tape drive, stores the operating system and application software. Mass storage 1510 within computer system 1500 may also include one or more drives 1511 for various portable media, such as a floppy disk, a compact disc read only memory (CD-ROM or DVD-ROM), or an integrated circuit non-volatile memory adapter 1514 (i.e. PC-MCIA adapter) to provide and receive instructions and data to and from computer system 1500.
Computer system 1500 also includes one or more input/output interfaces 142 for communications, shown by way of example as an interface for data communications to printer 1523 or another peripheral device 1522-1524. The interface may be a USB port, a modem, an Ethernet card or any other appropriate data communications device. The physical communication links may be optical, wired, or wireless. If used for scanning, the communications enable the computer system 1500 to receive scans from a scanner 1522, or documentation therefrom, to a printer 1523 or another appropriate output or storage device.
As used herein, terms such as computer or “machine readable medium” refer to any tangible, non-transitory medium that stores or participates, or both, in providing instructions to a processor for execution. Such a medium may take many forms, including but not limited to, non-volatile media and volatile media. Non-volatile media include, for example, optical or magnetic disks, flash drives, and such as any of the storage devices in any computer(s) operating as one of the server platforms, discussed above. Volatile media include dynamic memory, such as main memory of such a computer platform. Transitory physical transmission media include coaxial cables; copper wire and fiber optics, including the wires that comprise a bus within a computer system, a carrier wave transporting data or instructions, and cables or links transporting such a carrier wave. Carrier-wave transmission media can take the form of electric or electromagnetic signals, or acoustic or light waves such as those generated during radio frequency (RF) and infrared (IR) data communications. Common forms of non-transitory computer-readable media therefore include, for example: a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read programming code and/or data. Many of these forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution.
As is illustrated in
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention. For example, the embodiments described herein the sequence of process flow to print can be changed in terms of the order of printing in image domain or in aroma domain.
U.S. patent application Ser. No. 12/846,260, entitled “Apparatus and Method for Printing in both Image and Aroma Domains Intelligently”, filed Nov. 15, 2010, is assigned to the same assignee hereof, Eastman Kodak Company of Rochester, N.Y., and contains subject matter related, in certain respect, to the subject matter of the present application. Reference is made to commonly assigned, co-pending U.S. patent application Ser. No. ______ by Wang, filed of even date herewith entitled “Image Processing for Images with Aroma Information”; and commonly assigned, co-pending U.S. patent application Ser. No. _______ by Wang, filed of even date herewith entitled “Image Processing for Images with Aroma Information”.
