Patent Application
20050024686
1. Field of the Invention
The present invention relates to an image data recording method and apparatus, and image displaying method and apparatus. More particularly, the present invention relates to an image data recording method and apparatus in which image frames can be written in a well sorted manner, and image displaying method and apparatus capable of displaying image frames in the sorted manner.
2. Description Related to the Prior Art
A photo digitizing system service is known, in which image frames of photo film such as negative photo film are converted digitally into digital image data, which are written to a storage medium, such as a CD (compact disk) medium or DVD (digital versatile disk) medium. A customer or user is supplied with the storage medium. Photographs being converted to the image data, degradation of image quality with time can be prevented. Furthermore, the storage medium according to recent techniques has had a very great capacity, so that a great number of the image frames can be stored therein. In comparison with direct observation of photographic prints, a remarkable advantage arises in that a great number of the image frames can be handled, searched and viewed with great ease. To this end, commercial service of the photo digitizing system has been developed quickly.
JP-A 2002-354385 discloses a photo digitizer for the photo digitizing system. The photo digitizer includes a photo film scanner and a medium drive. The photo film scanner photoelectrically reads the image frames from the photo digitizer. The medium drive responds to the output of the photo film scanner, and writes the digital image data to the storage medium. The image data of the image frames are provided with information of file names mapped thereto according to a sequence of the reading.
The digital image data of the image frames stored in the storage medium are played by running an image displaying program. Various image displaying programs are known, including one for displaying the image frames in an arranged manner in a matrix form, and another program for displaying a selected one of the image frames in enlargement, and still another program for intermittently displaying the image frames at a predetermined interval of time to present a slide show.
After the photo digitizing operation, the digital image data of the image frames are independent from one another. No chronological relationship can be found clearly between the image frames. The image frames in the plurality are combined together according to the single strip of the photo film or film piece. The combined state clarifies the relationship of the calendrical period of photography. On the other hand, the image frames in the digitized form do not have chronological relationships between, because single data files of the image frames are individual from one another.
To enjoy viewing photographs, a user may observe a certain scene in comparison with another included in the image frames and having a date being close to that of the first scene. If a close relationship between the scene is recognized and followed, the recollection of his or her past years can be deeper. However, no known technique is useful in consideration of easily establishing such close relationship between the image frames.
In view of the foregoing problems, an object of the present invention is to provide an image data recording method and apparatus in which image frames can be written in a chronologically sorted manner, and image displaying method and apparatus capable of displaying image frames.
In order to achieve the above and other objects and advantages of this invention, an image data recording method of recording image data of an image frame to a storage medium is provided. In the method, the image frame is read from a film piece by a scanner to obtain the image data, the film piece being included in a plurality of film pieces defined by splitting of photo film, the film piece having a plurality of the image frame which is readable by the scanner. The image data is written to the storage medium together with piece discernment information for discernment of the film piece.
The piece discernment information is constituted by counted information of the film piece according to counting toward a front or rear end of the photo film in serial arrangement of the plural film pieces in an unsplit form of the photo film.
The photo film after being developed photographically is cut into a plurality of the film pieces, is contained in photo film sheaths, and the film pieces have a length adapted to a shape of the photo film sheaths.
Furthermore, the film pieces arranged in series are counted. The piece discernment information is assigned to the film pieces according to a result of the counting step.
Furthermore, the image frames are read per the film pieces. The image frames being read are counted in a range of the film pieces. Image frame discernment information is assigned to the image frames according to a result of the counting step. The image frame discernment information is written to the storage medium.
Furthermore, the film pieces are spliced together in series, to obtain a film piece group. The film piece group is transported. At least one of front and rear ends of the film pieces are detected in the film piece group being transported, the film pieces being counted upon detection of the front or rear end.
Furthermore, photo film discernment information of the photo film is written to the storage medium.
In a preferred embodiment, furthermore, information of a photographing date of the image frames is obtained by analyzing the image data according to character recognition. The information of the photographing date is written to the storage medium.
Furthermore, in case of failure of determining the photographing date, an estimated photographing period is determined. Information of the estimated photographing period being determined is written to the storage medium.
The estimated photographing period is determined by analyzing type information of a type of the photo film.
Furthermore, in case of failure of determining the photographing date, a production period is determined according to the type information, the production period being regarded as the estimated photographing period. In case of failure of determining the production period, an availability period is determined according to the type information, the availability period being regarded as the estimated photographing period.
Furthermore, the image frames are sorted per the film pieces according to the piece discernment information read from the storage medium. The image frames are displayed in a sorted manner by the film pieces.
The storage medium comprises an optical information recording medium.
Also, an image data recording apparatus for image data of an image frame is provided. An information recorder writes the image data to a storage medium, the image data being of respectively image frames obtained by reading from photo film. The information recorder writes piece discernment information of plural film pieces to the storage medium at addresses where the image frames are associated with respectively one of the film pieces, a series of the film pieces constituting the photo film.
The photo film after being developed photographically is cut into a plurality of the film pieces, is contained in photo film sheaths, and the film pieces have a length adapted to a shape of the photo film sheaths.
Furthermore, a transporting mechanism transports a film piece group of the film pieces in series. An edge sensor detects at least one of front and rear ends of the film pieces in the film piece group being transported. A controller counts the film pieces upon an output of the edge sensor, and assigns the piece discernment information to the film pieces according to a result of counting, the piece discernment information being transmitted to the information recorder.
Furthermore, an image sensor reads the image frames per the film pieces. The controller counts the image frames being read in a range of the film pieces, and assigns image frame discernment information to the image frames according to a result of counting, the image frame discernment information being written to the storage medium by the information recorder.
In a preferred embodiment, furthermore, a date image analyzer obtains information of a photographing date of the image frames by analyzing the image data according to character recognition, wherein the information recorder writes the information of the photographing date to the storage medium.
Furthermore, a period estimating unit is operated in case of failure of determining the photographing date, for determining an estimated photographing period, wherein the information recorder writes information of the estimated photographing period being determined to the storage medium.
The period estimating unit includes a storage device for storing first and second data tables. The first data table is constituted by information of a prescribed production period stored at an address of type information of one type of the photo film of which the production period is recognizable. The second data table is constituted by information of a pre-estimated availability period stored at an address of the type information of the type of the photo film irrespective of recognition of the production period thereof. The controller refers to the first data table for determining the production period according to the type information, and in case of failure of determining with the first data table, refers to the second data table for determining the availability period according to the type information, either one of the production period and the availability period being adapted to determining the estimated photographing period.
According to still another aspect of the invention, an image displaying method of displaying image frames of photo film on a display panel is provided. The image frames are arranged per film piece on the display panel, the film piece being defined by splitting of the photo film after being developed photographically.
Furthermore, image data of the image frames are read from a storage medium. The image data are sorted per the film piece.
Furthermore, piece discernment information is read from the storage medium, the piece discernment information being adapted to sorting of the image data per the film piece.
In the arranging step, at least one film piece region is determined on the display panel, to extend horizontally, and display a plurality of the image frames commonly included in the film piece.
The display panel further displays photo film discernment information of the photo film and the piece discernment information in association with the film piece region.
The at least one film piece region comprises plural film piece regions arranged vertically in series.
In the arranging step, an enlarged indicating frame region is determined on the display panel, to display a designated one of the image frames indicated in the film piece region in an enlarged size.
Furthermore, it is determined whether the piece discernment information is stored in the storage medium. In case of failure of determining the piece discernment information, the image frames are arranged on the display panel according to discernment information of the image data.
Also, an image displaying apparatus for displaying image frames of photo film on a display panel is provided, and includes a display panel. A controller reads image data of the image frames from a storage medium, reads piece discernment information of a film piece from the storage medium, the film piece being defined by splitting of the photo film after being developed photographically, and controls the display panel according to the image data and the piece discernment information, to arrange the image frames per the film piece on the display panel.
The above objects and advantages of the present invention will become more apparent from the following detailed description when read in connection with the accompanying drawings, in which:
In
The DVD medium 12 after recording of the image data of image frames and photo film reference information files is supplied to the user. A personal computer 13 at the home of the user is loaded with the DVD medium 12, to play the image data to display the image frames. A DVD drive 14a is connected with a computer main unit 14 of the computer 13, and receives insertion of the DVD medium 12 set therein. Peripheral elements are connected with the computer main unit 14, including a display panel 16 and an operation panel 17 having a keyboard, mouse and the like. A PC CPU or controller 14b in the computer main unit 14 responds operation signals from the operation panel 17, runs an image displaying program, to display image frames on the display panel 16 by playing the image data.
The photo film 10 is separated in plural film pieces 21, which are contained in photo film sheaths 22 or holder for preservation at a user or customer. The photo film sheaths 22 are used respectively for the film pieces 21 and a single user order of photofinishing of the film pieces 21. The film pieces 21 have a length of recording at most six (6) image frames.
In
User order information is recorded to the leader sheet 26, including a user information in a form of a user code, ordering date information, order number information, and photo filmstrip discernment information. The user order information is recorded in a bar code system, and is readable by the photo digitizer 11. The photo filmstrip discernment information is information for discerning plural photo filmstrips with which a single order is placed. Photo filmstrip numbers of 1, 2, 3 and so on are mapped to the photo filmstrips. For example, numbers of 1-10 are mapped to a plurality of the leader sheet 26 if ten strips of the photo film 10 is related to a single order.
In the present embodiment, a bar code is printed on the leader sheet 26 for representing information. However, any suitable system other than the bar code system may be used for storing of information with the leader sheet 26. A wireless tag, or other IC memory chip of a small type may be incorporated in the leader sheet 26. User information or the like may be written to the IC memory chip.
In the present embodiment, the plurality of the photo film 10 for one order are spliced together for forming the user order film piece group 24. However, a plurality of the photo film 10 for two or more orders may be spliced together for forming the film piece group 24, which can be scanned consecutively. The user orders are discerned according to the ordering numbers included in the user order information. If the film piece group 24 includes photo filmstrips 10 owned by plural users, obtained image data are sorted for each of the users according to the user information included in the user order information.
In
An area CCD camera 33 having an image sensor is incorporated in the scanner 32. A light source 34 emits detection light, which passes through the photo film 10 and is received by the CCD 33, so image frames on the user order film piece group 24 are read photoelectrically. An A/D converter 36 receives an analog output of the CCD 33, converts the output into a digital image data, which is sent to the digitizer main unit 31. Transport rollers 37 transport the film piece group 24. When image frames of the film piece group 24 respectively reach a reading position of the CCD 33, the transport of the film piece group 24 is stopped to read an image frame. Upon completion of reading one frame, the film piece group 24 is transported for one frame, to read a succeeding image frame. A transport motor 38 drives the transport rollers 37. A controller 39 controls the transport motor 38, the CCD 33, and elements included in the scanner 32.
A bar code reader 41 and an edge detecting photo sensor 42 are disposed upstream from the CCD 33. The bar code reader 41 reads the user order information recorded on the leader sheet 26. An A/D converter 43 converts the user order information to digital data, which is input to the digitizer main unit 31. The edge detecting photo sensor 42 detects an end or edge of each one of the film pieces 21, and transmits an edge sensor signal to the controller 39. The edge detecting photo sensor 42 is a photo sensor, but may be a sensor of a different type. There is an A/D converter 44 for converting the edge sensor signal to a digital signal. The controller 39 responds to the edge sensor signal, discerns ends of the film piece 21, and causes the transport motor 38 to control a moving amount of the user order film piece group 24.
In the film piece 21, image frames are arranged at a predetermined interval. In reading the respective image frames in the film piece 21, the controller 39 causes transport of the user order film piece group 24 at an amount according to the predetermined interval after reading of each one frame. Thus, a second image frame is set at the reading position of the CCD 33. However, an interval between a final frame or sixth frame of a first one of the film pieces 21 and a starting frame or first frame of a second one of the film pieces 21 is different from the above-described predetermined interval. Thus, the front and rear ends of the film pieces 21 are detected by the edge detecting photo sensor 42, to control a transported amount of the film piece group 24.
Also, an edge sensor signal from the edge detecting photo sensor 42 is sent to the digitizer main unit 31 by the controller 39. A digitizer controller or CPU 45 in the digitizer main unit 31 responds to the edge sensor signal, counts the number of the film pieces 21, and recognizes the piece number of a handled one of the film pieces 21 as a portion of the photo film 10.
The digitizer main unit 31 is basically constituted by a personal computer or workstation, and includes the digitizer CPU 45, a RAM 46, an image processor 47, a hard disk 48 or storage device as a period estimating unit, and a DVD recorder 49 or DVD drive as information recorder. The storage device may be any type other than the hard disk 48, and can be a server. Various programs are stored in the hard disk 48, including the operating system (OS), a device driver program for controlling the scanner 32, and a writing program for writing image data to the DVD medium 12.
The digitizer CPU 45 runs various programs stored in the hard disk or storage device 48, to control relevant elements of the apparatus. RAM 46 is a work memory used during execution of the programs by the digitizer CPU 45, but also stores data transmitted by the scanner 32 in a temporary manner. Image data of the image frames are written to RAM 46 temporarily. The image processor 47 subjects the image data to image processing, before the process image data is written to the hard disk 48. Examples of the image processing in the image processor 47 includes correction processing of gamma correction or the like, and data compression. Image data of the image frame is compressed according to the JPG (Joint Photographic Experts Program) format and converted in JPG files.
User order information read from the leader sheet 26 is written to RAM 46. The digitizer CPU 45 produces a photo film reference information file according to the user order information and edge sensor signal. The number of the reference information file is one for one user order. When the bar code reader 41 reads the user order information for a first time in relation to the user order film piece group 24, the digitizer CPU 45 produces a photo film reference information file newly.
At each time that image data of one image frame is read, information is stored in areas of the reference information files at the address of the file name of the image data, the information including the photo filmstrip number, piece number and frame number. In
The piece number is for discernment of each film piece in the photo film 10 as single strip. No. 1 is mapped to a first one of the film pieces 21 in the photo film 10. This number is stepped incrementally at each time that an end of the film pieces 21 is detected. When the entirety of the photo film 10 is read, the counting of the piece number is reset. As the frame number is for discernment of six (6) frames in each one of the film pieces 21, numbers of 1-6 are mapped to the frames of the film pieces 21 in the order of reading.
It is likely that an unrelated one of the film pieces 21 is mixed with the film pieces 21 included in the user order film piece group 24. In an ordinary state, the plurality of the film pieces 21 associated with the photo film sheaths 22 are combined to constitute the photo film 10. However, a certain film piece may be mixed in the film pieces 21 of the photo film sheaths 22. If there is an error, the photo filmstrip number may be mapped to the certain film piece even though it should be given a different photo filmstrip number.
To prevent the errors in recognition, it is preferred to read the DX code recorded on the photo film 10, to check whether two adjacent pieces in the film pieces 21 constitute the photo film 10 commonly. As is well-known in the art, the DX code has an encoded form of information of type of the photo film, level of photo sensitivity and the like. The code system is according to the ANSI (American National Standard Institute). If coincidence of the DX code is found by checking, it is confirmed that no incidental mixture of the film pieces 21 from other photo filmstrips occurs. If two differently derived pieces of the film pieces 21 are mixed, mixture information, such as time error information, can be recorded in association with image data of image frames of the film pieces 21 without mapping photo filmstrip numbers, piece numbers or frame numbers. This mixture information makes it possible to search and find the mixed pieces subsequently with great ease.
The DVD recorder 49 writes information to the DVD medium 12, the information including image data of read image frames, and the photo film reference information files 51 associated with the image data. In
The DVD medium 12 is supplied to the user together with the photo film 10. The user operates a personal computer, starts up an image displaying program 54, to play image frames on the display panel according to image data recorded in the DVD medium 12.
In
A cursor 63 is indicated in the index menu pattern 61, and shifted to click a desired one of frames for enlargement. In
The cursor 63 is indicated at one of the thumbnail images in the film piece region 64b corresponding to the enlarged image frame 66 in the enlarged indicating frame region 64a. If the cursor 63 is shifted and set to a second one of the thumbnail images, the enlarged image frame 66 formed by enlarging the second thumbnail image is displayed in the enlarged indicating frame region 64a.
The operation of the embodiment is described by referring to flow charts of
When the edge detecting photo sensor 42 detects an end of the film pieces 21, reading of an image frame is started. Upon reading of one image frame, image data is written to RAM 46 temporarily, and then stored in the hard disk or storage device 48. Then information of the frame numbers of image frames already read is written to an area of the reference information file in association with the photo filmstrip number and the piece number. Upon completion of reading the one image frame, the user order film piece group 24 is moved forwards by a predetermined moving amount. Another frame is read in a similar manner. Thus, six image frames are read. Then a succeeding one of the film pieces 21 starts being read. When one of the film pieces 21 is next detected, the photo filmstrip number is counted up. Also, the frame number is reset. The six-frame reading is effected also for the film pieces 21 in a similar manner, to write the image data of the image frames to the hard disk 48. Information of the photo filmstrip number and the piece number is written to areas of the photo film reference information file one after another.
When the digitizer CPU 45 detects the leader sheet 26 for the second time, the digitizer CPU 45 judges that reading of the photo film 10 is completed, and resets the piece number. In a manner similar to the above, image frames are read, and additional writing to a photo film reference information file is effected. When reading of the user order film piece group 24 is finished, image data of image frames and the photo film reference information file is written to the DVD medium 12. At this time, the image displaying program 54 is written to the DVD medium 12.
The DVD medium 12 is supplied to the user as customer. The user starts up the image displaying program 54 at the computer 13, and plays the image data of image frames stored in the DVD medium 12. In
If a photo film reference information file exists, the photo film reference information file is read together with image data of image frames. The image frames are sorted according to the file names. Also, the index menu pattern 61 is indicated in which the image frames are sorted and arranged by the film pieces 21 according to the photo film reference information file. A selected one of the image frames are designated for enlargement, to change over to the enlargement menu pattern 64. The enlarged image frame 66 included in the enlarged indicating frame region 64a is displayed conspicuously. Also, the remaining image frames are displayed in a thumbnail form with the background pattern 68, the remaining image frames being included in the same film piece.
Displaying the image frames on the display panel 16 by the unit of the film piece makes distinct the relations between the frames apparently. Thus, visual interest can be enhanced by the appearance similar to viewing the film pieces 21 itself. If a user wishes printing to photographic paper, an album is used for arranging and binding pictures. It is likely that certain two pictures are arranged in reverse to their time sequence, or that one picture is disposed adjacent to another picture with which the initial picture is totally unrelated. This is because he or she does not need to arrange the pictures in the order of the time. However, it is inevitable that image frames are arranged completely by following the sequence if within a single photo filmstrip. Also, the use of the photo film reference information file can maintain the chronological relationship typically for the photo film reference information file.
A user is likely to have prints produced only when some scenes particularly impress him or her. If very little impression remains, no print or no article as records is likely to have been produced. However, digitization of all frames of the photo filmstrips makes it possible to display scenes in very close chronological relationships. The user is enabled to review and observe various image frames by considering those relationships. Even though certain images are dropped from his or her awareness or impression, they can be rediscovered or newly evaluated.
In the above embodiment, image frames are read from the photo film. However, it is possible to extract photographing date information from portions of an image frame, and write the date information to an area of the reference information file. A date image analyzer 80 in the digitizer main unit 31 is operated to receive and analyze image data of each image frame, and scans and evaluates color and density of portions of the image, for character recognition and obtaining date information imprinted inside the frame region according to the analysis of the image. This makes it possible to sort and arrange image frames according to the order of the date information at the image playing time. This is useful to users. Also, the storing of the date information as part of the reference information file can be regarded as useful for the chronological relationship between digitized image frames.
In
It is likely that digits of the photographing date have very similar color as that of portions of the background image. This causes failure in character recognition to detect the photographing date. For this case, a preferred process is provided, in which the unreadable date is estimated according to distinctly readable two photographing dates of two image frames directly before and after the unreadable image frame. On the single photo filmstrip, exposures are taken by following the sequence of time. Let an image frame at the frame No. 2 be unreadable. If one image frame directly preceding to the unreadable frame has the photographing date of Dec. 12, 1988, and if one image frame directly succeeding to the unreadable frame has the photographing date of Jan. 1, 1989, then the unreadable frame is detected to have a photographing date in a range between those two dates. For this case, a period of Dec. 12, 1988-Jan. 1, 1989 is mapped to this unreadable frame. Furthermore, let a third image frame have the same photographing date as a first image frame which is two frames before the third. Then a second image frame between the first and third is detected to have the same photographing date, which can be mapped to the second without an error.
A photographing date naturally can be obtained and used if clearly readable in each one of image frames. If there is no imprinting of a photographing date, a photographing date cannot be recognized in a distinct manner. However, it is conceivable to estimate a period or term in which an actual photographing date is included. This is subsidiarily useful in sorting image frames in addition to clearly readable photographing dates.
To determine a calendrical period of photography of an image frame, the use of the above DX code is conceivable. It is necessary to use the DX code at the time of printing. In general, operators at photo laboratories for printing have been enabled to use the information by considering relationships between the DX code and information including a name of a manufacturer, a product name and the like. It is possible to use the DX code as useful information in the photo digitizing system, so as to find the product name of the photographic film by use of the DX code.
In
Let a production period be from November of 1988 to November of 1990. Let the photo filmstrip have a useful life or valid term of two years. Then a calendrical period of photography is estimated from November of 1988 to November of 1992. The calendrical period of photography is mapped to the respective image frames. Note that the DX code table 72 and the production history data table 73 are stored in the hard disk or storage device 48 of the photo digitizer 11. At the time of producing image files of image frames, the digitizer CPU 45 runs the period determining program to determine the calendrical period of photography.
To estimate a production period effectively according to a DX code, a production period table requires creating. However, a search of production periods of all known manufacturers is extremely difficult. For example, it is nearly impossible to find detailed information of foreign products or unfamiliar manufacturers.
Another preferred embodiment is directed to use an availability period of the photo filmstrip as calendrical period of photography, in place of its production period. To estimate the availability period, a DX code of the photo filmstrip is utilized to estimate photographing dates indirectly. Initially, sampling of data is required. Specifically, partial images in various image frames having photographing dates are read, analyzed by character recognition, and stored for sampling. DX codes of photo filmstrips are read. Information of relationships between the photographing dates and the DX codes are stored empirically. As a result, an availability history data table 76 of information which includes availability periods is created for relationships between the DX codes and the periods of availability of the negative photo films. See
Note that the period determining method of determination by sampling and storing the relations between the DX codes and the photographing dates is an auxiliary process used only when the DX code is not found in the production history data table 73. However, this method of determination by sampling and storing can be used as a period determining method of photo filmstrips of which the DX code is found in the production history data table 73.
In the above embodiment, the photo film is negative. However, the photo film according to the invention may be a positive film on which positive images of image frames are created.
In the above embodiment, the image displaying program or software is written to the DVD medium. However, the DVD medium may not store the image displaying program. Instead, a storage device in the computer is used for installing the image displaying program, which is run for displaying operation. In the above embodiment, the personal computer is used for displaying images. However, a general-purpose computer may not be used. An image displaying apparatus of the invention may have a specialized construction distinct from a general-purpose computer.
Examples of the DVD medium 12 used herein can be a type recordable at one time, such as DVD−R and DVD+R, and also a rewritable type, such as DVD−DW, DVD+DW and DVD−RAM. Furthermore, any suitable storage media may be used, including a CD medium, MO medium, micro drive (trade name), blue ray disk (or blu-ray disc), and other optical information recording media.
Although the present invention has been fully described by way of the preferred embodiments thereof with reference to the accompanying drawings, various changes and modifications will be apparent to those having skill in this field. Therefore, unless otherwise these changes and modifications depart from the scope of the present invention, they should be construed as included therein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2003-205113 | Jul 2003 | JP | national |
