Method and system for reading and assembling audio and image information for transfer out of a digital camera

Abstract

An electronic camera for connection to an external device such as a personal computer. The camera captures both images and audio which are associated with the images. The image and associated audio are written into a memory of the camera along with information describing the relationship between the image and audio. In this manner, the image can be played or presented at the same time as the audio is presented to a user. When the image and associated audio are transmitted out of the camera to an external device such as a personal computer, no information is transmitted describing the relationship between the image and audio. The image and audio are received by the external device and written into memory. The relationship between the image and audio can be determined by the fact that the image and audio were transmitted at the same time as a unit of information. Subsequently, information describing the relationship between the image and audio is written into a memory of the external device along with the image and audio.

Description

CROSS-REFERENCES TO RELATED APPLICATIONS

This application is related to commonly owned co-pending U.S. patent application Ser. No. 08/535,378 entitled "Digital Electronic Camera Having an External Input/Output Interface Through Which the Camera is Monitored and Controlled" and U.S. patent application Ser. No. 08/535,562 entitled "A Digital Electronic Still Camera Which Receives an Input/Output Control Program Through a Detachable Communication Interface Card", both of which were filed on Sep. 28, 1995 and are incorporated herein by reference. This application is also related to commonly owned co-pending U.S. patent application Ser. Nos. 08/606,196 entitled "Digital Camera Which Detects a Connection to an External Device", and 08/603,583 entitled "External Communication Interface for a Digital Camera", each concurrently filed with the present application and incorporated herein by reference.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to a digital electronic camera and the interfacing of the camera to an external processing device which monitors, receives images and/or audio, and/or controls the camera through an input/output interface. The invention is more particularly related to a digital electronic camera which automatically detects a connection to the external processing device.

Discussion of the Background

Conventional cameras which use light sensitive film have been known for a long time and the manner of generating images is well-known; light sensitive photographic film is exposed to light which passes through a lens and a shutter. The film is then taken to a developing center and processed into photographic prints.

Digital electronic cameras which electronically capture images or images along with audio are also known. However, this field of technology is relatively new and there is not a universal standard for exporting or producing images from digital cameras. When designing the camera corresponding to the present invention, the inventors have discovered various problems in communicating information out of the camera. These problems include the connection of the camera to an external device such as another camera or a general purpose computer. The present inventors have sought to overcome problems pertaining to the actual connection of the camera to the external device, the conversion of signal levels from a level used by the processor within the camera to a level compatible with a communication interface, the detection of a connection of the camera to the external device, and the manner of assembling the information to be transmitted.

SUMMARY OF THE INVENTION

Accordingly, one object of the present invention is to provide an electronic camera which can efficiently transmit information to an external device such as a computer. It is a further object of the invention for the camera to transmit both image and audio information out of the camera. It is another object of the invention to transmit image and audio information out of the camera without transmitting specific data which defines the relationship between the image and audio information.

These and other objects are accomplished by an electronic camera for connection to an external device such as a personal computer. The electronic camera first obtains image and audio information by detecting light which passes through a lens of the camera by a light sensor such as a charge couple device (CCD) and audio information using a microphone. The image and audio are separately compressed by the camera and stored within the camera. Also, information describing that the audio information is related to the image is stored in a memory of the camera.

When transmitting the image and audio out of the camera, the information describing the relationship is read to obtain the correspondence between the image and audio files. The desired image and audio files are then grouped together and transmitted out of the camera without any information describing the relationship between the audio and image.

When an external device such as a personal computer receives the combined image and audio, the image and audio are separated and stored in a memory of the computer. Further, information indicating the relationship between the image and audio are stored in the memory of the external device. Because the image and audio are transmitted together, the external device can determine that the image and audio are related to each other.

Preferably, the camera includes a first in first out (FIFO) memory which is used to temporarily store the information before it is transmitted. The FIFO memory can be used as a buffer both as the image and audio are being read from a memory of the camera so that the image and audio can be transmitted, and also before the image and audio information are written into the memory of the camera. The memory of the camera can be implemented using flash memories. In order to make the flash memories have a high storage speed, high speed buffers such as SRAM memories which are smaller in size than the flash memories can be utilized as buffers.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of the invention and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:

FIG. 1A illustrates a perspective view of the front and top of a digital camera according to the present invention;

FIG. 1B illustrates another perspective view of the digital camera of FIG. 1A viewed from the bottom and rear;

FIGS. 2A-2C illustrate perspective views of an external communication interface of the camera;

FIG. 3A illustrates a top view of a latching mechanism of the external communication interface;

FIG. 3B illustrates a cross-sectional view of the latching mechanism of the external communication interface;

FIG. 4A illustrates a view from the top of a pivoting latch member of the latching mechanism;

FIG. 4B illustrates a cross-sectional view of the pivoting latch member;

FIG. 5A illustrates the manner of inserting a latch 196 of the pivoting latch member into a receiving member;

FIG. 5B illustrates the latch 196 after being inserted through and latched to the receiving member;

FIG. 6A illustrates a top view of the latch locked into the receiving member;

FIG. 6B illustrates the pivoting latch member in a release position in which the pivoting latch member has rotated about pivot point 214;

FIG. 7 is an exploded view of the internal components of the external communication interface;

FIG. 8 is a functional block diagram of the electrical aspects of the digital camera;

FIG. 9 illustrates the details of the CPU 23 of the camera;

FIG. 10, illustrates a functional block diagram of the memory card 16 employing four flash memories;

FIG. 11 is a flowchart illustrating the process of capturing an image and audio by the camera;

FIG. 12 illustrates the manner of storing files within the memory card 16 and the format of information to be transmitted out of the camera;

FIG. 13A illustrates a single switch which controls both whether the camera is recording, playing or is off along with whether the camera is receiving or transmitting when connected to an external device;

FIG. 13B illustrates two switches; one for placing the camera in a receive or a transmit mode and the other for setting the camera to a record mode, play mode or turning the camera off;

FIG. 14 illustrates a flowchart of the communication process of the camera with an external device;

FIG. 15 illustrates the manner of transmitting information of the camera to an external device;

FIG. 16 is a flowchart illustrating the specific steps for receiving and storing by the camera data from an external device;

FIG. 17 is a functional block diagram of the electrical components within the external communication interface; and

FIG. 18 illustrates a timing diagram showing how power to the communication circuitry is reduced in order to conserve the life of a camera battery.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring now to the drawings wherein like reference numerals designate identical or corresponding parts throughout the several views, and more particularly to FIG. 1A thereof, a perspective view showing the front and top of a digital electronic camera according to the present invention is illustrated. The camera, referred to as a digital camera or electronic camera, captures images and/or audio and writes this information into a memory in digital form. The use of photographic film is not necessary and the camera may capture a series of consecutive still images to provide video with movement or motion. The camera 100 illustrated in FIG. 1A contains a button 102 for turning the flash 20 on and off and changing the flash mode, a button 104 for setting the recording mode such as whether audio is to be captured, whether a series of consecutive images are to be captured, etc. A display 22 is a LCD display which displays the state and settings of the camera such as the flash mode, record mode, battery state, number of images taken and other features of the camera. Switch 108 is used to set the self timer and switch 110 is used to turn the camera off and on and also sets whether the record mode or play mode is to be used. This switch in one embodiment is also used to set whether the camera will be in a transmit or receive mode when connected to an external device. There is a red LED 112 which indicates that an image is being recorded or that the self timer is operating. The windows designated by 114 are used to perform automatic focusing and the viewfinder window is designated by 116. Images are captured through the lens 7, and there is a window 118 for receiving commands from an infrared remote control (not illustrated) which can be used to instruct the camera to capture images and/or audio and also control the functions of the camera. There is also a clip 120 which holds a camera strap. A slidable lever 122 is used to zoom the lens and the camera also includes a shutter release button 124.

FIG. 1B illustrates a perspective view of the bottom and back of the camera 100. There is knob 130 to adjust the visibility, a cover 132 which covers an opening for a small button type battery used to maintain the setting of parameters in memory, a view finder 134, a date button 136 and time button 138 which controls the operation of the date and time functions of the camera, a microphone 140, and a switch 142 for controlling the image quality or resolution. There is a hole 146 for receiving a bolt from a tripod, and a lever 148 for releasing memory or I/O cards from the camera body through the slot 160.

The camera according to the present invention allows images and audio in a digital format to be transmitted from and received by the camera to and from an external communication interface which connects to a connecting portion 150 of the camera. The connecting portion 150 includes concave protrusions 152, each protrusion having a hole 154. Within each hole is a receiving member 156 which, due to its position within the hole 154, cannot be seen in FIG. 1B and is more clearly illustrated in FIGS. 5A and 5B which are described below. These receiving members 156 are metal and also serve to provide grounding connections between the camera and the external communication interface. There are also electrical contacts 158 which allow an electrical connection between the camera 100 and an external communication interface. Because of the existence of the slots 160 for receiving various types of cards (e.g., memory or communication PCMCIA cards) there is very little depth for the connection portion 150. This requirement resulted in the design of a novel connection mechanism described in further detail below. Additionally, a conductive ribbon cable which is thin and flexible is used to feed power and receive and transmit signals through the contacts 158.

The camera also includes contacts 162 on the side of the camera and connectors 164 which allow connection of a video display and a speaker to display images and audio generated by the camera.

FIGS. 2A-2C illustrate perspective views of an external communication interface 180. The interface 180 includes, as illustrated in FIG. 2A, a sliding release button 182, a DIN 8 pin RS-422 interface for connection to a modem port of a Macintosh computer and a 9 pin D connector 188 which communicates according to the RS-232 format to an IBM compatible personal computer. Images and/or audio are communicated between the connected computer and camera in either direction. The interface 180 also includes nuts 186 for receiving screws from a pin connector which plugs into the D-9 pin connector 188. FIG. 2B is a perspective view showing the underside of the communication interface 180 which connects to the camera 100. A clearer view of this connection portion 190 is seen in FIG. 2C.

The connection portion 190 includes convex indentations 194 which match with the concave protrusions 152 of the camera. The convex indentations 194 include pivoting latches 196 which latch with the receiving member 156. The communication interface also includes pins 192 which correspond to the contacts 158 of the camera.

FIG. 3A illustrates a latching mechanism 200 located within the external communication interface 180 which is used to connect the external communication interface 180 to the camera 100. The latching mechanism 200 includes a frame 202. On the frame is mounted a spring connector 204 which is used to mount a spring which is connected to a sliding release unit which is illustrated in FIG. 7. There is a pivoting latch member 210 which includes the latch 196 and is resiliently held in place via a spring 206.

FIG. 3B is a cross-sectional view of the latching mechanism 200 illustrated in FIG. 3A. In this figure, it is seen that the frame 202 is not planar but has the center portion thereof raised above a level of the region supporting the pivoting latch member 210. This allows the latching mechanism 200 to be mounted to a board, for example a printed circuit board, having holes to accommodate the end regions of the frame. Only the center region of the frame is mounted on the printed circuit board.

FIG. 4A is a top view of the pivoting latch member 210. The pivoting latch member 210 contains a body 212 which is pivotally mounted at a pivot point 214. Connected to the body 212 is the latch 196 and a pressing surface 216. FIG. 4B is a cross-sectional view of the pivoting latch member 210. This figure clearly shows that the latch 196 is at a level below the level of the body 212. This allows the latch 196 to be inserted into the hole 154 of the camera. Further, the level of the pressing surface 216 is shown to be above the level of the body 212 of the pivoting latch member.

FIGS. 5A and 5B are a perspective view of the operation of connecting the latch 196 of the external communication interface 180 to the receiving member 156 of the connecting portion of the camera. In FIG. 5A, first the latch 196 is pushed downwardly to the level of the receiving member 156. Next, the latch 196 is pushed through the receiving member 156 in order to engage with the receiving member 156 as illustrated in FIG. 5B. Referring to FIG. 5A, as the latch 196 is pushed forward through the receiving member 156, the surface 196A of the latch 196 contacts the surface 156A of the receiving member 156. The rounded surface 196A of the latch 196 causes the latch 196 to pivot and then engage with the receiving member 156, as illustrated in FIG. 5B.

FIGS. 6A and 6B are a top view of the interaction of the pivoting latch member 210 with the receiving member 156. In FIG. 6A, the pivoting latch member 210 is engaged with the receiving member 156 and corresponds to the perspective view illustrated in FIG. 5B. In order to release the latch 196 from the receiving member 156, a force is applied against the pressing surface 216 which pivots the latch member 196 so that the latch member 196 and the entire external communication interface can be slid back so that the latch 196 is no longer under the receiving member 156. Then, the latch 196 along with the entire external communication interface can be separated from the camera by moving the external communication interface away from the camera.

FIG. 7 is an exploded view of the internal components of the external communication interface 180. There is a sliding release unit 222 having ends which engage with the pressing surfaces 216 of the pivoting latch member 210. The exact position of the sliding release button 182 illustrated in FIG. 2A can be seen in FIG. 7. There is a groove 224 in the sliding release unit 222 which mates with and receives the spring connector 204. The spring connector 204 slides along this groove 224. There is also a spring connector 226 on the latching mechanism 222. A spring (not illustrated) connects to the spring connector 204 and the spring connector 226. This keeps the sliding release unit 222 biased away from the pressing surfaces 216. In order to operate the release mechanism, the sliding release unit is pushed towards the pressing surfaces 216 in the direction of the arrow on the sliding release button 182 which causes the latches 196 to pivot inwardly or towards each other.

The frame 202 of the latching mechanism spans the two holes 232 in a printed circuit board 230. Due to the offset levels of the frame 202, the ends of the frame containing the pivoting latch members 210 fit within the holes 232. Mounted on the printed circuit board 230 is a signal level conversion chip 234 which is described in detail below. Connected to the signal level conversion chip 234 are the 8 pin RS-422 connector 236 and the 9 pin D connector for RS-232 signals.

FIG. 8 is a block diagram showing the details of the construction of the camera 100. The microphone 1 is connected to an amplifier/filter 2a, which outputs a signal to an analog-to-digital converter 4. The amplifier/filter 2a reduces the audio signal to the appropriate bandwidth. The analog-to-digital converter 4 operates with an optimum sampling frequency, for instance, at a frequency which is an integer-times of the sub-carrier frequency of an NTSC signal used by the camera. Further, a sampling frequency of the A/D converter 4 is more than two times the necessary bandwidth. An audio data compression/expansion circuit 3 is used to encode and decode audio signals using known methods of audio encoding such as linear PCM, Dolby AC-3, or MPEG-2 audio encoding. The compressed audio signals are transmitted to a conventional FIFO circuit 13 which functions as a memory and alternatively can be a DRAM. The FIFO circuit 13 includes a section for images and a section for audio. Unencoded digital audio signals from the compression/expansion circuit 3 are transmitted to a digital-to-analog converter 5 and subsequently amplified and filtered by the amplifier/filter 2b. The audio signals included in the signals 26 are then output to a suitable audio generator such as a speaker 32.

An image photographing section 6 of the camera includes a photographing lens 7, a lens opening 8, an image photographing element 9 such as a CCD (charge coupled device) or a MOS-type image photographing element. The CCD 9 in the preferred embodiment has a resolution of 768.times.480 (horizontal.times.vertical). The output of the CCD 9 is transmitted to a circuit 10 which eliminates noise from the analog signal output by the CCD 9. This may be accomplished by a correlative doubled sampler (CDS). The output image signal from the image photographing portion 6 is transferred to an analog-to-digital converter 4 which transmits a digital image signal to a digital signal processing circuit 11 which, for example, performs ordinary and known treatment of the image signal including gamma-compensation, color separation, and generates the luminance signal Y, and color difference signals Cb and Cr in a known manner. An example of the performance of these functions is disclosed in U.S. Pat. No. 5,343,243, which is incorporated herein by reference. Video signals (either analog or digital) are output from the digital signal processing circuit 11 as a video signal 26 which is displayed by a display such as a color LCD panel.

An image data compression/expansion circuit 12 is used to encode and decode the images using known image compression methods which transform the images into and out of compressed formats such as GIFF, JPEG, MPEG or any other known image compression method. Details of image compression which may be used by the camera 100 are disclosed in U.S. Pat. No. 5,414,464 which is incorporated herein by reference. A card interface circuit 14 is connected to the card connector 17 through the card interface bus 25. The card interface circuit 14 controls communications between the camera and the plug-in communication cards which for example may function as a LAN card, a modem card either for a conventional wired telephone system or a cellular phone, a Small Computer System Interface (SCSI) interface, a serial port, an ISDN interface, or any other type of communication device. From interface circuit 14, images and audio are output to memory card 16 or I/O card 15. The I/O card includes a cable 24 for connecting to an external device. Also, images may also be transferred to interface circuit 14 from cards 15 or 16.

A Central Processing Unit 23 (CPU) controls the operation of the camera and is connected to a mode display 22 which displays various operating parameters of the camera including modes which have been set and operating parameters of the camera. The mode display 22 may be an LCD or LED display. An operating portion 21 through which the user inputs commands such as the command to take a picture when the shutter button is pressed, whether sound is recorded, whether still images or a series of still images forming moving images are recorded, and all other operations of the cameras. A flash 20 which is powered by batteries (not illustrated) is connected to the CPU 23 and is used to illuminate the scene to be photographed. There is a driver 18 which drives a mechanical system of the image photographing portion 6 and performs functions such as focusing and zooming of the lens. The timing signal generator 19 generates various timing signals as images are captured such as a vertical synchronizing signal, a horizontal synchronizing signal, and a CCD synchronizing signal.

Compressed images which are stored in the memory card 16 may be read out of the memory card 16 through the card interface circuit 14 and stored in the FIFO circuit 13. The compressed images are subsequently transferred to the image data compression/expansion circuit 12 which decodes or expands the compressed image signals and transfers the signals to the digital signal processing circuit 11. In the digital signal processing circuit, the luminance and color difference signals are transformed to a NTSC signal and output as a video signal.

Compressed audio information is similarly read out of the memory card 16 and written into the FIFO circuit 13. The encoded audio signals are transferred to the audio data compression/expansion circuit 3 where they are converted to an uncompressed digital form, converted to an analog form by the digital-to-analog converter 5, and amplified and filtered by the amplifier filter 2b. The converted signal is output as the audio signal.

The digital images captured by the camera are used to create exposure controlling evaluation information, automatic focus controlling information, and automatic white balance evaluation information by the CPU 23. Automatic control of the camera is performed using this information. Additionally, this and all other evaluation data, control data, status data, etc., can be output through or stored in the I/O card 15 or stored in the memory card 16. This information may be used, for example, when monitoring the camera in order to determine if an abnormal state exists. Further, the quality of the image can be optimized by changing the number of pixels used to represent an image.

The CPU 23 also performs a clock function for recording the date and time of when the audio and video has been captured. Additionally, a field number may be added to the image data by the CPU 23. Each of the image data, audio data, time, and field number may be output through the card interface circuit 14 to either the memory card 16, I/O card 15, or an interface circuit 27 which is an alternative device to the I/O card 15 for communicating.

The interface circuit 27 converts signals which are communicated to an appropriate standard. For example, the camera according to the present invention can communicate according to the RS-232 standard or the RS-422 standard. The interface circuit 27 is the structure which changes the signals to the appropriate format. During operation, the user of the camera will select the desired communication format (e.g., RS-232 for IBM PC compatibles and RS-422 for Macintosh computers). Both the RS-232 and RS-422 are well known standards and one of ordinary skill in the art would know how to build the appropriate circuitry to generate signals according to the appropriate standard. For example, see e.g., "Control Technology and Personal Computers, System Design and Implementation", by Hordeski, 1992, published by Van. Nostrand Reinhold, which discusses a single I/O expansion board which can transmit information according to either the RS-232 or RS-422 standards, depending on the user's desires, which is incorporated herein by reference.

Signals within the CPU will generally have a voltage range of 0 to +5 volts whereas bipolar signals in the range of approximately -15 volts to +15 volts are used with the RS-232 standard. The signal level conversion circuit 28 functions to convert the signal to the appropriate levels and is preferably contained within the signal level conversion chip 234 of the external communication interface 180. A more detailed description of the circuit is explained with respect to FIG. 17. There is a communication device 29 such as a personal computer, modem, or another camera, for example, connected to the signal level conversion circuit 28. This communication device 29 exchanges digital files containing video and/or audio information. The camera can both export and import audiovisual information.

In FIG. 8, the FIFO circuit or memory 13 is illustrated as being connected to each of the audio data compression/expansion circuit 3, the image data compression/expansion circuit 12, the card I/F circuit 14, and the CPU 23, as an alternative, the FIFO circuit or memory 13 may be directly connected between the card interface circuit 14 and the CPU 23. In this case, the audio data compression/expansion circuit 3 is connected to the card interface circuit 14 instead of being directly connected to the FIFO circuit 13. Further, as an alternative to any use of a FIFO circuit 13, a DRAM, an SRAM, or any other desired memory can be used.

Details of the CPU 23 are illustrated in FIG. 9. In FIG. 9, the CPU 23 contains a microprocessor 50, RAM 52 for storing various information and serves as a working memory area as calculations and functions are being performed, and a control program storing area 51. The control program storing area 51 includes a section 55 for storing basic routines such as BIOS (Basic Input Output System) routines, and other routines used by the system. The basic routines 55 are stored in a non-volatile memory such as a flash memory, an EPROM, or other type of memory. There is a section of the control program storing area 51 which stores rewritable and optional routines which may be loaded in from the memory card 16 and the I/O card 15. Section 54 may be constructed using the same flash memory as stores the basic routines 55 or may be a separate memory. In order to reduce the size of the chip and reduce the cost of the chip which may be used as the CPU 23, it is desirable to use a flash memory to store the basic routines 55 and the rewritable and optional routines 54. The CPU 23 may either be a single chip or be composed of multiple components. By having a section for rewritable and optional routines, the camera becomes very flexible by allowing the camera to be programmed as desired and there is no need to store routines which are not going to be used. This rewritable and optional routines section is especially useful for the process of inputting and outputting information as there are many different communication protocols which may be used. The control program storing area 51 stores routines which control the fundamental functions of the camera and other functions such as reading out program data, changing parameters within the camera, writing data into the rewritable and optional routines section 54, and any other function of the camera. Supplemental circuitry 53 performs functions which are necessary for the CPU and includes a bus controller, a serial communication controller, an interrupt controller and analog-to-digital converter for monitoring analog signals, and a clock for keeping track of the time and date.

FIG. 10 illustrates a possible structure for the memory card 16. In this example, the memory card includes four buffers 41A-41D which are respectively connected to four flash memories 40A-40D. The buffers 41 may be implemented using 256 byte SRAMs and the flash memories implemented each using a 16 Mbit flash memory. The flash memories may be conventional and can be NAND type flash memories available from Toshiba. Alternatively, the memories can be a NOR type flash memory available from Intel. The memory card 16 is connected to the card connector 17 through an eight bit data bus.

The buffers 41 are relatively high speed buffers whereas the flash memories 40 are relatively slow memories. The high speed buffers 41 may operate as burst transfer memories. During operation, information is transferred to the buffer memories and subsequently transferred to the corresponding flash memory in groups of 256 bytes. Accordingly, a plurality of transfer operation will usually be needed to transfer the desired material into or out of the memory card 16. The number of transfers between the buffers 41 and the FIFO circuit 13, for example, is set to be an integral multiple of a transfer size of the memory card. It is also possible for the number of transfers to be the amount of information to be transferred divided by the total size of the buffers 41, rounded up to the nearest integer. As an alternative to flash memories, the memories 40 can be implemented using EPPROMs.

FIG. 11 illustrates a process for capturing and storing video and audio information. After starting, the user presses the shutter release button 124 and a single picture along with associated audio is captured and stored in step 252. Step 254 then compresses the image and audio. Separate image and audio files are then written into the memory card 16 in step 256. Subsequently, a relation file which describes the association of the image and audio files is written or updated in step 258. The process of FIG. 11 then ends.

An example of the organization of files is illustrated on the left side of FIG. 12. The left side of this file illustrates memory card 16 having three video files 262A-262C, each having a header. The video files are stored in a compressed form such as according to the JPEG format. There are also two audio files 264A and 264B each containing headers and having been encoded using adaptive pulse coded modulation (PCM). A relation file 266 describes the correspondence between the video and audio files. For example, video file three 262C contains one image and corresponds with the audio in audio file two 264B and the relation file 266 describes this correspondence. The relation file 266 may also function as a directory of information within the memory card 16. The relation file can indicate information of just a still image, the combination of a still image with audio data, and information of successive images so that a series of images can be displayed to generate moving images. Further, if desired, the relation file will also store directory information indicating the location of the necessary files. The manner of storing information within the memory card 16 is preferably implemented according to known standards. For example, the information is preferably stored in a PCMCIA compatible memory card conforming to the PC Card Standard which conforms to the JEIDA Specific Extensions. This standard is described in the publication entitled "PC Card Standard", Vol. 12, JEIDA Specific Extensions, May, 1995 available from JEIDA (Japan Electronic Industry Development Association), which is incorporated herein by reference.

A feature of the present invention is the omission of a separate switch which is used to place the camera in a communication mode. Conventional digital cameras have a specific switch which changes the camera from a record or play mode to a mode which allows the transmission and receipt of images and audio. A description of how the invention operates without such a switch is set forth in detail below.

FIG. 13A illustrates a switch 110 which corresponds to switch 110 illustrated on the camera 100 in FIG. 1A. The switch is a three position switch having an off, a play and transmit position, and a record and receive position. When the camera detects that the communication mode is to be used, as explained below, the receive or transmit functions are selected. When the camera is not to communicate, the record or play functions are selected. As an alternative, FIG. 13B illustrates two separate switches 282 and 284, one for determining whether the camera is to be in a receive or transmit mode, and another for deciding whether the camera is to record images, play images, or to be turned off. In FIGS. 13A and 13B, the switches are slidable between the position the switch is in as illustrated by a solid circle and the other possible positions for the switches illustrated by broken circles.

FIG. 14 illustrates a flowchart of the overall process of transmitting information by the camera, or receiving information by the camera from an external device. The external communication device can be a computer, another camera, or any other device which receives and/or transmits information from the camera. After starting, the user connects the camera to a communication device such as a computer in step 302. At this time or prior to this time, the user will select the type of communication protocol which is to be utilized such as for example, the RS-232 protocol or the RS-422 protocol. Step 304 detects whether the camera is connected to the communication device. This can be performed, for example, by monitoring the Data Terminal Ready (DTR) signal when the communication protocol which is being used is RS-232. The signal line which is monitored is pin no. 4 of the nine pin D connector 188. By monitoring this electric signal from the communication device such as the computer, the switch which places the camera in a communication mode can be eliminated, thus reducing the weight and complexity of the camera. Step 304 has been described with respect to the DTR signal of an RS-232 protocol but any other signal of any other communication protocol which performs a similar function and indicates that the communication device is ready to receive or transmit information from or to the camera may be utilized. Step 304 is repeated until the appropriate signal is detected, indicating that the communication device is ready to communicate with the camera. Step 304 is preferably performed every 1/2 to 1 second, although longer or shorter times can be utilized.

After an affirmative response from step 304, step 306 is performed which executes or sets up the appropriate communication algorithms within the camera so that the camera will be prepared to transmit or receive information. As an example, before this time, the communication lines except for the DTR line may not be monitored in order to avoid the detection of improper or spurious signals which may occur before or during connection. Step 308 then detects whether the camera is to transmit or receive information based on the position of switch 110 illustrated in FIG. 13 or switch 282 illustrated in FIG. 13B. If the camera is in a transmit mode, step 310 is performed which transmits data according to the process illustrated in FIG. 15. If information is to be received by the camera, steps 312 and 314 respectively receive and store the data according to the process illustrated in FIG. 16. The process of FIG. 14 then ends.

FIG. 15 illustrates a process for transmitting information such as image and audio information out of the camera. In order to transmit the information out of the camera, first the relation file from the memory card is read in step 320. The relation file indicates the correspondence between the image and audio files. Additionally, the relation file will store directory information of the image and audio files. Based on the information in the relation file which has been read in step 320, the image file and the associated audio file are read in step 322 and transferred to the FIFO memory 13 in step 324. These two files are combined in step 326 and the resulting data does not contain any relation information. The combined image and audio files are illustrated as 270 in FIG. 12.

In FIG. 12, the combined image and audio files include a header and corresponding video file 262 and a header along with corresponding audio file 264B. In the example illustrated in FIG. 12, video file one corresponds to audio file one and video file three corresponds to audio file two but there is no corresponding audio information for video file two. After the video and audio information has been combined, the combined information is transmitted out of the camera in step 328 and the process of FIG. 15 ends.

FIG. 16 illustrates the process for receiving information by the camera. In step 340, combined image and audio files are received for example, through the I/O card 15 or from the communication device 29 through the signal level conversion circuit 28 and the interface circuit 27. When the received information is from the I/O card, or alternatively from the interface circuit 27, the received image and audio files are stored in the FIFO memory 13 in step 342. Next, this combined image and audio information is separated in step 346. The audio information is written into the memory card and the image information is also written into the memory card in step 348. Next, the relation file of-the memory card 16 is updated to describe the relationship between the newly received audio and image files in step 350 and the process of FIG. 16 then ends. The relationship information of the memory card indicates that the audio and image files correspond to each other and are to be presented or played at the same time. The relationship information is determined based on the transmission as a unit of the image and audio files.

Another feature of the present invention is the manner in which the digital signals representing images and audio generated within the camera are converted to signals conforming to the RS-232 standard. Unlike the logic signals normally used with a microprocessor within the camera, RS-232 signals are bipolar. This means that a level of zero volts (which corresponds to ground) does not indicate a logical low level but a negative voltage level is necessary to represent a logical low level. The voltage value for a "1" is preferably between +5 volts, and +15 volts and for a "zero" preferably between -5 volts and -15 volts.

In order to convert signals to their appropriate levels, there is a signal level conversion chip 234, illustrated in FIG. 17, within the external communication interface 180. This signal level conversion chip is, for example, a commercially available integrated circuit such as the MAX 213 CAI available from Maxim, or the UP04724 available from NEC. The signal level chip 234 is connected between the interface 27 and the connectors 238 and 236 according to known manufacturer's specifications. The nine pin D connector 238 and eight pin DIN connector respectively have the pin definitions as set forth in Table I and II below.

TABLE I______________________________________9 PIN D RS-232 CONNECTORSignal Signal FunctionNumber Abbreviation Function______________________________________1 CD Carrier Detect2 RD Received Data3 SD Send Data4 ER Data Terminal Ready5 SG Signal Ground6 DR Data Set Ready7 RS Request to Send8 CS Clear to Send9 CI Call Indicate______________________________________ TABLE II______________________________________8 PIN DIN RS-422 CONNECTORSignal Signal FunctionNumber Abbreviation Function______________________________________1 HSKO Handshake Output2 HSKI Handshake Input3 TXD- Transmission Data4 GND Ground5 RXD- Receiving Data7 GPI Call Indicate______________________________________

The power supplied to the signal level conversion chip 234 originates from the camera. The signal level conversion chip 234 may consume power, even when no communication operation is occurring. In order to extend the battery life of the camera by not wasting power unnecessarily powering the signal level conversion chip 234, the present invention employs a power conservation feature which places the signal level conversion chip 234 in a low-power mode or standby mode. As an example of the operation of the power conservation function, there is a timing diagram illustrated in FIG. 18. The top line of this diagram illustrated the occurrence of communication and the bottom line illustrates when the communication circuitry such as the signal level conversion chip 234 is powered. In this figure, it can be seen that the communication circuitry is powered for a short time before and after the occurrence of communication. When communication is not occurring, the power to the communication circuitry is turned off or changed to a standby mode.

In order to place the communication circuitry or signal level conversion chip 234 in the standby or low-power mode, the CPU within the camera monitors the Data Terminal Ready (DTR) line of the RS-232 connection. When this line is low, the external communication device such as a computer is not ready to perform communication and the signal level conversion chip may have the power thereto reduced. To the contrary, when the DTR signal is high, the external device is ready to communicate through the signal level conversion chip and accordingly, the communication circuitry must be powered. The checking of the signal which indicates that communication is ready to occur is performed at least once every second in the preferred embodiment. However, this checking frequency may be made shorter by checking the DTR signal once ever at least one half second or longer by checking the DTR signal once every five seconds, once every ten seconds, or even longer.

Obviously, numerous modifications and variations of the present invention are possible in light of the above teachings. For example, the invention can be implemented using one or more microprocessors, integrated circuits, convention circuit elements or other desired hardware. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.

Claims

1. A method of transmitting audiovisual information out of an electronic camera, comprising the steps of:

reading, from a memory of the camera, information describing a relationship between image information and audio information;

reading the image information and the audio information, using the information describing the relationship;

transmitting the image information and the audio information without the information describing the relationship;

receiving the image information and the audio information by an external device;

writing the image information and the audio information in a memory of the external device; and

writing information, in the memory of the external device, describing the relationship between the image information and the audio information.

2. A method according to claim 1, further comprising the step of:

detecting, by the external device, the relationship between the image information and the audio information, before the step of writing the information describing the relationship.

3. A method according to claim 2, wherein:

the step of detecting the relationship determines that the image information is to be presented at a same time as the audio information is presented.

4. A method according to claim 3, wherein:

the step of detecting the relationship determines that the image information is to be presented at the same time as the audio information is presented because the transmitting step transmits the image information along with the audio information.

5. A method according to claim 1, further comprising the steps of:

capturing an image corresponding to the image information and audio corresponding to the audio information; and

writing the image information and the audio information into the memory of the camera, along with the information describing the relationship between the image information and the audio information.

6. A method according to claim 5, further comprising the step of:

compressing the image information and the audio information before writing the image information and the audio information into the memory of the camera.

7. A method according to claim 6, further comprising the step of:

storing the image information and audio information which has been compressed into a first in first out (FIFO) memory, before the step of writing the image information and the audio information into the memory of the camera,

wherein the step of writing the image information and the audio information into the memory of the camera includes transferring the image information and the audio information from the FIFO memory to the memory of the camera.

8. A method according to claim 7, wherein:

the step of writing the image information and the audio information writes into a flash memory.

9. A method according to claim 8 wherein:

the step of writing the image information and the audio information transfers from the FIFO memory to the flash memory in a plurality of transfer operations.

10. A method according to claim 9, wherein:

the step of writing performs a number of said transfers which is an integral multiple of a transfer size of said flash memory.

11. A system for transferring information, comprising:

an electronic camera including:

a lens;

a light sensor for sensing images through the lens;

a microphone for sensing audio;

a memory for storing image information obtained by the light sensor, audio information obtained by the microphone, and information describing a relationship between the image information and the audio information;

means for reading, from the memory of the camera, the information describing the relationship between the image information and the audio information;

means for reading the image information and the audio information, using the information describing the relationship; and

a transmitter which transmits out of the electronic camera, the image information and the audio information without the information describing the relationship, and

an external device which is external to the camera and connected to the camera, including;

a memory;

a receiver which receives the image information and the audio information;

means for writing the image information and the audio information in the memory of the external device; and

means for writing information, in the memory of the external device, describing the relationship between the image information and the audio information.

12. A system according to claim 11, wherein the external device further comprises:

means for detecting the relationship between the image information and the audio information, before the means for writing writes the information describing the relationship.

13. A system according to claim 12, wherein:

the means for detecting the relationship determines that the image information is to be presented at a same time as the audio information is presented.

14. A system according to claim 13, wherein:

the means for detecting the relationship determines that the image information is to be presented at the same time as the audio information is presented because the transmitter transmits the image information along with the audio information.

15. A system according to claim 11, wherein the camera further comprises:

means for writing the image information and the audio information into the memory of the camera, along with the information describing the relationship between the image information and the audio information.

16. A system according to claim 15, wherein the camera further comprises:

means for compressing the image information and the audio information before writing the image information and the audio information into the memory of the camera.

17. A system according to claim 16, wherein the camera further comprises:

a first in first out memory (FIFO) which stores the image information and audio information which has been compressed, before writing the image information and the audio information into the memory of the camera,

wherein the means for writing the image information and the audio information into the memory of the camera includes means for transferring the image information and the audio information from the FIFO memory to the memory of the camera.

18. A system according to claim 17, wherein the memory of the camera is a flash memory card.

19. A system according to claim 18, wherein:

the means for transferring transfers from the FIFO memory to the flash memory in a plurality of transfer operations.

20. A system according to claim 19 wherein:

the means for transferring performs a number of said transfers which is an integral multiple of a transfer size of the flash memory.

21. A method according to claim 1, wherein:

the step of reading the information describing a relationship comprises reading, from the memory of the camera which stores a file including information describing a plurality of relationships between image information and corresponding audio information, a first relationship between a first set of the image information and audio information corresponding thereto,

the step of reading the image information and the audio information comprises reading the first set of the image information and the corresponding audio information, using the first relationship; and

the step of transmitting comprises transmitting the first set of the image information and the corresponding audio information without the information describing the relationship.

22. A method according to claim 21, further comprising the steps of:

reading information describing a second relationship between a second set of the image information and the audio information corresponding thereto;

reading the second set of the image information and the audio information corresponding thereto; and

transmitting the second set of the image information and the audio information without the information describing the second relationship.

23. A method according to claim 22, wherein the second set of the image information and the audio information includes a plurality of images, and

the step of transmitting the second set of the image information and the audio information comprises:

transmitting the second set of the image information which includes the plurality of images and the audio information without the information describing the second relationship.

24. A system according to claim 11, wherein:

the means for reading the information describing the relationship comprises means for reading, from the memory of the camera which stores a file including information describing a plurality of relationships between image information and corresponding audio information, a first relationship between a first set of the image information and audio information corresponding thereto,

the means for reading the image information and the audio information comprises means for reading the first set of the image information and the corresponding audio information, using the first relationship; and

the means for transmitting comprises means for transmitting the first set of the image information and the corresponding audio information without the information describing the relationship.

25. A system according to claim 24, further comprising:

means for reading information describing a second relationship between a second set of the image information and the audio information corresponding thereto;

means for reading the second set of the image information and the audio information corresponding thereto; and

means for transmitting the second set of the image information and the audio information without the information describing the second relationship.

26. A system according to claim 25, wherein the second set of the image information and the audio information includes a plurality of images, and

the means for transmitting the second set of the image information and the audio information comprises:

means for transmitting the second set of the image information which includes the plurality of images and the audio information without the information describing the second relationship.