The disclosure relates to a refrigerator having a door driving device used for opening and closing a door of the refrigerator and a camera.
In the conventional technology, there is a refrigerator having a photographing device for photographing the inside of the refrigerator such that the internal storage state of the refrigerator is confirmed even in a remote place.
More specifically, the photographing device is a camera installed inside a door of the refrigerator, and is configured to receive an instruction from the outside in a state where the door is closed and photograph the inside of the refrigerator.
However, in such a configuration, since the inside of the refrigerator is photographed while the door is closed, the distance between a stored object and the camera is relatively close when the stored object is placed at a front area inside the refrigerator such that there is a problem that the focus may not be properly adjusted and the camera may not photograph the stored object.
In addition, when photographing a storage pocket, the user needs to open both doors, so that when the user is away from the refrigerator, for example, when going out, the storage pocket may not be photographed and the storage state at that time may not be confirmed.
It is an aspect of the disclosure to provide a refrigerator capable of taking a photograph of a stored object in the refrigerator clearly and photographing the stored object in a storage pocket even when the user is far away from the refrigerator.
In accordance with one aspect of the disclosure, a refrigerator includes a housing having a storage chamber, a door having the inside facing the storage chamber and opens and closes the storage chamber, a driving device for transmitting power to the door for automatically opening and closing the door, and a photographing device disposed in the door and photographing at least one of the storage chamber or the inside of the door when the door is opened by the driving device.
Also, the door includes a first door and a second door provided in a left-right direction with respect to the storage chamber, and the photographing device includes a first camera disposed on the first door and a second camera disposed on the second door, and the first camera photographs the inside of the second door when the second door is opened by the driving device.
Also, the door includes a first door and a second door provided in a left-right direction with respect to the storage chamber, and the photographing device includes a first camera disposed on the first door and a second camera disposed on the second door, and the first camera photographs the storage chamber when the first door is opened by the driving device.
Also, the door includes a first door and a second door provided in a left-right direction with respect to the storage chamber, and the photographing device includes a first camera disposed on the first door and a second camera disposed on the second door, and the first camera photographs at least one of the inside of the second door or the storage chamber when the first door and the second door are opened by the driving device.
Also, the driving device is provided to open the first door after opening the second door, and the first camera photographs the inside of the second door at a first position where the first door is opened and positioned by the driving device.
Also, the driving device is provided to dispose the first door at a second position located between a closed position where the first door closes the storage chamber and the first position, and the first camera photographs the storage room when the first door is positioned in the second position.
Also, the driving device is provided to dispose the second door at a third position in which the second door is opened, and the second camera photographs the inside of the first door when the second door is disposed in the third position and when the first door is disposed adjacent to the first position.
Also, the driving device is provided to dispose the second door at a fourth position located between the closed position where the second door closes the storage chamber and the third position, and the second camera photographs the storage room when the second door is placed in the fourth position.
Also, the refrigerator further includes an information processing device for receiving the photographed information from the photographing device, and the information processing device combines the photographed information which are information that photographed by the first camera where the first camera disposed in the first position and second position respectively, and that photographed by the second camera where the first camera disposed in the third position and fourth position respectively to form one image.
Also, the refrigerator further includes an information processing device for receiving the photographed information from the photographing device, and the information processing device selects optimal information corresponding to the inside of the storage chamber or the door among the information, and transmits at least one piece of information or the optimum information to the outside of the refrigerator.
Also, the information processing device includes a receiver for receiving an external signal, a driving device controller for controlling the driving device based on a signal input from the receiver, and a photographing device controller for controlling the photographing device based on the signal input from the receiver, and after the photographing device is driven at the first position, the driving device controller further opens or closes the door so that the photographing device is disposed at the second position by an external signal received by the receiver, and the photographing device controller drives the photographing device when the photographing device is disposed at the second position.
Also, the photographing device includes a first photographing device disposed on the door and a second photographing device disposed on the housing, and the second photographing device photographs the inside of the door when the door is opened by the driving device.
Also, the first photographing device photographs the storage chamber when the door is opened by the driving device.
Also, the refrigerator further includes a hinge that rotatably couples the door to the housing, and the door further includes a throat portion protruding outward from the inside of the door and a storage pocket mounted to the throat portion, and the photographing device is disposed on a side of the throat portion adjacent to the hinge.
Also, the refrigerator further includes a hinge that rotatably couples the door to the housing, and the door further includes a throat portion protruding outward from the inside of the door and a storage pocket mounted to the throat portion, and the first photographing device is disposed on a side of the throat portion adjacent to the hinge, and the second photographing device is disposed on an opposite side of the hinge.
In accordance with one aspect of the disclosure, it is possible to clearly capture the objects housed in the refrigerator or the storage pocket of the door, so that the housed state of the refrigerator may be confirmed even when the user goes out.
Hereinafter, an air cleaner according to one embodiment will be described in detail with reference to the drawings.
Hereinafter, a first embodiment of a refrigerator according to the disclosure will be described with reference to the drawings.
As shown in
As shown in
First, the photographing device 10 will be described.
As shown in
The refrigerator R of the present disclosure is provided with a plurality of the photographing devices 10 installed at different positions on the upper and lower sides and each of the photographing devices 10 is provided with a plurality of the storage pockets P. Further, the number of photographing devices 10 may be changed as appropriate.
As shown in
The camera body is disposed in the casing 11 so as to take an image of the exterior of the casing 11 through the photographing window 12. Specifically, the camera body captures a moving image using a wide-angle lens.
Here, an angle of view of the camera body described above will be described with reference to
The relationship between an angle of view θθ of the camera body and a distance d between the camera body and a predetermined object surface to be photographed in the refrigerator or inside of the door D of the refrigerator is expressed by the following equation.
d=(L/2)/tan(θθ/2)
Here, L is the width of the inside of the refrigerator, the height of the inside of the refrigerator, the width of the door D, or the height of the door D.
Moreover, the object surface to be photographed set in the refrigerator is a surface including a front end of a plurality of shelves provided in the refrigerator and the object surface to be photographed set in the door D is a surface including a front end of a plurality of storage pockets provided in the door D, however, it may be set at a desired position as long as the object surface to be photographed is between the front surface of the refrigerator and the back surface or inside the refrigerator of the door D.
The distance d between the object surface to be photographed and the camera body set in the refrigerator or the door D changes depending on the degree of opening of the door D, herein, the distance d between the object surface to be photographed and the camera body set in the refrigerator or the door D is defined as the distance to the shortest state. Further, the distance d may be defined, for example, in a state in which the camera body is faced to each object surface to be photographed.
It is preferable that the angle of view of the camera body is set to be equal to or larger than the largest angle among the following angles θθ1˜θθ4 calculated based on the above-described expression in order to make it possible to capture images stored in the refrigerator without fail.
d1=(L1/2)/tan(θθ1/2)
d1=(L2/2)/tan(θθ2/2)
d2=(L3/2)/tan(θθ3/2)
d2=(L4/2)/tan(θθ4/2)
Here, d1 is a distance between the object surface to be photographed set in the refrigerator and the camera body, d2 is a distance between the object surface to be photographed set in the door D and the camera body, L1 is a width of the inside of the refrigerator, L2 is a height of the inside of the refrigerator, L3 is a width of the door, and L4 is a height of the door.
In the present disclosure, since the plurality of photographing devices are provided in each door, the angle of view of the camera body is set so that at least a part of the respective object surfaces to be photographed with respect to each camera body overlaps with each other so that these respective object surfaces to be photographed include both inside the refrigerator or inside the refrigerator.
Next, the driving device 20 will be described.
The driving device 20 outputs the power for opening and closing the door D and transmits this power to the door D, specifically as shown in
The power transmission device 40 is disposed between the motor M and the hinge axis Z and has a plurality of gears that rotate in conjunction with the motor M as shown in
More specifically, as shown in
As shown in
The swing device 50 includes a mounting member 51 which rotates about the rotational axis of the center gear 43 and on which the idler gears 44a and 44b are mounted, and a rotation load member 52 for applying a load to the rotation of each of the idler gears 44.
The mounting member 51 is provided with a plate member 511 on which both the center gear 43 and the pair of the idler gears 44 are installed and a pair of mounting shafts of the pair of the idler gears 512 standing from the plate member 511 for mounting the idler gears 44 and a mounting shafts of the center gear 513 for mounting the center gear 43.
The rotation load member 52 generates a torque that applies a load to the rotation of the idler gears 44 and pivots the pair of the idler gears 44 about the rotational axis of the center gear 43, and is an elastic member such as a spring that passes through the mounting shaft of the pair of the idler gears 512 and applies an upward force along the rotating shaft to the idler gears 44.
In the present embodiment, as shown in
The swing device 50 is configured so that the pair of the idler gears 44 are arranged between a forward power transmission position such that one of the idler gears 44a is engaged with the door gear 42 (
With the above-described configuration, as shown in
On the other hand, as shown in
In the refrigerator R of the present embodiment, the above-described driving device 20 is configured to photograph the inside of the refrigerator with the door D opened.
More specifically, the refrigerator R of the present embodiment receives a command from the outside to control the driving device 20 and the photographing device 10, and also provided with the information processing device 30 for processing the information photographed by the photographing device 10.
The information processing device 30 is physically equipped with a CPU, a memory, an A/D converter, and the like built-in the door D or the case H, as shown in
Hereinafter, the operation of the refrigerator R of the present embodiment will be described in the description of each of the configurations 31, 32, 33, 34, 35, and 36 of the information processing device 30.
First, the photographing command receiver 31 receives a photographing command by a user using an image display device such as an input device such as a touch panel provided in the refrigerator R or a portable device such as a mobile phone. The image display device may include a TV, a computer, a tablet PC, and the like. Hereinafter, a portable device will be described as an example.
When the photographing command receiver 31 receives the photographing command, the driving device controller 32 outputs a driving signal to control the driving device 20 to the automatic opening mode, and, as shown in
Hereinafter, for convenience of explanation, one of the doors D is referred to as the left door D as viewed from the front.
Next, the driving device 20 opens the other door D of the right and left doors D, that is, the right door D to a predetermined angle.
At this time, the photographing device controller 33 outputs a photographing start signal to the photographing device 10 installed on the door D on the right side to photograph a continuous still picture or to shoot a video from the state in which the right door D is closed to when the right door D is opened with the predetermined angle. Thus, the photographing device 10 installed on the right door D may photograph at least the storage pockets P of the doors D on the right and left sides in the refrigerator.
Subsequently, the driving device 20 closes the left door D as shown in
The photographing device controller 33 of this embodiment outputs the photographing start signal to all of the photographing devices 10 installed in each of the doors D when photographing the inside of the refrigerator, and outputs the photographing start signal to the photographing device 10 located at the uppermost position of the door D on the opposite side of the storage pocket P when photographing the storage pocket P.
In the present embodiment, as shown in
The photographing device 10 of the present embodiment has a horizontal viewing angle in which at least the whole length of the storage pocket P in the left and right direction.
When the driving device 20 and the photographing device 10 cooperate to take photographs of the inside of the refrigerator and the storage pocket P, the photographing data processor 34 reads the photographing data from the photographing device 10, and acquires image data or moving image data.
The photographing data processor 34 may acquire the photographing data after the above-described process of photographing, or may sequentially acquire the photographing data during the above-described process of photographing.
The photographing data processor 34 selects an acquired optimal continuous still picture or an acquired optimal video (hereinafter referred to as an optimal photograph).
More specifically, for example, in the refrigerator or on the inside of the refrigerator in the door D, an area index (not shown) indicating a photographing target area to be photographed by the photographing device 10 is provided in advance, and the photographing data processor 34 selects the optimal photograph from the acquired continuous still picture or acquired video based on the area index.
The area index is provided at a predetermined position of the case H or the door D in accordance with the viewing angle of the photographing device 10, and is a plurality of markers provided at corner portions on the inner side of the refrigerator, and the like.
As a result, the photographing data processor 34 of the present embodiment easily (with a small throughput) selects an image including all of the area index or an image having the least deformation of each area index as the optimum photograph from the acquired continuous still image data or moving image data. The optimum photograph selection method may be changed as appropriate.
The photographing data processor 34 appropriately corrects the optimal photograph according to a correction algorithm previously stored in the memory. For example, in this embodiment, as shown in
The photographing data processor 34 is configured to combine a plurality of optimal photographs.
As shown in
As a result, a photograph in which the left and right doors D are opened is generated as a composite photograph.
The photographing data saver 35 is set in a predetermined area of the memory and stores the optimal photograph obtained by the photographing data processor 34. Further, in order to reduce the capacity of the memory, it doesn't matter that the optimal photograph stored in the photographing data saver 35 may be configured to be overwritten.
As shown in
The photographing data transmission 36 of this embodiment is configured to transmit the optimal photograph or the composite photograph of the plurality of optimal photographs when the optimal photograph or the composite photograph of the plurality of optimal photographs is generated, however for example, the photographing data transmission 36 of this embodiment is configured to transmit the latest optimal photograph or the composite photograph of the plurality of optimal photographs stored in advance in the photographing data saver 35 when receiving a command from the user. Further, the latest optimal photograph or the composite photograph of the plurality of optimal photographs may be an image obtained when the door D is opened latest.
In the refrigerator R according to this embodiment configured as described above, since the photographing device 10 photographs the inside of the refrigerator while the door D is automatically opened by the driving device 20, a distance between the photographing device 10 and the refrigerator may be kept longer than the that of when the door D is closed. As a result, the photographing range is widened, so that even if the stored object is placed in front of the refrigerator, the stored object is within the entire photographing range, and other objects may be taken. As a result, the stored objects in the refrigerator may be clearly photographed, and the stored state in the refrigerator may be confirmed even in a remote place.
Since the storage pocket P of the door D is photographed by the driving device 20 with the door D automatically opened, even if the user is far from the refrigerator R, the storage pocket P may be photographed.
As a configuration for photographing the storage pocket even if the user is far away from the refrigerator, it is conceivable to adopt a configuration in which the photographing device is provided inside the refrigerator and the storage pocket is photographed by the photographing device in a state in which the door D is closed.
However, in the above-described configuration, when the distance between the photographing device and the storage pocket is relatively close, a large number of photographing devices are required to photograph all of the plurality of storage pockets installed at the upper and lower sides
On the other hand, in the refrigerator R according to the present embodiment, since the storage pocket P of each of the doors D is photographed with the left and right doors D opened by the driving device 20, the plurality of storage pockets P may be photographed by the photographing device 10 which is smaller than the above-described configuration.
In addition, the information processing device 30 selects the optimal photograph from the continuous still picture or the video, and transmits the corrected or composed optimal photograph to the outside, so that user may easily check the storage state of the refrigerator R even in the place where the user goes out.
The user confirms an optimal photograph through the portable device or the like, and the user may additionally desire an image photographed at a different angle. At this time, the user may send a signal to the information processing device 30 through a portable device or the like to receive the photographed image at an angle different from the optimal photograph.
In detail, the user may send a photographing command signal from another angle to the information processing device 30 through the portable device. The photographing command receiver 31 of the information processing device 30 receives the additional photographing command sent by the user and may drive the driving device 20 through the driving device controller 32.
In order to obtain the optimal photograph, the driving device 20 opens the door D at the predetermined angle, and the driving device controller 32 may rotate the door D at an angle larger or smaller than the predetermined angle for photographing at a different angle.
Thereafter, the photographing device controller 33 drives the photographing device 10 so that the photographing device 10 may photograph the inside of the refrigerator or the storage pocket P of the door D at the predetermined angle.
The image photographed at an angle outside the predetermined angle may be transmitted to the portable device or the like of the user again through the same process as described above, and the user may confirm the optimal photograph outside the portable device or the like.
In addition, the information processing device 30 allows the user to specify the angle desired by the user, rather than a predetermined angle, to allow the driving device 20 to open the door D at an angle desired by the user, and the photographing device 10 may be provided so as to photograph the storage pocket P in the refrigerator or the door D at the opening angle of the door D desired by the user.
That is, the user may input the opening angle of the door D desired by the user to the portable device or the like, and the input signal may be received by the photographing command receiver 31 of the information processing device 30.
Thereafter, the driving device controller 32 may drive the driving device 20 to open the door D by the angle designated by the user and the photographing device controller 33 may control the opening and closing of the door D, and the photographing device 10 may be driven to obtain the photograph at the angle designated by the user.
The photographed image at the angle designated by the user may be transmitted to the portable device or the like of the user again through the same process as described above and the user may confirm the photograph that is not the optimal photograph through the portable terminal or the like.
Hereinafter, a second embodiment of the refrigerator according to the present invention will be described with reference to the drawings.
As shown in
As shown in
The refrigerator R of the present embodiment further includes a second photographing device 60 installed in the refrigerator and the driving device 20 opens the door D so that the second photographing device 60 is configured to photograph a storage pocket P of the door D.
The second photographing device 60 is provided on the side (handle side) opposite to the hinge Z of the door D in the refrigerator. The specific configuration is the same as that of the photographing device 10 described above.
Hereinafter, the operation of the refrigerator R of the present embodiment will be described with reference to
First, the second photographing device 60 photographs the storage pocket P while the driving device 20 opens the door D in a closed state to a first predetermined angle.
Next, the photographing device 10 photographs the inside of the refrigerator while the driving device 20 further opens the door D at the first predetermined angle and moves it to a second predetermined angle.
Then, the driving device 20 closes the door D.
According to the refrigerator R of this embodiment configured as described above, the photographing device 10 photographs the inside of the refrigerator in a state in which the door D is automatically opened by the driving device 20 as in the first embodiment, and the second photographing device 60 is installed in the refrigerator, so that the storage pocket P may be photographed by the second photographing device 60 even the refrigerator R is one-door refrigerator.
Also, the present invention is not limited to the above-described embodiments.
The photographing device 10 is provided in the storage pocket P in each of the above embodiments, as shown in
Although the photographing device 10 of the above-described embodiment is configured to photograph a moving image, it may be configured to continuously photograph a plurality of images.
Also in the first embodiment, when the inside of the refrigerator and the storage pocket P are photographed by the photographing device 10, one of the doors D is opened and then the other door D is opened, however, the inside of the refrigerator and the storage pocket P may be photographed by the photographing device 10 installed in each of the doors D while simultaneously opening the doors D.
Further, in a refrigerator having a relatively small height called a French door type, it is judged from a viewing angle (00) of the camera and a distance d between the camera body and the object surface body calculated on the basis of the relational expression described in the first embodiment, so that the number of photographing apparatuses installed on the door may be one.
In addition, some or all of configurations 31, 32, 33, 34, 35, and 36 of the information processing device 30 of the first embodiment may be provided in a system, for example a server, located outside the refrigerator, and a management system for the refrigerator may be established by using the system and the refrigerator R.
In addition, some or all of the configurations 31, 32, 33, 34, 35, and 36 of the information processing device 30 of the first embodiment may be provided in a portable device, and the management system for the refrigerator may be established by using the portable device and the refrigerator R.
Moreover, some or all of the configurations 31, 32, 33, 34, 35, and 36 of the information processing device 30 of the first embodiment may be provided in the portable device and the system, and the management system for the refrigerator may be established by using the system, the portable device, and the refrigerator R.
The information processing device includes, for example, a display portion for displaying a photograph on a display mounted on the refrigerator or a user's portable telephone, and the display portion is configured to display a link or the like to be connected to delivery services automatically.
With such a configuration, the user may confirm a deficient object while viewing the photograph, smoothly purchase the deficient object, and assist the user in managing the inventory.
The information processing device may be configured so as to recognize a stored object by using the image recognition process from the photographed image.
Further, when the information processing device recognizes that it is stored and, for example, if the number of items previously selected is less than the required number, the information processing device automatically orders the required object from the delivery services or the like through a communication line such as a telephone line or the Internet.
Further, an ordering company, for example the delivery services, may be selected from a plurality of ordering companies previously authorized by the user, or may be limited to one ordering company designated by the user.
In the case where the deficient object is automatically ordered, the information processing device may automatically select the ordering company of the lowest ordering order or the shortest delivery date out of the plurality of ordering companies, or may select the ordering company based on the priority set in advance by the user.
When the deficient object is recognized, the information processing device notifies the user of the deficient object by e-mail, message, voice, video, etc. through the display mounted on the refrigerator or the cellular phone, and it is also possible to automatically order the deficient object.
The above-described various functions are not limited to the configuration in which the information processing device mounted in the refrigerator is used, and some or all of the functions may be connected to a remote server connected to the information processing device via a communication network such as the Internet, or it may be provided on the cell phone.
It is needless to say that the present invention is not limited to the above embodiments, and that various modifications are possible without departing from the spirit of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2016-043393 | Mar 2016 | JP | national |
2016-119511 | Jun 2016 | JP | national |
This application is a continuation of U.S. patent application Ser. No. 16/083,478 filed on Sep. 7, 2018, which is a 371 of International Application No. PCT/KR2017/002429 filed on Mar. 7, 2017, which claims priority to Japanese Patent Application No. 2016-043393 filed on Mar. 7, 2016 and Japanese Patent Application No. 2016-119511 filed on Jun. 16, 2016, the disclosures of which are herein incorporated by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 16083478 | Sep 2018 | US |
Child | 17463351 | US |