Watching system, watching detection device, and watching notification device

Information

  • Patent Grant
  • 10013862
  • Patent Number
    10,013,862
  • Date Filed
    Wednesday, July 29, 2015
    9 years ago
  • Date Issued
    Tuesday, July 3, 2018
    6 years ago
Abstract
This watching system is provided with: a watching detection device that is provided with a cartilage conduction vibration source, a mastication sensor, and a bone conduction microphone and that is configured to be mounted on an ear such that the entry of the ear canal is opened; and a mobile phone or an in-home monitoring unit that receives watching detection signals from the mastication sensor and the bone conduction microphone by means of short-range communication and issues a notification to the outside. The watching detection device has an air conduction microphone and also functions as a hearing aid. When detection signals cannot be received from the mastication sensor or the bone conduction microphone for a predetermined time period, a notification is issued. The mobile phone and the in-home monitoring unit crosscheck watching detection information. The mobile phone also issues a notification of information indicating that there is no abnormality.
Description
TECHNICAL FIELD

The present invention relates to a watching system, a watching detection device, and a watching notification device.


BACKGROUND ART

As for a watching system, Patent Literature 1 listed below proposes receiving data of detection both from a human detection sensor installed in a home of a person as a target to be watched and from an acceleration sensor that the resident wears, to make judgments on activities and conditions of the resident and events occurring in the home. On the other hand, Patent Literature 2 listed below proposes a mastication movement detection device in which the number of mastication movements is counted based on a detected waveform received from a detector that is placed in an external auditory canal and detects an amount of deformation of the external auditory canal. Also, as for cartilage conduction, which has been discovered as a third conduction route in addition to the long-known air conduction and bone conduction, Patent Literature listed below describes that vibration generated by a vibration source contacting an ear cartilage around the entrance part of an external auditory canal causes air-conducted sound to be generated from a cartilage surface inside the external auditory canal, and the generated air-conducted sound then proceeds through the inside of the external auditory canal to reach an tympanic membrane.


CITATION LIST
Patent Literature

Patent Literature 1: Japanese Patent Application Publication No. 2014-89494


Patent Literature 2: Japanese Patent Application Publication No. 2011-10791


Patent Literature 3: Japanese Patent Application Publication No. 2013-81047


SUMMARY OF INVENTION
Technical Problem

However, there are many problems that require further consideration regarding watching systems, watching detection devices, and watching notification devices.


In view of the above background, an object of the present invention is to provide an effective watching system, watching detection device, and watching notification device.


Solution to Problem

A watching detection device disclosed herein includes a cartilage conduction vibration source and a watching detection sensor, and is mountable to an ear without closing an entrance of an external auditory canal (a first configuration).


Here, the watching detection device having the first configuration may further include an air conduction microphone, and function as a hearing aid by vibrating the cartilage conduction vibration source in accordance with a voice signal picked up by the air conduction microphone (a second configuration).


The watching detection device having the first configuration may further include a short-range communication unit capable of communicating with a watching notification device, and makes the cartilage conduction vibration source vibrate in accordance with a voice signal received from the watching notification device via the short-range communication unit (a third configuration).


In the watching detection device having the first configuration, the watching detection sensor may be a masticatory movement sensor (a fourth configuration). In the watching detection device having the fourth configuration, the masticatory movement sensor may serve also as the cartilage conduction vibration source (a fifth configuration).


In the watching detection device having the first configuration, the watching detection sensor may be a voice sensor (a sixth configuration). In the watching detection device having the sixth configuration, the voice sensor may be a bone conduction microphone (a seventh configuration). In the watching detection device having the seventh configuration, the bone conduction microphone may serve also as the cartilage conduction vibration source (an eighth configuration). The watching detection device having the seventh configuration may further include an air conduction microphone for a hearing-aid function, and the air conduction microphone may be turned off when the bone conduction microphone is used (a ninth configuration).


A watching system disclosed herein includes the watching detection device having the first configuration and a watching notification device that receives watching information from the watching detection sensor via short-range communication with the watching detection device (a tenth configuration).


In the watching system having the tenth configuration, the watching detection sensor may be a voice sensor, the watching notification device may issue a notification of whether a voice signal picked up by the voice sensor is present, without issuing any notification of contents of the voice signal (an eleventh configuration). In the watching system having the eleventh configuration, the watching notification device may make a judgment on urgency of the voice signal picked up by the voice sensor and issue a notification of the contents of the voice signal exceptionally when the urgency is high (a twelfth configuration).


In the watching system having the tenth configuration, the watching notification device may issue a notification when it has been impossible to receive a detection signal from the watching detection sensor for a predetermined period of time (a thirteenth configuration). In the watching system having the tenth configuration, the watching notification device may include a plurality of watching notification devices that each receive watching information from a same watching detection device, and the plurality of watching notification devices exchange with each other the watching information received (a fourteenth configuration). In the watching system having the tenth configuration, the watching notification device may be a mobile phone, and a voice signal of a call partner received by the mobile phone may be transmitted to the watching detection device via short-range communication to vibrate the cartilage conduction vibration source (a fifteenth configuration).


A watching system disclosed herein includes a watching detection device and a plurality of watching notification devices that each receive watching information from the watching detection device via short-range communication with the watching detection device, and the plurality of watching notification devices exchange with each other the watching information received (a sixteenth configuration).


In the watching system having the sixteenth configuration, the plurality of watching notification devices issue different notifications based on the watching information (a seventeenth configuration). In the watching system having the sixteenth configuration, the plurality of watching notification devices include a mobile phone and a notification device placed in a home (an eighteenth configuration).


A watching notification device disclosed herein includes an acquisition unit which acquires watching information from a voice sensor and a notification unit which issues a notification of whether a voice signal acquired by the acquisition unit is present, without issuing any notification of contents of the voice signal (a nineteenth configuration).


In the watching detection device having the nineteenth configuration, the notification unit may make a judgment on urgency of the voice signal acquired by the acquisition unit and issue a notification of the contents of the voice signal exceptionally when the urgency is high (a twentieth configuration).


Advantageous Effects of Invention

As described above, according to the present invention, an effective watching system, watching detection device, and watching notification device are provided.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a diagram illustrating a system configuration of a first embodiment of the present invention (first embodiment);



FIG. 2 is a block diagram illustrating a detailed configuration of the first embodiment described in FIG. 1:



FIG. 3 is a sectional view of an ear for describing cartilage conduction;



FIG. 4 is a graph illustrating an example of measured data which shows an effect of the cartilage conduction:



FIG. 5 is a flowchart illustrating a function of an ear-mounted unit in the first embodiment;



FIG. 6 is a flowchart illustrating a function of a mobile phone in the first embodiment;



FIG. 7 is a flowchart illustrating a function of an in-home monitoring unit in the first embodiment; and



FIG. 8 is a diagram illustrating a system configuration of a second embodiment of the present invention (second embodiment).





DESCRIPTION OF EMBODIMENTS
First Embodiment


FIG. 1 is a diagram illustrating a system configuration of a first embodiment according to an aspect of the present invention. According to the first embodiment, a watching system that performs watching inside a home 2 includes an ear-mounted unit 6 (indicated by a short-dashed line for distinction from a structure of an ear), which contacts a cartilage around a hole of an ear 4 of a watching-target person by being sandwiched between an antihelix and a tragus to fit in a cavum conchae, an in-home monitoring unit 8, and a mobile phone 10 of the watching-target person. The in-home monitoring unit 8 and the mobile phone 10 exchange information with the ear-mounted unit 6 via short-range communication. The mobile phone 10 exchanges information with the ear-mounted unit 6 and the in-house monitor unit 8 via short-range communication.


The ear-mounted unit 6 functions as a headset for the mobile phone 10 by performing the short-range communication with the mobile phone 10, and allows a phone call to be made with the mobile phone 10 kept in a clothes pocket. The ear-mounted unit 6 also independently functions as a hearing aid. These functions as a headset and as a hearing aid are both achieved by making use of cartilage conduction, which will be described later. The ear-mounted unit 6 further includes a mastication sensor to detect movement of the tragus, etc., or deformation of the external auditory canal, caused by masticatory movement. Here, the ear-mounted unit 6 is ring-shaped with a hole 6a, so that the entrance of the external auditory canal is open even when the ear-mounted unit 6 is fitted in the external auditory canal. This makes it possible to hear external sound via the hole 6a, and contributes to a comfortable wear of the ear-mounted unit 6 without a feeling of blockage in the external auditory canal. Further, by closing the hole 6a with a finger or covering it with a palm as necessary as will be described later, it is possible to obtain an occlusion effect in the cartilage conduction to hear a larger sound.


The in-home monitor unit 8 has a short-range communication unit 12 for short-range communication with the ear-mounted unit 6 and the mobile phone 10, and a digital communication unit 14 which performs always-on-connection Internet communication with an external device. A control unit 16 controls the entire in-home monitoring unit 8, which includes the short-range communication unit 12 and the digital communication unit 14. A storage unit 18 stores therein a program necessary for the control performed by the control unit 16, and also temporarily stores therein various pieces of data related to the control, etc.


With this configuration, the in-home monitoring unit 8 receives a result of detection of masticatory movement from the ear-mounted unit 6 via the short-range communication. If no masticatory movement expected in daily life has been detected, the in-home monitor unit 8 judges that there is a possibility of an abnormality, and notifies a watching-service provider to that effect via the digital communication unit 14. Further, the in-home monitoring unit 8 receives information regarding presence/absence of voice of the watching-target person detected by the headset function of the ear-mounted unit 6. In a case where there is no voice detected within a predetermined period of time, or in a case where a voice signal conveying urgency, such as a scream, has been detected, the in-home monitoring unit 8 judges that there is a possibility of an abnormality, and notifies a watching-service provider to that effect via the digital communication unit 14.


Further, the mobile phone 10 receives a result of detection of masticatory movement from the ear-mounted unit 6 via short-range communication. If no masticatory movement expected in daily life has been detected, the mobile phone 10 judges that there is a possibility of an abnormality, and makes an automatic phone call to a mobile phone of a member of family of the watching-target person or the like who lives remotely and has been registered in advance, and when an answer to the phone call is received, the mobile phone 10 notifies him/her to that effect in a form of an automatic voice message. Further, the mobile phone 10 receives information regarding presence/absence of voice of the watching-target person detected by the headset function of the ear-mounted unit 6. In a case where there is no voice detected within a predetermined period of time, or in a case where a signal of voice conveying urgency, such as a scream, has been detected, the mobile phone 10 judges that there is a possibility of an abnormality, and makes an automatic phone call to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance, and when an answer to the phone call is received, the mobile phone 10 issues a notification to that effect.


Here, in a case where masticatory movement expected in daily life is detected, too, the mobile phone 10 makes an automatic phone call to the mobile phone of the member of family of the watching-target person or the like who lives remotely, and when an answer to the phone call is received, the mobile phone 10 notifies him/her to the effect that there is no abnormality occurring as an automatic voice message. Further, based on detection of a normal voice of the watching-target person, too, the mobile phone 10 makes an automatic phone call to the member of family of the watching-target person or the like who lives remotely as necessary, and when an answer to the phone call is received, the mobile phone 10 notifies him/her to the effect that there is no abnormality occurring in the form of an automatic voice message. This makes it possible for the member of family of the watching-target person or the like who lives remotely to know that the watching-target person regularly has three meals a day, and presence of conversation that the watching-target person is expected to usually have or a state of voice to be regularly uttered in a previously set time zone (for example, conversation in daily shopping, daily sutra chanting), and to rest reassured knowing that the watching-target person is all right. In this case, however, the mobile phone 10 makes an automatic phone call even when the watching-target person does not intend to, and thus contents of such conversations are to be undesirably heard by the member of family of the watching-target person or the like who lives remotely. Even though it is his or her own family member that hears the contents of such conversations, this is not desirable to the watching-target person in terms of privacy, and thus, as will be described later, what is notified is just whether or not voice has been uttered so that the contents of a conversation cannot be heard.



FIG. 2 is a block diagram illustrating a detailed configuration of the first embodiment of the present invention illustrated in FIG. 1. Such elements in FIG. 2 having counterparts in FIG. 1 are given the same reference numbers as their counterparts, and descriptions thereof will be omitted unless necessary. The in-home monitoring unit 8, which is configured as illustrated in FIG. 1, includes a power supply unit 20 which supplies power to the entire in-home monitoring unit 8. The power supply unit 20 receives power from a household power supply in the home 2.


On the other hand, as illustrated in FIG. 2, the mobile phone 10 includes a mobile phone function unit 22 to perform phone communication by means of an antenna 24 via a wireless telephone network. A short-range communication unit 26 communicates with the short-range communication units 36 and 12 of the ear-mounted unit 6 and the in-home monitoring unit 8, respectively. A GPS unit 28 detects a location of the watching-target person wearing the ear-mounted unit 6 when he/she is out, and communicates with the mobile phone of the member of family of the watching-target person or the like who lives remotely or with the watching-service provider, who have been described above, to thereby provide them with information of the location of the watching-target person. A control unit 30 performs entire control of the entire mobile phone 10, which includes the mobile phone function unit 22, the short-range communication unit 26, and the GPS unit 28. A storage unit 32 stores therein a program necessary for the control performed by the control unit 30, and also, temporarily stores therein various pieces of data related to the control, etc. A power supply unit 34 includes a rechargeable storage battery, and supplies power to the entire mobile phone 10. In FIG. 2, for simplicity, such ones of the components of the mobile phone 10 as are typically included in mobile phones, such as a large-sized touch-panel liquid crystal display unit, a microphone, a speaker, a proximity sensor, and an inner camera, are not illustrated.


As illustrated in FIG. 2, the ear-mounted unit 6 includes the short-range communication unit 36, which performs short-range communication with the short-range communication unit 26 of the mobile phone 10 and the short-range communication unit 12 of the in-home monitoring unit 8. A mastication sensor 38 detects movement of the tragus, etc., or deformation of the external auditory canal of the watching-target person, caused by masticatory movement of the watching-target person, and thereby detects presence/absence of mastication of the watching-target person. The mastication sensor 38 includes, for example, a strain gage, a piezoelectric element, or the like. When a masticatory movement is detected, a control unit 40 notifies the mobile phone 10 to that effect through the short-range communication unit 36 and the short-range communication unit 26. If no masticatory movement expected in daily life is detected, the control unit 40 judges that there is a possibility of an abnormality, and, by means of the short-range communication unit 36, notifies the mobile phone 10 and the in-home monitoring unit 8 to that effect through the short-range communication unit 26 and the short-range communication unit 36, respectively.


The ear-mounted unit 6 includes a cartilage conduction vibration source 42 (which is, for example, a piezoelectric bimorph element), which vibrates in accordance with a voice signal of a call partner received from the mobile phone 10 via short-range communication, and this vibration is transmitted to an ear cartilage in contact with the ear-mounted unit 6, and this makes it possible to hear the voice of the phone call partner by cartilage conduction, which will be described later. A bone conduction microphone 44 catches bone-conducted own voice of the watching-target person and transmits a voice signal of the own voice to the mobile phone 10 via short-range communication, and this enables conversations to be conducted. In this manner, the ear-mounted unit 6 functions as a headset for the mobile phone 10. An air conduction sound microphone 46 catches an air-conducted voice of an outside conversation partner located close to the watching-target person to obtain a voice signal of the conversation partner, which makes the cartilage conduction vibration source 42 vibrate. In this manner, the ear-mounted unit 6 also independently functions as a hearing aid. The control unit 40 controls the ear-mounted unit 6 also with respect to the head-set and hearing-aid functions. In the headset function, as described above, the bone conduction microphone 44 also functions as a voice sensor for watching whether or not the watching-target person utters voice expected in daily life. A power supply unit 48, which includes a rechargeable storage battery, supplies power to the entire ear-mounted unit 6.


Now, cartilage conduction will be explained. Cartilage conduction is a phenomenon discovered by the present inventors, and denotes the phenomenon in which vibration conducted to the cartilage around an entrance part of the external auditory canal, such as that in the tragus, makes the surface of an external-auditory-canal cartilaginous part vibrate, producing air-conducted sound inside the external auditory canal. The air-conducted sound produced inside the external auditory canal travels on deeper into the external auditory canal and reaches the tympanic membrane. Thus, the greater part of the sound heard by cartilage conduction is the sound heard via the tympanic membrane. Here, however, the sound heard via the tympanic membrane is not ordinary air-conducted sound, i.e., sound that has entered the external auditory canal from outside, but air-conducted sound that is produced inside the external auditory canal.



FIG. 3 is a sectional view of an ear for illustrating the phenomenon of cartilage conduction mentioned just above, and illustrates a relationship between the structure of an ear 4 and the ear-mounted unit 6 used in the present invention. Arrows 52 indicate transmission routes of vibration of the ear-mounted unit 6 which is made to vibrate by the cartilage conduction vibration source 42. Vibration generated from the ear-mounted unit 6 is, as indicated by the arrows 52, first conducted from a contact part to a cartilage 54 around the entrance part of the external auditory canal. The vibration of the cartilage 54 generates, from its surface (the external-auditory-canal cartilaginous part), air-conducted sound inside the external auditory canal. Then the air-conducted sound travels on deeper into the external auditory canal and reaches a tympanic membrane 50 via an external auditory canal osseous part 56. Here, as indicated by an arrow 58 (which indicates a route of ordinary audible sound), air-conducted sound from outside enters the external auditory canal via the hole 6a of the ear-mounted unit 6, and reaches the tympanic membrane 50. This contributes to comfortable wear of the ear-mounted unit 6 without a feeling of blockage in the external auditory canal.



FIG. 4 is a graph illustrating an example of measured data showing an effect of cartilage conduction. The graph of FIG. 4 illustrates, in relation to frequency, sound pressure within the external auditory canal at a position 1 cm inside from the entrance part of the external auditory canal when, without contact with a helix, a surface of an outer wall of a vibration body that is caused to vibrate by a cartilage conduction vibration source is brought into contact with at least part of ear cartilage around the entrance part of the external auditory canal. In the graph, a vertical axis indicates sound pressure (in dBSPL), and a horizontal axis indicates frequency on a logarithmic scale (in Hz). In terms of contact pressure relationship between the surface of the outer wall of the vibration body and the cartilage around the entrance part of the external auditory canal, the graph uses a solid line to illustrate the sound pressure during a non-contact state (in a state where only air-conducted sound generated from the surface of the outer wall of the vibration body can be heard), a short dashed line to illustrate the sound pressure under a contact pressure of 10 grams, a single-dotted chain line to illustrate the sound pressure under a contact pressure of 250 grams, and a double-dotted chain line to illustrate the sound pressure under a contact pressure of 500 grams. As illustrated in the figure, the sound pressure increases as the contact pressure is increased from the non-contact state to the 10-gram contact pressure, and further increases as the contact pressure is increased to 250 grams, and then, the sound pressure increases even more as the contact pressure is further increased to 500 grams.


As can be readily understood from the graph of FIG. 4, when the surface of the outer wall of the vibration body is brought into contact with at least part of the ear cartilage around the entrance part of the external auditory canal without contacting the helix, the sound pressure at the position 1 cm inside from the entrance part of the external auditory canal increases by at least 10 dB in a main frequency range of voice (500 Hz to 2,300 Hz), compared to in the non-contact state. (See and compare the non-contact state indicated by the solid line with the state indicated by the single-dotted chain line.)


As can also be readily understood from the graph of FIG. 4, when the surface of the outer wall of the vibration body is brought into contact with at least part of the ear cartilage around the entrance part of the external auditory canal without contacting the helix, the sound pressure at the position 1 cm inside from the entrance part of the external auditory canal changes by at least 5 dB in the main frequency range of voice (500 Hz to 2,500 Hz) as the contact pressure changes. (See and compare the slightly contacting state indicated by the short-dashed line with the state indicated by the single-dotted chain line).


As is clear from the above description, even when the ear-mounted unit 6 does not have a structure for generating air-conducted sound (such as a vibration plate included in typical earphones), it is possible to obtain sufficient sound pressure by transmitting vibration of the cartilage conduction vibration source 42 to the ear cartilage by bringing the cartilage conduction vibration source 42 into contact with the ear cartilage. As is also clear from the above description, since there is no need of providing a structure for generating air-conducted sound, the ear-mounted unit 6 can be formed in a ring shape having the hole 6a, for example, and this makes it possible to hear outside sound through the hole 6a even when the ear-mounted unit 6 is mounted to an ear, and this contributes to comfortable wear of the ear-mounted unit 6 without a feeling of blockage in the external auditory canal.


Further, as can be readily understood from the graph of FIG. 4, when the entrance part of the external auditory canal is closed by bringing the surface of the outer wall of the vibration body into firm contact with at least part of the ear cartilage (the data of FIG. 4 was actually obtained by measurement performed in a state where the entrance of the external auditory canal was closed with the tragus bent with the surface of the outer wall of the vibration body pressed against the tragus from outside), the sound pressure at the position 1 cm inside from the entrance portion of the external auditory canal increases by at least 20 dB in the main frequency range of voice (300 Hz to 1800 Hz). This is caused by the occlusion effect. (See and compare the non-contact state indicated by the solid line with the state where the external auditory canal is closed indicated by the double-dotted chain line).


The measurement results of which are illustrated in FIG. 4 was all conducted under a constant output of the cartilage conduction vibration source. Regarding FIG. 4, for the measurement conducted with the surface of the outer wall of the vibration body contacting at least part of the ear cartilage around the entrance part of the external auditory canal without contacting the helix, the surface of the outer wall of the vibration body was brought into contact with at least part of the ear cartilage from outside of the tragus. Also, for the measurement conducted with the external auditory canal closed, the closed state of the external auditory canal was brought about by pressing the tragus from outside so strong as to bend the tragus as described above.


In the first embodiment, the occlusion effect as described above can be achieved by closing the hole 6a and increasing the contact pressure of the ear-mounted unit 6 against the cartilage by pushing the ear-mounted unit 6 with a finger placed over the hole 6a. Or, instead, the occlusion effect can be achieved by covering the entire ear 4 with a palm. Thus, clearly, in the first embodiment, too, it is possible to hear a larger sound by closing the hole 6a with a finger or entirely covering the ear with a palm.


The measurement graph of FIG. 4 is merely an example; upon further scrutiny, there are individual differences. Also, for simplification and standardization of the phenomenon, the values illustrated in the measurement graph of FIG. 4 were obtained through measurement performed in a state where the surface of the outer wall of the vibration body was in contact only with a small surface area of the outside of the tragus. However, increase in sound pressure caused by the contact with the cartilage also depends on the area of the contact, and in a case where the surface of the outer wall is in contact with the ear cartilage around the entrance part of the external auditory canal without contacting the helix, the increase in sound pressure is further elevated when the surface of the outer wall of the vibration body is in contact with a portion of the cartilage wider than around the entrance part of the external auditory canal. In consideration of the above facts, the values illustrated in the measurement graph of FIG. 4 have generality in illustrating the configuration making use of cartilage conduction, and can be reproduced by many and unspecified subjects. Further, the measurement graph of FIG. 4 was drawn by plotting the values obtained by the measurement conducted with the tragus being pressed from the outside in closing the entrance part of the external auditory canal to thereby increase the contact pressure and fold the tragus over, but similar results can be obtained also in a case where the outer wall of the vibration body is pressed into the entrance part of the external auditory canal to close the external auditory canal.



FIG. 5 is a flowchart illustrating a function of the control unit 40 of the ear-mounted unit 6 in the watching system of the first embodiment. The flow starts when the ear-mounted unit 6 connected to an unillustrated charger for charging is disconnected from the charger. When the flow starts, in Step S2, it is checked whether or not pairing for short-range communication with the mobile phone 10 has been set, and when no pairing is found to have been set, pairing is automatically set. Next, in Step S4, the air conduction microphone 46 and the bone conduction microphone 44 are turned on. Thereby, the ear-mounted unit 6 starts to function as a hearing aid, and also the bone conduction microphone 44 is brought into a standby state in which it stands by for detection of voice of the watching-target person. Here, although omitted in the flow, the mastication sensor 38 is constantly in an ON state from the start to an end of the flow and in a standby state in which it stands by for detection of mastication.


Next, in Step S6, it is checked whether or not the mastication sensor 38 has detected a masticatory movement. When a mastication movement is found to have been detected, the process proceeds to Step S8, where a detection signal is transmitted to the mobile phone 10 via short-range communication, and then the process proceeds to Step S12. On the other hand, when no mastication movement is found to have been detected in Step S6, the process proceeds directly to Step S12.


In Step S12, it is checked whether or not the bone conduction microphone 44 has detected voice of the watching-target person. When voice of the watching-target person is found to have been detected, the process proceeds to Step S14, and a detected voice signal is transmitted to the mobile phone 10 via the short-range communication, and meanwhile, in Step S16, the detected voice signal is transmitted to the in-home monitoring unit 8 via the short-range communication. Although the steps from Step S12 to Step S16 are illustrated in a simplified manner, in these steps, actually, for a predetermined period of time (10 seconds, for example) after voice starts to be detected by the bone conduction microphone 44, the voice signal continues to be transmitted from the bone conduction microphone 44 simultaneously to the mobile phone 10 and the in-home monitoring unit 8. At this time, even when the voice continues to be detected for a predetermined period of time or longer, the transmission is stopped as soon as the predetermined period of time elapses, whereas even though the voice disappears before the predetermined period of time elapses, the transmission of output of the bone conduction microphone 44 continues to be performed until the predetermined period of time elapses. The above-described transmission of the voice signal continued for a predetermined period of time through the steps from Step S12 to Step S16 is finished, the process proceeds to Step S20. On the other hand, when no voice signal is detected in Step S12, the process proceeds directly to Step S20.


In Step S20, it is checked whether the watching-target person has operated the mobile phone 10 to make a phone call and the other party has answered the phone call, or whether there has been an external incoming call received by the mobile phone 10 and the watching-target person has operated the mobile phone 10 to answer the incoming call. If whichever of the above is found to have occurred, the process proceeds to Step S22, where the air conduction microphone 46 is turned off and the bone conduction microphone 44 is maintained in an on state, and then the process proceeds to Step S24. Thereby, the ear-mounted unit 6 starts to function as a headset for the mobile phone 10, and prevents ambient noise from being picked up by the air conduction microphone 46 to disturb the phone call.


In Step S24, it is checked whether the phone call started in Step S20 has been ended by hanging-up of the phone. Then, when it is detected that the phone call has been ended, the process proceeds to Step S26, where the air conduction microphone 46 is turned on and the bone conduction microphone 44 is maintained in an on state, and the process proceeds to Step S28. Thereby, the ear-mounted unit 6 starts to function as a hearing aid again, and the bone conduction microphone 44 is maintained in the standby state in which it stands by for detection of voice of the watching-target person. On the other hand, when it is found that the phone call has not been ended yet in Step S24, the Step S24 is repeated until end of the phone call is detected. Further, in a case where, in Step S20, neither making a phone call and answering the phone call nor receiving a phone call and answering the phone call is detected, the process proceeds directly to Step S28.


In Step S28, it is checked whether the storage battery of the power supply unit 48 has been exhausted. When the storage battery is found not to have been exhausted, the process proceeds to Step S30, where it is checked whether the ear-mounted unit 6 has been connected to the charger, which is not illustrated, to be charged. This step is provided to deal with a case of removing the ear-mounted unit 6 from the year 4 to be charged even though the storage battery has not been exhausted. When connection for charging is detected in Step S30, the process proceeds to Step S32, where ending processing is performed to end the flow. This is significant in that this helps prevent the ear-mounted unit 6 from being maintained in an operation state by mistake when it is removed from the ear 4 and thus its watching function is disabled. On the other hand, when no connection for charging is detected in Step S30, the process returns to Step S6 to repeat the steps from Step S6 to Step S30 until the storage battery becomes exhausted or connection is achieved for charging, and the ear-mounted unit 6 maintains, as necessary, its hearing-aid function, watching function, and headset function for the mobile phone 10. Here, in a case where it is detected in Step S28 that the storage battery has been exhausted, too, the process proceeds to Step S32, where the ending processing is performed to end the flow.



FIG. 6 is a flowchart illustrating a function of the control unit 30 of the mobile phone 10 in the first embodiment. Note that FIG. 6 illustrates the flow by extracting operations of functions related to watching, and thus in the mobile phone 10, the control unit 30 has operations that are not described in the flow of FIG. 6, such as operations related to a normal mobile phone function of the mobile phone 10. A hardware configuration itself of the mobile phone 10 is one that is typically adopted in mobile phones, and the functions extracted in FIG. 6 are installed in the ear-mounted unit 6 as accessory software.


The flow of FIG. 6 starts when a power switch of the mobile phone 10 is turned on, and in Step S42, a normal mobile phone mode is set. Next, in Step S44, a check is performed for a state of pairing for the short-range communication with the ear-mounted unit 6. When the pairing is found to have been achieved, watching can be performed by the mobile phone 10 in cooperation with the ear-mounted unit 6, and thus the process proceeds to Step S46.


In Step S46, it is checked whether or not a new mastication detection signal has been received from the ear-mounted unit 6, and when it is found that there has been reception of a new mastication detection signal, the process proceeds to Step S48, where an e-mail notifying that the watching-target person is safe is automatically transmitted to a mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance. Further, it may be set in advance that in Step S48, instead of sending an e-mail, an automatic phone call is made to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance, and on reception of a response from the mobile phone, an automatic voice message is transmitted to notify him/her that the watching-target person is safe. It is also possible to set such that both an e-mail and a phone call are to be sent and made. As for detecting mastication, which basically takes place three times a day and thus can be regarded as not too often, each time a mastication detection signal is detected, the member of family of the watching-target person or the like who lives remotely is notified that the watching-target person is safe and thereby reassured. Here, in a case where the member of family of the watching-target person or the like who lives remotely feels annoyed by such safety notifications, it is possible to set in advance such that Step S48 will be omitted.


Next, the process proceeds to Step S50, where reception history of mastication detection signals stored in the storage unit 32 is updated, together with time and date information, based on the reception of the new mastication detection signal, and a GPS signal at that time point is also stored in the storage unit 32, and then the process proceeds to Step S52. On the other hand, when reception of a mastication detection signal has not been able to be confirmed in Step S46, the process proceeds directly to Step S52.


In Step S52, based on the reception history stored in the storage unit 32, it is checked whether or not there has been reception of a new mastication detection signal within a predetermined period of time after the reception of the preceding mastication detection signal. When it is found that there has not been reception of a new mastication detection signal within the predetermined period of time, the process proceeds to Step S54, where an automatic phone call is made to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance, and on reception of a response to the phone call, an automatic voice message is transmitted to the effect that there is a possibility of an abnormality, and the process proceeds to Step S56. Further, in Step S54, another automatic voice message is transmitted to notify a current location of the watching-target person based on GPS information obtained then. On the other hand, in Step S52, when it is confirmed from the reception history that there has been reception of a new mastication detection signal, the process proceeds to Step S56.


In Step S56, it is checked whether or not there has been reception of a voice signal picked up by the bone conduction microphone 44 of the ear-mounted unit 6. When it is found that there has been reception of such a voice signal, the process proceeds to Step S58, where it is checked whether or not the received voice is a scream or begging for help (urgency) based on recognized contents of the voice signal (such as words included in the voice signal), intensity of the voice signal, a tone pattern, etc. When there is a high possibility that the voice is a scream or begging for help (when it is judged that it is a highly urgent situation), the process proceeds to Step S60, where an automatic phone call is made to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance, and on reception of a response to the phone call, the received voice itself is transmitted to the mobile phone, and then the process proceeds to Step S62. On the other hand, when, in Step S58, it is judged that the received voice is not a scream or begging for help but merely voice of an ordinary conversation (of low urgency), the process proceeds directly to Step S62.


In Step S62, it is checked whether or not the received voice signal has been received in a time zone (for example, a time zone when the watching-target usually goes shopping, a time zone when the watching-target person usually chants a sutra) previously set based on a regular life pattern. When the result of the check is in the affirmative, the process proceeds to Step S64, where an e-mail is automatically transmitted to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance to notify him/her that the watching-target person is safe, and the process proceeds to Step S66. On the other hand, in Step S62, when the received voice signal is found not to have been received in the previously set time zone, the process proceeds directly to Step S66. Here, a setting same as in Step S48 is also possible, that is, instead of or together with an e-mail, an automatic phone call may be made and automatic voice message may be transmitted. Further, in a case where the member of family of the watching-target person or the like who lives remotely feels annoyed by such safety notifications, it is possible to set in advance such that Steps S62 and S64 will be omitted. The message to be transmitted in Step S64 is not the voice signal actually picked up by the bone conduction microphone 44, but a message notifying merely the fact that there has been reception of a voice signal. Thus, in contrast to in Step S60, contents of conversation of the watching-target person are not heard and thus privacy of the watching-target person is preserved.


In Step S66, reception history of voice signals stored in the storage unit 32 is updated, together with time and date information, based on the reception of the new voice signal, and a GPS signal at that time point is also stored in the storage unit 32, and then the process proceeds to Step S68. On the other hand, in a case where reception of a voice signal picked up by the bone conduction microphone 44 has not been confirmed in Step S56, the process proceeds directly to Step S68.


In Step S68, based on the reception history stored in the storage unit 32, it is checked whether or not there has been reception of a new voice signal within a predetermined period of time after the reception of the preceding voice signal. When there has been no reception of a new voice signal within the predetermined period of time, the process proceeds to Step S70, where an automatic phone call is made to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance, and on reception of a response to the phone call, an automatic voice message is transmitted to the effect that there is a possibility of an abnormality, and then the process proceeds to Step S72. In Step S70, too, another automatic voice message is transmitted to notify a current location of the watching-target person based on GPS information obtained then. On the other hand, when it is confirmed in Step S68 that there has been reception of a new voice signal within the predetermined period of time, the process proceeds directly to Step S72. Here, in a case where setting of pairing with the ear-mounted unit 6 is not confirmed in Step S44, the process proceeds directly to Step S72, the steps for watching are not performed, and the mobile phone 10 functions as an ordinary mobile phone.


In Step S72, it is checked whether or not the storage battery of the power supply unit 34 has been exhausted. When the storage battery is found not to have been exhausted, the process returns to Step S44, and then, the steps from Step S44 to Step S72 are repeated until exhaustion of the storage battery is detected, such that the mobile phone 10 deals with various situations in watching. On the other hand, in a case where, in Step S72, the storage battery is found to have been exhausted, the process proceeds to Step S74, where ending processing is performed to end the flow.



FIG. 7 is a flowchart illustrating a function of the control unit 16 of the in-home monitoring unit 16 in the first embodiment. The flow starts when the in-home monitoring unit 8 is placed and connected to the household power supply or the power supply of the in-home monitoring unit 8 is turned on. Then, in Step S82, always-on connection to the Internet is automatically set for communication with the watching service provider, and an automatic test is performed to check cooperation, such as the short-range communication, with the ear-mounted unit 6, and the process proceeds to Step S84.


In Step S84, it is checked whether or not the state of the short-range communication with the ear-mounted unit 6 has been shifted from an enabled state to a disabled state. This is equivalent to checking whether or not the watching-target person has gone out into a range where the short-range communication is not available. When such shift of the state is found not to have taken place, the process proceeds to Step S86, where it is checked whether or not the state of the short-range communication with the ear-mounted unit 6 has shifted from the disabled state to the enabled state. This is equivalent to checking whether or not the watching-target person has come back into the short-range communication range. When such shift of the state is found to have taken place, the process proceeds to Step S88, where an e-mail is automatically transmitted to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance to notify him/her that the watching-target person has come home.


Further, in Step S90, automatic short-range communication is performed with the mobile phone 10, and processing is performed to confirm that the state of short-range communication has been shifted back into the state of system configuration as illustrated in FIG. 2. This processing is performed because it can be presumed that when the watching-target person is out, the mobile phone 10 is carried by him/her into a range where the short-range communication is not available. In Step S90, if by any chance it cannot be confirmed that the short-range communication is possible with the mobile phone 10, notification to that effect is issued to the watching service provider and to the mobile phone of the member of family of the watching-target person or the like who lives remotely.


In Step S90, further, a cross check of the history of reception from the ear-mounted unit 6 and information exchange are performed between the storage unit 18 of the in-home monitoring unit 8 and the storage unit 32 of the mobile phone 10 to match the information in the storage unit 18 and the information in the storage unit 32 with each other. This is applicable mainly to a case where the watching-target person is out and the in-home monitoring unit 8 cannot receive signals from ear-mounted unit 6, during which information cannot be received from the in-home monitoring unit 8 and thus information is received from the mobile phone 10 instead. This helps prevent inconvenience of, for example, the in-home monitoring unit 8 erroneously recognizing an abnormal state without any signal transmission from the ear-mounted unit 6 for a predetermined period of time or longer, although there has been a transmission of a signal from the ear-mounted unit 6. The function of matching information in the two storage units by the cross check as described above is also useful as a measure to deal with a case where the storage batter) of the mobile phone 10 has been exhausted when the mobile phone 10 is in the home 2 and thus information is not received from the ear-mounted unit 6 until the storage battery is recharged.


When the processing in Step S90 is completed, the process proceeds to Step S92, where it is checked whether or not there has been reception of a new mastication detection signal from the ear-mounted unit 6. When it is found that there has been reception of a new mastication detection signal, the process proceeds to Step S94, where reception history of mastication detection signals stored in the storage unit 18 is updated, together with time and date information, based on the reception of the new mastication detection signal, and the process proceeds to Step S96. On the other hand, when reception of a new mastication detection signal has been unable to be confirmed in Step S92, the process proceeds directly to Step S96.


In Step S96, based on the reception history stored in the storage unit 18, it is checked whether or not there has been reception of a new mastication detection signal within a predetermined period of time after the reception of the preceding mastication detection signal. When there is no reception of a new mastication detection signal within the predetermined period of time, the process proceeds to Step S98, where an automatic notification is issued to the watching service provider, with whom a contract has been made in advance, to the effect that there is a possibility of an abnormality, and then the process proceeds to Step S100. On the other hand, when it is confirmed, in Step S96, from the reception history of mastication detection signals, that there has been reception of a new mastication detection signal within the predetermined period of time, it is judged that there is no abnormality occurring, and the process proceeds directly to Step S100.


In Step S100, it is checked whether or not there has been reception of a voice signal picked up by the bone conduction microphone 44 of the ear-mounted unit 6. When it is found that there has been reception of such a voice signal, the process proceeds to Step S102, where it is checked whether or not the received voice is a scream, a cry for help, or the like, based on identification of voice in the contents (words and the like included therein) of the voice signal, intensity pattern, tone, and the like of the voice signal, etc. When there is a high possibility that the voice is a scream or a cry for help, the process proceeds to Step S104, where the received voice itself is transferred to the watching-service provider, and the process proceeds to Step S106. On the other hand, when, in Step S102, it is judged that the received voice is neither a scream nor a cry for help, but voice of an ordinary conversation, the process proceeds directly to Step S106.


In Step S106, reception history of voice signals stored in the storage unit 18 is updated, together with time and data information, based on the reception of the new voice signal, and the process proceeds to Step S108. On the other hand, when reception of a voice signal picked up by the bone conduction microphone 44 has not been confirmed in Step S100, the process proceeds directly to Step S108.


In Step S108, based on the reception history of voice signals stored in the storage unit 18, it is checked whether or not there has been reception of a new voice signal within a predetermined period of time after the reception of the preceding voice signal. When it is found that there has been no reception of a new voice signal within the predetermined period of time, the process proceeds to Step S110, where an automatic notification is issued to the watching service provider to the effect that there is a possibility of an abnormality, and then the process proceeds to Step S112. On the other hand, when it is confirmed in Step S108 that there has been reception of a new voice signal within the predetermined period of time based on the reception history, the process proceeds directly to Step S112. Here, when it is detected in Step S84 that the state of the short-range communication with the ear-mounted unit 6 has been shifted from an enabled state to a disabled state, the process proceeds to Step S114, where an e-mail is automatically transmitted to the mobile phone of the member of family of the watching-target person or the like who lives remotely and has been registered in advance to notify him/her that the watching-target person has gone out, and then the step proceeds to Step S112. In this case, since it is impossible to receive signals from the ear-mounted unit 6 and thus to perform watching, the mobile phone 10 that the watching-target person carries is charged with execution of the watching function, and the in-home monitoring unit 8 does not executes the watching function.


In Step S112, it is checked whether or not power of the in-home monitoring unit 8 has been turned off. Turning off of the power of the in-home monitoring unit 8 includes power-supply disconnection caused by power failure or the like. When it is found that there has been no turning off of the power, the process returns to Step S84, and then the steps of from Step S84 to Step S114 are repeated as long as the power is not turned off, and the in-home monitoring unit 8 deals with various situations in watching. On the other hand, when turning off of the power is detected in Step S112, the process proceeds to Step S116, where ending processing is performed to end the flow.


Second Embodiment


FIG. 8 is a diagram illustrating a system configuration of a second embodiment according to an aspect of the present invention. According to the second embodiment, a watching system for watching inside a home includes an eyeglass type ear-mounted unit 106. The other features are the same as the first embodiment illustrated in FIGS. 1 and 2, and thus the common features are denoted by the same reference numerals and overlapping descriptions thereof will not be repeated. In FIG. 8, for the sake of simplicity, a home 2 and an in-home monitoring unit 8 are not illustrated, but configurations thereof are common to those of the first embodiment described in FIGS. 1 and 2.


According to the present invention, a cartilage conduction vibration source, a bone conduction microphone, and a mastication sensor can each be formed with a piezoelectric element, and thus, one piezoelectric element can serve as a cartilage conduction vibration source, a bone conduction microphone, and a mastication sensor. In the second embodiment illustrated in FIG. 8, a piezoelectric bimorph element 142 which serves as a cartilage conduction vibration source, a bone conduction microphone, and a mastication sensor are formed in such part of a temple of eyeglasses as is laid on a cartilage in a base of an ear 4 when the eyeglasses are worn. With this configuration, vibration of the piezoelectric bimorph element 142 is conducted to the cartilage at the base of the ear 4 to cause cartilage conduction. Further, voice by bone conduction is picked up by the piezoelectric bimorph element 142. Further, movement caused by mastication in part close to the base of the ear 4 is also detected by the piezoelectric bimorph element 142. In using the piezoelectric bimorph element 142 for the plurality of functions, extraction and separation of signals fed to and outputted from the piezoelectric bimorph element 142 are achieved by means of signal processing performed by a control unit 140. When the piezoelectric bimorph element 142 is used for the plurality of functions, an air conduction microphone 46, which is originally provided for the purpose of picking up voice of a conversation partner for the function of hearing aid, is used to pick up voice of a watching-target person himself or herself by air conduction, and the picked up voice is used as information for the extraction and separation of signals fed to and outputted from the piezoelectric bimorph element 142. In the second embodiment, too, the entrance of an external auditory canal is left open, and thus it is possible to hear external sound and to achieve comfortable wear of an ear-mounted unit 106 without a feeling of blockage in the external auditory canal. Further, by closing the entrance of the external auditory canal with a finger or completely covering the ear 4 with a palm, it is possible to obtain the occlusion effect in cartilage conduction, to thereby hear a larger sound.


The various features of the embodiments described above can be implemented not only in those specific embodiments but also in any other embodiment so long as they provide their advantages. Moreover, the various features of the embodiments can be implemented with various modifications. Modified features can be implemented in appropriate combinations with each other and with unmodified features.


For example, in the configuration of the first embodiment, one piezoelectric bimorph element may be used for the functions of the cartilage conduction vibration source, the bone conduction microphone, and the mastication sensor as in the second embodiment. Or, conversely, in the second embodiment, the cartilage conduction vibration source, the bone conduction microphone, and the mastication sensor may be formed as optimum separate elements to be optimally disposed at scattered positions.


Further, in the above embodiments, a bone conduction microphone is adopted to pick up voice of a watching-target person, but an air-conducted sound microphone may be used for this purpose (for example, the air conduction microphone 46 serving for this purpose, too).


CONCLUSIVE DESCRIPTIONS

The following is conclusive descriptions of the features of the embodiments disclosed herein.


According to one embodiment disclosed herein, there is provided a watching system including a watching detection device and a watching notification device. The watching detection device has a cartilage conduction vibration source and a watching detection sensor, and is mountable to an ear with an entrance of an external auditory canal open. The watching notification device receives watching information from the watching detection sensor by performing short-range communication with the watching detection device. This contributes to comfortable wear of the watching detection device.


According to a specific feature, the watching detection device has an air conduction microphone, and functions as a hearing aid by vibrating the cartilage conduction vibration source in accordance with a voice signal picked up by the air conduction microphone. This makes it possible to perform watch by using a hearing aid which is used daily. According to another specific feature, the watching detection device makes the cartilage conduction vibration source vibrate in accordance with a voice signal received from the watching notification device via short-range communication. This makes it possible to perform watch by using a device, such as a mobile phone, through which it is possible to hear a voice signal received from another device.


According to another specific feature, the watching detection sensor is a masticatory movement sensor. According to another specific feature, the watching detection sensor is a voice sensor. For example, the voice sensor is a bone conduction microphone or an air-conducted sound microphone.


According to another specific feature, the watching notification device issues a notification when it has been impossible to receive a detection signal for a predetermined period of time.


According to another embodiment disclosed herein, there is provided a watching system including a watching detection device, and a plurality of watching notification devices which each receive watching information from the watching detection device via short-range communication with the watching detection device. The plurality of watching notification devices exchange with each other the watching information received. This makes it possible to deal with a missing part in the watching information received by one watching notification device by sharing the watching information received by the other watching notification devices, and thus to prevent confusion from occurring among the plurality of watching notification devices.


According to another embodiment disclosed herein, there is provided a watching system including a watching detection device, and a plurality of watching notification devices which each receive watching information from the watching detection device via short-range communication with the watching detection device. The plurality of watching notification devices issue different notifications based on the watching information. This makes it possible to perform watch in a manner suitable to each of the plurality of watching notification devices, which are different from each other in properties. According to a specific feature, the plurality of watching notification devices include a mobile phone and a notification device placed in a home.


According to another embodiment disclosed herein, there is provided a watching system including a watching detection device having a voice sensor, and a watching notification device that receives watching information from the watching detection sensor via short-range communication with the watching detection device. The watching notification device issues a notification of whether a voice signal picked up by the voice sensor is present, without issuing any notification of the contents of the voice signal. This helps protect privacy of a watching-target person. According to a specific feature, the watching notification device makes a judgment on urgency of the voice signal picked up by the voice sensor, and when the urgency is high, the contents of the voice signal is exceptionally notified. This makes it possible to obtain a specific notification in raw voice in a case where a scream or a cry for help has been received.


According to another embodiment disclosed herein, there is provided a watching detection device including a cartilage conduction vibration source and a watching detection sensor, and the watching detection device is mountable to an ear with an entrance of an external auditory canal open. This contributes to comfortable wear of the watching detection device.


According to a specific feature, the watching detection device has an air conduction microphone, and functions as a hearing aid by vibrating the cartilage conduction vibration source in accordance with a voice signal picked up by the air conduction microphone. According to another specific feature, the watching detection device vibrates the cartilage conduction vibration source in accordance with a voice signal received from the watching notification device via short-range communication, to thereby function as a device, such as a mobile phone, through which it is possible to hear a voice signal received from another device.


According to another specific feature, the watching detection sensor is a masticatory movement sensor. According to a more specific feature, the masticatory movement sensor can serve also as the cartilage conduction vibration source. According to another specific feature, the watching detection sensor is a voice sensor. More specifically, the voice sensor is a bone conduction microphone. Still more specifically, the bone conduction microphone can serve also as the cartilage conduction vibration source.


According to another specific feature, the watching detection sensor includes an air-conducted sound microphone for a hearing aid, and the air-conducted sound microphone is turned off when the bone conduction microphone is used. According to another specific feature, the voice sensor is an air-conducted sound microphone.


According to another embodiment disclosed herein, there is provided a watching notification device having an acquisition unit that acquires watching information from a voice sensor and a notification unit that issues a notification of whether a voice signal acquired by the acquisition unit is present, without issuing any notification of contents of the voice signal. This helps protect privacy of a watching-target person. According to a specific feature, the notification unit makes a judgment on urgency of the voice signal picked up by the voice sensor, and the contents of the voice signal is notified exceptionally when the urgency is high.


INDUSTRIAL APPLICABILITY

The present invention is applicable to a watching system, a watching detection device, and a watching notification device.


LIST OF REFERENCE SIGNS






    • 42 cartilage conduction vibration source


    • 38, 44, 46 watching detection sensor


    • 6, 106 watching detection device


    • 12, 26, 36 short-range communication unit


    • 8, 10 watching notification device


    • 46 air conduction microphone


    • 38 masticatory movement sensor


    • 44, 46 voice sensor


    • 44 bone conduction microphone


    • 46 air-conducted sound microphone


    • 8, 10 a plurality of watching notification devices


    • 10 mobile phone


    • 8 a notification device placed in a home


    • 142 masticatory movement sensor serving also as cartilage conduction vibration source


    • 142 bone conduction microphone serving also as cartilage conduction vibration source




Claims
  • 1. A watching system comprising: a watching detection device including a cartilage conduction vibration source and a watching detection sensor, wherein the watching detection device is mountable to an ear with an entrance of an external auditory canal open; anda watching notification device which receives watching information from the watching detection sensor via short-range communication with the watching detection device, whereinthe watching detection sensor is a voice sensor, and the watching notification device issues a notification of whether a voice signal picked up by the voice sensor is present, without issuing any notification of contents of the voice signal.
  • 2. The watching system according to claim 1, wherein the watching detection device further comprises an air conduction microphone, and wherein the watching detection device is operable to function as a hearing aid by vibrating the cartilage conduction vibration source in accordance with a voice signal picked up by the air conduction microphone.
  • 3. The watching system according to claim 1, wherein the watching detection device, further comprising a short-range communication unit capable of communicating with a watching notification device, wherein the watching detection device makes the cartilage conduction vibration source vibrate in accordance with a voice signal received from the watching notification device via the short-range communication unit.
  • 4. The watching system according to claim 1, wherein the watching detection sensor is a masticatory movement sensor.
  • 5. The watching system according to claim 4, wherein the masticatory movement sensor serves also as the cartilage conduction vibration source.
  • 6. The watching system according to claim 1, wherein the watching detection sensor is a voice sensor.
  • 7. The watching system according to claim 6, wherein the voice sensor is a bone conduction microphone.
  • 8. The watching system according to claim 7, wherein the bone conduction microphone serves also as the cartilage conduction vibration source.
  • 9. The watching system according to claim 7, wherein the watching detection device further comprising an air conduction microphone for a hearing aid function, wherein the air conduction microphone is turned off when the bone conduction microphone is used.
  • 10. The watching system according to claim 1, wherein the watching notification device makes a judgment on urgency of the voice signal picked up by the voice sensor, and issues a notification of the contents of the voice signal exceptionally when the urgency is high.
  • 11. The watching system according to claim 1, wherein the watching notification device issues a notification when it has been impossible to receive a detection signal from the watching detection sensor for a predetermined period of time.
  • 12. A watching system comprising; a watching detection device including a cartilage conduction vibration source and a watching detection sensor, wherein the watching detection device is mountable to an ear with an entrance of an external auditory canal open; anda watching notification device which receives watching information from the watching detection sensor via short-range communication with the watching detection device, whereinthe watching notification device includes a plurality of watching notification devices which each receive watching information from a same watching detection device, and the plurality of watching notification devices exchange with each other the watching information received.
  • 13. The watching system according to claim 12, wherein the watching notification device is a mobile phone, and a voice signal of a call partner received by the mobile phone is transmitted, via short-range communication, to the watching detection device to vibrate the cartilage conduction vibration source.
  • 14. A watching system comprising: a watching detection device; anda plurality of watching notification devices which each receive watching information from the watching detection device via short-range communication with the watching detection device, whereinthe plurality of watching notification devices exchange with each other the watching information received.
  • 15. The watching system according to claim 14, wherein the plurality of watching notification devices issue different notifications based on the watching information.
  • 16. The watching system according to claim 14, wherein the plurality of watching notification devices include a mobile phone and a notification device placed in a home.
  • 17. A watching notification device comprising: an acquisition unit which acquires watching information from a voice sensor; anda notification unit which issues a notification of whether a voice signal acquired by the acquisition unit is present, without issuing any notification of contents of the voice signal.
  • 18. The watching notification device according to claim 17, wherein the notification unit makes a judgment on urgency of the voice signal acquired by the acquisition unit, and issues a notification of the contents of the voice signal exceptionally when the urgency is high.
Priority Claims (1)
Number Date Country Kind
2014-167610 Aug 2014 JP national
PCT Information
Filing Document Filing Date Country Kind
PCT/JP2015/071490 7/29/2015 WO 00
Publishing Document Publishing Date Country Kind
WO2016/027632 2/25/2016 WO A
US Referenced Citations (222)
Number Name Date Kind
2045404 Nicholides Jun 1936 A
4351166 Belin Sep 1982 A
5295193 Ono Mar 1994 A
5323468 Bottesch Jun 1994 A
5396563 Yoshimi Mar 1995 A
5956682 Loudermilk Sep 1999 A
6028556 Shiraki Feb 2000 A
6380923 Fukumoto et al. Apr 2002 B1
6456721 Fukuda Sep 2002 B1
6463157 May Oct 2002 B1
6825830 Kanesaka et al. Nov 2004 B1
6912287 Fukumoto et al. Jun 2005 B1
6950126 Homma et al. Sep 2005 B1
7231235 Harrold Jun 2007 B2
7257372 Kaltenbach Aug 2007 B2
7437122 Choi Oct 2008 B2
7442164 Berrang et al. Oct 2008 B2
7555136 Wang Jun 2009 B2
7616771 Lenhardt Nov 2009 B2
7822215 Carazo Oct 2010 B2
7890147 Tanada Feb 2011 B2
8521239 Hosoi et al. Aug 2013 B2
8526646 Boesen Sep 2013 B2
8532322 Parker Sep 2013 B2
8886263 Hosoi et al. Nov 2014 B2
8918149 Hosoi et al. Dec 2014 B2
9020168 Karkkainen Apr 2015 B2
9020170 Hosoi et al. Apr 2015 B2
20010011951 Kimata et al. Aug 2001 A1
20010026626 Athanas Oct 2001 A1
20020001381 Mori Jan 2002 A1
20020012441 Matsunaga et al. Jan 2002 A1
20020068995 Yoshida Jun 2002 A1
20020114214 Hansen et al. Aug 2002 A1
20020115478 Fujisawa et al. Aug 2002 A1
20020149561 Fukumoto et al. Oct 2002 A1
20020183014 Takeda et al. Dec 2002 A1
20030108209 McIntosh Jun 2003 A1
20030118197 Nagayasu et al. Jun 2003 A1
20030119566 Chen Jun 2003 A1
20030174856 Johannsen et al. Sep 2003 A1
20040013279 Takeda Jan 2004 A1
20040048633 Sato et al. Mar 2004 A1
20040086149 Johannsen et al. May 2004 A1
20040087346 Johannsen et al. May 2004 A1
20040105566 Matsunaga et al. Jun 2004 A1
20040131211 Miyata et al. Jul 2004 A1
20040132509 Glezerman Jul 2004 A1
20040189151 Athanas Sep 2004 A1
20040207542 Chang et al. Oct 2004 A1
20040259513 Park Dec 2004 A1
20050031152 Hansen et al. Feb 2005 A1
20050046790 Jannard et al. Mar 2005 A1
20050088530 Homma et al. Apr 2005 A1
20050160270 Goldberg Jul 2005 A1
20050176459 Fukuda Aug 2005 A1
20050184875 Schmandt et al. Aug 2005 A1
20050185813 Sinclair et al. Aug 2005 A1
20050207599 Fukumoto et al. Sep 2005 A1
20050213432 Hoshuyama Sep 2005 A1
20050232436 Nagayasu et al. Oct 2005 A1
20050237685 Miyata Oct 2005 A1
20050244020 Nakajima et al. Nov 2005 A1
20050260969 Nagata et al. Nov 2005 A1
20050275714 Ishikawa et al. Dec 2005 A1
20050286734 Wang Dec 2005 A1
20060079291 Granovetter et al. Apr 2006 A1
20060093161 Falcon May 2006 A1
20060094464 Kyou et al. May 2006 A1
20060113932 Mori et al. Jun 2006 A1
20060120546 Tanaka et al. Jun 2006 A1
20060121960 Wang Jun 2006 A1
20060140439 Nakagawa Jun 2006 A1
20060158064 Asakawa et al. Jul 2006 A1
20060159297 Wirola et al. Jul 2006 A1
20060171107 Yamamoto et al. Aug 2006 A1
20060215873 Hansen et al. Sep 2006 A1
20060216022 Lee et al. Sep 2006 A1
20060227984 Sinclair Oct 2006 A1
20060262951 Jun Nov 2006 A1
20060286998 Fukuda Dec 2006 A1
20070003098 Martenson et al. Jan 2007 A1
20070015467 Nagayasu et al. Jan 2007 A1
20070019452 Ohkubo et al. Jan 2007 A1
20070036370 Granovetter et al. Feb 2007 A1
20070057601 Kawase et al. Mar 2007 A1
20070080951 Maruyama et al. Apr 2007 A1
20070081679 Suzuki et al. Apr 2007 A1
20070098200 Takei May 2007 A1
20070160253 Takei et al. Jul 2007 A1
20070249395 Kondo et al. Oct 2007 A1
20070263893 Kim Nov 2007 A1
20070269777 Fux Nov 2007 A1
20070297637 Sugiyama et al. Dec 2007 A1
20080008344 Wakabayashi et al. Jan 2008 A1
20080054862 Hara Mar 2008 A1
20080106449 Doi May 2008 A1
20080107300 Chen May 2008 A1
20080129703 Takeshita et al. Jun 2008 A1
20080139254 Levy Jun 2008 A1
20080143512 Wakisaka et al. Jun 2008 A1
20080170725 Asada et al. Jul 2008 A1
20080205679 Dathut Aug 2008 A1
20080227490 Homma et al. Sep 2008 A1
20080227501 Joo et al. Sep 2008 A1
20080239061 Cok et al. Oct 2008 A1
20080240465 Shiraishi Oct 2008 A1
20080247562 Nagayasu et al. Oct 2008 A1
20080267433 Katou et al. Oct 2008 A1
20080297373 Hayakawa et al. Dec 2008 A1
20090002626 Wakabayashi Jan 2009 A1
20090028356 Ambrose et al. Jan 2009 A1
20090129620 Tagawa et al. May 2009 A1
20090184884 Kyou et al. Jul 2009 A1
20090226011 Abolfathi et al. Sep 2009 A1
20090226017 Abolfathi et al. Sep 2009 A1
20090226020 Abolfathi et al. Sep 2009 A1
20090245556 Parker et al. Oct 2009 A1
20090245557 Parker Oct 2009 A1
20090288489 Lee et al. Nov 2009 A1
20090290730 Fukuda et al. Nov 2009 A1
20090304210 Weisman Dec 2009 A1
20090323976 Asada et al. Dec 2009 A1
20100056227 Hayakawa et al. Mar 2010 A1
20100061582 Takigawa et al. Mar 2010 A1
20100061584 Lin et al. Mar 2010 A1
20100098269 Abolfathi et al. Apr 2010 A1
20100150368 Chang et al. Jun 2010 A1
20100172519 Kimura et al. Jul 2010 A1
20100178597 Ishida et al. Jul 2010 A1
20100178957 Chen Jul 2010 A1
20100184487 Takada Jul 2010 A1
20100216526 Chen et al. Aug 2010 A1
20100238108 Rekimoto Sep 2010 A1
20100246878 Sim Sep 2010 A1
20100254562 Koo Oct 2010 A1
20100310086 Magrath et al. Dec 2010 A1
20100311462 Endo Dec 2010 A1
20100322127 Nakajima Dec 2010 A1
20100328033 Kamei Dec 2010 A1
20100329485 Fukuda et al. Dec 2010 A1
20110143819 Sugiyama et al. Jun 2011 A1
20110158425 Hayakawa Jun 2011 A1
20110159855 Cheng Jun 2011 A1
20110170718 Fukuda et al. Jul 2011 A1
20110180542 Drollinger et al. Jul 2011 A1
20110201301 Okada et al. Aug 2011 A1
20110237306 Kamii Sep 2011 A1
20110254616 Kawano Oct 2011 A1
20110267551 Yokote et al. Nov 2011 A1
20110280416 Abolfathi et al. Nov 2011 A1
20110281617 Kim et al. Nov 2011 A1
20110293105 Arie et al. Dec 2011 A1
20110299695 Nicholson Dec 2011 A1
20110301729 Heiman et al. Dec 2011 A1
20120008793 Knox et al. Jan 2012 A1
20120008807 Gran Jan 2012 A1
20120010735 Gilboa Jan 2012 A1
20120082329 Neumeyer Apr 2012 A1
20120082335 Duisters et al. Apr 2012 A1
20120105192 Norieda May 2012 A1
20120130660 Neumeyer May 2012 A1
20120133213 Borke et al. May 2012 A1
20120139750 Hayakawa et al. Jun 2012 A1
20120140917 Nicholson et al. Jun 2012 A1
20120162143 Kai et al. Jun 2012 A1
20120182429 Forutanpour et al. Jul 2012 A1
20120183163 Apfel Jul 2012 A1
20120219161 Amada Aug 2012 A1
20120221329 Harsch Aug 2012 A1
20120237075 East et al. Sep 2012 A1
20120244917 Hosoi et al. Sep 2012 A1
20120249223 Neugebauer Oct 2012 A1
20120253236 Snow Oct 2012 A1
20120289162 Hosoi et al. Nov 2012 A1
20120298441 Lin et al. Nov 2012 A1
20120300956 Horii Nov 2012 A1
20130039508 Chen et al. Feb 2013 A1
20130100596 Yokote et al. Apr 2013 A1
20130111346 Little May 2013 A1
20130120311 Ichikawa May 2013 A1
20130136279 Brown May 2013 A1
20130142348 Weisman Jun 2013 A1
20130169352 Kawano Jul 2013 A1
20130169829 Homma et al. Jul 2013 A1
20130191114 Gim Jul 2013 A1
20130236043 Abolfathi et al. Sep 2013 A1
20130242262 Lewis Sep 2013 A1
20130242809 Tone et al. Sep 2013 A1
20130252675 Nicholson Sep 2013 A1
20130259221 Shusaku et al. Oct 2013 A1
20130301860 Neumeyer et al. Nov 2013 A1
20130308799 Lin et al. Nov 2013 A1
20130316691 Forutanpour et al. Nov 2013 A1
20130322670 Hosoi et al. Dec 2013 A1
20130324193 Hosoi et al. Dec 2013 A1
20130335210 Arai et al. Dec 2013 A1
20130336507 Gran Dec 2013 A1
20140003641 Neumeyer et al. Jan 2014 A1
20140313280 Takuno et al. Oct 2014 A1
20140342783 Suzuki et al. Nov 2014 A1
20140378191 Hosoi et al. Dec 2014 A1
20150054779 Horii et al. Feb 2015 A1
20150065057 Hosoi et al. Mar 2015 A1
20150070083 Kawano Mar 2015 A1
20150078569 Magrath et al. Mar 2015 A1
20150086047 Horii et al. Mar 2015 A1
20150131838 Horii May 2015 A1
20150141088 Hosoi et al. May 2015 A1
20150172588 Homma et al. Jun 2015 A1
20150181338 Hosoi et al. Jun 2015 A1
20150208153 Hosoi et al. Jul 2015 A1
20150256946 Neumeyer et al. Sep 2015 A1
20160007109 Neumeyer et al. Jan 2016 A1
20160086594 Asada et al. Mar 2016 A1
20160205233 Hosoi et al. Jul 2016 A1
20160248894 Hosoi et al. Aug 2016 A1
20160261299 Hosoi et al. Sep 2016 A1
20160286296 Hosoi et al. Sep 2016 A1
20170006144 Hosoi et al. Jan 2017 A1
20170026727 Hosoi et al. Jan 2017 A1
20170302320 Hosoi et al. Oct 2017 A1
Foreign Referenced Citations (429)
Number Date Country
2198618 May 1995 CN
1672114 Sep 2005 CN
1679371 Oct 2005 CN
1791283 Jun 2006 CN
1843019 Oct 2006 CN
101267463 Sep 2008 CN
101277331 Oct 2008 CN
101355823 Jan 2009 CN
101360140 Feb 2009 CN
101390440 Mar 2009 CN
201216023 Apr 2009 CN
101513081 Aug 2009 CN
101795143 Aug 2010 CN
101897198 Nov 2010 CN
102075633 May 2011 CN
1705875 Mar 2005 EP
1705075 Sep 2006 EP
1705874 Sep 2006 EP
1 783 919 May 2007 EP
1970792 Sep 2008 EP
S51-94220 Aug 1976 JP
S55-088497 Jul 1980 JP
S56-17780 Feb 1981 JP
S56-089086 Jul 1981 JP
S5690018 Jul 1981 JP
S58-182398 Oct 1983 JP
S60116800 Aug 1985 JP
S62-208680 Sep 1987 JP
S63-115728 Jul 1988 JP
63-142981 Sep 1988 JP
S63140753 Sep 1988 JP
H0212099 Jan 1990 JP
H02-62199 Mar 1990 JP
3-29424 Feb 1991 JP
H03-117995 Dec 1991 JP
4-90298 Mar 1992 JP
H0573073 Mar 1993 JP
H05-41297 Jun 1993 JP
H05-183618 Jul 1993 JP
H05-207579 Aug 1993 JP
H05-292167 Nov 1993 JP
06-030494 Feb 1994 JP
3003950 Aug 1994 JP
3009206 Jan 1995 JP
07-107146 Apr 1995 JP
07-131268 May 1995 JP
H7-039150 Jul 1995 JP
H07210176 Aug 1995 JP
08-033026 Feb 1996 JP
H879338 Mar 1996 JP
8-102780 Apr 1996 JP
H08-090986 Apr 1996 JP
H08111703 Apr 1996 JP
08-237185 Sep 1996 JP
H08-256080 Oct 1996 JP
H09-023256 Jan 1997 JP
H10-042021 Feb 1998 JP
3050147 Apr 1998 JP
10-136480 May 1998 JP
H10-200608 Jul 1998 JP
10-227 Sep 1998 JP
H11-112672 Apr 1999 JP
H11-163980 Jun 1999 JP
3064055 Sep 1999 JP
11-298595 Oct 1999 JP
H11-352138 Dec 1999 JP
2000-013294 Jan 2000 JP
2000-031858 Jan 2000 JP
2000-49935 Feb 2000 JP
3070222 Apr 2000 JP
2000217015 Aug 2000 JP
2000-295696 Oct 2000 JP
2000-322186 Nov 2000 JP
2000-324217 Nov 2000 JP
2001125742 May 2001 JP
2001-177809 Jun 2001 JP
2001169016 Jun 2001 JP
2001-268211 Sep 2001 JP
2001-287183 Oct 2001 JP
2001287183 Oct 2001 JP
2001-320790 Nov 2001 JP
2001-333161 Nov 2001 JP
2001-339504 Dec 2001 JP
2001-352395 Dec 2001 JP
2002-016720 Jan 2002 JP
2002-036158 Feb 2002 JP
2002-041411 Feb 2002 JP
2002-051111 Feb 2002 JP
2002036158 Feb 2002 JP
2002041411 Feb 2002 JP
2002-84575 Mar 2002 JP
2002-111822 Apr 2002 JP
2002-149312 May 2002 JP
2002-164986 Jun 2002 JP
2002-171321 Jun 2002 JP
2002-223475 Aug 2002 JP
2002-238262 Aug 2002 JP
2002-262377 Sep 2002 JP
3090729 Oct 2002 JP
2002-359889 Dec 2002 JP
2002-368839 Dec 2002 JP
2003-032768 Jan 2003 JP
2003032343 Jan 2003 JP
2003-037651 Feb 2003 JP
2003-102094 Apr 2003 JP
2003-103220 Apr 2003 JP
2003-111175 Apr 2003 JP
2003-125473 Apr 2003 JP
2003101625 Apr 2003 JP
2003-143253 May 2003 JP
2003-145048 May 2003 JP
2003-169115 Jun 2003 JP
2003-173375 Jun 2003 JP
2003-173375 Jun 2003 JP
2003-179988 Jun 2003 JP
2003-188985 Jul 2003 JP
2003-198719 Jul 2003 JP
2003-211087 Jul 2003 JP
2003-218989 Jul 2003 JP
2003-274376 Sep 2003 JP
2003-274470 Sep 2003 JP
2003-300015 Oct 2003 JP
2003-304308 Oct 2003 JP
2003-319022 Nov 2003 JP
2003-348208 Dec 2003 JP
2004-064457 Feb 2004 JP
2004-094389 Mar 2004 JP
2004-128915 Apr 2004 JP
2004-157873 Jun 2004 JP
2004-158961 Jun 2004 JP
2004-173018 Jun 2004 JP
2004-173264 Jun 2004 JP
2004-187031 Jul 2004 JP
2004-205839 Jul 2004 JP
2004190699 Jul 2004 JP
2004208220 Jul 2004 JP
2004233316 Aug 2004 JP
2004-252626 Sep 2004 JP
2004-266321 Sep 2004 JP
2004-274438 Sep 2004 JP
2004-357198 Dec 2004 JP
2005-020234 Jan 2005 JP
2005-020730 Jan 2005 JP
2005-311125 Apr 2005 JP
2005-512440 Apr 2005 JP
2005-142835 Jun 2005 JP
2005-159969 Jun 2005 JP
2005142729 Jun 2005 JP
2005-184267 Jul 2005 JP
2005-223717 Aug 2005 JP
2005229324 Aug 2005 JP
2005-229324 Aug 2005 JP
2005-237026 Sep 2005 JP
2005-244968 Sep 2005 JP
2005-328125 Nov 2005 JP
2005-534269 Nov 2005 JP
2005-340927 Dec 2005 JP
2005-341543 Dec 2005 JP
2005-348193 Dec 2005 JP
2005-352024 Dec 2005 JP
2006-007342 Jan 2006 JP
2006-007919 Jan 2006 JP
2006-011591 Jan 2006 JP
2006-019812 Jan 2006 JP
2006005625 Jan 2006 JP
2006007342 Jan 2006 JP
2006-050056 Feb 2006 JP
2006-051300 Feb 2006 JP
2006-021133 Mar 2006 JP
2006-066972 Mar 2006 JP
2006-067049 Mar 2006 JP
2006-074671 Mar 2006 JP
2006-086581 Mar 2006 JP
2006-109326 Apr 2006 JP
2006-115060 Apr 2006 JP
2006-115476 Apr 2006 JP
2006094158 Apr 2006 JP
2006-129117 May 2006 JP
2006-129404 May 2006 JP
2006-148295 Jun 2006 JP
2006-155734 Jun 2006 JP
2006-157318 Jun 2006 JP
2006-165702 Jun 2006 JP
2006-166128 Jun 2006 JP
2006-166300 Jun 2006 JP
2006186691 Jul 2006 JP
2006-197404 Jul 2006 JP
2006197267 Jul 2006 JP
2006-211317 Aug 2006 JP
2006-217321 Aug 2006 JP
2006-226506 Aug 2006 JP
2006-229647 Aug 2006 JP
2006217088 Aug 2006 JP
2006-238072 Sep 2006 JP
2006-283541 Oct 2006 JP
2006-295786 Oct 2006 JP
2006303618 Nov 2006 JP
2006-333058 Dec 2006 JP
2006-339914 Dec 2006 JP
2006-345025 Dec 2006 JP
2006-345471 Dec 2006 JP
2006333058 Dec 2006 JP
2007-003702 Jan 2007 JP
2007-006369 Jan 2007 JP
2007010518 Jan 2007 JP
2007-019898 Jan 2007 JP
2007-019957 Jan 2007 JP
2007-020051 Jan 2007 JP
2007-028469 Feb 2007 JP
2007-051007 Mar 2007 JP
2007-051395 Mar 2007 JP
2007-072015 Mar 2007 JP
2007074663 Mar 2007 JP
2007-081276 Mar 2007 JP
2007-096386 Apr 2007 JP
2007-103989 Apr 2007 JP
2007-104548 Apr 2007 JP
2007-104603 Apr 2007 JP
2007-129740 May 2007 JP
2007-133698 May 2007 JP
2007-142920 Jun 2007 JP
2007-165938 Jun 2007 JP
2007-180827 Jul 2007 JP
2007-189578 Jul 2007 JP
2007-195239 Aug 2007 JP
2007-214883 Aug 2007 JP
2007-228508 Sep 2007 JP
2007-268028 Oct 2007 JP
2007-275819 Oct 2007 JP
2007281916 Oct 2007 JP
2007-306465 Nov 2007 JP
2007-307124 Nov 2007 JP
2007-330560 Dec 2007 JP
2007-336418 Dec 2007 JP
2008-000709 Jan 2008 JP
2008-006558 Jan 2008 JP
2008-017327 Jan 2008 JP
2008-017398 Jan 2008 JP
2008006558 Jan 2008 JP
2008-042324 Feb 2008 JP
2008-046844 Feb 2008 JP
2008-085417 Apr 2008 JP
2008-092164 Apr 2008 JP
2008-092313 Apr 2008 JP
2008-511217 Apr 2008 JP
2008-121796 May 2008 JP
2008-135991 Jun 2008 JP
2008-141589 Jun 2008 JP
2008-141687 Jun 2008 JP
2008-148086 Jun 2008 JP
2008-149427 Jul 2008 JP
2008-153783 Jul 2008 JP
2008-177629 Jul 2008 JP
2008-177705 Jul 2008 JP
2008149427 Jul 2008 JP
3144392 Aug 2008 JP
2008-227123 Sep 2008 JP
2008-227806 Sep 2008 JP
2008-229531 Oct 2008 JP
2008-263383 Oct 2008 JP
2008-301071 Dec 2008 JP
2009-010593 Jan 2009 JP
2009-044510 Feb 2009 JP
2009-077260 Apr 2009 JP
2009-094986 Apr 2009 JP
2009088942 Apr 2009 JP
2009-117953 May 2009 JP
2009-118396 May 2009 JP
2009111820 May 2009 JP
2009-147680 Jul 2009 JP
2009-159402 Jul 2009 JP
2009-159577 Jul 2009 JP
2009-166213 Jul 2009 JP
2009166213 Jul 2009 JP
2009171249 Jul 2009 JP
4307488 Aug 2009 JP
2009-207056 Oct 2009 JP
2009-232443 Oct 2009 JP
2009-246954 Oct 2009 JP
2009246954 Oct 2009 JP
2009-260883 Nov 2009 JP
2009-542038 Nov 2009 JP
2009267616 Nov 2009 JP
2010-010945 Jan 2010 JP
2010-010945 Jan 2010 JP
2010-011117 Jan 2010 JP
2010-054731 Mar 2010 JP
2010-068299 Mar 2010 JP
2010-087810 Apr 2010 JP
2010-094799 Apr 2010 JP
2010-094799 Apr 2010 JP
2010-109795 May 2010 JP
2010-124287 Jun 2010 JP
2010-147727 Jul 2010 JP
2010-166406 Jul 2010 JP
2010-524295 Jul 2010 JP
4541111 Jul 2010 JP
2010-528547 Aug 2010 JP
2010-207963 Sep 2010 JP
2010207963 Sep 2010 JP
2010-232755 Oct 2010 JP
2010245854 Oct 2010 JP
2010-258701 Nov 2010 JP
2010-268336 Nov 2010 JP
2010-283541 Dec 2010 JP
2011-004195 Jan 2011 JP
2011-008503 Jan 2011 JP
2011-010791 Jan 2011 JP
2011-010791 Jan 2011 JP
2011-015193 Jan 2011 JP
2011-017969 Jan 2011 JP
2011-035560 Feb 2011 JP
2011-048697 Mar 2011 JP
2011-053744 Mar 2011 JP
2011-059376 Mar 2011 JP
2011-087142 Apr 2011 JP
2011-512745 Apr 2011 JP
2011-130334 Jun 2011 JP
2011-135489 Jul 2011 JP
2011-139439 Jul 2011 JP
2011-139462 Jul 2011 JP
2011-212167 Oct 2011 JP
2011-212167 Oct 2011 JP
2011-223556 Nov 2011 JP
2011-223824 Nov 2011 JP
2011-233971 Nov 2011 JP
2011-234323 Nov 2011 JP
2012-508499 Apr 2012 JP
2012-109663 Jun 2012 JP
2012-138770 Jul 2012 JP
2012-515574 Jul 2012 JP
2012142679 Jul 2012 JP
2012-156781 Aug 2012 JP
2012150266 Aug 2012 JP
2012-169817 Sep 2012 JP
2012-178695 Sep 2012 JP
2012-249097 Dec 2012 JP
2012-257072 Dec 2012 JP
2013-005212 Jan 2013 JP
2013-055492 Mar 2013 JP
2013-061176 Apr 2013 JP
2013-078116 Apr 2013 JP
2013-081047 May 2013 JP
2013-081047 May 2013 JP
2013105272 May 2013 JP
2013115638 Jun 2013 JP
2013-128896 Jul 2013 JP
2013130402 Jul 2013 JP
2013-198072 Sep 2013 JP
2013-201560 Oct 2013 JP
2013-235316 Nov 2013 JP
2013-235316 Nov 2013 JP
2013-255091 Dec 2013 JP
2013-255212 Dec 2013 JP
2013255091 Dec 2013 JP
2013255212 Dec 2013 JP
2014-003488 Jan 2014 JP
2014003488 Jan 2014 JP
2014-089494 May 2014 JP
2014-089494 May 2014 JP
2014-116972 Jun 2014 JP
2014-190965 Oct 2014 JP
2014-229991 Dec 2014 JP
5676003 Feb 2015 JP
2015-061285 Mar 2015 JP
2015082818 Apr 2015 JP
2015-084801 May 2015 JP
2015084801 May 2015 JP
2015-139132 Jul 2015 JP
970008927 May 1997 KR
10-1998-0022845 Jun 1998 KR
10-2005-0086378 Aug 2005 KR
10-2007-0109323 Nov 2007 KR
10-2008-0006514 Jan 2008 KR
10-2008-0009602 Jan 2008 KR
10-2008-0040962 May 2008 KR
10-2009-0033564 Apr 2009 KR
10-2009-0120951 Nov 2009 KR
10-2010-0034906 Apr 2010 KR
10-2010-0041386 Apr 2010 KR
200423682 Nov 2004 TW
200536415 Nov 2005 TW
200539664 Dec 2005 TW
I391880200912814 Mar 2009 TW
200922261 May 2009 TW
201018982 May 2010 TW
M452360 May 2013 TW
201342313 Oct 2013 TW
199805148 Feb 1998 WO
2003055183 Jul 2003 WO
2004034734 Apr 2004 WO
2005067339 Jul 2005 WO
2005069586 Jul 2005 WO
2005091670 Sep 2005 WO
2005096599 Oct 2005 WO
2005096664 Oct 2005 WO
2006006313 Jan 2006 WO
2006028045 Mar 2006 WO
2006028045 Mar 2006 WO
2006075440 Jul 2006 WO
2007034739 Mar 2007 WO
2007-099707 Sep 2007 WO
2008007666 Jan 2008 WO
2008029515 Mar 2008 WO
2009104437 Aug 2009 WO
2009133873 Nov 2009 WO
2009136498 Nov 2009 WO
2009141912 Nov 2009 WO
2010005045 Jan 2010 WO
2010050154 May 2010 WO
2010060323 Jun 2010 WO
2010116510 Oct 2010 WO
2010140087 Dec 2010 WO
2011007679 Jan 2011 WO
2011023672 Mar 2011 WO
2011090944 Jul 2011 WO
2011121740 Oct 2011 WO
2011153165 Dec 2011 WO
2011159349 Dec 2011 WO
2002021881 Mar 2012 WO
2012090947 Jul 2012 WO
2012097314 Jul 2012 WO
2012114917 Aug 2012 WO
2012114772 Aug 2012 WO
2013047609 Apr 2013 WO
2013121631 Aug 2013 WO
2013168628 Nov 2013 WO
2014156534 Oct 2014 WO
2015122879 Aug 2015 WO
Non-Patent Literature Citations (72)
Entry
Japan Patent Office, International Search Report for PCT/JP2015/071490 dated Nov. 2, 2015 (with English translation).
Japanese Patent Office, International Search Report for PCT/JP2013/067781 dated Oct. 1, 2013 (with English translation).
Japanese Patent Office, International Search Report for International Patent Application PCT/JP2012/066376 (dated Oct. 30, 2012).
International Search Report for International Patent Application PCT/JP2011/080099 (dated Apr. 3, 2012).
Taiwanese Patent Office, search report in application 100148983 (2 pages) (dated Jan. 17, 2013).
U.S. Patent and Trademark Office, Office Action in U.S. Appl. No. 13/556,367 (dated Oct. 19, 2012).
European Patent Office, official communication in Application No. EP 11 85 3718 (dated May 14, 2014).
U.S. Patent and Trademark Office, Office Action in U.S. Appl. No. 13/489,971 (dated Oct. 24, 2012).
Isaka et al., “Development of Bone Conduction Speaker by Using Piezoelectric Vibration,” The Japan Society of Mechanical Engineers (No. 04-5) Dynamics and Design Conference 2004 CD-ROM Compilation (Sep. 27-30, 2004; Tokyo) (and English translation).
Japanese Patent Office, International Search Report for International Patent Application PCT/JP2012/053231 (dated Mar. 13, 2012).
EXtended European Search Report in European patent application No. 12866397.8 dated Jul. 20, 2015.
Japanese Patent Office, International Search Report for PCT/JP2014/071607 dated Nov. 11, 2014 (with English translation).
Japan Patent Office, International Search Report for PCT/JP2014/077792 dated Dec. 16, 2014 (with English translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2012-054308 dated Jun. 7, 2016 (and machine translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2015-056466 dated Jul. 12, 2016 (and machine translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2015-217427 dated Jul. 19, 2016 (and machine translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2015-217421 dated Jul. 19, 2016 (and machine translation).
SIPO of People's Republic of China, official communication for Chinese Patent Application No. 201180031904.5 dated Jul. 20, 2016 (and machine translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2012-120173 dated Jul. 26, 2016 (and machine translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2015-048052 dated Aug. 2, 2016 (and machine translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2012-147753 dated Aug. 23, 2016 (and machine translation).
Japanese Patent Office, official communication in Japanese Patent Application No. 2015-231478 dated Aug. 30, 2016 (and machine translation).
News Release, “New Offer of Smartphone Using Cartilage Conduction”, Rohm Semiconductor, Kyoto, Japan, Apr. 23, 2012 (with English translation).
European Patent Office, Partial Search Report for EP 11 85 3443 dated Oct. 27, 2016.
Chinese Office Action in Chinese Application No. 201510148247.2, dated May 3, 2017, 39 pages (English Translation).
Japanese Office Action in Japanese Application No. 2016-114221, dated Jun. 13, 2017, English Translation.
Japanese Office Action in Japanese Application No. 2012-150941, dated May 9, 2017, English Translation.
Shimomura et al., “Vibration and Acoustic Characteristics of Cartilage Transducer,” Acoustical Society of Japan, 2010 with Partial English Translation.
Rion Co. Ltd., “New-generation Vibration Level Meter Model VM-51,” Acoustical Society of Japan, 1990 with Partial English Translation.
Japanese Office Action in Japanese Application No. 2013-106416, dated May 30, 2017, English Translation.
Japanese Office Action in Japanese Application No. 2012-197484, dated Jun. 13, 2017, English Translation.
Japanese Office Action in Japanese Application No. 2013-126623, dated Jun. 13, 2017, English Translation.
Japanese Office Action in Japanese Application No. 2016-051347, dated Feb. 14, 2017, 6 pages (English Translation).
Korean Office Action in Korean Application No. 10-2015-7005518, dated Mar. 20, 2017, 12 pages (English Translation).
Japanese Office Action in Japanese Application No. 2015-217421, dated Feb. 28, 2017, 6 pages (English Translation).
Japanese Office Action in Japanese Application No. 2013-028997, dated Mar. 21, 2017, 8 pages (English Translation).
International Search Report for International Application No. PCT/JP2017/000787, dated Mar. 28, 2017, 1 page.
Japanese Office Action in Japanese Application No. 2016-087027, dated Mar. 28, 2017, 9 pages (English Translation).
Japanese Office Action in Japanese Application No. 2016-097777, dated Mar. 21, 2017, 8 pages (English Translation).
U.S. Patent and Trademark Office, Office Action in U.S. Appl. No. 15/049,403 dated Nov. 23, 2016.
U.S. Patent and Trademark Office, Office Action in U.S. Appl. No. 15/174,746 dated Nov. 25, 2016.
Smartphone Black Berry Bold 9700, Operation guide (2010).
Office Action for JP Patent Application No. 2016-013411 dated Nov. 22, 2016 with English Translation.
Office Action for KR Patent Application No. 10-2016-7004740 dated Nov. 28, 2016 with English Translation.
Office Action for JP Patent Application No. 2012-252203 dated Dec. 20, 2016 with English Translation.
Office Action for JP Patent Application No. 2012-243480 dated Dec. 20, 2016 with English Translation.
Office Action for JP Patent Application No. 2012-229176 dated Dec. 27, 2016 with English Translation.
Office Action for JP Patent Application No. 2012-268649 dated Jan. 31, 2017 with English Translation.
Office Action for JP Patent Application No. 2012-054308 dated Feb. 7, 2017 with English Translation.
Final Office Action for JP Patent Application No. 2012-120173 dated Feb. 7, 2017 with English translation.
Office Action mailed for KR Patent Application No. 10-2017-7019074 dated Oct. 13, 2017 with English Translation.
Office Action mailed for Japanese Patent Application No. 2013-227279 dated Oct. 17, 2017 with English translation.
Office Action for Japanese Patent Application No. 2013-221303 dated Oct. 17, 2017 with English Translation.
Office Action for Japanese Patent Application No. 2013-237963 dated Nov. 7, 2017 with English Translation.
Office Action for Japanese Application No. 2017-004233 dated Nov. 21, 2017 with English Translation.
Office Action for Japanese Patent Application No. 2016-236604 dated Nov. 21, 2017 with English Translation.
Office Action for Japanese Patent Application No. 2014-010271 dated Nov. 28, 2017 with English Translation.
Office Action for Japanese Patent Application No. 2017-000580 dated Dec. 19, 2017 with English Translation.
Office Action for Korean Application No. 10-2016-7004740 dated Dec. 19, 2017 with English Translation.
Office Action for Japanese Patent Application No. 2013-221303 dated Dec. 26, 2017 with English Translation.
Office Action for Japanese Patent Application No. 2013-237963 dated Dec. 26, 2017 with English Translation.
Japan Patent Office, International Search Report for PCT/JP2016/070848 dated Sep. 6, 2016, with English translation.
Office Action for corresponding Japanese Patent Application No. 2016-185559 dated Jul. 25, 2017 (with English translation).
Office Action for corresponding Japanese Patent Application No. 2016-195560 dated Aug. 22, 2017 (with English translation).
Office Action for corresponding Japanese Patent Application No. 2016-197219 dated Aug. 22, 2017 (with English translation).
Office Action for corresponding Japanese Patent Application No. 2016-197225 dated Aug. 22, 2017 (with English translation).
Office Action for corresponding Japanese Patent Application No. 2013-186424 dated Sep. 26, 2017 (with English translation).
Office Action for corresponding Japanese Patent Application No. 2013-195756 dated Sep. 26, 2017 (with English translation).
Office Action for corresponding Japanese Patent Application No. 2013-173595 dated Oct. 10, 2017 (with English translation).
Fukumoto, M. and Sugimura, T., Fulltime-wear Interface Technology , NTT Technical Review, 8(1):77-81, (2003) (with English Translation).
Sasaki C, Crusoe Supplementary Class note Which Condensed the Function Called for, ASCII, 12 pages (2001) (partial English translation).
European Patent Office; Extended European Search Report (Mar. 12, 2018) mailed in counterpart European Patent Application No. 15834516.5.
Related Publications (1)
Number Date Country
20170228995 A1 Aug 2017 US