The present invention relates generally to the field of video and audio communications devices, and more particularly to a device, method and system for capturing and transmitting unique personal user visual and audio inputs and sharing resulting visual and audio data with remote participants or devices.
Many systems have been developed and are currently in use for capturing video and audio inputs and storing or transmitting video and audio data. For example, conventional cameras, webcams, and so forth can be interfaced with computer systems to transmit video and audio files, either stored or in real time, over networks, including the Internet. Similarly, portable devices are well known for sending video and audio messages wirelessly, most prominently various cellular telephone technologies, Bluetooth protocols, and so forth. Moreover, telephone and video conferencing technologies are quite mature, and now commonly utilize high speed networks such as the Internet.
However, there is a growing and unsatisfied need for a business and personal-suitable hands-free technique for capturing, processing and disseminating video signals and ancillary information corresponding to the unique view of a user. That is, rather than a view made by a static camera or hand-held camera, there is a need for more personalized views to be transmitted by a user in a way that will more immediately and accurately depict what the user sees and hears. Existing camera technologies, for example, do not typically permit hands-free operation, and generally are inappropriate for conferencing and transmission of personal views, particularly using conventional video conferencing technologies. Experimental systems, such as helmets or the like equipped with cameras are more a curiosity than a practical solution for most applications, particularly in business.
The present need is motivated by a standing requirement for a person to be able to record, process, disseminate, and have understood, his or her personal viewpoint. There is a further need to enable the reception and viewing of unprocessed or processed views made previously or in real time by others.
While attempts have been made to create useful hands-free systems for video capture, none has yet successfully addressed the joint requirement of being both hands-free and allowing the user to go about his or her normal movement unencumbered by the video capture devices, while further incorporating and providing features vital to general business cases. The current need, as understood by the present invention, is for a system and components which can easily, unobtrusively, and comfortably integrate video and audio capture with the user, such as in a wearable device. In general, it is and will be necessarily that such devices provide suitably ergonomic means for accurately capturing high-quality video and audio signals, while providing the necessary electronics and sufficient electrical power for longer or medium-term operation.
The invention provides a novel device, method and system designed to respond to such needs. The invention may be based upon a camera which is designed to be worn on the head of a user, particularly in an ergonomic earpiece. The camera may be powered by a power unit coupled to the earpiece by a light-weight tether cable or wire. In certain embodiments, the earpiece may be completely wireless, having its own power supply. The camera captures video scenes similar or identical to those that would be seen by the wearer. The earpiece may also capture audio input, both from the environment of the particular scene as well as voice input by the wearer. The earpiece may further provide audio output for the wearer or, more generally, that may be heard by others in the presence of the wearer.
The earpiece may transmit video and audio data, encoded or un-encoded, via the same cabling or wirelessly. In certain embodiments, the earpiece or a separate worn device then transmits the video and audio signals to a receiver which can store, process or further transmit the video and audio inputs to other locations. For example, the receiver may be incorporated into an application-specific or general purpose computer that receives the video and audio input and transmits it to others via a network, including the Internet. The overall structure of the system might include a central manager or cell controller that serves as a hub for one or more such transmissions. The cell controller may regulate access to the video and audio input by both the signal provider and to other viewers and auditors, such as through conferencing procedures, subscriptions, and so forth.
In certain presently contemplated embodiments, the overall system, with the worn device and cooperating components forms what may be termed a “see what I see” (“CWIC”) system. That is, the overall system permits others to experience much the same video and, where provided, audio input as the wearer of the device experiences.
These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
Turning now to the drawings, and referring first to
Various sensors and subsystems may be included in the video/audio capture device 18. In a presently contemplated embodiment, the device will include one or more cameras for capturing video scenes, as well as one or more microphones for capturing sound. In the illustrated embodiment of
In the embodiment illustrated in
The embodiment illustrated in
The audio circuitry 42 similarly includes a number of functional components. In the illustrated embodiment, for example, a speaker 52 is provided as well as a microphone 54. The speaker is associated with a speaker driver circuitry 56 for powering the speaker and transforming received audio signals into appropriate signals to produce the audio output. Microphone interface circuitry 58 similarly receives signals from microphone 54, and may perform such functions as filtering, analog-to-digital conversion, encoding, decoding, encryption, compression and so forth. The speaker driver 56 and microphone interface 58 are coupled to a processor 60 which is programmed to carry out audio signal processing. Support circuitry may include memory circuitry 62 which serves to store routines executed by processor 60, and may store, at least temporarily, audio signals for transmission to the power/transceiver unit 14 through the intermediary of an interface 64.
The power/transceiver unit 14 similarly includes one or more interfaces 66 which communicate with interfaces 50 and 64 of the earpiece to receive video signals, and to send and receive audio signals. The interface circuitry 66 is coupled to processing circuitry 68 which coordinates the receipt and transmission of the video and audio signals, as well as their transmission to remote devices. The processing circuitry 68 may be served by a number of support circuits, such as memory circuitry 70 for storing the routines executed by the processing circuitry 68. Memory circuitry 70 may also store configuration parameters, data exchange protocols, and so forth needed for receipt and transmission of the video and audio signals, particularly their transmission to remote devices as described below. An interface circuit 72 is thus provided to permit wireless exchange of data between the power/transceiver unit 14 and remote devices.
It should be noted that other circuitry that may be included in the earpiece, the power/transceiver unit 14, or both may include circuitry for buffering, storing and forwarding audio and video signals based on the availability of the underlying network or connection. Similar circuitry may be included in the circuitry to which the signals are sent, as discussed in greater detail below. Similarly, the earpiece or the power/transceiver unit, or both, may include indicia to notify users and persons whose images or voices may be captured by the system that the system is currently recording. Such indicia may include, for example, light emitting diodes, blinking lights, and so forth. Still further, the earpiece or the power/transceiver unit, or both may include an indicator, and where desired, a selector, for indicating and selecting among a plurality of signal transport technologies (e.g., 2G, 3G, Wifi, WiMax, and so forth). For example, the system may automatically select a “best” transport mechanism or protocol, such as based upon a signal or connection strength, or may enable a user to select such technologies.
Still further, the circuitry of the earpiece and/or the power/transceiver unit may include one or more sensors for detecting environmental conditions or conditions of the wearer or even of persons or equipment in the environs of the user. By way of example, such sensors may include temperature sensors, chemical sensors, sensors for detecting vital signs, and so forth. In exemplary implementations, for example, a fire fighter or service technician may need to detect temperatures or air qualities. A physician may need to detect vital signs of a patient. The circuitry of the system, then, may collect sensed signals from such sensors, encode the information in an appropriate protocol and transmit the encoded information along with audio and/or video signals collected via the system.
In the presently contemplated embodiment illustrated in
The interface circuitry 72 of the power/transceiver unit 14 is equipped to communicate wirelessly with one or more receiver/transmitter units 78. Unit 78 may, in some embodiments, include a general purpose or application-specific computer coupled to a wireless interface, as designated generally by reference numeral 80 for exchanging data in accordance with any one or many known wireless protocols. Wireless protocols may include, for example, protocols known by the designations Bluetooth, ZIGBE, IEEE 802.11. Other presently contemplated wireless transmission technologies may include infrared connections, radio frequency connections, cellular telephony protocols, and so forth. In presently contemplated embodiments, the receiver/transmitter unit 78 will be local to the user. However, in future embodiments, particularly where longer range wireless communication is possible directly from the CWIC capture system 10, significant distances may exist between the capture system and the receiver/transmitter unit. Indeed, cellular protocols may be implemented directly in the CWIC capture system 10, with video and audio signals being transmitted directly via a cellular or similar network. In the illustrated embodiment, the receiver/transmitter unit 78 is coupled to a cell manager or similar controller, designated by reference numeral 82, via a network connection 84. The cell manager may carry out such functions as identifying permitted users or controlling access to the video and audio input from the capture system, controlling access by the capture system to a data transmission network, and so forth, as described in greater detail below with reference to
A number of variations may be envisaged for the capture system, and particularly for the earpiece 12. Certain of these are illustrated in
The foregoing arrangements are designed to function in a system which, in the present context, is termed the CWIC system. The CWIC system may be designed to provide for controlled access to networked or conference components in much the same way that conferencing models are presently used. That is, the wearer or user of the CWIC capture system may be required to maintain an up-to-date subscription for transmission of video and audio signals via the CWIC system. Other models may be based upon a pay-per-use arrangement with the user. In certain implementations, therefore, the user may be required to access the CWIC system by appropriate input of access code, such as via the receiver/transmitter unit 78 described above. This information may include, for example, user identification and password authentication, encryption protocols, session identifications, and so forth. The CWIC system itself may include a number of interface components as generally represented in
In the embodiment illustrated in
In the embodiment illustrated in
The CWIC system 104 may provide for individual receipt, storing, or communication of video and audio signals from single users or wearers. However, it should be noted that the system may interface with any number of wearers or users of capture systems 10, as indicated by reference numeral 116 in
In presently contemplated embodiments, to provide greater facility to the user in interfacing with the CWIC system, visible and/or audible indicators may be provided to inform the user that video and/or audio data is being acquired or is streaming through the system. Such indicators may include, for example, non-intrusive beeps, periodic beeps, or other audio clues. Similarly, visual indicators, such as colored LEDs, blinking LEDs and so forth may be provided for the same purpose. The system may also respond to audio commands, where desired, allowing the user complete hands-free control. For example, the user may speak commands such as “start streaming video” to control operation of the capture system. Similarly, particular audio or visual feedback may be provided to inform the user of the quality or bandwidth or resolution of the video and/or audio signals, the cost associated with transmission, and so forth.
Where desired, the earpiece, the power/transceiver unit, or the remote components with which these cooperate may include delay circuitry that adds a desired delay before transmission of the audio and video signals to a connected user or receiver of the content. Such delays may allow for the user of the system or for controllers at the CWIC system level to prevent transmission of audio signals, video signals, or both, should the system inadvertently capture inappropriate content.
Exemplary uses of the system described above may be many. As noted above, the system may be used, for example, for replacement of conventional video conferencing. Moreover, the system may be used to allow for expert direction of less trained personnel, such as for servicing, part replacement, troubleshooting of complex systems and equipment, and so forth. More generally, the system may be used for any application where video and audio input is desired, and where a view conforming much more closely to that experienced by the user is desired, as compared to existing video capture and transmission systems. Thus, the system may also provide collaboration and sharing of public and/or private (secure) content along with a medium that will enable users of the system to interact with the producers of the content along with the content itself.
While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.