Patent Application
20110109450
1. Field of the Invention
The present invention relates in general to children safety, and more particularly to a system and method of notifying a driver that a child has been left in the vehicle for a certain period of time after the ignition has been deactivated.
2. Description of the Related Art
Vehicle On-Board Diagnostics (OBD) interfaces are standardized by statute on all modern vehicles. These interfaces conforms to both physical and protocol specifications. The communication protocols used by OBD include serial (e.g.: RS-232) and controller area network (CAN). There are at least 5 different standards based protocol specifications in use for current OBD systems including SAE J1850 PWM/VPW, ISO 9141-2, ISO 14230 KWP2000, and ISO 15765 CAN. Starting in 2008, all US vehicles must use ISO 15765 CAN based communication protocols for the OBD interface. Various standards are known for OBD, such as OBD-I, OBD 1.5, and OBD-II which include various standard interfaces, signal protocols, data communications, etc. The present disclosure contemplates future OBD configurations and implementations.
In many applications, OBD interfaces are normalized using a translation microcontroller such as the ELM from SK Pang Electronics. The ELM is able to translate the different OBD protocols into a single protocol; however, the communication interface with the ELM remains serial. Some applications of the ELM or related translators have been adapted to use wireless communications BlueTooth™. These implementations rely on digital serial communication via BlueTooth™ that is not natively supported on many personal communication devices including smart phones.
Navigation computers are used in many vehicle applications as both installed and after-market additions. Vendors of these computers use global positioning systems (GPS) signals to provide interactive navigation assistance for drivers. Makers of these devices include Garmin® and TomTom®. The capability of navigation computers is expanding to include bidirectional information and to incorporate other location based services.
Smart phones have been widely available from companies such as Research In Motion (RIM). Recent introduction of the iPhone® by Apple Inc. and Android by Google phones have accelerated market penetration of these devices. Smart phones provide a broad range of capabilities, such as large readable displays, the ability to add new applications to the phone, network connectivity via cellular and/or WiFi, and global positioning system (GPS) location determination.
OBD display devices from companies including Autotap, ScanGauge allow drivers to display diagnostic data using a dedicated device and display. These after-market products allow drivers to monitor car diagnostics including fuel economy. Integrated vehicle diagnostic displays are included in some automobile dashboards or displays to show current and average fuel economy.
Numerous models of child car seats are available commercially. These devices typically attach to the vehicle using the standard seat belts or specially placed retention hooks. In general, child seats are after-market components that are installed by parents or guardians. They are not incorporated into the electronics of existing vehicles; consequently, vehicles are not able to determine when a child seat is occupied or if a child is restrained in the seat.
The benefits, features, and advantages of the present invention will become better understood with regard to the following description, and accompanying drawings where:
The following description is presented to enable one of ordinary skill in the art to make and use the present invention as provided within the context of a particular application and its requirements. Various modifications to the preferred embodiment will, however, be apparent to one skilled in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described herein, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed.
As illustrated, the DAB 102 communicates directly with the OBD system 101 to retrieve diagnostic data, to modulate the diagnostic data into an audio signal 126, and to transmit the audio signal 126 to the PCD 103 via the wired electronic interface 124. The PCD 103 includes a communication service 104, which demodulates the audio signal 126 to retrieve the diagnostic data and to incorporate the data into the appropriate format for consumption by the PCD 103. In a bidirectional configuration, the communication service 104 incorporates requests or commands or instructions or the like into the audio signal 126 which is transmitted to the DAB 102 via the wired electronic interface 124. In the bidirectional configuration, the DAB 102 incorporates similar functions as the communication service for decoding the received analog signal 126, retrieving instructions, commands, requests, etc., and interfacing the OBD system 101 accordingly. In one embodiment, the communication service 104 is an application executed on the PCD 103, such as an application configured for a smart phone or the like. The use of a wired interface ensures that communication is restricted between the two devices, but limits the location and connections for the system.
In one embodiment, the wired electronic interface 124 connects to the PCD 103 via an audio input/output connector 110. The connector 110 on the PCD 103 has any one of many different formats depending upon its implementation. There are two dominate form factors although any other suitable form factor may be used. A first form factor is the TRRS (tip-ring-ring-shield) audio jack plug that connects the microphone input and right/left audio channels of a smart phone. Another form factor is a proprietary control plug unique to each vendor and/or model. The proprietary interfaces generally provide for a microphone input and right/left audio channels. The plug may also have additional capabilities such as recharging the PCD 103. These extra capabilities may make the proprietary connector a more desirable interface in some applications, such as charging or maintaining charge of the PCD 103 during use.
In one embodiment, the communication is unidirectional in which the audio signal 126 is effectively “broadcasted” to the PCD 103. The unidirectional broadcast configuration has an advantage by reducing or eliminating bidirectional protocol translation between the OBD system 101 and the PCD 103. In an alternative embodiment, the communication is bidirectional. In a bidirectional configuration, the PCD 103 may periodically poll the OBD system 101 for OBD data or information or may send commands or requests for specific OBD data and information, such as according to OBD codes and the like as understood by those skilled in the art.
In one embodiment, the wireless signal 256 is according to a digital wireless audio (DWA) protocol. In one embodiment, the transceivers 205 and 206 are implemented according to BlueTooth™, which uses an open wireless protocol for exchanging data over short distances. The wireless transceivers 205 and 206 enable bidirectional wireless communications between the OBD system 101 and the PCD 103. In one embodiment, the wireless interface provides a meta-channel for control signals in which the PCD 103 sends instructions to the OBD system 101 via the DAB 102, such as for requesting particular data or the like. In an alternative broadcast embodiment, 205 is implemented as a wireless transmitter and 206 as a wireless receiver.
When the signal is transmitted using digital wireless protocols such as BlueTooth™ or the like, then it may be desired to alter the encoding strategy or data rates. This need arises because the digital wireless protocol may include data compression that is performed to convert the analog signal into a wireless digital signal. When the wireless signal is decoded back to audio, there may be a loss of fidelity that may impair the decoding algorithms reducing data transmission rate.
In an alternative embodiment, the communication system 300 is extended to reverse communication between the PCD 103 and the DAB 102. Bidirectional communication is established by using a speaker (not shown) on the PCD 103 and a corresponding microphone (not shown) coupled to the DAB 102.
An audio communication between the OBD system 101 and a PCD 103 as described herein circumvents the lack of direct serial communication support in current generation smart phones such as Apple's iPhone™, Google's Android™-based phones, and RIM's BlackBerry™. This limitation prevents external systems from communicating directly with the device for a variety of applications. In one embodiment, a communication system as described herein changes the communication model from point-to-point to broadcast.
At least one application for an audio communication between the OBD system 101 and a PCD 103 as described herein is to allow a vehicle OBD system to report current performance status to a monitoring application running on a smart phone. The communication pattern is strongly unidirectional and well suited to broadcast. This communication system is valuable because drivers can use vehicle diagnostic information from OBD to drive more efficiently and improve gas mileage. Diagnostic information may also be used to alert drivers about vehicle performance and maintenance issues. Based on information from extreme drivers, otherwise known as “hypermilers”, awareness of vehicle performance may be used to improve gas mileage by 20% or more. Improved gas mileage is a significant benefit particularly when gas prices rise.
It is anticipated that an audio communication between the OBD system 101 and a PCD 103 as described herein is generally applicable for other applications in which external communication with a smart phone is desired. For example, the communication system as described herein enables external communication with parking meters, machine-controlled telescopes, digital cameras, physical access control systems, and home or building automation control systems.
The vehicle specific part of the communication system employs a device (e.g., the DAB 102) that can communicate digitally with the OBD system. The DAB encodes and relays the digital performance data into audio signals. In an alternative embodiment, vehicle systems generate the audio signal 126 directly so that the DAB may be omitted. Smart phones are universally well-equipped to receive and process audio signals.
The OBD information is audio encoded in many ways including, but not limited to, methods employed by conventional modems. These approaches include, but are not limited to, highly discrete amplitude modulation, such as using 256 volume levels to encode a byte in a single pulse, discrete amplitude modulation, such as using 3 volume levels (on/off/space) to encode a bit in a single pulse, overlapping frequency modulation, such as using 256 audio overlapping frequencies to encode a byte, discrete frequency modulation, such as using 256 discrete frequencies to encode a byte, etc. A combination of amplitude and frequency modulation is also contemplated. It is desired to standardize on a single encoding approach to minimize decoding complexity. There are multiple mechanisms for the DAB to encode digital signals, including, but not limited to, recording waveforms for bits and playing them in the correct sequence, using a fast Fourier transform (FFT) or similar mathematical approach to generate the correct signals, using frequency generating electronics and combining them using analog circuits, etc.
As previously described, the encoding/decoding functions of the communication service 104 operate on both ends of the channel for bidirectional communication. The communication service 104 can be implemented in many different forms. For example, on the iPhone Objective C, the native programming language of the iPhone, can interpret the audio signal from the phone into digital data. The iPhone provides the audio signal as pulse code modulation (PCM) format information. On an Android-based phone, a Java program is preferred for the audio decoder. The Java application programming interface (API) also supplies a PCM signal. In one embodiment, a C or Assembly language program is used on the DAB 102 to decode the signals into digital data. In one embodiment, frequency counter integrated circuits (ICs) are used on the DAB 102 to simplify the decoding programs.
In general, encoding data is simpler than decoding because lookup tables can be used to map bit or byte patterns into PCM sound wave. The PCM data is delivered to the relevant API and translated by the system's operating system into sound. The DAB 102 has fewer support APIs and may use a digital to analog IC instead of a PCM interface.
Some implementations may not be able to use PCM input because the operating system does not provide a PCM formatted input. PCM is preferred because it is considered lossless. In non-PCM embodiments, the input audio is provided in an compressed format using one of the industry standard audio encodings such as MP3, 3GP, WAV etc. In these cases, the audio signal 126 has been substantially altered and frequencies have been eliminated from the data. One approach is to convert the signal back to PCM for use in the algorithms described above. An alternative approach, compressed pattern matching (CPM), is used to find frequency patterns in the encoded data based on a table lookup model. In the CPM application, knowledge of the encoding algorithm allows the CPM algorithm to inspect frames of the encoded data. Frames with similar encoding values are known to match certain frequencies. Lack of controllable frame boundaries requires additional padding between frequencies; consequently, the available bandwidth for CPM is limited.
An audio communication between the OBD system 101 and a PCD 103 as described herein allows for bidirectional communication between devices using at least two modes. A first mode relies on the same audio encoding methodology as described above. BlueTooth™ and similar technologies are bidirectional by design when both audio channels are used. Encoding using a sound via a microphone and speaker includes timing or noise cancellation to prevent signal collisions. A second mode employs the meta data or audio control channel of the digital audio encoding protocol. The control channel is used to manage mute and volume levels. Bidirectional communication is established by manipulating these control values to encode digital data. In one embodiment, a nibble is encoded as one of 16 discrete volume levels while mute on/off marks each nibble.
According to the encoding routine of
The encoder takes a PCM buffer from a microphone. The buffer contains 16-bit samples of the microphone at a frequency of 14,400 samples per second. The encoder looks for 50 samples that have a transition of a specific amount. Since the data was encoded as sine waves, the samples cross the 0 line a number of times. Each frequency crosses the 0 line a defined number of times for that frequency within the 50 sample unit. The decoder looks at the moving value of zero value crossing to see if it finds a sending frequency. The decoder uses the fact that a gap is sent between the bits of data to frame the data. The decoder acts as a state machine expecting a gap. Once a gap is found, it expects either a 0 or 1 signal. That bit of information is recorded and a gap is expected. This continues until two gaps are seen. Once 8 bits are seen, they are converted into an 8-bit number and stored in an array. These are accumulated and built into a string of information.
The PCD stack 602 includes a hardware layer including an audio input 610 and an audio output 611, system API's including a sound recording API 612 interfacing the audio input 610 and a sound play API 613 interfacing the audio output 611, a decoder 614 interfacing the sound recording API 612, an encoder 615 interfacing the sound play API 613, a PCD business logic layer 616 interfacing the encoder 615 and decoder 614, and a PCD user interface 617 interfacing the PCD business logic 616. In a similar manner, the OBD stack 604 includes a hardware layer including an audio input 620 and an audio output 621, system API's including a sound recording API 622 interfacing the audio input 620 and a sound play API 623 interfacing the audio output 621, a decoder 624 interfacing the sound recording API 622, an encoder 625 interfacing the sound play API 623, an OBD business logic layer 626 interfacing the encoder 625 and decoder 624, and an OBD interface 627 interfacing the OBD business logic 626 and for communicating with the OBD system 101.
In one embodiment, the PCD user interface 617 is an application that presents OBD data from the OBD system 101 of a vehicle (e.g., automobile) and directs the PCD business logic 616 to query for additional data elements. The OBD interface 627 drives the serial interface to an OBD data port. In each case, the business logic is responsible for handling the conversion of transmitted data received from the decoder into presentation views. It is also responsible for pushing data through the encoder from the presentation layer.
As a more specific example, suppose the PCD user interface 617 displays an RPM gauge on the PCD 103 representing engine RPMs from a car to which it is attached. The PCD user interface 617 displays the current RPM value. The job of the PCD business logic 616 is to make sure that this RPM value is always current. The PCD business logic 616 constructs and sends a request message to the OBD business logic 626 asking for the RPM value. The encoder 615 encodes the request message as sound or audio data in a PCM buffer and passes the PCM buffer to the sound play API 613. The sound play API 613 plays the audio data in the PCM buffer on the audio output 611 for transmission as the audio signal 608 to the audio input 620 of the OBD stack 604. The audio input 620 receives the audio signal 608 and converts the sound or audio data into data stored in a PCM buffer that the decoder 624 receives through the Sound recording API 622. The decoder 624 decodes the data in the PCM buffer into an OBD business logic request. The OBD business logic 626 takes that request and forwards a request to the OBD interface 627 for the current RPM value. The OBD interface 627 retrieves the new RPM value from the OBD system 101.
The OBD interface 627 gives the new RPM value to the OBD business logic 626. The OBD business logic 626 encodes the result as a message to the PCD business logic 616. The OBD business logic 626 passes the message to the encoder 625. The encoder 625 encodes the message as sound data in a PCM buffer and stores the data into a PCM buffer that represents the message containing the new RPM value. The encoder 625 “plays” the data in the PCM buffer through the Sound play API 623 and the audio output 607 as an audio signal 607. The audio input 610 “hears” the audio signal 607 and delivers corresponding data stored in a PCM buffer to the decoder 614 through the sound recording API 612. The decoder 614 converts the data in the PCM buffer to a message that contains the RPM value and passes that to the PCD business logic 616. The PCD business logic 616 then updates the current RPM value which causes the PCD user interface 617 to update its RPM gauge. This process repeats to keep the RPM gauge updated.
Other strategies may be used to reduce messaging by having the OBD business logic send an RPM value update at an interval. This takes a similar messaging style as that shown and described.
To address safety concerns about children left unattended in vehicles, it is desirable use the PCD 103 (e.g., cell phone or the like) of the driver to notify them that their child in car for a certain period of time after the car ignition has been deactivated. The PCD 103 works for notification because the driver is likely to remember the phone or device even if the child is forgotten. An embodiment described herein combines information about a vehicle's ignition state from the OBD system in order to determine when the car is turned on and describes a device to be installed on a child seat that communicates with the driver's PCD 103.
The sensor 709 may be configured according to any one of several different methods, such as a simple pressure sensitive pad, detecting contact between a seat belt and buckle, providing an in/out toggle switch which is manually changed when inserting/removing the child 705 from the car seat 707, etc., and is generally provided as an on/off indication. The DAB 102 detects the status of the sensor 709 and develops seat information 713, which indicates whether the child 705 is in the car seat 707. The DAB 102 provides ignition information 703 and the seat information 713 to the PCD 103 via the communication interface 605 and the communication service 104. The ignition information 703 indicates whether the vehicle is started (or running) or not. In one embodiment, the DAB 102 periodically broadcasts the information 703 and 713, and in another embodiment the PCD 103 request the information 703 and 713 and the DAB 102 responds by retrieving and sending the information 703 and 713. In one embodiment, the information 703 and 713 is modulated into an audio signal. The audio signal may be sent via a wired or wireless interface as previously described. In one embodiment, the information 703 and 713 is formulated into a least one message which is modulated into the audio signal.
The communication service 104 demodulates audio signals and provides the ignition and seat information 703, 713. The vehicle and seat interface modules 715 and 717 are dedicated processes which monitor the ignition status and seat status, respectively, and indicate this information to the monitor module 719. The vehicle interface module 715 detects the ignition information 703 and determines whether the vehicle is started or not. The seat interface module 717 communicates the child occupancy status to the monitor module 719. The interfaces 715 and 717 are shown as separate modules, but may be integrated into a common interface. Operation of the monitor module 719 is described further below. The communication service 104, the vehicle interface module 715, the seat interface module 717, the monitor module 719, and the alert module 721 collectively operate as safety control code for detecting when the child 705 has been left behind by the driver. The term “code” encompasses any combination of software, programs, applications, tasks, firmware or the like executed or otherwise operated or performed on the PCD 103. Alternatively, the modules may be implemented as circuitry or the like.
If the child 705 is detected as left behind, then any one or any combination of the alert mechanisms are activated by the alert module 721. The visual alert 723 includes any one or more of displaying images or text on a screen (not shown) of the PCD 103. The vibration alert 725 includes making the PCD 103 vibrate using an internal vibrator mechanism (not shown). The audio alert 727 includes playing sounds or vocalizing words to the speaker or headset (not shown) of the PCD 103. The send alert message 729 includes sending a predetermined text or email message, or even making a phone call for help. A phone call may be made to a predetermined number (e.g., 911, police, ambulance, etc.) with a pre-recorded information message.
After the delay at block 813, operation proceeds to block 815 to determine whether the child 705 is still detected in the car seat 707. If so, an alert mechanism is activated at block 817 and operation loops and the alert remains activated until the child is removed or other appropriate action is taken. If the child is not detected in the car seat after the delay as determined at block 819, then monitoring is deactivated at block 819 and operation is completed. After the delay at block 813, operation also proceeds in parallel to block 821 to query whether monitoring has been deactivated. If monitoring has been deactivated, then operation is completed for this loop. Otherwise, if monitoring has not yet been deactivated, operation proceeds to block 823 to query whether communication between the DAB 102 and the PCD 103 is lost. If not, operation loops back to block 821 and operation loops as long as monitoring is not deactivated and communication is not lost. It is noted that if the child is left in the car seat at this time, the alert is activated at block 817 as previously described. If the communication is lost while monitoring is still activated as determined at block 823, then operation proceeds to block 825 to activate an alert mechanism, and operation loops back to block 821. Operation continues to loop and the alert mechanism remains activated until communication is re-established, or monitoring is deactivated, or other suitable action is performed.
In this case, the monitor module 903 operates in a similar manner as the monitor module 719 for determining whether the child 705 has been left behind unattended. When the monitor module 903 determines that an alert mechanism is to be activated, it sends an alert indication to the PCD 103. In one embodiment, the alert indication is provided as a message which is modulated by the communication interface 903 into an audio signal. The communication is wired or wireless as previously described. If wireless, the audio signal is further converted to a wireless signal by a wireless transmitter as previously described, and the wireless signal is converted back to the audio signal by a wireless receiver coupled to the PCD 103 as previously described. The communication service 104 demodulates the audio signal and provides alert information to the alert module 721, which activates one or more of the alert mechanisms as previously described. The DAB 102 is a dedicated monitoring device and enables additional alarm functionality.
In the illustrated embodiment, the monitor module 903 is further coupled to an internal alarm 913, such as a speaker or lights or the like for alerting the driver that the child 705 has potentially been left behind unattended. The monitor module 903 is further coupled to an alarm interface 909, which is externally coupled to an external alarm 911. The external alarm 911 is an external trigger mechanism to an external alert, such as honking the horn, flashing signal or headlights, etc., or any combination thereof. Several methods may be used to configure the alert and/or alarm parameters for the DAB 102 or PCD 103, such as switches, a display and buttons, external configuration via a remote program running on another device that communicates with the monitoring device, etc.
It is appreciated that either dedicated or general purpose monitoring operates according to some basic logic. A combination of both dedicated and general purpose monitoring as shown in
Additional capabilities are contemplated. In one embodiment, the configurable delay (block 813) of the monitor module is changed based on the location of the vehicle from a GPS feed. For example, if the child 705 was left in the car seat 707 while the vehicle is located near a parent office triggers an alert or alarm more quickly. Furthermore, certain geological locations are predetermined to trigger the alert mechanisms or alarms regardless of the ignition state of the vehicle. For example, if the child 705 is in the car seat 707 when the vehicle is near an adult entertainment facility or the like.
It is appreciated that upon detection of a child left behind event, a safety system as described herein has many options available to notify the driver or request external assistance. It is anticipated that the device may escalate warnings while attempting to communicate with the driver. For example, the first notification may be visual on the phone display followed by a sound or vibration. If initial warnings do not address the problem, the application increases the volume of the alert and magnitude of vibration. If the alert continues, then the device may be able to use external networks to send a text message, email, or phone call for help. To enhance driver and child safety, the application may also monitor other OBD data, such as air bag deployment state to detect if the vehicle has been in an accident. If an accident is detected, then the application may use external networks to call for help. This aspect may be used even if no child is in the vehicle
In an alternative embodiment, detection of child occupancy is not used. Instead, the driver indicates on the PCD 103 when the child 705 is placed into the car seat 707. In another configuration, the PCD 103 is configured to automatically assume that a child is in the seat if the vehicle ignition is detected. The PCD 103 then reminds the driver to remove the child when the car ignition is switched off. While this method may result in false alerts, it is very simple to implement and may be applied to any situation in which valuable items are regularly transported.
Although the present invention has been described in considerable detail with reference to certain preferred versions thereof, other versions and variations are possible and contemplated. For example, circuits or logic blocks or modules described herein may be implemented as discrete circuitry or integrated circuitry or software or any alternative configurations. Finally, those skilled in the art should appreciate that they can readily use the disclosed conception and specific embodiments as a basis for designing or modifying other structures for carrying out the same purposes of the present invention without departing from the spirit and scope of the invention as defined by the appended claims.
This application claims the benefit of U.S. Provisional Application Ser. No. 61/197,606, filed on Nov. 7, 2008 which is herein incorporated by reference in its entirety for all intents and purposes. The present application is also a continuation-in-part of copending U.S. patent application Ser. No. ______, entitled SYSTEM AND METHOD FOR COMMUNICATING ON-BOARD DIAGNOSTIC INFORMATION AS AN AUDIO SIGNAL, filed on Oct. 30, 2009, which is incorporated herein by reference in its entirety for all intents and purposes.
