The disclosure relates to the field of in-vehicle information systems, and, more particularly, to data entry into an in-vehicle information system.
It is known to enter text information into an electronic vehicle system by typing via a keypad. However, such data entry is time consuming and requires the user's full attention such that he cannot safely perform any driving tasks while typing.
The present invention may include the use of a camera with a text recognition algorithm to perform automatic information entry into a vehicle system. The information may include vehicle destination, contact info, point of interest identification, etc. The information may be in the form of any type of text including text displayed on any hand-held devices (e.g., tablet, phone, etc.) or printed on papers, napkins, business cards, etc. The information does not need to be manually re-entered in the vehicle system, such as by typing or voice entry. Nor does the invention require any application on the devices in order to be able to transfer the information to the vehicle.
The inventive system is simple and handy because the text source of information can be displayed or printed on anything as long as the text is legible. The inventive system is also a quick and safe way of entering the info. Once the information is scanned and processed, the vehicle may ask the driver what he wants to do with the information. If the system recognizes the text as an address, the system may ask the driver if he would like to make the address a new vehicle destination or save the address for later use. If the system recognizes the text as a phone number, the system may ask the driver if he would like to call the number now or save it for later, etc. If the system recognizes the text as a restaurant name, the system may ask the driver if he would like to place a food order with the restaurant. The information can be infotainment related, such as the title of a song. In this case, the system may ask the driver if he wants the vehicle audio system to play the song.
In one embodiment, the invention comprises a vehicle including a camera directed generally toward a driver seat of the vehicle, and the camera can capture images within a passenger compartment of the vehicle. A text recognition module is communicatively coupled to the camera and recognizes text characters in the captured images. An electronic processor is communicatively coupled to the text recognition module and interprets the recognized text characters as text information and enters the text information into an application within the vehicle. The processor may also categorize the text information, e.g., recognize the information as address, phone number, POI, etc., based on the format, type, and metadata of entered text.
In another embodiment, the invention comprises a vehicle including a camera disposed adjacent to a driver's seat of the vehicle, and directed in a generally upward direction. The camera captures images within a passenger compartment of the vehicle. A substantially transparent first substrate is oriented substantially perpendicular to the generally upward direction and is disposed within a field of view of the camera. The first substrate supports a second substrate bearing text characters. A text recognition module (to interpret information entered by gesture) is communicatively coupled to the camera and recognizes text characters in the captured images. An electronic processor is communicatively coupled to the text recognition module and interprets the recognized text characters as text information and enters the text information into an application within the vehicle.
In yet another embodiment, the invention comprises a method of operating a motor vehicle, including providing a camera directed generally toward a driver seat of the vehicle, such as on the rear-view mirror or visor, for example. The camera can also be used to capture images within a passenger compartment of the vehicle. A text recognition module is communicatively coupled to the camera. The text recognition module is used to recognize text characters in the captured images. The recognized text characters are interpreted as text information, the text characters are processed to identify what the information is, and the text information is entered into an application within the vehicle.
The camera that is used for the information entry can also be used for other applications such as driver monitoring and gesture control.
The present invention has the advantage that text data may be quickly and automatically entered into a vehicle system without any effort from the driver except to show the information to the camera.
Another advantage is that the driver may safely perform at least some driving tasks while entering text data into the vehicle system.
A better understanding of the present invention will be had upon reference to the following description in conjunction with the accompanying drawings.
The images captured by camera 12 may be transmitted to text recognition module 14 which may recognize the alphanumeric characters (or other written characters) in the images. Text recognition module 14 may transmit the recognized characters to processor 18, which may interpret the recognized characters as words, commands or menu selections, for example. Text recognition module 14 may also identify what kind of information the recognized characters are, such as an address, phone number, schedule/meeting info, etc.
User interface 20 may include a display screen, head up display (HUD), microphone, loudspeaker, pushbuttons, etc. Through user interface 20, processor 18 may ask the driver or other user what he would like processor 18 to do with the recognized text that he entered. For example, the driver may instruct processor 18 to store the text from a business card he held up to camera 12 in a contacts list stored in memory 16. Alternatively, the driver may ask processor 18 to use the text in conjunction with one of applications 22. For example, one application may be a mobile telephone, and the user may ask processor 18 to use the mobile telephone to call a telephone number in the text. Another application may be a navigation system, and the user may ask processor 18 to use the navigation system to plan a route to a street address in the text.
In the example depicted in
An upwardly direct light (not shown) may be provided adjacent to the camera. The driver may selectively operate this light if needed for the text on the lens to be discerned and recognized, such as text printed on paper, but may keep the light off in the case of the camera scanning an illuminated display, such as on a mobile phone.
The camera may function as a scanner. The text recognition module may recognize hand gestures, finger swipes, handwritten notes or destinations, business cards, and text on a mobile electronic device screen, such as text messages, emails, web pages, contact information, and infotainment information, which may be music related.
Next, in step 404, the camera is used to capture images within a passenger compartment of the vehicle. For example, camera 12 may capture images of text within the vehicle passenger compartment that is displayed on a personal electronic device or printed on paper.
In a next step 406, a text recognition module is communicatively coupled to the camera. For example, the images captured by camera 12 may be transmitted to text recognition module 14 wirelessly or via a hard wire.
In step 408, the text recognition module is used to recognize text characters in the captured images. For example, text recognition module 14 may recognize the alphanumeric characters (or other written characters) in the images.
Next, in step 410, the recognized text characters are interpreted as text information. That is, text recognition module 14 may transmit the recognized characters to processor 18, which may interpret the recognized characters as words, commands or menu selections, for example.
In a final step 412, the text information is entered into an application within the vehicle. For example, the driver may ask processor 18 to use the text in conjunction with one of applications 22. One application may be a mobile telephone, and the user may ask processor 18 to use the mobile telephone to call a telephone number in the text. Another application may be a navigation system, and the user may ask processor 18 to use the navigation system to plan a route to a street address in the text.
The foregoing description may refer to “motor vehicle”, “automobile”, “automotive”, or similar expressions. It is to be understood that these terms are not intended to limit the invention to any particular type of transportation vehicle. Rather, the invention may be applied to any type of transportation vehicle whether traveling by air, water, or ground, such as airplanes, boats, etc.
The foregoing detailed description is given primarily for clearness of understanding and no unnecessary limitations are to be understood therefrom for modifications can be made by those skilled in the art upon reading this disclosure and may be made without departing from the spirit of the invention.
This application claims benefit of U.S. Provisional Application No. 62/287,401 filed on Jan. 26, 2016, which the disclosure of which is hereby incorporated by reference in its entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
62287401 | Jan 2016 | US |