Patent Application
20170082451
This application and claims priority to Chinese Patent Application No. 201510609516.0, filed Sep. 22, 2015, which is incorporated herein by reference in its entirety.
The present disclosure generally relates to the field of wireless communication technology, and more particularly to methods and devices for navigation based on real-life video.
Current navigation systems are based on maps. A user needs to identify abstract representation and symbols in a map while driving. Since some users may have slow response to navigation maps, they may not be able to follow navigation instructions in a map format in complicated road conditions with, for example, multi-intersection configurations.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
In one embodiment, a method for navigation is disclosed. The method includes obtaining navigation request information for a current navigation task; determining at least one navigation video segment based on at least one pre-stored navigation video clip according to the navigation request information, wherein each of the at least one pre-stored navigation video clip comprises a prior recording of at least a portion of a route corresponding to the navigation request being previously driven through; and performing the current navigation task by playing one of the at least one navigation video segment.
In another embodiment, a method for generating a navigation video clip is disclosed. The method includes obtaining navigation parameters entered by a user, wherein the navigation parameters comprise at least a navigation starting point and a navigation ending point; recording a video of roads while driving from the navigation starting point to the navigation ending point; associating the navigation parameters with the recorded video to obtain the navigation video clip; and uploading the navigation video clip to a database.
In yet another embodiment, a device for navigation is disclosed. The device includes a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: obtain navigation request information for a current navigation task; determine at least one navigation video segment based on at least one pre-stored navigation video clips according to the navigation request information, wherein each of the at least one pre-stored navigation video clip comprises a prior recording of at least a portion of a route corresponding to the navigation request being previously driven through; and perform the current navigation task by playing one of the at least one navigation video segment.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which same numbers in different drawings represent same or similar elements unless otherwise described. The implementations set forth in the following description of exemplary embodiments do not represent all implementations consistent with the invention. Instead, they are merely examples of devices and methods consistent with aspects related to the invention as recited in the appended claims.
Terms used in the disclosure are only for purpose of describing particular embodiments, and are not intended to be limiting. The terms “a”, “said” and “the” used in singular form in the disclosure and appended claims are intended to include a plural form, unless the context explicitly indicates otherwise. It should be understood that the term “and/or” used in the description means and includes any or all combinations of one or more associated and listed terms.
It should be understood that, although the disclosure may use terms such as “first”, “second” and “third” to describe various information, the information should not be limited herein. These terms are only used to distinguish information of the same type from each other. For example, first information may also be referred to as second information, and the second information may also be referred to as the first information, without departing from the scope of the disclosure. Based on context, the word “if” used herein may be interpreted as “when”, or “while”, or “in response to a determination”.
By way of introduction, navigation methods based on an interface showing maps for roads and routes in the form of abstract geometric images and accompanying simplified symbols may be confusing to users having slow reaction time to abstract instructions not based on real-life images. The embodiments of the present disclosure use a compiled real-life video segment for each navigation task and thus provide more direct navigation instructions and relieve users from stress when driving on roads with complicated configurations. Video fragments in the compiled navigation video segment may be pre-obtained by real-life footage of particular roads shot when the roads were previously driven through. The user queries the navigation system for a navigation video segment by inputting into the navigation system a set of navigation parameters including at least a starting point (or starting position, used in this disclosure interchangeably with “starting point”) and ending point (or ending position, used in this disclosure interchangeably with “ending point”). The navigation parameters may further include other information for more accurate and synchronous video compilation, such as a geographic region name parameter, a road name, a season parameter, a weather parameter, an average driving speed and the like. The compiled video segment is played in the navigation interface of a navigation device providing visually direct driving instructions and improving user experience.
The navigation parameters may be manually input by the user into the navigation system. Alternatively, some of the parameters may be automatically obtained by the navigation system. For example, the navigation system may automatically determine the starting point, the average driving speed, the geographic region name, season, and weather with the help from an embedded GPS, a pre-stored map, and a server in communication with the navigation system. The navigation system may include a navigation terminal device and at least one server in communication with the navigation terminal device. Information, such as the navigation video source, maps, and weather, may be obtained, stored, and processed locally in the navigation terminal device or remotely by the server. The information is communicated between the navigation terminal device and the server when needed.
In this disclosure, a “video clip” refers to a unit of video pre-stored in the navigation system. A video “sub-clip” refers to a portion of a video clip that may be extracted from the video clip. A “navigation video segment” refers to a video segment that the navigation system compiles from stored video clips for a particular navigation task. A navigation video segment, as disclosed herein, may be an entire video clip, or a sub-clip, or combined multiple video clips, or combined multiple sub-clips (which may be extracted from the same video clip, or from different video clips).
In step S13, the navigation system navigates based on one of the compiled navigation video segments. Navigating with real-life video may decrease driver reaction time compared to navigation interface based on maps and thus may reduce number of mistakes in following navigation instructions in locations with complex road configuration and may relieve a driver from excess stress.
The navigation request information may include navigation parameters such as navigation starting point and a navigation ending point. Step S12 may be implemented in the following non-limiting alternative manners in compiling suitable video segments for navigating from the starting point to the end point.
For example, the navigation starting point and the navigation ending point of the current navigation task may be A and B. The corresponding navigation route is thus A→B. The navigation system may find a stored navigation video clip shot for navigation route CD (the navigation starting point is C and the navigation ending point is D), and the navigation route AB is a sub-section of the navigation route CD. The navigation system thus may extract a sub-clip corresponding to AB from the navigation video clip CD. Here, the navigation parameters corresponding to the navigation video clip CD include the road names corresponding to the navigation route AB or identifications point A and point B.
The implementations above for identifying a navigation video segment are not mutually exclusive. Multiple navigation video segments may be found based on any one or combination of these implementations for a particular navigation task.
The navigation video segment compiled above (according to
The navigation video clips may be pre-shot under various conditions. For example, a video clip corresponding to particular starting and ending points may be recorded either on a rainy day, cloudy day, snowing day, or sunny day. It may be recorded during a particular season. It may be recorded when the vehicle with the camera was driven with a particular average speed. It may be recorded through different road options between the starting and ending points. Some of these parameters, such as season and weather may be related to the lighting condition of the video. For example, a navigation video clip recorded at 6:00 PM in summer may be bright and may show clear road signs and surrounding buildings but may be dark if recorded at 6:00 pm during winter time. Thus, for improve navigation and visual accuracy, navigation video segment for the current navigation task may be compiled from the stored video clips considering these other navigation parameters including but not limited to geographic region name, road name, season, weather, average speed and the like. These parameters may be input by the user, or they may be obtained by the navigation system automatically with the help from embedded GPS and external networks in communication with the navigation system. For example, the navigation system may obtain geographic region name, road name, and driving speed by combining GPS information and a map stored within the navigation system. It may further obtain weather information from an external weather server. In addition, it may maintain system time and date and thus may automatically determine the season. The navigation terminal device may compile the navigation video segment for the current navigation task that best matches all these navigation parameters. The more navigation parameters in the navigation request, the more accurate the compiled navigation video segment may be. The navigation video clips, accordingly, may be associated with a set of these parameters. Some of the navigational parameters of the navigation video clip may be global to the video clip. For example, the entire video clip may be shot under the same weather condition, or about the same lighting condition. These parameters may be stored in the metadata of the video clip. Other parameters may be in real-time. For example, driving speed may vary within the video clip. These parameters may be recorded in, for example, the header of the video frames. All these parameter, global, or real-time, may alternatively be stored in a separate data structure of data file that may be associated and synchronized with the video clip.
For example, there may be three navigation videos, Video 1, Video 2, and Video 3, all having navigation starting point A and the navigation ending point B. The navigation request information further includes:
season parameter being summer;
weather parameter being rainy;
average driving speed parameter being 40 km/h; and
road name parameter being Road A.
The navigation parameters of Video1, Video2, and Video3 are shown in Table 1.
The degree of matching may be calculated by calculating the percentage of number of parameters that are a match. From Table 1, the degree of matching for the parameters of Video1 and the corresponding navigation parameters of the navigation request information is the highest at 75%. Thus, Video 1 is determined as the navigation video clip among the three clips to be used for the current navigation task. Alternatively, the navigation system may present all clips having a degree of matching above a threshold, e.g., 50%, or predetermined number of top matches, e.g., top two matches, to the user to select which video clips is to be used in the current navigation task.
The method of the present disclosure may either be applied to a server or a navigation terminal device. The terminal device may be a mobile phone, a tablet computer, a laptop computer, a digital broadcasting terminal, a message transceiver device, a game console, a personal digital assistant and the like.
Either the server in
In another implementation of the method of
A method for generating a navigation video is further provided in an exemplary embodiment of the present disclosure as shown by the flow diagram of
With respect to the devices of
Each module or unit discussed above for
The device 2000 may include one or more of the following components: a processing component 2002, a memory 2004, a power component 2006, a multimedia component 2008, an audio component 2010, an input/output (I/O) interface 2012, a sensor component 2014, and a communication component 2016.
The processing component 2002 controls overall operations of the device 2000, such as the operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 2002 may include one or more processors 2020 to execute instructions to perform all or part of the steps in the above described methods. Moreover, the processing component 2002 may include one or more modules which facilitate the interaction between the processing component 2002 and other components. For instance, the processing component 2002 may include a multimedia module to facilitate the interaction between the multimedia component 2008 and the processing component 2002.
The memory 2004 is configured to store various types of data to support the operation of the device 2000. Examples of such data include instructions for any applications or methods operated on the device 2000, contact data, phonebook data, messages, pictures, video, etc. The memory 2004 may be implemented using any type of volatile or non-volatile memory devices, or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic or optical disk.
The power component 2006 provides power to various components of the device 2000. The power component 2006 may include a power management system, one or more power sources, and any other components associated with the generation, management, and distribution of power for the device 2000.
The multimedia component 2008 includes a display screen providing an output interface between the device 2000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may not only sense a boundary of a touch or swipe action, but also sense a period of time and a pressure associated with the touch or swipe action. In some embodiments, the multimedia component 2008 includes a front camera and/or a rear camera. The front camera and the rear camera may receive an external multimedia datum while the device 2000 is in an operation mode, such as a photographing mode or a video mode. Each of the front camera and the rear camera may be a fixed optical lens system or have optical focusing and zooming capability.
The audio component 2010 is configured to output and/or input audio signals. For example, the audio component 2010 includes a microphone (“MIC”) configured to receive an external audio signal when the device 2000 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in the memory 2004 or transmitted via the communication component 2016. In some embodiments, the audio component 2010 further includes a speaker to output audio signals.
The I/O interface 2012 provides an interface between the processing component 2002 and peripheral interface modules, the peripheral interface modules being, for example, a keyboard, a click wheel, buttons, and the like. The buttons may include, but are not limited to, a home button, a volume button, a starting button, and a locking button.
The sensor component 2014 includes one or more sensors to provide status assessments of various aspects of the device 2000. For instance, the sensor component 2014 may detect an open/closed status of the device 2000, relative positioning of components (e.g., the display and the keypad, of the device 2000), a change in position of the device 2000 or a component of the device 2000, a presence or absence of user contact with the device 2000, an orientation or an acceleration/deceleration of the device 2000, and a change in temperature of the device 2000. The sensor component 2014 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor component 2014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 2014 may also include an accelerometer sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 2016 is configured to facilitate communication, wired or wirelessly, between the device 2000 and other devices. The device 2000 can access a wireless network based on a communication standard, such as Wi-Fi, 2G, 3G, LTE or 4G cellular technologies, or a combination thereof. In an exemplary embodiment, the communication component 2016 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 2016 further includes a near field communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on a radio frequency identification (RFID) technology, an infrared data association (IrDA) technology, an ultra-wideband (UWB) technology, a Bluetooth (BT) technology, and other technologies.
In exemplary embodiments, the device 2000 may be implemented with one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components, for performing the above described methods.
In exemplary embodiments, there is also provided a non-transitory computer-readable storage medium such as memory 2004 including instructions executable by the processor 2020 in the device 2000, for performing the above-described navigation methods for a terminal device. For example, the non-transitory computer-readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storage device, and the like.
The device 2100 may also include a power supply 2126 for device 2100, a wired or wireless network interfaces 2150 for connecting the device 2100 to network or to a terminal device such as the device of 2000 in
A non-transitory computer readable storage medium having stored therein instructions is further disclosed. The instructions, when executed by the processor of the device 2010, cause the device 2010 to perform the above described video navigation methods for a server. For example, the method may include obtaining navigation parameters entered by a user, the navigation parameters include navigation starting point and navigation ending point; location shooting for road, stop shooting when arrived the navigation ending point to obtain a shooting video; associating the navigation parameters with the shooting video to obtain a navigation video; uploading the navigation video to network. The method may further include: recording driving speed; calculating an average driving speed based on the driving speed. The processing of associating the navigation parameters with the shooting video above may include: taking the average driving speed as a navigation parameter to associate it with the shot video.
A non-transitory computer readable storage medium having stored therein instructions that, when executed by the processor of the device 2000 or the device 2100, causes the device 2000 or the device 2100 to perform the above described method for navigating, including: obtaining navigation request information; determining a navigation video matching with the navigation request information, wherein the navigation video is a video obtained from location shooting of a road; navigating based on the navigation video. The navigation request information may include navigation parameters of a navigation starting point and a navigation ending point. The processing of determining the navigation video matching with the navigation request information includes: obtaining navigation starting points and navigation ending points of navigation videos; determining a navigation video, both the navigation starting point and the navigation ending point of which are the same as those of the navigation request information as the navigation video matching with the navigation starting point and the navigation ending point.
Alternatively, the navigation request information may include navigation parameters of a navigation starting point and a navigation ending point. The processing of determining the navigation video matching with the navigation request information may include: calculating a navigation route based on the navigation starting point and the navigation ending point; querying for the navigation video which including the navigation route; cutting out a navigation video corresponding to the navigation route from the navigation video including the navigation route, and determining the navigation video corresponding to the navigation route as the navigation video matching with the navigation starting point and the navigation ending point.
Alternatively, the navigation request information may include navigation parameters of a navigation starting point and a navigation ending point. The processing of determining the navigation video that matches the navigation request information includes: calculating a navigation route based on the navigation starting point and the navigation ending point; dividing the navigation route into at least two navigation sub-routes; querying for the navigation videos corresponding to the navigation sub-routes respectively; splicing the navigation videos corresponding to the navigation sub-routes to obtain the navigation video matching with the navigation starting point and the navigation ending point.
Alternatively, the navigation request information may further include at least one of the following navigation parameters: a regional name, a road name, a season, a weather, an average driving speed, a driving distance. In the case that at least two navigation videos matching with the navigation starting point and the navigation ending point are obtained by querying, the processing of determining a navigation video matching with the navigation request information may further include: obtaining the navigation parameters of the navigation videos; calculating the matching degrees of the navigation parameters of the navigation request information with respect to the navigation parameters of the navigation videos; determining a navigation video whose matching degree is the largest as the navigation video matching with the navigation request information, or determining navigation videos whose matching degrees are larger than a preset threshold as navigation videos matching with the navigation request information, or determining a predetermined number of navigation videos whose matching degrees are relatively high as navigation videos matching with the navigation request information.
In another embodiment, navigating according to the navigation video when the method is applied to a network may further include sending the navigation video to a terminal for playing.
In another embodiment, navigating according to the navigation video when the method is applied to a terminal may further include playing the navigation video.
In another embodiment, wherein when at least two navigation videos matching with the navigation request information are determined, the processing of navigating based on the navigation video may include: arranging and displaying the navigation videos matching with the navigation request information; receiving an operation for selecting one of the navigation videos from a user; playing the navigation video.
In another embodiment, the processing of navigating based on the navigation video may include: obtaining a present driving speed; determining a playing speed of the navigation video based on the present driving speed; playing the navigation video at the playing speed.
In another embodiment, when the method is applied to terminal, the method may include: synchronizing navigation data from a network, wherein the navigation data include the navigation video; storing the navigation data in a local navigation database. The processing of determining the navigation video matching with the navigation request information includes: querying for the navigation video matching with the navigation request information from the local navigation database.
The illustrations of the embodiments described herein are intended to provide a general understanding of the structure of the various embodiments. The illustrations are not intended to serve as a complete description of all of the elements and features of apparatus and systems that utilize the structures or methods described herein. Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following the general principles thereof and including such departures from the present disclosure as come within known or customary practice in the art. It is intended that the specification and examples are considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims in addition to the disclosure.
It will be appreciated that the inventive concept is not limited to the exact construction that has been described above and illustrated in the accompanying drawings, and that various modifications and changes can be made without departing from the scope thereof. It is intended that the scope of the invention only be limited by the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201510609516.0 | Sep 2015 | CN | national |
