The present disclosure relates generally to road markers that connect to one another and to a vehicle or network, in particular, road markers that indicate and broadcast to the vehicle or network an area of interest.
Road obstacles, such as road work zones, traffic accidents, and disabled vehicles may be visually indicated by one or more road cones, flashing lights, signs, or flares. Often, visual notification of traffic accidents or disabled vehicles may be located in close proximity to the incident, providing little warning to vehicle drivers as they approach the scene of the accident or disabled vehicle. Road work zones may be visually indicated by temporary road signs, or even portable signs with flashing lights, sometimes located just a few hundred yards before the zone. In some major highways, large displays may display text that indicates traffic conditions, and even if there is a traffic accident or road work zone.
Recent technology has become available in the way of mobile apps, or in some cases, apps that run in automobile navigation systems, that provide messages concerning traffic conditions, accidents, disabled vehicles, road work zones, and may even provide a warning that a police vehicle is located in a certain area. One mobile app works by way of an initial user(s) that first spots an incident and sends out a message via the mobile app to inform others of the incident. The location of the incident may be obtained based on the current location of the informant mobile device when the notification is entered into the app. The mobile app requires that information concerning an incident be accurately entered. It is possible that the exact location may not have been entered at the time of first entry of information about an incident. Also, drivers of vehicles that do not have access to the mobile app will not be informed of an incident that other drivers have spotted, or drivers without the app will not be able to inform other drivers of the incident.
There is a need for an approach to informing drivers of vehicles of incidents, such as road work zones, automobile accidents, disabled vehicles, sections of road that may be impassible due to floods, large pot holes, etc., or any other reason that a driver should be warned about traffic conditions in a certain area. There is a need to notify drivers of vehicles of incidents in a certain area at a time that the incident is marked, rather than as others have already come into view of the incident. There is a need for dynamically updating a boundary around a certain incident in the event that boundary of the incident changes over time, such as a moving road work zone. These and other problems are addressed by the present disclosure.
According to an embodiment of the present disclosure, there is provided a method of dynamically communicating information of an area of interest. The method including powering on and initiating communications in at least one marker device, determining a peripheral shape indicated by the at least one marker device as the information of the area of interest, and communicating the information from the at least one marker device.
Further, according to an embodiment of the present disclosure, there is provided an apparatus for dynamically communicating information of an area of interest, the apparatus including at least one road marker device including processing circuitry configured to determine a peripheral shape indicated by the at least one road marker device as the information of the area of interest, and communicate the information from the at least one marker device.
The foregoing “Background” description is for the purpose of generally presenting the context of the disclosure. Work of the inventors, to the extent it is described in this background section, as well as aspects of the description which may not otherwise qualify as prior art at the time of filing, are neither expressly or impliedly admitted as prior art against the present invention.
A more complete appreciation of the disclosure and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
The description set forth below in connection with the appended drawings is intended as a description of various embodiments of the disclosed subject matter and is not necessarily intended to represent the only embodiment(s). In certain instances, the description includes specific details for the purpose of providing an understanding of the disclosed embodiment(s). However, it will be apparent to those skilled in the art that the disclosed embodiment(s) may be practiced without those specific details. In some instances, well-known structures and components may be shown in block diagram form in order to avoid obscuring the concepts of the disclosed subject matter.
As used herein any reference to “one embodiment” or “some embodiments” or “an embodiment” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment. Conditional language used herein, such as, among others, “can,” “could,” “might,” “may,” “e.g.,” and the like, unless specifically stated otherwise, or otherwise understood within the context as used, is generally intended to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. In addition, the articles “a” and “an” as used in this application and the appended claims are to be construed to mean “one or more” or “at least one” unless specified otherwise.
Furthermore, the terms “approximately,” “proximate,” “minor,” and similar terms generally refer to ranges that include the identified value within a margin of 20%, 10% or preferably 5% in certain embodiments, and any values therebetween.
Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout several views, the following description relates to a dynamic system of road cones or other indicia that automatically generate a digital boundary around a location of interest by placement and connection of road cones having communications capability.
A road marker 111 may take any of various forms, such as a road cone, a puck, a barricade, a fence, or other object that can contain a small computer and/or communications device, and that preferably can withstand various weather conditions. In some embodiments, the road marker 111 should also be visible to drivers of automotive vehicles. In some embodiments, a road marker 111 may itself be a display device or lighting device. In some embodiments, a road marker 111 may be a ruggedized transceiver device or computer device contained in a housing that is made to withstand weather conditions and that is detected through communication with a sensor, such as a radio wave communications device.
In this disclosure, the term automotive vehicle applies to automobiles, trucks, buses, motor cycles and tractor trailers. An automotive vehicle may include autonomous or self-driving vehicles. Over time, most automotive vehicles will be equipped with sensors, communications functions and processing functions that augment or replace operations performed by a vehicle driver. For example, most automotive vehicles have built-in navigation functions or at least messaging functions, in which information about traffic conditions may be received and either displayed or spoken.
Automotive vehicles 130 may have built-in smart display devices 131. A built-in smart display device 131 may provide an interactive interface for access to various pre-programmed applications, such as radio and cabin environment control, that have previously been available by way of knobs and levers, and newer functions such as navigation, GPS, audio, phone connectivity, fuel economy, traffic, and weather, by way of a suite of apps. Because the smart display device can provide information on the status of the vehicle, such as fuel economy, as well as entertainment, such as radio, the smart display device may be part of an infotainment system. An example of an infotainment system is Toyota Entune®. In some cases, many of the same functions available in the smart display device are also available for a mobile device. Toyota for example offers an Entune® app.
A built-in display device 131 may be part of an in-vehicle computer system, or infotainment system. The infotainment system may be a computer-based system that includes communications circuitry for short range communications. Examples of short range communications may include WiFi®, Bluetooth®, a cellular network, direct transmission such as millimeter wave, ultrasonic, or laser. One or more of these communications circuitry may be used for external communication with a server computer system 120. The server computer system 120 may be the Internet, or some other network-based computer system.
Although the system of
An in-vehicle mobile device may be provided with a mobile app that enables the in-vehicle mobile device to perform some of the same functions as a built-in display 131. In an exemplary aspect, the in-vehicle mobile device may be used as the display device in place of a built-in display device 131. In some embodiments, the vehicle is not equipped with a built-in display device 131, and the in-vehicle mobile device is provided as the sole interactive display device for the vehicle. The in-vehicle mobile device may be any of a number of types of mobile devices, including, but not limited to, a smartphone, a tablet, a laptop computer, or other computing device having a display and a means for interacting with the display, and a connection means to enable communications with the vehicle and/or with an external computer system 120. The means for interacting with the display may be a touchscreen or a pointing device, and may also include technologies such as eye gaze direction.
In embodiments of the present disclosure, an app may be provided for the vehicle infotainment system, or a comparable app may be provided for a mobile device to offer alert-related services. In some embodiments, the mobile app may be used to access services without being connected to the vehicle, or being physically within the vehicle compartment, or proximate to the vehicle. In some embodiments, the mobile device is associated with more than one vehicle, and the mobile device may be used to select a particular vehicle in order to use the app for a particular vehicle. In some embodiments, either the mobile app or the built-in display may be used for alert-related services.
Further, automotive vehicles may be provided with a utility application, background daemon, or component of an operating system, or combination thereof, executing in conjunction with CPU 200 and an operating system such as LINUX®, Microsoft Windows®, Android, iOS, BlackBerry and other operating systems known to those skilled in the art.
In order to achieve the computer system 232, the hardware elements may be realized by various circuitry elements, known to those skilled in the art. For example, CPU 200 may be a quad-core ARM processor from Qualcomm, or an Intel Atom processor, or may be other processor types that would be recognized by one of ordinary skill in the art. The CPU 200 may also include a Cache 206 and a GPU 210. Special purposes devices include a timer 202, a boot ROM 204, power management and touch screen control 242, flash 254 and an associated flash controller 252. Alternatively, the CPU 200 may be implemented on an FPGA, ASIC, PLD or using discrete logic circuits, as one of ordinary skill in the art would recognize. Further, CPU 200 may be implemented as multiple processors cooperatively working in parallel to perform the instructions.
The computer 232 in
The computer system 232 may further include a video processor 212 and a LCD Video interface 214. The computer system 232 may include a touch screen 244, and buttons 246. In the case of a built-in smart display device, the computer system 232 may be connected to one or more cameras 226 mounted to the automotive vehicle 130. In other mobile devices, at least one camera 226 may be a component of the mobile device 110.
Communication between each road marker 111 may be by short range wireless communications or by a wired connection. In some embodiments, the road markers 111 may be part of a larger communications network that provides information to an external computer system. Examples of short range communications may include WiFi®, Bluetooth®, a cellular network, direct transmission such as millimeter wave, ultrasonic, or laser. One or more of these communications circuitry may be used for external communication as well. In the case of a communications network, the road markers 111 may be connected to an external computer system through WiFi® wireless communication or cellular communication. The road markers 111 may be interconnected to each other through Bluetooth Low Energy (LE) and Ultra-Wide Band (UWB) communication. UWB is a radio technology for short-range, high-bandwidth (greater than 500 MHz) communications. In some embodiments, road markers 111 include communication transceivers for the associated communications protocol. In some embodiments, at least one road marker 111 also includes a communications processor for each supported communications protocol. In one embodiment, the road markers 111 include a Bluetooth low energy communications processor and transceiver.
In some embodiments, one or more of the road markers may be equipped with a computer. The computer may be a programmable computer or computation circuitry for performing certain specialized functions. One specialized function is calculation of a shape of a boundary of an area of interest. This function will be explained in more detail below.
Although the description is of a particular circuit board, it should be understood that other computer system boards may be used. Processing circuitry 301 may vary based on the number of processing cores, size of non-volatile memory, the size of data memory, as well as whether or not it includes an A/D converter 309 or D/A converter.
In some embodiments, one or more of a group of road markers 111 may be placed in a power-save setting, such that various features of the road marker are disabled to reduce a power drain. For example, in a system having four road marker indicating the location of a crosswalk, only one road marker may be placed in a connection mode such that it makes a connection with automotive vehicles or the network, and the remaining three road markers may be placed in a low-power mode wherein the three remaining road markers only interact with the fourth road cone in connection mode. The system of road markers may be configured to automatically adjust power drain settings in order to maximize the energy stores on hand. In such embodiments, switching from a power-save mode to a full communication mode may occur by transmission of a request for communication signal to a marker in connection mode. In some embodiments, road markers 111 may be turned off by way of a switch, or automatically when the road marker 111 is lifted off of the ground.
In some embodiments, sensors may be attached to the circuit board by way of the Digital IN 315 or Analog IN 317, and may include an accelerometer to detect that a road marker has been moved, or knocked over, a radar to detect a distance to a moving vehicle, a camera to take pictures of vehicles that violate or approach to near an area of interest.
In some embodiments, an infrared (IR) reflective coating or partial coating may be applied to the road markers. Such a coating may be used to trigger an IR camera of the automotive vehicle to cause the vehicle to begin looking for an area of interest in the vicinity of the vehicle.
The road markers 111 may indicate and broadcast an area of interest. A single road marker 111 may operate in a mode, referred to as a radius mode, to broadcast a stored predetermined shape such as a circle or a square of certain dimensions. In some embodiments, other road markers 111 may together determine the physical size of the area of interest, and the single road marker 111 may broadcast a size of the predetermined shape based on the physical locations of the other road markers 111. For example, a radius of a circle may be determined based on a distance between two road markers 111, the radius being half of this distance. In a similar manner, dimensions of a square area of interest may be determined based on a distance between two road markers 111. A location of the square area of interest may be based on a third road marker 111 that indicates a second side of the square.
As an alternative to radius mode, in a fence mode two or more road markers may mark the extent of an area of interest. Two road markers may be used to form a fence line that indicates an extent of an area of interest and a line that vehicles should not cross. Three or more road markers may form a boundary of an area of interest.
In the case of three or more road markers, a shape formed by the road markers may be determined based on the distance between road markers. Distance between road markers may be calculated by time-of-flight (ToF) communication between road markers. ToF measurement involves transmitting an identifiable, unique bitstream from the master transceiver, echoing it back either passively or actively from the slave transceiver, and measuring either the time taken for the round trip, or for shorter distances, phase differences between outgoing and incoming signals. Distance is determined from the period of time taken to transmit a signal, which may include processing time. The master road marker may determine a shape based on the number of vertices and the distance between pairs of vertices (road markers). For example, given three road markers, the distance between pairs of road markers can be used to calculate the angle between lines, which defines the shape and size of the triangle.
In one embodiment, the various tiers of actions may be implemented using cost maps. In this embodiment, each tier may have a certain risk level. When an automotive vehicle enters an area defined by a tier, the risk level will change to the level corresponding to the respective tier.
In some embodiments, the areas of interest may be programmed into a road marker that includes a programmable computer using a wireless device, such as a handheld mobile device 110. Programming may be performed by uploading a configuration file into a memory of the controller of a road marker, may be performed by transmitting certain settings as attribute-value pairs, or may be performed by directly accessing and modifying code stored in memory of the road marker controller. The area of interest may be labeled and various settings may be programmed for the area of interest such as the level of sharing on the network or with vehicles. For example, the area of interest may be public, private, or disclosed to only certain entities on the network.
The road markers may be programmed to operate in additional modes.
A timing mode may be set in which the road markers 111 indicate a shape of an area of interest based on a schedule. The road markers 111 may be controlled to turn on and off at scheduled dates and/or times.
Another type of mode may include a Virtual Reality mode. A Virtual Reality mode may be set in which information provided from road markers may be used in virtual reality or augmented reality display. For example, the indication of an area of interest may be displayed in a vehicle smart display 131 by augmenting a display of an actual view of an area with a computer generated boundary that portrays a boundary of the area of interest. As another example, the area of interest and associated boundary may be computer generated as a virtual reality scene.
The area of interest may indicate an area that the vehicle should know of in order to take one or more actions with respect to the area. The information about the area of interest may be broadcast to automotive vehicles 130 in a vicinity of the area of interest 105, or may be transmitted to a network 120. For example, if construction is taking place within one lane of a two lane road, the road markers 111 could be placed around the area of construction to automatically transmit to the network 120 information to indicate the location of the construction. The information that is broadcast to the vehicles 130 directly or transmitted to the network 120 enables automotive vehicles 130 in the area to initiate one or more actions regarding the area of interest 105 or to reroute to a route that avoids the area of interest all together.
In some embodiments, the road markers 111 may broadcast the location of an area of interest to one or more static compute modules in the vicinity of the area of interest for transmission to a network 120 or vehicles 130 connected to a network. For example, if the road markers 111 are used to mark an area of interest in an intersection, the road markers 111 may broadcast the location of the area of interest to a compute module at the intersection for transmission to a wider network including automotive vehicles and other intersections.
In one embodiment, a vehicle may be required to be registered with a service that is accessible through the network 120. For example, a vehicle may be registered with a certain cloud service. Examples of cloud services that are related to travel and navigation include Google Maps, Apple Maps, Waze and other map services.
In some embodiments, multiple road markers may connect to one another automatically via any particular frequency of radio transmission using an ultra-wide band (UWB) connection. Such a connection may provide for high data transfer rates but have a relatively low energy consumption rate. The high data rates may allow transmission of detailed information about an area of interest. The relatively short range of UWB may not affect applications, because the areas of interest demarked by road markers may be relatively small.
In some embodiments, road markers may form a mesh network, in which road markers communicate with each other to determine distance between each pair of road markers. One or more of the road markers may calculate a shape based on the distance between the road markers. Once shape is established, the one or more road markers may communicate with a network 120 or vehicle(s) 130 to report the shape.
In some embodiments, certain road markers may be implemented as a primary device(s), which may be a road marker that has a full complement of hardware (controller and sensors). The road markers that are primary devices may be identified by, for example, a certain color or label (e.g., a blue road marker). In one embodiment, the primary device having a full complement of hardware may be located in a vehicle, or other external device. The road markers may include only minimal hardware (communications module) that can perform distance determination and external communication. If all road markers are primary devices, each road marker may be equipped with a complement of inexpensive hardware components.
In some embodiments, the operation of road markers is fully automatic. The road markers may power on when placed on the ground and may communicate with one another to determine distances and a shape of their arrangement, and may automatically begin broadcasting the shape indicating the area of interest.
In S705 (YES), if a road marker is set for a predetermined shape, in S707, one road marker 111 may be placed in the vicinity of the area of interest and may communicate the shape indicating the area of interest. In some embodiments, multiple road markers may be arranged according to the predefined shape. If automotive vehicles that are expected to approach the area of interest are autonomous vehicles or vehicles equipped with certain sensors, it may not be necessary to arrange a full set of road markers to visually indicate an area of interest. For example, two road markers 111 may be arranged to indicate a length of one side of a triangle or square shape, and the road markers may communicate the predefined shape and dimensions based on the two road markers 111. In some embodiments, once the road markers 111 are positioned, communications may be initiated in the road markers 111.
In fully automated road markers, in S709, placement of road markers on the ground may cause initiation of processing, including powering on, and initiating communications. In S711, road markers 111 may begin communication with other road markers 111 (for example in mesh communications) to determine distances and shape of the arrangement of markers. In S713 (YES), if the road markers are set for tiers, in S715, messages and commands will be modified according to settings for tiers. Once a shape of an arrangement of road markers is determined, and any other settings are made including tiers, in S717, one or more road markers may begin communicating the shape and location of the area of interest. If the road markers 111 are equipped for broadcast communications (NO in S717), in S721, the shape (including dimensions) and location of the area of interest may be broadcast to oncoming automotive vehicles 130. In some embodiments (YES in S717), in S719, the road markers 111 may communicate the shape (including dimensions) and location of an area of interest by transmitting the information to a network 120. In some embodiments, in the road markers 111 may communicate shape and location information both by broadcasting the information and by transmitting the information to a network 120.
Although the road markers 111 may communicate shape (including dimensions) and location information for an area of interest, other information may be communicated as well. For example, a message may include information about the type of area of interest, such as road work zone, disabled vehicle, traffic accident, or in the case of crosswalk mode, crosswalk. A message may include information about a time schedule that the area of interest will be in effect.
Numerous modifications and variations are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.
Thus, the foregoing discussion discloses and describes merely exemplary embodiments of the present invention. As will be understood by those skilled in the art, the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Accordingly, the disclosure of the present invention is intended to be illustrative, but not limiting of the scope of the invention, as well as other claims. The disclosure, including any readily discernible variants of the teachings herein, defines, in part, the scope of the foregoing claim terminology such that no inventive subject matter is dedicated to the public.
Number | Name | Date | Kind |
---|---|---|---|
4359733 | O'Neill | Nov 1982 | A |
4687369 | McDonald | Aug 1987 | A |
5129605 | Burns | Jul 1992 | A |
5437422 | Newman | Aug 1995 | A |
5554982 | Shirkey | Sep 1996 | A |
5793329 | Nakada | Aug 1998 | A |
5823481 | Gottschlich | Oct 1998 | A |
6371416 | Hawthorne | Apr 2002 | B1 |
6853888 | Kane | Feb 2005 | B2 |
7142982 | Hickenlooper | Nov 2006 | B2 |
7397390 | Dipiazza | Jul 2008 | B2 |
7859428 | Boss et al. | Dec 2010 | B2 |
9043124 | Tran | May 2015 | B1 |
9127420 | Ko | Sep 2015 | B2 |
9478129 | Kothari | Oct 2016 | B1 |
9898759 | Khoury | Feb 2018 | B2 |
9902411 | Bartek | Feb 2018 | B2 |
9930120 | Gutierrez | Mar 2018 | B2 |
9959754 | King | May 2018 | B1 |
20040130463 | Bloomquist | Jul 2004 | A1 |
20070085734 | Whitehead | Apr 2007 | A1 |
20130276315 | Kahle | Oct 2013 | A1 |
20140368373 | Crain | Dec 2014 | A1 |
20150089606 | Wang | Mar 2015 | A1 |
20150266471 | Ferguson | Sep 2015 | A1 |
20160076207 | Moran | Mar 2016 | A1 |
20160087486 | Pogorelik | Mar 2016 | A1 |
20170088046 | Denny | Mar 2017 | A1 |
20180038939 | Bruemmer | Feb 2018 | A1 |
20180142436 | Agajanian | May 2018 | A1 |
Number | Date | Country | |
---|---|---|---|
20200118431 A1 | Apr 2020 | US |