The present disclosure relates generally to visualization of alerts within a smart city. More particularly, the present disclosure relates to visualization of alerts within a smart city along with an indication of the asset providing the alert.
Smart cities can deploy a substantial number of assets such as security cameras and other security devices in order to monitor activity within the smart city. In many cases, a smart city may include a monitoring service having a video wall. Various alerts, video streams and the like may be displayed on the video wall. It will be appreciated that due to the large number of assets such as security cameras and other security devices, it can be difficult to quickly ascertain whether a particular alert represents a minor problem that may present a nuisance, or a major problem that may present a major disruption to life in the smart city. What would be desirable are methods for providing a map-based visualization of alerts along with the assets providing the alerts and a relative priority of each alert.
The present disclosure relates generally to visualization of alerts within a geographical region, such as a smart city, a campus, a facility and/or a building. In an example, a method provides for monitoring a geographic region for alerts that are generated by a plurality of assets that are disposed within the geographic region. The method includes receiving, at a server or other device, information from the plurality of assets that are disposed within the geographic region over time. The information includes indications of alerts generated by one or more of the plurality of assets that are disposed within the geographic region, and the plurality of assets include assets of two or more different asset types. The server or other device generates a map of the geographic region that includes a map representation of the geographic region and a plurality of asset icons each positioned at a location on the map representation that corresponds to a physical location of the corresponding asset in the geographic region Each of the plurality of asset icons visually identify the asset type of the corresponding asset from the two or more different asset types. The map includes one or more alert icons each corresponding to an active alert generated by one of the plurality of assets in the geographic region, each of the one or more alert icons positioned at a location adjacent to or partially overlapping the asset icon of the asset that generated the active alert. At least some of the one or more alert icons visually identify an alert type of the corresponding active alert from two or more different alert types and at least some of the one or more alert icons visually identify a priority level of the corresponding active alert from two or more different priority levels. The server or other device displays the generated map on a display. The server or other device receives updated information from the plurality of assets over time, updates the map resulting in an updated map, and displays the updated map on the display.
In another example, a non-transient, computer-readable storage medium has instructed stored thereon. When the instructions are executed by one or more processors, the one or more processors are caused to receive information from the plurality of assets that are disposed within a geographic region over time, and to generate a map of at least part of the geographic region. The information includes indications of alerts generated by one or more of a plurality of assets that are disposed within the geographic region. The plurality of assets include assets of two or more different asset types. The map of the geographic region includes a plurality of asset icons each positioned at a location on the map that corresponds to a physical location of the corresponding asset in the geographic region. Each of the plurality of asset icons visually identifies the asset type of the corresponding asset from the two or more different asset types. The map of the geographic region includes one or more alert icons each corresponding to an active alert generated by one of the plurality of assets in the geographic region. Each of the one or more alert icons positioned at a location adjacent to or partially overlapping the asset icon of the asset that generated the active alert. The one or more processors are caused to display the generated map on a display. The one or more processors are caused to receive updated information from the plurality of assets over time, update the map resulting in an updated map, and display an updated map on the display.
Another example provides a method of monitoring a geographic area for alerts. The geographic area is divided into a plurality of jurisdictions with a plurality of assets disposed within each of the plurality of jurisdictions. The method includes receiving, at a server or other device, information from each of the plurality of assets that are disposed within each of the plurality of jurisdictions. The information includes indications of alerts generated by one or more of the plurality of assets that are disposed within each of the plurality of jurisdictions. The server or other device generates, for each of the plurality of jurisdictions, an aggregate representation of the alerts generated by one or more of the plurality of assets that are disposed within the corresponding jurisdiction of the plurality of jurisdictions. The server or other device generates and displays a map of the geographic area that includes the aggregate representation of the alerts generated by the one or more of the plurality of assets that are disposed within each jurisdiction of the plurality of jurisdictions. An indication that the user desires additional information pertaining to one of the aggregate representations is accepted from a user. In some cases, in response to accepting from the user the indication that the user desires additional information pertaining to one of the aggregate representations, the server or other device displays one or more screens that provide additional information pertaining to one of the aggregate representations, wherein the additional information includes asset icons representing each of the assets within the jurisdiction as well as related alert icons representing each of the alerts generated by each of the assets within the jurisdiction.
The preceding summary is provided to facilitate an understanding of some of the innovative features unique to the present disclosure and is not intended to be a full description. A full appreciation of the disclosure can be gained by taking the entire specification, claims, figures, and abstract as a whole.
The disclosure may be more completely understood in consideration of the following description of various examples in connection with the accompanying drawings, in which:
While the disclosure is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the disclosure to the particular examples described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure.
The following description should be read with reference to the drawings, in which like elements in different drawings are numbered in like fashion. The drawings, which are not necessarily to scale, depict examples that are not intended to limit the scope of the disclosure. Although examples are illustrated for the various elements, those skilled in the art will recognize that many of the examples provided have suitable alternatives that may be utilized.
All numbers are herein assumed to be modified by the term “about”, unless the content clearly dictates otherwise. The recitation of numerical ranges by endpoints includes all numbers subsumed within that range (e.g., 1 to 5 includes 1, 1.5, 2, 2.75, 3, 3.80, 4, and 5).
As used in this specification and the appended claims, the singular forms “a”, “an”, and “the” include the plural referents unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.
It is noted that references in the specification to “an embodiment”, “some embodiments”, “other embodiments”, etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is contemplated that the feature, structure, or characteristic may be applied to other embodiments whether or not explicitly described unless clearly stated to the contrary.
In the example shown, the monitoring system 10 includes a Command Center Platform (CCP) server 12. The CCP server 12 may represent a single server. The CCP server 12 may represent a plurality of linked servers that may be at a central location or may be distributed throughout the smart city. The CCP server 12 may represent a cloud-based server. The CCP server 12 may be configured to receive information such as sensor signals, videos streams, and the like, from a plurality of assets that are disposed about the smart city (or other geographic region) and are operably coupled with the CCP server 12.
Examples of assets include video cameras 14 and sensors 16. In some cases, at least some of the video cameras 14 and/or the sensors 16 may communicate wirelessly with the CCP server 12. At least some of the video cameras 14 may be operably coupled to a wired network running through the smart city. The video cameras 14 may provide live feeds of video streams from each of the video cameras 14 to the CCP server 12. The CCP server 12 may store these video streams over time, for subsequent use and reference. At least some of the sensors 16 may provide periodic sensor signals to the CCP server 12. At least some of the sensors 16 may provide continuous or near-continuous sensor signals to the CCP server 12. In some cases, there may be intervening components between the video cameras 14 and/or sensors 16 and the CCP server 12. These intervening components may buffer, process, filter, add metadata, and/or otherwise condition and/or process the video camera 14 and/or sensor 16 data before providing the original and/or processed data to the CCP server 12.
In the smarty city application, the sensors 16 may individually represent any of a variety of different types of sensors, including but not limited to noise sensors, hazardous material sensors, parking sensors, lighting sensors and the like. Garbage bin sensors 18 may, for example, provide the CCP server 12 with an indication that a particular garbage bin is full and needs to be emptied. Alternatively, in some cases, a garbage bin sensor 18 may inform the CCP server 12 that a particular garbage bin is not filling up as fast as expected, and that a planned emptying of the particular garbage bin can be delayed.
The monitoring system 10 includes a video display wall 20. While illustrated as a single monitor, the video display wall 20 may include a large number of monitors that are wall-mounted adjacent to one another, so that a user is able to simultaneously view a large number of photos, video streams, social monitoring feeds, sensor data and the like. In some cases, the video display wall 20 may be used to display a geographic map that is generated by the CCP server 12 and that includes icons indicating the relative positions of a number of assets such as but not limited to the video cameras 14, the sensors 16 and the garbage bin sensors 18 as well as including icons that indicate particular alarms that are being raised by at least some of those assets. In some cases, the CCP server 12 may be provided with the location of each of the assets so that the assets can be accurately displayed on the geographic map. This may include receiving the latitude and longitude of each asset, sometimes during initial commissioning of the monitoring system 10. This may include receiving GPS (global positioning system) coordinates for each of the assets, for example.
In
In some cases, the map of the geographic region includes a map representation of the geographic region, as indicated at block 44a. The map of the geographic region may include a plurality of asset icons each positioned at a location on the map representation that corresponds to a physical location of the corresponding asset in the geographic region. Each of the plurality of asset icons visually identifies the asset type of the corresponding asset from the two or more different asset types, as indicated at block 44b. The map of the geographic region may include one or more alert icons each corresponding to an active alert generated by one of the plurality of assets in the geographic region. In the example shown, each of the one or more alert icons is positioned at a location adjacent to or partially overlapping the asset icon of the asset that generated the active alert, as indicated at block 44c. At least some of the one or more alert icons visually identify an alert type of the corresponding active alert from two or more different alert types, as indicated at block 44d. At least some of the one or more alert icons visually identifying a priority level of the corresponding active alert from two or more different priority levels, as indicated at block 44e.
The illustrative method 40 includes the server displaying the generated map on a display, as indicated at block 46. The server receives updated information from the plurality of assets over time, updates the map resulting in an updated map, and displays an updated map on the display, as indicated at block 48. In some cases, the map may further include an alert count icon for each of the plurality of assets that have a plurality of active alerts, the alert count icon visually identifying a count of the active alerts for the corresponding asset. Each of the alert count icons may be positioned at a location adjacent to or partially overlapping the alert icon of the corresponding asset.
In some cases, the map of the geographic region includes a map representation of the geographic region. The map of the geographic region may include a plurality of asset icons each positioned at a location on the map representation that corresponds to a physical location of the corresponding asset in the geographic region. Each of the plurality of asset icons visually identify the asset type of the corresponding asset from the two or more different asset types. The map of the geographic region may include one or more alert icons each corresponding to an active alert generated by one of the plurality of assets in the geographic region. Each of the one or more alert icons positioned at a location adjacent to or partially overlapping the asset icon of the asset that generated the active alert. At least some of the one or more alert icons visually identify an alert type of the corresponding active alert from two or more different alert types. At least some of the one or more alert icons visually identifying a priority level of the corresponding active alert from two or more different priority levels. The illustrative method 60 includes the server displaying the generated map on a display, as indicated at block 66. The server receives updated information from the plurality of assets over time, updates the map resulting in an updated map, and displays an updated map on the display, as indicated at block 68.
In some cases, the illustrative method 60 may further include the server receiving a user selection of one of the alert icons, and in response, the server displays additional information about the active alert that corresponds to the selected alert icon on the display, as indicated at block 70. When the selected alert icon correspond to an alert generated by a video camera asset, and the additional information may include a video stream captured by the video camera asset. The additional information may include information from the asset that generated the alert that corresponds to the selected alert icon, as well as information from one or more assets that neighbor the asset that generated the alert that corresponds to the selected alert icon. In some cases, the selected alert icon may correspond to an alert generated by a video camera asset, and the one or more assets that neighbor the asset that generated the alert that corresponds to the selected alert icon may include video camera assets and the additional information may include a video stream captured by the video camera asset as well as a video stream captured by each of the neighboring video camera assets. In some cases, the video stream captured by the video camera asset as well as the video streams captured by the neighboring video camera assets may be displayed in adjacent panels on the display.
In some cases, the map of the geographic region includes a map representation of the geographic region. The map of the geographic region may include a plurality of asset icons each positioned at a location on the map representation that corresponds to a physical location of the corresponding asset in the geographic region. Each of the plurality of asset icons visually identify the asset type of the corresponding asset from the two or more different asset types. The map of the geographic region may include one or more alert icons each corresponding to an active alert generated by one of the plurality of assets in the geographic region. Each of the one or more alert icons positioned at a location adjacent to or partially overlapping the asset icon of the asset that generated the active alert. At least some of the one or more alert icons visually identify an alert type of the corresponding active alert from two or more different alert types. At least some of the one or more alert icons visually identify a priority level of the corresponding active alert from two or more different priority levels. The illustrative method 80 includes the server displaying the generated map on a display, as indicated at block 86. The server also receives updated information from the plurality of assets over time, updates the map resulting in an updated map, and displays an updated map on the display, as indicated at block 88.
In some cases, the method 80 may further include the server receiving a zoom out command from a user, as indicated at block 90. In response, the server may display a zoomed out representation of the map, as indicated at block 92. The server may generate an aggregate representation of the alerts generated by one or more of the plurality of assets that are disposed within at least part of the geographic region, as indicated at block 94. The server may replace the plurality of asset icons and the one or more alert icons for the at least part of the geographic region with the aggregate representation of the alerts, as indicated at block 96. The aggregate representation of the alerts may include a total number of alerts that correspond to the at least part of the geographic region. In some cases, the aggregate representation of the alerts may include a total number of alerts that correspond to the at least part of the geographic region for each of the two or more different priority levels. At least part of the geographic region may be predefined by a jurisdictional boundary.
The server generates a map of the geographic area that includes the aggregate representation of the alerts generated by the one or more of the plurality of assets that are disposed within each jurisdiction of the plurality of jurisdictions, as indicated at block 106. The generated map is displayed on a display, as indicated at block 108. An indication that the user desires additional information pertaining to one of the aggregate representations is accepted from the user, as indicated at block 110. In some cases, in response to accepting from the user the indication that the user desires additional information pertaining to one of the aggregate representations, the server displaying one or more screens that provide additional information pertaining to one of the aggregate representations, wherein the additional information include asset icons representing each of the assets within the jurisdiction as well as related alert icons representing each of the alerts generated by each of the assets within the jurisdiction, as indicated at block 112.
In some cases, each asset icon includes a graphical representation that identifies a particular asset type of the corresponding asset from a plurality of different asset types. Examples of asset icons are shown in
Referring to
A number of alert icons 126 may be generated by a camera represented by the camera icon 120, and may be displayed on a geographic map adjacent or at least partially overlapping the camera icon 120 itself. Illustrative alert icons are shown in the right column of
In some cases, each alert icon 126 includes a color ring 130. The color ring 130 may be any of a variety of different colors, with each color representing an alert priority or an alert seriousness. Relatively minor alerts may have a color ring 130 that is yellow in color. More serious alerts may have a color ring 130 that is orange in color. More serious alerts yet may have a color ring 130 that is red in color. These colors are just illustrative, and are shown in the drawings using differing shading patterns. As illustrated, the alert icon 126a includes a color ring 130a that represents a color red, the alert icon 126b includes a color ring 130b that represents a color orange, the alert icon 126c includes a color ring 130c that represents a color yellow and the alert icon 126d includes a color ring 130d that represents a color red.
In
A smoke detector icon 138 includes a smoke image 140 that will be repeated in any alert icon that is triggered by a smoke detector represented by the smoke detector icon 138. The smoke detector icon 138 may trigger an alert meaning that smoke has been detected, a fire has been detected, or gaseous combustion products have been detected.
A lighting gateway icon 142 includes a light bulb image 142. An alert icon 146 includes the light bulb image 142, indicating the source of the alert. The alert icon 146 also includes a color ring 146a representing the color yellow. Alerts may be raised to indicate that street (or other) lights have been turned on. Alerts may be raised to indicate that street (or other) lights have not yet turned on, even though street lights are scheduled to turn on, or other burned out. Weather conditions may make ambient lighting less than expected. In these situations, a lighting alert may be raised to indicate that certain street lighting should be turned on, even though not scheduled to be on.
Continuing on with
An emergency icon 154 includes an emergency image 156. An alert icon 158 includes the emergency image 156, indicating the source of the alert. The emergency icon 154 may be considered as representing a location of an emergency phone, for example. The emergency icon 154 may be considered as representing not only the location of an emergency phone, but in some cases could instead be a simple PANIC button that a user can select to obtain assistance. The alert icon 158 includes a color ring 158a which as shown may represent a color red, indicating a high seriousness or a high priority alert.
An environmental sensor icon 160 includes a leaf image 162. An alert icon 164 includes the leaf image 162, indicating the source of the alert. The alert icon 164 may indicate that an environmental sensor such as a carbon monoxide sensor or a carbon dioxide sensor has detected unsafe or potentially unsafe levels of either carbon monoxide or carbon dioxide, as the case may be. The alert icon 162 includes a color ring 162a which as shown may represent a color orange, indicating a medium seriousness or a medium priority alert.
A bin sensor icon 166 includes a garbage bin image 168. An alert icon 170 includes the garbage bin image 168, indicating the source of the alert. In on example, the alert icon 170 may indicate that a particular garbage bin is full and needs to be emptied.
A water meter icon 184 includes a water meter image 186 that may be displayed as part of an alert icon that is triggered by the water meter icon 184 in order to indicate the source of the alert icon. A water meter measures water consumption. In some cases, an alert icon such as an alert icon 188 may be displayed if the water meter represented by the water meter icon 184 detects unusually large volumes of water being consumed, as this can in some cases indicate a possible water leak. As shown, the alert icon 188 includes a water level image 190 that may indicate a possible water leak. The alert icon 188 includes a color ring 188a which as shown may represent a color orange, indicating a medium seriousness or a medium priority alert.
A power meter icon 192 includes a power meter image 194 that may be displayed as part of an alert icon that is triggered by the power meter icon 192 in order to indicate the source of the alert icon. A power meter measures electrical consumption.
There may be a desire to track city vehicles moving around the smart city, including knowing where the city vehicles are, and whether any of the city vehicles are either at an unexpected location or are being driven in an unsafe manner, such as speeding. A city vehicle icon 196 may be used to represent the current location of each of a variety of different city vehicles such as city buses and garbage trucks. Likewise, and as shown in
A PA icon 204 includes a PA (public announcement) image 206 that may be displayed as part of an alert icon that is triggered by the PA icon 206 in order to indicate the source of the alert icon. A PA device is a device used to make important public announcements. An alert icon 208 includes the PA image 206. The alert icon 208 includes the PA image 206 as well as a color ring 208a which as shown may represent a color orange, indicating a medium seriousness or a medium priority alert. The alert icon 208 may be displayed when the PA system is currently being used to broadcast an public announcement and/or when the PA system is currently down or other wise needs service. These are just examples.
In some cases, a user may wish to investigate an alert by checking nearby assets. For example, the user may wish to check video streams from cameras that are nearby the camera represented by the asset icon 224.
In some cases, a user may wish to zoom out, and view a larger geographic area.
Having thus described several illustrative embodiments of the present disclosure, those of skill in the art will readily appreciate that yet other embodiments may be made and used within the scope of the claims hereto attached. It will be understood, however, that this disclosure is, in many respects, only illustrative. Changes may be made in details, particularly in matters of shape, size, arrangement of parts, and exclusion and order of steps, without exceeding the scope of the disclosure. The disclosure's scope is, of course, defined in the language in which the appended claims are expressed.
This is a continuation of co-pending U.S. patent application Ser. No. 17/215,790, filed Mar. 29, 2021, and entitled “SMART CITIES MAP-BASED ALERT VISUALIZATION”, which is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
8730040 | Donovan et al. | May 2014 | B2 |
9355540 | Zajac et al. | May 2016 | B2 |
9615066 | Tran | Apr 2017 | B1 |
20070008099 | Kimmel et al. | Jan 2007 | A1 |
20150163626 | Zimmer | Jun 2015 | A1 |
20150317356 | Deichler | Nov 2015 | A1 |
20150365246 | Kane | Dec 2015 | A1 |
20160119424 | Kane et al. | Apr 2016 | A1 |
20160227376 | Hernoud et al. | Aug 2016 | A1 |
20170094474 | Hernoud et al. | Mar 2017 | A1 |
20170180814 | Stathacopoulos et al. | Jun 2017 | A1 |
20170332204 | Hernoud et al. | Nov 2017 | A1 |
20180299540 | Cardno | Oct 2018 | A1 |
20190116466 | Hernoud et al. | Apr 2019 | A1 |
20190364389 | Hernoud et al. | Nov 2019 | A1 |
20200037125 | Neuert | Jan 2020 | A1 |
20200196108 | Hernoud et al. | Jun 2020 | A1 |
20200389335 | Kane | Dec 2020 | A1 |
20210314757 | Pellegrini et al. | Oct 2021 | A1 |
20220014895 | Horelik et al. | Jan 2022 | A1 |
Entry |
---|
Hitachi Solutions Geographical Information System, 7 pages, https://www.hitachi-solutions.com/gis/ Accessed on Mar. 29, 2021. |
Screenshot Hitachi Ventara hitachivantara.com/en.us/video/demonstration-hitachi-visularization-hitachi-visualization.html, 1 page, Accessed on Mar. 29, 2021. |
Hitachi Visualization Suite Datasheet, 2 pages, Aug. 2019. |
Trinity ICCC Brochure Trinity Mobility, Pvt. Ltd. Bengaluru, Kornataka, 4 pages, www.trinitymobility.com, Accessed on Mar. 29, 2021. |
Mehboob, Fozia, et al., “Glyph-based video visualization on Google Map for surveillance in smart cities,” EURASIP Journal on Image and Video Processing, (2017) 2017:28, Dec. 4, 2017 (16 pgs). |
India Office Action, Indian Patent Office, IN Application No. 202214011942, dated Oct. 17, 2022 (6 pgs). |
Number | Date | Country | |
---|---|---|---|
20220351605 A1 | Nov 2022 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 17215790 | Mar 2021 | US |
Child | 17864336 | US |