Patent Application
20230219790
This application claims the priority benefit of Taiwan application serial no. 111100831, filed on Jan. 7, 2022. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
The disclosure relates to an escalator alert technology, and in particular, to an escalator equipment alert method and an escalator equipment alert system.
Most shopping malls or stores are equipped with escalators for customers to move between floors. However, when a customer boards an escalator with soft rubber shoes (such as Crocs), accidents frequently occur. For instance, it is easy form them to have their feet caught in the carrier of the operating escalator and cause foot injuries, or fall on the escalator when they (e.g. children) board in the wrong way (e.g. standing in reverse direction).
In view of this, the disclosure provides an escalator equipment alert method and an escalator equipment alert system, which can effectively improve the safety of people when boarding escalator equipment.
The embodiments of the disclosure provides an escalator equipment alert method, which includes: activating a camera disposed on an entrance of an escalator equipment; capturing a foot image of a passenger about to board the escalator equipment through the camera; performing an image analyzation on the foot image to detect a danger boarding behavior related to the passenger; and, in response to the danger boarding behavior, issuing an alert message matched with the danger boarding behavior through an alert device.
The embodiments of the disclosure further provides an escalator equipment alert system, which includes a camera, an alert device, and a processor. The camera is disposed on an entrance of an escalator equipment. The processor is coupled to the camera and the alert device. The processor is configured to: activate the camera; capture a foot image of a passenger about to board the escalator equipment through the camera; perform an image analyzation on the foot image to detect a danger boarding behavior related to the passenger; and, in response to the danger boarding behavior, issue an alert message matched with the danger boarding behavior through the alert device.
Based on the above, the escalator equipment alert method and escalator equipment alert system provided by the disclosure focuses on analyzing the foot image of a user (i.e. passenger) of the escalator, and issues a corresponding alert message when a possible danger boarding behavior is detected. Thereby, the safety of people when boarding the escalator equipment can be effectively improved.
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the disclosure and, together with the description, serve to explain the principles of the disclosure.
Reference will now be made in detail to the exemplary embodiments of the disclosure, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts.
The alert device 12 may be configured to issue an alert message. For example, the alert device 12 may include at least one of an audio alert device and a visual alert device. The audio alert device may issue the alert message in the form of sound. For example, the audio alert device may include a speaker to issue an alert sound as a warning or reminder. The visual alert device may issue the alert message in a visual form. For example, the visual alert device may include a display and/or an indicator light to issue an alert image and/or an alert light signal as a warning or reminder.
The processor 13 is coupled to the camera 11 and the alert device 12. The processor 13 may be used for the whole or part of the operation of the escalator equipment alert system 10. For example, the processor 13 may include a central processing unit (CPU), a graphics processing unit (GPU), or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSP), programmable controllers, application specific integrated circuits (ASIC), programmable logic devices (PLD), or other similar devices or combinations of these devices.
Further, the escalator equipment alert system 10 may further include a storage circuit, a power supply circuit, and various input/issue (I/O) interfaces. The storage circuit may be configured to store data (e.g. code). The power supply circuit may be configured to provide the power required for the operation of the escalator equipment alert system 10. Various input/issue (I/O) interfaces may be configured to transmit signals.
The processor 13 may be configured to activate the camera 11(1) and/or the camera 11(2). After activating the camera 11(1) and/or the camera 11(2), the processor 13 may capture the foot image of the passenger at the entrance of the escalator equipment 21 and about to board the escalator equipment 21 through the camera 11(1) and/or the camera 11(2). The foot image may at least represent the foot image of one or more passengers. For example, the foot may include or specifically refer to a position between the lower leg and the sole of the passenger.
It should be noted that the camera 11(1) and the camera 11(2) in
Moreover, the actual disposition position of the camera 11(1) and the camera 11(2) on the escalator equipment 21 may be adjusted according to practical needs, as long as they may be configured to capture the foot image of the passenger. Alternatively, more cameras may also be disposed on the entrance of the escalator equipment 21 (e.g. near the camera 11(1) and/or the camera 11(2)) to provide more angle-focusing foot images of the passenger. Further, in one embodiment, the camera 11(1), the camera 11(2), and/or other cameras may also be disposed under the handrail device inside the escalator equipment 21 to capture foot images of the passenger boarding the escalator equipment 21.
After obtaining the foot image, the processor 13 may be configured to perform an image analyzation on the foot image to detect a danger boarding behavior related to the passenger. For example, the processor 13 may perform the image analyzation (e.g. object recognition) on the foot image using an image recognition model such as a trained neural(-like) network model or a deep learning model and detect the danger boarding behavior according to the analyzation result. After detecting the danger boarding behavior, in response to the danger boarding behavior, the processor 13 may issue an alert message matched with the danger boarding behavior through the alert device 12.
In one embodiment, the danger boarding behavior may include at least one of a first danger boarding behavior, a second danger boarding behavior, and a third danger boarding behavior. The first danger boarding behavior is related to the type of shoes worn by the passenger. The second danger boarding behavior is related to the orientation of the passenger's feet (e.g. toes). The third danger boarding behavior is related to the number of passengers (e.g. the total number of people). Further, more danger boarding behaviors may also be defined according to practical needs, and the disclosure is not limited thereto.
In one embodiment, the processor 13 may detect the type of shoes worn by the passenger according to the result of the image analyzation. In response to a particular type of shoes worn by a passenger, the processor 13 may determine that a first danger boarding behavior occurs. Then, the alert device 12 may issue an alert message (also referred to as a first alert message) matched with the first danger boarding behavior. For example, common shoes that are more dangerous for escalators include shoes with toes and/or uncovered toes (e.g. slippers or sandals) and soft rubber shoes (e.g. Crocs), and the disclosure is not limited thereto.
In one embodiment, when it is detected that the type of shoes worn by the passenger belongs to one of the more dangerous shoes for escalators (that is, the passenger wears a specific type of shoes), the processor 13 may determine that the first danger boarding behavior occurs and instruct the alert device 12 to issue the first alert message. For example, the first alert message may be used to remind passengers who are currently boarding or about to board the escalator equipment 21 that the shoes they are wearing are dangerous when boarding the escalator equipment 21, and that they need to pay more attention and prevent the soles of their shoes from being caught by the equipment.
In case of soft rubber shoes, a common soft rubber shoe is characterized by non-covering of the heel, wider width at the front quarter of the shoe than at the halfway of the shoe, and the tip not right in the middle of the toe cap. The processor 13 may identify the type of shoes worn by the passenger 301 in the foot image 31 according to these characteristics. For example, the processor 13 may train an image recognition model according to such characteristics. Alternatively, the processor 13 may use a plurality of training images representing images of soft rubber shoes to train the image recognition model. The trained image recognition model may then have the ability to detect soft rubber shoes in the foot image 31. In addition, different types of shoes may have different characteristics. The processor 13 may train the image recognition model according to the characteristics or training images of different types of shoes, such that the trained image recognition model has the ability to identify shoes (i.e. to detect a specific type of shoes).
In one embodiment, the processor 13 may detect the orientation of the passenger's feet according to the result of the image analyzation. In response to the passenger's feet facing a specific direction, the processor 13 may determine that the second danger boarding behavior occurs. Then, the alert device 12 may issue an alert message (also referred to as a second alert message) matched with the second danger boarding behavior. For example, a common danger escalator boarding behavior includes passengers deliberately boarding the escalator in the reverse direction. For example, when boarding an escalator, some passengers may deliberately stand with their toes in the reverse direction to the moving direction of the escalator, causing themselves to fall for not being able to know when to exit the escalator.
In one embodiment, when it is detected that the passenger deliberately stands with the toes in the reverse direction to the moving direction of the escalator (that is, the passenger's feet are facing a specific direction), the processor 13 may determine that the second danger boarding behavior occurs and instruct the alert device 12 to issue the second alert message. For example, the second alert message may be used to remind the passengers who are currently boarding or about to board the escalator equipment 21 do board the escalator equipment 21 with their front facing the moving direction of the escalator so as to avoid danger.
Taking
In one embodiment, the processor 13 may detect a passenger density according to the result of the image analyzation. In response to the passenger density reaching a critical value, the processor 13 may determine that the third danger boarding behavior occurs. Then, the alert device 12 may issue an alert message (also referred to as a third alert message) matched with the third danger boarding behavior. For example, common time points that are prone to escalator accidents include when the passenger density is too high. For example, when there are too many passengers on the escalator at a certain time (or within a certain time range), it is easy for the passengers to push each other or collide and cause accidents, and even mechanical damage or life reduction may occur due to excessive passengers boarding in a short period of time.
In one embodiment, when it is detected that the passenger density is too high (i.e. the passenger density reaches a critical value), the processor 13 may determine that the third danger boarding behavior occurs and instruct the alert device 12 to issue the third alert message. For example, the third alert message may be used to remind the passengers who are about to board the escalator equipment 21 to suspend boarding the escalator equipment 21, increase the distance from other people boarding taking the escalator equipment 21, or board other nearby escalators so as to avoid danger or mechanical damage caused by crowds.
Taking
It should be noted that the foregoing embodiments only provide several danger boarding behaviors as examples to be defined and detected by analyzing foot images. In other embodiments, more danger boarding behaviors may be defined and detected, and more types of alert messages may be correspondingly issued, and the disclosure is not limited thereto.
In one embodiment, the alert device 12 may be integrated (e.g. embedded) in the escalator equipment 21 or independent of the escalator equipment 21. For example, the alert device 12 may be disposed on the ground at the entrance of the escalator equipment 21, on the handrail devices on both sides of the escalator equipment 21, and/or on the surface of the stepped transportation mechanism, and the like. The disclosure does not limit the actual disposition position of the alert device 12.
In one embodiment, the processor 13 may further deliver customized advertisement content according to the type of shoes worn by the passenger. For example, the processor 13 may deliver the customized advertisement content through an advertising device on or near the escalator equipment 21 according to the type of shoes worn by the passenger detected in one or more foot images. For example, when it is detected that more than a preset proportion (e.g. 50%, 60% or 70%) of the passengers boarding the escalator equipment 21 in a certain time range are wearing high heels, the processor 13 may send the customized advertisement content related to high heels to the advertising devices such as displays and/or speakers near the exit of the escalator equipment 21 (or at the place where the escalator equipment 21 is located) to play the advertisement content. Alternatively, when it is detected that more than the preset proportion of the passengers who board the escalator equipment 21 within a certain time range are wearing sports shoes, the processor 13 may instead deliver advertisement content related to sporting goods, and so on.
In one embodiment, the processor 13 may further provide at least one of equipment maintenance information and manpower scheduling information according to the detected passenger density. The equipment maintenance information may include an equipment maintenance suggestion related to the escalator equipment 21. The manpower scheduling information includes a manpower scheduling suggestion related to the location where the escalator equipment 21 is located. For example, the processor 13 may automatically generate the equipment maintenance information and/or the manpower scheduling information according to the distribution of passenger density within a specific time range. For example, the equipment maintenance information may provide appropriate adjustment suggestions for the maintenance regulations of the escalator equipment 21 (e.g. equipment is maintained at a frequency of every n days) in response to changes in passenger density and/or statistical results within a specific time range. For example, the manpower scheduling information may provide suitable adjustment suggestions for the manpower resources of the place where the escalator equipment 21 is located (for example, to provide additional manpower to guide passengers during the peak traffic period of the escalator equipment 21) in response to correspond to changes in passenger density and/or statistical results within a specific time range. Moreover, the equipment maintenance information and/or the manpower scheduling information may be sent to the back-end management platform or server for storage and for the management personnel as a reference for field management.
In one embodiment, the detected information on the type of shoes worn by the passengers and/or the passenger density may also be stored in the back-end management platform or server, and may be used by managers or advertisers as a reference for advertising. For example, if there are many passengers wearing high heels on the escalator equipment 21 during a certain period of the week, the advertiser may consider running a large number of advertisements related to high heels in the place where the escalator equipment 21 is located during this period so to improve the advertising efficiency. Moreover, managers may also adjust the cost of running specific advertisements in specific time periods based on such information.
It should be noted that the above-mentioned embodiments only provide several examples of applying the analyzation result of the foot image (e.g. the type of shoes worn by passengers and/or information of passenger density) to advertisement placement and/or field management. In other embodiments, the analyzation result of the foot image may be more widely applied to other field management mechanisms (e.g. adjusting the admission fee of the field according to the trough period and peak period of the traffic of the escalator equipment 21, etc.), and the disclosure is not limited thereto.
Each step in
In summary, compared with the traditional escalator equipment that may only play standardized broadcasting messages with public broadcasting equipment at the venue or with its own broadcasting equipment, the escalator alert method and the escalator equipment alert system provided by the embodiments of the disclosure may study and determine possible danger boarding behaviors and provide matched alert messages according to the foot images of the passengers captured in focus. In this manner, the safety of people when boarding the escalator equipment can be effectively improved.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the disclosure without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the disclosure cover modifications and variations of this disclosure provided they fall within the scope of the following claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 111100831 | Jan 2022 | TW | national |
