Patent Grant
11377326
This application claims priority to Chinese Patent Application No. 201810487047.3, filed May 21, 2018, and all the benefits accruing therefrom under 35 U.S.C. § 119, the contents of which in its entirety are herein incorporated by reference.
The present invention relates to the technical field of elevators, and more particularly to an elevator door control system, an elevator system, and an elevator door control method based on to-be-carried object grouping identification.
Elevators have been widely used in modern society, bringing great convenience to people's work and daily life. Although a large variety of elevator apparatuses, devices or systems have been provided in the prior art to meet different application needs of people, these existing elevator apparatuses, devices or systems still have shortcomings and defects in such aspects as security monitoring, intelligence, user-friendliness, reliability, and user experience, and need to be further improved and optimized.
In view of this, the present invention provides an elevator door control system, an elevator system, and an elevator door control method based on to-be-carried object grouping identification, to solve at least one or more of the above-mentioned and other problems in the prior art.
First, a first aspect of the present invention provides an elevator door control system based on to-be-carried object grouping identification, with the elevator door control system including: the elevator door control system including: one or more three-dimensional sensors, arranged to capture three-dimensional data of to-be-carried objects in an elevator waiting region, where the three-dimensional data includes depth data; a data processing device, communicating with the three-dimensional sensor, and configured to receive and process the three-dimensional data, to provide grouping data of one or more groups obtained according to correlations between the to-be-carried objects and position data of each to-be-carried object in the elevator waiting region; and a control device, connected to an elevator door, communicating with the data processing device, and configured to control operation of the elevator door according to the grouping data and the position data.
In the elevator door control system according to the present invention, optionally, the control device is configured to control operation of the elevator door to simultaneously load all to-be-carried objects in at least one group or simultaneously load remaining to-be-carried objects in at least one group that have not been carried.
In the elevator door control system according to the present invention, optionally, the data processing device includes: a detecting and locating module, configured to acquire an object feature of each to-be-carried object from the three-dimensional data and determine a coordinate position of each to-be-carried object in the elevator waiting region; a grouping module, communicating with the detecting and locating module, and configured to group each to-be-carried object into a group according to the object feature; and a group tracking module, communicating with the grouping module, and configured to track positions of to-be-carried objects in the same group and update coordinate positions of the to-be-carried objects in the elevator waiting region.
In the elevator door control system according to the present invention, optionally, the data processing device further includes a category defining module, communicating with the grouping module and the group tracking module, and configured to define, according to at least two object features of the to-be-carried objects in the same group, a category of the group, wherein the at least two object features include height and shape, and the category includes an adult group, an adult and juvenile group, an adult and pet group, and a juvenile and pet group.
In the elevator door control system according to the present invention, optionally, the control device is configured to execute the following operations: if the category of the group is the adult and juvenile group, controlling, when only a juvenile in the group enters an elevator car, the elevator door to be in an open state until an adult in the group enters the elevator car; if the category of the group is the adult and pet group, controlling, when only a pet in the group enters an elevator car, the elevator door to be in an open state until an adult in the group enters the elevator car; if the category of the group is the juvenile and pet group, controlling, when only a pet in the group enters an elevator car, the elevator door to be in an open state until a juvenile in the group enters the elevator car; and/or if the category of the group is the adult group, controlling, when not all the adults in the group have entered an elevator car and a current crowdedness degree of the elevator car does not exceed a preset value, the elevator door to be in an open state until all the adults in the group enter the elevator car.
In the elevator door control system according to the present invention, optionally, the crowdedness degree is determined according to a ratio of a current load of the elevator car to a preset rated load of the elevator car.
In the elevator door control system according to the present invention, optionally, the three-dimensional sensor has a parameter that is calibrated, and the detecting and locating module converts a coordinate position of the to-be-carried object in the depth data into a coordinate position of the to-be-carried object in the elevator waiting region based on the parameter.
In the elevator door control system according to the present invention, optionally, the parameter includes a position and an angle at which the three-dimensional sensor is arranged.
In the elevator door control system according to the present invention, optionally, the detecting and locating module processes the three-dimensional data by using background modeling and foreground segmentation methods.
In the elevator door control system according to the present invention, optionally, the object feature includes position, speed, acceleration, moving direction, trajectory, body orientation, height, and shape.
In the elevator door control system according to the present invention, optionally, the three-dimensional sensor is at least arranged at the top of the elevator waiting region.
Next, a second aspect of the present invention provides an elevator system, including any one of the above-mentioned elevator door control systems.
In addition, a third aspect of the present invention further provides an elevator door control method based on to-be-carried object grouping identification, including steps of: receiving three-dimensional data captured from to-be-carried objects in an elevator waiting region, where the three-dimensional data includes depth data; processing the three-dimensional data, to provide grouping data of one or more groups obtained according to correlations between the to-be-carried objects and position data of each to-be-carried object in the elevator waiting region; and controlling operation of the elevator door according to the grouping data and the position data.
In the elevator door control method according to the present invention, optionally, the operation of the elevator door is controlled to simultaneously load all to-be-carried objects in at least one group or simultaneously load remaining to-be-carried objects in at least one group that have not been carried.
In the elevator door control method according to the present invention, optionally, the step of processing the three-dimensional data includes: acquiring an object feature of each to-be-carried object from the three-dimensional data and determining a coordinate position of each to-be-carried object in the elevator waiting region; grouping each to-be-carried object into a group according to the object feature; and tracking positions of to-be-carried objects in the same group and updating coordinate positions of the to-be-carried objects in the elevator waiting region.
In the elevator door control method according to the present invention, optionally, the step of processing the three-dimensional data further includes defining, according to at least two object features of the to-be-carried objects in the same group, a category of the group, wherein the at least two object features include height and shape, and the category includes an adult group, an adult and juvenile group, an adult and pet group, and a juvenile and pet group.
In the elevator door control method according to the present invention, optionally, the following operations are executed according to the category of the group: if the category of the group is the adult and juvenile group, controlling, when only a juvenile in the group enters an elevator car, the elevator door to be in an open state until an adult in the group enters the elevator car; if the category of the group is the adult and pet group, controlling, when only a pet in the group enters an elevator car, the elevator door to be in an open state until an adult in the group enters the elevator car; if the category of the group is the juvenile and pet group, controlling, when only a pet in the group enters an elevator car, the elevator door to be in an open state until a juvenile in the group enters the elevator car; and/or if the category of the group is the adult group, controlling, when not all the adults in the group have entered an elevator car and a current crowdedness degree of the elevator car does not exceed a preset value, the elevator door to be in an open state until all the adults in the group enter the elevator car.
In the elevator door control method according to the present invention, optionally, the crowdedness degree is determined according to a ratio of a current load of the elevator car to a preset rated load of the elevator car.
In the elevator door control method according to the present invention, optionally, the object feature includes position, speed, acceleration, moving direction, trajectory, body orientation, height, and shape.
In the elevator door control method according to the present invention, optionally, the three-dimensional data is captured by using one or more three-dimensional sensors having a parameter that is calibrated, and a coordinate position of the to-be-carried object in the depth data is converted into a coordinate position of the to-be-carried object in the elevator waiting region based on the parameter.
In the elevator door control method according to the present invention, optionally, the parameter includes a position and an angle at which the three-dimensional sensor is arranged.
In the elevator door control method according to the present invention, optionally, the three-dimensional sensor is at least arranged at the top of the elevator waiting region.
The principles, characteristics, features, advantages and the like of the technical solutions of the present invention will be apparent from the following detailed description made with reference to the accompanying drawings. For example, it will be appreciated that the elevator door control system, the elevator system, and the elevator door control method based on to-be-carried object grouping identification provided by the present invention have obvious technical advantages over the prior art, can intelligently implement quick and accurate identification of correlations between the to-be-carried objects, and accordingly distribute the associated to-be-carried objects to the same elevator car in a more user-friendly way, thus improving the safety in use of the elevator door, and enhancing user experience of passengers.
The technical solutions of the present invention will be described in further detail with reference to the accompanying drawings and embodiments. However, it should be understood that the accompanying drawings are merely designed for the purpose of explanation, are merely intended to conceptually illustrate the structural constructions described herein, and are not necessarily drawn to scale.
First, it should be noted that the compositions, steps, features, and advantages of the elevator door control system, the elevator system and the elevator door control method based on to-be-carried object grouping identification according to the present invention will be described below by way of example, but the descriptions are not intended to limit the present invention.
In addition, for any single technical feature described or implied in the embodiments mentioned herein or any single technical feature shown or implied in the accompanying drawings, the present invention still allows these technical features (or equivalents thereof) to be combined or omitted arbitrarily without causing any technical obstacle. Therefore, all such embodiments obtained according to the present invention should be considered to fall within the scope disclosed herein. In addition, the same or similar components and features may be labeled at only one or more positions in the same drawing for the sake of simplicity.
Refer to
Specifically, one or more three-dimensional sensors 3 (for example, commercially available ZED, Kinect, Camcube, Astra, Intel Realsense, etc.) may be provided according to actual on-site situations, for example, arranged at any suitable position such as the top 11 of the elevator waiting region 10 (or referred to as “elevator lobby”, “lobby”, etc.), so as to capture three-dimensional data of to-be-carried objects 12 in the elevator waiting region 10 through a field of view A formed by the one or more three-dimensional sensors 3. The three-dimensional data includes depth data, which is helpful for analysis and identification, positioning, and moving trajectory tracking of the to-be-carried objects 12, and will be detailed later. It will be appreciated that without departing from the spirit of the present invention, the actual number of three-dimensional sensors to be provided, the arrangement position, the coverage range, working parameters and the like can be flexibly selected, changed and adjusted according to specific applications requirements in the present invention.
The data processing device 4 may be connected to the three-dimensional sensor 3 through wired communication or wireless communication, so as to acquire and process the three-dimensional data captured by the three-dimensional sensor 3 and then group the to-be-carried objects 12 according to the three-dimensional data, thus grouping the to-be-carried objects 12 into one or more groups and obtaining corresponding grouping data. As an example, correlations between the to-be-carried objects 12 may be determined according to one or more object features such as position, speed, acceleration, moving direction, trajectory, body orientation, height, and shape, and accordingly the to-be-carried objects 12 are grouped into different groups. In addition, position data of the to-be-carried objects 12 in the elevator waiting region 10 may also be obtained by processing the three-dimensional data based on the data processing device 4.
To facilitate a better understanding of the technical solutions of the present invention,
First, in the example of
For the positioning of the to-be-carried object, in an optional case, parameters in the three-dimensional sensor 3 may be calibrated. The parameters include but are not limited to a position and an angle at which the three-dimensional sensor 3 is arranged. Then, the detecting and locating module 6 may convert a coordinate position of the to-be-carried object 12 in the depth data that is captured into a coordinate position of the to-be-carried object 12 in the elevator waiting region 10 based on the calibrated parameters, thus achieving timely and accurate detection and positioning of the to-be-carried objects 12.
The grouping module 7 is configured to group the to-be-carried objects 12 into one or more groups according to the object features of the to-be-carried objects 12. For example, as described above, the correlations between the to-be-carried objects 12 may be determined according to information such as position, speed, acceleration, moving direction, trajectory, and body orientation of the to-be-carried objects 12 in a plurality of frames of three-dimensional data, and accordingly the to-be-carried objects 12 are grouped. For example, if multiple to-be-carried objects have relatively stable relative positions and have similar speeds, moving directions and trajectories, it indicates that they may be friends, colleagues, family, partners or have other close or intimate relationships. In this case, they may be grouped into the same group. The information will be provided to a control device 5 for intelligent and user-friendly elevator door control, so as to distribute members of the same group into the same elevator car as much as possible.
The group tracking module 8 is configured to track positions of to-be-carried objects 12 in the same group and update coordinate positions of the to-be-carried objects 12 in the elevator waiting region 10. The information will be provided to the control device 5 for intelligent and user-friendly elevator door control, so as to distribute the to-be-carried objects of the same group into the same elevator car as much as possible.
In addition,
The control device 5 is not only connected to the elevator door 2, but also communicates with the data processing device 4, so as to acquire the grouping data and the position data from the data processing device 4 and control operation of the elevator door 2. The control device 5 intelligently controls the operation of the elevator door 2 in a user-friendly way. One purpose of the control is to distribute all the to-be-carried objects 12 in the same group into the same elevator car 1 as much as possible, so as to offer care and convenience for the passengers, ensure that passengers in the same group who are family, friends, colleagues or the like take the same elevator car, and reduce or eliminate great safety risks caused by some passengers rushing and hitting the elevator door when the elevator door is being closed. In this way, not only the user experience and personal safety of passengers are improved, but also the risks of damage to elevator equipments are effectively reduced.
In an optional case, the control device 5 may be configured to execute the following one or more operations so as to better implement the above-mentioned intelligent and user-friendly elevator door control: if the category of one group is the adult and juvenile group, that is, the group includes both an adult and a juvenile, controlling, when only the juvenile in the group enters the elevator car 1, the elevator door 2 to be in an open state until the adult in the group also enters the elevator car 1, preventing the juvenile from detaching from the adult and taking the elevator alone to face safety risks; if the category of one group is the adult and pet group, that is, the group includes both an adults and a pet, controlling, when only the pet in the group enters the elevator car 1, the elevator door 2 to be in an open state until the adult in the group also enters the elevator car 1, to take care of and manage the pet, preventing the pet from detaching from the adult to annoy or cause adverse effects and safety risks to other passengers in the elevator car; if the category of one group is juvenile and pet group, that is, the group includes both a juvenile and a pet, controlling, when only the pet in the group enters the elevator car 1, the elevator door 2 to be in an open state until the juvenile in the group also enters the elevator car 1, to take care of and manage the pet, preventing the pet from detaching from the juvenile to annoy or cause adverse effects and safety risks to other passengers in the elevator car; and if the category of one group is the adult group, that is, the group includes two or more adults considered to be family, friends, colleagues or have other close or intimate relationships, controlling, when not all the adults in the group have entered the elevator car 1 and a current crowdedness degree of the elevator car 1 (which may be determined according to a ratio of a current load of the elevator car 1 to a preset rated load of the elevator car 1) does not exceed a preset value (which may be determined according to specific applications), the elevator door 2 to be in an open state until all the adults enter the elevator car 1, bringing great convenience for the adult passengers, and offering them good experience in using the elevator.
Definitely, the control device 5 may optionally be further configured to control operation of the elevator door to simultaneously load remaining to-be-carried objects in at least one group that have not been carried. For example, the elevator car may be too crowded and cannot hold all the to-be-carried objects in the same group. That is, the elevator car currently only carries some of the to-be-carried objects in the group, and one or more remaining to-be-carried objects in the same group need to wait in the elevator waiting region for next ride. In this case, the control device 5 can be used to control operation of the elevator door of the elevator that subsequently comes, so as to distribute as much as possible the remaining to-be-carried objects to one elevator car at a time or to a plurality of elevator cars in batches, thus providing intelligent and user-friendly elevator control, and minimizing the number of elevator cars required for carrying the to-be-carried objects in the same group.
The approximate structures, working principles, and technical advantages of the elevator door control system according to the present invention have been described in detail with reference to the examples of
In addition, as an aspect obviously superior to the prior art, the present invention further provides an elevator door control method based on to-be-carried object grouping identification. As an example, as shown in
In step S11, receiving three-dimensional data captured from to-be-carried objects in an elevator waiting region, wherein the three-dimensional data includes depth data;
In step S12, processing the three-dimensional data, to provide grouping data of one or more groups obtained according to correlations between the to-be-carried objects and position data of each to-be-carried object in the elevator waiting region; and
In step S13, controlling operation of the elevator door according to the grouping data and the position data.
For example, in some embodiments, the operation of the elevator door may be controlled in step S13 to simultaneously load all to-be-carried objects in at least one group or simultaneously load remaining to-be-carried objects in at least one group that have not been carried, thus providing intelligent and user-friendly elevator control, and minimizing the number of elevator cars required for carrying the to-be-carried objects in the same group.
In an optional case, the received three-dimensional data may be processed in the following manner in some embodiments: first, acquiring an object feature (for example, position, speed, acceleration, moving direction, trajectory, body orientation, height, and significance) of each to-be-carried object from the three-dimensional data and determining a coordinate position of each to-be-carried object in the elevator waiting region; then, grouping each to-be-carried object into a group according to the object feature; and then, tracking positions of to-be-carried objects in the same group and updating coordinate positions of the to-be-carried objects in the elevator waiting region.
In addition, in an optional case, the to-be-carried object may be detected and positioned by using methods such as background modeling and foreground segmentation.
In addition, in an optional case, the three-dimensional data of the to-be-carried objects in the elevator waiting region may be captured by using one or more three-dimensional sensors having a parameter that is calibrated (for example, a position and an angle at which the three-dimensional sensor is arranged), and a coordinate position of the to-be-carried object in the depth data is converted into a coordinate position of the to-be-carried object in the elevator waiting region based on the above parameter.
In some embodiments, according to two or more object features (for example, height and shape) of the to-be-carried objects in the same group, a category of the group may be defined. For example, the category may be set to include an adult group, an adult and juvenile group, an adult and pet group, and a juvenile and pet group. Based on the classification and setting of the categories of the groups, the operation of the elevator door can be intelligently controlled in a user-friendly way according to the categories of different groups, to prevent the annoyance, adverse effects, and safety risks caused by the juvenile or pet from detaching from the adult, the pet from detaching from the juvenile, or that passengers in the same group not taking the same elevator car, thus improving better user experience for passengers,
It will be appreciated that the technical contents such as the grouping and setting of the to-be-carried objects, the setting of the categories of groups, the detection, positioning and tracking of the to-be-carried objects, the intelligent and user-friendly control operation on the elevator door, and the configuration and use of the three-dimensional sensor have been elaborated thoroughly in the foregoing description of the elevator door control system; therefore, for contents related to the method of the present invention, reference can be made to the specific description of the foregoing corresponding part, and the details will not be repeated herein.
The elevator door control system, the elevator system and the elevator door control method based on to-be-carried object grouping identification according to the present invention are described in detail above by way of example only. These examples are only used for describing the principles and implementations of the present invention, and are not intended to limit the present invention. Those of ordinary skill in the art can also make various modifications and improvements without departing from the spirit and scope of the present invention. Therefore, all equivalent technical solutions shall fall within the scope of the present invention as defined by the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201810487047.3 | May 2018 | CN | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5258586 | Suzuki et al. | Nov 1993 | A |
| 6496220 | Landert et al. | Dec 2002 | B2 |
| 7079669 | Hashimoto | Jul 2006 | B2 |
| 7140469 | Deplazes | Nov 2006 | B2 |
| 7281610 | Ylinen et al. | Oct 2007 | B2 |
| 8020672 | Lin | Sep 2011 | B2 |
| 8260042 | Peng et al. | Sep 2012 | B2 |
| 9463953 | Lee | Oct 2016 | B2 |
| 9481548 | Siddiqui et al. | Nov 2016 | B2 |
| 10241486 | Finn | Mar 2019 | B2 |
| 10479647 | Hsu | Nov 2019 | B2 |
| 10513417 | Zhao | Dec 2019 | B2 |
| 10532909 | Richmond | Jan 2020 | B2 |
| 20150075914 | Armistead et al. | Mar 2015 | A1 |
| 20160031675 | Silvennoinen et al. | Feb 2016 | A1 |
| 20160292515 | Jia et al. | Oct 2016 | A1 |
| 20160292522 | Chen | Oct 2016 | A1 |
| 20160295196 | Finn et al. | Oct 2016 | A1 |
| 20160347577 | Simcik et al. | Dec 2016 | A1 |
| 20160368732 | Zhao | Dec 2016 | A1 |
| 20170275134 | Toner et al. | Sep 2017 | A1 |
| 20170327344 | Richmond | Nov 2017 | A1 |
| 20200331723 | Sudi | Oct 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 1931697 | Mar 2007 | CN |
| 102013209368 | Nov 2014 | DE |
| 2016142968 | Sep 2016 | WO |
| Entry |
|---|
| Chinese Office Action for AppIicaton No. 201810487047.3; dated Mar. 3, 2022; 9 Pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20190352136 A1 | Nov 2019 | US |
