Patent Application
20220281715
Not Applicable
A voice-controlled elevator has long been a sought-after technology, as evidenced by science fiction imaginings such as the turbolifts featured on Star Trek. Now, at a time when people are particularly concerned about the transmission of pathogens during the ongoing pandemic of coronavirus disease 2019 (COVID-19), voice control functionality is especially desirable because of the hands-free operation that it affords. Unfortunately, even with recent advances in voice recognition software, attempts at bringing a voice-controlled elevator product to market have been unsuccessful. As it turns out, the varied needs of each building, such as the number of floors serviced by the elevator, have made a one-size-fits-all approach impractical, leaving two unsatisfactory alternatives: i) either produce a wastefully designed system with a large amount of unused functionality that only comes into play when the system is installed in a many-floored building requiring complex elevator operation, or ii) custom build each system at great expense.
The present disclosure contemplates various systems and apparatuses for overcoming the above drawbacks accompanying the related art. One aspect of the embodiments of the present disclosure is an apparatus for retrofitting an elevator system to enable voice control. The apparatus may comprise a plurality of main boards (e.g., printed circuit boards) including a first main board installable within an elevator adjacent to an elevator button panel and two or more additional main boards installable on respective floors adjacent to respective elevator call panels. Each of the main boards may have a microphone circuit, a plurality of onboard output relays, and a processor operable to select an output relay from among the plurality of onboard output relays in response to a voice command received by the microphone circuit and to output a signal to the selected output relay. The apparatus may further comprise one or more auxiliary output relay boards installable within the elevator adjacent to the elevator button panel, each of the one or more auxiliary output relay boards having a plurality of additional output relays. The processor of the first main board may be further operable to select the output relay from among the plurality of additional output relays. The apparatus may further comprise a controller area network (CAN) bus connecting the first main board to the one or more auxiliary output relay boards.
The one or more auxiliary output relay boards may be addressable by the processor of the first main board via dual in-line package (DIP) switches. The CAN bus may comprise a three-wire CAN bus. The plurality of additional output relays of each of the one or more auxiliary output relay boards may number fifteen or more. The plurality of onboard output relays of each of the main boards may number four or fewer (e.g., two relays, corresponding to “up” and “down” elevator call functions).
Each of the main boards may have one or more LEDs. The processor of each of the main boards may be operable to illuminate the one or more LEDs in response to a wake-up word received by the microphone circuit.
Each of the main boards may have an onboard input relay circuit connected to a power circuit of the processor. The onboard input relay circuit may be operable to cut power to the processor in response to an input signal (e.g., a signal from an emergency light circuit of the elevator).
Another aspect of the embodiments of the present disclosure is an elevator system retrofitted to enable voice control. The elevator system may comprise an elevator button panel in an elevator, a plurality of elevator call panels on respective floors accessible by the elevator, a controller operable to control the elevator in response to signals received from the elevator button panel and the plurality of elevator call panels, and a first main board installed within the elevator adjacent to the elevator button panel. The first main board may have a microphone circuit, a plurality of onboard output relays connected to the elevator button panel, and a processor operable to select an output relay from among the plurality of onboard output relays in response to a voice command received by the microphone circuit and to output a signal to the selected output relay. The elevator system may further comprise two or more additional main boards installed adjacent to respective elevator call panels from among the plurality of elevator call panels. Each of the two or more additional main boards may have a microphone circuit, a plurality of onboard output relays connected to the respective elevator call panel, and a processor operable to select an output relay from among the plurality of onboard output relays in response to a voice command received by the microphone circuit and to output a signal to the selected output relay. The elevator system may further comprise one or more auxiliary output relay boards installed within the elevator adjacent to the elevator button panel. Each of the one or more auxiliary output relay boards may have a plurality of additional output relays connected to the elevator button panel. The processor of the first main board may be further operable to select the output relay from among the plurality of additional output relays. The elevator system may further comprise a controller area network (CAN) bus connecting the first main board to the one or more auxiliary output relay boards.
The one or more auxiliary output relay boards may be addressable by the processor of the first main board via dual in-line package (DIP) switches. The CAN bus may comprise a three-wire CAN bus. The plurality of additional output relays of each of the one or more auxiliary output relay boards may number fifteen or more. In each of the first main board and the two or more additional main boards, the plurality of onboard output relays may number four or fewer (e.g., two relays, corresponding to “up” and “down” elevator call functions).
Each of the first main board and the two or more additional main boards may have one or more LEDs. In each of the first main board and the two or more additional main boards, the processor may be operable to illuminate the one or more LEDs in response to a wake-up word received by the microphone circuit.
The elevator system may comprise an emergency light circuit in the elevator and an input relay connected to the emergency light circuit and to a power circuit of the processor. The input relay may be operable to cut power to the processor in response to an input signal received from the emergency light circuit.
Another aspect of the embodiments of the present disclosure is a voice-controlled elevator system. The voice-controlled elevator system may comprise a first main board installed in an elevator. The first main board may have a microphone circuit and a processor operable to output a floor select signal in response to a voice command received by the microphone circuit. The voice-controlled elevator system may further comprise two or more additional main boards installed on respective floors accessible by the elevator. Each of the two or more additional main boards may have a microphone circuit and a processor operable to output an elevator call signal in response to a voice command received by the microphone circuit. The voice-controlled elevator system may further comprise a controller operable to control the elevator in response to the floor select signal received from the first main board and the elevator call signals received from the two or more additional main boards. The voice-controlled elevator system may further comprise a controller area network (CAN) bus connecting the first main board, the two or more additional main boards, and the controller. The voice command signal and the elevator call signals may be received by the controller over the CAN bus.
The first main board and the two or more additional main boards may be addressable by the controller via dual in-line package (DIP) switches. The CAN bus may comprise a three-wire CAN bus. Each of the first main board and the two or more additional main boards may have one or more LEDs. In each of the first main board and the two or more additional main boards, the processor may be operable to illuminate the one or more LEDs in response to a wake-up word received by the microphone circuit.
The processor of the first main board may be operable to output a door control signal in response to a voice command received by the microphone circuit. The controller may be operable to control a door of the elevator in response to the door control signal received from the first main board.
The processor of the first main board may be operable to output an emergency signal in response to a voice command received by the microphone circuit. The controller may be operable to control an alarm in response to the emergency signal received from the first main board.
These and other features and advantages of the various embodiments disclosed herein will be better understood with respect to the following description and drawings, in which like numbers refer to like parts throughout, and in which:
The present disclosure encompasses various embodiments of voice-controlled elevator systems and apparatuses for retrofitting elevator systems to enable voice control. The detailed description set forth below in connection with the appended drawings is intended as a description of several currently contemplated embodiments and is not intended to represent the only form in which the disclosed invention may be developed or utilized. The description sets forth the functions and features in connection with the illustrated embodiments. It is to be understood, however, that the same or equivalent functions may be accomplished by different embodiments that are also intended to be encompassed within the scope of the present disclosure. It is further understood that the use of relational terms such as first and second and the like are used solely to distinguish one from another entity without necessarily requiring or implying any actual such relationship or order between such entities.
For the enablement of voice control as described herein, the system 10 may be retrofitted with an apparatus 100 comprising a plurality of main boards 110-0, 110-1, 110-2, . . . , 110-n (collectively, main boards 110), one or more auxiliary output relay boards 120-1, 120-2, . . . , 120-m (collectively, auxiliary output relay boards 120), and a controller area network (CAN) bus 130. Unlike prior attempts to design a voice-controlled elevator, the apparatus 100 employs a modular approach in which the capability of a given main board 110 may be expanded as needed using one or more auxiliary output relay boards 120 and the CAN bus 130, allowing the apparatus 100 to retrofit any conventional elevator system irrespective of the number of floors in the building and the complexity of the desired elevator operation. Thus, advantageously, all of the main boards 110 may be identically fabricated and all of the auxiliary output relay boards 120 may likewise be identically fabricated, making mass production practically feasible despite the diversity of elevator system implementations ranging from small two-story buildings to skyscrapers.
The plurality of main boards 110 may include a first main board 110-0 to be installed within the elevator 11 adjacent to the elevator button panel 12 as well as two or more additional main boards 110-1, 110-2, . . . , 110-n to be installed on respective floors 13-1, 13-2, . . . , 13-n adjacent to the respective elevator call panels 14-1, 14-2, . . . , 14-n. The first main board 110-0 may receive and interpret voice commands of passengers riding in the elevator 11, such as floor commands (e.g., “third floor,” “basement,” etc.) or door commands (e.g., “open,” “close,” etc.), while the additional main boards 110-1, 110-2, . . . , 110-n may receive and interpret voice commands of people outside the elevator, such as elevator call commands (e.g., “going up” or “going down”). In response to a given voice command, the main board 110 may output a signal to the adjacent elevator button panel 12 in the case of the first main board 110-0 or to the adjacent elevator call panel 14-1, 14-2, . . . , 14-n in the case of each respective additional main board 110-1, 110-2, . . . , 110-n. The elevator button panel 12 or elevator call panel 14 may treat the input from the adjacent main board 110 equivalently to a manual button press and thus may signal the controller 18 accordingly, such that the controller 18 cannot distinguish between manual operation and voice control. (Indeed, it is contemplated that both manual and voice control may be simultaneously possible.) The controller 18 may then control the elevator 11 (e.g., via equipment 16) in response to the voice commands.
As noted above, the first main board 110-0 that is connected to the elevator button panel 12 and the additional main boards 110-1, 110-2, . . . , 110-n that are connected to the respective elevator call panels 14-1, 14-2, . . . , 14-n may all advantageously be identically fabricated. Moreover, and even more importantly, the first main board 110-0 may be fabricated identically for every customer without regard to the particular needs of the building such as the number of floors or complexity of the desired elevator operation. To this end, the apparatus 100 may further include the one or more auxiliary output relay boards 120, which may be conveniently installed adjacent to the first main board 110-0 and to the elevator button panel 12. Depending on the number of floors or, more generally, the number of different output signals required within the elevator 11 (e.g., floor numbers, door open/close signals, emergency signals, etc.), the first main board 110-0 may be expanded by a number of auxiliary output relay boards 120 as required, which may be connected together (e.g., daisy chained) and to the first main board 110-0 by the CAN bus 130. As the number of buttons on the elevator button panel 12 exceeds the output capability of the first main board 110-0, each additional auxiliary output relay board 120 may be connected to the elevator button panel 12 to provide voice-controlled operation of additional buttons. For example, the first main board 110-0 may output signals directly to the elevator button panel 12 to open and close the door but may instruct a first auxiliary output relay board 120-1 to output signals to the elevator button panel 12 to select floors 1 through 15 and may instruct a second auxiliary output relay board 120-2 to output signals to the elevator button panel 12 to select floors 16 through 30. In this way, the number of buttons that need to be retrofitted with voice control may dictate the number of auxiliary output relay boards 120 employed, while the first main board 110-0 remains the same in all cases (and may further be the same as the additional main boards 110-1, 110-2, . . . , 110-n as described above).
Along the same lines, each additional main board 110-1, 110-2, . . . , 110-n may be fabricated identically to each other and identically for every customer and may further be fabricated identically to the first main board 110-0 as noted above. In the case of the additional main boards 110-1, 110-2, . . . , 110-n, the auxiliary output relay boards 120 may typically be unnecessary since the output capability of each main board 110 may generally be sufficient for operation of the corresponding elevator call panel 14 (which typically has only two buttons: up and down). However, it is contemplated that one or more auxiliary output relay boards 120 may in some cases be provided for any of the additional main boards 110-1, 110-2, . . . , 110-n, depending on the complexity of the elevator call panel 14 to be retrofitted with voice control. If so, the auxiliary output relay boards 120 may be connected using a CAN bus 130 as described above.
The processor 113 may be operable to select an output relay from among the plurality of onboard output relays 112 in response to a voice command received by the microphone circuit 111a, 111b and to output a signal to the selected output relay 112. To this end, the processor 113 may execute a voice recognition algorithm that recognizes a specific vocabulary of spoken commands including floor commands (“third floor, basement,” etc.), door commands (“open,” “close,” etc.), elevator call commands (“going up,” “going down,” etc.), emergency commands, and other commands, which may be generic or tailored to the specific building where the main board 110 will be installed (or in some cases tailored to the specific elevator 11 or the specific floor 13-1, 13-2, . . . , 13n). A tailored vocabulary may include non-standard names for floors, such as “mezzanine,” “garden,” “lower level,” “lobby,” “penthouse,” etc., depending on the needs of the particular building. Preferably, the processor 113 may be initially programmed with a tailored vocabulary at the time of installation and may be reprogrammable as needed. It is contemplated that the voice recognition algorithm may recognize multiple languages and may be capable of distinguishing and processing multiple voice commands spoken in succession or at the same time (e.g., four people speaking over each other). The voice recognition algorithm may define a wake-up word, such as “elevator,” that functions as a special command that places the processor 113 in a “listening” state in which it is ready to receive and process spoken commands other than the wake-up word. Upon recognizing a voice command that corresponds to a button on the elevator button panel 12 or elevator call panel 14, the processor 113 may select the onboard output relay 112 that is connected (e.g., via wire terminal 115a) to a button circuit inside the panel 12, 14 that is activated by that button. In this regard, the onboard output relays 112 may be electrically connected to the panel 12, 14 such that the output signal of the onboard output relay 112 is indistinguishable from the manual pressing of the corresponding button.
In order to provide visual feedback to the user that the wake-up word has been recognized, the main board 110 may include one or more LEDs 117a as shown in
The system 10 may include an emergency light circuit in the elevator 11, which may be internal to an existing elevator button panel 12, for example. The emergency light circuit may be activated (e.g., by the elevator controller 18 via the equipment 16 or by emergency personnel using a key to access the elevator button panel 12 within the elevator 11) in the case of fire service operation, seismic operation, emergency power operation, etc. In order to turn off the main board 110 under such an emergency condition (as may be required for safety code compliance), it is contemplated that an input relay circuit may be connected to a power circuit 118 of the main board 110. The input relay circuit may be onboard (and part of the power circuit 118, for example) or external to the main board 110. The input relay circuit may be operable to cut power to the processor 113 (e.g., from a DC power input 115b) in response to an input signal, in particular an input signal from the emergency light circuit. In this way, the input relay circuit may be driven off of the emergency light circuit such that the same signal from the controller 18 (or manual operation using emergency personnel's key) that places the elevator 11 in an emergency state may also stop voice control operation of the elevator system 10. Once the emergency is resolved, the processor 113 may automatically boot up to an operational state upon re-application of power.
As noted above, visual feedback may be provided to the user of the elevator system 10 in the form of illumination of LEDs 117a, 117b formed on the main board 110. It should be noted that other forms of feedback are contemplated as well. For example, auditory feedback (e.g., speech or a tone indicating that the system 10 is “listening” in response to the wake-up word, diagnostic tones, etc.) may be output by a speaker or buzzer 119 of the main board 110. In this way, support may be provided for visually impaired users.
For any main board 110 whose output capabilities are to be expanded using one or more auxiliary output relay boards 120 (e.g., most notably the first main board 110-0 installed in the elevator 11), the CAN bus 130 (see
Owing to the modular, expandable nature of the apparatus 100, in which any of the main boards 110 may be connected to one or more auxiliary output relay boards 120 over a CAN bus 130 as needed, the number of onboard output relays 112 formed on each main board 110 may be deliberately limited for the sake of efficiency. For example, the plurality of onboard output relays 112 of each of the main boards 110 may number four or fewer, such as two output relays 112. Using two output relays 112 may be especially efficient as this may be the number needed to operate a typical elevator call panel 14. Thus, on each floor 13-1, 13-2, . . . , 13-2, the two output relays 112 of the main board 110-1, 110-2, . . . , 110-n may be wired to the “up” and “down” buttons, respectively, of the corresponding elevator call panel 14, such that no auxiliary output relay boards 120 are typically needed on each floor. In the case of the first main board 110-0 installed in the elevator 11, assuming it is identical to the additional main boards 110-1, 110-2, . . . , 110-n, the two output relays 112 may be wired to any two buttons of the elevator button panel 12, such as door “open” and “close” buttons, for example. On the other hand, the plurality of additional output relays 121 of each of the one or more auxiliary output relay boards 120 may be greater and may number, for example, fifteen or more. In the case of a fifteen-relay auxiliary output relay board 120, every auxiliary output relay board 120 may expand the main board 110 to allow voice-controlled operation of fifteen additional buttons (e.g., floors 1 through 15, floors 16 through 30, etc.). Once the auxiliary output relay board(s) 120 are wired to the button panel 12, the processor 110 of the main board 110 can operate each button in response to a corresponding voice command by broadcasting a signal over the CAN bus 130. For example, the processor 113 may output a signal on the CAN bus 130 including an address of the relevant auxiliary output relay board 120. The processor 124 of the auxiliary output relay board 120 may then activate the particular relay 121 as indicated by the signal.
The number of auxiliary output relay boards 120 connected over a CAN bus 130 with a given main board 110 may depend generally on the size and complexity of the elevator system 10. It is contemplated that as many as twenty auxiliary output relay boards 120 (or even more) may be linked together and connected to the same main board 110 in some cases. Such large number of auxiliary output relay boards 120 may be used to provide corresponding output signals (to corresponding button circuits of an elevator button panel 12, for example) for upwards of two hundred fifty-five different commands/calls that may be issued by a single processor 113.
Additional features of each auxiliary output relay board 120 may include relay test buttons and associated LEDs 126a, additional indicator or diagnostic LEDs 126b, and a diagnostic header 127, which may be used to aid in installation troubleshooting, etc. Jumpers 128 corresponding to each relay 121 may be used to select shared vs. individual common return. Each auxiliary output relay board 120 may further include a DC power supply 129.
As noted above, each of the main boards 410 may be the same as the exemplary main board 110 shown in
As noted above, the main boards 410 of the system 400 may be the same as the main boards 110 of the apparatus 100. This may have the advantage of making mass production simpler and more efficient, for example. However, it is also contemplated that the main boards 110, 410 may omit one or more components depending on their implementation in an apparatus 100 for retrofitting an elevator system 10 or in a scratch-built voice-controlled elevator system 400. For example, the main boards 410 may, in some cases, omit the onboard relays 112 (and a corresponding portion of wire terminals 115a) since they will not need to output signals to any panels 12, 14. On the other hand, the main boards 110 of the apparatus 100 may, in some cases, omit the DIP switches 116a since they will not necessarily need to be addressed on the CAN bus 130 as the main boards 410 may need to be individually addressed on the CAN bus 430 by the elevator controller 440. (Instead, the DIP switches 125 shown in
In either the retrofitted system 10 or the scratch-built system 400, voice commands may be received by each main board 110, 410 and processed so as to operate floor selections, door open/close operations, elevator call operations, and emergency commands (“help” or “call for help”) as mentioned above. Additional voice commands that may be used in either system (e.g., either as an output to an onboard output relay 112 or additional output relay 121 over the CAN bus 130 or as a signal on the CAN bus 430 directly to the elevator controller 440) to operate various other features that may exist in the elevator 11 (or on a given floor 13-1, 13-2, . . . , 13-n) including, for example, music selection, air conditioning control, information requests, directory assistance (“Elevator, what floor is the fitness room on?”), etc. Any and all such functionality may be fully voice-automated using the boards 110, 120 of the apparatus 100 or using the boards 410 of the system 400. Owing to the readily expandable nature of the apparatus 100 using auxiliary output relay boards 120, as well as the CAN bus communication over the CAN bus 130, 430, such functionality may be efficiently implemented on a mass scale using identically fabricated main boards 110, 410 as described herein.
Throughout the above disclosure, a single elevator 11 is discussed for the sake of simplicity. However, the disclosure is not intended to be so limited. For example, the elevator 11 may be one of a plurality of elevators in an elevator bank that serves the same set of floors 13-1, 13-2, . . . , 13-n or different over overlapping sets of floors. In the case of the retrofitted system 10 shown in
From the perspective of a user, both the retrofitted system 10 and the system 400 may provide seamless voice-controlled operation and thus a hands-free (germ-free) experience from the moment of calling the elevator through the elevator ride and exiting of the elevator. As an exemplary use case, a person may simply approach the elevator shaft on a given floor and say, “elevator,” pausing to notice the LEDs 117a light up to signal that the system is listening, and continue, “going up.” The voice command will be heard by a main board 110, 410 installed on the wall next to or in place of the elevator call panel 14, which may then interpret the command and activate a corresponding “up” button in the case of the main board 110 of the retrofitted system 10 or instruct an elevator controller 440 (via a CAN bus 430) in the case of the scratch-built system 400. Moments later, while inside the elevator 11, the user may say, “elevator, third floor,” which will be heard and interpreted by another main board 110, 410 within the elevator 11. Again, the main board 110 may activate the corresponding “10” button, this time perhaps by broadcasting a signal on a CAN bus 130 connected to an auxiliary output relay board 120 connected to the elevator button panel 12. In the case of the system 400, the main board 440 in the elevator 11 may simply instruct the elevator controller 440 (via the CAN bus 430). In this way, the passenger may arrive at his/her destination easily and conveniently without ever needing to touch any buttons. Owing to the uniquely modular/expandable system described herein, the owner or manager of the building may provide this functionality to its tenants or guests/public at relatively low cost without having to commission a custom-built system to meet the building's particular needs.
The functionality described above in relation to the elevator controller 440 shown in
The above computer programs may comprise program instructions which, when executed by the processor, cause the processor to perform operations in accordance with the various embodiments of the present disclosure. The computer programs may be provided to the secondary storage by or otherwise reside on an external computer-readable medium such as a DVD-ROM, an optical recording medium such as a CD or Blu-ray Disk, a magneto-optic recording medium such as an MO, a semiconductor memory such as an IC card, a tape medium, a mechanically encoded medium such as a punch card, etc. Other examples of computer-readable media that may store programs in relation to the disclosed embodiments include a RAM or hard disk in a server system connected to a communication network such as a dedicated network or the Internet, with the program being provided to the computer via the network. Such program storage media may, in some embodiments, be non-transitory, thus excluding transitory signals per se, such as radio waves or other electromagnetic waves. Examples of program instructions stored on a computer-readable medium may include, in addition to code executable by a processor, state information for execution by programmable circuitry such as a field-programmable gate arrays (FPGA) or programmable logic array (PLA).
The above description is given by way of example, and not limitation. Given the above disclosure, one skilled in the art could devise variations that are within the scope and spirit of the invention disclosed herein. Further, the various features of the embodiments disclosed herein can be used alone, or in varying combinations with each other and are not intended to be limited to the specific combination described herein. Thus, the scope of the claims is not to be limited by the illustrated embodiments.
The present application claims priority to U.S. Provisional Application Ser. No. 63/156,449, filed Mar. 4, 2021, the disclosure of which is incorporated by reference herein.
| Number | Date | Country | |
|---|---|---|---|
| 63156449 | Mar 2021 | US |
