Travelers often need to carry a lot with them, especially when travelling long distances for long periods of time. They typically pack their belongings into suitcases, including smaller suitcases that they may carry onto the plane with them, as well as larger suitcases that need to be checked and stored in the plane's cargo space. An individual traveler may often have to transport multiple suitcases, bags, and other items at various moments during their travels, while simultaneously perform tasks such as checking in, getting past security, boarding, holding conversations, making payments, and supervising pets and children. The complexity of such inventory management further increases when they not only have to look after their own luggage, but also those of their family and friends. During these potentially stressful moments, a traveler is more likely to mishandle items or otherwise make mistakes that may result in lost luggage, damaged property, or injury to himself and others around him.
a-12b and 13 illustrate 3D renderings of the robotic suitcase, highlighting the LED light strips.
b illustrate the power transmission system for transferring power from a motor to one or both of the omni wheels.
The present technology is directed to methods, devices, and systems involving a robotic suitcase that can autonomously follow a traveler while providing him or her with additional smart functionalities. The robotic suitcase may be communicatively connected with a mobile device via a wireless connection so that the robotic suitcase follows the mobile device. The traveler may also configure the robotic suitcase via the wireless device to control its functionalities. Given these features, the robotic suitcase thus provides a more comfortable travel experience for its user. In addition to being a travel companion, the same functionalities of the robotic suitcase may also assist a user during everyday use, such when the user is going to their workplace, their school, or a shopping center. Similarly, the same functionalities of the robotic suitcase may also have applications outside of being a travel companion, including applications as a shopping assistant, or other applications in sports, medical settings, and security.
The present technology comprises hardware and software components. At a high level, these components may be grouped into functional categories. Hardware components include those directed to the suitcase's overall structure and appearance, power, processing capabilities, sensors, wireless communication, locomotion, and peripherals. Software components include those directed to processing sensor data, controlling the robot's movements, communicating with the user device, and controlling peripheral functionalities.
General Structure and Features
In one embodiment, the robotic suitcase 100 may be made of ABS and Polycarbonate plastic material. The suitcase 100 may be made of other combinations of one or more materials in alternative embodiments. The suitcase 100 has a generally rectangular shape with rounded edges and corners. Accordingly, the suitcase 100 has six surfaces, including a front surface 110, back surface 210, top surface 310, bottom surface 410, left surface 510, and right surface 610.
The suitcase comprises two separable sections (as shown and labelled in
The front surface may further comprise two front roller wheels 150 located near the bottom surface 410. The front roller wheels 150 may engage the floor and help maintain balance and enable locomotion while the robotic suitcase 100 is moving in the vertical travel mode. The front roller wheels 150 may comprise a spherical rolling element (as depicted in
The recessed region 240 may comprise a back support wheel assembly 230. The back support wheel assembly 230 may engage the floor and help maintain balance and enable locomotion while the robotic suitcase 100 is moving in the horizontal travel mode (as shown in
The two motorized omni wheels 250 are discussed in greater detail in a related provisional application 62/520,463, filed Jun. 15, 2017. Details contained within that application are not repeated herein. The geometry and operation of the omni wheels allow for easier movement over uneven terrain and locomotion along a surface in any direction.
The bottom surface 410 further comprises hinges 440 that join the suitcase cap 710 and body 720. In one embodiment, there may be six hinges 440 placed on the bottom surface 410. The number of hinges 440 may be different in other embodiments. The hinges 440 and the smart lock 320 on the top surface 310 allow the cap 710 of the suitcase 100 to partially open at the top surface 310, as shown in
The suitcase 100 may also include a wireless communications device, such as a Bluetooth device, for communicating with, and following, a mobile user device such as a smart phone. The mobile user device may be other computing devices in further embodiments including for example a tablet, a smart watch, a personal digital assistant a laptop and a smart camera. The mobile user device may alternatively be an electronic control device dedicated to the robotic suitcase 100 (i.e., has no uses other than controlling the robotic suitcase). In a further embodiment, the user device may be incorporated into an item of jewelry or clothing worn by a user. The suitcase 100 further include antennas to extend the range of the wireless communication devices so that the suitcase 100 may maintain communication with the user device at longer distances. The suitcase 100 may further include an antenna extender, which may be used to further extend the range of the wireless communications device.
The suitcase 100 may also include other types of sensors or devices for gathering information about its surroundings, such as touch sensors, speed sensors, accelerometers, and gyroscopes. The suitcase 100 may also have a GPS device for gathering data about the suitcase's location so that a traveler may track the location of the suitcase 100 if it gets lost. The suitcase 100 may also have a built in scale to automatically indicate the weight of the suitcase 100, so that the traveler would not have to manually weigh the suitcase 100.
Locomotion
In one embodiment, the power transmission system 2300 comprises a motor-side inner panel 2402, a first drive shaft 2510, a drive shaft gear 2410, a first large gear 2420, a small gear 2430, a second shaft 2810, a second large gear 2440, a third shaft 2710, and a wheel-side outer panel 2404. In one embodiment, the drive shaft 2510 connects the motor to the drive shaft gear 2410.
The drive shaft 2510 may have four protrusions that may be inserted into corresponding slots in the center of the drive shaft gear 2410 to lock the drive shaft 2510 into the drive shaft gear 2410 so that they would rotate together. Thus, a motor 2310 is able to rotate the drive shaft gear 2410 by rotating the drive shaft 2510.
The drive shaft gear 2410 may interface with the first large gear 2420. The first large gear 2420 may be secured to the inner and outer panels by the second shaft 2810, which may be inserted through circular slots on the inner and outer panels as well as a circular slot in the center of the first large gear 2420. In this way, the position of the first large gear 2420 is secured relative to the inner 2402 and outer panels 2404 and may rotate around the second shaft 2810 freely.
The drive shaft gear 2410 may have a plurality of teeth around its circumference that interface with the teeth on the first large gear 2420. The teeth of the drive shaft gear 2410 may have the same pitch as the teeth of the first large gear 2420 so that the gears mesh and the first large gear 2410 may be rotated by the drive shaft gear 2410.
Because the circumference of the first large gear 2420 is greater than that of the drive shaft gear 2410, each full rotation of the drive shaft gear 2410 causes the first large gear 2420 to move a fraction of a single rotation. In one embodiment, one-hundred rotations of the drive shaft gear 2410 causes the first large gear to rotate through ten full rotations. This configuration multiples the amount of torque that the motor 2310 may apply while reducing the number rotations the motor 2310 may create with each rotation of the drive shaft 2510.
The small gear 2430 may be integrally connected to the first large gear 2420. Thus, every ten rotations of the first large gear results in a similar ten rotations of the small gear 2430. The small gear 2430 may interface with the second large gear 2440. The second large gear's 2440 position may be secured relative to the inner panel 2402 and outer panel 2404 in a similar fashion as the manner in which the first large gear 2420 is secured. A third shaft 2710 may be fitted through circular slots in the inner panel 2402 and outer panel 2404 and also through the slot 2520 at the center of the second large gear 2440. The slot 2520 may have a flat surface for locking the third shaft 2710 with the second large gear 2440 so that they would rotate together. Thus, each rotation of the second large gear 2440 causes one rotation of the third shaft 2710, which in turn connects to the omni wheels 250, causing those wheels 250 to rotate accordingly.
The small gear 2430 may have teeth that are of the same pitch as the teeth of the second large gear 2440. In one embodiment, this pitch may be different than the pitch and/or pattern as the pitch of the first large gear 2420 and the drive shaft gear 2410. In one embodiment, the circumference of the second large gear 2440 is similar to that of the first large gear 2420, both of which having a circumference that is greater than that of the small gear 2430. Consequently, it may require many rotations of the small gear 2430 against the second large gear 2440 to make one full rotation of the second large gear 2440. In one embodiment, ten rotations of the small gear 2430 causes the second large gear 2440 to rotate once.
Altogether, given this configuration of the power transmission system 2300, when the motor 2310 rotates the drive shaft gear 2410 one-hundred times, it causes the first large gear 2420 and the small gear 2430 to perform ten rotations, and the second large gear 2440, the third shaft 2710, and the omni wheel to perform one full rotation. The use of two large gears 2420 and 2440 and an intermediary small gear 2430 allows for more compact design than using a single large gear that interfaces with the drive shaft gear 2410. In one embodiment, this configuration allows the robotic suitcase 100 to move at a speed of 6.75 miles per hour or 10.86 kilometers per hour. In an alternative embodiment, the suitcase 100 may move up to 15 miles per hour. It is understood that in further embodiments, the suitcase 100 may move at a wide variety of speeds depending on its configuration.
System and Software
The user device 2910 may be within the area of influence 2920 or outside it. For example, the user device 2910 may move far away from where the suitcase 100 is located such that the suitcase 100 may not be able to detect the user device or easily move to the device's location. Alternatively, the user device 2910 might not be too far away, but is positioned in a location that is unreachable by the suitcase 100, such as on top of a building.
In one embodiment, the suitcase 100 comprises a controller, such as a computer 2911 or other processor, a battery 2912, one or more sensors 2913, one or more motors 2914, one or more wireless communication devices 2915, and one or more peripheral devices 2916. The suitcase 100 may be communicatively connected to the user device 2910 via its wireless communication devices 2915, such as a Bluetooth device, or a Wi-Fi device.
In one embodiment, the memory 3020 may comprise a sensor data analysis module 3020A, a path planning module 3020B, a motor control module 3020C, a peripheral control module 3020D, and a neural net training module 3020E.
In one embodiment, the computer (or processor) 2911 controls the operation of the robotic suitcase 100 and the interaction between the suitcase 100 and the mobile device 2910. The computer (or processor 2911) may employ an autonomous target tracking control system (ATTS) 3018 (
The first subsystem for determining a user device in general connects to the robotic suitcase using a Bluetooth protocol. The first time connecting, the user device and robotic suitcase may undergo authentication protocols to pair with each other. Thereafter, only that particular user device is considered as a trusted device. The robotic suitcase will not pair with other user devices until the user disconnects a paired user device from the robotic suitcase. After the first activation of the robotic suitcase and establishing connection, the robotic suitcase's system is calibrated. After calibration, the robotic suitcase is ready to operate. The system with very high accuracy (for example 5-15 degrees) determines the user's position and follows him, observing the set distance and the optimum speed (explained below). The first subsystem may consists of hardware (4 special directional circular polarization antennas and 4 Bluetooth Low Energy modules) and the software (mathematical algorithms and information processing from antennas) for determining and pairing with a user device. Once paired, the first subsystem determines (or causes to be determined) the angle between the user device and the robotic suitcase. In embodiments, the maximum distance at which the pairing is effective is 40m, but it may be greater or lesser than that in further embodiments.
The robotic suitcase 100 may track the user device 2920 using Bluetooth low energy modules, such as for example BLE 4.0 CC254xEMv2. The Bluetooth modules may use a variety of antenna, including for example those using SMA Antenna Minimal System Integrated Circuits with the connected and integrated directional or bipolar antennas (on the top shell of the suitcase)+camera (on the top shell of the suitcase) for the precise distance and angle calculation to the target user. The robotic suitcase 100 may follow the footsteps of the user (follow the path taken by the user device 2920). Alternatively, the robotic suitcase 100 may continuously determine and update a shortest path (a straight line in the absence of obstacles) between the user device 2920 and the robotic suitcase and follow that shortest path.
Such Bluetooth modules and antenna have a wide area of connectivity with the user device 2920, such as for example 30m in all directions. However, it may happen that the robotic suitcase 100 loses track of the user device 2920, either as a result of being out of range, or loss of power. In such an instance, the robotic suitcase 100 may send a notification to the user, either to the user device 2920 or other smart appliance (e.g. mobile phone) of the user. The notification may be sent using a mobile application associated with the operation of the robotic suitcase 100 and may be communicated by any wireless method, including text, phone call and/or email. In one example, the notification may alert the user as to the loss of tracking of the robotic suitcase, and in embodiments, the notification may guide the user to the robotic suitcase 100, for example using transmitted GPS coordinates of the robotic suitcase 100.
The second subsystem may consist of one camera module 3200 (
It is understood that camera module 3200 may also be used to capture a scene around the robotic suitcase, which can be used by the ATTS control 3018 to assist in navigation.
The third subsystem for determining the user using a variety of distance-measuring sensors may make use of 3 ultrasonic sensors located on the front of the robotic suitcase, 1 infrared sensor on the top cap (under the handle) of the robotic suitcase, 2 infrared sensors near the telescopic handle of the robotic suitcase, 2 infrared distance sensors on the right and left sides of the robotic suitcase, and 2 ultrasonic sensors and 1 infrared sensor located on the back side of the robotic suitcase. Using these sensors, the user device and/or the user may be tracked and followed.
The fourth subsystem for detecting and avoiding obstacles based on distance sensors may consists of 3 ultrasonic sensors and 1 infrared sensor located on the front of the robotic suitcase, 2 infrared sensors near the telescopic handle of the robotic suitcase, 2 infrared sensors located on the left side of the robotic suitcase, 2 infrared sensors located on the right side of the robotic suitcase (optionally a lidar located on the top cover of the product), and 2 ultrasonic sensors and 1 infrared sensor located on the back side of the robotic suitcase. These may be the same sensors or different sensors than those used in the third subsystem. If an obstacle is detected, the system informs and corrects the route that the vehicle does not interfere with the obstacle. If it's impossible to bypass an obstacle or an unavoidable obstacle (e.g., a step) is detected—it may stop and signal to alert the user.
The computer 2911 may constantly receive feedback from the variety of sensors via the fourth subsystem to detect and avoid (move around) obstacles and to navigate uneven terrain as it tracks and follows the mobile device 2910. For example, when a stationary obstacle is detected, the robotic suitcase 100 may stop and/or the sensors may detect a shortest clear path around the obstacle for the suitcase to travel in order to continue following the mobile device.
Such obstacles may include structures or objects in a path of the robotic suitcase 100, or such obstacles may include abrupt decent changes, such as an open hole. The robotic suitcase 100 may use sensors including ultrasonic sensors for sensing structures or objects in its path, and the robotic suitcase 100 may use sensors including infrared proximity sensors for sensing abrupt decent changes. When a moving obstacle is detected (for example using the ultrasonic sensors), the computer 2911 may either chart a course to avoid the moving obstacle, or cause the suitcase to stop until the moving obstacle is clear.
The fifth subsystem of observing a given distance and optimal speed. The system consists of algorithms for incoming data processing from all other subsystems, analyzing them and deciding on driving speed (including acceleration and deceleration), rotation angles, and observing the optimal distance.
The sixth subsystem of sound and light notification consists of addressable LED ribbon lights (described above), and also a speaker. Using a variety of different light patterns in the LED ribbon lights, the sixth subsystem can inform of:
The robotic suitcase may have different locomotion control modes:
In joystick mode, the robotic suitcase is controlled to move using the manipulator implemented in the application. There are 3 sensitivity modes of the joystick available.
In find me mode, the robotic suitcase moves in any of a variety of predefined patterns searching for the user device and/or user, for example where the robotic suitcase is more than 40 m away from the user device and/or the robotic suitcase has lost the signal. The robotic suitcase may move at a minimum speed.
In follow me mode, the robotic suitcase follows the user. To enable this mode, the user should be in a reasonable distance (e.g., 1 m) from the robotic suitcase. After the mode is turned ON, the ATTS 3018 is guided by the user via the user device. After the user is ahead of the robotic suitcase, the remaining detection systems (the second and third subsystems) are also used determine the travel of the robotic suitcase. Further on, the fourth and fifth subsystems, using the data from first, second and third subsystems, control the optimal speed with a given distance.
The computer 2911 continuously receives a signal from the mobile device 2910 to identify the position of the mobile device 2910. The computer 2911 may send locomotion signals to the motors of the respective omni wheels that cause the suitcase 100 to track and follow the mobile device 2910. The user may configure a desired spacing between the suitcase 100 and mobile device as the user moves with the mobile device. Alternatively, a default spacing may be provided. In embodiments, such a default spacing is 0.5 to 1.5 meters, but it may be smaller or larger than that in further embodiments.
In one embodiment, the sensor data analysis module 3020A, the path planning module 3020B, the motor control module 3020C, the peripheral control module 3020D, and the AI training module 3020E may all have integrated artificial intelligence elements including neural networks, such as deep neural networks and convolutional neural networks, and machine learning functionalities. These neural networks may analyze input received from the suitcase's 100 sensors 2913 to generate pathing plans and commands for controlling the suitcase's 100 movements and functionalities. The neural networks may further be trained using machine learning functionalities to improve and optimize their computation speed, accuracy, and other performance measures. A prepared set of training data may be used for optimizing the neural networks. Training data may including information directed to sensor data, pathing plans used, control commands used, and user feedback. Additional training data may be collected and aggregated from other similar suitcases. Training of the neural networks may be supervised or unsupervised.
It is understood that the robotic companion suitcase system 2900 provides a platform upon which additional functionalities may be added. In one embodiment, a user may update existing software or download additional software to the computer 2911 of the robotic suitcase 100 as well as the user device 2910, such as software directed to improved locomotion behaviors and functionality. Additional hardware components may also be added to increase the functionality of the suitcase 100, such as additional sensors, peripheral devices, and accessories.
In embodiments described above, the robotic suitcase uses omni wheels 250 as shown in
The foregoing detailed description of the technology has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the technology to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. The described embodiments were chosen in order to best explain the principles of the technology and its practical application to thereby enable others skilled in the art to best utilize the technology in various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the technology be defined by the claims appended hereto.
The present application claims priority to Provisional Patent Application No. 62/520,463, filed Jun. 15, 2017, and Provisional Patent Application No. 62/530,744 filed Jul. 10, 2017, both of which applications are incorporated herein in there entireties.
Number | Date | Country | |
---|---|---|---|
62520436 | Jun 2017 | US | |
62530744 | Jul 2017 | US |