Patent Grant
11850499
This application is the U.S. National Phase under 35 U.S.C. § 371 of International Application No. PCT/KR2020/014925, filed on Oct. 29, 2020, which in turn claims the benefit of Korean Application No. 10-2020-0131501, filed on Oct. 12, 2020, the disclosures of which are incorporated by reference into the present application.
The present invention relates to an augmented reality based interactive sports device and, more particularly, to an augmented reality based interactive sports device using a LiDAR sensor.
As science advances, overall physical activity of modern people is declining, and most modern people lack sufficient activity. In particular, the population with adult diseases such as obesity is continuously increasing. In addition, as outdoor activities are restricted due to rapid weather changes, environmental pollution, fine dust, and infectious diseases, there is an increasing interest in exercise that allows enjoying sufficient physical activity indoors.
The most common exercise that can be done indoors is physical fitness. Physical fitness refers to creating a healthy and balanced body or performing exercise for the purpose thereof. Such fitness is generally done under personal guidance from a professional trainer in a fitness center equipped with professional equipment. However, it is difficult for modern people to visit a fitness center and regularly receive personal guidance from a professional trainer due to their busy daily life. In addition, it is very difficult to maintain fitness due to the high tuition fees.
Meanwhile, since exercise is done using equipment in general fitness, there is a risk of injury due to wrong exercise, and since the exercise capable of being done using professional equipment is limited, there is a problem in that users may easily get bored. In addition, in aerobic exercise done with equipment such as a treadmill, a set course is repeated so that the exercise process is monotonous. Thus, there is a problem in many cases where the user gives up on the exercise before finishing.
In order to overcome such problems, technologies that allow enjoying sports using virtual reality or augmented reality have been developed. Patent Publication No. 10-2020-0082990 (title of the invention: FITNESS MANAGEMENT METHOD THROUGH VR SPORTS) and the like have been disclosed as the related art.
However, the technology that enables enjoying sports using virtual reality in the related art has limitations in that it is difficult to obtain sufficient exercise effects due to inconvenient motions because the VR device should be worn on the head. In addition, there are limitations to using fitness or VR sports for the purpose of improving physical strength and education of children and adolescents, and the fitness or VR sports are mainly solo sports, whereby it is not suitable for promoting cooperation among children and adolescents.
In addition, user motion recognition has been performed using camera sensing in the related art. However, multi-user motion recognition cannot be performed simultaneously using camera sensing, so that the motion recognition should be performed separately for each user. As a result, there is a problem in that it is difficult for multiple users to enjoy sports together. Alternatively, a separate object should be used, and in this case, another problem that types of sports are limited has occurred.
Therefore, there is a need to develop a technology that allows multiple users to enjoy various sports together indoors.
The present invention has been made keeping in mind the above problems occurring in the related art, and an objective of the present invention is to provide an augmented reality based interactive sports device using a LiDAR sensor, which allows enjoying sports indoors only with the user's body without requiring a user to wear a separate object or device by projecting an image for sports content on the floor and tracking a user motion of the sports content using the LiDAR sensor to control the interaction between the sports content and the user, allows using the floor surface efficiently due to wide range of motion tracking, and allows quickly and accurately tracking a motion of each user by tracking a user motion using two LiDAR sensors even when multiple users are using sports content at the same time.
In order to achieve the above objective, an augmented reality based interactive sports device using a LiDAR sensor according to the present invention is provided
Preferably, the LiDAR sensor unit
Preferably, the LiDAR sensor unit
Preferably, the motion tracking unit
Preferably, the sensor connection unit
Preferably, Preferably, the augmented reality based interactive sports device may further include
Preferably, the augmented reality based interactive sports device may further include
Preferably, the augmented reality based interactive sports device may further include
According to an augmented reality based interactive sports device using a LiDAR sensor proposed in the present invention, it is possible to allow enjoying sports indoors only with the user's body without requiring a user to wear a separate object or device by projecting an image for sports content on the floor and tracking a user motion of the sports content using the LiDAR sensor to control the interaction between the sports content and the user, allow using the floor surface efficiently due to wide range of motion tracking, and allow quickly and accurately tracking a motion of each user by tracking a user motion using two LiDAR sensors even when multiple users are using sports content at the same time.
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. In the following detailed description of the preferred embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention unclear. The same reference numerals are used for portions having similar functions and configurations throughout the drawings.
In addition, throughout the specification, when a part is referred to as being “connected” to other part, it includes not only the case that the part is “directly connected” to the other part, but also the case that the part is “indirectly connected” to the other part with another device in between. In addition, “comprising any component” means that other components may be further included, rather than excluding other components, unless specifically stated otherwise.
The main body 110 may be a frame constituting the body of the augmented reality based interactive sports device 100, and may include a computer device with the control unit 160 mounted on its inner surface. The main body 110 may have a rectangular parallelepiped shape as shown in
The projector unit 120 is provided on the front of the main body 110 to project an image for sports content on the floor surface. As shown in
The LiDAR sensor unit 130 may be installed toward the projection direction of the projector unit 120. That is, in order to recognize a motion of a user using sports content in the projection area 10, the LiDAR sensor unit 130 may be disposed to cover the projection area 10. Herein, the LiDAR sensor included in the LiDAR sensor unit 130 may be RP LiDAR A3, and the laser scanning range may be on the order of 20 m. In particular, the LiDAR sensor unit 130 may be configured to include two LiDAR sensors 130b and 130b. A detailed configuration of the LiDAR sensor unit 130 will be described in detail later with reference to
The motion tracking unit 140 may track a user motion by recognizing the user's position according to the sports content using the LiDAR sensor unit 130. More specifically, the motion tracking unit 140 may use the LiDAR sensor unit 130 to recognize the position of the user's foot at a predetermined point from the ground, and track the user's motion by tracing a change in position of the user's foot. That is, the LiDAR sensor unit 130 may perform laser scanning for a plane at a height of about 5 cm from the ground to detect the presence and position of the user's foot. The motion tracking unit 140 may track a change in the position of the user's foot as the user motion.
In the user motion tracking method in the related art, visual sensing using cameras has been widely used. For example, a high-speed camera sensor, a 3D depth camera sensor, a Kinetic camera sensor, or the like may be used. With respect to the high-speed camera sensor, although it may be used for virtual reality exercise, there are limitations that continuous tracking for data processing is not possible, only one user may use the camera sensor at a fixed location, and a separate object is required. Because the 3D depth camera sensor detects and uses a change value at a specific depth, there are limitations that an event must be generated at a specific depth, only a small number of one to ten users can use the camera sensor at the same time, and a separate object is also required. Although the Kinetic camera sensor detects motions of a subject, there are limitations that the Kinetic camera sensor has a narrow sensing range due to an angle of view of the camera so that the user should exercise at a fixed position, resulting in narrow range of activity, and only one user may use the Kinetic camera sensor at a time.
In order to solve the limitations of the related art as described above, since the augmented reality based interactive sports device 100 using the LiDAR sensor according to an embodiment of the present invention includes a LiDAR sensor unit 130 and the motion tracking unit 140, the user may enjoy augmented reality sports only with his/her body without requiring the user to wear a separate object or device. Further, since a motion tracking range is wider so that the user may sufficiently use the floor surface including the projection area 10, it is possible for the user to exercise while moving around. In addition, since the LiDAR sensor unit 130 may track the positions of one to 30 people at the same time, the present invention may be applied to group sports, thereby providing the fun of exercising together and helping to develop a sense of cooperation.
The sensor connection unit 150 has one end connected to a side surface of a lower end of the main body 110 and the other end connected to the LiDAR sensor unit 130, so that the LiDAR sensor unit 130 may be connected to be spaced apart from the main body 110 by a predetermined distance. More specifically, as shown in
Meanwhile, the LiDAR sensor unit 130 may include two LiDAR sensors connected to each of both sides of the lower end of the main body 110 through the sensor connection unit 150. In particular, in the augmented reality based interactive sports device 100 using a LiDAR sensor according to an embodiment of the present invention, multiple users may be tracked quickly and accurately by tracking the user motion using two LiDAR sensors.
When the LiDAR sensor is used, a laser scanning shadow obscured by an object not to be reached by the laser is generated, so that the object located in the laser scanning shadow may not be detected. In the single LiDAR sensor, as long as the positions of two users do not overlap, there is no problem in motion tracking of each user. However, as shown in
Meanwhile, when two LiDAR sensors (dual LiDAR sensor) are used, the laser scanning shade area by the first LiDAR sensor unit 130a is scanned by the second LiDAR sensor unit 130b, so that the motion tracking of multiple users may be performed at the same time without interference. That is, as shown in
The control unit 160 outputs sports content through the projector unit 120 to provide the user with augmented reality based sports content. The control unit 14 may control interaction between the sports content and the user by using a user motion tracked by the motion tracking unit 140. That is, the control unit 160 may convert the user motion tracked by the motion tracking unit 140 into an input signal of the sports content to deliver the same, for the purpose of the interaction between the sports content and the user.
The communication unit 170 performs communication with the trainer terminal, provides the user's sports content use information to the trainer terminal, receives a control signal from the trainer terminal and transmits the same to the control unit 160, and provides the user with non-contact based training guidance. Here, it may be understood that various wireless communication methods may be applied to the communication unit 170, including Wi-Fi (Wireless Fidelity) with internet access, mobile radio communication network, satellite network, Bluetooth, Wibro (Wireless Broadband Internet), 3/4/5th Generation Mobile Telecommunication (3G/4G/5G), and LTE (Long Term Evolution).
The display unit 180 is provided on the front of the main body 110 to receive a selection signal of sports content and output play information related to the sports content. That is, as shown in
The speaker unit 190 may output a sound related to the sports content. The speaker may be installed on the front surface or side surface of the main body 110, and the volume thereof may be adjusted through the display unit 180.
In particular, the augmented reality based interactive sports device 100 using a LiDAR sensor according to an embodiment of the present invention is configured to include a projector unit 120, a LiDAR sensor unit 130, a motion tracking unit 140, a control unit 160, a communication unit 170, a display unit 180, and a speaker unit 190, so that a user may place the main body 110 at a specific place to easily enjoy sports content at the place.
Here, the trainer terminal may be implemented as an electronic device. The electronic device may include at least one of a smartphone, a tablet, a PC (personal computer), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, PDA (personal digital assistant), a media box, a game console, an electronic dictionary, or a wearable device. The wearable device may include at least one of accessory types (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or HMD (head mounted device)), all-in-one types of fabric or clothing (e.g. electronic clothing), body-worn types (e.g. a skin pad or tattoo), or an implantable circuit. According to various embodiments, the electronic device is not limited to the aforementioned devices, and may be a combination of two or more of the aforementioned various devices.
Meanwhile, the display unit 180 and the speaker unit 190 may output a real-time trainer image that the communication unit 170 receives from the trainer terminal. That is, as shown in
As describe above, according to an augmented reality based interactive sports device using a LiDAR sensor proposed in the present invention, it is possible to allow enjoying sports indoors only with the user's body without requiring a user to wear a separate object or device by projecting an image for sports content on the floor and tracking a user motion of the sports content using the LiDAR sensor to control the interaction between the sports content and the user, allow using the floor surface efficiently due to wide range of motion tracking, and allow quickly and accurately tracking a motion of each user by tracking a user motion using two LiDAR sensors even when multiple users are using sports content at the same time.
The present invention described above can be variously modified or applied by those of ordinary skill in the art to which the present invention pertains, and the scope of the technical idea according to the present invention should be defined by the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2020-0131501 | Oct 2020 | KR | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/KR2020/014925 | 10/29/2020 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2022/080548 | 4/21/2022 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20080218641 | Kjeldsen | Sep 2008 | A1 |
| 20190121522 | Davis | Apr 2019 | A1 |
| 20200075707 | Ko | Mar 2020 | A1 |
| 20210072818 | Liu | Mar 2021 | A1 |
| Number | Date | Country |
|---|---|---|
| 20170008896 | Jan 2017 | KR |
| 20190055364 | May 2019 | KR |
| 102088333 | Mar 2020 | KR |
| 20200075707 | Jun 2020 | KR |
| 20200082990 | Jul 2020 | KR |
| 20200092389 | Aug 2020 | KR |
| 102233395 | Mar 2021 | KR |
| WO2010015274 | Feb 2010 | WO |
| Entry |
|---|
| International search report of PCT/KR2020/014925, dated Jul. 9, 2021, English translation. |
| Number | Date | Country | |
|---|---|---|---|
| 20230241483 A1 | Aug 2023 | US |
