Patent Grant
11487413
The present invention relates to a mobile device capable of simulating the installation of an imaging device using augmented reality technology and a method of controlling the mobile device.
Mobile devices are devices that provide various functions based on the mobility thereof and are widely used in various fields. Such a mobile device includes various function modules to provide various functions. For example, the mobile device includes a camera module that provides an image capturing function.
There is augmented reality technology as a technology using a camera module of a mobile device. Augmented reality technology refers to graphic technology that combines a virtual object or virtual information with a real environment to make the virtual object or virtual information appear like an object present in the real environment.
Unlike the existing virtual reality technologies implemented using virtual spaces and virtual objects, augmented reality technologies combine virtual objects in real spaces. Therefore, the augmented reality technology has features that can reinforce and provide pieces of additional information that is difficult to acquire only in the real world. Such augmented reality technology can be applied to various real environments and is particularly in the spotlight as next generation display technology suitable for a ubiquitous environment.
The present invention is directed to providing a mobile device allowing a user to realistically simulate the installation of an imaging device by displaying a virtual image corresponding to the imaging device having an actual size together with an image of a real space in which the imaging device is to be installed, and a method of controlling the mobile device.
The present invention is also directed to providing a mobile device capable of performing calibration on pixel values of a display device including a plurality of display modules using a camera of the mobile device, and a method of controlling the mobile device.
According to one embodiment of the present invention, a mobile device includes a display, a camera configured to photograph a space in which an imaging device is to be installed, a user interface unit configured to receive a user input, and a control unit configured to control the display to display an image of the space photographed by the camera together with a grid and control the display to display a virtual image of the imaging device having an adjusted size on the grid in response to the user input.
In response to the user input of selecting at least one cell included in the grid, the control unit may control the display to display the virtual image of the imaging device on the selected at least one cell.
In response to the user input of selecting an additional cell from the grid, the control unit may control the display to display the virtual image of the imaging device on the selected additional cell.
The control unit may recognize at least one of a specific pattern and a specific object from the image of the space to recognize a plane on which the imaging device is installable and may control the display to display the grid on the recognized plane.
The control unit may control the display to display the image of the space and a guide line together, may recognize the plane based on the guide line, and may control the display to display the grid on the recognized plane.
In response to the user input of changing a size of a cell of the grid, the control unit may control the display to display the grid having the cell with the changed size together with the image of the space.
In response to the user input of selecting the virtual image of the imaging device, the control unit may control the display to display one or more virtual content images around the virtual image of the imaging device.
In response to the user input of selecting any one virtual content image of the one or more virtual content images, the control unit may control the display to display first content corresponding to the selected virtual content image in an area of the virtual image of the imaging device.
In response to the user input of additionally selecting the virtual content image, the control unit may divide the area of the virtual image of the imaging device into a first area and a second area and may control the display to display the first content and second content corresponding to the additionally selected virtual content image in the first area and the second area, respectively.
The mobile device may further include a communication unit connected to an external server, wherein the control unit acquires purchase information about the imaging device corresponding to the virtual image of the imaging device from the external server and controls the display to display the purchase information about the imaging device together with the virtual image of the imaging device.
According to one embodiment of the present invention, a method of controlling a mobile device includes photographing a space, in which an imaging device is to be installed, using a camera; displaying an image of the space photographed by the camera together with a grid on a display; and in response to a user input, displaying a virtual image of the imaging device, of which a size is adjusted, on the grid.
The displaying of the virtual image of the imaging device on the grid may include, in response to the user input of selecting at least one cell included in the grid, displaying the virtual image of the imaging device on the selected at least one cell.
The displaying of the virtual image of the imaging device on the grid may further include, in response to the user input of selecting an additional cell from the grid, displaying the virtual image of the imaging device on the selected additional cell.
The displaying of the image of the photographed space together with the grid on the display may include recognizing at least one of a specific pattern and a specific object from the image of the space to recognize a plane on which the imaging device is installable and displaying the grid on the recognized plane.
The displaying of the image of the photographed space together with the grid on the display may further include displaying the image of the space and a guide line together on the display, and recognizing the plane based on the guide line and displaying the grid on the recognized plane.
The displaying of the image of the photographed space together with the grid on the display may further include, in response to the user input of changing a size of a cell of the grid, displaying the grid having the cell with the changed size together with the image of the space.
The method may further include, in response to the user input of selecting the virtual image of the imaging device, displaying one or more virtual content images around the virtual image of the imaging device.
The method may further include, in response to the user input of selecting any one virtual content image of the one or more virtual content images, displaying first content corresponding to the selected virtual content image in an area of the virtual image of the imaging device.
The method may further include, in response to the user input of additionally selecting the virtual content image, dividing the image of the virtual image of the imaging device into a first area and a second area and displaying the first content and second content corresponding to the additionally selected virtual content image in the first area and the second area, respectively.
The method may further include acquiring purchase information about the imaging device corresponding to the virtual image of the imaging device from an external server, and displaying the purchase information about the imaging device together with the virtual image of the imaging device.
According to a mobile device and a method of controlling the mobile device according to one aspect, a virtual image corresponding to an imaging device with an actual size is displayed together with an image of a real space in which the imaging device is to be installed, thereby allowing a user to realistically simulate the installation of the imaging device.
In addition, according to a mobile device and a method of controlling the mobile device according to one aspect, content is displayed in an area of a virtual image corresponding to an imaging device with an actual size, thereby performing a more realistic simulation of the installation of the imaging device.
According to a mobile device and a method of controlling the mobile device according to another aspect, calibration can be performed on pixel values of a display device including a plurality of display modules using a camera of the mobile device.
Embodiments described herein and configurations shown in the accompanying drawings are only examples of exemplary embodiments of the present invention, and various modifications may be made at the time of filing of the present invention to replace the embodiments and drawings of the present specification. The terms used herein are for the purpose of describing the embodiments and are not intended to restrict and/or to limit the present invention.
The term “unit” used throughout the specification may be implemented in software and/or hardware, and a plurality of “units” may be implemented as one element, or one “unit” may include a plurality of elements. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. In addition, the term “first” or “second” is used to distinguish one part from another and does not mean a sequential expression unless otherwise specified.
In addition, in this specification, the terms “including,” “having,” and the like are used to specify features, numbers, steps, operations, elements, components, or combinations thereof but do not preclude the presence or addition of one or more other features, numbers, steps, operations, elements, components, or combinations thereof.
In addition, terms including ordinal numbers such as “first,” “second,” and the like are used herein to distinguish one element from another element and do not limit one element. In addition, terms such as “unit,” “device,” “block,” “member,” “module” etc. used in the present specification may denote a unit for processing at least one function or operation. For example, the terms may denote at least one process executed using at least one piece of hardware, at least one piece of software stored in a memory, or a processor.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same reference numerals or symbols shown in the accompanying drawings may indicate components or elements performing substantially the same function.
First, a mobile device 1 according to one embodiment includes an device capable of providing augmented reality as a portable device. For example, the mobile device 1 may be implemented as a device, such a mobile phone, a portable multimedia player (PMP), a digital broadcasting player, a personal digital assistant (PDA), a music file player (for example, an MP3 player), a portable game terminal, a tablet personnel computer (PC), or a smartphone, which may be provided with a camera to provide augmented reality. Hereinafter, for convenience of description, it is assumed that the mobile device 1 is a smartphone.
Referring to
The camera 100 may photograph a space in which an imaging device is to be installed. The camera 100 is a camera module that is typically mounted on the mobile device 1. The camera 100 may include a lens, an image sensor such as a charge coupled device (CCD), a complementary metal-oxide semiconductor (CMOS), and an analog-to-digital converter. The camera 100 converts an image acquired by capturing a subject into a digital signal to transmit the digital signal to the control unit 600. The control unit 600 to be described below may process an image converted into a digital signal.
The UI unit 210 receives and transmits a user input to the control unit 600. The UI unit 210 may include various user input units such as a key pad, a dome switch, a (pressure/capacitive) touch pad, a jog wheel, and a jog switch.
In addition, the UI unit 210 may be a display 310 equipped with a touch panel. The UI unit 210 may be handled the same as the display 310 which senses a user input such as a touch gesture and simultaneously displays a processing result of the user input as an image. The UI unit 210 may display a UI element, through which the mobile device 1 may be controlled, on the display 310.
The microphone 220 may receive and convert an audio signal into an electrical signal to transmit the electrical signal to the control unit 600. The microphone 220 may receive a voice command of a user and transmit the voice command to the control unit 600, and the control unit 600 may control the mobile device 1 in response to the voice command of the user.
The output unit 300 may be a device capable of outputting an image signal or an audio signal and may correspond to various devices. Specifically, the output unit 300 may include at least one of the display 310 and a speaker 320. The speaker 320 may output audio signals related to various functions of the mobile device 1.
The display 310 may display information input by a user or information provided to the user on various screens. The display 310 displays information processed by the control unit 600. For example, the display 310 may display an image of a space photographed by the camera 100 and may display an augmented reality image in which a virtual image is combined with the image of the space. The display 310 may display a graphical UI (GUI) related to various functions of the mobile device 1.
In addition, the display 310 may include a touch panel to be used as an input device. The display 310 may be implemented as a liquid crystal display, a thin film transistor liquid crystal display, an organic light-emitting diode display, a flexible display, or a three dimensional (3D) display.
The communication unit 400 connects the mobile device 1 to an external device, an external server, or the like through a network or a communication channel. The communication unit 400 may include various communication modules. For example, the communication unit 400 may include communication modules connectable to various communication networks such as Bluetooth, ZigBee, a wireless local area network, a home radio frequency (RF), an ultra-wide band (UWB), and the Internet.
Programs and data for controlling the operation of the mobile device 1 may be recorded/stored in the storage unit 500. In addition, the storage unit 500 may store input/output data (for example, messages, still images, and videos).
The storage unit 500 may correspond to a memory and may include volatile memories such as a static random access memory (S-RAM) and a dynamic random access memory (D-RAM) and nonvolatile memories for storing data for a long time, such as a read only memory, an erasable programmable read only memory (EPROM), and an electrically erasable programmable read only memory (EEPROM).
The control unit 600 may include a processor that generates a control signal for controlling the operation of the mobile device 1 according to a program and data stored/recorded in the storage unit 500. The processor may include a logic circuit and an operation circuit and may process data according to a program provided from the storage unit 500 and may generate a control signal according to a processing result.
In addition, the processor and the memory may be implemented as separate chips or as a single chip. The control unit 600 may include a plurality of processors and a plurality of memories.
Referring to
The space recognition unit 610 may recognize a plane from an image of a space, in which an imaging device photographed by the camera 100 is to be installed, in response to a user input. Specifically, the space recognition unit 610 may distinguish and recognize a wall surface W, a floor surface 10, and a ceiling surface included in an image of a real space. The imaging device may have a planar or curved shape, but for convenience of description, it is assumed that the imaging device has a planar shape. Furthermore, the imaging device may be installed at various positions but is generally installed on a wall surface.
The imaging device is an electronic device capable of displaying an image and refers to a display module. The display module may be a light-emitting diode (LED) module including at least one LED pixel or an LED cabinet in which a plurality of LED modules are connected. A plurality of display modules may be physically connected to form one screen. That is, the imaging device may be a device in which the plurality of display modules are connected and assembled.
In addition, the space recognition unit 610 may store data about a plane recognized from an image of a specific space in the storage unit 500 and may fetch data about a plane from the storage unit 500. When an image of a space photographed by the camera 100 is the same as an image of a space stored in the storage unit 500, the space recognition unit 610 may fetch data about a plane included in the photographed space from the storage unit 500.
As described above, the mobile device 1 according to one exemplary embodiment can automatically recognize a space or a plane in which an imaging device is installable, and thus, it can be easier for a user to simulate the installation of the imaging device.
The virtual image generation unit 620 may generate a virtual image of an object. The generated virtual image of the object may interact with a user input, and a user may select, move, and change the virtual image of the object.
For example, the virtual image generation unit 620 may generate a grid image that is to be displayed on a plane recognized from an image of a space. The grid image is an image of a grid pattern and is an image having a plurality of cells with a certain size. A size of a grid cell may be changed in response to a user input. The virtual image generation unit 620 may generate a grid image having cells with a size changed in response to a user input of changing a size of a grid cell.
In addition, the virtual image generation unit 620 may generate a virtual image of an imaging device and virtual content images that may be displayed around the virtual image of the imaging device. Content is various types of data such as a photo, a video, a sound, and a text, and virtual content images are virtual images including such content information. In addition, content corresponding to a virtual content image may be stored in the storage unit 500 or may be received from the external server or the like through the communication unit 400.
The augmented reality processing unit 630 may display an image of a real space and a virtual image together on the display 310. Specifically, the augmented reality processing unit 630 may generate an augmented reality image obtained by combining an image of a real space and a virtual image and display the generated augmented reality image on the display 310.
The augmented reality processing unit 630 may display a grid image generated by the virtual image generation unit 620 on an image of a space photographed by the camera 100 and may control the display 310 to display a virtual image of an imaging device concurrently on the grid in response to a user input. In addition, the augmented reality processing unit 630 may control the display 310 to display an image of a real space, a virtual image of an imaging device, and a virtual content image together.
As described above, since a virtual image corresponding to an imaging device having an actual size is displayed together with an image of a real space in which the imaging device is to be installed, a user can realistically simulate the installation of the imaging device.
Referring to
The control unit 600 controls a display 310 to display the image of the photographed space together with a grid. Specifically, the control unit 600 may display a grid including a plurality of cells having a certain size on the plane recognized from the image of the photographed space (705). A UI unit 210 receives an input of selecting at least one cell on the displayed grid from a user (706). In response to a user input of selecting at least one cell, the control unit 600 may generate a virtual image of the imaging device on the selected at least one cell and may control the display 310 to display the generated virtual image of the imaging device together with the image of the photographed space and a grid image (707).
In addition, when a user input of selecting the displayed virtual image of the imaging device is received through the UI unit 210, the control unit 600 may generate one or more virtual content images around the virtual image of the imaging device and may control the display 310 to display the virtual content images. When a user input of selecting any one virtual content image of one or more virtual content images is received, the control unit 600 may control the display 310 to display first content corresponding to the selected virtual content image in an area of the virtual image of the imaging device (708).
As described above, a virtual image corresponding to an imaging device having an actual size is displayed together with an image of a real space in which the imaging device is to be installed, and content is reproduced in an area of the virtual image corresponding to the imaging device having the real size, thereby performing a more realistic simulation of the installation of the imaging device.
In addition, the control unit 600 may acquire purchase information about a real imaging device corresponding to the virtual image of the imaging device from an external server (not shown) and may control the display 310 to display the purchased information about the imaging device together with the virtual image of the imaging device (709).
A user can purchase and install an imaging device that is identical to that simulated by the user so that it is possible to minimize an error that may occur when the imaging device is actually installed.
Hereinafter, the features of the present invention will be described in more detail with reference to
Referring to
Referring to
Referring to
As described above, a space or a plane in which an imaging device is installable can be automatically recognized so that it can be easier for a user to simulate the installation of the imaging device. In addition, a grid is displayed on a plane in which an imaging device is installable so that a user can easily adjust a size of the imaging device to perform a simulation. Furthermore, a virtual image of an imaging device having a size equal to a size of an actual imaging device is displayed, thereby performing a more realistic simulation.
Referring to
In this case, the virtual images 30 of the imaging device may be displayed after the plurality of cells 21 are selected or may be sequentially displayed according to the order of the selected cells 21 while the plurality of cells 21 are selected. In addition, the control unit 600 may control the display 310 to distinguish and display the selected cells 21 while the plurality of cells 21 are selected. For example, a color of the selected cell 21 may be changed and displayed.
In addition, a size of one cell 21 may be changed in response to a user input. The change of the size of the cell 21 will be described in detail with reference to
In addition, the control unit 600 may display a GUI required to simulate the installation of an imaging device on the display 310. Specifically, the control unit 600 may generate and display a guide icon 40 for setting whether to display a grid 20, a cell icon 50 for changing a size of a cell 21, an order icon 60 for requesting purchase information corresponding to a displayed virtual image 30 of an imaging device or a purchase, and a clear icon 70 for deleting the displayed virtual image 30 of the imaging device on the display 310.
Referring to
In this case, even when the user moves a mobile device 1 to change a direction in which the camera 100 faces, the virtual image 30 of the imaging device may be displayed as if the imaging device is fixed to the wall surface of the real space.
In addition, when the camera 100 faces another area of the wall surface W, the user may connect and select the cell 21 of the grid 20 displayed on another area of the wall surface W. In other words, when a user input of selecting the cells 21 is maintained within the grid 20, the control unit 600 may connect the cell 21 that has already been selected and thus is not displayed on the display 310 to the cell 21 that is displayed on the display 310 and selected. Therefore, when the user selects the cell 21 of the grid 20, a facing direction of the camera 100 does not need to be fixed.
Referring to
Referring to
The size menu 51 of the unit cell may be provided to select a unit cell 51a having a horizontal length to vertical length ratio of 1:1 or a unit cell 51b having a horizontal length to vertical length ratio of 16:9. A horizontal length, a vertical length, and a ratio of the horizontal length to the vertical length of the unit cell 21 may be variously determined according to an actual size of an imaging device. In addition, a size of the unit cell 21 may be determined according to a size of a display module that is to constitute the imaging device.
In
Referring to
In response to a user input of selecting an additional cell on a grid 20, a control unit 600 may control a display 310 to display a virtual image 31 of an additional imaging device on the selected additional cell.
Referring to
For example, when the virtual image 30 of the existing imaging device includes 14 (7×2) cells, and the number of additionally selected cells is 12 (6×2) or 8 (2×4), the control unit 600 may control the display 310 to display the virtual image 30 of the existing imaging device and the virtual image 31 of the additional imaging device so as to be distinguished from each other.
In other words, when a horizontal or vertical length of the additional imaging device corresponding to the plurality of additionally selected cells is different from a horizontal or vertical length of the virtual image 30 of the existing imaging device, the virtual image 31 of the additional imaging device may be displayed so as to be distinguished from the virtual image 30 of the existing imaging device.
In addition, when a user selects additional cells so as to include an area of a virtual image 30 of an existing imaging device, the control unit 600 may allow a virtual image of the additional imaging device to be displayed only in an area excluding the area of the virtual image 30 of the existing imaging device.
Alternatively, referring to
In addition, referring to
Meanwhile, referring to
As described above, a user can easily adjust the size and number of virtual images of imaging devices, thereby variously simulating the installation of the imaging device.
Referring to
Specifically, when a user performs a touch input on the virtual image 31 of the imaging device, the virtual content image 80a including a thumbnail image of content reproducible in the virtual image 31 of the imaging device may be generated and displayed on the display 310.
One or more virtual content images 80a may be arranged in various patterns. For example, one or more virtual content images 80a may be arranged in a circular shape so as to surround the virtual image 31 of the imaging device or may be arranged vertically or diagonally based on the virtual image 31 of the imaging device.
In addition, in response to a user input of selecting any one virtual content image of one or more virtual content images 80a, the control unit 600 may control the display 310 to display first content corresponding to the selected virtual content image 80a in an area of the virtual image 31 of the imaging device.
That is, in
Referring to
In a state in which one or more virtual content images 80a corresponding to a first category are displayed around a virtual image 31 of an imaging device, when a swipe gesture of a user is input to any area on the display 310, the control unit 600 may display one or more virtual content images 80b corresponding to a second category, which are around the virtual image 31 of the imaging device, on the display 310. In this case, one or more virtual content images 80a corresponding to the first category may not be displayed on the display 310 and may be displayed again according to a swipe gesture input of a user.
As described above, various pieces of content belonging to various categories can be produced in an area of a virtual image of an imaging device so that a user can perform a more realistic simulation.
Referring to
Specifically, in a state in which the first content is displayed in an area of the virtual image 31 of the imaging device, when a user inputs a gesture for selecting a virtual content image including second content information and moving the selected virtual content image to the area of the virtual image 31 of the imaging device, both the first content and the second content may be displayed in the area of the virtual image 31 of the imaging device.
That is, in response to a user input, the control unit 600 may divide the area of the virtual image 31 of the imaging device into a plurality of areas and may simultaneously display a plurality of pieces of content in the plurality of divided areas.
On the other hand, referring to
As described above, the area of the virtual image 31 of the imaging device can be divided into a plurality of areas to simultaneously display a plurality of pieces of content so that a user can realistically simulate the installation of a multi-screen.
In addition, as described above, according to a mobile device and a method of controlling the mobile device according to one aspect, since a virtual image corresponding to an imaging device with an actual size is displayed together with an image of a real space in which the imaging device is to be installed, a user can realistically simulate the installation of the imaging device.
Furthermore, according to a mobile device and a method of controlling the mobile device according to one aspect, content is displayed in an area of a virtual image corresponding to an imaging device with an actual size, thereby performing a more realistic simulation of the installation of the imaging device.
Referring to
The control unit 600 of the mobile device 1 transmits reference images stored in a storage unit 500 to the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 through the communication unit 400 (2103). The reference image refers to an image having a reference pixel value in a calibration process. The plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 may all display the same reference image. In addition, the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 may display different reference images.
A camera 100 of the mobile device 1 photographs a display device including the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 and acquires images of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 that display the reference images (2104).
The control unit 600 extracts pixel values of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 from the images of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 that display the reference images (2105).
Each of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 includes a plurality of pixels, and each of the plurality of pixels has pixel values such as a color, luminance, and brightness. In addition, since the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 independently receive power and independently operate, the display modules S1, S2, S3, S4, S5, S6, S7, and S8 may have different pixel values.
When the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 have different pixel values, a user who views the display device may feel eye strain. Therefore, the pixel values of the display modules S1, S2, S3, S4, S5, S6, S7, and S8 need to be adjusted to be uniform.
The control unit 600 compares the extracted pixel values of the display modules S1, S2, S3, S4, S5, S6, S7, and S8 with the reference images and calculates correction values to be applied to the display modules S1, S2, S3, S4, S5, S6, S7, and S8 (2106). The control unit 600 controls the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 using the calculated correction values such that the pixel values of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 become uniform (2107).
When a difference between the pixel values of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 is within a preset range, the control unit 600 determines that the pixel values of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 are uniform, thereby ending a calibration process (2108).
When the difference between the pixel values of the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 is out of the preset range, the control unit 600 may control the camera 100 to again photograph the plurality of display modules S1, S2, S3, S4, S5, S6, S7, and S8 that display images with corrected pixel values. Thereafter, the control unit 600 repeatedly performs a calibration process based on an image captured by the camera 100.
As described above, instead of manually adjusting pixel values of a plurality of display modules, the pixel values of the plurality of display modules can be calibrated using the camera 100 of the mobile device 1. Accordingly, it is possible to increase user convenience in performing calibration, and it is possible to reduce the time required for calibration.
Meanwhile, the provided embodiments can be implemented as recording media storing computer-executable instructions. The instructions can be stored in the form of program code, and generate, when executed by a processor, a program module such that the operation of the provided embodiments can be performed. The recording media can be implemented as computer-readable recording media.
The computer-readable recording media include all types of recording media in which instructions that can be read by a computer are stored. Examples of the computer-readable recording media include a read only memory (ROM), a random access memory (RAM), a magnetic tape, a magnetic disc, a flash memory, an optical data storage device, and the like.
The disclosed embodiments have been described above with reference to the accompanying drawings. It will be understood by those of ordinary skill in the art to which the disclosed embodiments belong that the disclosed embodiments can be implemented in different forms from the disclosed embodiments without departing from the spirit and scope of the disclosed embodiments. The disclosed embodiments are illustrative and should not be construed as restrictive.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2018-0121724 | Oct 2018 | KR | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/KR2019/001939 | 2/19/2019 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2020/075925 | 4/16/2022 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 7199934 | Yamasaki | Apr 2007 | B2 |
| 9201625 | Karkkainen | Dec 2015 | B2 |
| 9330478 | Anderson | May 2016 | B2 |
| 9335547 | Takano | May 2016 | B2 |
| 9361732 | Ebstyne | Jun 2016 | B2 |
| 9530232 | Maciocci | Dec 2016 | B2 |
| 9927877 | Cox | Mar 2018 | B2 |
| 10262226 | Flowers | Apr 2019 | B1 |
| 10281976 | Nishizawa | May 2019 | B2 |
| 10692287 | Evans | Jun 2020 | B2 |
| 11145096 | McHugh | Oct 2021 | B2 |
| 11258891 | Hoellwarth | Feb 2022 | B2 |
| 20050068290 | Jaeger | Mar 2005 | A1 |
| 20110157400 | Kim | Jun 2011 | A1 |
| 20110273369 | Imai | Nov 2011 | A1 |
| 20120206334 | Osterhout | Aug 2012 | A1 |
| 20120302289 | Kang | Nov 2012 | A1 |
| 20130050258 | Liu | Feb 2013 | A1 |
| 20130325317 | Pylappan | Dec 2013 | A1 |
| 20140037189 | Ziegler | Feb 2014 | A1 |
| 20140063060 | Maciocci | Mar 2014 | A1 |
| 20140300733 | Mitchell | Oct 2014 | A1 |
| 20160073080 | Wagner | Mar 2016 | A1 |
| 20160267712 | Nartker | Sep 2016 | A1 |
| 20160291699 | Katz | Oct 2016 | A1 |
| 20160364907 | Schoenberg | Dec 2016 | A1 |
| 20170031357 | Bear | Feb 2017 | A1 |
| 20170090269 | Huang et al. | Mar 2017 | A1 |
| 20170161928 | Huang | Jun 2017 | A1 |
| 20170256096 | Faaborg | Sep 2017 | A1 |
| 20170323488 | Mott et al. | Nov 2017 | A1 |
| 20180004401 | Travis | Jan 2018 | A1 |
| 20180300952 | Evans | Oct 2018 | A1 |
| 20190018479 | Minami | Jan 2019 | A1 |
| 20190065027 | Hauenstein | Feb 2019 | A1 |
| 20200051337 | Reynolds | Feb 2020 | A1 |
| 20210038975 | Grillet | Feb 2021 | A1 |
| Number | Date | Country |
|---|---|---|
| 10-2011-0133295 | Dec 2011 | KR |
| 10-2012-0076541 | Jul 2012 | KR |
| 10-2016-0036915 | Apr 2016 | KR |
| 10-2016-0086717 | Jul 2016 | KR |
| 10-1636027 | Jul 2016 | KR |
| 10-1651620 | Aug 2016 | KR |
| 10-2017-0010985 | Feb 2017 | KR |
| 10-2017-0092632 | Aug 2017 | KR |
| 10-2018-0058048 | May 2018 | KR |
| Entry |
|---|
| Communication dated Oct. 4, 2021 issued by the European Intellectual Property Office in counterpart European Application No. 19871289.5. |
| International Search Report dated Jul. 12, 2019 issued by the International Searching Authority in counterpart International Application No. PCT/KR2019/001939 (PCT/ISA/210). |
| Number | Date | Country | |
|---|---|---|---|
| 20210397332 A1 | Dec 2021 | US |
