Pursuant to 35 U.S.C. §119(a), this application claims the benefit of earlier filing date and right of priority to Korean Application No. 10-2015-0067272, filed on May 14, 2015, the contents of which are hereby incorporated by reference herein in their entirety.
1. Field of the Invention
The present invention relates to a wearable display device, and more particularly, to a wearable display device and controlling method thereof. Although the present invention is suitable for a wide scope of applications, it is particularly suitable for displaying progress of a payment process associated with billing or price information on a display unit.
2. Discussion of the Related Art
Generally, mobile terminals can be classified into non-wearable devices and wearable devices according to whether to be worn on a user's body. Particularly, among the wearable terminals, a mobile terminal that can be worn on a user's head (i.e., head mounted device) has a display unit to show an image directly to a user's eyes.
Functions of the wearable display device tend to be diversified. Examples of such functions include data and voice communications, photography and videography through a camera, voice recording, playback of music files through a speaker system, and output of images or videos through a display unit. Some terminals include additional functionality which supports game playing while other terminals are configured as multimedia players. As financial payment using the mobile terminal has emerged as interest recently, financial payment using the wearable display device has been also received attention.
Meanwhile, the wearable display device differs from the general mobile terminal in receiving a user's input. Therefore, it is necessary for the financial payment using the wearable display device to consider UX and UI different from those of the general mobile terminal.
Accordingly, embodiments of the present invention are directed to a mobile terminal and controlling method thereof that substantially obviate one or more problems due to limitations and disadvantages of the related art.
One object of the present invention is to provide a wearable display device and controlling method thereof, which improves user convenience.
Another object of the present invention is to provide a wearable display device and controlling method thereof, which provides a payment method.
Technical tasks obtainable from the present invention are non-limited by the above-mentioned technical tasks. And, other unmentioned technical tasks can be clearly understood from the following description by those having ordinary skill in the technical field to which the present invention pertains.
Additional advantages, objects, and features of the invention will be set forth in the disclosure herein as well as the accompanying drawings. Such aspects may also be appreciated by those skilled in the art based on the disclosure herein.
To achieve these objects and other advantages and in accordance with the purpose of the invention, as embodied and broadly described herein, a wearable display device according to an embodiment of the present invention may include a frame unit having a shape wearable on a head of a user, a display unit connected to the frame unit directly or indirectly, the display unit configured to show an image to at least one of left and right eyes of the user, a camera connected to the frame unit directly or indirectly, the camera configured to photograph a direction of the user's eyes in a surrounding environment of the user by being disposed adjacent to the display unit, and a controller connected to the frame unit directly or indirectly, the controller controlling the display unit to display the image, the controller processing the image photographed through the camera, the controller controlling a progress screen of a payment process associated with billing information photographed through the camera to be displayed on the display unit, the controller controlling an amount corresponding to the billing information to be paid by receiving a payment authorization input of the user.
In another aspect of the present invention, in a wearable display device including a frame unit having a shape wearable on a head of a user, a display unit configured to show an image to at least one of left and right eyes of the user, a camera configured to photograph of a direction of the user's eyes in a surrounding environment of the user by being disposed adjacent to the display unit, and a controller controlling the display unit to display the image or processing the image photographed through the camera, a method of controlling the wearable display device according to an embodiment of the present invention may include a step (a) for the controller to receive billing information photographed through the camera, a step (b) for the controller to control a progress screen of a payment process associated with the received billing information to be displayed on the display unit, a step (c) for the controller to receive a payment authorization input of the user, and a step (d) for the controller to control an amount corresponding to the billing information to be paid.
Effects obtainable from the present invention may be non-limited by the above mentioned effect. And, other unmentioned effects can be clearly understood from the following description by those having ordinary skill in the technical field to which the present invention pertains. It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principle of the invention. The above and other aspects, features, and advantages of the present invention will become more apparent upon consideration of the following description of preferred embodiments, taken in conjunction with the accompanying drawing figures. In the drawings:
Description will now be given in detail according to exemplary embodiments disclosed herein, with reference to the accompanying drawings. For the sake of brief description with reference to the drawings, the same or equivalent components may be provided with the same reference numbers, and description thereof will not be repeated. In general, a suffix such as “module” and “unit” may be used to refer to elements or components. Use of such a suffix herein is merely intended to facilitate description of the specification, and the suffix itself is not intended to give any special meaning or function. The accompanying drawings are used to help easily understand various technical features and it should be understood that the embodiments presented herein are not limited by the accompanying drawings. As such, the present disclosure should be construed to extend to any alterations, equivalents and substitutes in addition to those which are particularly set out in the accompanying drawings.
The glass-type device 100 can be wearable on a head of a human body and provided with a frame unit therefor. The frame unit may be made of a flexible material to be easily worn. It is illustrated in the drawing that the frame unit includes a first frame 101 and a second frame 102, which may be made of different materials.
The frame unit 101 and 102 can be supported on the head and define a space for mounting various components. As illustrated, electronic components, such as a controller 180, an audio output unit 152, and the like, may be mounted to the frame unit. Also, a lens 103 for covering either or both of the left and right eyes may be detachably coupled to the frame unit. It is shown in the drawing that the display unit 151, the camera 121 and the controller 180 are connected to the frame unit on one side of the user's head directly or indirectly, by which locations of the display unit 151, the camera 121 and the controller 180 are non-limited.
The display unit 151 to show an image directly to either or both of the left and right eyes may be detachably coupled to the frame unit 101 and 102. The display unit 151 may be implemented as a head mounted display (HMD). The HMD refers to display techniques by which a display is mounted to a head to show an image directly to a user's eyes. In order to provide an image directly to the user's eyes when the user wears the glass-type device 100, the display unit 151 may be located to correspond to either or both of the left and right eyes.
The display unit 151 may project an image onto the user's eye using a prism. The prism may be formed from optically transparent material such that the user can view both the projected image and a general visual field (a range that the user views through the eyes) in front of the user. In such a manner, the image output through the display unit 151 may be viewed while overlapping with the general visual field. The wearable display device 100 according to the present specification may provide an augmented reality (AR) by overlaying a virtual image on a realistic image or background using the display unit 151.
The camera 121 may be disposed adjacent to the display unit 151 and take a photograph of a direction of the user's eyes in the surrounding environment of the user. As the display unit 151 is connected to the frame unit to show an image to either or both of the left and right eyes, the camera 121 is also located adjacent to either or both of the left and right eyes, thereby being able to acquiring the scene that the user is currently viewing as an image. Although
The wireless communication unit 110 typically includes one or more modules which permit communications such as wireless communications between the wearable display device 100 and a wireless communication system, communications between the wearable display device 100 and another the wearable display device, communications between the mobile terminal 100 and an external server. Further, the wireless communication unit 110 typically includes one or more modules which connect the wearable display device 100 to one or more networks. To facilitate such communications, the wireless communication unit 110 includes at least one selected from the group consisting of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115.
The input unit 120 includes a microphone 122 for inputting an audio signal, an audio input unit or a user input unit 123 for allowing the user to input information. Audio data or image data obtained by the input unit 120 may be analyzed and processed according to a control command of the user. The above-mentioned camera 121 may be also included in the input unit 120.
The user input unit 123 for allowing the user to input the control command may be included in the glass-type wearable display device 100. In order to implement the user input unit 123, various types of techniques such as a tactile manner, which allows the user to operate a device using the sense of touch like touch, push and the like, and a touchpad using a touch sensor may be used.
The sensing unit 140 may include one or more sensors configured to sense internal information of the device 100, information on the surrounding environment of the device 100, user information and the like. For example, the sensing unit 140 may include at least one selected from the group consisting of a proximity sensor 141, an illumination sensor 142, a tilt sensor 143, a touch sensor 144, an acceleration sensor, a magnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared (IR) sensor, a finger scan sensor, a ultrasonic sensor, an optical sensor (for example, camera 121), a microphone 122, a battery gauge, an environment sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, a thermal sensor, a gas sensor, etc.), and a chemical sensor (for example, an electronic nose, a health care sensor, a biometric sensor, etc.). The device 100 disclosed in this specification may be configured to utilize information obtained from sensing unit 140, i.e., information obtained from one or more sensors of the sensing unit 140 and combinations thereof. For instance, the tilt sensor 143 may sense a tilt of the device 100 and a vertical or horizontal movement of the device 100 by processing values sensed by the G-sensor, the gyroscope sensor and the acceleration sensor.
The output unit 150 is typically configured to output various types of information, such as audio, video, tactile output and the like. The output unit 150 may include at least one selected from the group of a display unit 151, an audio output module 152, a haptic module 153, and an optical output module 154.
The interface unit 160 serves as an interface with various types of external devices that can be coupled to the device 100. The interface unit 160, for example, may include at least one selected from the group consisting of wired/wireless headset ports, external power supply ports, wired/wireless data ports, memory card ports, ports for connecting a device having an identification module, audio input/output (I/O) ports, video I/O ports, earphone ports. In some cases, the device 100 may perform assorted control functions associated with a connected external device, in response to the external device being connected to the interface unit 160
The memory 170 is typically implemented to store data to support various functions or features of the device 100. For instance, the memory 170 may be configured to store application programs executed in the device 100, data or instructions for operations of the device 100, and the like. Some of these application programs may be downloaded from an external server via wireless communication. Other application programs may be installed within the device 100 at time of manufacturing or shipping, which is typically the case for basic functions of the device 100 (for example, receiving a call, placing a call, receiving a message, sending a message, and the like). It is common for application programs to be stored in the memory 170, installed in the device 100, and executed by the controller 180 to perform an operation (or function) for the device 100.
The controller 180 typically controls overall operations of the device 100 including an operation associated with the application program as well as an operation of processing the image photographed through the camera 121 to display the corresponding image on the display unit 151. The controller 180 can process or provide appropriate information or function to a user by processing signals, data, information and the like input or output through the above-mentioned components or running application programs saved in the memory 170. In order to run the application programs saved in the memory 170, the controller 180 controls some or all of the components described with reference to
The power supply unit 190 is configured to receive external power or provide internal power in order to supply appropriate power required for operating elements and components included in the device 100. The power supply unit 190 may include a battery and the battery may be configured to be embedded in the device body or configured to be detachable from the device body.
At least one portion of the above-mentioned components can cooperatively operate to embody operations, controls or controlling methods of the device according to various embodiments mentioned in the following description. In addition, the operations, controls or controlling methods of the device can be embodied on the device 100 by running at least one or more application programs saved in the memory 170.
The controller 180 according to the present specification controls the display unit 151 to display a progress screen of a payment process associated with billing or price information photographed through the camera 121. In addition, the controller 180 can control an amount corresponding to the billing or price information to be paid by receiving a payment authorization input of a user.
Since all QR codes obtained through the camera 121, i.e., all of billing information may not correspond to payment objects for which the user intends to pay, a payment intention and the payment object should be confirmed and then processed. According to one embodiment of the present specification, the controller 180 can control the display unit 151 to display a progress screen of a payment process associated with billing information photographed for a preset time (e.g., 5 seconds) in billing information photographed through the camera 121. Further, an amount corresponding to the billing information can be paid by receiving the payment authorization input of the user.
Referring to
According to one embodiment of the present specification, when determining a presence or non-presence of the payment authorization input during the payment process, the controller 180 can process a user's head movement as the payment authorization input by receiving the tilt signal. Although a motion of nodding user's head is illustrated as an example of the payment authorization input in
Next,
According to one embodiment of the present specification, when determining a presence or non-presence of the payment authorization input during the payment process, the controller 180 can process a user's touch input as the payment authorization input by receiving the touch signal. Referring to
If a touch pattern of the user matches the preset touch pattern, the controller 180 can determine it as the payment authorization input of an authorized user and then progress the payment. Referring to
Next,
In addition, a different user can participate in the payment process. For instance, the user can pay an amount of the user together with that of the different user or make a payment by splitting a prescribed amount with the different user. In this instance, if at least one different user except the user participates in the payment process, the controller 180 can control participant information to be displayed on the display unit 151.
According to an embodiment of the present specification, the controller 180 can receive participant information through the wireless communication unit 110. For example, the device 100 can directly recognize participant information through communication with a different device 100. The device 100 can recognize a QR code and then inform all nearby devices of the recognized QR code. The wireless communication unit 110 can perform communication between the wearable display device and a wireless communication system or communication between the wearable display device and the different wearable display device. The device 100 that has been received the information from the different device 100 can transmit information on whether to participate in the payment to the different device 100 that has been transmitted the information on the QR code, according to whether to participate in the payment process.
In another example, the device 100 can recognize a QR code and then access a server address included in the QR code. In this instance, a different user can also recognize the same QR code through a different device and then access the server address included in the same QR code. The server can transmit information on all the users who access the server through the same QR code to each of the device. In addition, the controller 180 of each of the devices can receive information, which is transmitted by the server, on the different user through the wireless communication unit 110.
Although it is illustrated in
Subsequently, if the controller 180 of each of the devices senses a user input 707 and 708 for authorizing the participation of the displayed different user, the participation in the payment process by the different user is completed. Consequently, the controller 180 can control an image indicating that the payment process is changed from the payment 709 by a single user into the payment 710 by two or more users to be displayed on the display unit 151. Although
Meanwhile, as mentioned in the foregoing description, when a user makes a payment together with a different user, the user can pay an amount of the user together with that of the different user or the user can make a payment by dividing a prescribed amount with the different user. If the user applies an input to make the payment by dividing some or all of the payment amount with a participant selected by the user from participants participating in the payment process, the controller 180 can control a remaining payment amount of the user and a payment amount split to the selected participant to be displayed on the display unit 151 and then pay the remaining payment amount of the user by receiving the payment authorization input of the user.
The controller 180 can control an image 801 for asking its user whether to make a payment by splitting a payment amount with a different participant to be displayed on the display unit 151. In addition, if the controller 180 senses a user input 802 for authorizing that the user makes the payment by splitting the payment amount with the different participant, the controller 180 can control an image 803 indicating a split payment amount to be displayed on the display unit 151. Subsequently, if the controller 180 senses a user input 804 for authorizing payment for the split amount, the controller 180 can complete the payment through security authentication.
Since controlling of the security authentication 805 and payment completion 806 is described with reference to
If the controller 180 senses the user input 802 for authorizing that the user makes the payment by splitting the payment amount with the different participant, the controller 180 can control an image 802-1 for requesting an input for a payment rate to the user to be displayed on the display unit 151. In addition, the controller 180 can control the payment rate and a payment amount according to the payment rate to be displayed on the display unit 151 by receiving the user input. According to one embodiment of the present specification, a user input 802-2 for the payment rate may be received through the touch sensor 144.
In addition, when the user makes a payment by splitting a prescribed amount with the different user, determination of the payment rate of the user naturally affects the payment rate of the different participant. Therefore, the controller 180 can transmit a result of the input for the payment rate to the device of the different participant through the wireless communication unit 110 (cf. reference number 901 in
The controller 180 can select a participant from the participants by receiving a user input and then receive an input for a payment amount of the selected participant. The input for selecting the participant may correspond to an input 1002 of shaking a user's head from side to side. Also, the input for determining the payment amount of the selected participant may correspond to an input 1003 of touching the touch sensor 144. If the respective payment amounts of participant are determined, the controller 180 can transmit information on the payment amount to the respective participants by controlling the wireless communication unit 110 (1004).
If each of participants determines that the payment amount is reasonable after checking the payment amount, each of participants transmit information on payment acceptance. If the controller 180 receives all of the information on the payment acceptance from all the participants through the wireless communication unit 110, the controller 180 can control an image 1005 containing related information to be displayed on the display unit 151. Since details of the remaining payment process is described with reference to
The above-mentioned example relates to paying the prescribed amount by dividing it with the different user. Besides this method, a user can pay a payment amount of the user together with that of the different person r. In particular, the user can pay the payment amount of the different user in place of the different user.
Next,
According to one embodiment of the present specification, if a gesture of sweeping the touch sensor 144 from the outside to the inside of a user's body is sensed through the touch sensor 144, the controller 180 can control the sum of a payment amount of the user and some or all of a payment amount of a selected participant to be displayed on the display unit 151. According to another embodiment of the present specification, if a gesture of sweeping the touch sensor 144 from the inside to the outside of a user's body is sensed through the touch sensor 144, the controller 180 can control a remaining payment amount of the user and a payment amount split to a selected participant to be displayed on the display unit 151.
Referring to
As a result of the above-mentioned inputs, the controller 180 of the user A can control the sum of the payment amount of the user A and the payment amount of the user B to be displayed on the display unit 151 as shown in
Meanwhile, in describing the payment process according to an embodiment of the present specification, methods for paying the payment amount may be predefined using various types of payment services such as a bank account, a credit card, a check card, a debit card and the like. Therefore, if payment intention of the user is checked, the controller 180 pays the amount corresponding to the payment amount to a service provider contained in the billing information using the predefined payment mean. Since various methods for paying the payment amount according to various payment means are disclosed to public, detailed description thereof will be omitted.
Hereinafter, a method of controlling a wearable display device according to the present specification will be described. In describing the controlling method, details of the components of the wearable display device are explained in the foregoing description, redundant description thereof will be omitted.
Accordingly, the present invention provides several advantages. According to at least one of embodiments of the present invention, a wearable display device for improving user convenience is provided. In addition, according to an embodiment of the present invention, a wearable display device for providing a payment method can be provided. Further, according to an embodiment of the present invention, a wearable display device capable of minimizing user's actions for payment and controlling method thereof can be provided.
Various terms used in this specification are general terms selected in consideration of functions of the embodiments disclosed in this specification but may vary according to the intentions or practices of those skilled in the art or the advent of new technology. Additionally, certain terms may have been arbitrarily selected and in this instance, their meanings are described in detail herein. Accordingly, the terms used in this specification should be interpreted based on substantial implications that the terms have and the contents across this specification not the simple names of the terms.
The present invention encompasses various modifications to each of the examples and embodiments discussed herein. According to the invention, one or more features described above in one embodiment or example can be equally applied to another embodiment or example described above. The features of one or more embodiments or examples described above can be combined into each of the embodiments or examples described above. Any full or partial combination of one or more embodiment or examples of the invention is also part of the invention.
As the present invention may be embodied in several forms without departing from the spirit or essential characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, unless otherwise specified, but rather should be construed broadly within its spirit and scope as defined in the appended claims, and therefore all changes and modifications that fall within the metes and bounds of the claims, or equivalence of such metes and bounds are therefore intended to be embraced by the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2015-0067272 | May 2015 | KR | national |