This application claims priority from and the benefit under 35 U.S.C. §119(a) of Korean Patent Application No. 10-2014-0002246, filed on Jan. 8, 2014, which is hereby incorporated by reference for all purposes as if fully set forth herein.
The present disclosure relates to a method of controlling other device.
The functionality of portable terminals has gradually developed. At first, they could only provide one-dimensional services such as voice call and short message transmission. However, recently, a larger variety of functions have been implemented, such as note-taking, picture editing, document creation, and wireless Internet. Furthermore, the screen of the portable terminal has gradually increased in size.
Various auxiliary input devices for controlling the portable terminal have been developed. For example, portable terminals may now benefit from the addition of wireless keyboards and mouse peripherals capable of text input and scroll input, a wireless controllers for gaming, Bluetooth headsets capable of voice input and volume control and other various accessories.
In one aspect of this disclosure, a method is disclosed, including detecting, by a processor, an application being executed in a remote device, displaying, by a display, a function menu associated with the application, and in response to detecting a selection in the displayed function menu, transmitting a control signal corresponding to the selection to the remote device to control a particular function of the application.
In another aspect of this disclosure, a method for controlling an electronic device by a remote device is disclosed including: displaying, on a display unit, an image associated with an application being executed by a processor, the displayed image including at least one icon executable to control the application, in response to activation of a menu editing mode, displaying a function menu having at least one configurable section over the displayed image, and in response to detecting a drag gesture moving the at least one icon to the at least one configurable section, storing the moved at least one icon in the configurable section of the function menu, and transmitting the function menu containing the moved at least one icon for display to the remote device such that an input to the function menu displayed on the remote device is received by the processor to control the application running on the display unit.
In another aspect of this disclosure, an electronic device includes a display unit, and at least one processor configured to detect, an application being executing on a remote device, display a function menu associated with the application in the display unit, and in response to detecting a selection in the displayed function menu, transmit a control signal corresponding to the selection to the remote device to control a particular function of the application.
The present disclosure will be more apparent from the following detailed description in conjunction with the accompanying drawings, in which:
Hereinafter, example embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be noted that the same elements will be designated by the same reference numerals although they are shown in different drawings. Further, a detailed description of a known function and configuration which may make the subject matter of the present disclosure unclear will be omitted. Hereinafter, it should be noted that the descriptions will be provided that may help understanding the operations provided in association with the various embodiments of the present disclosure, and other descriptions will be omitted to avoid making the subject matter of the present disclosure rather unclear.
A control apparatus according to the present disclosure may be implemented as part of an electronic device.
According to some embodiments, the electronic device may be a device with a communication function. For example, the electronic device may include at least one of a smart phone, a tablet Personal Computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a PDA, a Portable Multimedia Player (PMP), an MP3 player, a mobile medical device, a camera, a wearable device (for example, a Head-Mounted-Device (HMD) such as electronic glasses, electronic clothes, an electronic bracelet, an electronic necklace, an electronic appcessory, an electronic tattoo, and a smart watch.
According to an embodiment, an electronic device may be a smart home appliance with a communication function. The smart home appliances may include at least one of, for example, televisions, digital video disk (DVD) players, audio players, refrigerators, air conditioners, cleaners, ovens, microwaves, washing machines, air purifiers, set-top boxes, TV boxes (e.g., HomeSync™ of Samsung, Apple TV™, or Google TV™), game consoles, electronic dictionaries, electronic keys, camcorders, or electronic frames.
According to some embodiments, the electronic device may include at least one of various types of medical devices (for example, Magnetic Resonance Angiography (MRA), Magnetic Resonance Imaging (MRI), Computed Tomography (CT), a scanning machine, ultrasonic wave device and the like), a navigation device, a Global Positioning System (GPS) receiver, an Event Data Recorder (EDR), a Flight Data Recorder (FDR), a car infotainment device, ship electronic equipment (for example, navigation equipment for a ship, a gyro compass and the like), avionics, a security device, and an industrial or home robot.
According to another embodiment, the electronic devices may include at least one of furniture or a part of a building/structure having a communication function, electronic boards, electronic signature receiving devices, projectors, or various measuring equipment (e.g., equipment for a water supply, an electricity, gases or radio waves). The electronic device according to the present disclosure may be a combination of one or more of the aforementioned various devices. Further, it is obvious to those skilled in the art that the electronic device according to the present disclosure is not limited to the aforementioned devices.
Auxiliary devices sold on the market today are implemented so to control a predetermined function. Thus, the predetermined function of the auxiliary device may be controlled. However, in order to use an undecided function, other auxiliary device is utilized. That is, one auxiliary device cannot control a portable terminal, and thus respective auxiliary devices capable of controlling various functions are utilized. Thus, there is an inconvenience in that auxiliary devices should be included according to respective functions.
An example embodiment of the present disclosure is to provide a method of controlling a device and a control apparatus capable of effectively controlling other device using one control apparatus.
A method of controlling a device of the present disclosure may be performed by a “control apparatus”. The control apparatus may be a main device such as a smart phone, and may be an auxiliary device such as a wireless keyboard, a headset and the like controlling the main device.
Hereinafter, in
Referring to
For example, the control apparatus may check whether the other device is connected to the control apparatus through wired or wireless communication. As a result of the check, when the other device is connected to the control apparatus, the control apparatus may transmit a request signal to the other device. Wireless communication may be implemented utilizing various communication schemes such as Bluetooth, Near Field Communication (NFC) or a sound wave communication, and the control apparatus may monitor in real time whether the other device is connected to the control apparatus via wireless communication. The request signal may request information for process of the other device. The other device may receive the request signal and transmit a response signal. The response signal may include information for the process of the other device. The control apparatus may analyze the process of the other device based on the response signal. In addition, the response signal may also include state information (e.g., a message notification, a battery level, a communication signal strength, and the like).
A mutual control instruction (e.g., a volume control, a media playing, a media stop, and the like) and the state information (e.g., the message notification, the battery level, the communication signal strength, and the like) of an electronic device may be exchanged through a wireless connection.
In step 120, the control apparatus displays a function menu associated with the checked process. The function menu is related to various control tools such as a volume control, playing media, direction keys, a start and an end. For example, when the checked process is “music,” the control apparatus may display a function menu including at least one of “play,” “stop,” “search,” “next song,” “previous song” and “pause” associated with a media playing. In addition, when the checked process is a “game”, the control apparatus may display direction keys (e.g., up, down, left and right keys) as the function menu.
In step 130, the control apparatus transmits a control signal from a user input through the displayed function menu to the other device to control the process of the other device. The user selects a desired control tool in the function menu, the control apparatus transmits a control signal associated with the selected control tool to the other device. Thus, the control apparatus may control the process of the other device by the control signal.
Referring to
As another example embodiment, the function menu for each process of the control apparatus 210 may be selected and received from the user, and the control apparatus 210 may store the selected function menu in memory according to each process. Thus, when the control apparatus 210 performs the step 120 displaying a function menu associated with a process operating in the other device 220, the control apparatus may search for a function menu associated with the executing process from memory, retrieve it and display the searched function menu.
Referring to
Referring to
In another example embodiment, the control apparatus 340 may transmit a selection signal for the selected function menu from the user to the other device 330 and execute the process of the other device in association with the selected function menu by the selection signal.
The control apparatus may store a plurality of function menus, each associated to an executable process in a memory and displayable on a screen. Referring to
Referring to
Referring to
Hereinafter, in
Referring to
When an icon 510 is selected, the control tools 530 may be dragged or displayed as “floating” and thus moved to the desired position within the layout 520. In a “normal mode,” selection of the control tools 530 may cause execution of the corresponding action in the music player. However, when the layout editor is activated, the control tools 530 do not cause execution of the relevant operations, but instead may be dragged as floating icons and dropped into the layout 520.
Referring to
The shape may include polygons such as a quadrangle and a triangle, or non-polygonal shapes such as a circle. The shape may be selected or set with reference to the number of sections desired in the function menu or the number of control tools to be included. The position may include the center, the upper end, the lower end, the left end and the right end of a display screen.
Thus, the control apparatus may provide a layout 710 which is quadrisected in a triangle, a layout 720 which is not divided, a layout 730 having a “curtain” shape, a layout 740 which is bisected, a layout 750 which is octuplicated, and a layout 760 which is quadrisected into a quadrangle.
Referring to
Referring to
Referring to
As described with reference to the drawings, the controlling menus are often implemented on the other device, and the main applications executed on a main device, but it is understood that these examples are provided to ease understanding, and that the menus and respective applications might be implemented on any such device.
Referring to
The check unit 910 detects whether another device is connected to the control apparatus. Here, “connected” may mean that the control apparatus is physically or electrically connected to the other device, such as via a wireless “pairing” operation. The “other” device may refer to a “main device”. When the control apparatus is connected to the other device through a network, the check unit 910 may detect the process executing on the other device. The process may include at least one of an application, a program, an Operating System (OS) and middleware which are executed in the other device. Notably, the check unit 910 may be implemented as a separate unit from the control unit 930, or it may be implemented as a single unit so that the control apparatus 900 operates with a single unified processing module.
The display unit 920 may display a function menu associated with the detected process. The function menu is related to various control tools such as a volume control, playing media, direction keys, a start and an end, which may be dependent on the particular process being executed
The control unit 930 may transmit a control signal corresponding to a user input detected through the displayed function menu to the other device, and thereby control functions of the process executing on the other device. For example, when the user selects a desired control tool in the function menu, the control apparatus transmits a control signal associated with the selected control tool to the other device, causing it to execute the specified action. Thus, the control apparatus allows non-local third party control of a process executing on another device.
As an example embodiment, the control unit 930 may store a plurality of function menus, each associated with particular process in memory, and may display each function menu (e.g., for a game, a music application or a note taking application) through the display unit 920. When a user selection is detected on a portion of the displayed menu, the control unit 930 may transmit a signal corresponding to the selection to the other device, which may execute a corresponding function.
An example embodiment in which the control apparatus 900 is the “main device” will now described.
The control unit 930 may generate a function menu according to each process to be used in other device, which may be an “auxiliary device.” The control unit 930 may display a layout of a function menu. The control unit 930 may allow configuration of the function menu by enabling control tools displayed on the display 920 to be manually dragged by the user (e.g., by a drag gesture) to the desired position within the layout of the function menu. The control unit 930 may further retrieve or set the layout (e.g., that is, the number and positioning of buttons, icons or sections within the menu) according to at least one of attributes of the process, attributes of the other device and attributes of the user.
The control unit 930 may thus set at least one of a shape, a number and a position of the layout or the control tool according to at least one of the attributes of the process, the attributes of the other device and the attributes of the user. The shape may be a polygon such as a quadrangle and a triangle, or alternatively a variety of circular shapes. The number of sections, buttons or icons may depend on, for example, a number of control tools to be included in the function menu. The position of each function may be situated at, for example, the center, the upper end, the lower end, the left end and the right end of a display of the other device. The control tools may be displayed using at least one of a symbol, a character, a sign, an icon, a button and an image.
The control unit 930 may store the generated function menus in a memory, each associated to a particular process, and may transmit the stored function menus to the other device.
The memory unit 940 may be used to store the generated function menus, from which the menus may be retrieved before transmission to other remote devices. The communication unit 950 may be used to communication with other remote devices, and transmit and receive information, such as the function menu, commands to execute the application, controls for the application, etc. The communication unit 950 may be wired or wireless. A wireless embodiment of the communication unit 950 may be implemented utilizing various communication schemes such as Bluetooth, Near Field Communication (NFC) or a sound wave communication, as described previously, and the control apparatus 900 may monitor in real time whether the other device is connected to the control apparatus via the communication unit 950. According to an example embodiment of the present disclosure, other device effectively can be controlled using one control apparatus.
The embodiments disclosed in the present specifications and drawings were provided merely to readily describe and to help a thorough understanding of the present disclosure but not intended to limit the ambit of the present disclosure. Therefore, it should be construed that all modifications or modified forms drawn by the technical idea of the present disclosure in addition to the embodiments disclosed herein are included in the ambit of the present disclosure.
The above-described embodiments of the present disclosure can be implemented in hardware, firmware or via the execution of software or computer code that can be stored in a recording medium such as a CD ROM, a Digital Versatile Disc (DVD), a magnetic tape, a RAM, a floppy disk, a hard disk, or a magneto-optical disk or computer code downloaded over a network originally stored on a remote recording medium or a non-transitory machine readable medium and to be stored on a local recording medium, so that the methods described herein can be rendered via such software that is stored on the recording medium using a general purpose computer, or a special processor or in programmable or dedicated hardware, such as an ASIC or FPGA.
As would be understood in the art, the computer, the processor, microprocessor controller or the programmable hardware include memory components, e.g., RAM, ROM, Flash, etc. that may store or receive software or computer code that when accessed and executed by the computer, processor or hardware implement the processing methods described herein. In addition, it would be recognized that when a general purpose computer accesses code for implementing the processing shown herein, the execution of the code transforms the general purpose computer into a special purpose computer for executing the processing shown herein.
Any of the functions and steps provided in the Figures may be implemented in hardware, software or a combination of both and may be performed in whole or in part within the programmed instructions of a computer. No claim element herein is to be construed under the provisions of 35 U.S.C. 112, sixth paragraph, unless the element is expressly recited using the phrase “means for”.
In addition, an artisan understands and appreciates that a “processor” or “microprocessor” constitute hardware in the claimed invention. Under the broadest reasonable interpretation, the appended claims constitute statutory subject matter in compliance with 35 U.S.C. §101.
The terms “unit” or “module” referred to herein is to be understood as comprising hardware such as a processor or microprocessor configured for a certain desired functionality, or a non-transitory medium comprising machine executable code, in accordance with statutory subject matter under 35 U.S.C. §101 and does not constitute software per se.
Number | Date | Country | Kind |
---|---|---|---|
10-2014-0002246 | Jan 2014 | KR | national |