1. Field of the Invention
The disclosure relates generally to methods and systems for operation activation, and, more particularly to methods and systems that automatically retrieve and perform at least one operation for at least one object which is recognized in an image displayed on the touch-sensitive display unit.
2. Description of the Related Art
Recently, portable devices, such as handheld devices, have become more and more technically advanced and multifunctional. For example, a handheld device may have telecommunications capabilities, e-mail message capabilities, an advanced address book management system, a media playback system, and various other functions. Due to increased convenience and functions of the devices, these devices have become necessities of life.
Currently, a handheld device may be equipped with a touch-sensitive display unit. Users can directly perform operations, such as application operations and data input via the touch-sensitive display unit. Generally, when a user wants to perform an operation on the handheld device, the user must manually activate an application/function of the mobile device, and set related information, such as email addresses or phone numbers of receivers via the touch-sensitive display unit. The activation process for the operation is inconvenient and time-consuming for users.
Generally, a plurality of applications can be installed in a handheld device to provide various functions. It is understood that, respective applications may have various requirements. For example, the number of users involved in an application may be limited. In a case, when one user (receiver) is specified, an email function or a dial-up function can be provided to the specified user. In another case, when several users are specified, an ad-hoc network connection function can be provided to the specified users. That is, when the function is performed, an ad-hoc network can be established for the specified users. Conventionally, users must know the requirements of the respective applications, and manually perform the selection and performance of the applications, thus requiring more complex operations and actions to be performed by the users. Currently, however, no automatic and efficient mechanism is provided for operation activation, thus users are less apt to use the functions of handheld devices.
Methods and systems for operation activation are provided.
In an embodiment of a method for operation activation, an image is displayed on a touch-sensitive display unit. At least one object in the image is recognized using an object recognition algorithm, and at least one indicator for the at least one object is displayed on the touch-sensitive display unit. At least one operation is retrieved according to the at least one object. An instruction with respect to the at least one indicator is received via the touch-sensitive display unit, and the at least one operation regarding the at least one object is automatically performed according to the instruction.
An embodiment of a system for operation activation includes a storage unit, a touch-sensitive display unit, and a processing unit. The storage unit comprises a plurality of operations for a plurality of objects. The touch-sensitive display unit displays an image. The processing unit recognizes at least one object in the image using an object recognition algorithm, and displays at least one indicator for the at least one object on the touch-sensitive display unit. The processing unit retrieves at least one operation from the storage unit according to the at least one object. The processing unit receives an instruction with respect to the at least one indicator via the touch-sensitive display unit, and automatically performs the at least one operation regarding the at least one object according to the instruction.
In some embodiments, the at least one indicator is displayed as an icon besides or near the at least one object, or as an image covers part or all of the at least one object.
In some embodiments, at least one specific indicator within the at least one indicator for the at least one object is further selected, and the at least one operation is retrieved according to the selected at least one specific indicator.
In some embodiments, the at least one operation is retrieved further according to the type or the number of the at least one object.
In some embodiments, the at least one operation is displayed on the touch-sensitive display unit. In some embodiments, the instruction can comprise contacts and movements involving the at least one indicator and a specific operation of the at least one operation on the touch-sensitive display unit.
Methods for operation activation may take the form of a program code embodied in a tangible media. When the program code is loaded into and executed by a machine, the machine becomes an apparatus for practicing the disclosed method.
The invention will become more fully understood by referring to the following detailed description with reference to the accompanying drawings, wherein:
Methods and systems for operation activation are provided.
The system for operation activation 100 comprises a storage unit 110, a touch-sensitive display unit 120, and a processing unit 130. The storage unit 110 can be used to store related data, such as calendars, files, web pages, images, and/or interfaces. It is noted that, the storage unit 110 can include a database recoding relationships between a plurality of operations 111, such as applications/functions and a plurality of objects, such as faces or bodies of users, products, and others. It is noted that, in some embodiments, the database can further record semantics or properties of objects. The semantics or properties can be used to recognize the type of the objects. It is understood that, each operation can correspond to a specific number of objects. In one example, an operation can be performed for only one object. In another example, an operation can be performed for a plurality of objects. It is understood that, in some embodiments, the operations may comprise an email function, a permission management function, a data retrieval function, an ad hoc network connection function, and others. It is understood that, the above operations are examples of the present application, and the present invention is not limited thereto. In some embodiments, the system for operation activation 100 may further comprise an image capturing unit (not shown), used for capturing images, which can be stored in the storage unit 110. The touch-sensitive display unit 120 is a screen integrated with a touch-sensitive device (not shown). The touch-sensitive device has a touch-sensitive surface comprising sensors in at least one dimension to detect contact and movement of an object (input tool), such as a pen/stylus or finger near or on the touch-sensitive surface. The touch-sensitive display unit 120 can display the data provided by the storage unit 110. The processing unit 130 can perform the method for operation activation of the present invention, which will be discussed further in the following paragraphs.
In step S210, an image is displayed on a touch-sensitive display unit 120. It is understood that, in some embodiments, the image can be obtained from the storage unit 110. In some embodiments, the image can be real time captured via an image capturing unit of the electronic device. In step S220, an object recognition algorithm is applied to the image to recognize/detect at least one object in the image, and in step S230, at least one indicator for the at least one object is displayed on the touch-sensitive display unit 120. It is understood that, in some embodiments, the at least one indicator can be displayed as an icon besides or near the at least one object. In some embodiments, the at least one indicator can be displayed as an image covers part or all of the at least one object. For example, an image 310 can be displayed on the touch-sensitive display unit 120, as shown in
In an embodiment, when a user double-clicks an indicator corresponding to a face detected in the image, an email function is automatically activated to compose an email message for a specific user with the face. It is understood that, in some embodiments, the detected face can be compared with a contact database to know the specific user and related information, such as an email address of the specific user. The related information of the specific user can be automatically brought to the email function. In another embodiment, when a user draws a circle to cover two indicators corresponding to two faces detected in the image, an ad-hoc network connection function is automatically activated to set up an ad-hoc network with the two specific users with the faces. Similarly, the detected face can be compared with a contact database to know the specific user and related information, such as a network address of a mobile device of the specific user. The related information of the specific user can be automatically brought to the ad-hoc network connection function.
In step S410, an image is displayed on a touch-sensitive display unit 120. Similarly, in some embodiments, the image can be obtained from the storage unit 110. In some embodiments, the image can be real time captured via an image capturing unit of the electronic device. In step S420, an object recognition algorithm is applied to the image to recognize/detect at least one object in the image, and in step S430, at least one indicator for the at least one object is displayed on the touch-sensitive display unit 120. Similarly, in some embodiments, the at least one indicator can be displayed as an icon besides or near the at least one object. In some embodiments, the at least one indicator can be displayed as an image covers part or all of the at least one object. It is noted that, the above display manners of the indicator are examples of the present application, and the present invention is not limited thereto. The display manner of the indicator can be various. Then, in step S440, at least one operation is retrieved according to the at least one object. It is understood that, in some embodiments, at least one specific indicator within the at least one indicator for the at least one object can be further selected using an input tool, such as a finger or a stylus via the touch-sensitive display unit 120, and the at least one operation is retrieved according to the selected at least one specific indicator. As described, each operation can correspond to a specific number of objects. In some embodiments, when at least two indicators are selected, the intersection of the operations corresponding to the selected at least two indicators is retrieved. Further, in some embodiments, the at least one operation can be retrieved further according to the type and/or the number of the at least one object. As described, the type of the object may be a face or body of users, a product, and others. In some embodiments, the type of the object can be recognized according to the semantics or properties of the object. After the at least one operation is retrieved, in step S450, the at least one operation is displayed on the touch-sensitive display unit 120. For example, an image 510 can be displayed on the touch-sensitive display unit 120, as shown in
In an embodiment, when a user drags an indicator corresponding to a face detected in the image to a specific folder (operation icon) displayed on the touch-sensitive display unit 120, a permission management function is automatically activated to grant permission for a specific user with the face. Similarly, in some embodiments, the detected face can be compared with a contact database to know the specific user and related information, such as personal ID of the specific user. The related information of the specific user can be automatically brought to the permission management function. In another embodiment, when a user draws a circle to cover two indicators corresponding to two faces detected in the image and drags the circle to an operation icon corresponding to an ad-hoc network connection function, an ad-hoc network connection function is automatically activated to set up an ad-hoc network with the two specific users with the faces. Similarly, the detected face can be compared with a contact database to know the specific user and related information, such as a network address of a mobile device of the specific user. The related information of the specific user can be automatically brought to the ad-hoc network connection function. In further another embodiment, when a user drags an indicator corresponding to a detected object, such as product, text, and others to a specific position or a specific folder displayed on the touch-sensitive display unit 120, a data retrieval function is automatically activated to link to a website, and perform a data retrieval process for the detected object. In an example, when a user drags an indicator of a product, such as a watch to a compare-price box (operation icon), a browser can be launch and linked to a price comparison service for results of the watch.
Therefore, the methods and systems for operation activation can automatically retrieve and perform at least one operation for at least one object which is recognized in an image displayed on the touch-sensitive display unit, thus increasing operational convenience, and reducing power consumption of electronic devices for complicated operations.
Methods for operation activation, or certain aspects or portions thereof, may take the form of a program code (i.e., executable instructions) embodied in tangible media, such as floppy diskettes, CD-ROMS, hard drives, or any other machine-readable storage medium, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine thereby becomes an apparatus for practicing the methods. The methods may also be embodied in the form of a program code transmitted over some transmission medium, such as electrical wiring or cabling, through fiber optics, or via any other form of transmission, wherein, when the program code is received and loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the disclosed methods. When implemented on a general-purpose processor, the program code combines with the processor to provide a unique apparatus that operates analogously to application specific logic circuits.
While the invention has been described by way of example and in terms of preferred embodiment, it is to be understood that the invention is not limited thereto. Those who are skilled in this technology can still make various alterations and modifications without departing from the scope and spirit of this invention. Therefore, the scope of the present invention shall be defined and protected by the following claims and their equivalent.