Patent Application
20200225826
This application is based on and claims priority under 35 U.S.C. § 119 to Korean Patent Application No. 10-2019-0004636, filed on Jan. 14, 2019, in the Korean Intellectual Property Office, the disclosure of which is incorporated by reference herein in its entirety.
The disclosure relates to an electronic device and operation method thereof, and for example, to an electronic device having a blackboard function and operation method thereof.
With the advancement of electronic technologies, various types of electronic products are being developed and released. Many different display devices such as televisions (TVs), mobile phones, personal computers (PCs), laptops, personal digital assistants (PDAs), etc., are widely used in most homes.
Electronic blackboard devices having a writing input function in addition to a content display function, which usual display devices have, are commonly used as well.
The electronic blackboard device may be more effectively used when the user inputs written content to the electronic blackboard device and applies various functions, such as text conversion, image capturing, storing, or the like, to the input written content. Accordingly, a method is required for the user to conveniently apply such various functions for the input written content to the electronic blackboard device.
Embodiments of the disclosure provide an electronic device and operation method thereof, which enable tag functions to be used more conveniently for written content input to the electronic device having an electronic blackboard function.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description.
According to an example embodiment of the disclosure, an electronic device includes a display, a touch input module comprising touch input circuitry configured to receive a touch input, a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to control the electronic device to: receive a writing area designation input designating a writing area through the touch input module, receive a tag input for the writing area through the touch input module, and perform a predefined function corresponding to the tag input for the writing area.
In an example embodiment of the disclosure, the processor may execute one or more instructions to further control the electronic device to a receive tag area designation input designating the tag input through the touch input module and detect the tag input based on the tag area designation input.
In an example embodiment of the disclosure, the writing area designation input may include a first closed figure input, and the tag area designation input may include a second closed figure input different from the first closed figure input.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: obtain a table defining one or more tags and functions corresponding to the respective one or more tags, and obtain information about a function defined for a tag corresponding to the tag input based on the table.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: store metadata including an identifier of a tag corresponding to the received tag input and color information used in the tag input in storage space (e.g., a memory) as tag information.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: search for the tag information stored in the storage space based on at least one of the tag identifier or the tag color information.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: detect a text tag from the tag input, recognize a written character from the writing area, and convert the recognized character into digital text based on a defined function corresponding to the text tag.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: create metadata that includes an identifier of the text tag, digital text corresponding to the recognized character, and color information used in the tag input.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: detect a capture tag from the tag input, and capture a written content obtained from the writing area and store the content as an image based on a defined function corresponding to the capture tag.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: detect a secret tag from the tag input, and conceal a written content obtained from the writing area with an image in a color used in the tag input based on a defined function corresponding to the secret tag.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: output a user interface configured to receive personal identification information based on the detection of the secret tag, conceal the written content and output an image indicating that the secret tag is applied based on a user input including the personal identification information being received, output a user interface for receiving the personal identification information to release the secret tag based on a user input selecting the image being received, and disclose the concealed written content based on a user input including the personal identification information being received.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: detect a content storing tag from the tag input, and store a written content obtained from the writing area in a virtual space classified based on a color used in the tag input, based on a defined function corresponding to the content storing tag.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: detect a fetch tag from the tag input, and fetch and display the written content stored in the virtual space based on color information used in the tag input based on a defined function corresponding to the fetch tag.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: display one or more contents of writing stored in a virtual space corresponding to the color information of a pen used in the tag input as respective thumbnail images based on the fetch tag being detected, and fetch and display a written content corresponding to a thumbnail image selected by an input received from among the one or more thumbnail images from the virtual space.
In an example embodiment of the disclosure, the processor may execute the one or more instructions to control the electronic device to: detect an all-tag display tag from the tag input, and output one or more tag images applicable to the written content obtained from the writing area based on a defined function corresponding to the all-tag display tag.
According to an example embodiment of the disclosure, an operation method of an electronic device includes: receiving a writing area designation input designating a writing area through a touch input module of the electronic device; receiving a tag input for the writing area through the touch input module; and performing a predefined function corresponding to the tag input for the writing area
According to an example embodiment of the disclosure, a computer program product comprising a non-transitory computer-readable recording medium having a program stored therein to perform an operation method of an electronic device is provided, the operation method including: receiving a writing area designation input designating a writing area through a touch input module of the electronic device; receiving a tag input for the writing area through the touch input module; and performing a predefined function corresponding to the tag input for the writing area.
The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:
Terms as used herein will be described before the detailed description of embodiments of the disclosure.
The terms are selected as common terms widely used now, taking into account principles of the disclosure, which may however depend on intentions of those of ordinary skill in the art, judicial precedents, emergence of new technologies, and the like. Some terms as herein used may be arbitrarily selected, in which case, description thereof will be explained in detail in the disclosure. Therefore, the terms should be defined based on their meanings and descriptions throughout the disclosure.
Throughout the disclosure, the expression “at least one of a, b or c” indicates only a, only b, only c, both a and b, both a and c, both b and c, all of a, b, and c, or variations thereof.
The term “include (or including)” or “comprise (or comprising)” is inclusive or open-ended and does not exclude additional, unrecited elements or method steps. “Unit”, “module”, “block”, etc., as used herein may each represent a unit for handling at least one function or operation, and may be implemented in hardware, software, or a combination thereof.
Embodiments of the disclosure will now be described in greater detail with reference to accompanying drawings. However, the various example embodiments of the disclosure may be implemented in many different forms, and are not limited thereto as will be discussed herein. In the drawings, parts unrelated to the description may be omitted for clarity, and like numerals refer to like elements throughout the disclosure.
The term ‘user’ as used herein may refer, for example, to a person who uses a control device to control functions or operations of an image display device, including, for example, and without limitation, a viewer, an administrator, or an installation engineer, etc.
Referring to
Upon making the writing input to the electronic device 100 with his/her finger or the pen 10, the user may want to capture written content or convert the written content into text.
In an embodiment of the disclosure, the electronic device 100 provides a method of performing a predefined function based on the written content via the writing input made by the user without having to provide a menu prepared to perform a separate operation.
Referring to
The function corresponding to the tag may be variously determined. For example, when the written content is about character(s), a tag function, for example, may be converting the character(s) into digital text. In another example, when the written content is about character(s) or picture(s), a tag function, for example, may be capturing the character(s) or the picture(s). In another example, there may be a tag function for storing the written content in virtual space or fetching the written content from the virtual space. In another example, there may also be a tag function for concealing the written content. Furthermore, there may be a tag function for displaying all tags that may be provided to inform the user of types of tags. It will be understood that the foregoing examples are not limiting and that the disclosure is not limited thereto.
Although the tag has the form of ‘T’ in
As described above, the electronic device 100 enables various functions to be performed for the written content by the user's writing input without causing the user to inconveniently manipulate menus.
As the writing input function does not require pen-based menus or buttons, the user may make writing input with his/her finger and perform a desired function for the written content.
Furthermore, information of the color used in tag input may enable more various tag functions to be implemented. For example, when the user inputs a tag using a red-colored pen, the written content may be stored in a storage space identified as red color. The user may search for the storage space identified as red color later on to look for the written content input with the red-colored pen.
As such, with writing input, many different functions may be performed for the written content, so that users using their electronic devices may efficiently manage the content written on the electronic device during a meeting or any event. For example, when the user writes an important note on his/her electronic device during a meeting, the user may store the written content by drawing a form of a tag that corresponds to a writing area storing function without trouble of manipulating any extra menus on the electronic device.
Referring to
Example components of the electronic device 100 will now be described in greater detail below with reference to
The display 110 may output data processed by the electronic device 100.
The user input module 190 may include various user input circuitry and provide an interface for receiving user inputs, which may use a touch sensitive device to receive touch inputs. The user inputs may include the user's finger touch inputs, palm touch inputs, electronic pen inputs, etc.
When the display 110 is implemented by a touch screen, the display 110 may also be used as an input device in addition to the output device. For example, the display 110 may include, for example, and without limitation, at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), organic light-emitting diodes (OLEDs), a flexible display, a three dimensional (3D) display, an electrophoretic display, or the like.
The processor 130 may include various processing circuitry and controls general operation of the electronic device 100. For example, the processor 130 may execute one or more instructions stored in the memory 120 to control the display 110 and perform functions of the electronic device 100 as shown in
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to receive writing area designation input which designates a writing area through a touch input module, receive tag input for the writing area through the touch input module, and perform a predefined function corresponding to the tag input. As such, the electronic device may perform a certain function that the user wants for the written content through writing input from the user, so that the user may conveniently perform a tag function without manipulating any extra menu or button.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to further receive tag area designation input which designates the tag input through the touch input module, and detect the tag input based on the tag area designation input. The writing area designation input includes first closed figure input, and the tag area designation input may include second closed figure input, which is different from the first closed figure input. To use the user's writing input as a tag function, a particular pattern of the user's writing input may be used as a tag format used for the tag function. For example, patterns of the writing input from the user for the processor 130 to recognize as a particular tag format may include the writing area designation input, the tag area designation input, and the tag input.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to obtain a table that defines one or more tags and corresponding functions, and obtain information about a defined function corresponding to the detected tag input based on the table. The memory 120 may store the table that defines one or more tags and corresponding functions. When recognizing predefined tag input from the user' writing input, the processor 130 may look for a tag from the table stored in the memory 120 that corresponds to the tag input and identify a tag function corresponding to the tag input.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to store metadata that includes an identifier of the detected tag and color information used in the tag pattern in the memory 120 as tag information. By storing information about a tag every time the tag is generated or executed, the electronic device 100 may allow the user later on to search for a description of the tag that the user used.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to use at least one of the tag identifier or tag color information to search for tag information stored in the memory 120.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to detect a text tag from the tag input, recognize written characters from the written content obtained from the writing area, convert the recognized characters into digital text according to a defined function corresponding to the text tag, and display the digital text. Furthermore, when performing the text tag function, the processor 130 may create metadata including an identifier of the text tag input, the digital text corresponding to the recognized characters, and color information used in the tag input.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to detect a capture tag from the tag input, capture the written content obtained from the writing area according to a defined function corresponding to the capture tag input, and store the captured content as an image.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to detect a secret tag from the tag input, and conceal the written content obtained from the writing area according to a defined function corresponding to the secret tag input with an image of a color used in the tag input. In this case, the processor 130 may further output an item for receiving user input of personal identification information after detection of the secret tag input, output an image indicating that the secret tag has been applied while concealing the written content when receiving the user input including the personal identification information, output an item for user input of personal identification information to release the secret tag when receiving user input that selects the image, and disclose the concealed written content when receiving the user input including the personal identification information.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to detect a content storing tag from the tag input, and store the written content obtained from the writing area according to a defined function corresponding to the content storing tag input in a virtual space classified according to the color used in the tag input.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to detect a fetch tag from the tag input, and fetch the written content stored in the virtual space according to a defined function corresponding to the fetch tag input using the color information used in the tag input.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to display one or more contents of writing stored in the virtual space corresponding to the color information of the pen used in the writing input as respective thumbnail images when detecting the fetch tag input, and fetch and display a written content corresponding to a thumbnail image selected according to user input from among the one or more thumbnail images.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to detect an all-tag display tag from the tag input, and output one or more tag images that may be applicable to the written content obtained from the writing area according to a defined function corresponding to the all-tag display tag input.
The memory 120 may store a program for processes and control of the processor 130, and store data input to or output from the electronic device 100.
The memory 120 may include, for example, and without limitation, at least one type of storage medium including a flash memory, a hard disk, a multimedia card micro type memory, a card type memory (e.g., SD or XD memory), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read-Only Memory (ROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Programmable Read-Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, or the like.
In an embodiment of the disclosure, the memory 120 may store a table that defines one or more tags and corresponding functions.
In an embodiment of the disclosure, the memory 120 may store one or more rolls, which are a kind of task file of the electronic device 100, and metadata corresponding to the respective rolls.
In an embodiment of the disclosure, the memory 120 may include virtual space classified by color according to the content storing tag.
Referring to
Descriptions of the display 110, memory 120, processor 130, and input module 190 overlapping with what are described above in connection with
The tuner 140 may tune in with a frequency of a channel that the electronic device 100b intends to receive among a lot of radio frequencies through amplification, mixing, resonance of broadcast signals received via wires or wirelessly. The broadcast signal may include, for example, and without limitation, audio, video, and additional information, e.g., electronic program guide (EPG).
The communication module 150 may include various communication circuitry and connect the electronic device 100 to an external device, e.g., an audio device, a mobile device, or the like, under the control of the processor 130. The processor 130 may transmit or receive content to or from an external device connected through the communication module 150, download an application from the external device, or browse the web.
The communication module 150 may include one or more modules including various communication circuitry that allow wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network in which another electronic device is located. For example, the communication module 150 may include various modules, each including various communication circuitry, such as, for example, and without limitation, a broadcast receiving module 151, a mobile communication module 152, a wireless Internet module 153, and a short-range communication module 154. The communication module 150 may also be referred to as a transceiver.
The broadcast receiving module 151 receives broadcast signals and/or broadcasting-related information from an external broadcasting management server on a broadcasting channel. The broadcast signals may include television broadcast signals, radio broadcast signals, data broadcast signals, and a combination thereof.
The mobile communication module 152 transmits and/or receives wireless signals to and from at least one of a base station, an external terminal, or a server in the mobile communication network. The wireless signal may include a voice call signal, a video call signal or different types of data involved in transmission/reception of a text/multimedia message.
The wireless Internet module 153 may refer, for example, to a module for wireless Internet access, which may be built inside or outside the device. The wireless Internet technology may employ wireless LAN (WLAN), Wi-Fi, wireless broadband (Wibro), world interoperability for microwave access (Wimax), high speed downlink packet access (HSDPA), etc. The device may make Wi-Fi connection to another device through the wireless Internet module 153. For example, the processor 130 may use the wireless Internet module 153 to communicate with one or more APs 300.
The short-range communication module 154 may refer, for example, to a module for short-range communication. For the short-range communication technology, Bluetooth, Radio Frequency Identification (RFID), infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used.
The detector 160 may include various detecting circuitry and detect the user's voice, the user's image or the user's interaction, and may include various detecting circuitry including, for example, and without limitation, a microphone 161, a camera 162, and an optical receiver 163.
The microphone 161 may receive voice uttered by the user. The microphone 161 may convert the received voice into an electric signal and output the electric signal to the processor 130.
The camera 162 may receive an image, e.g., consecutive frames, corresponding to a motion of the user including a gesture in a camera recognition range.
The optical receiver 163 may receive an optical signal (including a control signal) from a remote control device. The optical receiver 163 may receive an optical signal corresponding to the user input, e.g., touch, pushing, a touching gesture, voice, or motion, of the user from the remote control device. A control signal may be derived from the received optical signal under the control of the processor 130.
The input/output module 170 may include various input/output circuitry and may receive a video (e.g., a moving image), an audio (e.g., a voice, music, etc.), additional information (e.g., an EPG), or the like from outside of the electronic device 100 under the control of the processor 130. The input/output module 170 may include various input/output circuitry including, for example, and without limitation, one or a combination of a high-definition multimedia interface (HDMI) port 171, a component jack 172, a personal computer (PC) port 173, and a universal serial bus (USB) port 174.
The video processor 180 may include various video processing circuitry and process image data to be displayed on the display 110, and perform various image processing operations such as decoding, rendering, scaling, noise filtering, frame rate conversion, resolution conversion, etc., on the video data.
The display 110 may display a video included in the broadcast signal received through the tuner 140 on the screen, under the control of the processor 130. Furthermore, the display 110 may display content, e.g., a moving image, received through the communication module 150 or the input/output module 170. The display 110 may output an image stored in the memory 120, under the control of the processor 130. In an embodiment of the disclosure, the display 110 may output a screen of an external device mirrored onto the electronic device 100, and may output drawing data corresponding to the received drawing input.
When the display 110 and a touch pad are implemented in a layered structure to constitute a touch screen, the display 110 may also be used as an input device in addition to the output device. The display 110 may include, for example, and without limitation, at least one of an LCD, a TFT-LCD, OLEDs, a flexible display, a 3D display, an electrophoretic display, or the like.
The audio processor 115 may include various audio processing circuitry and may process audio data. For example, the audio processor 115 may perform various processing such as decoding, amplification, noise filtering, etc., on the audio data.
The audio output module 125 may include various audio output circuitry and may output an audio included in the broadcast signal received through the tuner 140, an audio received through the communication module 150 or the input/output module 170, or an audio stored in the memory 120, under the control of the processor 130. The audio output module 125 may include various audio output circuitry, such as, for example, and without limitation, at least one of a speaker 126, a headphone output terminal 127 or a Sony/Philips digital interface (S/PDIF) 128.
The user input module 190 may include various user input circuitry that allows the user to input data to control the electronic device 100. The user input module 190 may include a touch input module to receive touch input. For example, the user input module 190 may include a key pad, a dome switch, a (capacitive, resistive, infrared detection type, surface acoustic wave type, integral strain gauge type, piezoelectric effect type) touch pad, a jog wheel, a jog switch, etc., without being limited thereto.
In an embodiment of the disclosure, the memory 120 may store a program for processes and control of the processor 130, and store data input to or output from the electronic device 100.
The processor 130 may include various processing circuitry and control general operation of the electronic device 100 and signal flows between the internal components of the electronic device 100, and process data. The processor 130 may run an operating system (OS) and various applications stored in the memory 120 at the user's request or when a predetermined condition is met.
In an embodiment of the disclosure, the processor 130 may execute one or more instructions stored in the memory 120 to receive writing input on the display 110, detect a writing area and a tag area from the writing input, detect a predefined form of tag input from the detected tag area, obtain a defined function corresponding to the detected tag input, obtain written content from the detected writing area, and perform the defined function corresponding to the detected tag input for the written content. As such, the electronic device may perform a certain function that the user wants for the written content through writing input from the user, so that the user may conveniently perform a tag function without manipulating any extra menu or button.
The block diagrams of the electronic device 100 as shown in
Referring to
When the user makes writing input on his/her electronic device 100 e.g., during a meeting and wants to perform a particular function for the writing input, the user may make the writing area designation input to define a writing area to be subject to the particular function. The writing area designation input may also be a kind of writing input on the electronic device 100.
For example, the writing area designation input may correspond to a closed figure that encloses part or all of the written content input from the user on the electronic device 100. The user may determine a writing area of the written content to an extent which the user wants to perform the particular function and make the writing area designation input by drawing the closed figure that encloses the writing area.
In operation S420, the electronic device 100 receives tag input for the writing area through the touch input module.
The user may make the tag input for the writing area to be subject to a particular function. The tag input is also a kind of writing input.
The electronic device 100 may store information about one or more tags and functions defined to correspond to the tags. To use the stored tag functions in the electronic device 100, the user may make tag input corresponding to a tag function that the user wants.
As long as the tag input may be identified by the electronic device 100, the tag input may be made at any location on the display of the electronic device 100.
In operation S430, the electronic device 100 performs a predefined function that corresponds to the tag input for the writing area.
The electronic device 100 may receive the tag input in operation S420 and compare the form of the received tag input with one or more tags stored in the electronic device 100. When the received tag input is recognized as one of the predefined tags stored in the electronic device 100, the electronic device 100 may obtain a defined function corresponding to the recognized tag and perform the function.
Referring to
For example, when the electronic device 100 recognizes the tag input 404 from the writing input 401, it may determine to perform a tag function corresponding to the tag input 404 for the writing area 402 defined by the writing area designation input 403.
In the disclosure, to settle (e.g., designate) a range of the writing area 402 to be subject to the tag function, the writing area designation input 403 may be detected among the writing input 401. In a way to distinguish written content to be subject to the tag among the writing input 401, a closed figure to enclose the written content may be taken into account. The closed figure may have its starting point connected to its end point to enclose the writing area 402 regardless of shape.
The electronic device 100 may recognize a tag corresponding to the tag input 404 by comparing the tag input 404 received through the touch input module with the forms of tags stored in the electronic device 100. When the electronic device 100 recognizes the tag, it may apply a function corresponding to the tag to the writing area 402 to perform the tag function.
For example, the user may write ‘BIG’ on the display of the electronic device 100 while performing a task using the electronic device 100. And, when the user wants to apply a certain function to the written content ‘BIG’, the user may apply the tag function by drawing the writing area designation input 403 that encloses the writing ‘BIG’, and the tag input 404. Although the user usually uses the above method to use a tag function in the electronic device 100, the sequences in the method are not limited thereto.
According to various embodiments of the disclosure it does not matter in which order the user makes the writing input in on the display of the electronic device 100. As the electronic device 100 determines a target to be subject to the tag function by recognizing the writing area designation input 403 and the tag input 404, it does not matter whether the tag input 404 comes first or the writing area designation input 403 comes first.
Furthermore, the electronic device 100 may define color information in relation to a tag function. No matter which color the user uses for the content in the writing area 402, the electronic device 100 may define a color of the pen used in the writing area designation input 403 and the tag input 404 as a tag color. The electronic device 100 may add the tag color to the information about the tag and store the information. Accordingly, the electronic device 100 may search for tag information based on the tag color.
Referring to
For example, the user may make writing input by writing characters or drawing a picture on the touch input module with his/her finger or an electronic pen, or by fetching an image.
In operation S520, the electronic device 100 detects the writing area designation input and tag area designation input from the writing input.
For example, the electronic device 100 may detect the writing area and the tag area by recognizing the writing area designation input and the tag area designation input from the received writing input. The writing area designation input may include a first pattern. The tag area designation input may include a second pattern. For example, the first pattern may include a first closed figure, and the second pattern may include a second closed figure different from the first closed figure. For example, the second closed figure may be located next to the first closed figure. The first and second closed figures refer to figures that form a closed loop with its starting point connected to its end point. In an embodiment of the disclosure, as a tag is executed not by a separate menu but based on writing input made by the user, the electronic device 100 is required to distinguish between the writing input as content and the writing input for tag execution. When recognizing a particular pattern while the user is making writing input, the electronic device 100 may determine the particular pattern as a pattern for tag execution.
Unlike in the example as shown in
In operation S530, the electronic device 100 detects a predefined form of tag input from the detected tag area designation input.
For example, the electronic device 100 may store one or more predefined tags, and when determining that the tag input detected from the tag area designation input detected from the writing input is similar to a predefined form of tag stored in the electronic device 100 by more than certain threshold value by comparing the tag input with the one or more predefined tags, detect the tag input as the predefined form of tag.
In operation S540, the electronic device 100 obtains a defined function corresponding to the detected tag input.
For example, the electronic device 100 may store a table that defines one or more tags and corresponding functions. Accordingly, the electronic device 100 may obtain a defined function corresponding to the detected tag input from the table. The predefined tags may include, for example, and without limitation, a text tag, a capture tab, a secret tag, a content storing/fetch tag, an all-tag display tag, etc., which will be described in greater detail below.
In operation S550, the electronic device 100 obtains the written content from the detected writing area designation input.
The electronic device 100 may obtain the written content from the writing area designation input detected in operation S520. As described above, the writing area designation input may be settled e.g., by the first closed figure, and the written content includes what is enclosed by the first closed figure. The remaining writing input outside the first enclosed figure is not included in the written content.
In operation S560, the electronic device 100 performs a defined function corresponding to the detected tag input for the written content.
The electronic device 100 may perform the tag function obtained in operation S540 on the written content obtained in operation S550.
Referring to
For example, when the electronic device 100 recognizes the writing area designation input 503, the tag area designation input 504, and the tag input 505 from the writing input 501, it may determine that the writing input 501 is related to a tag. Except the writing area 502, the writing area designation input 503, the tag area designation input 504, and the tag input 505, which are related to tag recognition, may be referred to as a tag format.
In an embodiment of the disclosure, the writing area designation input 503 may have the form of a first closed figure. To settle a range of the written content to be subject to a tag function, the written content needs to be distinguished first among the writing input. In a way to distinguish written content to be subject to the tag among the writing input 501, a closed figure to enclose the written content may be taken into account. The closed figure may have its starting point connected to its end point to enclose the written area 502 regardless of what shape it has.
In an embodiment of the disclosure, the tag area designation input 504 may have the form of a second closed figure. What is enclosed by the second closed figure may be referred to as the tag input. The first closed figure is used to settle the written content to which the tag function is to be applied, and the second closed figure is used to identify the tag input. In other words, the electronic device 100 may look for tag input to be recognized by the electronic device 100 from what is enclosed by the second closed figure. By recognizing the second closed figure next to the first closed figure, the electronic device 100 may determine that the second closed figure contains the tag input 505.
In an embodiment of the disclosure, the tag area designation input 504 may be arranged next to the writing area designation input 503. As shown in
For example, the user may write ‘BIG’ on the display of the electronic device 100 while performing a task using the electronic device 100. And, when the user wants to apply a certain function to the written content ‘BIG’, the user may apply the tag function he/she wants by drawing the writing area designation input 503 (the first closed figure) that encloses the writing ‘BIG’, the tag area designation input 504 (the second closed figure) next to the writing area designation input 503, and the tag input 505 in an area enclosed by the tag area designation input 504. Although the user usually uses the above method to use a tag function in the electronic device 100, the sequences in the method are not limited thereto.
According to various embodiments of the disclosure it does not matter in which order the user makes the writing input in on the display of the electronic device 100. As the electronic device 100 determines a target to be subject to the tag function by recognizing the first closed figure, the second closed figure, and the tag inside the second closed figure, it does not matter whether the tag input 505 comes first or the written content comes first.
Furthermore, the electronic device 100 may define color information in relation to a tag function. No matter which color the user uses for the content of the writing input 501, the electronic device 100 may define a tag format, e.g., a color of the pen used in the writing area designation input 504, the tag area designation input 504, and the tag input 505 as a tag color. The electronic device 100 may add the tag color to the information about the tag and store the information. Accordingly, the electronic device 100 may search for tag information based on the tag color.
Referring to
In
The user may make writing input on the electronic device 100 using his/her finger. In this case, when the user wants to determine or change the color of the writing input, the user may determine a color to be used in writing input using a menu or button equipped in the electronic device 100.
The user may make writing input on the electronic device 100 using a pen. In this case, for example, the user may have a color menu 710 of a pen 700 to be displayed for use in writing input by pushing the pen 700 on the display of the electronic device 100 for a certain time. The user may determine a color of the pen 700 to be used in writing input by selecting the color on the color menu 710.
In an embodiment of the disclosure, the color information used in writing input may be used in the tag function.
In an embodiment of the disclosure, as for a text tag that converts the written content into digital text, the written content may be converted into digital text using the color information used in the written content.
In an embodiment of the disclosure, when a function corresponding to the tag input is performed for the written content, tag information is stored as the tag function is performed, and the tag information may include color information used in the written content. The color information included in the tag information may be used later to search for a tag executed in the electronic device 100. This will be described in greater detail below.
Referring to
The all-tag display tag 811 is to output forms of all tags that may be designated in a writing area to a user interface. The all-tag display tag 811 is to display all possible forms of tags that that user may apply to the written content in the writing area to serve as such a function as ‘help’ for the user when the user has no idea of which tags he/she is able to use. For example, the tag form 840 of the all-tag display tag 811 may be, for example, a star.
The text tag 812 is to recognize characters of the written content in the writing area through e.g., object recognition, and convert them into digital text. The digital text may be stored in a document for which the text tag is performed. The digital text may also be included in text information. The tag information 830 stored for the text tag 812 may include the digital text resulting from the conversion, color information used in the tag input, and a tag identifier. The tag form 840 of the text tag 812 may be, for example, ‘T’.
The capture tag 813 is to capture the written content in the writing area and store it as an image in a local drive in the electronic device 100. The written content in the writing area may include an image or characters. The tag information 830 stored for the capture tag 813 may include color information used in the writing input, and the tag identifier. The tag form 840 of the capture tag 813 may be, for example, ‘0’.
The secret tag 814 is to conceal the written content in the writing area with a cover of a color used in the writing input. To release the secret tag and remove the cover, a personal identification number (PIN) number may be required. The tag information 830 stored for the secret tag 814 may include color information used in the writing input, and the tag identifier. The tag form 840 of the secret tag 814 may be, for example, ‘X’.
The content storing tag 815 is to store the written content in the writing area in virtual space classified by color. The tag information 830 stored for the content storing tag 815 may include color information used in the writing input, and the tag identifier. The tag form 840 of the content storing tag 815 may be, for example, T.
The fetch tag 816 is to fetch the written content stored in the virtual space classified by color. The tag information 830 stored for the fetch tag 816 may include color information used in the writing input, and the tag identifier. The tag form 840 of the fetch tag 816 may be, for example,
In an embodiment of the disclosure, a file used in the electronic device 100 may be called a ‘roll’. The roll may refer, for example, to a file with several successive pages. For example, one roll may have the form of 1 page or up to 20 successive pages.
Referring to
Referring to
Each roll has its metadata 1020, and the metadata 1020 may include one or more pieces of tag information. When the user opens and uses a roll, as many pieces of tag information as the number of tags used by the user are created and included in the metadata while the roll is used. For example, referring to
Each tag information includes a detailed item 1030. For example, tag information #1 may include detailed items 1030, such as a tag identifier 1031 for identifying the tag #1, and a tag color 1032, which is a pen color used as the tag format in using the tag. Furthermore, tag information #1 may further include digital text 1033 as the detailed item 1030 when the tag corresponds to the text tag.
As shown in
Functions of the tags as shown in
The all-tag display tag serves to output a user interface that shows forms of tags provided by the electronic device 100.
Referring to
As shown in 1100A of
Subsequently, as shown in 1100B of
Referring to 1100C of
The electronic device 100 recognizes the first closed
Referring to 1100D of
In an embodiment of the disclosure, when the user selects a tag form from the user interface 1115, the electronic device 100 may perform a function of the tag selected by the user for the characters ‘BIG’ 1112, which is the written content enclosed by the first closed
In an embodiment of the disclosure, when the user selects a tag form from the user interface 1115, the electronic device 100 may output another user interface that shows a description of the function of the tag selected by the user. For example, as shown in 1100D, the user may still not know what function each tag has even while the user interface 1115 is displayed to show all the forms of tags, so another user interface (not shown) may be shown to provide help about each tag.
The text tag has a function for the electronic device 100 to convert the written content into digital text.
Referring to 1200 of
As shown in 1200A of
Subsequently, as shown in 1200B of
Referring to 1200C of
The electronic device 100 recognizes the first closed
Referring to 1200D of
In an embodiment of the disclosure, the electronic device 100 may store the digital text converted from the written content in the corresponding roll.
Furthermore, in an embodiment of the disclosure, the electronic device 100 may store information about the executed text tag in the roll as the metadata of the roll.
It may be assumed, for convenience, that the text tag as described above in connection with
Referring to
In an embodiment of the disclosure, a file name of roll #1 1310 may be created to include ‘orange’. As the file name of roll #1 1310 includes ‘orange’, the electronic device 100 may search for a roll that includes a tag whose writing input is in orange.
In an embodiment of the disclosure, a plurality of pieces of tag information are stored as metadata of roll #1 1330, in which case tag information 1340 of the text tag may include ‘text tag’ for the tag identifier, ‘orange’ for the tag color, and ‘BIG’ for the digital text. As such, roll #1 includes ‘BIG’ and ‘orange’ as information of the text tag, so the electronic device 100 may search for the tag based on ‘BIG’ and ‘orange’.
The capture tag has a function for the electronic device 100 to capture the written content and store it in an image form in a local storage space of the electronic device 100.
Referring to 1400 of
Referring to 1400A of
Referring to 1400B of
The electronic device 100 recognizes the first closed
Referring to 1400C of
In an embodiment of the disclosure, the electronic device 100 may store information about the capture tag as metadata of the corresponding roll. Referring to 1400D of
In an embodiment of the disclosure, when the captured content is stored in the storage space in the image form, an image file including the image may include e.g., tag color information. Accordingly, the electronic device 100 may search for the image file stored according to the capture tag based on the tag color information later on.
The secret tag has a function for the electronic device 100 to conceal the written content with a cover in the color of a pen, so that the content is not viewed on the display.
Referring to 1500 of
Referring to 1500A of
Subsequently, as shown in 1500B of
The electronic device 100 recognizes the first closed
As shown in 1500C of
Referring to 1500D of
Referring to 1500E of
As such, when the secret tag is executed, information about the secret tag may include ‘secret tag’ for the tag identifier and ‘orange’ for the tag color.
Referring to 1600A of
As shown in 1600B of
Referring to 1600C of
Referring to 1600D of
The content storing tag has a function for the electronic device 100 to store the written content in a virtual space of the electronic device 100.
Referring to 1700 of
Referring to 1700A of
Referring to 1700B of
The electronic device 100 recognizes the first closed
Referring to 1700C of
As such, when the content storing tag is executed, information about the content storing tag may include ‘content storing tag’ for the tag identifier and ‘orange’ for the tag color.
Virtual space 1800 may include a plurality of virtual spaces classified by color. The written content subject to the content storing tag may be stored in the virtual space that automatically corresponds to a color used for the content storing tag.
For example, the user may open the content of the virtual space through a particular menu of the electronic device 100. An example of a virtual space user interface to be shown for the user is the virtual space 1800 shown in
Referring to
For example, when the user stores all the written content related to a particular meeting topic by means of the content storing tag using blue color, the user may easily look up the written content by selecting the blue virtual space to open the written content related to the particular meeting topic.
The fetch tag has a function for the electronic device 100 to fetch the written content stored by means of the content storing tag in the virtual space.
Referring to 1900 of
As shown in 1900A of
The electronic device 100 recognizes the first closed
Referring to 1900B of
Referring to 1900C of
Referring to
When the user selected the roll manager menu 2010, a new user interface 2100 may be output. The new user interface 2100 may include menus like ‘create new’, ‘roll explorer’, ‘store’, ‘blackboard’, etc. The menu ‘create new’ is a menu to create a new roll. The menu ‘roll explorer’ is a menu to open, delete, or export a stored roll. The menu ‘store’ is a menu to store the current roll. The menu ‘blackboard’ is a menu to switch writing mode between blackboard and whiteboard.
A fetch menu 2050 and an export menu 2060 may be arranged near the top edge of the screen of the electronic device 100. The fetch menu 2050 may enable the electronic device 100 to show a screen of an external device connected to the electronic device 100 or fetch a material, such as an image stored in a connected USB or network drive. The export menu 2060 may enable the electronic device 100 to export a roll created in the electronic device 100 in various methods, such as by email, printer, USB, screen sharing with an external device.
Referring to
Every time a roll is created in the electronic device 100, the roll and its metadata may be stored in storage space of the electronic device 100, as described above in connection with
In an embodiment of the disclosure, the electronic device 100 may use text used for the text tag in a roll explorer 2110 to search for a roll. For example, the user may input text ‘BIG’ on a search keyword input window in the roll explorer 2110. When receiving the text input, the electronic device 100 may discover one or more rolls that include the text ‘BIG’ inside the roll or as tag information. As described above in connection with
In an embodiment of the disclosure, the electronic device 100 may use color information used for the tag in a roll explorer 2120 to search for a roll. For example, the user may input text ‘Orange’ on a search keyword input window in the roll explorer 2120. When receiving the text input, the electronic device 100 may discover one or more rolls that include the text ‘Orange’ inside the roll or as tag information. As described above in connection with
The one or more rolls that come in search results may include both the rolls having text ‘Orange’ in the rolls and the rolls having ‘Orange’ for tag information in relation to the rolls. Hence, the electronic device 100 may output the rolls by distinguishing the rolls having the keyword ‘Orange’ for text from rolls having the keyword ‘Orange’ for a tag color.
Accordingly, when the user ever executed a tag function using an orange colored tag during e.g., a meeting, the user may discover all the rolls including the orange colored tag later by searching for ‘Orange’ in the roll explorer 2130.
In an embodiment of the disclosure, the electronic device 100 may recommend tags that have been used recently or have frequently been used in a roll explorer 2130. When one of the recommended tags is selected by the user, the electronic device 100 may search for the selected tag. For example, when the user selects ‘Holiday’ in the roll explorer 2130, the electronic device 100 may search for and output rolls those include the text ‘Holiday’ therein or as the tag information, among rolls stored in the electronic device 100.
A roll created in the electronic device 100 may be exported into a PDF document. A roll that has text tag information as its metadata stores text in the roll, and the text tag information also includes the text. In this case, when the roll is exported to a PDF document, the text tag information, which is the metadata of the roll, may be stored in the PDF document. For example, when a roll including text ‘BIG’ and tag color information ‘orange’ as a result of executing the text tag as described above in connection with
Accordingly, referring to
Furthermore, when ‘Orange’ is input as a search keyword on the interface 2200 of the PDF document to which the roll is exported, the text ‘BIG’ having color information ‘orange’ may be searched for.
The electronic device and operation method of the electronic device according to embodiments of the disclosure may be implemented in program commands which are executed by various computing devices and recorded in computer-readable media. The computer-readable media may include program commands, data files, data structures, etc., separately or in combination. The program commands recorded on the computer-readable media may be designed and configured specially for the disclosure, or may be well-known to those of ordinary skill in the art of computer software. Examples of the computer readable recording medium include hardware devices specially configured to store and execute program commands, such as read-only memories (ROMs), random-access memories (RAMs), Compact Disc (CD)-ROMs, magnetic tapes, floppy disks, optical data storage devices, etc. Examples of the program commands include not only machine language codes but also high-level language codes which are executable by various computing means using an interpreter, including, for example, codes generated by a compiler or codes executed by an interpreter.
According to embodiments of the disclosure, an electronic device may allow the user to perform a tag function for the written content input to the electronic device by the writing input without extra button or menu manipulation.
While various example embodiments of the disclosure have been illustrated and described, it will be understood that various modifications can be made without departing the scope of the disclosure. It will be apparent to those ordinary skilled in the art that the disclosure is not limited to the example embodiments of the disclosure described, but can encompass not only the appended claims but the equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2019-0004636 | Jan 2019 | KR | national |
