Patent Application
20170329504
Methods and apparatus consistent with exemplary embodiments relate to a method and a device for providing content.
Mobile terminals are portable devices equipped with at least one of functions of performing voice and video calls, inputting or outputting information, and storing data, while being carried. As the functions are diversified, mobile terminals are gradually equipped to perform complex functions such as capturing images or moving pictures, reproducing music files or moving picture files, playing games, receiving broadcasts, accessing wireless internet, etc., and are implemented in form of a multimedia player providing various content.
Exemplary embodiments address at least the above problems and/or disadvantages and other disadvantages not described above. Also, the exemplary embodiments are not required to overcome the disadvantages described above, and may not overcome any of the problems described above.
Exemplary embodiments provide a method and a device for providing content by modifying a selected part of the content and an unselected part of the content provided by a device, to be different from each other.
According to an aspect of an exemplary embodiment, there is provided a device including a display configured to display content, and an interface configured to receive a first input that selects a part of the displayed content, and a second input that requests to change a size of the displayed content. The device further includes a controller configured to control the display to display the selected part of the displayed content and an unselected part of the displayed content by changing a size of the selected part and a size of the unselected part to be different from each other, in response to the interface receiving the second input.
The controller may be further configured to control the display to increase the size of the selected part of the displayed content by a first magnification, and decrease the size of the unselected part of the displayed content by a second magnification that is determined based on the first magnification.
The first input may select the part of the displayed content using an input tool, and the controller may be further configured to determine the first magnification based on at least one among a thickness, a color, and a style of the first input.
The second input may include an open pinch, and the controller may be further configured to determine the first magnification based on a distance moved by two fingers in the open pinch.
The controller may be further configured to control the display to cease display of the unselected part of the displayed content, and display a first icon in place of the unselected part of the displayed content.
The interface may be further configured to receive a third input that selects the first icon, and the controller may be further configured to control the display to display the unselected part of the displayed content, and change the first icon to a second icon, in response to the interface receiving the third input.
The interface may be further configured to receive a fourth input that selects the second icon, and the controller may be further configured to control the display to cease display of the unselected part of the displayed content, and change the second icon to the first icon, in response to the interface receiving the fourth input.
The content may include at least one among handwritten text, typed text, and image content.
According to an aspect of another exemplary embodiment, there is provided a device including a display configured to display audio/video (A/V) content, an interface configured to receive an input that selects a section of the displayed A/V content, and a controller configured to control a reproduction speed of the selected section of the displayed A/V content and a reproduction speed of an unselected section of the displayed A/V content to be different from each other.
The display may be further configured to display a timeline that indicates a reproduction time point of the A/V content, the input may select a first position and a second position on the timeline, and the controller may be further configured to determine the selected section of the displayed A/V content to be between the first position and the second position.
The interface may be further configured to receive a close pinch or an open pinch in which two fingers touch the first position and the second position and move in directions toward or away from each other, respectively, and the controller may be further configured to determine the reproduction speed of the selected section of the displayed A/V content and the reproduction speed of the unselected section of the displayed A/V content, based on the directions and a distance of the movement of the two fingers.
According to an aspect of another exemplary embodiment, there is provided a method of providing content of a device, the method including displaying content, and receiving a first input that selects a part of the displayed content, and a second input that requests to change a size of the displayed content. The method further includes displaying the selected part of the displayed content and an unselected part of the displayed content by changing a size of the selected part and a size of the unselected part to be different from each other, in response to the interface receiving the second input.
The displaying the selected part and the unselected part may include increasing the size of the selected part of the displayed content by a first magnification, and decreasing the size of unselected part of the displayed content by a second magnification that is determined based on the first magnification.
The first input may select the part of the displayed content using an input tool, and the method may further include determining the first magnification based on at least one among a thickness, a color, and a style of the first input.
The second input may include an open pinch, and the method may further include determining the first magnification based on a distance moved by two fingers in the open pinch.
The displaying the selected part and the unselected part may include ceasing display of the unselected part of the displayed content, and displaying a first icon in place of the unselected part of the displayed content.
The method may further include receiving a third input that selects the first icon, and displaying the unselected part of the displayed content, and changing the first icon to a second icon, in response to the receiving the third input.
According to an aspect of another exemplary embodiment, there is provided a method of providing content of a device, the method including displaying audio/video (A/V) content, receiving an input that selects a section of the displayed A/V content, and controlling a reproduction speed of the selected section of the displayed A/V content and a reproduction speed of an unselected section of the displayed A/V content to be different from each other.
The method may further include displaying a timeline that indicates a reproduction time point of the A/V content, wherein the input selects a first position and a second position on the timeline, and determining the selected section of the displayed A/V content to be between the first position and the second position.
The method may further include receiving a close pinch or an open pinch in which two fingers touch the first position and the second position and move in directions toward or away from each other, respectively, and the controlling may include determining the reproduction speed of the selected section of the displayed A/V content and the reproduction speed of the unselected section of the displayed A/V content, based on the directions and a distance of the movement of the two fingers.
According to an aspect of another exemplary embodiment, there is provided a device including a display configured to display content, an interface configured to receive an input that selects a part of the displayed content, and a controller configured to control the display to display the selected part of the displayed content and an unselected part of the displayed content by changing a size of the selected part and a size of the unselected part to be different from each other.
The content may include image content, and the controller may be further configured to increase the size of the selected part of the displayed image content, and decrease the size of the unselected part of the displayed image content.
The interface may be further configured to receive a size change input that requests to change a size of the displayed content, and the controller may be further configured to increase the size of the selected part of the displayed content, in response to the interface receiving the size change input that draws a clockwise circle, and decrease the size of the selected part of the displayed content, in response to the interface receiving the size change input that draws a counterclockwise circle.
The interface may be further configured to receive a size change input that requests to change a size of the displayed content, and the controller may be further configured to increase the size of the selected part of the displayed content, in response to the interface receiving the size change input that includes an open pinch, and decrease the size of the selected part of the displayed content, in response to the interface receiving the size change input that includes a close pinch.
The above and/or other aspects will be more apparent by describing exemplary embodiments with reference to the accompanying drawings in which:
Exemplary embodiments are described in greater detail herein with reference to the accompanying drawings.
In the following description, like drawing reference numerals are used for like elements, even in different drawings. The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. However, it is apparent that the exemplary embodiments can be practiced without those specifically defined matters. Also, well-known functions or constructions are not described in detail because they would obscure the description with unnecessary detail.
It will be understood that the terms “comprises” and/or “comprising” used herein specify the presence of stated features or components, but do not preclude the presence or addition of one or more other features or components. In addition, the terms such as “unit,” “-er (-or),” and “module” described in the specification refer to an element for performing at least one function or operation, and may be implemented in hardware, software, or the combination of hardware and software.
In the entire specification, a “touch input” may signify a gesture performed by a user on a touch screen to control a device. The touch gesture stated in the present specification may include tapping, touching & holding, double tapping, dragging, panning, flicking, dragging & dropping, etc.
“Tapping” is a user's motion of touching a screen by using a finger or a touch tool such as an electronic pen (e.g., stylus) and then instantly lifting the finger or touch tool from the screen without moving.
“Touching & holding” is a user's motion of touching a screen by using a finger or a touch tool such as an electronic pen and then maintaining the above touching motion over a time, for example, 2 secs, after touching the screen. In other words, a time difference between a touch-in time and a touch-out time is greater than or equal to the time, for example, 2 secs. When a touch input lasts over the time, to remind the user whether the touch input is tapping or touching & holding, a feedback signal may be provided in a visual, acoustic, or tactile manner. The time may vary according to an embodiment.
“Double tapping” is a user's motion of touching the screen twice by using the finger or touch tool.
“Dragging” is a user's motion of touching the screen by using the finger or touch tool and moving the finger or touch tool to another position on the screen while keeping the touching motion. The dragging motion may enable the moving or panning motion of an object.
“Panning” is a user's motion of performing a dragging motion without selecting an object. Because no object is selected in the panning motion, no object is moved in a page but the page itself is moved on the screen or a group of objects may be moved within a page.
“Flicking” is a user's motion of performing a dragging motion over a speed, for example, 100 pixel/s, by using the finger or touch tool. The dragging (panning) motion or the flicking motion may be distinguished based on whether the moving speed of the finger or touch tool is over the speed, for example, 100 pixel/s, or not.
“Dragging & Dropping” is a user's motion of dragging an object to a predetermined position on the screen by using the finger or touch tool and then dropping the object at that position.
“Pinching” is a user's motion of moving two fingers touching on the screen in opposite directions. The pinching motion is a gesture to magnify (open pinch) or contract (close pinch) an object or a page. A magnification value or a contraction value is determined according to the distance between the two fingers.
“Swiping” is a user's motion of touching an object on the screen by using the finger or touch tool and simultaneously moving the object horizontally or vertically by a predetermine distance. A swiping motion in a diagonal direction may not be recognized as a swiping event.
Also, in the exemplary embodiments, a button input may include a physical user interface (PUI) button input and a graphical user interface (GUI) button input.
Also, in the exemplary embodiments, a motion input may include a user motion input and a device motion input. In the case of a user motion input, a motion of a user may be recognized through a camera. In the case of a device motion input, a device may recognize a movement of a device through an acceleration sensor or a gyro sensor.
For example, the user motion input may be an input to move a user's hand to be away from or toward a device, an input to move a user's hand from right to left or from left to right, an input to move a user's hand from up to bottom or from bottom to up, or an input to open or close a user's hand.
Also, the device motion input may be inputs of shaking a device left and right or up and down, and an input to move a device to be away from or toward a device.
Referring to
The device 100 may be a mobile phone, a smartphone, a laptop computer, a tablet PC, an electronic book terminal, a digital broadcast terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, an MP3 player, a digital camera, a wearable device, for example, glasses or a wrist watch, etc., but the present exemplary embodiment is not limited thereto.
The device 100 is a device that reproduces various types of content. For example, the content may be handwritten text content, typed text content, an image content, a video content, an audio content, a list, etc., but the present exemplary embodiment is not limited thereto.
The handwritten text content may be a set of strokes input in a predetermined time order. The strokes may signify a trajectory that is drawn from a touch point on the device 10 by the input tool 200 maintaining a touch. For example, in an equation “3+2=5”, when a user draws, without interruption, each of “3” and “2” while maintaining a touch, each of “3” and “2” may constitute one stroke. For a symbol “+”, a user first draws “−” and then draws “I” so that “−” and “I” each may constitute one stroke. One stroke may constitute one character or symbol, or a plurality of strokes may constitute one character or symbol.
Alternatively or additionally, each stroke included in a handwritten text content is relative to time information. The time information of a stroke may correspond to a time point when the stroke is generated or changed. The time information of a stroke may be recorded according to a time stamp format representing a time.
A typed text content may be a list of characters in an order or the list may include items having the same attribute that are arrayed in sequence.
Also, the device 100 may display a handwritten text content, a typed text content, an image content, a list, etc. on a display 121 (
Also, the input tool 200 is a device used by a user to input information to the device 100. For example, the input tool 200 may be a finger, an electronic pen, for example, a stylus pen, a keyboard, a mouse, etc., but the present exemplary embodiment is not limited thereto. The device 100 may receive a user's touch input, and the input tool 200 may receive a touch input on the device 100.
The device 100 may receive an input to select a partial area of content by a user using the input tool 200.
For example, referring to
Alternatively or additionally, the user may select a part of a typed text content displayed on the device 100 by using the input tool 200. The device 100 may recognize the part of a typed text content in units of coordinates or characters. For example, a part of a typed text content may be presented by a coordinate value (first coordinate information) on a coordinate plane corresponding to the display 121 or a coordinate value (second coordinate information) on a coordinate plane corresponding to the entire typed text content. Alternatively or additionally, the part of a typed text content may be presented by a character included in the part of a typed text content.
Alternatively or additionally, the user may select a part of an image content displayed on the device 100 by using the input tool 200. The device 100 may recognize the part of an image content in units of coordinates or objects. For example, a part of an image content may be presented by a coordinate value (first coordinate information) on a coordinate plane corresponding to the display 121 or a coordinate value (second coordinate information) on a coordinate plane corresponding to the entire image content. Alternatively or additionally, the part of an image content may be presented by an object, for example, a person, a building, a character, etc., included in the part of image content.
Alternatively or additionally, the user may select a partial section of a video content or an audio content reproduced by the device 100, by using the input tool 200. The device 100 may recognize the partial section of a video content in units of time. For example, a total reproduction time of a video content is 1 hour, 12 mins, and 23 secs, a partial section may be selected in a section between 0 seconds when a video content starts and 1 hour, 12 mins, and 23 secs when the video content ends. Accordingly, the partial section of a video content may be presented by time information based on a start time of the video content.
Also, the device 100 may recognize the partial section of an audio content in units of time like the video content. The partial section of an audio content may be presented by time information based on a start time of the audio content.
Alternatively or additionally, the user may select a part of a list displayed on the device 100. The device 100 may recognize the part of a list in units of items.
The above-described system for providing content is described below in detail with reference to the accompanying drawings.
Referring to
The handwritten text content may signify content obtained by converting a user's handwritten input to digital information. For example, the handwritten text content may include a handwritten image, a handwritten text, etc. drawn on a digital device, but the present exemplary embodiment is not limited thereto. Also, the handwritten text content may be generated by the device 100 based on a received touch input on the device 100, or may be generated by and received from an external device.
The device 100 may display the handwritten text content on an execution window of an application. For example, the application may include a writing notebook application, a memo application, a diary application, a calendar application, an e-book application, a household account book, etc., but the present exemplary embodiment is not limited thereto.
In operation S220, the device 100 receives an input to select a part of the displayed handwritten text content.
For example, the user may highlight or underline a part of the handwritten text content displayed on the device 100 by using the input tool 200. The device 100 may determine the highlighted or underlined part of the handwritten text content, to be selected.
Also, the user may draw a closed curve such as a circle or a polygon by using the input tool 200. The device 100 may determine the part of the handwritten text content included in the drawn closed curve to be selected.
In operation S230, the device 100 receives a user input to modify (magnify or reduce) a handwritten text content.
For example, an input requesting magnification or reduction of a handwritten text content may include an input to draw a pattern, a button input, a user motion input, a device motion input, a voice input, etc., but the present exemplary embodiment is not limited thereto.
In operation S240, the device 100 displays on the display 121 the selected handwritten text content and unselected handwritten content by magnifying or reducing the same at different magnification powers.
For example, when the device 100 receives an input requesting magnification of a handwritten text content, a selected part of the handwritten text content may be magnified at a first magnification and an unselected part of the handwritten text content may be magnified at a second magnification, where the first magnification may be greater than the second magnification.
In another example, when the device 100 receives an input requesting reduction of a handwritten text content, a selected part of the handwritten text content may be reduced at a first magnification and an unselected part of the handwritten text content may be reduce at a second magnification, where the first magnification may be greater than the second magnification. In still another example, when the device 100 receives an input requesting reduction of a handwritten text content, a selected part of the handwritten text content may be reduced at a magnification of one time, that is, not reduced, and an unselected part of the handwritten text content may be reduced at a magnification of 0.5 times, but the present exemplary embodiment is not limited thereto.
The above-described operation is described below in detail with reference to the accompanying drawings.
Referring to
The device 100 may receive an input to select a part of a handwritten text content by a user using the input tool 200. For example, as illustrated in
After the part of a handwritten text content is selected, the device 100 may receive a user input requesting magnification or reduction of the selected part of the handwritten text content. For example, as illustrated in
In response to an input requesting magnification of the selected part of the handwritten text content, for example, an input to draw a circle clockwise, the device 100 may magnify the selected part of the handwritten text content only. For example, as illustrated in
In contrast, in response to an input requesting reduction of the selected part of the handwritten text content, for example, an input to draw a circle counterclockwise, the device 100 may reduce the selected part of the handwritten text content only.
Also, in response to an input requesting magnification of the selected part of the handwritten text content, for example, an input to draw a circle clockwise, the device 100 may magnify the selected part of the handwritten text content and reduce an unselected part (e.g., 350 of
Also, when the user inputs a magnification by using the input tool 200, the device 100 may magnify the selected part of the handwritten text content at an input magnification and reduce the unselected part of the handwritten text content based on the magnification of the selected part of the handwritten text content. For example, when the selected part of the handwritten text content is magnified two times, the unselected part of the handwritten text content may be reduced 0.5 times. When the selected part of the handwritten text content is magnified three times, the unselected part of the handwritten text content may be reduced ⅓ times. However, the present exemplary embodiment is not limited thereto.
The device 100 may display a highlighted part of the handwritten text content by magnifying the same two times and a non-highlighted part of the handwritten text content by reducing the same ½ times. Accordingly, the user may recognize at first sight main parts of the handwritten text content, for example, highlighted parts of the handwritten text content.
In contrast, in response to an input requesting reduction of the selected part of the handwritten text content, for example, an input to draw a circle counterclockwise, the device 100 may reduce the selected part of the handwritten text content and the unselected part of the handwritten text content at different magnifications, as illustrated in
Alternatively, when an input requesting reduction of the selected part of the handwritten text content is received, the device 100 may reduce the selected part of the handwritten text content and magnify the unselected part of the handwritten text content. Because the method of reducing the selected part of the handwritten text content and magnifying the unselected part of the handwritten text content is similar to the method of magnifying the selected part of the handwritten text content and reducing the unselected part of the handwritten text content described with reference to
Alternatively or additionally, the device 100 may display the selected part of the handwritten text content in three dimensions (3D) and the unselected part of the handwritten text content in two dimensions (2D).
Although
For example, the user may highlight a part of the handwritten text content to select, by drawing a circle clockwise (an input requesting magnification) or drawing a circle counterclockwise (an input requesting reduction), on the display 121 by using the input tool 200, and then dragging an area where the part of the handwritten text content to be magnified or reduced. Accordingly, the device 100 may magnify or reduce the highlighted part at a preset magnification. Alternatively, before a part of the handwritten text content is selected, the device 100 may receive an input of a magnification and magnify or reduce the selected part of the handwritten text content at the received magnification.
As illustrated in
Alternatively or additionally, as illustrated in
Also, the device 100 may apply a different magnification or reduction power to the selected part of the handwritten text content according to a number of the marks 420. For example, when one star mark is input to a first line and two star marks are input to a second line, the device 100 may magnify a part of the handwritten text content indicated on the first line two times and a part of the handwritten text content indicated on the second line three times. However, the present exemplary embodiment is not limited thereto.
Alternatively or additionally, as illustrated in
Also, the device 100 may apply a different magnification or reduction power to the selected part of the handwritten text content according to a thickness value of an underline, a color value of an underline, and a style value of an underline. For example, when a first part of the handwritten text content is underlined with a first color value and a second part of the handwritten text content is underlined with a second color value, the first part of the handwritten text content may be magnified two times and the second part of the handwritten text content may be magnified three times. However, the present exemplary embodiment is not limited thereto.
Alternatively or additionally, when a first part of the handwritten text content is underlined with a first underline of a first thickness and a second part of the handwritten text content is underlined with a second underline of a second thickness, the first part of the handwritten text content may be magnified two times and the second part of the handwritten text content may be magnified three times. However, the present exemplary embodiment is not limited thereto.
For example, as illustrated in
In contrast, as illustrated in
Also, the device 100 may apply different magnifications to magnification or reduction of the selected part of the handwritten text content, according to a distance moved by the two fingers. For example, when a pinch-out input to move two fingers a first distance in directions away from each other is performed, the device 100 may magnify the selected part of the handwritten text content two times. When a pinch-out input to move two fingers a second distance that is longer than the first distance in directions away from each other is performed, the device 100 may magnify the selected part of the handwritten text content three times. However, the present exemplary embodiment is not limited thereto.
The device 100 receives an input to select a part of a handwritten text content displayed on the display 121. Because this process is described in detail with reference to
Also, the device 100 receives an input of “folding.” The term “folding” signifies that an unselected part of the handwritten text content is folded not to be displayed on the display 121 and only a selected part of the handwritten text content is displayed on the display 121.
For example, the input of “folding” may be an input to select an icon, for example, a folding icon, or an input to draw a circle clockwise or counterclockwise by using the input tool 200 on the display 121, as described above with reference to
When a folding input is received, the device 100 may display only the selected part of the handwritten text content and may not display the unselected part of the handwritten text content. In this state, the device 100, as illustrated in
When the user selects the “unfolding” icon 610, as illustrated in
Also, when the user selects the “folding” icon 620 again, as illustrated in
Referring to
The typed text content may be generated by the device 100 according to a user's text input, or may be generated by and received from an external device.
Also, the device 100 may display the typed text content on an execution window of an application. For example, the application may include a memo application, a diary application, a calendar application, an e-book application, a household account book, etc., but the present exemplary embodiment is not limited thereto.
In operation S720, the device 100 receives an input to select a part of the displayed typed text content.
For example, a user may highlight or underline a part of the typed text content displayed on the device 100 by using the input tool 200. The device 100 may determine the highlighted or underlined part of the typed text content, to be selected.
Also, the user may draw a closed curve such as a circle or a polygon by using the input tool 200 over the typed text content. The device 100 may determine a part of the typed text content that is included in the closed curve to be selected.
Also, the user may select a text by using a keyword search. When the user conducts a search by inputting a keyword, a word corresponding to the keyword may be selected, or a sentence or paragraph including the keyword may be selected.
In operation S730, the device 100 receives a user input to modify the typed text content.
For example, the device 100 may receive a user input requesting magnification or reduction of the typed text content, for example, an input to draw a pattern, a button input, a user motion input, a device motion input, a voice input, etc., but the present exemplary embodiment is not limited thereto.
In operation S740, the device 100 displays the selected part of the typed text content and an unselected part of the typed text content on the display 121 by magnifying or reducing the same at different magnification powers.
The above-described operation is described below in detail with reference to the accompanying drawings.
Referring to
As illustrated in
Alternatively or additionally, the device 100 may select a part of the typed text content based on a search keyword input. For example, as illustrated in
Also, the device 100 may select a part of the typed text content based on a closed curve input. For example, as illustrated in
Alternatively or additionally, the user may underline or highlight a part of the typed text content by using the input tool 200. The device 100 may select an underlined part of the typed text content or a highlighted part of the typed text content. Also, the device 100 may select a sentence or paragraph including the underlined or highlighted part of the typed text content. However, the present exemplary embodiment is not limited thereto.
After a part of a typed text content is selected as illustrated in
Alternatively or additionally, when a pinch-out input 920 that the user move two fingers in a state of touching the display 121 in directions away from each other is performed, as illustrated in
Alternatively or additionally, as illustrated in
The device 100 may receive a user motion input or a device motion input. For example, when the device 100 recognizes though a camera a user's motion of opening a hand or moving a hand away from the device 100, the device 100 may determine the motion to be an input requesting magnification of the selected part of the typed text content.
Also, when an input that the device 100 moves toward the user is received by using an acceleration sensor or a gyro sensor, the device 100 may determine the input to be an input requesting magnification of the selected part of the typed text content.
Alternatively or additionally, although
For example, when the device 100 receives a user input to draw a circle counterclockwise by using the input tool 200, a pinch-in input that the user moves two fingers in a state of touching the display 121 in directions toward each other, a reduction button input, a motion input that the user closes a hand, a motion input that a user's hand moves away from the device 100, or a motion input that the device 100 moves away from the user, the device 100 may determine each input to be an input requesting reduction of a selected part of the typed text content. However, the present exemplary embodiment is not limited thereto.
Referring to
Accordingly, as illustrated in
Alternatively or additionally, the device 100 may display the selected part of the typed text content in 3D and the unselected part of the typed text content in 2D.
The device 100 may receive an input to select a part of the typed text content displayed on the display 121. Because the above operation is described in detail with reference to
Also, the device 100 may receive a “folding” input. For example, the “folding” input may be an input to select an icon, for example, a folding icon, or an input to draw a circle clockwise or counterclockwise by using the input tool 200 on the display 121, as described with reference to
When a “folding” input is received, the device 100 may display only the selected part of the typed text content and may not display an unselected part of the typed text content. In this state, the device 100 displays a selected part 1120 of the typed text content by magnifying the same at a preset magnification or an input magnification, as illustrated in
When the user selects the “unfolding” icon 1110, as illustrated in
Also, when the user selects the “folding” icon 1130 again, as illustrated in
Referring to
The image content may be captured by the device 100, may be generated based on a user input, or may be generated by and received from an external device.
Also, the device 100 may display the image content on an execution window of a application. For example, the application may include a gallery application, an image edition application, etc., but the present exemplary embodiment is not limited thereto.
In operation S1220, the device 100 receives an input to select a part of the displayed image content.
For example, the user may draw a closed curve such as a circle or a polygon by using the input tool 200 over the image content displayed on the device 100. The device 100 may determine a part of the image content that is included in the closed curve, to be selected.
In operation S1230, the device 100 receives a user input to modify the image content.
For example, the device 100 may receive a user input requesting magnification or reduction of the image content, for example, an input to draw a pattern, a button input, a user motion input, a device motion input, a voice input, etc., but the present exemplary embodiment is not limited thereto.
In operation S1240, the device 100 displays the selected part of the image content and an unselected part of the image content by magnifying or reducing the same at different magnification powers.
The above-described operation is described below in detail with reference to the accompanying drawings.
Referring to
Also, the device 100 may receive a user input to select an area of an image content. For example, a user may select an area by selecting or setting a shape of the area to be used to select and touching and dragging the image content. As illustrated in
However, the shape of the area and the user input to select the area are not limited thereto. The shape of the area may include a circle, an ellipse, a free curved shape, etc., and the user input may include a key input, a touch input, for example, tapping, double tapping, flicking, swiping, etc., a voice input, a motion input, etc.
The device 100, as described with reference to
For example, as illustrated in
However, the present exemplary embodiment is not limited. When the device 100 receives an input to draw a pattern, for example, an input to draw a circle clockwise, on the display 121 by using the input tool 200, a magnification GUI input displayed on the display 121, or a PUI button included in the device 100, the device 100 may determine each input to be an input requesting magnification of a selected part of the image content.
Also, when the device 100 recognizes through a camera a motion of the user opening a hand or a motion of a user's hand moving away from the device 100, the device 100 may determine the motion to be an input requesting magnification of a selected part of the image content.
Also, when the device 100 receives an input that the device 100 moves toward the user by using an acceleration sensor or a gyro sensor, the device 100 may determine the input to be an input requesting magnification of a selected part of the image content.
Alternatively or additionally, although
Referring to
For example, when the selected part 1410 of the image content is magnified two times, the device 100 may reduce the unselected part 1430 of the image content 0.5 times. When the selected part 1410 of the image content is magnified three times, the device 100 may reduce the unselected part 1430 of the image content ⅓ times. However, the present exemplary embodiment is not limited thereto, and a part of the image content may be magnified or reduced based on various magnifications.
Alternatively, the device 100 may display the selected part of the image content in 3D and the unselected part of the image content in 2D.
Referring to
The device 100 may receive a user input to select an object included in any one of the image contents. The object may include a person, a building, a character, etc.
For example, as illustrated in
When the first person is selected, as illustrated in
However, the present exemplary embodiment is not limited thereto. When the selected object is a building, the device 100 may extract at least one of image contents including the building by using, for example, pattern recognition. Also, when the selected object is a character, the device 100 may extract at least one of image contents including the character by performing, for example, a character recognition technology using optical character recognition (OCR).
Also, the device 100 displays the extracted image content 1610 on the display 121, magnifies an image 1650 of an object, for example, the first person, included in the extracted image content 1610, and reduces another part of the image content 1610 except for the object. In this connection, the device 100 may reduce the other part of the image content 1610 except for the object based on a magnification used for magnifying the image 1650 of the object.
For example, when the image 1650 of the object is magnified two times, the device 100 may reduce the other part of the image content 1610 except for the object 0.5 times. When the image 1650 of the object is magnified three times, the device 100 may reduce the other part of the image content 1610 except for the object ⅓ times. However, the present exemplary embodiment is not limited thereto. The image content 1610 may be magnified or reduced based at various magnifications.
Also, the device 100 displays the extracted image content 1610 on the display 121, and may display the image of the object in 3D by giving a 3D effect to the image of the object, for example, the first person, included in the extracted image content 1610.
Referring to
The video content may be a video content captured by the device 100 or a video content generated by or received from an external device. Also, the device 100 may display the video content on an execution window of an application.
The reproduction screen of a video content may include a timeline indicating a reproduction time point of the video content.
In operation S1720, the device 100 receives a user input to select a partial reproduction section of an entire reproduction section of the video content.
For example, the device 100 may receive a user input to select the partial reproduction section on the timeline displayed on the reproduction screen.
Referring to operation S1730, the device 100 receives a user input to change a reproduction speed of a video content.
For example, the device 100 may receive a user input requesting control of the reproduction speed of the video content to be slower or faster than an existing reproduction speed. The user input requesting control of the reproduction speed of the video content to be slower or faster than the existing reproduction speed may include a pinch-out input to move two fingers touching the display 121 in directions away from each other, a pinch-in input to move two fingers touching display 121 in directions toward each other, an input to draw a pattern, a button input, a user motion input, a device motion input, a voice input, etc., but the present exemplary embodiment is not limited thereto.
In operation S1740, the device 100 reproduces a video content of a selected section and a video content of an unselected section at different reproduction speeds.
For example, the device 100 may control the reproduction speed of the selected section of the video content to be faster or slower than the reproduction speed of the unselected section of the video content. However, the present exemplary embodiment is not limited thereto.
Alternatively or additionally, the device 100 may reproduce the selected section of the video content and the unselected section of the video content at different reproduction volumes of sound.
Alternatively or additionally, the device 100 may receive a user input to select a sound included in the video content, and may control a reproduction speed or a reproduction volume with respect to a section including the selected sound.
Alternatively or additionally, the device 100 may control a reproduction speed or a reproduction volume with respect to a section in which a volume of sound included in the video content is equal to or greater than a preset value.
The above-described operation is described below in detail with reference to the accompanying drawings.
Referring to
For example, as illustrated in
Additionally, the user selects a partial section of the video content by using the timeline 1810 of the video content, as illustrated in
For example, the user selects the partial section by moving and setting a first icon 1830 indicating a start point of the partial section and a second icon 1840 indicating an end point of the partial section, which are marked on the timeline 1810.
In this state, when the first icon 1830 is located at a first position on the timeline 1810 indicating a first time point, for example, 35 secs (00:00:35) and the second icon 1840 is located at a second position on the timeline 1810 indicating a second time point, for example, 1 min and 48 secs (00:01:48), the device 100 determines a section between the first position and the second position to be the selected partial section.
When the partial section is selected, the device 100 may reproduce the selected partial section of the video content and an unselected section of the video content at different reproduction speeds.
For example, as illustrated in
Alternatively, the device 100 may control a reproduction speed of the selected partial section of the video content to be faster or slower according to a preset ratio, and a reproduction speed of the unselected section of the video content to be the same as the existing reproduction speed.
Alternatively, the device 100 may control a reproduction speed of the video content included in the selected partial section to be fast at a preset ratio (a first ratio), and a reproduction speed of the unselected section of the video content to be slow at a preset ratio (a second ratio). In this state, the device 100 may set the second ratio based on the first ratio. For example, when the first ratio is two times, the second ratio may be 0.5 times, and when the first ratio is three times, the second ratio may be ⅓ times.
In contrast, the device 100 may control a reproduction speed of the video content included in the selected partial section to be slow at a preset ratio, and a reproduction speed of the unselected section of the video content to be fast at a preset ratio.
Alternatively, the device 100 may control a reproduction volume of the video content included in the selected partial section video content to be higher or lower than a reproduction volume of the unselected section of the video content.
Referring to
For example, as illustrated in
As illustrated in
Also, when the user inputs through the setting window 1910 a speed to be “slow” and a ratio to be “0.5” times, the device 100 may control the reproduction speed of a video content corresponding to a period of 73 secs of the selected partial section, for example, from 35 secs to 1 min and 48 secs, to be slow at the ratio of 0.5 times of an existing reproduction speed.
Referring to
The device 100 may receive a user input to select an object included in any one of a plurality of frames and the object may include a person, a building, a character, etc.
For example, as illustrated in
When the first person is selected, the device 100 may extract at least one frame including the first person from the frames forming a video content by using, for example, face recognition.
When the frames are reproduced, the device 100 may reproduce an extracted frame and an unextracted frame at different reproduction speeds.
For example, as illustrated in
Referring to
Alternatively, as illustrated in
The device 100 may set the reproduction speed of a selected partial section to be faster than an existing reproduction speed. Also, the reproduction speed of an unselected section may be equal to or slower than the existing reproduction speed. In this state, an increase ratio of the reproduction speed of the selected partial section may be determined according to a movement distance between the first icon 2210 and the second icon 2220. The above-described process is described below in detail with reference to
The device 100 may differently set the reproduction speed of a partial section selected according to a movement distance between a first icon 2310 and a second icon 2320.
Referring to
When a distance between the third position P3 and the fourth position P4 is ⅓ of the distance between the first position P1 and the second position P2, as illustrated in
Alternatively or additionally, when a distance between the third position P3 and the fourth position P4 is ½ of the distance between the first position P1 and the second position P2, as illustrated in
Referring to
Alternatively, as illustrated in
The device 100 may set the reproduction speed of a selected partial section to be slower than an existing reproduction speed. Also, the reproduction speed of an unselected section may be equal to or faster than the existing reproduction speed. In this state, a decrease ratio of the reproduction speed of the selected partial section may be determined according to a movement distance between the first icon 2410 and the second icon 2420. The above-described process is described below in detail with reference to
The device 100 may differently set the reproduction speed of a partial section selected according to a movement distance between a first icon 2510 and a second icon 2520.
Referring to
When a distance between the third position P3 and the fourth position P4 is two times longer than the distance between the first position P1 and the second position P2, as illustrated in
Alternatively or additionally, when a distance between the third position P3 and the fourth position P4 is three times longer than the distance between the first position P1 and the second position P2, as illustrated in
Referring to
The audio content may be a voice file, a music file, etc., which is recorded by the device 100, or may be generated by and received from an external device. Also, the device 100 may display the audio content on an execution window of an application.
The reproduction screen of an audio content may include a timeline indicating a reproduction time point of the audio content.
In operation S2620, the device 100 receives a user input to select a partial reproduction section of an entire reproduction section of the audio content.
For example, the device 100 may receive a user input to select the partial reproduction section on the timeline displayed on the reproduction screen.
In operation S2630, the device 100 receives a user input to change a reproduction speed of the audio content.
For example, the device 100 may receive a user input requesting control of the reproduction speed of the audio content to be slower or faster than an existing reproduction speed. The user input requesting control of the reproduction speed of the audio content to be slower or faster than the existing reproduction speed may include a pinch-out input to move two fingers touching the display 121 in directions away from each other or in directions toward each other, an input to draw a pattern, a button input, a user motion input, a device motion input, a voice input, etc., but the present exemplary embodiment is not limited thereto.
In operation S2640, the device 100 reproduces an audio content of a selected section and an audio content of an unselected section at different reproduction speeds.
For example, the device 100 may control the reproduction speed of the audio content of the selected section to be faster or slower than the reproduction speed of the audio content of the unselected section. However, the present exemplary embodiment is not limited thereto.
Alternatively or additionally, the device 100 may reproduce the audio content of the selected section and the audio content of the unselected section at different reproduction volumes of sound.
Alternatively or additionally, the device 100 may receive a user input to select a sound included in the audio content, and may control a reproduction speed or a reproduction volume with respect to a section including the selected sound.
Alternatively or additionally, the device 100 may control a reproduction speed or a reproduction volume with respect to a section in which a volume of sound included in the audio content is equal to or greater than a preset value.
The above-described operation is described below in detail with reference to the accompanying drawings.
Referring to
Alternatively or additionally, as illustrated in
For example, the user may select a partial section by moving on the timeline 2720 a first icon 2731 indicating a start point of the partial section and a second icon 2732 indicating an end point of the partial section, which are marked on the timeline 2720.
When the first icon 2731 is located at a first position on the timeline 2720 indicating a first time point and the second icon 2732 is located at a second position on the timeline 2720 indicating a second time point, the device 100 may determine a section between the first time point and the second time point to be a partial section.
When the partial section is selected, the device 100 may reproduce an audio content corresponding to a selected partial section and an audio content corresponding to an unselected partial section at different reproduction speeds. The above-described operation is described below in detail with reference to
Referring to
The device 100 may set the reproduction speed of a selected partial section to be faster than an existing reproduction speed. In this state, an increase ratio of the reproduction speed of the selected partial section may be determined to be a preset ratio or according to a movement distance between the first icon 2831 and the second icon 2832. Because the above-described process is described below in detail with reference to
Also, the device 100 may set the reproduction speed of the unselected section to be the same as the existing reproduction speed or slower than the existing reproduction speed.
Alternatively or additionally, referring to
The device 100 may set the reproduction speed of the selected section to be slower than the existing reproduction speed. In this state, a decrease ratio of the reproduction speed of the selected section may be determined to be a preset ratio or according to a movement distance between the first icon 2931 and the second icon 2932. Because the above-described process is described below in detail with reference to
Also, the device 100 may set the reproduction speed of the unselected section to be the same as the existing reproduction speed or faster than the existing reproduction speed.
Referring to
The reproduction screen of the audio content may include information about the audio content, a timeline indicating a reproduction time point of the audio content, a reproduction button to reproduce the audio content, a stop button to stop reproduction of the audio content, a previous song button to move to a previous audio content in a reproduction list, a next song button to move to a next audio content, etc.
Also, the device 100 may display a voice list 3010 based on information about voice included in the audio content. For example, when the audio content is a song file sung by signers A, B, and C together, the audio content may include the voice of A, the voice of B, and the voice of C. The device 100, as illustrated in
The user may select any one voice in the voice list 3010 and set a reproduction speed for an audio section including a selected voice by using a reproduction speed setting menu 3020. For example, as illustrated in
Alternatively or additionally, as illustrated in
Also, the device 100 may select a partial reproduction section of a section of the audio content through voice recognition. For example, when the audio content includes the voice of A, the voice of B, and the voice of C, as illustrated in
Alternatively, when a time point of the audio section is selected, the device 100 may extract an audio section including the same voice as the voice, for example, the voice of C, reproduced at a selected time point, based on the information about an audio section including the metal data of the audio content.
Referring to
The list signifies a set of items having the same attributes. For example, the list may be an array of data items satisfying conditions in sequence. The list may include a telephone number list, a message list, a recommended book list, a schedule list, a financial management list, a photo list, a music file list, a moving picture list, etc. However, the present exemplary embodiment is not limited thereto.
Also, the list may be generated by the device 100 or may be generated by or received from an external device.
Also, the device 100 may display a list on an application execution window. For example, the application may include a phonebook application, a message application, an album application, a household account book application, etc. However, the present exemplary embodiment is not limited thereto.
In operation S3210, the device 100 receives a user input to select at least one item included in the list.
In operation S3130, the device 100 receives a user input to modify the list.
For example, the device 100 may receive a user input requesting magnification or reduction of the list. The input requesting magnification or reduction of the list may include an input to draw a pattern, a button input, a user motion input, a device motion input, a voice input, etc., but the present exemplary embodiment is not limited thereto.
In operation S3140, the device 100 displays the selected item and an unselected item on the display 121 by magnifying or reducing the same at different magnifications.
The above-described operation is described below in detail with reference to the accompanying drawings.
Referring to
Also, an item included in the financial expense list may include a date of expense, a place of use of expense, a reason for expense, cash or card, an amount of expense, etc.
As illustrated in
When the device 100 receives an input to select an item, the device 100 may display a check mark on the rectangular icon 3210 of the item or may display the item by highlighting the same.
After the item is selected, the device 100 may receive a user input requesting magnification or reduction of the selected item. For example, as illustrated in
In addition, when a user input to draw a circle clockwise on the display 121, a pinch-out input that the user moves two fingers in a state on touching the display 121 in directions away from each other, or an input of a button, for example, a physical user interface (PUI) button, included in the device 100 is received, the device 100 may determine each input to be an input requesting magnification of the selected item.
Alternatively or additionally, the device 100 may receive a user motion input or a device motion input. For example, when the device 100 recognizes though a camera a user's motion of opening a hand or moving a hand away from the device 100, the device 100 may determine each input to be an input requesting magnification of the selected item.
Also, an input requesting reduction of a selected content may be performed in a similar method. For example, when a user input to draw a circle counterclockwise by using the input tool 200, a pinch-in input that the user moves two fingers in a state of touching the display 121 in directions toward each other, a reduction button input, a motion input that the user closes a hand, a motion input that a user's hand moves toward the device 100, or a motion input that the device 100 moves toward the user is received, the device 100 may determine each input to be an input requesting reduction of a selected part. However, the present exemplary embodiment is not limited thereto.
Referring to
Accordingly, as illustrated in
Alternatively or additionally, the device 100 may display the selected item in 3D and the unselected item in 2D.
Referring to
The device 100 may select an item based on a search keyword input. For example, as illustrated in
When a keyword is input and a search request input is received, the device 100 may search for the keyword and select an item including the keyword. Also, the device 100 may display the found keyword by highlighting the same.
For example, as illustrated in
Accordingly, the user may search for or select items of expenses spent on a date by inputting a date of expenses, items of expenses spent at a place by inputting a place of expenses, or items of expenses by inputting a keyword related to the expenses, through the keyword search.
The device 100 may receive an input of “folding” on a selected item among the list displayed on the display 121. For example, the input of “folding” may be an input to select an icon, for example, a folding icon, or an input to draw a circle clockwise or counterclockwise on the display 121 by using the input tool 200. Alternatively or additionally, the input of “folding” may be a pinch-in/out input that the user moves two fingers in a state of touching the display 121 in directions toward or away from each other. However, the present exemplary embodiment is not limited thereto.
When the input of “folding” is received, the device 100 may display only the selected items and may not display unselected items. In this state, the device 100 may display the selected items by magnifying the same at a preset magnification or an input magnification, as illustrated in
When the user selects the “unfolding” icon 3510, as illustrated in
Also, when the user selects the “folding” icon 3530 again, as illustrated in
The device 100 may make scroll speeds of the selected item and the unselected item display displayed on the list to be different from each other. For example, when an input that the user touches and drags a scroll bar 3610 is received, the device 100 may display the list by scrolling the same in a dragging direction. While the list is scrolled and the selected item is included in an area 3620 of a screen, the device 100 make a scroll speed to be different from an existing scroll speed. The existing scroll speed signifies a scroll speed when the scroll bar 3610 is touched and dragged without selecting an item from the list. Also, the area 3620 of a screen is not limited to the area illustrated in
For example, when a selected item is included in the area 3620 of the screen, the scroll speed may be set to be slower than the existing scroll speed. Also, when the unselected item is included in the area 3620 of the screen, the scroll speed may be set to be faster than the existing scroll speed. However, the present exemplary embodiment is not limited thereto.
As illustrated in
For example, as illustrated in
These elements are described below in detail.
The display 121 displays and outputs information processed by the device 100. For example, the display 121 may display a handwritten text content, a typed text content, an image content, a list, a reproduction screen of a video content, a reproduction screen of an audio content, etc.
Alternatively, when the display 121 and a touch pad constituting a layer structure form a touch screen, the display 121 may be used as an input device in addition to an output device. The display 121 may include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display. Also, the device 100 may include two or more of the displays 121 according to an implement type of the device 100.
The user interface 140 signifies a device used by the user to input data to control the device 100. For example, the user interface 140 may include a key pad, a dome switch, a touch pad including a capacitive overlay type, a resistive overlay type, an infrared beam type, a surface acoustic wave type, an integral strain gauge type, and a piezoelectric type, a jog wheel, a jog switch, etc., but the present exemplary embodiment is not limited thereto.
The user interface 140 may receive a user input to select a part of a handwritten text content displayed on the display 121, a user input to select a part of a typed text content displayed on the display 121, a user input to select a part of an image content displayed on the display 121, a user input to select a part of an entire section of a video content, a user input to select a part of an entire section of an audio content, and a user input to select at least one of items in a list displayed on the display 121.
Also, the user interface 140 may receive a user input to magnify or reduce a content, a user input to change a reproduction speed of a video content or an audio content, etc. In this state, the user input may include a touch input, an input to draw a pattern, a button input, a user motion input, a device motion input, a voice input, etc., but the present exemplary embodiment is not limited thereto.
The controller 130, which is, for example, a processor, may control an overall operation of the device 100. For example, the controller 130 may control the communication interface 110, the output interface 120, the user interface 140, the sensor 150, the A/V interface 160, etc., by executing programs stored in the memory 170.
The controller 130 may display a selected handwritten text content and an unselected handwritten text content on the display 121 by magnifying or reducing the same at different magnifications.
The controller 130 may use the different magnification for magnifying or reducing the selected handwritten text content according to a thickness value, a color value, and a style value of an underline.
When a pinch-in/out input that the user moves two fingers in a state of touching the display 121 in directions toward or away from each other is received, the controller 130 may use the different magnification for magnifying or reducing a selected handwritten text content according to a distance moved by the two fingers.
The controller 130 may display a selected typed text content and an unselected typed text content on the display 121 by magnifying or reducing the same at different magnifications.
The controller 130 may display a selected image content and an unselected image content on the display 121 by magnifying or reducing the same at different magnifications.
The controller 130 may reproduce a selected section of a video content and an unselected section of the video content at different reproduction speeds.
The controller 130 may reproduce a selected section of an audio content and an unselected section of the audio content at different reproduction speeds.
When a pinch-in/out input to move two fingers in a state of touching the display 121 in directions toward or away from each other is received, the controller 130 may change an increase or decrease ratio of the reproduction speed of the selected section of the video content according to a distance moved by the two fingers.
When a pinch-in/out input to move two fingers in a state of touching the display 121 in directions toward or away from each other is received, the controller 130 may change an increase or decrease ratio of the reproduction speed of the selected section of the audio content according to a distance moved by the two fingers.
The controller 130 may display a selected item and an unselected item in a list on the display 121 by magnifying or reducing the same at different magnifications.
The communication interface 110 may include one or more constituent elements that enables communications between the device 100 and an external device. For example, the communication interface 110 includes a short-range wireless communication interface 111, a mobile communication interface 112, and a broadcast receiver 113.
The short-range wireless communication interface 111 may include a Bluetooth communication interface, a Bluetooth low energy (BLE) communication interface, a near field communication (NFC) unit, a WLAN (Wi-Fi) communication interface, a Zigbee communication interface, an infrared data association (IrDA) communication interface, a Wi-Fi Direct (WFD) communication interface, an ultra wideband (UWB) communication interface, an Ant+ communication interface, etc., but the present exemplary embodiment is not limited thereto.
The mobile communication interface 112 may transceive wireless signals with respect to at least one of a base station, an external terminal, and a server 300 through a mobile communication network. A wireless signal may include a voice call signal, a video call signal, or various types of data according to transceiving of text/multimedia messages.
The broadcast receiver 113 receives a broadcast signal and/or information related to broadcast from the outside through broadcast channels. A broadcast channel may include a satellite channel and a ground wave channel. In some embodiments, the device 100 may not include the broadcast receiver 113.
The communication interface 110 may transmit multimedia information stored in the memory 170 to the server 300. For example, the multimedia information may include images, text, graphics, sound, video, animation, etc., but the present exemplary embodiment is not limited thereto.
The output interface 120 outputs an audio signal, a video signal, or a vibration signal, and includes the display 121, a sound output interface 122, and a vibration motor 123.
The sound output interface 122 outputs audio data received from the communication interface 110 or stored in the memory 170. Also, the sound output interface 122 outputs a sound signal related to a function performed by first the device 100, for example, a call signal receipt sound, a message receipt sound, or an alarm sound. The sound output interface 122 may include a speaker, a buzzer, etc.
The vibration motor 123 may output a vibration signal. For example, the vibration motor 123 may output a vibration signal corresponding to an output of audio data or video data, for example, a call signal receipt sound or a message receipt sound. Also, when a touch is input to a touch signal, the vibration motor 123 may output a vibration signal.
The sensor 150 may sense a state of the device 100 or a state of the periphery of the device 100 and transfer sensed information to the controller 130.
The sensor 150 may include at least one of a geo-magnetic sensor 151, an acceleration sensor 152, a temperature/humidity sensor 153, an infrared sensor 154, a gyroscope sensor 155, a position sensor 156, for example, a global positioning system (GPS), an atmosphere sensor 157, a proximity sensor 158, and an RGB sensor 159, for example, an illuminance sensor, but the present exemplary embodiment is not limited thereto. Because the function of each sensor may be intuitively guessed by one of ordinary skill in the art from its name, a detailed description thereof is omitted.
The sensor 150 may sense a position of the device 100 by using a position sensor.
The A/V interface 160 is for inputting an audio signal or a video signal, and includes a camera 161 and a microphone 162. The camera 161 may acquire an image frame such as a still image or an execution through an image sensor in a video call mode or a photography mode. An image captured through the image sensor may be processed by the controller 130 or a separate image processor.
An image frame processed by the camera 161 may be stored in the memory 170 or transmitted to the outside through the communication interface 150. Two or more of the camera 161 may be provided.
The microphone 162 receives an external sound signal and processes the received signal into electric voice data. For example, the microphone 162 may receive a sound signal from an external device or a speaker. The microphone 162 may use various noise removal algorithms to remove noise generated in a process of receiving an input of an external sound signal.
The memory 170 may store a program of processing and controlling the controller 130 and data that is input and output.
The memory 170 may include at least one type of storage media, for example, memory of a flash memory type, a hard disk type, a multimedia card micro type, a card type, for example, SD or XD memory, etc., random access memory (RAM) static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disc, and an optical disc. Also, the device 100 may run a web storage or a cloud server that performs a storage function of the memory 170 on the Internet.
The programs stored in the memory 170 may be classified into a plurality of modules according to their functions, for example, a UI module 171, a touch screen module 172, a notification module 173, etc.
The UI module 171 may provide a UI or GUI engaged with the device 100 for each application. The touch screen module 172 may sense a user's touch gesture on a touch screen and transfer information about the touch gesture to the controller 130. The touch screen module 172 may recognize and analyze a touch code. The touch screen module 172 may be configured by separate hardware including a controller.
Various sensors may be provided inside or around the touch screen to sense a touch or proximity touch of the touch screen. An example of a sensor to sense a touch on a touch screen may be a tactile sensor. A tactile sensor signifies a sensor that detects a contact of an object to a degree or more that a human senses. The tactile sensor may detect various pieces of information such as a roughness of a contact surface, a rigidness of a contact object, a temperature of a contact position, etc.
Also, an example of a sensor for sensing a touch on a touch screen is a proximity sensor.
A proximity sensor signifies a sensor that detects an object approaching a predetermined detection surface or existence of an object existing in the vicinity by using a force of an electromagnetic field or using an infrared ray without mechanical contacts. The proximity sensor may include, for example, a transmissive photoelectric sensor, a direct reflective photoelectric sensor, a mirror reflective photoelectric sensor, a high frequency oscillating proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, an infrared proximity sensor, etc. The touch gesture of a user may include tapping, touching and holding, double tapping, dragging, panning, flicking, dragging and dropping, swiping, etc.
The notification module 173 may generate a signal to notify occurrence of an event in the device 100. The event occurring in the device 100 may include, for example, call signal receiving, message receiving, key signal input, schedule notification, etc. The notification module 173 may output a notification signal in form of a video signal through the display 121, an audio signal through the sound output interface 122, or a vibration signal through the vibration motor 123.
In addition, the exemplary embodiments may also be implemented through computer-readable code and/or instructions on a medium, e.g., a non-transitory computer-readable medium, to control at least one processing element to implement any above-described embodiments. The medium may correspond to any medium or media which may serve as a storage and/or perform transmission of the computer-readable code.
The computer-readable code may be recorded and/or transferred on a medium in a variety of ways, and examples of the medium include recording media, such as magnetic storage media (e.g., ROM, floppy disks, hard disks, etc.) and optical recording media (e.g., compact disc read only memories (CD-ROMs) or digital versatile discs (DVDs)), and transmission media such as Internet transmission media. Thus, the medium may have a structure suitable for storing or carrying a signal or information, such as a device carrying a bitstream according to one or more exemplary embodiments. The medium may also be on a distributed network, so that the computer-readable code is stored and/or transferred on the medium and executed in a distributed fashion. Furthermore, the processing element may include a processor or a computer processor, and the processing element may be distributed and/or included in a single device.
The foregoing exemplary embodiments and advantages are merely exemplary and are not to be construed as limiting. The present teaching can be readily applied to other types of apparatuses. Also, the description of the exemplary embodiments is intended to be illustrative, and not to limit the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2014-0098480 | Jul 2014 | KR | national |
| 10-2014-0173240 | Dec 2014 | KR | national |
| 10-2015-0075369 | May 2015 | KR | national |
This application is a divisional of U.S. application Ser. No. 14/815,312 filed Jul. 31, 2015, which claims priority from Korean Patent Application No. 10-2014-0098480, filed on Jul. 31, 2014, Korean Patent Application No. 10-2014-0173240, filed on Dec. 4, 2014, and Korean Patent Application No. 10-2015-0075369, filed on May 28, 2015, in the Korean Intellectual Property Office, the disclosures of which are incorporated herein by reference in their entireties.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14815312 | Jul 2015 | US |
| Child | 15664434 | US |
