Patent Grant
11042582
The present application is based upon and claims the benefit of a priority of Chinese patent application No. 201710121020.8, filed on Mar. 2, 2017, the entirety of which is incorporated herein by reference.
The present disclosure relates to the technical field of multimedia, in particular, relates to a method and a device for categorizing multimedia resources.
Video websites usually categorizes videos, to display under a category the information of videos belonging to that category. For example, when a user clicks on the category of comedy movies, information of various videos under the category of comedy movies will be displayed in the associated interface, wherein, the information of the videos may include the titles, the labels and/or the posters of the videos and the likes. For example, the videos may usually be categorized according to the titles and/or the labels thereof, with relatively little information being taken into consideration, resulting in a relatively low accuracy of the video categorization.
In one aspect, in general, the present disclosure describes a method and a device for categorizing multimedia resources, so as to improve the accuracy of the categorization of multimedia resources.
In another aspect, in general, the present disclosure describes a method for categorizing a multimedia resource, comprising: counting numbers of icons for respective types of icons input by a user for the multimedia resource; and determining a category to which the multimedia resource belongs according to the numbers of the respective types of icons input for the multimedia resource.
In another aspect, in general, the present disclosure describes a device for categorizing a multimedia resource, comprising: a first counter configured to count numbers of icons for respective types of icons input by a user for the multimedia resource; and a first determiner configured to determine a category to which the multimedia resource belongs according to the numbers of the respective types of icons input for the multimedia resource.
In another aspect, in general, the present disclosure describes a device for categorizing a multimedia resource, comprising: a processor; a memory storing computer-readable instructions that, when executed by the processor, cause the processor to: count numbers of icons for respective types of icons input by a user for the multimedia resource; and determine a category to which the multimedia resource belongs according to the numbers of the respective types of icons input for the multimedia resource.
In another aspect, in general, the present disclosure describes a non-volatile computer readable storage medium including instructions that causes a terminal and/or server to perform the above method when executed by a processor of the terminal and/or server.
Aspects may have one or more of the following advantages. The categorization of a multimedia resource can be performed based at least in part on information obtained by interactions between a server device categorizing the multimedia resource and client devices, as described in more detail herein. Thus, the technological problem addressed herein is particular to the interactions between such client and server devices, such as those that occur on the Internet. For example, the method and the device for categorizing multimedia resources according to the present disclosure determines the category to which the multimedia resource belongs by counting the numbers of icons for respective types of icons input by a user of a client device for the multimedia resource and according to the numbers of the respective types of icons input for the multimedia resource. Thus, the respective types of icons input by the user for the multimedia resource can be taken into account when categorizing the multimedia resource, thereby improving the accuracy of the categorization of the multimedia resource.
Other features and aspects of the present disclosure will become apparent from the following descriptions on exemplary embodiments with reference to the drawings.
The drawings are incorporated in and constitute part of the specification, illustrate the exemplary embodiments, features and aspects of the present disclosure together with the description, and serve to explain the principles of the present disclosure.
Various exemplary embodiments, features and aspects of the present disclosure will be described in detail with reference to the drawings. The same reference numerals in the drawings represent elements having the same or similar functions. Although various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn in scale, unless otherwise specified.
Herein the term “exemplary” means “being used as an instance or embodiment, or being explanatory”. Any “exemplary” embodiment given here should not be necessarily construed as being superior to or better than other embodiments.
Furthermore, numerous details are given in the following embodiments for a better explanation to the present disclosure. One skilled in the art may understand that the present disclosure can be implemented without some of the details. In some embodiments, methods, means, elements and circuits that are well known to one skilled in the art are not described in detail, so as to highlight the principle of the present disclosure.
The multimedia may be a combination of multiple kinds of media, including multiple media forms of, for example, characters, sounds and images. For example, the multimedia resource may include, but is not necessarily limited to, video. The multimedia may be released from a server device to the client device for presentation. The server device releasing the multimedia may be a same device as or a different device from the above mentioned server device in which the method is applied (i.e. the server device categorizing the multimedia resource).
The server device in which the method is applied is configured to collect input from the one or more client devices associated with presentation of the multimedia on the client devices. The input indicates one or more icons. The respective types of icons input by the user for the multimedia resource may include, but are not necessarily limited to, comment icons or bullet-screen (real-time overlaying commentary subtitle) icons and the likes input by the user for the multimedia resource. The comment icons may be the icons input by the user in a comment area. The bullet-screen icons may be the icons input by the user in a bullet-screen area.
It should be noted that each type of icons may include multiple icons of different graphics but the same emotion; for example, icons representing the emotion of sorrow (i.e., an emotion identified by an emotion label of “sorrow”) can include icons that have names associated with the emotion of sorrow (e.g., the icons having names of tears, cry, sadness and curling lips, etc.), and may be determined as one type. Also, each type of icon may include merely one icon; for example, the icon of sadness may be determined as one type of icon. Determining the emotion of the user from the icons input by the user for the multimedia resource is a relatively direct and accurate manner of matching if the icons themselves have already been associated with a predetermined emotion (e.g., an emotion corresponding to a name characterizing the icon). As a result, the determined emotion label, or categorization of the multimedia resource based on the emotion label, can be performed relatively accurately.
As an example of the present embodiment, the numbers of respective types of icons among all the bullet-screen icons input by all the users for the multimedia resource may be counted. Because the bullet-screen icons can represent the emotion of the user on the multimedia resource immediately and accurately, bullet-screen icons may be preferable for counting the numbers of respective types of icons input by the users for the multimedia resource.
As a further example of the present embodiment, the numbers of respective types of icons among a part (i.e., a subset of fewer than all) of the bullet-screen icons input by individual users for the multimedia resource within a first time period may be counted. The subset of the bullet-screen icons may include all the bullet-screen icons for which the input time is within the first time period. The server device in which the method is applied is further configured to store respective input times for at least some of the bullet-screen icons. The respective input times for the icons may correspond to times at which the icons temporarily overlay at least a portion of a display of the multimedia.
As a further example of the present embodiment, the numbers of respective types of icons among a part (i.e., a subset of fewer than all) of the comment icons and a subset of the bullet-screen icons input by individual users for the multimedia resource within a first time period may be counted. The subset of the comment icons may include all the comment icons for which the input time is within the first time period. The server device in which the method is applied is further configured to store respective input times for at least some of the comment icons.
It should be noted that, the first time period may be a time range with a start time and an end time. The first time period may start no earlier than a time of release of the multimedia resource and ends such that a subset of fewer than all icons input by all of the plurality of client devices have input times within the particular time period. For example, the first time period may be the three or six months before the current system time, and the like, which is not limited herein. The numbers of respective types of icons input by the user for the multimedia resource within the first time period is counted, to make the statistical result be more representative, thereby improving the accuracy of the categorization of the multimedia resource.
Each type of icons may have a correspondence with some category of the multimedia resources. For example, the icons representing the emotion of love may have a correspondence with the category of affection; the icons representing the emotion of surprise may have a correspondence with the category of horror; the icons representing the emotion of face with tears of joy may have a correspondence with the category of comedy; and the icons representing the emotion of pity may have a correspondence with the category of tragedy, and so on.
As an example of the present embodiment, a category to which the multimedia resource belongs may be determined according to the numbers of each type of icons input for the multimedia resource. The determined category can then be associated with that multimedia resource, for example, by including that multimedia resource in a ranking list for the determined category, or other category information.
As a further example of the present embodiment, multiple categories to which the multimedia resource belongs may be determined according to the numbers of each type of icons input for the multimedia resource. The determined categories can then be associated with that multimedia resource, for example, by including that multimedia resource in different respective ranking lists for each of the determined categories, or other category information.
It should be noted that a certain multimedia resource may belong to multiple categories; and in different categories, a ranking of the multimedia resource within each category may vary. For example, if for a certain multimedia resource, the number of the bullet-screen icon of face with tears of joy is 1000, and the number of the bullet-screen icon of surprise is 500, then the multimedia resource may rank at a first ranking position (e.g., within a ranking list) in the category of comedy and at a fourth ranking position in the category of horror.
This embodiment does not limit the manner of display for the multimedia resources. For example, at least one category may be displayed; after the user clicks into the category, information of multiple multimedia resources belonging to the category may be displayed. The user can click on the information to view the details of a multimedia resource, or click a “More” control corresponding to the category to view other categories. The information of the multimedia resources may include the title, labels, posters and the likes thereof.
For a further example, the ranking list of at least one category may be displayed, on a client device, and information for multiple multimedia resources belonging to the category may be displayed, on the client device, in the ranking list. The user may click on the information to view the details of the multimedia resource, or click the “More” control corresponding to the ranking list of the category to view the ranking lists of other categories. The present embodiment does not limit the manner of determining the ranking list. For example, the multimedia resources belonging to the category may be displayed randomly in the ranking list. For a further example, the ranking list may be determined according to the numbers of the icons corresponding to the category and input for respective multimedia resources belonging to the category. A variety of other information characterizing a set of multimedia resources can be sent from the server device to one or more of the client devices, where the information characterizing the multimedia resources is based at least in part on one or more categories that have been determined and associated with the multimedia resources.
Further, the user may, for example, click on the information to view the details of the multimedia resource, and may click on the “More” control corresponding to the multimedia resource to view one or more of the respective types of icons input for the multimedia resource, the numbers of the respective types of icons, and the ranking of the multimedia resource with regard to the respective types of icons. For example, when the “More” control in a video A of the category of comedy is clicked on, respective types of icons input for the video A, such as the bullet-screen icon of face with tears of joy and the bullet-screen icon of surprise, may be displayed; the numbers of the respective types of icons input for the video A may also be displayed, e.g., the number of the bullet-screen icon of face with tears of joy is 1000, and the number of the bullet-screen icon of surprise is 500; the ranking of video A under the respective types of icons may also be displayed, e.g., video A is ranked at the first in the category of comedy corresponding to the bullet-screen icon of face with tears of joy, and at the fourth in the category of horror corresponding to the bullet-screen icon of surprise.
It should be noted that, one skilled in the art should understand that the examples described herein are some possible embodiments of the methods for categorizing multimedia resources to determine the category to which the multimedia resource belongs according to the numbers of the respective types of icons input for the multimedia resource. Also, the numbers of the respective types of icons input for the multimedia resource may be taken as a reference, and the above method could be combined with other methods for categorizing multimedia resources in the relative arts to determine the category to which the multimedia resource belongs.
In the method for categorizing multimedia resources according to the embodiment, respective types of icons input by the user for the multimedia resource can be taken into consideration when categorizing the multimedia resources, thereby improving the accuracy of the multimedia resource categorization.
a step S301 of determining a type of icons having the largest number among the respective types of icons input for the multimedia resource as a first type of icons; and
a step S302 of determining a category corresponding to the first type of icons as the category to which the multimedia resource belongs.
For example, the numbers of respective types of icons among all the bullet-screen icons input by the respective users for the video A are counted, obtaining 600 bullet-screen icons of face with tears of joy, 70 bullet-screen icons of boring and 200 bullet-screen icons of surprise. Then, the bullet-screen icon of face with tears of joy can be determined as the first type of icons, and the category of comedy corresponding to the bullet-screen icon of face with tears of joy is determined as the category to which the video A belongs.
a step S401 of sorting the respective types of icons in a descending order according to the numbers of the respective types of icons input for the multimedia resource; and
a step S402 of determining categories corresponding to the first N types of icons in the sorting as categories to which the multimedia resource belongs, wherein N is a positive integer.
For example, the numbers of the respective types of icons among all the bullet-screen icons input by respective users for the video A are counted, obtaining 600 bullet-screen icons of face with tears of joy, 70 bullet-screen icons of boring and 200 bullet-screen icons of surprise. Then, the respective types of icons may be sorted in a descending order according to the numbers of the respective types of icons input for the video A, and the result of sorting will be: the bullet-screen icon of face with tears of joy, the bullet-screen icon of surprise, and the bullet-screen icon of boring. The category of comedy corresponding to the bullet-screen icon of face with tears of joy and the category of horror corresponding to the bullet-screen icon of surprise, i.e. the first two in the sorting, are determined as the categories to which the video A belongs.
In one possible implementation, determining the category to which the multimedia resource belongs according to the numbers of the respective types of icons input for the multimedia resource includes: sorting the respective types of icons in an ascending order according to the numbers of the respective types of icons input for the multimedia resource; and determining the categories corresponding to the last N types of icons in the sorting as the categories to which the multimedia resource belongs, wherein N is a positive integer.
For example, the numbers of the respective types of icons among all the bullet-screen icons input by respective users for the video A are counted, obtaining 600 bullet-screen icons of face with tears of joy, 70 bullet-screen icons of boring and 200 bullet-screen icons of surprise. Then, the respective types of icons may be sorted in an ascending order according to the numbers of the respective types of icons input for the video A, and the result of sorting will be: the bullet-screen icon of boring, the bullet-screen icon of surprise, and the bullet-screen icon of face with tears of joy. The category of horror corresponding to the bullet-screen icon of surprise and the category of comedy corresponding to the bullet-screen icon of face with tears of joy, i.e. the last two in the sorting, are determined as the categories to which the video A belongs.
It should be noted that, one skilled in the art should understand that there are multiple manners to determine the value of N. For example, but without making any limit, the value of N may be a predetermined value, or can be determined according to the number of types of the respective types of icons input for the multimedia resources.
In one possible implementation, determining the value of N according to the number of types of the respective types of icons input for the multimedia resource may include: determining a difference between the number of types of the respective types of icons input for the multimedia resource and a first value as the value of N, wherein the first value is smaller than the number of types of the respective types of icons input for the multimedia resource.
For example, by counting the respective types of icons input by the user for video B, there are obtained the bullet-screen icons of face with tears of joy, boring, surprise and love. Thus, the number of types of the respective types of icons input for video B is 4. If the first value is 2, the value of N can be determined as 2, which is the difference between the number of types 4 and the first value 2.
a step S501 of counting numbers of icons for respective types of icons input by a user for a multimedia resource;
a step S502 of determining a category to which the multimedia resource belongs according to the numbers of the respective types of icons input for the multimedia resource;
a step S503 of determining, for each of multimedia resources belonging to the category, a number of icons input for the multimedia resource and corresponding to the category and/or time of release of the multimedia resource; and
a step S504 of sorting the multimedia resources belonging to the category, according to the numbers of icons input for the multimedia resources and corresponding to the category and/or the time of release of the multimedia resources.
In one possible implementation, the respective multimedia resources belonging to some category are sorted according to the numbers of icons input for the respective multimedia resources and corresponding to the category.
As one example of this implementation, the respective multimedia resources belonging to some category are sorted in a descending order according to the numbers of icons input for the respective multimedia resources and corresponding to the category. Wherein the icons corresponding to the category may be the icons that have correspondence with the category. For example, the icons corresponding to the category of comedy may be a bullet-screen icon of face with tears of joy.
For example, the number of the bullet-screen icon of face with tears of joy input for the respective videos belonging to the category of comedy, i.e. videos A, B and C, are counted, obtaining 600 bullet-screen icons of face with tears of joy input for video A, 1000 input for video B and 200 input for video C. Then, the respective videos can be sorted in a descending order according to the numbers of the bullet-screen icon of face with tears of joy input for the respective videos in the category of comedy, and the result of sorting will be: video B, video A and video C. After having the sorting result obtained, the information of video B, video A and video C may be displayed in a descending sequence in the ranking list of the category of comedy. The information of video may include a title, labels or posters thereof.
In one possible implementation, the respective multimedia resources belonging to some category are sorted according to the time of release of the respective multimedia resources.
As one example of this implementation, the respective multimedia resources belonging to some category are sorted in an order from the latest to the earliest according to the time of release of the respective multimedia resources.
For example, assuming that the category of comedy includes videos A, B, C, D and E, and the time of release of video A is Jan. 25, 2017, and that of video B is Feb. 22, 2017, video C Nov. 8, 2016, video D Dec. 8, 2016, and video E Oct. 8, 2016. Then, the videos may be sorted in an order from the latest to the earliest according to the time of release of the respective videos, and the result of sorting will be: video B, video A, video D, video C, video E. After having the sorting result obtained, the information of video B, video A and video D may be displayed in a descending sequence in the ranking list of the category of comedy.
In one possible implementation, the respective multimedia resources belonging to some category are sorted according to the numbers of the icons input for the respective multimedia resources and corresponding to the category and the time of release of the respective multimedia resources.
As one example of this implementation, sorting the respective multimedia resources belonging to some category according to the numbers of the icons input for the respective multimedia resources and corresponding to the category and the time of release of the respective multimedia resources may include: determining scores of the respective multimedia resources according to the numbers of the icons input for respective multimedia resources and corresponding to the category and the time of release of the respective multimedia resources; and sorting the respective multimedia resources in a descending order according to the scores of the respective multimedia resources.
The following Equation 1 is applied to determine the score Si of the ith multimedia resource.
Si=Q1iC1i+Q2iC2i Equation 1
Wherein, Q1i indicates the weight corresponding to the number of icons input for the ith multimedia resource and corresponding to the category, C1i indicates the number of icons input for the ith multimedia resource and corresponding to the category, Q2i indicates a weight corresponding to the time of release of the ith multimedia resource, and C2i indicates a value corresponding to the time of release of the ith multimedia resource. The value corresponding to the time of release may be determined according to the difference between the time of release and the current system time. The value corresponding to the time of release may negatively correlate to the difference; that is, the smaller the difference is, the larger the value corresponding to the time of release will be, and the larger the difference is, the smaller the value corresponding to the time of release will be.
As one example of this implementation, sorting the respective multimedia resources belonging to some category according to the numbers of the icons input for respective multimedia resources and corresponding to the category and the time of release of the respective multimedia resources may include: sorting the respective multimedia resources in a descending order according to the numbers of the icons input for the respective multimedia resources and corresponding to the category; selecting the first M multimedia resources in the sorting, wherein M is a positive integer; and sorting the M multimedia resources in an order from the latest to the earliest according to the time of release.
For example, the numbers of the bullet-screen icon of face with tears of joy input for the respective videos in the category of comedy, i.e. videos A, B, C, D and E, are counted, obtaining 600 bullet-screen icons of face with tears of joy input for video A, 1000 input for video B, 200 input for video C, 400 input for video D and 800 input for video E. Then, the videos may be sorted in a descending order according to the numbers of the bullet-screen icon of face with tears of joy input for the respective videos in the category of comedy, and the result of sorting will be: video B, video E, video A, video D, and video C. The top three videos, i.e., Video B, Video E, and Video A, are selected. Assuming that the time of release of video B is Feb. 22, 2017, that of video E is Oct. 8, 2016, and that of video A is Jan. 25, 2017. Then, the three videos B, E and A may be sorted in an order from the latest to the earliest according to the time of release of the respective videos, and the result of sorting will be: video B, video A, video E. After having the sorting result obtained, the information of video B, video A and video E may be displayed in a descending sequence in the ranking list of the category of comedy.
According to the method for categorizing multimedia resources according to this embodiment, respective types of icons input by the users for multimedia resources and the time of release of the multimedia resources can be taken into consideration in categorizing the multimedia resources, so as to rank the latest released multimedia resource at the top, thereby improving the accuracy of the categorization of the multimedia resources.
In one possible implementation, the device further comprises storage for storing respective input times for at least some of the icons, and the first counter 11 is configured to count numbers of icons for respective types of icons included in the collected input having input times within a particular time period, where the particular time period starts no earlier than a time of release of the multimedia resource and ends such that a subset of fewer than all icons input by all of the plurality of client devices have input times within the particular time period.
In one possible implementation, the device further comprises circuitry for transmitting information characterizing a plurality of multimedia resources from the server device to one or more of the client devices, where the information characterizing the plurality of multimedia resources is based at least in part on one or more categories represented in respective category information associated with the plurality of multimedia resources.
In one possible implementation, the first determiner 13 includes: an icon sub-sorter 133 for sorting the respective types of icons in a descending order according to the numbers of the respective types of icons input for the multimedia resource; and a second category sub-determiner 134 for determining the categories corresponding to the first N types of icons in the sorting as the categories to which the multimedia resource belongs, wherein N is a positive integer.
In one possible implementation, the device further comprises: a second determiner 15 for determining, for each of multimedia resources belonging to the category, a number of icons input for the multimedia resource and corresponding to the category and/or time of release of the multimedia resource; and a multimedia resource sorter 17 for sorting the multimedia resources belonging to the category, according to the numbers of icons input for the multimedia resources and corresponding to the category and/or the time of release of the multimedia resources.
The device for categorizing multimedia resources according to this embodiment can take the respective types of icons input by the user for the multimedia resources into consideration when categorizing the multimedia resources, thereby improving the accuracy of the categorization of the multimedia resources.
The device 1900 may further include: a power assembly 1926 configured to perform power management on the device 1900; a wired or wireless network interface 1950 configured to connect the device 1900 to a network; and an input/output (I/O) interface 1958. The device 1900 may be operated on the basis of an operating system stored in the memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, and the likes.
In an exemplary embodiment, there is also provided a non-transitory computer readable storage medium, such as the memory 1932, that comprises instructions; the instructions may be executed by the processing assembly 1922 of the device 1900 for performing the above methods.
The present disclosure may be implemented by a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions for causing a processor to carry out the aspects of the present disclosure stored thereon.
The computer readable storage medium can be a tangible device that can retain and store instructions used by an instruction executing device. The computer readable storage medium may include, but is not necessarily limited to, e.g., electronic storage device, magnetic storage device, optical storage device, electromagnetic storage device, semiconductor storage device, or any proper combination thereof. A non-exhaustive list of more specific examples of the computer readable storage medium includes: portable computer diskette, hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanically encoded device (for example, punch-cards or raised structures in a groove having instructions recorded thereon), and any proper combination thereof. A computer readable storage medium referred herein should not to be construed as transitory signal per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signal transmitted through a wire.
Computer readable program instructions described herein can be downloaded to individual computing/processing devices from a computer readable storage medium or to an external computer or external storage device via network, for example, the Internet, local area network, wide area network and/or wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing devices.
Computer readable program instructions for carrying out the operations of the present disclosure may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state-setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language, such as Smalltalk, C++ or the like, and the conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may be executed completely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or completely on a remote computer or a server. In the scenario with remote computer, the remote computer may be connected to the user's computer through any type of network, including local area network (LAN) or wide area network (WAN), or connected to an external computer (for example, through the Internet connection from an Internet Service Provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA), may be customized from state information of the computer readable program instructions; the electronic circuitry may execute the computer readable program instructions, so as to achieve the aspects of the present disclosure.
Aspects of the present disclosure have been described herein with reference to the flowchart and/or the block diagrams of the method, device (systems), and computer program product according to the embodiments of the present disclosure. It will be appreciated that each block in the flowchart and/or the block diagram, and combinations of blocks in the flowchart and/or block diagram, can be implemented by the computer readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, a dedicated computer, or other programmable data processing devices, to produce a machine, such that the instructions create means for implementing the functions/acts specified in one or more blocks in the flowchart and/or block diagram when executed by the processor of the computer or other programmable data processing devices. These computer readable program instructions may also be stored in a computer readable storage medium, wherein the instructions cause a computer, a programmable data processing device and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises a product that includes instructions implementing aspects of the functions/acts specified in one or more blocks in the flowchart and/or block diagram.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing devices, or other devices to have a series of operational steps performed on the computer, other programmable devices or other devices, so as to produce a computer implemented process, such that the instructions executed on the computer, other programmable devices or other devices implement the functions/acts specified in one or more blocks in the flowchart and/or block diagram.
The flowcharts and block diagrams in the drawings illustrate the architecture, function, and operation that may be implemented by the system, method and computer program product according to the various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a part of a module, a program segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions denoted in the blocks may occur in an order different from that denoted in the drawings. For example, two contiguous blocks may, in fact, be executed substantially concurrently, or sometimes they may be executed in a reverse order, depending upon the functions involved. It will also be noted that each block in the block diagram and/or flowchart, and combinations of blocks in the block diagram and/or flowchart, can be implemented by dedicated hardware-based systems performing the specified functions or acts, or by combinations of dedicated hardware and computer instructions
Although the embodiments of the present disclosure have been described above, it will be appreciated that the above descriptions are merely exemplary, but not exhaustive; and that the disclosed embodiments are not limiting. A number of variations and modifications may occur to one skilled in the art without departing from the scopes and spirits of the described embodiments. The terms in the present disclosure are selected to provide the best explanation on the principles and practical applications of the embodiments and the technical improvements to the arts on market, or to make the embodiments described herein understandable to one skilled in the art.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201710121020 | Mar 2017 | CN | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20120254301 | Fiero | Oct 2012 | A1 |
| 20140004489 | Kim | Jan 2014 | A1 |
| 20140007149 | Huang et al. | Jan 2014 | A1 |
| 20140163969 | Chattopadhyay | Jun 2014 | A1 |
| 20140282633 | Fiero | Sep 2014 | A1 |
| 20150205580 | Tan et al. | Jul 2015 | A1 |
| 20160050389 | Fiero | Feb 2016 | A1 |
| 20160055183 | Fiero | Feb 2016 | A1 |
| 20160294885 | Fiero | Oct 2016 | A1 |
| 20170126611 | Rajan | May 2017 | A1 |
| 20170255618 | Fiero | Sep 2017 | A1 |
| 20170357647 | Fiero | Dec 2017 | A1 |
| Number | Date | Country |
|---|---|---|
| 102880712 | Jan 2013 | CN |
| 102880712 | Jan 2013 | CN |
| 103530788 | Jan 2014 | CN |
| 104035982 | Sep 2014 | CN |
| 104410911 | Mar 2015 | CN |
| 105868686 | Aug 2016 | CN |
| 106294830 | Jan 2017 | CN |
| 106326391 | Jan 2017 | CN |
| 106951137 | Jul 2017 | CN |
| Entry |
|---|
| Machine Translation of Chinese Office Action dated Mar. 28, 2019 for Chinese aapplication No. 201710121020.8,. a counterpart foreign application of U.S. Appl. No. 15/909,092. 12 pages. |
| Chinese Search Report dated Mar. 20, 2019 for CN Application No. 201710121020.8, 2 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20190272330 A1 | Sep 2019 | US | |
| 20210026925 A9 | Jan 2021 | US |
