Patent Grant
11722638
One or more embodiments relate to a video communication device, a video communication method, and a video communication mediating method, which are capable of preventing a user who is making a video communication from being exposed to an inappropriate image or sound from the other party.
With the development of communication technology and the miniaturization of electronic devices, personal terminals have become widespread to general consumers. In particular, portable personal terminals such as smart phones or smart tablets have been widely used in recent years. Most of terminals include a communication function. A user may use a terminal to perform a search on the Internet or exchange messages with the other party.
In addition, with the development of small camera, small microphone, small display, and small speaker technology, most terminals such as smart phones include cameras, microphones, displays, and speakers. A user can record a voice or capture a video containing voice using a terminal. The user can confirm the recorded voice through a speaker included in the terminal or confirm the captured video through a display.
In addition, a user can share the recorded voice or the captured video with the other party using a communication function of a terminal. The user can transmit the previously recorded voice or the previously captured video to the other party. The user can also transmit a voice currently being recorded by the terminal or a video currently being captured to the other party in real time.
At the same time, the other party can transmit a voice currently being recorded or a movie currently being captured by a terminal to the user in real time. The display included in the user's terminal can simultaneously display a video currently being captured by the user's terminal and a video currently being captured by the other party's terminal. In addition, a speaker included in the terminal of the user can simultaneously reproduce the voice currently being recorded by the terminal of the other party. In other words, the user and the other party can make a video communication with each other using their own terminals.
The user and the other party may already be acquainted with each other or may not be acquainted with each other. A plurality of terminals including the terminal of the user and the terminal of the other party may be connected to the server. The server can mediate between the terminal of the user and the terminal of the other party. Therefore, even if the user and the other party do not know each other, they can make a video communication with each other through mediation of the server.
While a user is in a video communication with the other party, the user may be exposed to an inappropriate image or sound from the other party. Particularly, while the user is in a video communication with the other party having an unknown relationship with each other, there is a high possibility that the user is exposed to obscene images from the other party.
For example, a naked body image of the other party captured by the other party's terminal may be received at the user's terminal through the video communication session. The user's terminal displays the received image so that the user can be exposed to the sexually obscene image. When the user is exposed to an obscene image that she or he does not want, the user may feel sexual shame or discomfort.
One or more embodiments may provide a video communication device, a video communication method, and a video communication mediating method, which are capable of preventing a user who is making a video communication from being exposed to an inappropriate video or sound from the other party.
One or more embodiments may provide a video communication device, a video communication method, and a video communication mediating method, which are capable of preventing a user from transmitting an inappropriate image or sound.
One or more embodiments may provide a video communication device, a video communication method, and a video communication mediating method, which are capable of preventing a user who is making a video communication from feeling sexual shame or discomfort caused by an image or sound from the other party.
One or more embodiments may provide a video communication device, a video communication method, and a video communication mediating method, which are capable of inducing a healthy video communication between users.
According to an embodiment, a video communication method may comprise establishing a first video communication session with a first terminal, consecutively receiving images or sounds from the first terminal through the first video communication session, examining at least a portion of images or sounds received in a period of recent specific time among the received images or sounds, and blocking an output of at least a portion of the received images or sounds or reporting a user of the first terminal as an abusive user to a first server according to a result of the examining.
Further, the examining may comprise detecting a specific portion from the at least a portion of images or sounds received in a period of recent specific time.
Further, the detecting the specific portion may comprise detecting a portion corresponding to a specific facial expression, body language, or body part from the at least a portion of images or sounds received in a period of recent specific time.
Further, the detecting the portion corresponding to a specific facial expression, body language, or body part may comprise detecting a portion corresponding at least one of an obscene gesture, an insult gesture, a racism gesture, sexual content, nudity, genitalia, sexual activity, unsanitary content, excreta, excretion, antisocial content, antihuman content, illegal conduct, criminal conduct, hate crime, violent conduct, maltreatment conduct, self-harmful conduct, a weapon, a drug, an antisocial symbol, hateful content, threatening content, phobia-inducing content, or blood from the at least a portion of images or sounds received in a period of recent specific time.
Further, the examining may comprise detecting a portion corresponding to a specific voice or language from the at least a portion of images or sounds received in a period of recent specific time.
Further, the detecting a portion corresponding to a specific voice or language may comprise detecting a portion corresponding to a language related to at least one of a swear word, insult, racial discrimination, defamation, obscenity, sexual harassment, antisocial conduct, antihuman conduct, terrorism, hate speech, violence, maltreatment, a drug, or threatening.
Further, the video communication method may comprise repeating additionally examining at least one time after the examining and before the blocking or the reporting, wherein the blocking or the reporting comprises blocking an output of the at least a portion of the received images or sounds or reporting a user of the first terminal when a cumulative number of times in which the specific portion is detected is a first number or more or the number of times in which the specific portion is consecutively detected a second number of times or more after establishing the first video communication session.
Further, the video communication method may comprise repeating the examining to the blocking or the reporting with regular or irregular cycles.
Further, the video communication method may comprise consecutively outputting the received images or sounds after the receiving.
Further, the video communication method may comprise preparing information on correlation between at least one feature included in an image or sound of an arbitrary user and information on whether the arbitrary user is an abusive user before the establishing the first video communication session, wherein the examining comprises calculating whether the user of the first terminal is an abusive user using the prepared information on correlation and the at least a portion of images or sounds received in a period of recent specific time.
Further, the preparing the information on correlation may comprise preparing a machine learning model, and the examining may comprise predicting whether the user of the first terminal is an abusive user using the prepared machine learning model and the at least a portion of images or sounds received in a period of recent specific time.
Further, the preparing the machine learning model may comprise receiving the machine learning model from a second server.
Further, the preparing the machine learning model may comprise preparing at least one image or sound corresponding to a non-abusive user or abusive user and training the machine learning model using the at least one image or sound and information on whether each of the at least one image or sound corresponds to the abusive user.
Further, the preparing the at least one image or sound may comprise establishing at least one second video communication session with at least one terminal of the non-abusive user or at least one terminal of the abusive user and collecting at least a portion of images or sounds transmitted or received through the at least one second video communication session.
According to another embodiment, a video communication method may comprise establishing a video communication session between a first terminal and a second terminal, consecutively capturing images of a surrounding area of the first terminal or consecutively recording sounds from the surrounding area, examining at least a portion of images captured or sounds recorded in a period of recent specific time among the captured images or the recorded sounds by the first terminal, and according to a result of the examining, blocking transmission of at least a portion through the video communication session among the captured images or the recorded sounds by the first terminal or reporting a user of the first terminal as an abusive user to a first server.
Further, the video communication method may comprise repeating, by the first terminal, additionally examining at least one time after the examining and before the blocking or the reporting, wherein the blocking or the reporting may comprise blocking the transmission of the at least a portion of the captured images or recorded sounds or reporting the user of the first terminal when a cumulative number of times in which the specific portion is detected is a first number or more or the number of times in which the specific portion is consecutively detected a second number of times or more after establishing the video communication session.
Further, the video communication method may comprise receiving, by the first terminal, a machine learning model from a second server, which corresponds to correlation between at least one feature included in an image or sound of an arbitrary user and information on whether the arbitrary user is an abusive user, before the establishing the video communication session, wherein the examining comprises predicting whether the user of the first terminal is an abusive user using the received machine learning model and the at least a portion of images captured or sounds recorded in a period of recent specific time.
Further, the video communication method may comprise, before the establishing the video communication, preparing, by the first terminal, at least one image or sound corresponding to a non-abusive user or abusive user and training, by the first terminal, the machine learning model using the trained machine learning model and the at least a portion of images captured or sounds recorded in a period of recent specific time, wherein the examining may comprise predicting, by the first terminal, whether the user of the first terminal is an abusive user using the trained machine learning model and the at least a portion of images captured or sounds recorded in a period of recent specific time.
According to still another embodiment, a video communication mediating method may comprise receiving, by a server, a mediation request from a plurality of terminals, mediating, by the server, a video communication connection between a first terminal and a second terminal among the plurality of terminals, receiving, by the server, a report from the first terminal, which indicates that a user of the first terminal or a user of the second terminal is an abusive user as the result of the first terminal's examination on an image of a surrounding area of the first terminal, captured by the first terminal, a sound from the surrounding area of the first terminal, recorded by the first terminal, an image received by the first terminal from the second terminal, or a sound received by the first terminal from the second terminal, mediating, by the server, a video communication connection between a terminal of the reported user and a terminal of a monitoring agent in response to the report, receiving, by the server, a result of verification on the reported user from the terminal of the monitoring agent, and rejecting, by the server, an additional mediation request from the reported user according to the received result of verification.
According to yet another embodiment, a video communication device may comprise a communication interface configured to establish a video communication session with a terminal and consecutively receive images or sounds from the terminal through the video communication session, an output interface configured to consecutively output the received images or sounds, and a controller configured to examine at least a portion of images or sounds received in a period of recent specific time, wherein according to a result of examination, the controller may control the output interface to block an output of at least a portion of the received images or sounds or the communication interface to report a user of the terminal as an abusive user to a server.
According to yet another embodiment, a video communication device may comprise an input interface configured to consecutively capture images of a surrounding area thereof or consecutively record sounds from the surrounding area, a communication interface configured to establish a video communication session with a terminal and consecutively transmit the captured images or recorded sounds to the terminal through the video communication session, and a controller configured to examine at least a portion of images captured or sounds recorded in a period of recent specific time among the captured images or recorded sounds, wherein according to a result of the examination, the communication interface may block transmission of at least a portion of the captured images or recorded sounds or report a user of the video communication device as an abusive user to a server.
One or more embodiments can prevent a user who is making a video communication from being exposed to an inappropriate image or sound from the other party.
One or more embodiments can prevent a user from transmitting an inappropriate image or sound.
One or more embodiments can prevent a user who is making a video communication from feeling sexual shame or discomfort caused by an image or sound from the other party.
One or more embodiments can induce a healthy video communication between users.
These and/or other aspects will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings in which:
Advantages and features of the present disclosure and a method of achieving the same will be more clearly understood from embodiments described below in detail with reference to the accompanying drawings. However, the present disclosure is not limited to the following embodiments and may be implemented in various different forms. The embodiments are provided merely to complete the present disclosure and to provide those of ordinary skill in the art with the category of the present disclosure. The present disclosure is defined only by the claims. Wherever possible, the same reference numbers will be used throughout the specification to refer to the same or like components.
It will be understood that although the terms “first,” “second,” etc. may be used to describe various components, these components should not be limited by these terms. These terms may be only used to distinguish one component from another. Therefore, a first component used herein may be a second component within the technical scope of the present disclosure.
The terminology used herein is for the purpose of describing embodiments and is not intended to limit the present disclosure. As used herein, the singular forms are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” or “comprising” used in this specification may denote that the used components or steps do not preclude the presence or addition of one or more other components and/or steps.
Unless otherwise defined, all terms used herein have the same meaning as commonly understood by those of ordinary skill in the art. It will be further understood that terms, such as those defined in commonly used dictionaries, will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
Hereinafter, video communication devices 200, 210, and 300, a video communication method, video communication medicating method, according to embodiments, will be described in detail with reference to
The server 100 may be connected to a communication network. The server 100 may be connected to an external device via the communication network. The server 100 may transmit data to other devices connected to each other or receive data from other devices.
The communication network connected to the server 100 may include a wired communication network, a wireless communication network, or a composite communication network. The communication network may include a mobile communication network such as 3G, Long Term Evolution (LTE), or LTE-A. The communication network may include a wired or wireless communication network such as Wi-Fi, Universal Mobile Telephone System/General Packet Radio Service (UMTS/GPRS), or Ethernet. The communication network may include a short-range communication network such as Magnetic Secure Transmission (MST), Radio Frequency Identification (RFID), Near Field Communication (NFC), ZigBee, Z-Wave, Bluetooth, Bluetooth Low Energy (BLE), or InfraRed (IR) communication. The communication network may include Local Area Network (LAN), Metropolitan Area Network (MAN), or Wide Area Network (WAN).
The server 100 may be connected to each of the video communication devices 200, 210, and 300 through a communication network. When the server 100 is connected to a first video communication device 200, the server 100 may transceive data with the first video communication device 200 through a communication network. When the server 100 is connected to a second video communication device 210, the server 100 may transceive data with the second video communication device 210 through a communication network. When the server 100 is connected to a third video communication device 300, the server 100 may transceive data with the third video communication device 300 through a communication network.
The server 100 may receive data from the video communication devices 200, 210, and 300. The server 100 may operate calculations using data received from the video all devices 200, 210, and 300. The server 100 may transmit the calculation result to the video communication devices 200, 210, and 300.
The server 100 may receive mediation requests of video communications from a plurality of video communication devices 200, 210, and 300. The server 100 may select at least two video communication devices among the plurality of video communication devices 200, 210, and 300 that transmit the mediation requests. For example, the server 100 may select the first video communication device 200 and the second video communication device 210 as the at least two video communication devices 200, 210, and 300.
The server 100 may mediate a connection of a video communication between the selected at least two video communication devices 200, 210, and 300. For example, the server 100 may transmit the connection information on the first video communication device 200 to the second video communication device 210. As another example, the server 100 may transmit the connection information on the second video communication device 210 to the first video communication device 200.
The connection information on the first video communication device 200 may include, for example, an IP address and a port number of the first video communication device 200. The second video communication device 210 receiving the connection information on the first video communication device 200 may attempt to connect to the first video communication device 200 using the received connection information.
The connection information on the second video communication device 210 may include, for example, an IP address and a port number of the second video communication device 210. The first video communication device 200 receiving the connection information on the second video communication device 210 may attempt to connect to the second video communication device 210 using the received connection information.
Succeeding in an attempt to connect the first video communication device 200 to the second video communication device 210 or an attempt to connect the second video communication device 210 to the first video communication device 200 may enable establishment of a video communication session between the first video communication device 200 and the second video communication device 210. The first video communication device 200 may transmit an image or sound to the second video communication device 210 through the video communication session. The first video communication device 200 may encode an image or sound into a digital signal and transmit the encoded result to the second video communication device 210.
Further, the first video communication device 200 may receive an image or sound from the second video communication device 210 through the video communication session. The first video communication device 200 may receive an image or sound encoded in a digital signal and may decode the received encoded image or sound.
The second video communication device 210 may transmit an image or sound to the first video communication device 200 through the video communication session. Further, the second video communication device 210 may receive an image or sound from the first video communication device 200 through the video communication session. Accordingly, a user of the first video communication device 200 and another user of the second video communication device 210 may make a video communication with each other.
The video communication devices 200, 210 and 300 may be terminals. The video communication devices 200, 210 and 300 may be, for example, desktop computers, laptop computers, smart phones, smart tablets, smart watches, mobile terminals, digital cameras, wearable devices, or portable electronic devices. The video communication devices 200, 210, and 300 may execute programs or applications. Each of the video communication devices 200, 210 and 300 may be the same kind of device each other or may not be the same kind of device each other.
Hereinafter, the first video communication device 200 and a first terminal 200 may be interchangeably used as a term to refer to the first video communication device 200 for convenience of description. Hereinafter, the second video communication device 210 and a second terminal 210 will be interchangeably used as a term to refer to the second video communication device 210 and a third video communication device 300, and the third terminal 300 will be interchangeably used as a term to refer to the third video communication device 300.
The input interface 201 may receive input from the outside. The input interface 201 may receive input from a user of the first terminal 200. Further, the input interface 201 may receive a signal from an external device as the input. The input interface 201 may include, for example, a microphone, a camera, a keyboard, a mouse, a trackball, a touch screen, a button, a switch, a sensor, a network interface, or other input devices.
The input interface 201 may receive light from outside through a camera included in the input interface 201. The input interface 201 may receive light emitted from an external object or light reflected from an external object. The input interface 201 may consecutively capture images of the surrounding area of the first terminal 200 through the camera. The input interface 201 may capture an image of a user of the first terminal 200.
The input interface 201 may receive a sound from outside through a microphone included in the input interface 201. The input interface 201 may receive a sound from the user of the first terminal 200. Further, the input interface 201 may receive a sound from an external sound reproducing device. The input interface 201 may consecutively record sounds from the surrounding area of the first terminal 200 through the microphone. The input interface 201 may record a voice of the user of the first terminal 200.
The storage 202 may store data. The storage 202 may store the input received by the input interface 201. The storage 202 may store the image captured or the sound recorded by the input interface 201. The storage 202 may store data to be used by the controller 205 to perform an arithmetic operation. The storage 202 may store the result of the arithmetic operation performed by the controller 205. For example, the storage 202 may store the image or voice encoded by the controller 205. The storage 202 may store data to be transmitted to the outside through the communication interface 203 or may store data received from the outside through the communication interface 203.
The storage 202 may include a volatile memory or a non-volatile memory. The storage 202 may include, for example, flash memory, read-only memory (ROM), random access memory (RAM), electrically erasable read-only memory (EEROM), erasable programmable read-only memory (EPROM), electrically erasable and programmable read-only memory (EEPROM), hard disk drive (HDD), register, or the like. The storage 202 may include, for example, a file system, a database, or an embedded database.
The communication interface 203 may transmit data to the exterior or receive data from the exterior. The communication interface 203 may transmit data to the other video communication devices 210 and 300 or the server 100. The communication interface 203 may receive data from the other video communication devices 210 and 300 or the server 100. The communication interface 203 may transmit the result of the arithmetic operation performed by the controller 205 to the exterior. Further, the communication interface 203 may transmit data stored in the storage 202 to the exterior. The communication interface 203 may transmit the image captured or the sound recorded by the input interface 201 to the exterior.
Data to be transmitted by the communication interface 203 or data received by the communication interface 203 may be stored in the storage 202. For example, the communication interface 203 may transmit an encoded image or voice stored in the storage 202 to the server 100 or the other video communication devices 210 and 300. Further, the communication interface 203 may receive an image or a voice encoded by the other video communication devices 210 and 300 from the other video communication devices 210 and 300.
The communication interface 203 may include, for example, a long-range network interface such as a 3G module, an LTE module, an LTE-A module, a Wi-Fi module, a WiGig module, an Ultra Wide Band (UWB) module, or a LAN card. Further, the communication interface 203 may include, for example, a short-range network interface such as an MST module, a Bluetooth module, an NFC module, an RFID module, a ZigBee module, a Z-Wave module, or an IR module. Further, the communication interface 203 may include other network interfaces.
The output interface 204 may output a signal to the exterior. The output interface 204 may, for example, display a screen, reproduce a sound, or output a vibration. The output interface 204 may include a display, a speaker, a vibrator, an oscillator, or other output devices.
The output interface 204 may display a screen. The controller 205 may control the output interface 204 to display a screen. The output interface 204 may display a user interface. The output interface 204 may display another screen in response to an input of a user.
The output interface 204 may display data. The output interface 204 may display the result of the arithmetic operation performed by the controller 205. The output interface 204 may display data stored in the storage 202. The output interface 204 may display data received by the communication interface 204.
The output interface 204 may display an image of a user of the first terminal 200 captured by the input interface 201 or images of the other users captured by the other video communication devices 210 and 300. Further, the output interface 204 may reproduce the voice of the user of the first terminal 200 recorded by the input interface 201 or the voice of the other users recorded by the other video communication devices 210 and 300.
The output interface 204 may include, for example, a flat-panel display device such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), or a plasma display panel (PDP). The output interface 204 may include a curved display or a flexible display. The output interface 204 may include a touch screen.
The controller 205 may control an operation of the first terminal 200. The controller 205 may be connected to the components included in the first terminal 200. The controller 205 may control each operation of the components included in the first terminal 200.
The controller 205 may process a signal. The controller 205 may process a signal received by the input interface 201. For example, the controller 205 may process the images of the users, captured by the camera included in the input interface 201. The controller 205 may process a sound and a voice of a user, recorded by the microphone included in the input interface 201.
The controller 205 may process the signal received by the communication interface 203. For example, the controller 205 may process a request of the user, received through the communication interface 203. The controller 205 may process images or voices of other users received through the communication interface 203.
The controller 205 may control an operation of the first terminal 200 in response to a signal received by the input interface 201. The controller 205 may control operation of the first terminal 200 in response to a request of a user received by the input interface 201.
The controller 205 may perform an arithmetic operation. The controller 205 may perform an arithmetic operation according to a signal received by the input interface 201. The controller 205 may perform an arithmetic operation using a signal received by the input interface 201 or data stored in the storage 202. For example, the controller 205 may perform image-processing using an image captured by the camera included in the input interface 201. The controller 205 may encode an image captured by the camera included in the input interface 201. The controller 205 may encode a sound or a voice recorded by the microphone included in the input interface 201. The controller 205 may encode a sound or a voice recorded by the camera included in the input interface 201.
The controller 205 may decode images or voices of other users, received by the communication interface 203. The controller 205 may perform post-processing on the decoded image or voice. For example, the controller 205 may perform image-processing on images of other users, received by the communication interface 203.
The controller 205 may control such that the result of the arithmetic operation is stored in the storage 202. The controller 205 may control such that the result of the arithmetic operation is output by the output interface 105. The controller 204 may control that the result of the arithmetic operation is transmitted to the other video communication devices 210 and 300 by the communication interface 203.
The controller 205 may include, for example, a central processing unit (CPU), a graphic processing unit (GPU), a micro controller unit (MCU), or a microprocessor.
A type of the second terminal 210 may be same as or different from a type of the first terminal 200. The second terminal 210 may execute a program or an application.
The second terminal 210 may be connected to a communication network. The second terminal 210 may be connected to an external device with each other via the communication network. The second terminal 210 may transmit data to the connected external device or receive data from the connected external device.
The second terminal 210 may be connected to the first terminal 200 with each other by mediation of the server 100. The second terminal 210 may transmit data to the first terminal 200 or receive data from the first terminal 200. The first terminal 200 and the second terminal 210, which are connected to each other, may transceive a message, a file, data, an image, a video, a sound, or a voice, and so on with each other.
The second terminal 210 may establish a voice communication session or a video communication session with the first terminal 200. The video communication session may be established using, for example, transmission control protocol (TCP), user datagram protocol (UDP), or web real-time communication (WebRTC). The user of the first terminal 200 and the user of the second terminal 210 may make a voice communication or a video communication with each other.
The video communication session may directly be established between the first terminal 200 and the second terminal 210. According to another example, the video communication session may directly be established between the first terminal 200 and the second terminal 210 via at least one other device. For example, the video communication session may include a session established between the first terminal 200 and the server 100 and a session established between the server 100 and the second terminal 210.
The first terminal 200 and the second terminal 210 may directly exchange data with each other. Further, the first terminal 200 and the second terminal 210 may exchange data with each other via the server 100 or other mediating devices.
A type of the third terminal 300 may be identical to or different from a type of the first terminal 200. The third terminal 300 may execute a program or an application.
The third terminal 300 may be connected to a communication network. The third terminal 300 may be connected to an external device with each other via the communication network. The third terminal 300 may transmit data to the connected external device or receive data from the connected external device.
Hereinafter, the specific operations of the video communication devices 200, 210, and 300 in the video communication method, according to an embodiment, will be described in detail with reference to
An arbitrary image or sound of the arbitrary user may include at least one feature. The feature included in the arbitrary image may be a specific shape, pattern, color, or a combination thereof included in the arbitrary image. The feature may be, for example, a specific facial expression, a specific body language, a specific shape, pattern, or color corresponding to a body part, or combination thereof.
Each feature included in the arbitrary image may correspond to a non-abusive element or an abusive element. For example, the feature may correspond to at least one abusive element of an obscene gesture, an insult gesture, a racism gesture, sexual content, nudity, genitalia, sexual activity, unsanitary content, excreta, excretion, antisocial content, antihuman content, illegal conduct, criminal conduct, hate crime, violent conduct, maltreatment conduct, self-harmful conduct, a weapon, a drug, an antisocial symbol, hateful content, threatening content, phobia-inducing content, or blood.
The feature included in the arbitrary sound may be a specific waveform, a pattern, or a combination thereof included in the arbitrary sound. The feature may be, for example, a specific waveform, pattern, or a combination thereof corresponding to a specific voice or language.
Each feature included in the arbitrary sound may correspond to a non-abusive element an abusive element. For example, the feature may correspond to at least one abusive element of groaning, gasping sound, screaming, or shrieking. As another example, the feature may correspond to at least one abusive element among a crash, a gun-shooting sound, a vomit sound, a hit sound, a whip sound, a knife sound, a swing sound, a stab sound, a sound having a pitch equal to or greater than an arbitrary threshold value, or a sound having a loudness equal to and greater than a specific threshold value. As still another example, the feature may correspond to a language related to at least one of a swear word, insult, racial discrimination, defamation, obscenity, sexual harassment, antisocial conduct, antihuman conduct, terrorism, hate speech, violence, maltreatment, a drug, or threatening as the abusive element.
The storage 202 of the second terminal 210 may prepare at least one of a list, a table, a database, or a machine learning model including information on the correlation. The storage 202 of the second terminal 210 may prepare a list including at least one item. The storage 202 of the second terminal 210 may prepare a database corresponding to the list.
Each item included in the list may include information on one feature. Each feature corresponding to each item may correspond to an abusive element. Therefore, when any feature among features corresponding to the item included in the list is identical to the feature included in the arbitrary image or sound, it may be determined that the arbitrary image or sound includes an abusive element. When it is determined that the arbitrary image or sound includes an abusive element, the arbitrary user may be determined as an abusive user.
The communication interface 203 of the second terminal 210 may receive the list or a database corresponding to the list from the server 100 or a separate server. The storage 202 of the second terminal 210 may store the received list or database. According to another embodiment, the controller 205 of the second terminal 210 may generate the list or database by itself, and the storage 202 of the second terminal 210 may store the generated list or database.
According to another embodiment, the storage 202 of the second terminal 210 may prepare a table including at least one record. The storage 202 of the second terminal 210 may prepare a database corresponding to the table.
Each record included in the table may include information on a feature and information on whether the feature corresponds to a non-abusive element or an abusive element. Therefore, when the information indicating that a record corresponding to a feature included in an arbitrary image or sound is present among the records included in the table and information indicating that the feature corresponds to an abusive element is included in the record, the arbitrary image or sound may be determined to contain an abusive element. When the arbitrary image or sound is determined to include an abusive element, the arbitrary user may be determined as an abusive user.
The communication interface 203 of the second terminal 210 may receive the table or a database corresponding to the table from the server 100 or a separate server. The storage 202 of the second terminal 210 may store the received table or database. According to another embodiment, the controller 205 of the second terminal 210 may generate the table or database by itself, and the storage 202 of the second terminal 210 may store the generated table or database.
According to another embodiment, the storage 202 of the second terminal 210 may prepare a machine learning model corresponding to the correlation. The machine learning model may be a neural network including at least two layers. The machine learning model may include an input layer and an output layer. The machine learning model may further include at least one hidden layer.
The machine learning model may be a classification model trained using at least one image or sound and information on whether the at least one image or sound corresponds to a non-abusive element or an abusive element. The machine learning model may use at least one feature included in an arbitrary image or sound as an input value. The machine learning model may predict whether the at least one feature corresponds to a non-abusive element or an abusive element. When it is predicted that the at least one feature corresponds to an abusive element, the arbitrary user may be determined as an abusive user.
The communication interface 203 of the second terminal 210 may receive the machine learning model from the server 100 or a separate server. The storage 202 of the second terminal 210 may store the received machine learning model. According to another embodiment, the controller 205 of the second terminal 210 may train the machine learning model by itself and the storage 202 of the second terminal 210 may store the trained machine learning model.
The communication interface 203 of the second terminal 210 may transmit an image or sound recorded by the input interface 201 to the other video communication devices 200 and 300 through the second video communication session. The output interface 204 of the second terminal 210 may output the captured image or the recorded sound. The communication interface 203 of the second terminal 210 may receive an image or sound recorded by the other video communication devices 200 and 300 from the other video communication devices 200 and 300 through the second video communication session. The output interface 204 of the second terminal 210 may output the received image or sound.
Next, operation S103 may be performed to collect at least one portion of the image or sound transmitted or received through the at least one second video communication session. In response to the output of the received image or sound, the input interface 201 of the second terminal 210 receives the feedback indicating that the output image or sound does not contain an abusive element from the user of the second terminal 210. The storage 202 of the second terminal 210 may collect the image or sound output when the feedback is received, as an image or sound corresponding to s non-abusive user.
Further, in response to the output of the received image or sound, the input interface 201 of the second terminal 210 may receive the feedback indicating that the output image or sound contains an abusive element from the user of the second terminal 210. For example, when an image or sound including an abusive element is output, the user of the second terminal 210 may touch a report button displayed on a touch screen. The storage 202 of the second terminal 210 may collect the image or sound output when the report button was touched, as an image or sound corresponding to an abusive user.
Referring again to
For example, the controller 205 may train the machine learning model using a deep learning algorithm. The machine learning model may include at least one of deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), region-based convolutional neural networks (R-CNN), restricted Boltzmann machine (RBM), deep belief network (DBN), or deep Q-networks.
The machine learning model may be convolutional neural network (CNN). The machine learning model may include AlexNet, ZFNet, GoogLeNet, VGGNet, ResNet, Inception-ResNet, Inception-v2, Inception-v3, or Inception-v4.
The controller 205 may convert each of the at least one image into an RGB format image having a width of 60 pixels and a height of 80 pixels using a convolutional layer. The controller 205 may train the machine learning model including Inception-v4 using each of the transformed images. The trained model may include total 4,330,627 variables. The size of each variable may be 4 bytes. Thus, the size of the trained model may be at least 17,322,508 bytes.
Referring again to
Next, operation 120 may be performed to consecutively receive images or sounds from the first terminal 200 through the first video communication session. The communication interface 203 of the second terminal 210 may consecutively receive images or sounds through the first video communication session. The communication interface 203 may receive a data stream including an encoded image or sound from the first terminal 200. The controller 205 of the second terminal 210 may decode the received encoded image or sound.
Next, operation S130 may be performed to consecutively output the received images or sounds. The display included in the output interface 204 of the second terminal 210 may consecutively show the received image. The output interface 204 may display images of the surrounding area of the second terminal 210, being consecutively captured by the camera included in the input interface 201 of the second terminal 210 together with the received image.
Each of
The speaker included in the output interface 204 of the second terminal 210 may consecutively reproduce the received sounds. The output interface 204 may reproduce sounds in the surrounding area of the second terminal 210, being consecutively recorded by the microphone included in the input interface 201 of the second terminal 210 together with the received sounds.
According to another embodiment, in operation S130, consecutively outputting the received images or sounds may be excluded. Alternatively, after operation S140 of examining at least a portion of images or sounds received in a period of recent specific time, the control interface 205 of the second terminal 210 may control the output interface 204 according to a result of the examination so that the received images or sounds is consecutively output.
Referring again to
The controller 205 may examine all of the images or sounds received in a period of the recent specific time. When the images are being received at 30 frames per second (FPS), the controller 205 may examine all 30 images received for recent one second.
The controller 205 may select a portion of the images or sounds received in a period of the recent specific time. The controller 205 may check the selected portion of the images or sounds. For example, the controller 205 may arbitrarily select one image among the 30 images received for recent one second. The controller 205 may examine the selected single image. As another example, the controller 205 may examine an image of the user of the first terminal 200 displayed in the remaining area except for the rectangular area positioned at the lower left of the display in
The controller 205 may detect a specific portion from at least a portion of the image received in a period of the recent specific time. The controller 205 may detect a portion corresponding to a specific facial expression, body language, or body part as the specific portion. For example, the controller 205 may detect a portion corresponding to at least one of an obscene gesture, an insult gesture, a racism gesture, sexual content, nudity, genitalia, sexual activity, unsanitary content, excreta, excretion, antisocial content, antihuman content, illegal conduct, criminal conduct, hate crime, violent conduct, maltreatment conduct, self-harmful conduct, a weapon, a drug, an antisocial symbol, hateful content, threatening content, phobia-inducing content, or blood.
The controller 205 may detect a specific portion from at least one portion of the images received in a period of the recent specific time. The controller 205 may detect a portion corresponding to a specific voice or language. For example, the controller 205 may detect a portion corresponding to at least one of an obscene gesture, an insult gesture, a racism gesture, defamation, obscenity, sexual harassment, antisocial conduct, antihuman conduct, terrorism, hate speech, violence, maltreatment, a drug, or threatening.
The controller 205 of the second terminal 210 may calculate whether the user of the first terminal 200 is an abusive user by detecting the specific portion. When the specific portion is detected from the image or sound which is the examination object, the controller 205 may determine that the user of the first terminal 200 is an abusive user. When the specific portion is not detected from the image or sound which is the examination object, the controller 205 may determine that the user of the first terminal 200 is a non-abusive user.
According to another embodiment, the controller 205 may calculate whether the user of the first terminal 200 is an abusive user using information on the prepared correlation and the at least a portion of the images or sounds received in a period of the recent specific time. The controller 205 may extract a feature included in the at least a portion of the images or sounds received in a period of the recent specific time. The controller 205 may calculate whether the user of the first terminal 200 is an abusive user using the extracted feature and the information on the prepared correlation.
For example, the information on the prepared correlation may include the list. The controller 205 may compare a feature corresponding to at least one item included in the list and the extracted feature with each other. When one among features corresponding to the at least one item is the same as the extracted feature, the controller 205 may determine that the image or sound to be examined includes an abusive element. Further, the controller 205 may determine that the user of the first terminal 200 is an abusive user.
As another example, the information on the prepared correlation may include the table. The controller 205 may compare the extracted feature with the feature corresponding to at least one record included in the table. If information indicating that a record corresponding to the extracted feature is included in the records included in the table and that the extracted feature corresponds to an abusive element is included in the record, it may be determined that the image or sound includes an abusive element. Further, the controller 205 may determine that the user of the first terminal 200 is an abusive user.
As another example, the information on the prepared correlation may include the machine learning model. The controller 205 may predict whether the user of the first terminal 200 is an abusive user using the prepared machine learning model and the at least a portion of the images or sounds received in a period of the recent specific time.
For example, the controller 205 may convert an image subjected to the examination into an RGB format image having a width of 60 pixels and a height of 80 pixels using a convolutional layer. The controller 205 may use the converted image as an input value of the machine learning model. The controller 205 may run the machine learning model.
As the result of the running as described above, the result value may be calculated from the output layer of the machine learning model. The result value may be, for example, a vector including three numerical values. The three numerical values, respectively, may correspond to the probability that the image to be examined does not include an abusive element, the probability that the image to be examined includes an abusive element, and the probability that the image to be examined includes the appearance of a user of the first terminal 200, who has taken off his or her clothes that the user wear on the upper part of the body. The sum of the three numerical values may be one.
When the greatest value is the first numeric value among the three numeric values, the controller 205 may determine that the user of the first terminal 200 is a non-abusive user. For example, in
When the greatest value is the second or the third numeric value among the three numeric values, the controller 205 may determine that the user of the first terminal 200 is an abusive user. For example, in
Referring again to
According to another embodiment, the operation S150 of repeating may be excluded.
Next, operation S160 may be performed to block the output of at least a portion of the received image or sound or to report the user of the first terminal 200 as an abusive user to the server 100 according to the result of the examination. When the user of the first terminal 200 is determined to be a non-abusive user, the controller may control the output interface 204 to consecutively output the received image or sound.
When the user of the first terminal 200 is determined to be an abusive user, the controller 205 may control the output interface 204 to block the at least a portion of the received image or sound. According to another embodiment, when the user of the first terminal 200 is determined to be an abusive user, the controller 205 may control the communication interface 203 to report the user of the first terminal 200 as an abusive user to the server 100. According to still another embodiment, when the user of the first terminal 200 is determined to be an abusive user, the at least a portion of the received image or sound may be blocked, and the user of the first terminal 200 may be reported as an abusive user to the server 100.
According to another embodiment, when the cumulative number of times that the specific portion is detected after establishing the first video communication session is a first number of times or more, the controller 205 may control the output interface 204 to block the output of the at least a portion or the communication interface 205 to report the user of the first terminal 200 as an abusive user. The first number of times may be, for example, one or five times. According to still another embodiment, when the cumulative number of times that the user of the first terminal 200 is determined to be an abusive user after establishing the first video communication session is the first number of times or more, the controller 205 may control the output interface 204 to block the output of the at least a portion or the communication interface 203 to report the user of the first terminal 200 as an abusive user.
According to still another embodiment, the number of times that the specific portion is consecutively detected is a second number of times or more, the controller 205 may control the output interface 204 to block the output of the at least a portion or the communication interface 205 to report the user of the first terminal 200 as an abusive user. The second number of times may be, for example, one or five times. According to yet another embodiment, when the cumulative number of times that the user of the first terminal 200 is consecutively determined to be an abusive user is the second number of times or more, the controller 205 may control the output interface 204 to block the output of the at least a portion or the communication interface 203 to report the user of the first terminal 200 as an abusive user.
As described above, only when the cumulative number of times or the consecutively determined number of times is a specific number of times or more, the output is blocked or the user of the first terminal 200 is reported, thereby tolerating intermittent errors of the determination that may occur in the result of the examination. Therefore, more stable operation of the second terminal 210 may further be ensured.
Next, operation S170 may be performed to repeat the operation S140 of examining or the operation S160 of blocking or reporting with regular or irregular cycles. For example, after the controller 205 performed the latest operation S140 of examining or the latest operation S160 of blocking or reporting, the operation S140 of examining or operation S160 of blocking or reporting may be repeated after at least 10 seconds have elapsed. Therefore, it may be consistently examined whether the images or sounds which the first terminal 200 consecutively transmits may include an abusive element.
According to the embodiment as described above, a user in a video communication may be prevented from being exposed to an inappropriate image or sound from the other party. Further, a user in a video communication may be prevented from feeling sexual shame or discomfort. Further, a healthy video communication between users can be induced.
The storage 202 of the first terminal 200 may prepare information on the correlation. The storage 202 of the first terminal 200 may prepare at least one of a list, a table, a database, or a machine learning model including information on the correlation.
The storage 202 of the first terminal 200 may prepare a machine learning model corresponding to the correlation. The communication interface 203 of the first terminal 200 may receive the machine learning model from the server 100 or a separate server. The storage 202 of the first terminal 200 may store the received machine learning model. According to another embodiment, the controller 205 of the first terminal 200 may train the machine learning model by itself, and the storage 202 of the first terminal 200 may store the trained machine learning model.
The storage 202 of the first terminal 200 may prepare at least one image or sound corresponding to a non-abusive user or an abusive user. The controller 205 of the first terminal 200 may train the machine learning model using the at least one image or sound and information on whether each of the at least one image or sound corresponds to an abusive user.
Next, operation S210 may be performed to establish a video communication session between the first terminal 200 and the second terminal 210. The communication interface 203 of the first terminal 200 may establish a video communication session with the second terminal 210.
Next, operation S220 may be performed in which the first terminal 200 consecutively captures an image of the surrounding area of the first terminal 200 or consecutively records a sound from the surrounding area. The camera included in the input interface 201 of the first terminal 200 may consecutively capture an image of the surrounding area of the first terminal 200. The microphone included in the input interface 201 of the first terminal 200 may consecutively record the sound from the surrounding area. The storage 202 of the first terminal 200 may store the captured image or the recorded sound.
Next, operation S230 may be performed in which the first terminal 200 consecutively transmits the captured images or recorded sounds to the second terminal 210 through the video communication session. The communication interface 203 of the first terminal 200 may consecutively transmit the captured images or recorded sounds. Further, at the same time, the communication interface 203 may consecutively receive images or sounds from the second terminal 210. The output interface 204 may display the captured images together with the received images. The output interface 204 may reproduce the recorded sounds together with the received sounds.
According to another embodiment, the operation S230 of consecutively transmitting the captured images or the recorded sounds may be excluded. Alternatively, after the operation S240 of examining at least a portion of the captured images or the recorded sounds in a period of the recent specific time is performed, the controller 205 of the first terminal 200 may control the communication interface 203 according to the result of the examination to consecutively transmit the captured images or the recorded sounds.
Next, operation S240 may be performed in which the first terminal 200 examines at least a portion of the images captured or sounds recorded in a period of the recent specific time among the captured images or the recorded sounds. The controller 205 of the first terminal 200 may detect a specific portion from the at least a portion of the images captured or sounds recorded in a period of the recent specific time. The specific time may be, for example, one second.
The controller 205 may predict whether the user of the first terminal 200 is an abusive user using the prepared machine learning model and the at least a portion of the images captured or sounds recorded in a period of the recent specific time. For example, the controller 205 may convert an image which is the examination object into an RGB format image having a width of 60 pixels and a height of 80 pixels using a convolutional layer. The controller 205 may use the converted image as an input value of the machine learning model. The controller 205 may run the machine learning model.
As the result of the operation of running as described above, the result value may be calculated from the output layer of the machine learning model. The result value may be, for example, a vector including three numerical values. The three numerical values, respectively, may correspond to the probability that the image to be examined does not include an abusive element, the probability that the image to be examined includes an abusive element, and the probability that the image to be examined includes the appearance of a user, who has taken off his or her clothes that the user wear on the upper part of the body, of the first terminal 200. The sum of the three numerical values may be one.
When the greatest value is the first numeric value among the three numeric values, the controller 205 may determine that the user of the first terminal 200 is a non-abusive user. For example, in
When the greatest value is the second or the third numeric value among the three numeric values, the controller 205 may determine that the user of the first terminal 200 is an abusive user.
Next, operation S250 may be performed in which the first terminal 200 repeats the operation S240 of examining at least one time. The controller 205 of the first terminal 200 may perform an examination on an image or sound received later than the image or sound that is the object of the latest examination after performing the latest examination. For example, the controller 205 may further perform four examinations after performing the first examination. In other words, the controller 205 may examine each of the five images or sounds received at an interval of one second from each other. Each result of the examinations may be accumulated. For example, when a portion corresponding to an abusive element is detected in each of five images, the cumulative number of times may be five.
According to another embodiment, the operation S250 of repeating may be excluded.
Next, operation S260 may be performed in which the first terminal 200 blocks the transmission of the at least a portion of the captured image or the recorded sound through a video communication session or reports the user of the first terminal 200 as an abusive user to the server 100 according to the result of the examination.
When the user of the first terminal 200 is determined to be a non-abusive user, the controller may control the communication interface 203 to consecutively transmit the captured images or the recorded sounds.
When the user of the first terminal 200 is determined to be an abusive user, the controller 205 may control the communication interface 203 to block the transmission of the at least a portion of the captured images or the recorded sounds. According to another embodiment, when the user of the first terminal 200 is determined to be an abusive user, the controller 205 may control the communication interface 203 to report the user of the first terminal 200 as an abusive user to the server 100. According to still another embodiment, when the user of the first terminal 200 is determined to be an abusive user, the transmission of the at least a portion of the captured images or the recorded sounds may be blocked, and the user of the first terminal 200 may be reported as an abusive user to the server 100.
According to another embodiment, when the cumulative number of times that the specific portion is detected after establishing the video communication session is a first number of times or more, the controller 205 may control the communication interface 203 to block the transmission of the at least a portion or to report the user of the first terminal 200 as an abusive user. The first number of times may be, for example, one or five times. According to still another embodiment, when the cumulative number of times that the user of the first terminal 200 is determined to be an abusive user after establishing the video communication session is the first number of times or more, the controller 205 may control the communication interface 203 to block the output of the at least a portion or to report the user of the first terminal 200 as an abusive user.
According to still another embodiment, the number of times that the specific portion is consecutively detected is a second number of times or more, the controller 205 may control the communication interface 203 to block the transmission of the at least a portion or to report the user of the first terminal 200 as an abusive user. The second number of times may be, for example, one or five times. According to yet another embodiment, when the cumulative the number of times that the user of the first terminal 200 is consecutively determined to be an abusive user is the second number of times or more, the controller 205 may control the communication interface 203 to block the transmission of the at least a portion or to report the user of the first terminal 200 as an abusive user.
As described above, only when the cumulative number of times or the consecutively determined number of times is a specific number of times or more, the transmission is blocked or the user of the first terminal 200 is reported, thereby tolerating intermittent errors of the determination that may occur in the result of the examination. Therefore, more stable operation of the first terminal 200 may further be ensured.
Next, operation S270 may be performed that the first terminal 200 repeats the operation S240 of examining or the operation S260 of blocking or reporting with regular or irregular cycles. For example, after the controller 205 performed the latest operation S140 of examining or the latest operation S160 of blocking or reporting, the operation S140 of examining or the operation S160 of blocking or reporting may be repeated after at least 10 seconds have elapsed. Therefore, it may be consistently examined whether the images or sounds which the first terminal 200 consecutively transmits may include an abusive element.
According to the embodiment as described above, a user in a video communication may be prevented from being exposed to an inappropriate image or sound from the other party. Further, a healthy video communication between users can be induced.
Next, operation S310 may be performed that the server 100 may mediate a video communication connection between the first terminal 200 and the second terminal 210 among the plurality of terminals. The server 100 may select the first terminal 200 and the second terminal 210 among the plurality of terminals. The server 100 may mediate a video communication connection between the selected first terminal 200 and second terminal 210. For example, the server 100 may transmit information on the connection for the first terminal 200 to the second terminal 210. As another example, the server 100 may transmit information on the connection for the second terminal 210 to the first terminal 200.
Next, operation S320 may be performed that the server 100 receives the report, from the first terminal 200, indicating that a user of the first terminal 200 or a user of the second terminal 210 is an abusive user as the result of the examination on, by the first terminal 200, an image of the surrounding area of the first terminal 200, captured by the first terminal 200, a sound from the surrounding area of the first terminal 200, recorded by the first terminal 200, an image received from the second terminal 210, or a sound received from the second terminal 210.
The first terminal 200 may examine the image captured or the sound recorded by the first terminal 200. When it is determined that the user of the first terminal 200 is an abusive user, the first terminal 200 may transmit the report indicating that the user of the first terminal 200 is an abusive user to the server 100.
Further, the terminal 200 may examine the image captured or the sound received from the second terminal 210. When the user of the second terminal 210 is determined to be an abusive user as the result of the examination, the first terminal may transmit the report indicating that the user of the second terminal 210 is an abusive user to the server 100.
Next, operation S330 may be performed that the server 100 mediates a video communication connection between the terminal of the reported user and the terminal of a monitoring agent in response to the report. For example, it is assumed that the report indicating that the user of the first terminal 200 is an abusive user is received from the first terminal 200. The server 100 may mediates a video communication connection between the first terminal 100 and the third terminal 300 in response to the report. The third terminal 300 may be a terminal of a monitoring agent. In other words, the user of the third terminal 300 may be a monitoring agent.
Next, operation S340 may be performed that the server 100 receives the result of verification on the reported user from the terminal of the monitoring agent. The user of the third terminal 300 may input information on whether the user of the first terminal 200 is an abusive user after making a video communication with the user of the first terminal 200. The third terminal 300 may transmit the input information as the result of the verification on the user of the first terminal 200.
Next, operation S350 may be performed that the server 100 rejects the additional mediation request from the terminal of the reported user according to the received result of the verification. When it is verified that the user of the first terminal 200 is not an abusive user, the server 100 may mediate a video call connection between the first terminal 200 and other terminal in response to the additional mediation request from the first terminal 200. When it is verified that the user of the first terminal 200 is an abusive user, the server 100 may reject the additional mediation request from the first terminal 200.
According to the embodiment as described above, a video call mediation request from a terminal of a user who is verified as an abusive user may be rejected, so that a healthy video communication between users is induced.
According to the embodiment as described above, a user in a video communication may be prevented from being exposed to an inappropriate image or sound from the other party. Further, a user in a video communication may be prevented from transmitting an inappropriate image or sound to the other party. Further, a user in a video communication may be prevented from feeling sexual shame or discomfort due to the image or sound of the other party. Further, a healthy video communication between users can be induced.
The embodiment as described above may be embodied in a non-transitory computer-readable recording medium having recorded thereon computer-executable instruction codes, such as a program module executable by the computer. The non-transitory computer-readable recording medium may be any available medium which can be accessed by the computer and may include any volatile and non-volatile media and any removable and non-removable media.
Furthermore, the non-transitory computer-readable recording medium may include any computer storage medium and communication medium. The computer storage medium may include any volatile and non-volatile media or any removable and non-removable media embodied by a certain method or technology for storing information such as computer-readable instruction codes, a data structure, a program module, or other data. The communication medium may include computer-readable instruction code, a data structure, a program module, other data of modulated data signals, or other transmission mechanisms, and may include any information transmission medium.
It should be understood that embodiments described herein should be considered in a descriptive sense only and not for purposes of limitation. Descriptions of features or aspects within each embodiment should typically be considered as available for other similar features or aspects in other embodiments.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2017-0048893 | Apr 2017 | KR | national |
This application is a continuation of U.S. application Ser. No. 17/183,890, filed Feb. 24, 2021, which is a continuation of U.S. application Ser. No. 16/605,657, filed Oct. 16, 2019, which is a National Stage of International Application No. PCT/KR2018/000787 filed Jan. 17, 2018, claiming priority based on Korean Patent Application No. 10-2017-0048893 filed Apr. 17, 2017.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6590601 | Sukeno et al. | Jul 2003 | B2 |
| 7321384 | Wu et al. | Jan 2008 | B1 |
| 7444403 | Packer et al. | Oct 2008 | B1 |
| 7564476 | Coughlan et al. | Jul 2009 | B1 |
| 8165416 | Cutler | Apr 2012 | B2 |
| 8441356 | Tedesco et al. | May 2013 | B1 |
| 8626879 | Dham et al. | Jan 2014 | B2 |
| 8826322 | Bliss et al. | Sep 2014 | B2 |
| 8856165 | Cierniak | Oct 2014 | B1 |
| 8977063 | Lee et al. | Mar 2015 | B2 |
| 9225897 | Sehn | Dec 2015 | B1 |
| 9230328 | Wotzlaw | Jan 2016 | B1 |
| 9282287 | Marsh | Mar 2016 | B1 |
| 9319632 | Kim et al. | Apr 2016 | B2 |
| 9380264 | Vakalapudi | Jun 2016 | B1 |
| 9460340 | Kauffmann et al. | Oct 2016 | B2 |
| 9503456 | Lindberg et al. | Nov 2016 | B1 |
| 9569697 | Mcnerney et al. | Feb 2017 | B1 |
| 9591261 | Suzuki et al. | Mar 2017 | B2 |
| 9716599 | Gates et al. | Jul 2017 | B1 |
| 9792710 | Kimura | Oct 2017 | B2 |
| 9848167 | Christian et al. | Dec 2017 | B1 |
| 10021344 | Farrell et al. | Jul 2018 | B2 |
| 10084988 | Farrell et al. | Sep 2018 | B2 |
| 10127195 | Bliss et al. | Nov 2018 | B2 |
| 10574941 | Ahn et al. | Feb 2020 | B2 |
| 10791261 | Oyman et al. | Sep 2020 | B2 |
| 10855933 | Ahn et al. | Dec 2020 | B2 |
| 10965907 | Ahn et al. | Mar 2021 | B2 |
| 11080325 | Ahn et al. | Aug 2021 | B2 |
| 11102450 | Ahn et al. | Aug 2021 | B2 |
| 11140356 | Ahn et al. | Oct 2021 | B2 |
| 11184582 | Ahn et al. | Nov 2021 | B2 |
| 11206362 | Ahn | Dec 2021 | B2 |
| 11252374 | Lichtenberg et al. | Feb 2022 | B1 |
| 11323659 | Ahn et al. | May 2022 | B2 |
| 11394922 | Ahn et al. | Jul 2022 | B2 |
| 11496709 | Ahn et al. | Nov 2022 | B2 |
| 11553157 | Ahn et al. | Jan 2023 | B2 |
| 20030028875 | Piotrowski | Feb 2003 | A1 |
| 20030091239 | Imagawa et al. | May 2003 | A1 |
| 20030126267 | Gutta et al. | Jul 2003 | A1 |
| 20040049780 | Gee | Mar 2004 | A1 |
| 20070195158 | Kies | Aug 2007 | A1 |
| 20080012935 | Echtenkamp | Jan 2008 | A1 |
| 20080059198 | Maislos et al. | Mar 2008 | A1 |
| 20080259154 | Garrison et al. | Oct 2008 | A1 |
| 20080294439 | Kirby | Nov 2008 | A1 |
| 20080298571 | Kurtz et al. | Dec 2008 | A1 |
| 20090041311 | Hundley | Feb 2009 | A1 |
| 20090049467 | Robson et al. | Feb 2009 | A1 |
| 20090219146 | Vandenburgh et al. | Sep 2009 | A1 |
| 20090288131 | Kandekar et al. | Nov 2009 | A1 |
| 20100017818 | Joshi et al. | Jan 2010 | A1 |
| 20100054592 | Nanu et al. | Mar 2010 | A1 |
| 20100124941 | Cho | May 2010 | A1 |
| 20100175129 | Poddy et al. | Jul 2010 | A1 |
| 20100226261 | Piché | Sep 2010 | A1 |
| 20110184982 | Adamousky et al. | Jul 2011 | A1 |
| 20120155759 | Kang et al. | Jun 2012 | A1 |
| 20120182379 | Ding | Jul 2012 | A1 |
| 20120320141 | Bowen et al. | Dec 2012 | A1 |
| 20130083155 | Andresen | Apr 2013 | A1 |
| 20130147897 | Ichimura et al. | Jun 2013 | A1 |
| 20130234826 | Sekiguchi et al. | Sep 2013 | A1 |
| 20130342633 | Ikeda et al. | Dec 2013 | A1 |
| 20140176732 | Cohen et al. | Jun 2014 | A1 |
| 20140267583 | Zhu et al. | Sep 2014 | A1 |
| 20150030314 | Skarakis | Jan 2015 | A1 |
| 20150070516 | Shoemake et al. | Mar 2015 | A1 |
| 20150220777 | Kauffmann et al. | Aug 2015 | A1 |
| 20150229882 | Liu | Aug 2015 | A1 |
| 20150286858 | Shaburov et al. | Oct 2015 | A1 |
| 20150325023 | Gross | Nov 2015 | A1 |
| 20150370474 | Belaunde et al. | Dec 2015 | A1 |
| 20160019412 | Kang et al. | Jan 2016 | A1 |
| 20160023116 | Wire et al. | Jan 2016 | A1 |
| 20160034786 | Suri et al. | Feb 2016 | A1 |
| 20160127653 | Lee et al. | May 2016 | A1 |
| 20160316265 | Gopalan et al. | Oct 2016 | A1 |
| 20160350675 | Laks et al. | Dec 2016 | A1 |
| 20160373571 | Woolsey et al. | Dec 2016 | A1 |
| 20170061248 | Ryan, Jr. | Mar 2017 | A1 |
| 20170251336 | Keller | Aug 2017 | A1 |
| 20170289624 | Avila | Oct 2017 | A1 |
| 20170339081 | Beust | Nov 2017 | A1 |
| 20180027042 | Kim | Jan 2018 | A1 |
| 20180103234 | Ahn et al. | Apr 2018 | A1 |
| 20180176641 | Yun et al. | Jun 2018 | A1 |
| 20180213364 | Segal et al. | Jul 2018 | A1 |
| 20180260577 | Adams et al. | Sep 2018 | A1 |
| 20180309801 | Rathod | Oct 2018 | A1 |
| 20180316892 | Jeong et al. | Nov 2018 | A1 |
| 20180335908 | Kim et al. | Nov 2018 | A1 |
| 20190188453 | Ahn et al. | Jun 2019 | A1 |
| 20190199963 | Ahn et al. | Jun 2019 | A1 |
| 20190238759 | Ahn | Aug 2019 | A1 |
| 20190251118 | Ahn et al. | Aug 2019 | A1 |
| 20190266444 | Ryan, Jr. et al. | Aug 2019 | A1 |
| 20190342246 | Theriault et al. | Nov 2019 | A1 |
| 20200021623 | Nevick et al. | Jan 2020 | A1 |
| 20200137352 | Ahn et al. | Apr 2020 | A1 |
| 20200145613 | Ahn et al. | May 2020 | A1 |
| 20200213530 | Ahn | Jul 2020 | A1 |
| 20200242750 | Kokkula et al. | Jul 2020 | A1 |
| 20200335090 | Freed et al. | Oct 2020 | A1 |
| 20200358904 | Ahn et al. | Nov 2020 | A1 |
| 20210037271 | Bikumala | Feb 2021 | A1 |
| 20210099672 | Ahn et al. | Apr 2021 | A1 |
| 20210203880 | Ahn et al. | Jul 2021 | A1 |
| 20210203882 | Ahn et al. | Jul 2021 | A1 |
| 20210243407 | Ahn et al. | Aug 2021 | A1 |
| 20210243408 | Ahn et al. | Aug 2021 | A1 |
| 20220229488 | Akimoto et al. | Jul 2022 | A1 |
| 20220353464 | Ahn et al. | Nov 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 2515526 | Oct 2012 | EP |
| 2782326 | Sep 2014 | EP |
| 3035283 | Jun 2016 | EP |
| 3800879 | Apr 2021 | EP |
| H0690279 | Mar 1994 | JP |
| H09200714 | Jul 1997 | JP |
| 2001309325 | Nov 2001 | JP |
| 2003219383 | Jul 2003 | JP |
| 2004532581 | Oct 2004 | JP |
| 2006270380 | Oct 2006 | JP |
| 2008159034 | Jul 2008 | JP |
| 2011082694 | Apr 2011 | JP |
| 2011205243 | Oct 2011 | JP |
| 2012018571 | Jan 2012 | JP |
| 2012054897 | Mar 2012 | JP |
| 2012146209 | Aug 2012 | JP |
| 2013531923 | Aug 2013 | JP |
| 2016122975 | Jul 2016 | JP |
| 2017228224 | Dec 2017 | JP |
| 2019047357 | Mar 2019 | JP |
| 2020010158 | Jan 2020 | JP |
| 2020500488 | Jan 2020 | JP |
| 20010000426 | Jan 2001 | KR |
| 20040064972 | Jul 2004 | KR |
| 100844334 | Jul 2008 | KR |
| 20080110064 | Dec 2008 | KR |
| 20110019499 | Feb 2011 | KR |
| 20110025720 | Mar 2011 | KR |
| 20110073238 | Jun 2011 | KR |
| 20120090870 | Aug 2012 | KR |
| 20120126677 | Nov 2012 | KR |
| 20140012474 | Feb 2014 | KR |
| 20150087362 | Jul 2015 | KR |
| 20180000255 | Jan 2018 | KR |
| 20180116520 | Oct 2018 | KR |
| 20190007934 | Jan 2019 | KR |
| 20190016671 | Feb 2019 | KR |
| 101989842 | Jun 2019 | KR |
| 2012131932 | Oct 2012 | WO |
| 2014100774 | Jun 2014 | WO |
| 2015091487 | Jun 2015 | WO |
| 2015162647 | Oct 2015 | WO |
| 2016112299 | Jul 2016 | WO |
| 2018194243 | Oct 2018 | WO |
| 2018221824 | Dec 2018 | WO |
| Entry |
|---|
| Communication for Korean Patent Application No. 10-2017-0048893, dated Apr. 16, 2018, 9 Pgs. |
| Communication in European Patent Office in Application No. 20173922.4, dated Oct. 9, 2020, 7 Pgs. |
| Communication in Korean Patent Office in Application No. 10-2018-0174192, dated Nov. 25, 2019, 9 Pgs. |
| Communication in Korean Patent Office in Application No. 10-2019-0054670, dated Apr. 21, 2020, 11 Pgs. |
| Extended European Search Report for Application No. 18213173.0, dated May 7, 2019, 8 Pgs. |
| Extended European Search Report for European Application No. 19156400.4, Search completed Apr. 11, 2019, dated Apr. 24, 2019, 11 Pgs. |
| Extended European Search Report for European Application No. 20199235.1, Search completed Feb. 10, 2021, dated Feb. 19, 2021, 7 Pgs. |
| Extended European Search Report for European Application No. 21154225.3, Search completed Apr. 20, 2021, dated Apr. 29, 2021, 7 Pgs. |
| Extended Search Report for European Application No. 17859740.7, Search completed Sep. 16, 2019, dated Sep. 24, 2019, 10 Pgs. |
| Extended Search Report for European Application No. 21154208.9, Search completed May 21, 2021, dated Jun. 4, 2021, 9 Pgs. |
| International Search Report and Written Opinion for International Application No. PCT/KR2018/000787, Search completed Apr. 26, 2018, dated Apr. 26, 2018, 12 Pgs. |
| International Search Report dated Jan. 18, 2018 in International Application No. PCT/KR2017/011139, 3 pages. |
| Korean Office Action for Application No. 10-2017-0181512, dated Mar. 8, 2019, 8 Pgs. |
| Korean Office Action for Application No. 10-2019-0121524, dated Sep. 22, 2020, 9 Pgs. |
| Korean Office Action of KR 10-2020-0012270 dated Nov. 30, 2020, 6 pgs. |
| Office Action dated Aug. 29, 2017 of Korean Patent Application No. 10-2016-0130656 which is the parent Application—6 pages. |
| Office Action dated Feb. 14, 2017 of Korean Patent Application No. 10-2016-0130656 which is the parent Application—5 pages. |
| Office Action for Japanese Patent Application No. 2020-165934 dated Sep. 24, 2021, 12 pages. |
| Office Action for Japanese Patent Application No. 2021013320 dated Jan. 19, 2022, 6 pgs. |
| Office Action issued from Korean Patent Application No. 10-2020-0012233, dated Nov. 20, 2020, 5 Pgs. |
| Office Action issued in Japanese Patent Application No. 2018-238541, dated Dec. 10, 2019, 12 Pgs. |
| Office Action dated Nov. 30, 2018 in Korean Application No. 10-2018-0134869, in 5 pages. |
| Translation of Office Action dated Jun. 29, 2020 in Japanese Application No. 2019-540499, in 3 pages. |
| Communication issued in Korean Patent Office in Application No. 10-2018-0012389, dated Jul. 31, 2019, 11 Pgs. |
| “Talking To Complete Strangers On Holla App! Awkward” YouTube, Life With Nae, Published Jul. 21, 2018, Available online at hitps://www.youtube.com/watch?v=F9ddBJ4yJZA, 8 pgs. |
| Dou et al., “Coarse-to-Fine Trained Multi-Scale Convolutional Neural Networks for Image Classification”, IEEE, 2015, 7 pgs. |
| Freitas et al., “A Multimodal CNN-Based Tool to Censure Inappropriate Video Scenes”, arXiv:1911.03974v1 [cs.MM], Nov. 10, 2019, 7 pgs. |
| Sood et al., “Automatic Identification of Personal Insults on Social News Sites”, Journal of The American Society for Information Science and Technology, Feb. 1, 2012, vol. 63, No. 2, pp. 270-285. Published Online: Oct. 28, 2011. |
| Xing et al., “SafeVchat: Detecting Obscene Content and Misbehaving Users in Online Video Chat Services”, World Wide Web, ACM, Mar. 28, 2011, pp. 685-694. |
| Office Action for Japanese Patent Application No. 2021013354 dated Mar. 9, 2022, 4 pgs. |
| Number | Date | Country | |
|---|---|---|---|
| 20220239862 A1 | Jul 2022 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17183890 | Feb 2021 | US |
| Child | 17659130 | US | |
| Parent | 16605657 | US | |
| Child | 17183890 | US |
