Patent Application
20130308874
1. Technical Field
Disclosed systems and methods relate in general to providing efficient data communication.
2. Description of the Related Art
Demand of and dependency on computer-operated devices is exponentially increasing on a global scale in both public and private sectors. For example, the popularity of social network platforms headlined by services such as Facebook and Twitter has significantly increased the usage of computer-operated devices, particularly fueling the increase in usage of mobile devices by the general consumer.
In one aspect, due to the increased usage of mobile devices, airwave spectrum availability for communication usage between mobile computer-operated devices has rapidly been consumed. It is projected that the availability of the airwave spectrum for internet and telecommunication use will fall into a substantial shortage by 2013. This bandwidth shortage will ultimately limit the current freedom of web based communication as the current infrastructure will no longer be able to meet the demands of the population. In fact, more particularly, Internet and telecommunication providers and web based service providers are already encountering insufficient capacity to store the enormous amount of data in a memory that are required to maintain their services as the demand for high resolution imagery increases, especially on mobile platforms. To combat the insufficiency of the current infrastructure of computer networking systems and data storage, the information technology (IT) industry is faced with the inevitable choice of improving the current infrastructure by increasing data bandwidth and data storage capacities, reducing the stress on the infrastructure, or both.
Yet in another aspect, the full potential of computer-operated devices has not been fully exploited. One of the reasons is the lack of intuitive user interface. Some classes of consumers are still hindered from adopting new technologies and leveraging computer-operated devices because the user interface for operating the computer-operated devices is cumbersome, if not difficult to use. For example, the existing user interfaces do not allow a blind person to appreciate visual media, and they do not allow a hearing impaired person to appreciate audio media. Therefore, the IT industry is also faced with the task of improving user interfaces to accommodate a larger set of consumers.
Embodiments of the present invention address the challenges faced by the IT industry. One of the embodiments of the present invention includes a software application called the KasahComm application. The KasahComm application allows a user to interact with digital data in an effective and intuitive manner. Furthermore, the KasahComm application allows efficient communication between users using efficient data representations for data communication.
The disclosed subject matter includes a method of communicating by a computing device over a communication network. The method includes receiving, by a processor in the computing device, image data, applying, by the processor, a low-pass filter associated with a predetermined parameter on at least a portion of the image data to generate blurred image data, and compressing, by the processor, the blurred image data using an image compression system to generate compressed blurred image data. Furthermore, the method also includes sending, by the processor, the compressed blurred image data over the communication network, thereby consuming less data transmission capacity compared with sending the image data over the communication network.
The disclosed subject matter includes an apparatus for providing communication over a communication network. The apparatus can include a non-transitory memory storing computer readable instructions, and a processor in communication with the memory. The computer readable instructions are configured to cause the processor to receive image data, apply a low-pass filter associated with a predetermined parameter on at least a portion of the image data to generate blurred image data, compress the blurred image data using an image compression system to generate compressed blurred image data, and send the compressed blurred image data over the communication network, thereby consuming less data transmission capacity compared with sending the image data over the communication network.
The disclosed subject matter includes non-transitory computer readable medium. The computer readable medium includes computer readable instructions operable to cause an apparatus to receive image data, apply a low-pass filter associated with a predetermined parameter on at least a portion of the image data to generate blurred image data, compress the blurred image data using an image compression system to generate compressed blurred image data, and send the compressed blurred image data over the communication network, thereby consuming less data transmission capacity compared with sending the image data over the communication network.
In one aspect, the image data includes data indicative of an original image and overlay layer information.
In one aspect, the overlay layer information is indicative of modifications made to the original image.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for applying the low-pass filter on the data indicative of original image.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for sending an image container over the communication network, where the image container includes the compressed blurred image data and the overlay layer information.
In one aspect, access to the original image is protected using a password, and the image container includes the password for accessing the original image.
In one aspect, the modifications made to the original image includes a line overlaid on the original image.
In one aspect, the modifications made to the original image includes a stamp overlaid on the original image.
In one aspect, the original image includes a map.
In one aspect, the low-pass filter includes a Gaussian filter and the predetermined parameter includes a standard deviation of the Gaussian filter.
The disclosed subject matter includes a method for sending an electronic message over a communication network using a computing device having a location service setting. The method can include identifying, by a processor in the computing device, an emergency contact to be contacted in an emergency situation, in response to the identification, overriding, by the processor, the location service setting of the computing device with a predetermined location service setting that enables the computing device to transmit location information of the computing device, and sending, by the processor, the electronic message, including the location information of the computing device, over the communication network.
The disclosed subject matter includes an apparatus for providing communication over a communication network. The apparatus can include a non-transitory memory storing computer readable instructions, and a processor in communication with the memory. The computer readable instructions are configured to identify an emergency contact to be contacted in an emergency situation, in response to the identification, override the location service setting of the computing device with a predetermined location service setting that enables the computing device to transmit location information of the computing device, and send the electronic message, including the location information of the computing device, over the communication network.
The disclosed subject matter includes non-transitory computer readable medium. The computer readable medium includes computer readable instructions operable to cause an apparatus to identify an emergency contact to be contacted in an emergency situation, in response to the identification, override the location service setting of the computing device with a predetermined location service setting that enables the computing device to transmit location information of the computing device, and send the electronic message, including the location information of the computing device, over the communication network.
In one aspect, the location information includes a Global Positioning System coordinate.
The disclosed subject matter includes a method for visualizing audio information using a computer system. The method includes determining, by a processor in the computer system, a pitch profile of the audio information, where the pitch profile includes a plurality of audio frames, identifying, by the processor, an audio frame type associated with one of the plurality of audio frames, determining, by the processor, an image associated with the audio frame type of the one of the plurality of audio frames, and displaying the image on a display device coupled to the processor.
The disclosed subject matter includes an apparatus for visualizing audio information. The apparatus can include a non-transitory memory storing computer readable instructions, and a processor in communication with the memory. The computer readable instructions are configured to determine a pitch profile of the audio information, wherein the pitch profile includes a plurality of audio frames, identify an audio frame type associated with one of the plurality of audio frames, determine an image associated with the audio frame type associated with one of the plurality of audio frames, and display the image on a display coupled to the processor.
The disclosed subject matter includes non-transitory computer readable medium. The computer readable medium includes computer readable instructions operable to cause an apparatus to determine a pitch profile of the audio information, wherein the pitch profile includes a plurality of audio frames, identify an audio frame type associated with one of the plurality of audio frames, determine an image associated with the audio frame type associated with one of the plurality of audio frames, and display the image on a display coupled to the processor.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for measuring changes in pitch levels within the one of the plurality of audio frames.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for measuring: (1) a rate at which the pitch levels change, (2) an amplitude of the pitch levels, (3) a frequency content of the pitch levels, (4) wavelet spectral information of the pitch levels, and (5) a spectral power of the pitch levels.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for identifying one or more repeating sound patterns in the plurality of audio frames.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for comparing pitch levels within the one of the plurality of audio frames to pitch levels associated with different sound sources.
In one aspect, the pitch levels associated with different sound sources are maintained as a plurality of audio fingerprints in an audio database.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for comparing characteristics of the one of the plurality of audio frames with those of the plurality of audio fingerprints.
In one aspect, an audio fingerprint can be based on one or more of: (1) average zero crossing rates associated with the pitch levels of the one of the plurality of audio frames, (2) tempo associated with the pitch levels of the one of the plurality of audio frames, (3) average spectrum associated with the pitch levels of the one of the plurality of audio frames, (4) a spectral flatness associated with the pitch levels of the one of the plurality of audio frames, (5) prominent tones across a set of bands and bandwidth associated with the pitch levels of the one of the plurality of audio frames, and (6) coefficients of encoded pitch levels of the one of the plurality of audio frames.
In one aspect, the method, the apparatus, or the non-transitory computer readable medium can include steps or executable instructions for retrieving, from a non-transitory computer readable medium, an association between the audio frame type and the image.
The foregoing summary is illustrative only and is not intended to be in any way limiting. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will become apparent by reference to the following drawings and the detailed description.
The foregoing and other features of the present disclosure will become more fully apparent from the following description and appended claims, captured in conjunction with the accompanying drawings. Understanding that these drawings depict only several embodiments in accordance with the disclosure and are, therefore, not to be considered limiting in its scope, the disclosure will be described with additional specificity and detail through use of the accompanying drawings.
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. It will be readily understood that the aspects of the present disclosure, as generally described herein, and illustrated in the figures, can be arranged, substituted, combined, and designed in a wide variety of different configurations, all of which are explicitly contemplated and made part of this disclosure.
Embodiments of the present inventions include a software application called the KasahComm application. The KasahComm application is a communication program including executable instructions that enable network communication between computing devices. The KasahComm application can enable computing devices to efficiently transmit and receive digital data, including image data and text data, over a communication network. The KasahComm application also enables users of the computing devices to intuitively interact with digital data.
The computing devices 106 can include non-transitory computer readable medium that includes executable instructions operable to cause the computing device 106 to run the KasahComm application. The KasahComm application can allow the computing devices 106 to communicate over the communication network 102. A computing device 106 can include a desktop computer, a mobile computer, a tablet computer, a cellular device, or any computing systems that is capable of performing computation. The computing device 106 can be configured with one or more processors that process instructions and run instructions that may be stored in non-transitory computer readable medium. The processor also communicates with the non-transitory computer readable medium and interfaces to communicate with other devices. The processor can be any applicable processor such as a system-on-a-chip that combines a central processing unit (CPU), an application processor, and flash memory.
The server 104 can be a single server, or a network of servers, or a farm of servers in a data center. Each computing device 106 can be directly coupled to the server 104; alternatively, each computing device 106 can be connected to server 104 via any other suitable device, communication network, or combination thereof. For example, each computing device 106 can be coupled to the server 104 via one or more routers, switches, access points, and/or communication networks (as described below in connection with communication network 102).
Each computing device 106 can send data to, and receive data from, other computing devices 106 over the communication network 102. Each computing device 106 can also send data to, and receive data from, the server 104 over the communication network 102. Each computing device 106 can send data to, and receive data from, other computing devices 106 via the server 104. In such configurations, the server 104 can operate as a proxy server that relays messages between the computing devices.
The communication network 102 can include a network or combination of networks that can accommodate data communication. For example, the communication network can include a local area network (LAN), a virtual private network (VPN) coupled to the LAN, a private cellular network, a private telephone network, a private computer network, a private packet switching network, a private line switching network, a private wide area network (WAN), a corporate network, a public cellular network, a public telephone network, a public computer network, a public packet switching network, a public line switching network, a public wide area network (WAN), or any other types of networks implementing one of a variety of communication protocols, including Global System for Mobile communication (GSM), Universal Mobile Telecommunications System (UMTS), Long Term Evolution (LTE), and/or IEEE 802.11. Such networks may be implemented with any number of hardware and software components, transmission media and network protocols.
For the purpose of discussion, the foregoing figures illustrate how the disclosed subject matters are embodied in the KasahComm application. However, the disclosed subject matters can be implemented as standalone software applications that are independent of the KasahComm application.
In embodiments, if the user clicks on the “Register” button, the KasahComm application can provide a registration interface.
Once the user is registered and logged in, the KasahComm application can provide the contact interface.
If a user presses the “Add” button, the KasahComm application can provide the “Add a New Contact” interface.
To use the first mechanism for adding new contacts, the user can press the “Use Address Book” button. When the user presses the “Use Address Book” button, the KasahComm application can provide the “Choose Contacts” interface.
In embodiments, the KasahComm application can include a specialized contact list. The specialized contact list can include “Emergency Contacts.”
In embodiments, the KasahComm application can indicate that the user has received a new message via the KasahComm application. For example, the top notification bar can provide the KasahComm application logo.
In embodiments, the KasahComm application can provide the user different mechanisms to interact with the KasahComm application.
Referring to
In embodiments, the KasahComm application allows users to edit images. In particular, the KasahComm application allows users to add one or more of the following to images: hand-written drawings, overlaid text, watermarking, masking, layering, visual effects such as blurs, and preset graphic elements along with the use of a selectable color palette.
When a user selects the stamp icon 1406, the KasahComm application activates the stamp tool to modify the photo using preset image stamps such as circles and arrows.
When a user selects the free-hand line drawing icon 1404, the KasahComm application activates the free-hand line drawing tool to modify the captured photo.
In embodiments, an image editor can use a weighted input device to provide more flexibility in image editing. The weighted input device can include a touch input device with a pressure sensitive mechanism. The input device with a pressure sensitive mechanism can detect the pressure at which the touch input is provided. The input device can include a resistive touch screen, or a stylus. The input device can use the detected pressure to provide additional features. For example, the detected pressure can be equated to a weight of the input. In embodiments, the detected pressure can be proportional to the weight of the input.
The weighted input device can include a input device with a time sensitive mechanism. The time sensitive input mechanism can adjust the weight of the input based on the amount of time during which a force is exerted on the input device. The amount of time during which a force is exerted can be proportional to the weight of the input.
In embodiments, the weighted input device can use both the pressure sensitive mechanism and the time sensitive mechanism to determine the weight of the input. The weight of the input can also be determined based on a plurality of touch inputs. Non-limiting applications of the weighted input device can include controlling the differentiation in color, color saturation, or opacity based on the weighted input.
Oftentimes, an input device, such as a touch screen, uses a base shape to represent a user input. For example, a touch screen would model a finger touch using a base shape. The base shape can include one of a circle, a triangle, a square, any other polygons or shapes, and any combinations thereof. The input device often represents a user input using a predetermined base shape.
Unfortunately, a predetermined base shape can limit the flexibility of a user input. For example, different fingers can have a different finger size or a different finger shape, and these differences cannot be captured using a predetermined base shape. This can result in a non-intuitive user experience in which a line drawn with a finger is not in the shape or size of the finger, but in the selected “base shape.” This can be visualized by comparing a line drawn with your finger on a smartphone application and a line drawn with your finger in sand. While the line drawn on a smartphone application would be in the thickness of the predetermined base shape, the line drawn in the sand would directly reflect the size and shape of your finger.
To address this issue, in embodiments, the base shape of the input is determined based on the actual input received by the input device. For example, the base shape of the input can be determined based on the size of the touch input, shape of the touch input, received pressure of the touch input, or any combinations thereof. This scheme can be beneficial in several ways. First, this approach provides an intuitive user experience because the tool shape would match the shape of the input, such as a finger touch. Second, this approach can provide an ability to individualize user experience based on the characteristics of the input, such as a size of a finger. For example, one person's finger can have a different base shape compared to another person's base shape. Third, this approach provides more flexibilities to users to use different types of input to provide different imprints. For example, a user can use a square shaped device to provide a square shape user input to the input device. This experience can be similar to using pre-designed stamps, mimicking the usage of rubber ink stamps on the input device: for design purposes, to serve as a “mark” (approval, denied, etc), or to provide identification (family seal).
In embodiments, the detected base shape of the input can be used to automatically match user interface elements, which can accommodate the differences in finger sizes. In embodiments, users can select the base shape of the input using selectable preset shapes.
In embodiments, the KasahComm application manages digital images using an efficient data representation. For example, the KasahComm application can represent an image as (1) an original image and (2) any overlay layers. The overlay layers can include information about any modifications applied to the original image. The modifications applied to the original image can include overlaid hand-drawings, overlaid stamps, overlaid color modifications, and overlaid text. This representation allows a user to easily manipulate the modifications. For instance, a user can easily remove modifications from the edited image by removing the overlay layers. As another example, the KasahComm application can represent an image using a reduced resolution version of the underlying image. This way, the KasahComm application can represent an image using a smaller file size compared to that of the underlying image. The efficient representation of image(s), as illustrated in
In step 1804, the KasahComm application can apply (or operate) a defocus blur to the underlying original image (i.e., without any image edits.) The KasahComm application can operate a defocus blur to the underlying original image using a convolution operator. For example, the KasahComm application can convolve the underlying original image with the defocus blur. The defocus blur can reduce the resolution of the image, but at the same time, reduce the amount of data (i.e., number of bits) needed to represent the image.
In embodiments, the defocus blur can include with a smoothing operator, such as a low-pass filter. The low-pass filter can include a Gaussian blur filter, a skewed Gaussian blur filter, a box filter, or any other filters that reduce the high frequency information of the image.
The defocus blur can be associated with one or more parameters. For example, the Gaussian blur filter can be associated with parameters representing (1) the size of the filter and (2) the standard deviation of the Gaussian kernel. As another example, the box filter can be associated with one or more parameters representing the size of the filter. In some cases, the parameters of the defocus blur can be determined based on the readout from the autofocus function of the image capture device. For example, starting from an in-focus state, the image capture device forces its lens to defocus and records images over a range of defocus settings. Based on the analysis of the resulting compression rate and decompression quality associated with each of the defocus settings, optimized parameters can be obtained.
In embodiments, some parts of the image can be blurred more than other parts of the image. In some cases, the KasahComm application can blur some parts of the image more than other parts of the image by using different defocus blur to different parts of the image.
In step 1806, the KasahComm application can optionally compress the defocused image using an image compression system. This step is an optional step to further reduce the file size of the image. The image compression system can implement one or more image compression standards, including the JPEG standard, the JPEG 2000 standard, the MPEG standard, or any other image compression standards. Once the defocused image is compressed, the file size of the resulting image file can be substantially less than the file size of the original, in-focus image file.
In step 1808, the resulting compressed image file can be packaged in an image container.
The KasahComm application can recover images from the efficient image representations of
The efficient image representation, as illustrated in
In embodiments, the receiving KasahComm application can further modify the received image. For example, the receiving KasahComm application can eliminate modifications made by the sender KasahComm application or add new modifications. When the receiving KasahComm application completes the modification, the receiving KasahComm application can send the modified image back to the sending KasahComm application. In some cases, the receiving KasahComm application can store the modified image as a compressed or decompressed data file, and/or display the data file contents on a digital output device or on an analog output device by utilizing the necessary a digital to analog converter.
In embodiments, the KasahComm application can enable multiple users to share messages over a communication network. The messages can include texts, photographs, videos, or any other types of media. In this communication mechanism, the KasahComm application can use the image compression/decompression scheme of
In embodiments, when a user receives a message, the user can respond to the received message by selecting the name of the user sending the message.
In embodiments, when the user selects the text bar at the bottom, the user can reply to the sender of the photograph by text messaging.
In embodiments, the photograph can include metadata, such as the location information. The KasahComm application can use this information to provide additional services to the user.
In embodiments, the KasahComm application can allow a user to modify a map.
In embodiments, the KasahComm application can enable other types of user interaction with the map.
In embodiments, the KasahComm applications on mobile devices can determine the location of the users and share the location information amongst the KasahComm applications. In some cases, the KasahComm applications can determine the location of the users using a Global Positioning System (GPS.) Using this feature, the KasahComm application can deliver messages to users at a particular location. For example, the KasahComm application can inform users within a specified area of an on-going danger.
In embodiments, the KasahComm application can accommodate a multiple resolution image data file where certain portions of the image are of higher resolution compared to other portions. In other words, a multiple resolution image data file can have a variable resolution at different positions in an image.
The multiple resolution image can be useful in many applications. The multiple resolution image can maintain a high resolution in areas that are of higher significance, and a lower resolution in areas of lower significance. This allows users to maintain high resolution information in the area of interest, even when there is a restriction on the file size of the image. For example, a portrait image can be processed to maintain high resolution information around the face, while, at the same time, reduce resolution in other regions to reduce the file size. Considering that users tend to zoom in on the areas of most significance, in this case, the facial region, the multiple resolution image would not significantly degrade the user experience, while achieving a reduced file size of the image.
In some cases, the multiple resolution image can be useful for maintaining high resolution information in areas that are necessary for subsequent applications, while reducing the resolution of regions that are unnecessary for subsequent applications. For example, in order for text or bar code information to be read reliably by, e.g., users or by bar code readers, high resolution information of the text or the bar code can be crucial. To this end, the multiple resolution image can maintain high resolution information in areas with text or bar code information, while reducing the resolution in irrelevant portions of the image.
A multiple resolution image data file can be generated by overlaying one or more higher resolution images on a lower resolution image while maintaining x-y coordinate data.
The second step of the process includes processing the edge enhanced image to create a binary image, typically resulting in a black and white image. In embodiments, the binary image can be created by processing the edge enhanced image using filters. The filters can include color reduction filters, color separation filters, color desaturation filters, brightness and contrast adjustment filters, exposure adjustment filter, and/or image history adjustment filters.
The third step of the process includes processing the binary image to detect areas to be enhanced, also called a target region. The target region is the primary focus area of the image. In embodiments, the target region can be determined by measuring the difference in blur levels across the entire image. In other embodiments, the target region can be determined by analyzing the prerecorded focus information associated with the image. The focus information can be gathered from the image capture device, such as a digital camera. In embodiments, the target region can be determined by detecting the largest area bound by object edges. In embodiments, the target region can be determined by receiving a manual selection of the region from the user using, for example, masking or freehand gestures. In embodiments, any combinations of the disclosed methods can be used to determine the target region.
The dark portion of the image mask, shown in
The multiple resolution image can be generated by sampling the original image within the selected enhanced area indicated by the image mask, and filling in the non-selected area with a blurred, low-resolution image.
In embodiments, systems and methods of the disclosed subject matter may utilize multi-layer video files where video bookmarks can be created on existing video files to provide fast access to specific frames within the video file. The video bookmarks may be accompanied with image or text information layered over the video image.
In embodiments, systems and methods of the disclosed subject matter may be used to create image and text that can be layered over a video image. Such image and text information may be frame based where the edit would only exist corresponding to select frames, or across several or all frames, where the added image and text information will result in an animation layered over the original video.
In embodiments, the KasahComm application may process audio information to create visual and audio output. The visual and audio output can be created based on predetermined factors. The predetermined factors can include one or more of data patterns, audio output frequency, channel output, gain, peak, and the Root Mean Squared (RMS) noise level. The resulting visual output may be based on colors, images, and text.
In embodiments, the KasahComm application can provide a visual representation of audio information. This allows physically disabled people, including deaf people, to interact with audio information.
In embodiments, each audio frame can be categorized as one of sound types. For example, an audio frame can be categorized as a bird tweeting sound or as a dog barking sound. Thus, in step 2704, the computing system can identifying an audio frame type associated with one of the audio frames in the audio information: the audio information can be processed to determine whether the audio information includes audio frames of a particular type.
In embodiments, identifying a type of audio frame from audio information can include measuring changes in pitch levels (or amplitude levels) in the input audio information. The changes in the pitch levels can be measured in terms of the rate at which the pitch changes, the changes in the amplitude, measured by decibels, the changes in the frequency content of the input audio information, the changes in the wavelet spectral information, the changes in the spectral power of the input audio information, or any combinations thereof. In embodiments, identifying a certain type of audio frame from audio information can include isolating one or more repeating sound patterns from the input audio information. Each repeating sound pattern can be associated with an audio frame type. In embodiments, identifying a certain type of audio frame from audio information can include comparing the pitch profile of the input audio information against pitch profiles associated with different sound sources. The pitch profiles associated with different sound sources can be maintained in an audio database.
In embodiments, identifying a certain type of audio frame from audio information can include comparing characteristics of the audio information against audio fingerprints. Each audio fingerprint can be associated with a particular sound source. The audio fingerprint can be characterized in terms of average zero crossing rates, estimated tempos, average spectrum, spectral flatness, prominent tones across a set of bands and bandwidth, coefficients of the encoded audio profile, or any combinations thereof
In embodiments, the sound types can be based on a sound category or a sound pitch. The sound categories can be organized in a hierarchical manner. For example, the sound categories can include a general category and a specific category. The specific category can be a particular instance of the general category. Some examples of the general/specific categories include an alarm (general) and a police siren (specific), a musical instrument (general) and a woodwind instrument (specific), a bass tone (general) and a bassoon sound (specific). The hierarchical organization of the sound categories can enable a trade-off between the specificity of the identified sound category and the computing time. For example, if the desired sound category is highly specific, then it would take a long time to process the input audio information to identify the appropriate sound category. However, if the desired sound category is general, then it would only take a short amount of time to process the input audio information.
Once an audio frame is associated with an audio frame type, in step 2706, the audio frame can be matched up with an image associated with that audio frame type. To this end, the computing system can determine an image associated with the audio frame type.
Once each audio frame is associated with one of the images, in step 2708, the computing system can display the image on a display device. In some cases, the time-domain audio information can be supplemented with the associated images as illustrated in
In embodiments, systems and methods of the disclosed subject matter can use masking techniques to isolate specific sound patterns in audio information.
The selected audio frame can be isolated from the audio information. The isolated audio frame is illustrated in
In embodiments, the identified audio frames can be further processed to modify the characteristics of the original audio information. For example, the identified audio frames can be depressed in magnitude within the original audio information so that the identified audio frames are not audible in the modified audio information. The identified audio frames can be depressed in magnitude by multiplying the original audio frames with a gain factor less than one.
In embodiments, the KasahComm application can aid mentally disabled people. It is generally known that mentally disabled people suffering from various neurological disorders, such as autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD), fail to communicate effectively with other people. As the intelligence of these patients is not entirely disrupted, the KasahComm application would be a good device to compensate for the defective communication skills. The KasahComm application allows elaborated communication because a picture speaks more than a thousand words. A photo per se will remarkably help for these mentally disabled people to express their thoughts and feelings by a few words or drawings associated with the photo to deliver as a method of communication.. Moreover, although these people fail to communicate with eye contacts, they do not resist playing with computer-operated devices, including computer-gaming gadgets and digital cameras.
In embodiments, the KasahComm application may create a password protected image file. Some image display applications, such as windows photo viewer, can restrict access to images using a security feature. The security feature of the applications can request a user to provide a password before the user can access and view images. However, the security feature of image display applications is a part of the applications and is independent of the images. Therefore, users may by-pass the security feature of the applications to access protected images by using other applications that do not support the security feature.
For example, in some cases, access to a phone is restricted by a smartphone lock screen. Therefore, a user needs to “unlock” the smartphone before the user can access images on the phone. However, the user may by-pass the lock screen using methods such as syncing the phone to a computer or by accessing the memory card directly using a computer. As another example, in some cases, access to folders may be password protected. Thus, in order to access files in the folder, a user may need to provide password. However, the password security mechanism protects only the folder and not the files within the folder. Thus, if the user uses another software to access the contents of the folder, the user can access any files in the folder, including images files, without any security protections.
To address these issues, in embodiments, the KasahComm application may create a password protected image file by packaging a password associated with the image file in the same image container. By placing a security mechanism on the image file itself, the image file can remain secure even if the security of the operating system and/or the file system are breached.
In embodiments, the KasahComm application can place a limit on how long an image file can be accessed, regardless of whether a user has provided a proper credential to access the image file. In particular, an image file can “expire” after a predetermined period of time to restrict circulation of the image file. An image may be configured so that it is not meant to be viewed after a specific date. For example, an image file associated with a beta test software should not be available for viewing once a retail version releases. Thus, the image can be configured to expire after the retail release date. In embodiments, the expiration date of the image can be maintained in the header field of the image container.
In embodiments, the KasahComm application may be used to provide communication between multiple and varying electronic devices over a secure private network utilizing independent data storage devices.
In embodiments, the KasahComm application may be used to provide messages, including images and text, to multiple users. The messages can be consolidated using time specific representations such as, but not limited to, a timeline format. In some cases, the timeline format can include a presentation format that arranges messages in a chronological order. In other cases, the timeline format can include a presentation format that arranges images and text as a function of time, but different from the chronological order. For example, messages can be arranged to group messages by topic. Suppose messages between to users, u, v, were chronologically ordered as follows: vA1, uA1, vB1, uA2, uA3, uB1, where u, v, indicates the user sending the message, A and B indicate a message group based on the topic, and the numbers indicate the order within the message group. For example:
In embodiments, the message group of a message can be determined by utilizing one or more of the following aspects. In one aspect, the message group of a message can be determined by receiving the message group designation from a user. In some cases, the user can indicate the message group of a message by manually providing a message group identification code. The message group identification code can include one or more characters or numerals that is associated with a message group. In the foregoing example, messages were associated with message groups A and B. Thus, if a user sends a message—“A Should be there in 5 min”—where “A” is the message group identification code, this message can be associated with the message group A. In other cases, the user can indicate the message group of a message by identifying the message to which the user wants to respond. For example, before responding to “Where are you now?”, the user can identify that the user is responding to that message and type “I'm still at home leaving soon!”. This way, the two message, “Where are you now?” and “I'm still at home leaving soon!” can be associated with the same message group, which is designated as the message group A. The user can identify the message to which the user wants to respond by a finger tap, mouse click or other user input mechanism for the KasahComm application (or the computing device running the KasahComm application.)
In one aspect, the message group of a message can be determined automatically by using a timestamp indicative of the time at which a user of a KasahComm application begins to compose the message. In some cases, such timestamp can be retrieved from a computing device running the KasahComm application, a computing device that receives the message sent by the KasahComm application, or, if any, an intermediary server that receives the message sent by the KasahComm application.
As an example, suppose that (1) a first KasahComm application receives the message vA1 at time “a”, (2) a user of the first KasahComm application begins to compose uA1 at time “b”, (3) the first KasahComm application sends uA1 to a second KasahComm application at time “c”, (4) the user of the first KasahComm application begins to compose uA2 at time “d”, (5) the first KasahComm application receives the message vB1 at time “e”, and (6) the first KasahComm application sends uA2 to the second KasahComm application at time “f”.
In some cases, when displaying messages for the first KasahComm application, messages can be ordered based on the time at which messages are received by the first KasahComm application and at which the user of the first KasahComm application began to compose the messages. This way, the order of the messages becomes vA1(a), uA1(b), uA2(d), vB1(e), which properly groups the messages according to the topic. This is in contrast to cases in which messages are ordered based on the time at which messages are “received” or “sent” by the first KasahComm application, because under this ordering scheme, the order of the messages becomes vA1(a), uA1(c), vB1(e), uA2(f), which does not properly group the messages according to the topic.
In other cases, messages can be automatically grouped based on a time overlap between (1) a receipt of a message from the second KasahComm application and a predetermined time period thereafter and (2) the time at which the user of the first KasahComm application begins to compose messages. In these cases, from the first KasahComm application's perspective, a received message can be associated with the same message group as messages that began to be composed between the receipt of the message and a predetermined time period thereafter. For example, if the user of the first KasahComm application begins to compose messages between time “a” and “f”, those messages would be designated as the same message group as the message received at time “a.” The predetermined time period can be determined automatically, or can be set by the user.
In embodiments, the KasahComm application may be used to provide off-line messaging functionality.
In embodiments, the KasahComm application may include geotagging functionality. In some cases, the location information can be provided through Global Positioning System (GPS) and geographical identification devices and technologies. In other cases, the location information can be provided from a cellular network operator or a wireless router. Such geographical location data can be cross referenced with a database to provide, to user, map information such as city, state and country names and may be displayed within the communication content.
In embodiments, the KasahComm application can provide an emergency messaging scheme using the emergency contacts. Oftentimes, users do not turn on location services that use location information for privacy reasons. For example, users are reluctant to turn on a tracking system that tracks location of the mobile device because users do not want to be tracked. However, in emergency situations, the user's location may be critically important. Therefore, in emergency situations, the KasahComm application can override the location information setting of the mobile device and send the location information of the mobile device to one or more emergency contacts, regardless of whether the location information setting allows the mobile device to do so.
To this end, in response to detecting an emergency situation, the KasahComm application can identify an emergency contact to be contacted for emergency situations and purposes. The KasahComm application can then override the location information setting with a predetermined location information configuration, which enables the KasahComm application to provide location information to one or more emergency contacts. Subsequently, the KasahComm application can send an electronic message over the communications network to the one or more emergency contacts. The predetermined location information configuration can enable the mobile device to send the location information of the mobile device. The location information can include GPS coordinates. The electronic message can include texts, images, voices, or any other types of media.
In embodiments, the emergency situations can include situations involving one or more of fire, robbery, battery, weapons including guns and knives, and any other life-threatening circumstances. In some cases, the KasahComm application can associate one of these life-threatening circumstances with a particular emergency contact. For example, the KasahComm application can associate emergency situations involving fire with a fire station.
In embodiments, the KasahComm application may utilize the location information to present images in non-traditional formats such as the presentation of images layered on top of geographical maps or architectural blueprints.
In embodiments, the KasahComm application may utilize the location information to create 3D representations from the combination of multiple images.
In embodiments, the KasahComm application may create a system that calculates the geographical distance between images based on the location information associated with the images. The location information associated with the images can be retrieved from the images' metadata.
In embodiments, the KasahComm application can utilize the location information to provide weather condition and temperature information at the user's location.
In embodiments, the KasahComm application can utilize the location information and other technologies, such as built in gyroscope and accelerometers, to create user created images and/or modified to be displayed on a communication recipients device when the recipient is in proximity of the location where the image was created.
In embodiments, the KasahComm application can retrieve device specific information associated image data to identify the original imaging hardware such as, but not limited to, digital cameras to be delivered with the images and present such information within the KasahComm application. Such information can be utilized to confirm authenticity of the image source, ownership of used hardware, or simply be provided for general knowledge purposes.
In embodiments, the KasahComm application can network images captured on digital cameras to application software located on a networked computer or mobile device to be prepared for automatic or semi-automatic delivery to designated users on private or public networks.
In embodiments, systems and methods of the disclosed subject matter may be incorporated or integrated into electronic imaging hardware such as, but not limited to, digital cameras for distribution of images across communication networks to specified recipients, image sharing, or social networking websites and applications. Such incorporation would forgo the necessity for added user interaction and drastically automate the file transmission process.
In embodiments, the KasahComm application can include an image based security system. The image based security system uses an image to provide access to the security system. The access to the security system may provide password protected privileges, which can include access to secure data, access to systems such as cloud based applications, or a specific automated response which may act as a confirmation system.
In some cases, the image based security system can be based on an image received by the image based security system. For example, if a password of the security system is a word “A”, one may take a photograph of a word “A” and provide the photograph to the security system to gain access to the security system.
In some cases, the image based security system can be based on components within an image. For example, if a password of the security system is a word “A”, one may take a photograph of a word “A”, provide a modification to the photograph based on the security system's specification, which is represented as an overlay layer of the photograph, and provide the modified photograph to the security system. In some cases, the security system may specify that the modified photograph should include an image of “A” and a signature drawn on top of the image as an overlay layer. In those cases, the combination of the “signature” and the image of “A” would operate as a password to gain access to the security system.
In some cases, the image based security system can be based on modifications to an image in which the image and the modifications are flattened to form a single image file. For example, if a password of the security system is a word “A”, one may take a photograph of a word “A”, provide a modification to the photograph based on the security system's specification, flatten the photograph and the modification to form a single image, and provide the flattened image to the security system. In some cases, the security system may specify that the flattened image should include an image of “A” and a watermark on top of the photograph. The watermark may serve to guarantee that the photograph of “A” was taken with a specific predetermined imaging device and not from a non-authorized imaging device and therefore function as a password.
The access to the security system may provide password protected privileges, which can include access to secure data, access to systems such as cloud based applications, or a specific automated response which may act as a confirmation system.
In embodiments, systems and methods of the disclosed subject matter may be used to trigger an automatic response from the receiver of the transferred data file, and vice versa. The automated response may be dependent or independent on the content of the data file sent to the recipient.
In embodiments, systems and methods of the disclosed subject matter may be used to trigger remote distribution of the transferred data file from the sender to the receiver to be further distributed to multiple receivers.
In embodiments, systems and methods of the disclosed subject matter may be used to scan bar code and QR code information that exists within other digital images created or received by the user. The data drawn from the bar code or QR code can be displayed directly within the KasahComm application or utilized to access data stored in other compatible applications.
In embodiments, systems and methods of the disclosed subject matter can perform digital zoom capabilities when capturing a photo with the built-in camera. When the built-in camera within the KasahComm application is activated, a one finger press on the screen will activate the zoom function. If the finger remains pressed against the screen, a box will appear designating the zoom area and the size of the box will decrease in size while the finger retains contact with the screen. Releasing the finger from the screen triggers the camera to capture a full size photo of the content visible within the zoom box.
In embodiments, systems and methods of the disclosed subject matter may use a camera detectable device in conjunction with the KasahComm application. A camera detectable device includes a device that can be identified from an image as a distinct entity. In some cases, the camera detectable device can emit a signal to be identified as a distinct entity. For example, the camera detectable device can include a high-powered light emitting device (LED) pen: the emitted light can be detected from an image.
When the camera detectable device is held in front of the camera, the camera application can detect and register the movement of the camera detectable device. In embodiments, the camera detectable device can be used to create a variation of “light painting” or “light art performance photography” for its creative applications. In other embodiments, the camera detectable device can operate to point to objects on the screen. For example, the camera detectable device can operate as a mouse that can operate on the objects on the screen. Other non-limiting detection methods of the camera detectable device can include movement based detection, visible color based detection, or non-visible color based detection such as through the usage of infrared. The KasahComm application of this functionality can include methods for navigating within the KasahComm application, for example, for browsing messages within the KasahComm application, or as an editing tool, for example, for editing images.
The KasahComm application can be implemented in software. The software needed for implementing the KasahComm application can include a high level procedural or an object-orientated language such as MATLAB®, C, C++, C#, Java, or Perl, or an assembly language. In embodiments, computer-operable instructions for the software can be stored on a non-transitory computer readable medium or device such as read-only memory (ROM), programmable-read-only memory (PROM), electrically erasable programmable-read-only memory (EEPROM), flash memory, or a magnetic disk that can be read by a general or special purpose-processing unit. The processors can include any microprocessor (single or multiple core), system on chip (SoC), microcontroller, digital signal processor (DSP), graphics processing unit (GPU), or any other integrated circuit capable of processing instructions such as an x86 microprocessor.
The KasahComm application can operate on various user equipment platforms. The user equipment can be a cellular phone having phonetic communication capabilities. The user equipment can also be a smart phone providing services such as word processing, web browsing, gaming, e-book capabilities, an operating system, and a full keyboard. The user equipment can also be a tablet computer providing network access and most of the services provided by a smart phone. The user equipment operates using an operating system such as Symbian OS, Apple iOS, RIM BlackBerry OS, Windows Mobile, Linux, HP WebOS, and Android. The interface screen may be a touch screen that is used to input data to the mobile device, in which case the screen can be used instead of the full keyboard. The user equipment can also keep global positioning coordinates, profile information, or other location information.
The user equipment can also include any platforms capable of computations and communication. Non-limiting examples can include televisions (TVs), video projectors, set-top boxes or set-top units, digital video recorders (DVR), computers, netbooks, laptops, and any other audio/visual equipment with computation capabilities.
In embodiments, the user can interact with the KasahComm application using a user interface. The user interface can include a keyboard, a touch screen, a trackball, a touch pad, and/or a mouse. The user interface may also include speakers and a display device. The user can use one or more user interfaces to interact with the KasahComm application. For example, the user can select a button by selecting the button visualized on a touchscreen. The user can also select the button by using a trackball as a mouse.
This application claims benefit of U.S. Provisional Patent Application No. 61/648,774, entitled “SYSTEMS AND METHODS FOR MANAGING FILES WITH DIGITAL DATA,” filed on May 18, 2012; of U.S. Provisional Patent Application No. 61/675,193, entitled “SYSTEMS AND METHODS FOR MANAGING FILES WITH DIGITAL DATA,” filed on Jul. 24, 2012; and of U.S. Provisional Patent Application No. 61/723,032, entitled “SYSTEMS AND METHODS FOR MANAGING FILES WITH DIGITAL DATA,” filed on Nov. 6, 2012. The entire contents of all three provisional patent applications are herein incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| 61648774 | May 2012 | US | |
| 61675193 | Jul 2012 | US | |
| 61723032 | Nov 2012 | US |
