Patent Application
20250021219
This application claims priority to Chinese Application No. 202111384354.7, entitled “SCREEN ZOOM-IN PROCESSING METHOD AND APPARATUS BASED ON MOBILE TERMINAL, AND TERMINAL AND MEDIUM”, filed on Nov. 19, 2021. The entire disclosures of the above applications are incorporated herein by reference.
The present disclosure relates to a mobile terminal, and more particularly, to a screen enlargement processing method, a device, a mobile terminal and a storage medium based on a mobile terminal.
With the development of science and technology and the continuous improvement of people's living standards, the use of various mobile terminals such as mobile phones is becoming more and more popular, and mobile phones have become an indispensable communication and entertainment tool in people's lives.
People often use mobile browser applications, chat applications, reading applications, etc. With the aging of society, when the mobile phone user is an elderly person with poor eyesight, some pages often have to be close to the elderly to see clearly. The conventional mobile terminal, such as the auxiliary function of mobile phone, has a screen magnification function, but the menu is deeply hidden, is not easy to use, and is inconvenient to operate especially for the elderly.
Therefore, this still needs to be improved and enhanced.
One objective of an embodiment of the present disclosure is to provide a screen enlargement processing method, a device, a mobile terminal and a storage medium based on a mobile terminal. The auxiliary function of the mobile terminal such as a conventional mobile phone is designed to solve the screen magnification function, but the menu is hidden deeply, is not easy to use, and the operation is inconvenient for the elderly. The present disclosure provides a method for determining the distance between the user and the screen by using the front-facing camera and automatically prompting the user to turn on the magnification function, which is provided for users with insufficient eyesight. The present disclosure uses the front camera of the mobile terminal to determine whether the current user is close to the screen, and when the user is close to the screen at a predetermined distance, a prompt pop up is automatically generated to enable the screen magnification function, which provides convenience to the user.
In order to solve the above-mentioned technical problems, the technical scheme adopted in the present disclosure is as follows:
According to an embodiment of the present disclosure, a screen magnification processing method based on a mobile terminal is disclosed. The method comprises:
According to another embodiment of the present disclosure, before the detecting and obtaining an application opened by the mobile terminal, and determining whether the currently opened application is a preset application of a specified type, the method further includes:
According to another embodiment of the present disclosure, before the detecting and obtaining an application opened by the mobile terminal, and determining whether the currently opened application is a preset application of a specified type, the method further includes:
According to another embodiment of the present disclosure, the step of detecting and obtaining the application opened by the mobile terminal, and determining whether the currently opened application is the preset application of the specified type comprises:
According to another embodiment of the present disclosure, the step of obtaining the distance from the user's face to the screen of the mobile terminal when the currently opened application is the preset application of the specified type comprises:
controlling the front camera to obtain a current picture of the mobile terminal, and obtaining and detecting the distance from the user's face to the screen of the mobile terminal;
According to another embodiment of the present disclosure, the step of determining whether the distance from the user's face to the screen of the mobile terminal is less than the predetermined distance comprises:
According to another embodiment of the present disclosure, the step of automatically prompting whether to enable the screen magnification function when the distance from the user's face to the screen of the mobile terminal is less than the predetermined distance comprises:
According to an embodiment of the present disclosure, a screen magnification processing device based on a mobile terminal is disclosed. The screen magnification processing device includes:
According to an embodiment of the present disclosure, a mobile terminal includes a memory, a processor, and a computer program stored in the memory and executable by the processor. The processor executes the computer program to perform the steps of the screen magnification processing method.
According to an embodiment of the present disclosure, a computer readable storage medium storing a computer program. A processor executes the computer program to perform the steps of the screen magnification processing method.
Compared with the prior art, the present disclosure is directed to a screen magnification processing method based on a mobile terminal. The method comprises: detecting and obtaining an application opened by the mobile terminal, and determining whether the currently opened application is a preset application of a specified type; when the currently opened application is the preset application of the specified type, obtaining a distance from a user's face to a screen of the mobile terminal; when the distance from the user's face to the screen of the mobile terminal is less than a predetermined distance, automatically prompting whether to enable a screen magnification function; when the user selects to enable the screen magnification function, controlling the mobile terminal screen to display a magnified image in a predetermined magnification rate. The present disclosure uses the front camera of the mobile terminal to determine whether the current user is close to the screen, and when the user is close to the screen at a predetermined distance, a prompt pop up is automatically generated to enable the screen magnification function, which provides convenience for the user.
In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings described below are only some embodiments of the present disclosure, and for those skilled in the art, other drawings can be obtained according to these drawings without creative labor.
In order to make the purpose, technical scheme and effect of the present disclosure clearer and more definite, the present disclosure is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are used only to interpret the present disclosure and are not intended to qualify the present disclosure.
It should be noted that if there is a directional indication (such as upper, lower, left, right, front, rear, . . . , etc.) involved in the embodiment of the present disclosure, the directional indication is only used to explain the relative position relationship between the parts under a specific attitude (as shown in the attached drawing), the motion situation, etc., and if the specific attitude changes, the directional indication also changes accordingly.
In addition, if there are descriptions involving “first”, “second”, etc., in the embodiment of the present disclosure, the descriptions of “first”, “second”, etc., are only for descriptive purposes and cannot be construed as indicating or implying their relative importance or implying the number of technical features indicated. Thus, defining the “first” and “second” features may explicitly or implicitly include at least one of those features. In addition, the technical solutions between the various embodiments may be combined with each other, but only on the basis that they can be realized by a person skilled in the art, and when the combination of technical solutions contradicts or cannot be realized, it shall be deemed that the combination of such technical solutions does not exist and is not within the scope of protection claimed in the present disclosure.
With the development of science and technology and the continuous improvement of people's living standards, the use of various mobile terminals such as mobile phones is becoming more and more popular, and mobile phones have become an indispensable communication and entertainment tool in people's lives.
People often use mobile browser applications, chat applications, reading applications, etc. With the aging of society, when the mobile phone user is an elderly person with poor eyesight, some pages often have to be close to the elderly to see clearly. As previously mentioned, the conventional mobile terminal has a screen magnification function. For example, the Android system comes with an accessibility function, which allows the user to quickly enlarge the screen so that the content is displayed more clearly. Furthermore, this enabling entrance of this function is generally in “settings-accessibility/accessibility-magnification function”, and the magnification function menu is hidden deeply, is not easy to use, and is inconvenient especially for the elderly to operate.
In order to solve the above issue, according to an embodiment of the present disclosure, a screen magnification processing method based on a mobile terminal is disclosed. The face detection of the camera can be used to detect whether the user is too close to the screen. When the user is far away from the screen, the face area will only occupy a small part of the camera screen. But if the user is very close to the screen, the face area will occupy the vast majority of the screen, when the distance between the user's face and the mobile terminal screen is less than the predetermined distance, then the mobile terminal automatically prompt whether to turn on the screen magnification function. When the command to select the screen magnification function is detected, then the mobile terminal screen is controlled to enlarge and display according to the predetermined coefficient/rate. The present disclosure adds a new function to the mobile terminal: it has the function of automatically controlling the screen of the mobile terminal to enlarge the display according to the predetermined coefficient/rate according to the need, which is more convenient for the user and improves the user experiences.
As shown in
Step S100: detecting and obtaining an application opened by the mobile terminal, and determining whether the currently opened application is a preset application of a specified type.
In this embodiment, a mobile phone is used as an example for illustration. Often some users have poor eyesight, and need to get very close to the mobile phone, so the application is provided with the function of automatically controlling the mobile terminal screen to enlarge the display according to the predetermined coefficient/rate according to the needs. This could allow the user to read automatically-enlarged information and is easier for the user to view the information.
Before Step S100, it is necessary to set up an application of a specific type on the mobile terminal in advance. The application of the specific type includes a browser application, a chat application, and a reading application. That is, when an application of a specific type is opened, the function of automatically controlling the mobile terminal screen to be enlarged according to a predetermined coefficient/rate is enabled as needed. Generally, users need to read a lot of words in browser applications, chat applications, and reading applications, so the auto-magnification function is turned on to facilitate users to read.
The mobile terminal is pre-configured in advance to automatically prompt a shortcut menu item on the mobile terminal to check whether to enable the screen magnification function when the application of the specific type is detected. That is, in this embodiment, there is no need to frequently set whether to turn on the screen magnification function (the function of automatically controlling the mobile terminal screen to enlarge the display according to a predetermined coefficient as needed), and the application is pre-configured to automatically pop up a dialog box according to the application type of the application currently-used by the user to remind the user whether to turn on the screen magnification function. It is very user-friendly, especially for the elderly, and it is very convenient for the elderly to use.
The mobile phone could real-time detect the applications currently-opened on the mobile terminal, and compare the currently-opened applications with the preset applications of the specified type to determine whether the currently-opened applications are the preset applications of the specified type. That is, this step is to determine whether the currently-opened application is the specified application that the user has pre-set, such as browser application, chat application, and reading application, which needs to read a large number of words. If yes, then go to Step S200.
Step S200: when the currently opened application is the preset application of the specified type, obtaining a distance from a user's face to a screen of the mobile terminal.
If the currently opened application is the preset application of the specified type, the function of automatically controlling the mobile terminal screen to enlarge the display according to a predetermined coefficient/rate will be automatically enabled as needed, and the distance from the user's face to the mobile terminal screen will be automatically obtained.
If the currently opened application is the preset application of the specific type, such as a browser application, a chat application, or a reading application, the front camera of the mobile terminal is turned on and the front camera is set to be in a low-power operation mode. The front camera is controlled to obtain the current screen of the mobile terminal, and the distance from the user's face to the screen of the mobile terminal is detected. Furthermore, whether the distance from the user's face to the screen of the mobile terminal is less than the predetermined distance is determined. For example, the mobile terminal could determine whether the straight-line distance between the user's face and the screen of the mobile terminal is less than 20 cm. In this embodiment, the distance from the user to the screen can be detected by the front camera in the low-power mode, which is more power-saving. Low-power mode: specifically, the power consumption can be reduced by reducing the frame rate and output size of the front camera's sensor, for example, the front camera in the low power mode can only obtain a simple image of the user's face contour to determine the straight-line distance from the user's face to the mobile terminal's screen.
If the distance between the user's face and the screen of the mobile terminal is determined to be less than the predetermined distance (20 cm), then go to Step S300.
If the distance between the user's face and the screen of the mobile terminal is determined to be greater than or equal to the predetermined distance, the mobile terminal is controlled to wait for a predetermined time to perform the next detection to continue to detect the distance between the user's face and the screen of the mobile terminal.
Step S300: when the distance from the user's face to the screen of the mobile terminal is less than a predetermined distance, automatically prompting whether to enable a screen magnification function.
When the distance between the user's face and the screen of the mobile terminal is less than the predetermined distance, the screen magnification function will be automatically prompted. For example, when a user opens a specified type of application on a mobile phone, such as a browser application, a chat application, or a reading application, and detects that the distance between the user's face and the mobile terminal screen is less than the predetermined distance (20 cm), a floating window will automatically pop up to prompt whether to enable the screen magnification function, and the yes or no operation selection button will be displayed in the floating window.
In this embodiment, the distance between the user's face and the screen of the mobile terminal can be determined by using a front camera with a motor that can focus, and the distance of the camera to the focus point can be used to determine the distance. This scheme can determine the distance more accurately.
In this embodiment, the floating winder is used to prompt whether to turn on the screen magnification function. This is more convenient for users to view and open as needed in a timely manner, so as to provide convenience for users. The predetermined distance of this embodiment can also be set and adjusted as needed, such as 15 cm or 10 cm, etc., so that it is convenient to set accordingly according to different user groups.
Step S400: when the user selects to enable the screen magnification function, controlling the mobile terminal screen to display a magnified image in a predetermined magnification coefficient/rate.
When it is detected that the user has opened an application of a specified type, and it is detected that the eyes of the user's face are closer to the screen than a predetermined distance (for example, 20 cm), and it is considered that it is difficult for the user to look at the mobile phone in the current display state of the mobile phone. Then, the mobile terminal will automatically enable the screen magnification function as needed, and the interface font of the current display screen of the mobile terminal will be enlarged according to the predetermined coefficient/rate. It is convenient for users to read more clearly and provides convenience for users to use.
For the convenience of the user, when the user opens the application of the specified type, after the mobile terminal screen is enlarged according to the predetermined coefficient, the user view is completed, and the user is detected to close the specified application, the mobile terminal will automatically control its screen back to display in the original display state before magnification without the user's manual operation. This is simple and convenient. This present disclosure could ease the use of mobile phones by the elderly, and can achieve accessibility functions: assist them in using mobile phones, and this series of functions include screen text reading, screen magnification function, etc.
In the following disclosure, the implementation of the process is further illustrated in more details.
As shown in
Step S12: turning on the front camera, set the camera in the low-power mode, and go to Step S13;
In this embodiment, the face detection of the camera can be used to detect whether the user is too close to the screen, and when the user is far away from the screen, the face area will only occupy a small part of the camera screen; if the user is very close to the screen, the face area will occupy the vast majority of the screen, for example, the application may set the user's face to occupy more than 80% of the screen and it is considered too close, then the control starts to turn on the screen magnification function. In this embodiment, the present disclosure uses camera to detect the user's face in the screen. This is very cost effective because and there are many publically available models of cameras, which are at low cost.
In this embodiment, the mobile terminal can determine whether the current user is very close to the screen by calculating the proportion of the face position occupying the image captured by the front camera.
The pseudocode is as follows:
The screen magnification feature can be implemented with Android's built-in accessibility features.
In this embodiment, the present disclosure could determine whether the user's face is too close to the screen by detecting the proportion of the user's face on the screen. This detection is very simple and convenient and can be realized in the low-power mode of the camera, which does not occupy more memory and provides convenience for the user.
Step S14: waiting for 3 seconds, and return to Step S13;
Step S16: end.
Through the embodiment of the present disclosure, the gap of the automatic triggering magnification function mechanism is filled, and the user experience of the “accessibility function” of the Android system is improved. The “screen magnification” module can be directly implemented with the “accessibility features” embedded in the Android system. This could minimize the development effort.
The detection and determination module 610 is configured to detect and obtain an application opened by the mobile terminal, and determine whether the currently opened application is a preset application of a specified type.
The distance detection module 620 is configured to obtain a distance from a user's face to a screen of the mobile terminal when the currently opened application is the preset application of the specified type.
The magnification prompting module 630 is configured to automatically prompt whether to enable a screen magnification function when the distance from the user's face to the screen of the mobile terminal is less than a predetermined distance.
The magnification controlling module 640 is configured to control the mobile terminal screen to display a magnified image in a predetermined magnification rate when the user selects to enable the screen magnification function.
According to an embodiment, a mobile terminal is disclosed. As shown in
Please note, the elements shown in
In an embodiment, the mobile terminal comprises a memory, a processor and a screen magnification processing program based on a mobile terminal. The screen magnification processing program is stored in the memory and is loaded and executed by the processor to perform the operations comprising:
The operation of detecting and obtaining an application opened by the mobile terminal, and determining whether the currently opened application is a preset application of a specified type, comprises:
The operation of detecting and obtaining an application opened by the mobile terminal, and determining whether the currently opened application is a preset application of a specified type, comprises:
The operation of detecting and obtaining the application opened by the mobile terminal, and determining whether the currently opened application is the preset application of the specified type comprises:
The operation of obtaining the distance from the user's face to the screen of the mobile terminal when the currently opened application is the preset application of the specified type comprises:
The operation of determining whether the distance from the user's face to the screen of the mobile terminal is less than the predetermined distance comprises:
The operation of automatically prompting whether to enable the screen magnification function when the distance from the user's face to the screen of the mobile terminal is less than the predetermined distance comprises:
A person skilled in the art may understand that all or part of the process in the method for realizing the above embodiments can be completed by instructing the relevant hardware through a computer program. The computer program may be stored in a non-volatile computer-readable storage medium, and may include a flow such as the embodiments of each of the methods when executed. Any reference to memory, storage, database, or other medium used in each embodiment provided in the present disclosure may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration rather than a limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Dual Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM), etc.
In summary, the present disclosure is directed to a screen magnification processing method based on a mobile terminal. The method comprises: detecting and obtaining an application opened by the mobile terminal, and determining whether the currently opened application is a preset application of a specified type; when the currently opened application is the preset application of the specified type, obtaining a distance from a user's face to a screen of the mobile terminal; when the distance from the user's face to the screen of the mobile terminal is less than a predetermined distance, automatically prompting whether to enable a screen magnification function; when the user selects to enable the screen magnification function, controlling the mobile terminal screen to display a magnified image in a predetermined magnification rate. The present disclosure uses the front camera of the mobile terminal to determine whether the current user is close to the screen, and when the user is close to the screen at a predetermined distance, a prompt pop up is automatically generated to enable the screen magnification function, which provides convenience for the user.
The above are specific embodiments of the present disclosure, but the claimed scope of the present disclosure is not limited thereto. Those skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present disclosure. These modifications or replacements should be covered by the claimed scope of the present disclosure. Therefore, the claimed scope of the present disclosure should be determined by claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202111384354.7 | Nov 2021 | CN | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2022/128603 | 10/31/2022 | WO |
