Embodiments of this disclosure relate to the field of electronic technologies, and in particular, to an electronic apparatus and an image processing method of the electronic apparatus.
With progress of electronic science and technology, more and more functions are integrated into an intelligent terminal. Thanks to development of image processing technologies, more and more users like to use the intelligent terminal device to perform photographing, video recording, video calling, and the like.
Due to a limited computing capability of an algorithm of an image signal processor (ISP) in the intelligent terminal, to improve image processing effect, the industry proposes a combination of a conventional image processing algorithm and an artificial intelligence (AI) technology. For example, an AI processor is disposed at a back end of the ISP to provide an additional calibration to an ISP image processing result, that is, AI post-processing is performed. In a specific implementation, the ISP stores a processed image to an off-chip memory; and the AI processor reads, from the off-chip memory, the image stored by the ISP, and further corrects the image based on ISP image processing, to generate a final image. In this solution, because the capability of the conventional ISP has a bottleneck, information loss occurs after original image data collected by an image sensor is processed by the ISP, thereby lowering the image processing effect. Although the AI post-processing technology can improve the image processing result output by the ISP to some extent, effect is still unsatisfactory. Therefore, a problem of the poor processing effect of the conventional ISP cannot be fully resolved in the conventional technology.
This application provides an electronic apparatus and an image processing method of the electronic apparatus, to improve image processing effect. To implement the foregoing objective, the following technical solutions are used in this application.
According to a first aspect, an embodiment of this disclosure provides an electronic apparatus. The electronic apparatus includes: an artificial intelligence AI processor, configured to perform first image signal processing on a first image signal to obtain a second image signal, where the first image signal is obtained based on image data output by an image sensor; and an image signal processor ISP, configured to perform second image signal processing on the second image signal to obtain an image processing result.
After the AI processor processes the image data, the ISP performs other image processing. In an entire image signal processing process, a processing capability of the AI processor may be fully used, so that the AI processor replaces a conventional ISP to perform some processing processes, thereby improving quality of the image processing result output by the ISP.
With reference to the first aspect, in a possible implementation, the ISP is further configured to: receive the image data from the image sensor, and perform third image signal processing on the image data to obtain the first image signal.
In this implementation, a first image processing process performed by the AI processor may be set among a plurality of image processing processes performed by the ISP, and the AI processor may replace the ISP to perform some processing processes in the image processing processes, to achieve preset effect, improve flexibility of combining the AI processor with the ISP, and improve image processing effect.
With reference to the first aspect, in a possible implementation, the third image signal processing includes a plurality of processing processes, and in two adjacent processing processes in the plurality of processing processes, a previous processing process is used to generate a third image signal, and a next processing process is used to process a fourth image signal; and the AI processor is further configured to perform fourth image signal processing on the third image signal to obtain the fourth image signal. In this solution, flexibility of performing the image processing process by using the AI processor is further improved.
With reference to the first aspect, in a possible implementation, the first image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, or gamma calibration.
With reference to the first aspect, in a possible implementation, the second image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, gamma calibration, or RGB-to-YUV domain conversion.
With reference to the first aspect, in a possible implementation, the third image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, or demosaicing.
With reference to the first aspect, in a possible implementation, the fourth image signal processing includes at least one of the following processing processes: black level calibration, shadow calibration, white balance calibration, demosaicing, or color difference calibration.
With reference to the first aspect, in a possible implementation, the electronic apparatus further includes a memory, coupled to the AI processor and the ISP, and configured to transfer a first image unit in any image signal between the AI processor and the ISP.
With reference to the first aspect, in a possible implementation, the memory, the AI processor, and the ISP are located in a system on chip in the electronic apparatus, and the memory includes an on-chip random access memory RAM.
With reference to the first aspect, in a possible implementation, the first image unit includes any one of the following: a single frame of image or an image block in a single frame of image.
With reference to the first aspect, in a possible implementation, the electronic apparatus further includes: an off-chip memory, located outside the system on chip, and configured to transfer a second image unit in any image signal between the AI processor and the ISP, where the second image unit includes a plurality of frames of images.
With reference to the first aspect, in a possible implementation, the electronic apparatus further includes a controller, configured to trigger the AI processor to execute the first image signal processing, and control the ISP to execute the second image signal processing.
With reference to the first aspect, in a possible implementation, an interrupt signal is transmitted between the AI processor and the ISP through an electronic line connection. Optionally, the electronic line connection includes a connection by using an interrupt controller. The interrupt signal is transmitted by setting the electronic line connection between the AI processor and the ISP, and does not need to be forwarded by another processor such as a CPU. This can improve a signal transmission speed, and can reduce an image output delay in some real-time videos, which helps improve user experience.
Optionally, the electronic apparatus further includes the image sensor.
According to a second aspect, an embodiment of this disclosure provides an image processing method of an electronic apparatus. The image processing method includes: controlling an artificial intelligence AI processor to perform first image signal processing on a first image signal to obtain a second image signal, where the first image signal is obtained based on image data output by an image sensor; and controlling an image signal processor ISP to perform second image signal processing on the second image signal to obtain an image processing result.
With reference to the second aspect, in a possible implementation, before the controlling an artificial intelligence AI processor to perform first image signal processing on a first image signal, the method further includes: controlling the ISP to receive the image data from the image sensor, and performing third image signal processing on the image data to obtain the first image signal.
According to the second aspect, in a possible implementation, the third image signal processing includes a plurality of processing processes, and in two adjacent processing processes in the plurality of processing processes, a previous processing process is used to generate a third image signal, and a next processing process is used to process a fourth image signal; and the method further includes: controlling the AI processor to perform fourth image signal processing on the third image signal to obtain the fourth image signal.
With reference to the second aspect, in a possible implementation, the first image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, or gamma calibration.
With reference to the second aspect, in a possible implementation, the second image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, gamma calibration, or RGB-to-YUV domain conversion.
With reference to the second aspect, in a possible implementation, the third image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, or demosaicing.
With reference to the second aspect, in a possible implementation, the fourth image signal processing includes at least one of the following processing processes: black level calibration, shadow calibration, white balance calibration, demosaicing, or color difference calibration.
According to a third aspect, an embodiment of this disclosure provides an image processing apparatus. The image processing apparatus includes: an AI processing module, configured to perform first image signal processing on a first image signal to obtain a second image signal, where the first image signal is obtained based on image data output by an image sensor; and an image signal processing module, configured to perform second image signal processing on the second image signal to obtain an image processing result.
With reference to the third aspect, in a possible implementation, the image signal processing module is further configured to: receive the image data from the image sensor, and perform third image signal processing on the image data to obtain the first image signal.
With reference to the third aspect, in a possible implementation, the third image signal processing includes a plurality of processing processes, and in two adjacent processing processes in the plurality of processing processes, a previous processing process is used to generate a third image signal, and a next processing process is used to process a fourth image signal; and the AI processing module is further configured to perform fourth image signal processing on the third image signal to obtain the fourth image signal.
With reference to the third aspect, in a possible implementation, the first image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, or gamma calibration.
With reference to the third aspect, in a possible implementation, the second image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, gamma calibration, or RGB-to-YUV domain conversion.
With reference to the third aspect, in a possible implementation, the third image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, or demosaicing.
With reference to the third aspect, in a possible implementation, the fourth image signal processing includes at least one of the following processing processes: black level calibration, shadow calibration, white balance calibration, demosaicing, or color difference calibration.
According to a fourth aspect, an embodiment of this disclosure provides an electronic apparatus. The electronic apparatus includes a memory and at least one processor, the memory is configured to store computer programs, and the at least one processor is configured to invoke all or some of the computer programs stored in the memory, to perform the method according to the second aspect. The at least one processor includes an AI processor and an ISP. Optionally, the electronic apparatus further includes an image sensor.
According to a fifth aspect, an embodiment of this disclosure provides a system on chip, where the system on chip includes at least one processor and an interface circuit, the interface circuit is configured to obtain a computer program from outside of the chip system, and the computer program is executed by the at least one processor to implement the method according to the second aspect. The at least one processor includes an AI processor and an ISP.
According to a sixth aspect, an embodiment of this disclosure provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, where the computer program is executed by at least one processor to implement the method according to the second aspect. The at least one processor includes an AI processor and an ISP.
According to a seventh aspect, an embodiment of this disclosure provides a computer program product, and when being executed by at least one processor, the computer program product is used to implement the method according to the second aspect. The at least one processor includes an AI processor and an ISP.
It should be understood that technical solutions in the second to the seventh aspects of this application are consistent with that in the first aspect. Beneficial effect achieved by the various aspects and corresponding implementations is similar, and details are not described again.
To describe technical solutions in embodiments of this disclosure more clearly, the following briefly introduces the accompanying drawings for describing embodiments of this disclosure. It is clear that the accompanying drawings in the following descriptions show merely some embodiments of this disclosure, and a person of ordinary skill in the art may still derive other drawings from these accompanying drawings without creative efforts.
The following clearly describes the technical solutions in embodiments of this disclosure with reference to the accompanying drawings in embodiments of this disclosure The described embodiments are some but not all of embodiments of this disclosure and the present disclosure should not be limited to the disclosed embodiments. All other embodiments obtained by a person of ordinary skill in the art based on embodiments of this disclosure without creative efforts shall fall within the protection scope of this application.
The word “first”, “second”, or the like mentioned in this specification does not indicate any order, quantity, or importance, but is used only for distinguishing between different components. Likewise, the word “a/an”, “one”, or the like is not intended to indicate a quantity limitation either, but is intended to indicate at least one. The word “coupling”, or the like is not limited to a physical or mechanical direct connection, but may include an electrical connection, whether directly or indirectly. It is equivalent to a connection in a broad sense.
In addition, in embodiments of this disclosure, the word “an example” or “for example” is used to represent giving an example, an illustration, or a description. Any embodiment or design scheme described as an “an example” or “for example” in embodiments of this disclosure should not be explained as being more preferred or having more advantages than another embodiment or design scheme. Exactly, use of the word “an example”, “for example”, or the like is intended to present a related concept in a specific manner. In the description of the embodiment of this disclosure, unless otherwise stated, “a plurality of” means two or more than two. For example, a plurality of processors mean two or more processors.
An electronic apparatus provided in embodiments of this disclosure may be an electronic device, or a module, a chip, a chipset, a circuit board, or a component integrated into the electronic device. The electronic device may be user equipment (UE), for example, various types of devices such as a mobile phone, a tablet computer, a smart screen, or an image capturing device. The electronic device may be provided with a photographing apparatus, and the photographing apparatus may also be referred to as an image sensor, to collect image data. The electronic device may further be installed with various software applications that are used to drive the photographing apparatus to capture an image, such as a photographing application, a video calling application, or an online video shooting application. A user may start the foregoing various types of applications to take a photo or a video by using the photographing apparatus. In addition, the user may further perform personalized settings of various types of image beautification by using these types of applications. The video calling application is used as an example. The user may select, during a video call, to perform automatic adjustment (for example, “one-click beautification”) on an image (for example, a presented facial portrait or a presented background image) presented on a screen. After the user starts the foregoing various types of applications or starts the foregoing various types of applications and selects image beautification, an image processing service supported by the foregoing various types of applications in the electronic device may trigger the electronic device to process image data collected by the photographing apparatus, to present a processed image on the screen of the electronic device, thereby achieving image beautification effect. The image beautification may include, for example, but is not limited to: increasing brightness of a part or the entire image, changing a display color of the image, performing skin smoothing on a face object presented in the image, adjusting image saturation, adjusting image exposure, adjusting image brightness, adjusting image highlight, adjusting image contrast, adjusting image sharpness, or adjusting image definition. The image processing described in this embodiment of this disclosure may include but not be limited to: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, gamma calibration, or red-green-blue (RGB)-to-YUV (YCrCb) domain conversion, thereby achieving the foregoing image beautification effect. Based on the electronic apparatus in this embodiment of this disclosure, in a specific application scenario, after a user A starts the image processing service, when a video call is performed between the user A and a user B, an image presented on a screen of an electronic device used by the user A and an image of the user A presented on a screen of an electronic device used by the user B may be images processed by the electronic apparatus in this embodiment of this disclosure. In addition, the processed images are always presented until the user A ends the video call with the user B or the user A disables the image processing service.
In this embodiment of this disclosure, the AI processor 101 may include a dedicated neural processor such as a neural network processor (NPU), and includes but is not limited to a convolutional neural network processor, a tensor processor, or a neural processing engine. The AI processor may be independently used as a component or integrated into another digital logic device. The digital logic device includes but is not limited to: a CPU (central processing unit), a GPU (graphics processing unit), or a DSP (digital signal processor). For example, the CPU, the GPU, and the DSP are all processors in the system on chip. The AI processor 101 may perform one or more image processing operations. The one or more image processing operations may include but are not limited to: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, or gamma calibration. The AI processor 101 may run one or more image processing models, and each image processing model is configured to perform a specific image processing operation. For example, an image processing model for noise cancellation is used to perform an image processing operation for noise cancellation, and an image processing model for demosaicing is used to perform an image processing operation for demosaicing. Each image processing model may be obtained by training a neural network based on a training sample in a conventional neural network training method. Details are not described in this embodiment of this disclosure. The ISP 102 may be configured with a plurality of hardware modules or run a necessary software program to process an image or communicate with the AI processor 101. The ISP 102 and the AI processor 101 may communicate with each other in a hardware direct connection manner (for example, related descriptions in embodiments shown in
In this embodiment of this disclosure, image data obtained from a photographing apparatus 105 may be processed by using a plurality of image processing processes to generate a final image processing result. The plurality of image processing processes may include but are not limited to: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, gamma calibration, or RGB-to-YUV domain conversion. The AI processor 101 may perform one or more processes in the foregoing image processing processes, that is, corresponding to the foregoing one or more image processing operations, the ISP 102 may also perform one or more processes in the foregoing image processing processes. The AI processor 101 and the ISP 102 may perform different image processing processes. In addition, the AI processor 101 and the ISP 102 may also perform a same image processing process, for example, perform further enhancement processing. This is not limited in this embodiment. When the AI processor 101 and the ISP 102 perform the same image processing process, image processing performed by the AI processor 101 may be used as enhancement or supplement to the image processing processes. For example, when the AI processor 101 and the ISP 102 simultaneously perform a noise cancellation process, the ISP 102 is configured to perform initial denoising, and the AI processor 101 is configured to perform secondary denoising based on the initial denoising of the ISP 102. Therefore, the entire image processing process includes a plurality of processing processes, and the plurality of processing processes are allocated to the AI processor 101 and the ISP 102 as tasks. This is equivalent to that before the ISP 102 completes all the processing processes, the AI processor 101 replaces a conventional ISP to perform some processing processes, and a final processing result is output by the ISP 102.
According to the electronic apparatus 100 shown in this embodiment of this disclosure, after the AI processor 101 performs one or more image processing processes on the image data, the ISP 102 performs the remaining image processing process. The AI processor 101 may replace the ISP 102 to perform partial processing, to avoid an information loss of original image data caused by an insufficient processing capability of the ISP 102 in the image processing processes, and improve image processing effect. In addition, in some other implementations, when some image processing processes performed by the conventional ISP cannot achieve preset effect, the image processing process performed by the AI processor 101 may be performed in a plurality of image processing processes performed by the ISP 102 (for example, embodiments of
The following describes in detail a process in which the AI processor 101 is combined with the ISP 102 to perform image processing and a hardware structure of an electronic apparatus corresponding to each image processing process. Refer to
Based on the image processing steps shown in
Further, in a possible implementation, an interrupt signal Z1 is transmitted between the AI processor 101 and the image processing module 02 in the ISP 102 through an electronic line connection L1, and the interrupt signal Z1 indicates the image processing module 02 to store the image signal A to the on-chip RAM. An interrupt signal Z2 is transmitted between the AI processor 101 and the image processing module 03 in the ISP 102 through an electronic line connection L2, and the interrupt signal Z2 indicates the AI processor 101 to store the image signal B to the on-chip RAM. The AI processor shown in
In a specific scenario, the ISP 102 obtains image data from the photographing apparatus 105. After shadow calibration and white balance calibration processing are sequentially performed on the image data by respectively using the image processing module 01 and the image processing module 02, an image signal A is generated and stored to the on-chip RAM. After storing the image signal A to the on-chip RAM, the image processing module 02 sends the interrupt signal Z1 to the AI processor 101 through the electronic line connection L1. The AI processor 101 obtains the image signal A from the on-chip RAM in response to the interrupt signal Z1. The AI processor 101 performs demosaicing processing on the image signal A to generate an image signal B, and stores the image signal B to the on-chip RAM. The AI processor 101 stores the image signal B to the on-chip RAM, and then sends the interrupt signal Z2 to the image processing module 03. In response to the interrupt signal Z2, the image processing module 03 reads the image signal B from the on-chip RAM. After color difference calibration, . . . , gamma calibration, and RGB-to-YUV domain conversion processing are sequentially performed on the image signal B by respectively using the image processing module 03, . . . , the image processing module N, and the image processing module N+1 in the ISP 102, a final image processing result is generated. It should be noted that more image processing modules may be further included before the image processing module 01, so that the ISP 102 performs more image processing processes on the image data.
In an embodiment, the electronic line connection between the AI processor 101 and the ISP 102 is also referred to as a physical connection or an interrupt connection. The AI processor 101 and the ISP 102 implement sending and receiving of an interrupt signal through the connection, so that the interrupt signal does not need to be forwarded by another processor such as a CPU, and does not need to be relatedly controlled by the CPU. This can improve a transmission speed of the interrupt signal, and can reduce an image output delay in some real-time videos, which helps improve user experience. The interrupt connection includes an interrupt signal processing hardware circuit configured to implement sending and receiving functions of the interrupt signal and a connection line for transmitting a signal, to implement receiving and sending of the interrupt signal. The interrupt signal processing hardware circuit includes but is not limited to a conventional interrupt controller circuit. For a specific implementation solution of the interrupt signal processing hardware circuit, refer to related descriptions of the interrupt controller in the conventional technology, and details are not described herein again.
In embodiments shown in
In
Still refer to
In this embodiment of this disclosure, in a procedure of performing the plurality of processing processes on the image data to obtain the image processing result, the AI processor 101 may perform a plurality of continuous image processing processes to process the image data or an image signal, as shown in embodiments shown in
Based on the image processing steps shown in
Based on the electronic apparatus shown in
In addition, when the ISP 102 stores, in the form of the image block, the image block to the on-chip RAM shown in
In a possible implementation of this embodiment of this disclosure, the electronic apparatus further includes an off-chip memory 106, as shown in
For example, the memory 103, for example, the on-chip RAM, may be configured to store a single frame of image or an image block in a single frame of image. The off-chip memory 106 is configured to store a plurality of frames of images. Therefore, for the method shown in
In this embodiment of this disclosure, the electronic apparatus 100 may further include a controller 104, as shown in
In this embodiment of this disclosure, the image data usually has a preset clock cycle T from a time at which processing is started to a time at which a final image processing result is generated. Based on different image processing models run by the AI processor or different image processing processes executed by the AI processor, duration, in the clock cycle T, occupied when the AI processor executes the image processing process is different. For example, the clock cycle T, of the image data, from the time at which processing is started to the time at which the final image processing result is 33.3 ms, and the duration of performing image processing by the AI processor is 18 ms. In other words, the AI processor is in an idle state in half of the clock cycle T. Based on this, to improve utilization of the AI processor and improve running efficiency of the electronic apparatus, in a possible implementation, the controller 104 may further determine running duration of the used image processing model. When determining that the running duration of the image processing model in the clock cycle T is less than a preset threshold, the controller 104 may further allocate idle time of the AI processor to another AI service. The another AI service may include but not be limited to: a biometric recognition (for example, face recognition or fingerprint recognition) service and a service of adding special effect to an image (for example, adding an object to an image). In this case, an executable program or a parameter of an AI model used to execute the another AI service may also be stored in the off-chip memory 106. Further, when a storage capacity of the memory 103 is large enough, the executable program or the parameter of the AI model of the another AI service may also be stored in the memory 103.
In another possible implementation, the controller 104 may include a plurality of independent controllers, and each of the plurality of independent controllers may be a digital logic device (for example, including but not limited to a GPU or a DSP). The plurality of independent controllers include an ISP controller configured to control running of components in the ISP 102 and an AI controller configured to control running of components in the AI processor 101. In this case, the AI controller may be integrated inside the AI processor 101. In this implementation, the ISP controller and the AI controller may transmit information in an inter-core communication manner. For example, after determining the selected image processing model based on the image data, the ISP controller may send various configuration information to the AI controller before image processing. The configuration information may include but not be limited to: address information of the executable program of the image processing model in the memory 103 or the off-chip memory 106, or priority information of each of the plurality of image processing models. In addition, information transmission between the AI processor 101 and the ISP 102 may also be implemented through communication between the ISP controller and the AI controller. For example, when no electronic line connection is provided between the AI processor 101 and the ISP 102 to transmit the interrupt signal, the ISP 102 may store the image signal to the on-chip RAM and then notify the ISP controller. The ISP controller sends, to the AI controller, information indicating that the image signal is stored to the on-chip RAM. The AI controller controls the computing unit in the AI processor 101 to read the image signal from the on-chip RAM to perform image processing. After storing the image signal to the on-chip RAM, the computing unit in the AI processor 101 notifies the AI controller. The AI controller sends, to the ISP controller, information indicating that the image signal is stored to the on-chip RAM. The ISP controller ISP 102 reads the image signal from the on-chip RAM for processing.
In this embodiment, the electronic apparatus 100 may further include a communication unit (not shown in the figure), and the communication unit includes but is not limited to a short-distance communication unit or a cellular communication unit. The short-range communication unit exchanges information with a terminal that is located outside a mobile terminal and is configured to access the internet by running a short-range wireless communication protocol. The short-distance wireless communication protocol may include but not be limited to: various protocols supported by a radio frequency identification technology, a Bluetooth communication technology protocol, an infrared communication protocol, and the like. The cellular communication unit accesses the internet by running a cellular wireless communication protocol and a radio access network, to implement information exchange between a mobile communication unit and a server that is on the internet and that supports various applications. The communication unit may be integrated into a same SoC with the AI processor 101, the ISP 102, and the like in the foregoing embodiments, or may be disposed separately. In addition, optionally, the electronic apparatus 100 may further include a bus, an input/output port I/O, a storage controller, or the like. The storage controller is configured to control the memory 103 and the off-chip memory 106. The bus, the input/output port I/O, the storage controller, and the like may all be integrated into a same SoC with the ISP 102, the AI processor 101, and the like. It should be understood that, in actual application, the electronic apparatus 100 may include more or fewer components than those shown in
It may be understood that, to implement the foregoing functions, the electronic apparatus includes a corresponding hardware and/or software module for performing each function. With reference to the steps of each example described in embodiments disclosed in this specification, this application may be implemented in a form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or hardware driven by computer software depends on particular applications and design constraints of the technical solutions. A person skilled in the art may use different methods to implement the described functions for each particular application with reference to embodiments, but it should not be considered that the implementation goes beyond the scope of this application.
In this embodiment, the foregoing one or more processors may be divided into functional modules according to the foregoing method examples. For example, different processors corresponding to various functions may be obtained through division, or processors with two or more functions may be integrated into one processor module. The integrated module may be implemented in a form of hardware. It should be noted that, in embodiments, division into the modules is an example, and is merely logical function division. During actual implementation, another division manner may be used.
When each functional module is obtained through division based on each corresponding function,
In a possible implementation, the image signal processing module 902 is further configured to: receive the image data from the image sensor, and perform third image signal processing on the image data to obtain the first image signal.
In a possible implementation, the third image signal processing includes a plurality of processing processes, and in two adjacent processing processes in the plurality of processing processes, a previous processing process is used to generate a third image signal, and a next processing process is used to process a fourth image signal; and the AI processing module 901 is further configured to perform fourth image signal processing on the third image signal to obtain the fourth image signal.
In a possible implementation, the first image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, or gamma calibration.
In a possible implementation, the second image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, demosaicing, color difference calibration, gamma calibration, or RGB-to-YUV domain conversion.
In a possible implementation, the third image signal processing includes at least one of the following processing processes: noise cancellation, black level calibration, shadow calibration, white balance calibration, or demosaicing.
In a possible implementation, the fourth image signal processing includes at least one of the following processing processes: black level calibration, shadow calibration, white balance calibration, demosaicing, or color difference calibration.
The image processing apparatus 900 provided in this embodiment is configured to perform the image processing method performed by the electronic apparatus 100, and may achieve same effect as the foregoing implementation method or apparatus. The modules corresponding to
For example, the image processing apparatus 900 may include at least one processor and a memory. For details, refer to
An embodiment further provides a computer-readable storage medium. The computer-readable storage medium stores computer instructions, and when the computer instructions are run on a computer, the computer is enabled to perform the foregoing related method steps, to implement the image processing method in the foregoing embodiments.
This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is enabled to perform the foregoing related steps, to implement the image processing method in the foregoing embodiments.
The computer-readable storage medium or the computer program product provided in embodiments of this disclosure is configured to perform the foregoing corresponding methods. Therefore, for beneficial effect that can be achieved, refer to the beneficial effect in the foregoing corresponding methods. Details are not described herein again.
Based on the foregoing descriptions of the implementations, a person skilled in the art may understand that for the purpose of convenient and brief description, division into the foregoing functional modules is merely used as an example for illustration. During actual application, the foregoing functions can be allocated to different functional modules for implementation based on a requirement, that is, an inner structure of an apparatus is divided into different functional modules to implement all or some of the functions described above.
In addition, functional units in embodiments of this disclosure may be integrated into one product, or each of the units may exist alone physically, or two or more units are integrated into one product. Corresponding to
The foregoing descriptions are merely specific implementations of this application, but are not intended to limit the protection scope of this application. Any variation or replacement readily figured out by a person skilled in the art within the technical scope disclosed in this application shall fall within the protection scope of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.
This application is a continuation of International Application No. PCT/CN2020/115590, filed on Sep. 16, 2020, the disclosure of which is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2020/115590 | Sep 2020 | US |
Child | 18184659 | US |