ADAPTIVE ILLUMINATION FOR A TIME-OF-FLIGHT CAMERA ON A VEHICLE

Abstract

Disclosed are devices, systems and methods for capturing an image. In one aspect an electronic camera apparatus includes an image sensor with a plurality of pixel regions. The apparatus further includes an exposure controller. The exposure controller determines, for each of the plurality of pixel regions, a corresponding exposure duration and a corresponding exposure start time. Each pixel region begins to integrate incident light starting at the corresponding exposure start time and continues to integrate light for the corresponding exposure duration. In some example embodiments, at least two of the corresponding exposure durations or at least two of the corresponding exposure start times are different in the image.

Description

TECHNICAL FIELD

This document relates to image capture and processing.

BACKGROUND

A vehicle can be autonomously controlled to navigate along a path to a destination. Autonomous vehicle control uses sensors to sense the position and movement of the vehicle, and based on data from the sensors, navigates the vehicle in the presence of stationary and moving objects. Autonomous vehicle navigation can have important applications in the transportation of people, goods and services. One aspect of autonomous vehicle control, which ensures the safety of the vehicle and its passengers, as well as people and property in the vicinity of the vehicle, is analysis of images generated by image sensors on the vehicle. The images may be analyzed to determine fixed and moving obstacles in the vehicle's path, or in the vicinity of the vehicle. Improved image capture and analysis are needed to improve autonomous vehicle navigation and control.

SUMMARY

Disclosed are devices, systems and methods for processing an image. In one aspect, an electronic camera apparatus includes an image sensor with a plurality of pixel regions. The apparatus further includes an exposure controller. The exposure controller determines, for each of the plurality of pixel regions in an image, a corresponding exposure duration and a corresponding exposure start time. Each pixel region begins to integrate incident light starting at the corresponding exposure start time and continues to integrate light for the corresponding exposure duration. In some example embodiments, at least two of the corresponding exposure durations or at least two of the corresponding exposure start times are different in the image.

The following features may be included in any combination. The apparatus further includes a plurality of gating circuits, one gating circuit for each of the plurality of pixel regions, wherein each gating circuit begins exposure of one of the plurality of pixel regions at the corresponding exposure start time and continues the exposure for the corresponding exposure duration. Multiple pixel regions correspond to a portion of the image, wherein the portion of the image is of an object at a distance from the image sensor, and wherein each of the multiple pixel regions have the same exposure start time. The image is representative of a plurality of objects at different distances from the image sensor, wherein each object corresponds to a different portion of the image, and wherein each portion of the image is associated with different pixel regions each with a different corresponding exposure start time associated with one of the different distances. A light intensity at each of the plurality of pixel regions determines the corresponding exposure duration. The distance is determined by one or more sensors including a LiDAR sensor, a RADAR sensor, or an ultrasonic sensor. The one or more sensors determine positions of moving objects within a field of view of the camera. The distance is determined from a high-definition map, wherein the high-definition map includes global positioning system coordinates for road lanes and objects within a field of view of the camera. The high-definition map is updated over time as the camera moves or as moving objects change location. The high-definition map is updated by predicting the location of the camera using velocity information about the camera from global positioning system data. The high-definition map is updated by predicting the location of one of the moving objects using velocity information about the moving object determined at least in part from two or more determined positions of the moving object.

In another aspect, a method of generating an image on an electronic camera is disclosed. The method includes receiving, from one or more distance sensors, distances between an image sensor and objects imaged by the image sensor, and associating one or more pixel regions of the image sensor with each of the objects. The method further includes determining, from the received distances and the associations of the one or more pixel regions with the objects, a corresponding exposure start time for each of the pixel regions to begin exposure to incoming light, and determining, for each pixel region, a corresponding exposure duration, wherein each pixel region continues to be exposed to incoming light starting from the exposure start time and continuing for the corresponding exposure duration. At least two of the corresponding exposure durations or at least two of the corresponding exposure start times are different in the image.

In another aspect, the above-described method is embodied in the form of executable code stored in a computer-readable program medium.

In yet another aspect, a device that is configured or operable to perform the above-described method is disclosed. The device may include a processor that is programmed to implement the method.

The above and other aspects and features of the disclosed technology are described in greater detail in the drawings, the description and the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an example block diagram of a camera system, in accordance with some example embodiments;

FIG. 2 depicts an illustrative example showing a range of times for electronic shutters for various pixel regions, in accordance with some example embodiments;

FIG. 3 depicts a process, in accordance with some example embodiments; and

FIG. 4 depicts an example of an apparatus that can be used to implement some of the techniques described in the present document, in accordance with some example embodiments.

DETAILED DESCRIPTION

Visual perception in self-driving or autonomous vehicles requires high-reliability cameras in various environments such as environments that are backlit, have low lighting, and so on. Because of imbalanced light distribution or an insufficient amount of light, the setting of a global shutter speed for the entire image sensor that is imaging a scene may not be feasible. Consistent with the disclosed subject matter is a time-of-flight (ToF) camera such as a Complementary Metal Oxide Semiconductor (CMOS)/Charge-Coupled Device (CCD) camera where the exposure to light of individual pixels, or regions of pixels, can be controlled to achieve different exposures for the different pixels or regions of the image sensor. Different areas in the resulting image may be generated with different exposure start times and/or exposure durations. The different exposure start times may be determined in part from different distances between the image sensor and the objects in the image determined from a pre-built high-definition (HD) map or distance sensors such as LiDAR, RADAR, or ultrasonic distance sensors. In some example embodiments, a light source such as a flash is initiated. From the known location of the flash and the distances between the flash and the various objects, arrival times at the image sensor for the light from the objects can be determined. Other sensors may determine the light intensity received from the different objects. From the intensities of the light from the various objects, the amount of time the electronic shutter should be open for each pixel region can be determined.

The techniques described in this patent document provide shutter for individual pixels or regions of pixels. The electronic shutter control incorporates information from a high-definition map and/or distance sensors to provide better camera perception in poor lighting conditions thereby improving camera performance in autonomous driving applications.

FIG. 1 depicts an example block diagram of a camera system 100, in accordance with some example embodiments. Real-world scene 110 is an example view from a camera on an autonomous vehicle looking forward, rearward, or to a side. Image sensor 120 captures an image of the scene 110. Pixel region controller 130 controls the exposures of regions of the image sensor 120. Exposure control module 140 determines the exposure start times and the exposure durations for the various regions of image sensor 120. To determine the exposure start times, exposure control module 140 may receive distance information related to the objects in scene 110 from one or more distance sensors such as RADAR sensor 154, LiDAR sensor 152, ultrasonic sensor 156, and/or high-definition map 150. To determine the exposure durations, exposure control module 140 determines the brightness of the various regions on the image sensor 120.

In the example of scene 110, objects are included such as tree 114 and block 112. Tree 114 is closer to image sensor 120 than is box 112. Other objects may be in scene 110 (not shown) such as roads, buildings, other vehicles, road signs, bicycles, pedestrians, and the like. Some objects may be at the same distance form image sensor 120 and other objects may be at different distances. Some objects may be more brightly illuminated than other objects due to their proximity to a light source, proximity to the image sensor, and/or the reflectivity of the object. Generally closer and/or more reflective objects appear brighter at the image sensor and farther and/or less reflective objects appear less bright at the image sensor.

Image sensor 120 captures an image of the scene 110 including box 112 and tree 114 as well as other objects which are at different distances from image sensor 120. Image sensor 120 may be a two-dimensional array of pixels where each pixel generates an electrical signal related to the light intensity impinging on the pixel. When combined together, the electrical signals corresponding to the individual pixels produce an electrical representation of the image of scene 110. Image sensor 120 may include 1,000,000 pixels or any other number of pixels. Although not shown, optical components such as lenses, apertures, and/or mechanical shutters may be included in the camera which includes image sensor 120. Image sensor 120 may provide for applying an electronic shutter to individual pixels or regions of pixels. An electronic shutter is an enabling signal, or a gate, that enables a corresponding pixel or pixel region to capture incident light when the electronic shutter is open (or the enabling signal or gate is active) and to not capture incident light when the electronic shutter is closed (or the enabling signal or gate is inactive). Shown at 120 is a two-dimensional array of pixel regions including pixel regions 122, 124, 126, 128, and others. Image sensor 120 may be a charge-coupled device or any other type of image sensor that is electronically gated or shuttered.

Pixel region controller 130 controls the exposure of the pixel regions (or individual pixels) of the image sensor 120. Shown in FIG. 1 is pixel region controller 132 which controls the exposure of pixel region 122, pixel region controller 134 which controls the exposure of pixel region 124, pixel region controller 136 which controls the exposure of pixel region 126, and pixel region controller 138 which controls the exposure of pixel region 128. Controlling the exposure includes control of when the pixel region is exposed to incident light such as an exposure start time control and an exposure duration control. For example, a charge coupled device integrates charge due to the incident light starting at the exposure start time and continues to integrate for the exposure duration.

Exposure control module 140 determines the exposure start times for the various pixel regions of image sensor 120—a time when the exposure starts for each pixel region. Exposure control module 140 may receive distance information related to the objects in scene 110 from one or more sensors such as RADAR sensor 154, LiDAR sensor 152, ultrasonic sensor 156, and/or high-definition map 150 as further detailed below. For example, exposure control module 140 can determine when after a flash is initiated at the camera system 100 that the electronic shutter should open for each pixel region based on the known speed of light, the known distance between the camera sensor 120 and objects imaged at each pixel region. As an illustrative example, tree 114 may be imaged by one or more pixel regions such as pixel region 122. After a light flash (not shown in FIG. 1), the electronic shutter for pixel region 122 can remain closed after the flash until the light from the flash propagates to tree 114, is reflected from tree 114, and propagates back to pixel region 122. The electronic shutter is controlled to open at the time the light arrives at pixel region 122.

Exposure control module 140 may receive distance information related to scene 110 from one or more sensors such as RADAR sensor 154, LiDAR sensor 152, ultrasonic sensor 156 and/or high-definition map 150. As illustrative examples, exposure control module 140 may receive from LiDAR sensor 152 a distance that tree 114 is from image sensor 120; exposure control module 140 may receive from RADAR sensor 154 a distance that box 112 is from image sensor 120; exposure control module 140 may receive from ultrasonic sensor 156 distances that box 112 and tree 114 are from image sensor 120. Exposure control module 140 uses the distance information to determine the exposure start times for the pixel regions of the image sensor 120.

Exposure control module 140 determines an exposure duration for each of the various pixel regions—a length of time that the electronic shutter remains open for each pixel region after opening at each corresponding exposure start time. For example, the electronic shutter corresponding to pixel region 126 may open when light propagates from a flash to tree 112, is reflected, and propagates back to pixel region 126. In this example, the image of box 112 at pixel region 126 may be brighter that the image of tree 114 at pixel region 122. Accordingly, the exposure duration for pixel region 126 may be shorter than the exposure duration for pixel region 122. The brightness may be determined from signal levels of the pixels or pixel regions in a recent previous image. As an illustrative example, when images are taken at 30 frames per second, there are 33 milliseconds between frames and the image seen from an autonomous vehicle changes little in 33 milliseconds. In this case, pixel values in the previous image corresponding to the intensities in the previous image may be used to determine the exposure duration for the same pixel region in a later image. For example, in a first image, a pixel region may be saturated or otherwise negatively affected due to too much light exposure which may be determined using image processing of the values from the pixel region. In this example, on the next image of the same scene, the exposure duration may be reduced to prevent saturation or other negative impacts based on the values in the previous image. Objects that appear brighter at the image sensor 120 can have a shorter exposure duration. The exposure duration for each pixel region may be adjusted on successive images and the exposure duration of each pixel region may be adjusted independently from the other pixel regions. In this way, different pixel regions may have different exposure durations to generate an image that includes the correct exposure for all pixel regions.

Exposure control module 140 may receive distance information from high-definition map 150 which may include a map of known objects in the vicinity of a GPS location provided to the high-definition map 150. The high-definition map 150 may contain detailed information about roads, lanes on the roads, traffic lights, stop signs, buildings, and so on. Using GPS information locating the autonomous vehicle and camera system, the vehicle can be placed in the high-definition map 150. Accordingly, the objects stored in the map at the location of the vehicle can be located relative to the vehicle. Distances to the objects can be determined from the map and the vehicles location. The vehicle's location on the map can be updated as the vehicle moves. In some embodiments, the vehicle's location may be advanced to a later time on the map using a location, velocity, and acceleration information at the location at a starting time. In this way, the location of the vehicle may be determined less frequently and the accuracy of the vehicle location between successive location updates can be improved.

FIG. 2 depicts an illustrative example of a diagram 200 showing a range of times for the electronic shutters for various pixel regions, in accordance with some example embodiments. On the horizontal axis is time, and on the vertical axis is a representation of whether an electronic shutter corresponding to a pixel region is open at 202 thereby capturing an image, or closed at 204 thereby not capturing an image. In FIG. 2, time t_o is the earliest time that the electronic shutter of any of the pixel regions may be opened, and time t₅ is the latest time that the electronic shutter of any of the pixel regions may close. Between times t₁ and t₂ is a representation 220 of an electronic shutter control for one or more pixel regions. The electronic shutter opens at a shutter time t₁ and closes at t₂. Accordingly, in this example, t₁ is the exposure start time and the exposure duration is t₂−t₁. Representation 220 corresponds to an object closer to the image sensor than the object corresponding to representation 230. Between times t₃ and t₄ is a representation 230 of another electronic shutter control for one or more pixel regions. The electronic shutter at 230 opens at a shutter start time t₃ and closes at t₄. Accordingly, in this example, the exposure duration is t₄−t₃. FIG. 2 depicts two different electronic shutter control representations, but any number of different shutter controls may be used depending on the number of objects and their distances from the image sensor. In some example embodiments one or more pixel regions may have their electronic shutters open more than once in an image corresponding to more than one object being imaged by the same pixel region(s) where the objects are at different distances, or the distance to one object is unknown but one of several values. The exposure duration t₄−t₃ is greater that the exposure duration t₂−t₁ corresponding to the image at the pixel region(s) associated with 230 being darker and thus requiring more image capture (or integration) time than the pixel regions associated with 220.

FIG. 3 depicts a process, in accordance with some example embodiments. At 310, the process includes receiving distances between an image sensor and objects imaged by the image sensor. At 320, the process includes associating one or more pixel regions of the image sensor with each of the objects. At 330, the process includes determining, from the received distances and the associations, an exposure start time for each of the pixel regions to begin exposure to incoming light. At 340, the process includes determining, for each pixel region, a corresponding exposure duration, wherein each pixel region continues to be exposed to incoming light starting from the exposure start time and continuing for the exposure duration.

At 310, the process includes receiving distances from one or more distance sensors between an image sensor and objects imaged by the image sensor. For example, a LiDAR distance sensor may determine a first distance between the image sensor and a first object. An ultrasonic distance sensor may determine a second distance. A RADAR distance sensor may determine a third distance and/or may provide another distance measurement to an object whose distance is also determined by another distance sensor. In some example embodiments, the distance may be determined to a fixed object associated with the image sensor and the distance may be corrected by the fixed offset distance.

At 320, the process includes associating one or more pixel regions of the image sensor with each of the objects. As an illustrative example, an image sensor may have 100,000 pixel regions, each region including 100 pixels for a total of 10,000,000 pixels in the image sensor. In this example, a car is imaged on the image sensor. The image of the car occupies 1,000 pixel regions which are associated with the car object. The car is a distance from the image sensor that is determined by one or more distance sensors. Other objects may be imaged on the image sensor occupying a number of different pixel regions dependent on the size of the object and its proximity to the image sensor. Associated with the other objects that are various distances from the image sensor that are determined by the one or more distance sensors.

At 330, the process includes determining an exposure start time for each of the pixel regions based on the distances to the objects and the associations of the one or more pixel regions with the objects. The exposure start time is an amount of time after an illumination event such as a flash when the light reflected from an object arrives at the image sensor. Continuing the example above, one or more of the distance sensors may determine that the car is 100 feet from the camera. As such, the time of flight for light generated by a flash at the camera is twice the one-way time-of-flight. In this example, if the time of flight is 1 ns per foot, then 200 ns after the flash, light would arrive at the camera due to the flash. Accordingly, the exposure start time would be set to 200 ns after the flash for the 1000 pixel regions associated with the car. Because a car has a complex shape and an orientation relative to the camera and image sensor, some pixel regions may have different exposure start times according to the different distances. Pixel regions associated with other objects may have different exposure start times due to their different distances from the camera.

At 340, the process includes determining a corresponding exposure duration for each pixel region. The exposure duration is the amount of time after the exposure start time, which starts the capture of an image, that the image capture continues. For example, an exposure duration is the amount of time that a charge-coupled device camera sensor integrates charge due to incident light. Each pixel region continues to be exposed to incoming light starting from its corresponding exposure start time and continues for its corresponding exposure duration. The exposure duration may be different for pixel regions whose images have different light intensities. For example, pixel regions corresponding to bright areas of an image have shorter exposure durations than pixel regions corresponding to less bright areas. In this way, different pixel regions have different exposure durations according to the brightness of the associated image areas thereby preventing under exposed image areas and over exposed image areas. In some example images, at least two of the corresponding exposure durations or at least two of the corresponding exposure start times are different in the image.

FIG. 4 depicts an example of an apparatus 400 that can be used to implement some of the techniques described in the present document. For example, the hardware platform 400 may implement the process 300 or may implement the various modules described herein. The hardware platform 400 may include a processor 402 that can execute code to implement a method. The hardware platform 400 may include a memory 404 that may be used to store processor-executable code and/or store data. The hardware platform 400 may further include a communication interface 406. For example, the communication interface 406 may implement one or more communication protocols (LTE, Wi-Fi, Bluetooth, and so on).

Implementations of the subject matter and the functional operations described in this patent document can be implemented in various systems, semiconductor devices, camera devices, digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Implementations of aspects of the subject matter described in this specification can be implemented as one or more computer program products, e.g., one or more modules of computer program instructions encoded on a tangible and non-transitory computer readable medium for execution by, or to control the operation of, data processing apparatus. The computer readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine-readable propagated signal, or a combination of one or more of them. The term “data processing unit” or “data processing apparatus” encompasses all apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, or multiple processors or computers. The apparatus can include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them.

A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.

The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).

Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read only memory or a random-access memory or both. The essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks. However, a computer need not have such devices. Computer readable media suitable for storing computer program instructions and data include all forms of nonvolatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.

While this patent document contains many specifics, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features that may be specific to particular embodiments of particular inventions. Certain features that are described in this patent document in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.

Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Moreover, the separation of various system components in the embodiments described in this patent document should not be understood as requiring such separation in all embodiments.

Only a few implementations and examples are described and other implementations, enhancements and variations can be made based on what is described and illustrated in this patent document.

Claims

1. A method, comprising: for each of a plurality of pixel regions of an image sensor, associating the pixel region with at least one of a plurality of objects;determining an exposure duration based on light intensity received at the pixel region; anddetermining a start time for exposure of the pixel region based on the exposure duration and a distance between the at least one object and the image sensor; andobtaining an image of the plurality of objects by gating exposures of the plurality of pixel regions based on their respective start times and exposure durations.

2. The method of claim 1, wherein: the plurality of objects comprise a first object and a second object; the plurality of pixel regions comprise a first pixel region;associating each of the plurality of pixel regions with at least one of a plurality of objects comprises associating the first pixel region with the first object and the second object; anddetermining a start time for exposure of each of the plurality of pixel regions comprises: for the first pixel region, determining a first start time using a first distance between the first object and the image sensor; anddetermining a second start time using a second distance between the second object and the image sensor, wherein the first distance is different from the second distance.

3. The method of claim 2, further comprising: obtaining the image including the first object and the second object by gating the first pixel region using a gating circuit associated with the first pixel region such that the gating circuit begins exposure of the first pixel region at the first start time, continues the exposure for a first exposure duration, begins exposure of the first pixel region again at the second start time, and continues the exposure for a second exposure duration.

4. The method of claim 1, further comprising: activating a light source to illuminate at least one of the plurality of objects.

5. The method of claim 1, wherein the start time of the pixel region associated with at least one object corresponds to a time of flight of light from a light source to the at least one object and back from the at least one object to the image sensor.

6. The method of claim 1, wherein, for a current image, the exposure duration of one of the plurality of pixel regions is determined using one or more images obtained before the current image.

7. The method of claim 1, further comprising: determining a distance between each of the plurality of objects and the image sensor using at least one of a distance sensor or a high-definition map.

8. A non-transitory computer readable storage medium encoded with executable instructions for operating an image sensor that, when executed by at least one processor, cause the at least one processor to perform operations, comprising: for each of a plurality of pixel regions of the image sensor, associating the pixel region with at least one of a plurality of objects;determining an exposure duration based on light intensity received at the pixel region; anddetermining an exposure start time for the pixel region based on the exposure duration and a distance between the at least one object and the image sensor; andobtaining an image of the plurality of objects by gating exposures of the plurality of pixel regions based on their respective start times and exposure durations.

9. The non-transitory computer readable storage medium of claim 8, wherein gating exposures of the plurality of pixel regions comprises causing a gating circuit to expose each of the plurality of pixel regions by beginning exposure of the pixel region at the start time determined for the pixel region and continuing the exposure for the exposure duration determined for the pixel region.

10. The non-transitory computer readable storage medium of claim 8, wherein gating exposures of the plurality of pixel regions comprises causing a gating circuit to expose the pixel region by beginning an exposure of the pixel region at the start time determined for the pixel region and ending the exposure at an exposure end time.

11. The non-transitory computer readable storage medium of claim 8, wherein the executable instructions cause the at least one processor to perform operations, comprising: associating a first pixel region of the plurality of pixel regions with a first object and a second object of the plurality of objects;determining a first exposure start time using a first distance between the first object and the image sensor; anddetermining a second exposure start time using a second distance between the second object and the image sensor, wherein the first distance is different from the second distance.

12. The non-transitory computer readable storage medium of claim 11, wherein the executable instructions cause the at least one processor to perform operations, comprising: obtaining the image comprising the first object and the second object by gating the first pixel region using a gating circuit associated with the first pixel region such that the gating circuit begins exposure of the first pixel region at the first exposure start time, continuing the exposure for a first exposure duration, beginning exposure of the first pixel region again at the second exposure start time, and continuing the exposure for a second exposure duration.

13. The non-transitory computer readable storage medium of claim 8, wherein the operations further comprise: activating a light source to illuminate a scene including one or more of the plurality of objects.

14. The non-transitory computer readable storage medium of claim 8, wherein the exposure start time determined for a pixel region associated with an object corresponds to a time of flight of light from a light source to the object and back from the object to the image sensor.

15. An electronic camera apparatus, comprising: an image sensor with a plurality of pixel regions;an exposure controller configured to determine, for each pixel region in the plurality of pixel regions, an exposure start time and an exposure duration of the pixel region; anda plurality of gating circuits, wherein each gating circuit is configured to gate a pixel region in the plurality of pixel regions to begin exposure of the pixel region at an exposure start time, and continue the exposure for an exposure duration or end the exposure at an exposure end time,wherein each pixel region is configured to begin collecting incoming light starting at a corresponding exposure start time and continue collecting the incoming light during the corresponding exposure,wherein the exposure start time for a pixel region in the plurality of pixel regions is determined using a distance between the image sensor and an object imaged by the pixel region, andwherein the exposure duration for a pixel region in the plurality of pixel regions is determined based on light intensity received at the pixel region.

16. The apparatus of claim 15, wherein, for a first pixel region in the plurality of pixel regions, the exposure controller is configured to determine a first exposure start time using a first distance between the image sensor and a first object imaged by the first pixel region and determine a second exposure start time using a second distance between the image sensor and a second object imaged by the first pixel region, wherein the first distance is different from the second distance.

17. The apparatus of claim 16, wherein a gating circuit in the plurality of gating circuits is configured to begin exposure of the first pixel region at the first exposure start time, continue the exposure for a first exposure duration, begin exposure of the first pixel region again at the second exposure start time, and continue the exposure for a second exposure duration to obtain a single image of the first object and the second object using the image sensor.

18. The apparatus of claim 15, wherein, for an object imaged in a single image by several pixel regions in the plurality of pixel regions, at least two pixel regions in the several pixel regions have exposure start times that are different.

19. The apparatus of claim 15, wherein further comprising a shutter for each of the plurality of pixel regions configured to open at the exposure start time of the pixel region and remain open for the exposure duration of the pixel region.

20. The apparatus of claim 15, wherein the distance is determined using at least one of: a high-definition map;a LiDAR sensor,a RADAR sensor, oran ultrasonic sensor.