Patent Application
20230370702
Modern vehicles generally provide illumination by a combination of white lights (e.g., low-beam lights, high-beam lights, and fog-lights). However, mere illumination of a potential hazard may not provide enough information about the nature of the potential hazard. Consequently, the driver's ability to react appropriately to the potential hazard may be limited.
In particular embodiments, a method may provide illumination for a vehicle to illuminate and detect potential objects of interest. For example, a driver may be alerted to a detected illuminated object of interest from images of a scene illuminated and captured by the headlamp assembly. The headlamp assembly may illuminate the scene by a laser-based white light lamp or a laser-based infrared lamp and may capture images of the illuminated scene by a light sensor.
Artificial intelligence-based techniques (e.g., computer vision or machine-learning models) may be utilized to detect, identify, and assess the illuminated objects. For example, the detecting the object of interest may include segmenting the captured images to locate boundaries of the illuminated objects in the images of the scene. The detected object may be classified as an object of interest based on features of the illuminated objects in the images of the scene. From the features of the illuminated objects in the images of the scene, a level of risk of impact may be determined for each of the objects in the scene. Based on the detection of the objects of interest, an alert may be provided. The alert may also be based on the risk of impact determined for each of the objects in the scene.
The embodiments disclosed above are only examples, and the scope of this disclosure is not limited to them. Particular embodiments may include all, some, or none of the components, elements, features, functions, operations, or steps of the embodiments disclosed above. Embodiments according to the invention are in particular disclosed in the attached claims directed to a method, a storage medium, a system and a computer program product, wherein any feature mentioned in one claim category, e.g., method, can be claimed in another claim category, e.g., system, as well. The dependencies or references back in the attached claims are chosen for formal reasons only. However any subject matter resulting from a deliberate reference back to any previous claims (in particular multiple dependencies) can be claimed as well, so that any combination of claims and the features thereof are disclosed and can be claimed regardless of the dependencies chosen in the attached claims. The subject-matter which can be claimed comprises not only the combinations of features as set out in the attached claims but also any other combination of features in the claims, wherein each feature mentioned in the claims can be combined with any other feature or combination of other features in the claims. Furthermore, any of the embodiments and features described or depicted herein can be claimed in a separate claim and/or in any combination with any embodiment or feature described or depicted herein or with any of the features of the attached claims.
In particular embodiments, a method may provide illumination for a vehicle to illuminate and detect potential objects of interest. For example, a driver may be alerted to a detected illuminated object of interest from images of a scene illuminated and captured by the headlamp assembly. The headlamp assembly may illuminate the scene by a laser-based white light lamp or a laser-based infrared lamp and may capture images of the illuminated scene by a light sensor.
Artificial intelligence-based techniques (e.g., computer vision or machine-learning models) may be utilized to detect, identify, and assess the illuminated objects. For example, the detecting the object of interest may include segmenting the captured images to locate boundaries of the illuminated objects in the images of the scene. The detected object may be classified as an object of interest based on features of the illuminated objects in the images of the scene. From the features of the illuminated objects in the images of the scene, a level of risk of impact may be determined for each of the objects in the scene. Based on the detection of the objects of interest, an alert may be provided. The alert may also be based on the risk of impact determined for each of the objects in the scene.
In particular embodiments, a method may provide selective high-beam illumination for a vehicle. For example, if a traveling vehicle is within the beam field of the high-beam illumination from a laser-based lamp of the primary vehicle, the high-beam illumination may dim light output towards the other vehicle to minimize negatively affecting the driver of the other vehicle.
In response to receiving user-input about controlling a headlamp assembly, artificial intelligence-based techniques (e.g., computer vision or machine-learning models) may be utilized to detect, identify, and assess illuminated objects. For example, the detecting the object of interest may comprise segmenting the captured images to locate boundaries of the illuminated objects in the images of the scene. The detected object may be classified as an object of interest based on features of the illuminated objects in the images of the scene. From the features of the illuminated objects in the images of the scene, each of the objects in the scene may be determined as a traveling vehicle.
In particular embodiments, a method may provide for illumination for a vehicle, where the illumination distribution may be modified for spatial beam shaping. For example, when a vehicle is approaching a curve in a road, the high-beam illumination distribution may be modified to increase brightness of one or more beam subfields of the high-beam illumination within a focal region which may be the intended direction of travel.
Artificial intelligence-based techniques (e.g., computer vision or machine-learning models) may be utilized to detect, identify, and assess the focal region. The focal region for the high-beam illumination may be determined based on images captured by the light sensor. The focal region for the high-beam illumination may be based on an identified curve in front of the vehicle. The curve may be determined based on road markings or road signs or a road surface. The focal region may also be determined based on a user input for controlling vehicle movement (e.g., steering, turn-signal activation, accelerating, or braking), a kinetic state (e.g., speed or acceleration) of the vehicle, or an upcoming change in direction of the vehicle based on information defining a route of travel (e.g., based on a calculated route from a user-inputted destination or based on mapping data related to the roadway the vehicle is currently traveling on).
When the brightness of the one or more beam subfields of the high-beam illumination increases within the focal region, the total energy consumption may remain constant (i.e., there may be no increase in energy consumption when the brightness within the focal region increases).
The features for each illuminated object may comprise a shape of illuminated object based on the boundaries, a classification of illuminated object as stationary or moving, or a kinematics assessment for illuminated object. The shape of the illuminated object may be used to determine the illuminated object as a vehicle. The vehicle captured in the images of the scene may be at any angle relative to vehicle 210. For example, the vehicle captured in the images of the scene may be same-direction traveling vehicle 240A, opposite-direction traveling vehicles 240B-C, or may be a vehicle crossing in front of vehicle 210 at an intersection.
The classification of the illuminated object as stationary or moving may be used to determine illuminated object as traveling vehicle. The classification of illuminated object as stationary or moving may be based the captured images of the scene. For example, if the illuminated object changes position relative to the scene, the illuminated object may be classified as a moving vehicle. A moving vehicle may be classified as traveling vehicles 240A-C, but a stationary vehicle may not be classified as traveling vehicles 240A-C. The traveling vehicle may be further classified as an approaching or a departing vehicle based on the captured images of the scene. For example, the traveling vehicle increasing in size in subsequent captured images of the scene may be classified as an approaching vehicle and the traveling vehicle decreasing in size in subsequent captured images of the scene may be classified as a departing vehicle.
The kinematics assessment for illuminated object may be a calculated acceleration of the illuminated object, a calculated velocity of the illuminated object, a calculated relative velocity between the illuminated object and vehicle 210, or a predicted trajectory of the illuminated object. The kinematics assessment of the illuminated object may also be used to determine the path of same-direction traveling vehicle 240A or opposite-direction traveling vehicles 240B-C.
In particular embodiments, same-direction traveling vehicle 240A may be classified as traveling in the same direction as vehicle 210 and opposite-direction vehicles 240B-C may be classified as traveling in the opposite direction as vehicle 210 based on features of the traveling vehicle.
In some embodiments, beam subfields 220 may be dimmed for traveling vehicles 240A-C. Beam Subfields 220 may also dim for users on a wheel based mode of transportation (e.g., bicycles, scooters, or longboards). When and where beam subfields 220 are dimmed may be based on the path of traveling vehicles 240A-C. One or more beam subfields 220 may be dimmed at simultaneously. The number of beam subfields 220 dimmed may correlate with the number of traveling vehicles 240A. A size and shape of beam subfield 220 may correspond to a size and shape of the traveling vehicle. The size and shape of beam subfields 220 may also correspond to an area to minimize high-beam illumination glare to the driver of traveling vehicles 240A-C. The high-beam illumination glare may comprise direct light or indirect light (e.g., reflected from a mirror or other reflective surface) from headlamp assembly 235. Beam subfields 220 may also be at maximum brightness until reaching traveling vehicle boundary 260 or until threshold distance 270. Beam subfield 220 may be based on the predicted trajectory of the traveling vehicle. Beam subfield 220 may further be based on when the traveling vehicle will intersect beam field 230 or subfield 220.
The dimming of beam subfield 220 may be based on the direction of travel of traveling vehicles 240A-C. The amount of dimming of the light output within a beam subfield can vary from 0% dimming (e.g., full brightness) to 100% dimming (e.g., turned off). The dimming of beam subfield 220 may be greater in a subarea within the field of vision of a driver of traveling vehicle 240A-C than the rest of beam subfield 220 outside the driver's field of vision. The differential in dimming may reduce the glare experienced by the driver of the traveling vehicle while illuminating traveling vehicle 240A-C for the driver of the primary vehicle.
In particular embodiments, the detection of traveling vehicles 240A-C may be based on roadway 250. Roadway 250 may comprise center line 252, same-direction shoulder line 254A, and opposite-direction shoulder line 254B. Traveling vehicles 240A-C may be determined as a same-direction traveling vehicle 240A when the traveling vehicle is between center line 252 and the same-direction shoulder line 254A. Traveling vehicles 240A-C may be determined as a same-direction traveling vehicle 240B-C when the traveling vehicle is between center line 252 and the same-direction shoulder line 254B.
In particular embodiments, variable illumination pattern 200 may be increasing brightness within prescribed focal region 280. Focal region 280 may be a direction of intended travel of vehicle 210. Focal region 280 may also be an inside corner of a curve on roadway 250. Foal region 280 may also comprise one or more corners of an intersection. Focal region 280 may be based on a speed or acceleration of vehicle 210. Focal region 280 may be a region without traveling vehicles 240A-C.
In particular embodiments, focal region 280 may be determined based on curve 290 in front of vehicle 210. The road markings, such as center line 252 or shoulder lines 254A-B, or road signs in front of the vehicle may be used to determine curve 290 in front of vehicle 210. The curve may be determined based on a path, radius, or slope of curve 290. The path, radius, or slope of curve 290 may be determined based on the road markings or road signs in front of vehicle 210.
Curve 290 may also be determined based on a road surface of roadway 250 in front of vehicle 210. The road surface may comprise a constructed road surface or a natural surface compacted by regular travel.
Focal region 280 may be determined based on a predicted trajectory. The predicted trajectory may be based on detecting a user-input for controlling vehicle movement (e.g., a steering angle, a turn signal activation, or a throttle input or a brake input). The focal region may be determined based on the amount of steering angle inputted by the user. For example, a slight steering input (e.g., making a shallow turn) by the user may result in increased brightness of the focal region where the focal region is slightly off from center in the direction of the steering input, while a large steering input (e.g., making a sharp turn or U-turn) may result in the focal region being more deflected from center in the direction of the steering input. The turn signal activation may be used to determine the left or right direction of curve 290. Focal region 280 may also be determined based on a kinetic state of the vehicle. The kinetic state of the vehicle may comprise a speed or acceleration of vehicle 210. An increase in acceleration or velocity may raise the height of the focal region, and a deceleration or decrease in velocity may lower the focal region.
In particular embodiments, focal region 280 may be determined based on an upcoming change in direction of the vehicle based on information defining a route of travel. The information defining the route of travel may be inputted by the user.
The junction in front of vehicle 210 may be two or more roadways or walkways intersecting. Junctions may include, four-way 90-degree intersections, on- or off-ramps from highways, roundabouts, T-intersections, or pedestrian crosswalks across a roadway. The junction may include one or more corners.
Modify a distribution of the high-beam illumination within focal region 280 may be based on weather conditions. For example, during heavy fog weather conditions, the focal region may be lowered to reduce high-beam glare from light reflecting off the fog.
Object 510 may be detected as an object of interest. The detecting may comprise segmenting the captured images to locate boundaries of object 510 in the images of the scene. Object 510 may be partially occluded by the scene in the captured images. The detecting may further comprise classifying object 510 as being an object of interest based on features of object 510 in the images of the scene. Features of object 510 may comprise an estimation of a size of object 510, a shape of object 510 based on the boundaries, a proximity of object 510 to the vehicle, a kinematics assessment of object 510, a classification of object 510 as stationary or moving, a classification of object 510 as a live human or animal or neither, a classification of object 510 as a change in terrain, an estimated type of damage to vehicle 210 attributable to an impact with object 510. The kinematics assessment may comprise an estimated mass of object 510, a calculated acceleration of object 510, a calculated velocity of object 510, a calculated relative velocity between object 510 and vehicle 210, a predicted trajectory of object 510, an estimated force of impact with object 510; or a time to impact for the object 510, which may be classified as an object of interest. The detecting may comprise determining whether the predicted trajectory of object 510 intersects with identified roadway 560. The classifying may comprise determining a level of risk of a negative outcome associated with encountering each of the objects in the scene based on the features of the illuminated objects in the images of the scene. The negative outcome may be an outcome that poses a hazard to vehicle 210 or its occupants.
Object 510 may be classified as a live human or animal based on the shape of the illuminated object. The classification may be further based on whether the illuminated object is classified as moving. The classification of the object as moving may be based on the calculated velocity or the calculated acceleration of the illuminated object as non-zero.
In particular embodiments, displayed images 525 may contain depiction of object 540 or depiction of roadway 545. Depiction of object 540 may be based on object 510. Depiction of roadway 545 may be based on roadway 560. Displayed images 525 may also contain distance information 550 and time to impact information 555. Displayed images 525 may also contain a position of object 510, or a velocity of object 510, or a classification-based label for object 510.
In some embodiments, vehicle 210 may provide alerts by displaying a visual output or visual indicators on infotainment screen 530, heads-up display, or dash screen 535. The visual output or visual indicators may include information regarding distance to the object of interest, a classification of the object of interest, or a type of damage if vehicle 210 is impacted with the object of interest. Alerts may also be provided by emitting an auditory output by one or more speakers of vehicle 210. Alerts may also be generated haptic feedback by one or more actuators in an internal component of vehicle 210 in contact with a driver of the vehicle. The intensity of the alerts may vary with the risk of impact with the object of interest. When object 510 is classified as a live human or animal, vehicle 210 may activate sound-making devices or one or more lights external to the vehicle. The sound-making devices or one or more lights may be configured to alert the live human or animal of vehicle 210.
In some embodiments, alerts may be displayed on infotainment display 530, dash display 535, or the heads-up display at the same time. In some embodiments, alerts on the heads-up display may be displayed at a different time than the alert is displayed on infotainment display 530 or dash display 535. The alert may be displayed on the heads-up display when the driver is closer to the object of interest. For example, the heads-up display may provide a last opportunity reminder to the driver in the event the driver has not reacted to the alert displayed on infotainment display 530, dash display 535, or the auditory or haptic feedback associated with the alert. The alert may also be displayed on the heads-up display when the features of the objects of interest have changed. For example, the heads-up display may provide an additional alert when a formerly stationary animal begins to move towards the vehicle.
In particular embodiments, when the hazard is detected, one or more visual indicators, or graphics, may be shown to identify the hazard. The graphics may be projected from headlamp assembly 235 of vehicle 210. The graphics may also be projected inside the vehicle to a heads-up display. The graphics may differ depending on the hazard. For example, when the hazard is a cliff-drop off 720, the drop graphic 740 may be displayed to indicate the area as a drop. When the hazard is cliff wall 725, wall-graphic 742 may be displayed. Graphics may also comprise a highlighted path 744 to avoid the hazard. The graphics may compensate for the terrain such that the graphic is understandable by the driver. For example, the projection of the graphics may compensate for the slope of the surface the graphic is displayed upon to minimize distortion.
In particular embodiments, the alerts may be displayed on infotainment display 530 or dash display 535. The alerts may also be displayed on a heads-up display. The alerts may be projected from headlight assembly 235.
High-beam matrix lamp 1330 may increase or decrease the brightness of a portion (e.g., a subfield) of the high-beam beam field. The high-beam matrix lamp may change the brightness of a portion of the high-beam beam field without changing the brightness of another portion of the high-beam beam field. When the portion of the high-beam beam field brightness is decreased, the power consumed by the high-beam matrix lamp may decrease.
Laser high-beam lamp with infrared capabilities 1340 may provide broad-spectrum incoherent white light and infrared spectrum light. Laser high-beam lamp with infrared capabilities 1340 may also comprise a high-beam boost lamp. The high-beam boost lamp may output light about one kilometer in distance. The high-beam boost lamp may also be integrated with the laser high-beam lamp such that the laser high-beam lamp operates as a laser high-beam lamp until high-beam boost is enabled. When high-beam boost is enabled, the integrated laser high-beam lamp may operate as a high-beam boost lamp.
Laser low-beam lamp with infrared capabilities 1340 may be integrated into a single laser-based light source. Laser high-beam lamp with infrared capabilities 1340 may comprise laser high-beam 1342 and infrared high-beam 1345. Laser high-beam 1342 may also comprise the high-beam boost lamp. Infrared high-beam 1345 may be positioned as a ring about laser high-beam with high-beam boost 1342.
Laser low-beam lamp 1310 or laser low-beam lamp with infrared capabilities 1320 may output a broad-spectrum incoherent white light beam field with, by way of example and not limitation, a vertical beam spread of up to 25 degrees and the vertical beam spread may be 15 degrees above and 10 degrees below a horizontal center line of the white-light beam field. High-beam matrix lamp 1330 or laser high-beam with infrared capabilities 1340 may output a white light beam field with, by way of example and not limitation, a vertical beam spread of up to 10 degrees and the vertical beam spread may be 5 degrees above and 5 degrees below a horizontal center line of the white light beam field.
Control system 1430 may enables control of various systems on-board the vehicle. As shown in
In particular embodiments, one or more functions of the headlamps as described herein may be controlled by a Body Control Module (BCM) ECU. The BCM ECU may provide electronic controls for various components of the body of the vehicle, such as, by way of example and not limitation: exterior lighting (e.g., headlamps, side lights, rear lights, camp lights) and interior lighting (e.g., cabin lights, seatbelt lights).
In particular embodiments, one or more functions of the headlamps as described herein may be controlled in part by information provided by ECUs providing automated driving system (ADS) and/or an advanced driver assistance system (ADAS) functionality. The ADS and/or ADAS systems may be enabled by a driver of the vehicle to provide one or more functions to support driving assistance and/or automation. An Autonomy Control Module (ACM) ECU may process data captured by cameras 1420 and/or sensors 1410. In some embodiments, the ACM ECU may provide artificial intelligence functionality to provide and/or refine functions to support driving assistance and/or automation. An Autonomous Safety Module (ASM) ECU may provide functions to support driving safety by monitoring sensors that support self-driving functions. A Driver Monitoring System (DMS) ECU may provide functionality to monitor and inform the control system about the driver's level of attention (e.g., while relying on driving assistance and/or automation functions).
In particular embodiments, one or more functions of the headlamps as described herein may be controlled through a user interface displayed on a dashboard of the vehicle by an Experience Management Module (XMM) ECU. The user interface may display information and provide audio output for an infotainment system, including various views around and inside the vehicle. XMM may provide interactive controls for a number of different vehicle functions that may be controlled in conjunction with enabling the designated mode, such as, by way of example and not limitation: controlling interior and exterior lighting, vehicle displays (e.g., instrument cluster, center information display, and rear console display), audio output (e.g., audio processing, echo cancellation, beam focusing), music playback, heating, ventilation, and air conditioning (HVAC) controls, power settings, Wi-Fi connectivity, Bluetooth device connectivity, and vehicle leveling, as well as displaying information in the user interface (e.g., surround view camera feed, distance to nearest charger, and minimum range). In some embodiments, interactive controls provided by XMM may enable interaction with other modules of control system 1430. In some embodiments, functions of the ACM and the XMM may be combined together in an Autonomous eXperience Module (AXM) ECU.
In particular embodiments, one or more functions of the headlamps as described herein may be controlled in part by information provided by a Vehicle Dynamics Module (VDM) ECU may perform a number of different functions related to aspects of the vehicle's drivetrain, regenerative braking, suspension, steering, traction control, distribution of mass, aerodynamics, and driving modes. In some embodiments, a VDM ECU may, by way of example and not limitation, control vehicle acceleration, control vehicle energy regeneration, calculate torque distribution, provide traction control, control drive modes, provide odometer functions, control driveline disconnects, adjust damping, adjust roll stiffness, adjust ride height, automatically level a vehicle when on a slope, and control the emergency parking brake driver.
In particular embodiments, one or more functions of the headlamps as described herein may be controlled in part by information provided by a Telematics Control Module (TCM) ECU may provide a wireless vehicle communication gateway to support functionality such as, by way of example and not limitation, over-the-air (OTA) communication between the vehicle and the internet or the vehicle and a computing device 1450, in-vehicle navigation, vehicle-to-vehicle communication, communication between the vehicle and landscape features (e.g., automated toll road sensors, automated toll gates, power dispensers at charging stations), or automated calling functionality.
Vehicle 1400 may include one or more additional ECUs, such as, by way of example and not limitation: a Central Gateway Module (CGM) ECU, a Vehicle Access System (VAS) ECU, a Near-Field Communication (NFC) ECU, a Seat Control Module (SCM) ECU, a Door Control Module (DCM) ECU, a Rear Zone Control (RZC) ECU, a Winch Control Module (WCM) ECU. If vehicle 1400 is an electric vehicle, one or more ECUs may provide functionality related to the battery pack of the vehicle, such as a Battery Management System (BMS) ECU, a Battery Power Isolation (BPI) ECU, a Balancing Voltage Temperature (BVT) ECU, and/or a Thermal Management Module (TMM) ECU.
Networked environment 1500 may enable transmission of data and communications between any of the depicted elements. In some embodiments, such information may be communicated in only one direction (e.g., a smart road sign broadcasting information related to traffic control or delays due to construction); in other embodiments, information may include two-way communications (e.g., an automated toll gate that processes a request received from vehicle 1400 to deduct a toll from a specified account and provides confirmation of the transaction). In particular embodiments, one or more elements of networked environment 1500 may include one or more computer systems, as described in further detail with respect to
This disclosure contemplates any suitable number of computer systems 1600. This disclosure contemplates computer system 1600 taking any suitable physical form. As example and not by way of limitation, computer system 1600 may be an electronic control unit (ECU), an embedded computer system, a system-on-chip (SoC), a single-board computer system (SBC) (such as, for example, a computer-on-module (COM) or system-on-module (SOM)), a desktop computer system, a laptop or notebook computer system, a mainframe, a mesh of computer systems, a mobile telephone, a personal digital assistant (PDA), a server computing system, a tablet computer system, or a combination of two or more of these. Where appropriate, computer system 1600 may include one or more computer systems 1600; be unitary or distributed; span multiple locations; span multiple machines; span multiple data centers; or reside in a cloud, which may include one or more cloud components in one or more networks. Where appropriate, one or more computer systems 1600 may perform without substantial spatial or temporal limitation one or more steps of one or more methods described or illustrated herein. One or more computer systems 1600 may perform in real time or in batch mode one or more steps of one or more methods described or illustrated herein. One or more computer systems 1600 may perform at different times or at different locations one or more steps of one or more methods described or illustrated herein, where appropriate.
Processor 1602 (e.g., compute units 1522 and 1532) may include hardware for executing instructions, such as those making up a computer program. As an example and not by way of limitation, to execute instructions, processor 1602 may retrieve (or fetch) the instructions from an internal register, an internal cache, memory 1604, or storage 1606; decode and execute them; and then write one or more results to an internal register, an internal cache, memory 1604, or storage 1606 (e.g., storage units 1524 and 1534). Processor 1602 may include one or more internal caches for data, instructions, or addresses. This disclosure contemplates processor 1602 including any suitable number of any suitable internal caches. Processor 1602 may also include one or more instruction caches, one or more data caches, and one or more translation lookaside buffers (TLBs). Instructions in the instruction caches may be copies of instructions in memory 1604 or storage 1606, and the instruction caches may speed up retrieval of those instructions by processor 1602. Data in the data caches may be copies of data in memory 1604 or storage 1606 for instructions executing at processor 1602 to operate on; the results of previous instructions executed at processor 1602 for access by subsequent instructions executing at processor 1602 or for writing to memory 1604 or storage 1606; or other suitable data. The data caches may speed up read or write operations by processor 1602. The TLBs may speed up virtual-address translation for processor 1602. In particular embodiments, processor 1602 may include one or more internal registers for data, instructions, or addresses. This disclosure contemplates processor 1602 including any suitable number of any suitable internal registers, where appropriate. Where appropriate, processor 1602 may include one or more arithmetic logic units (ALUs); be a multi-core processor; or include one or more processors 1602. Although this disclosure describes and illustrates a particular processor, this disclosure contemplates any suitable processor.
In particular embodiments, memory 1604 includes main memory for storing instructions for processor 1602 to execute or data for processor 1602 to operate on. Computer system 1600 may load instructions from storage 1606 or another source (such as, for example, another computer system 1600) to memory 1604. Processor 1602 may then load the instructions from memory 1604 to an internal register or internal cache. To execute the instructions, processor 1602 may retrieve the instructions from the internal register or internal cache and decode them. During or after execution of the instructions, processor 1602 may write one or more results (which may be intermediate or final results) to the internal register or internal cache. Processor 1602 may then write one or more of those results to memory 1604. In particular embodiments, processor 1602 executes only instructions in one or more internal registers or internal caches or in memory 1604 (as opposed to storage 1606 or elsewhere) and operates only on data in one or more internal registers or internal caches or in memory 1604 (as opposed to storage 1606 or elsewhere). One or more memory buses (which may each include an address bus and a data bus) may couple processor 1602 to memory 1604. Bus 1612 may include one or more memory buses, as described below. In particular embodiments, one or more memory management units (MMUs) reside between processor 1602 and memory 1604 and facilitate accesses to memory 1604 requested by processor 1602. In particular embodiments, memory 1604 includes random access memory (RAM). This RAM may be volatile memory, where appropriate. Where appropriate, this RAM may be dynamic RAM (DRAM) or static RAM (SRAM). Moreover, where appropriate, this RAM may be single-ported or multi-ported RAM. This disclosure contemplates any suitable RAM. Memory 1604 may include one or more memories 1604, where appropriate. Although this disclosure describes and illustrates particular memory, this disclosure contemplates any suitable memory.
In particular embodiments, storage 1606 includes mass storage for data or instructions. As an example and not by way of limitation, storage 1606 may include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disc, a magneto-optical disc, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Storage 1606 may include removable or non-removable (or fixed) media, where appropriate. Storage 1606 may be internal or external to computer system 1600, where appropriate. Where appropriate, storage 1606 may include non-volatile, solid-state memory or read-only memory (ROM). The ROM may be mask-programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), electrically alterable ROM (EAROM), or flash memory or a combination of two or more of these. This disclosure contemplates mass storage taking any suitable physical form. Storage 1606 may include one or more storage control units facilitating communication between processor 1602 and storage 1606, where appropriate. Where appropriate, storage 1606 may include one or more storage units 1606. Although this disclosure describes and illustrates particular storage, this disclosure contemplates any suitable storage.
In particular embodiments, I/O interface 1608 includes hardware, software, or both, providing one or more interfaces for communication between computer system 1600 and one or more I/O devices. Computer system 1600 may include or be communicably connected to one or more of these I/O devices, where appropriate. One or more of these I/O devices may enable communication between a person and computer system 1600. An input device may include devices for converting different forms of volitional user input into digital signals that can be processed by computer system 1600, for example and not by way of limitation, a keyboard, a keypad, microphone (e.g., to provide audio input), a camera (e.g., to provide gesture input or facial/body expression input), a mouse or trackball, stylus, touch screen, digital glove, hand-held 3D controller, head-mounted controller, optical motion-sensing systems (comprising infrared light projectors and detectors and/or cameras), non-optical (e.g., inertial, mechanical, magnetic, or stretch sensor-based) motion-capture systems, another suitable input device, or a combination of two or more of these. An input device may include one or more sensors for capturing different types of information. An output device may include devices designed to receive digital signals from computer system 1600 and convert them to some output format, for example and not by way of limitation, a paper or other 2D-media printer, 3D printer, speaker, headphones, projector, monitor, heads-up display, vehicle, drone, robot, another suitable output device, or a combination thereof. This disclosure contemplates any suitable I/O devices and any suitable I/O interfaces 1608 for them. Where appropriate, I/O interface 1608 may include one or more device or software drivers enabling processor 1602 to drive one or more of these I/O devices. I/O interface 1608 may include one or more I/O interfaces 1608, where appropriate. Although this disclosure describes and illustrates a particular I/O interface, this disclosure contemplates any suitable I/O interface.
In particular embodiments, communication interface 1610 includes hardware, software, or both providing one or more interfaces for communication (such as, for example, packet-based communication) between computer system 1600 and one or more other computer systems 1600 or one or more networks. Communication interface 1610 may include one or more interfaces to a controller area network (CAN) or to a local interconnect network (LIN). Communication interface 1610 may include one or more of a serial peripheral interface (SPI) or an isolated serial peripheral interface (isoSPI). In some embodiments, communication interface 1610 may include a network interface controller (NIC) or network adapter for communicating with an Ethernet or other wire-based network or a wireless NIC (WNIC) or wireless adapter for communicating with a wireless network, such as a WI-FI network. This disclosure contemplates any suitable network and any suitable communication interface 1610 for it. As an example and not by way of limitation, computer system 1600 may communicate with an ad hoc network, a personal area network (PAN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or one or more portions of the Internet or a combination of two or more of these. One or more portions of one or more of these networks may be wired or wireless. As an example, computer system 1600 may communicate with a wireless PAN (WPAN) (such as, for example, a BLUETOOTH WPAN), a WI-FI network, a WI-MAX network, a cellular telephone network (such as, for example, a Global System for Mobile Communications (GSM) network), or other suitable wireless network or a combination of two or more of these. Computer system 1600 may include any suitable communication interface 1610 for any of these networks, where appropriate. Communication interface 1610 may include one or more communication interfaces 1610, where appropriate. Although this disclosure describes and illustrates a particular communication interface, this disclosure contemplates any suitable communication interface.
In particular embodiments, bus 1612 includes hardware, software, or both coupling components of computer system 1600 to each other. As an example and not by way of limitation, bus 1612 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a front-side bus (FSB), a HYPERTRANSPORT (HT) interconnect, an Industry Standard Architecture (ISA) bus, an INFINIBAND interconnect, a low-pin-count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCIe) bus, a serial advanced technology attachment (SATA) bus, a Video Electronics Standards Association local (VLB) bus, or another suitable bus or a combination of two or more of these. Bus 1612 may include one or more buses 1612, where appropriate. Although this disclosure describes and illustrates a particular bus, this disclosure contemplates any suitable bus or interconnect.
Herein, a computer-readable non-transitory storage medium or media may include one or more semiconductor-based or other integrated circuits (ICs) (such, as for example, field-programmable gate arrays (FPGAs) or application-specific ICs (ASICs)), hard disk drives (HDDs), hybrid hard drives (HHDs), optical discs, optical disc drives (ODDs), magneto-optical discs, magneto-optical drives, solid-state drives (SSDs), RAM-drives, any other suitable computer-readable non-transitory storage media, or any suitable combination of two or more of these, where appropriate. A computer-readable non-transitory storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate.
Herein, “or” is inclusive and not exclusive, unless expressly indicated otherwise or indicated otherwise by context. Therefore, herein, “A or B” means “A, B, or both,” unless expressly indicated otherwise or indicated otherwise by context. Moreover, “and” is both joint and several, unless expressly indicated otherwise or indicated otherwise by context. Therefore, herein, “A and B” means “A and B, jointly or severally,” unless expressly indicated otherwise or indicated otherwise by context.
The scope of this disclosure encompasses all changes, substitutions, variations, alterations, and modifications to the example embodiments described or illustrated herein that a person having ordinary skill in the art would comprehend. The scope of this disclosure is not limited to the example embodiments described or illustrated herein. Moreover, although this disclosure describes and illustrates respective embodiments herein as including particular components, elements, feature, functions, operations, or steps, any of these embodiments may include any combination or permutation of any of the components, elements, features, functions, operations, or steps described or illustrated anywhere herein that a person having ordinary skill in the art would comprehend. Furthermore, reference in the appended claims to an apparatus or system or a component of an apparatus or system being adapted to, arranged to, capable of, configured to, enabled to, operable to, or operative to perform a particular function encompasses that apparatus, system, component, whether or not it or that particular function is activated, turned on, or unlocked, as long as that apparatus, system, or component is so adapted, arranged, capable, configured, enabled, operable, or operative. Additionally, although this disclosure describes or illustrates particular embodiments as providing particular advantages, particular embodiments may provide none, some, or all of these advantages.
