Patent Application
20250033540
The present disclosure relates generally to the vehicle safety field. More specifically, the present disclosure pertains to techniques and approaches for identifying a child safety seat and presenting instructions to a user on proper installation of the child safety seat. Further, the present disclosure presents instructions to the user on placing and harnessing a child or a baby properly in the child safety seat.
There are several problems that may arise while installing a child safety seat. For a normal vehicle user, the installation of an accessory child seat might be difficult because there are very few visual or haptic confirmations on a correct installation. The installation process is often complicated and hard to understand from instructions and might also contradict the vehicle manual. Similarly, proper placement of a child in a child safety seat, including harnessing the belt, adjusting the chest clip, etc., are crucial for the child's safety, but several common problems can arise.
Therefore, there is a need for a system and method for guidance on installation and checking whether the child safety seat is installed properly or not, whether the child is properly placed and harnessed or not, and whether the child safety seat's adjustable parts are properly adjusted or not.
The following presents a summary to provide a basic understanding of one or more embodiments described herein. This summary is not intended to identify key or critical elements or delineate any scope of the different embodiments and/or any scope of the claims. The sole purpose of the summary is to present some concepts in a simplified form as a prelude to the more detailed description presented herein.
According to an embodiment it is a system comprising: an information system of a vehicle operable to present step-by-step instructions to guide a user in placing a child in a child safety seat; and a processor operatively connected to the information system operable to control a display of the step-by-step instructions; and wherein the processor is operable to, recognize, via a first sensor, a make, and a model of the child safety seat; recognize, via a second sensor, a height of the child, and a weight of the child that is seated in the child safety seat; generate a digital model of the placing the child in the child safety seat on the information system of the vehicle; display the step-by-step instructions for placing and harnessing of the child in the child safety seat; and wherein the processor is operable to determine an optimal adjustment of the child safety seat according to a first parameter of the child that is being placed in the child safety seat, wherein the first parameter is one or more of the height of the child and the weight of the child.
According to an embodiment it is a method comprising: recognizing, via a first sensor, a make and a model of a child safety seat in a vehicle; recognizing, via a second sensor, a child that is seated in the child safety seat, a height of the child, and a weight of the child; generating, via a processor, a digital model of the child sitting in the child safety seat on an information system of the vehicle; and displaying step-by-step instructions for placing and harnessing of the child in the child safety seat for a user; and wherein the method is operable to determine an optimal adjustment of the child safety seat according to the child that is being placed in the child safety seat.
According to an embodiment, it is a non-transitory computer-readable medium having stored thereon instructions executable by a computer system to perform operations comprising: recognizing, via a first sensor, a make and a model of a child safety seat in a vehicle; recognizing, via a second sensor, a child that is seated in the child safety seat, a height of the child, and a weight of the child; generating, via a processor, a digital model of the child sitting in the child safety seat on an information system of the vehicle; and displaying step-by-step instructions for placing and harnessing of the child in the child safety seat by a user; and wherein the step-by-step instructions on the non-transitory computer-readable medium are operable to determine an optimal adjustment of the child safety seat according to the child that is being placed in the child safety seat.
According to an embodiment, it is a system comprising: an information system of a vehicle operable to present a step-by-step instructions to guide a user in placing a child in a child safety seat; and a processor operatively connected to the information system operable to control a display of the step-by-step instructions; and wherein the processor is operable to, recognize, via a first sensor, a make, and a model of the child safety seat; recognize, via a second sensor, the child that is seated in the child safety seat, a height of the child, and a weight of the child; generate, via the processor, a digital model of the child sitting in the child safety seat on the information system of the vehicle; display and execute the step-by-step instructions for placing and harnessing of the child in the child safety seat; and automatically adjust by a control system a tautness of the belt of the child safety seat; and wherein the processor is operable to determine an optimal adjustment of the child safety seat according to the child that is being placed in the child safety seat and automatically adjust by a control system a tautness of the belt of the child safety seat.
Aspects of the present invention will now be described in more detail, with reference to the appended drawings showing exemplary embodiments of the present invention, in which:
For simplicity and clarity of illustration, the figures illustrate the general manner of construction. The description and figures may omit the descriptions and details of well-known features and techniques to avoid unnecessarily obscuring the present disclosure. The figures exaggerate the dimensions of some of the elements relative to other elements to help improve understanding of embodiments of the present disclosure. The same reference numeral in different figures denotes the same element.
Although the detailed description herein contains many specifics for the purpose of illustration, a person of ordinary skill in the art will appreciate that many variations and alterations to the details are considered to be included herein.
Accordingly, the embodiments herein are without any loss of generality to, and without imposing limitations upon, any claims set forth. The terminology used herein is for the purpose of describing particular embodiments only and is not limiting. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one with ordinary skill in the art to which this disclosure belongs.
As used herein, the articles “a” and “an” used herein refer to one or to more than one (i.e., to at least one) of the grammatical object of the article. By way of example, “an element” means one element or more than one element. Moreover, usage of articles “a” and “an” in the subject specification and annexed drawings construe to mean “one or more” unless specified otherwise or clear from context to mean a singular form.
As used herein, the terms “example” and/or “exemplary” mean serving as an example, instance, or illustration. For the avoidance of doubt, such examples do not limit the herein described subject matter. In addition, any aspect or design described herein as an “example” and/or “exemplary” is not necessarily preferred or advantageous over other aspects or designs, nor does it preclude equivalent exemplary structures and techniques known to those of ordinary skill in the art.
As used herein, the terms “first,” “second,” “third,” and the like in the description and in the claims, if any, distinguish between similar elements and do not necessarily describe a particular sequence or chronological order. The terms are interchangeable under appropriate circumstances such that the embodiments herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms “include,” “have,” and any variations thereof, cover a non-exclusive inclusion such that a process, method, system, article, device, or apparatus that comprises a list of elements is not necessarily limiting to those elements, but may include other elements not expressly listed or inherent to such process, method, system, article, device, or apparatus.
As used herein, the terms “left,” “right.” “front,” “back.” “top.” “bottom,” “over,” “under” and the like in the description and in the claims, if any, are for descriptive purposes and not necessarily for describing permanent relative positions. The terms so used are interchangeable under appropriate circumstances such that the embodiments of the apparatus, methods, and/or articles of manufacture described herein are, for example, capable of operation in other orientations than those illustrated or otherwise described herein.
No element act, or instruction used herein is critical or essential unless explicitly described as such. Furthermore, the term “set” includes items (e.g., related items, unrelated items, a combination of related items and unrelated items, etc.) and may be interchangeable with “one or more”. Where only one item is intended, the term “one” or similar language is used. Also, the terms “has,” “have,” “having.” or the like are open-ended terms. Further, the phrase “based on” means “based, at least in part, on” unless explicitly stated otherwise.
As used herein, the terms “system,” “device,” “unit,” and/or “module” refer to a different component, component portion, or component of the various levels of the order. However, other expressions that achieve the same purpose may replace the terms.
As used herein, the terms “couple,” “coupled,” “couples,” “coupling,” and the like refer to connecting two or more elements mechanically, electrically, and/or otherwise. Two or more electrical elements may be electrically coupled together, but not mechanically or otherwise coupled together. Coupling may be for any length of time, e.g., permanent, or semi-permanent or only for an instant. “Electrical coupling” includes electrical coupling of all types. The absence of the word “removably,” “removable,” and the like, near the word “coupled” and the like does not mean that the coupling, etc. in question is or is not removable.
As used herein, the term “or” means an inclusive “or” rather than an exclusive “or.” That is, unless specified otherwise, or clear from context, “X employs A or B” means any of the natural inclusive permutations. That is, if X employs A; X employs B; or X employs both A and B, then “X employs A or B” is satisfied under any of the foregoing instances.
As used herein, two or more elements or modules are “integral” or “integrated” if they operate functionally together. Two or more elements are “non-integral” if each element can operate functionally independently.
As used herein, the term “real-time” refers to operations conducted as soon as practically possible upon occurrence of a triggering event. A triggering event can include receipt of data necessary to execute a task or to otherwise process information. Because of delays inherent in transmission and/or in computing speeds, the term “real-time” encompasses operations that occur in “near” real-time or somewhat delayed from a triggering event. In a number of embodiments, “real-time” can mean real-time less a time delay for processing (e.g., determining) and/or transmitting data. The particular time delay can vary depending on the type and/or amount of the data, the processing speeds of the hardware, the transmission capability of the communication hardware, the transmission distance, etc. However, in many embodiments, the time delay can be less than approximately one second, two seconds, five seconds, or ten seconds.
As used herein, the term “approximately” can mean within a specified or unspecified range of the specified or unspecified stated value. In some embodiments, “approximately” can mean within plus or minus ten percent of the stated value. In other embodiments, “approximately” can mean within plus or minus five percent of the stated value. In further embodiments, “approximately” can mean within plus or minus three percent of the stated value. In yet other embodiments, “approximately” can mean within plus or minus one percent of the stated value.
Other specific forms may embody the present invention without departing from its spirit or characteristics. The described embodiments are in all respects illustrative and not restrictive. Therefore, the appended claims rather than the description herein indicate the scope of the invention. All variations which come within the meaning and range of equivalency of the claims are within their scope.
As used herein, the term “component” broadly construes hardware, firmware, and/or a combination of hardware, firmware, and software.
Digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them may realize the implementations and all of the functional operations described in this specification. Implementations may be as one or more computer program products i.e., one or more modules of computer program instructions encoded on a computer-readable medium for execution by, or to control the operation of, data processing apparatus. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter affecting a machine-readable propagated signal, or a combination of one or more of them. The term “computing system” encompasses all apparatus, devices, and machines for processing data, including by way of example, a programmable processor, a computer, or multiple processors or computers. The apparatus may include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them. A propagated signal is an artificially generated signal (e.g., a machine-generated electrical, optical, or electromagnetic signal) that encodes information for transmission to a suitable receiver apparatus.
The actual specialized control hardware or software code used to implement these systems and/or methods is not limiting to the implementations. Thus, any software and any hardware can implement the systems and/or methods based on the description herein without reference to specific software code.
A computer program (also known as a program, software, software application, script, or code) is written in any appropriate form of programming language, including compiled or interpreted languages. Any appropriate form, including a standalone program or a module, component, subroutine, or other unit suitable for use in a computing environment may deploy it. A computer program does not necessarily correspond to a file in a file system. A program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code). A computer program may execute on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
One or more programmable processors, executing one or more computer programs to perform functions by operating on input data and generating output, perform the processes and logic flows described in this specification. The processes and logic flows may also be performed by, and apparatus may also be implemented as, special purpose logic circuitry, for example, without limitation, a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), Application Specific Standard Products (ASSPs), System-On-a-Chip (SOC) systems, Complex Programmable Logic Devices (CPLDs), etc.
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any appropriate kind of a digital computer. A processor will receive instructions and data from a read-only memory or a random-access memory or both. Elements of a computer can include a processor for performing instructions and one or more memory devices for storing instructions and data. A computer will also include, or is operatively coupled to receive data, transfer data or both, to/from one or more mass storage devices for storing data e.g., magnetic disks, magneto optical disks, optical disks, or solid-state disks. However, a computer need not have such devices. Moreover, another device, e.g., a mobile telephone, a personal digital assistant (PDA), a mobile audio player, a Global Positioning System (GPS) receiver, etc. may embed a computer. Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including, by way of example, semiconductor memory devices (e.g., Erasable Programmable Read-Only Memory (EPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), and flash memory devices), magnetic disks (e.g., internal hard disks or removable disks), magneto optical disks (e.g. Compact Disc Read-Only Memory (CD ROM) disks, Digital Versatile Disk-Read-Only Memory (DVD-ROM) disks) and solid-state disks. Special purpose logic circuitry may supplement or incorporate the processor and the memory.
To provide for interaction with a user, a computer may have a display device, e.g., a Cathode Ray Tube (CRT) or Liquid Crystal Display (LCD) monitor, for displaying information to the user, and a keyboard and a pointing device, e.g., a mouse or a trackball, by which the user may provide input to the computer. Other kinds of devices provide for interaction with a user as well. For example, feedback to the user may be any appropriate form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and a computer may receive input from the user in any appropriate form, including acoustic, speech, or tactile input.
A computing system that includes a back-end component, e.g., a data server, or that includes a middleware component, e.g., an application server, or that includes a front-end component, e.g., a client computer having a graphical user interface or a Web browser through which a user may interact with an implementation, or any appropriate combination of one or more such back-end, middleware, or front-end components, may realize implementations described herein. Any appropriate form or medium of digital data communication, e.g., a communication network may interconnect the components of the system. Examples of communication networks include a Local Area Network (LAN) and a Wide Area Network (WAN), e.g., Intranet and Internet.
The computing system may include clients and servers. A client and server are remote from each other and typically interact through a communication network. The relationship of the client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship with each other.
Embodiments of the present invention may comprise or utilize a special purpose or general purpose computer including computer hardware. Embodiments within the scope of the present invention may also include physical and other computer-readable media for carrying or storing computer-executable instructions and/or data structures. Such computer-readable media can be any media accessible by a general purpose or special purpose computer system. Computer-readable media that store computer-executable instructions are physical storage media. Computer-readable media that carry computer-executable instructions are transmission media. Thus, by way of example and not limitation, embodiments of the invention can comprise at least two distinct kinds of computer-readable media: physical computer-readable storage media and transmission computer-readable media.
Although the present embodiments described herein are with reference to specific example embodiments it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the various embodiments. For example, hardware circuitry (e.g., Complementary Metal Oxide Semiconductor (CMOS) based logic circuitry), firmware, software (e.g., embodied in a non-transitory machine-readable medium), or any combination of hardware, firmware, and software may enable and operate the various devices, units, and modules described herein. For example, transistors, logic gates, and electrical circuits (e.g., Application Specific Integrated Circuit (ASIC) and/or Digital Signal Processor (DSP) circuit) may embody the various electrical structures and methods.
In addition, a non-transitory machine-readable medium and/or a system may embody the various operations, processes, and methods disclosed herein. Accordingly, the specification and drawings are illustrative rather than restrictive.
Physical computer-readable storage media includes RAM, ROM, EEPROM, CD-ROM or other optical disk storage (such as CDs, DVDs, etc.), magnetic disk storage or other magnetic storage devices, solid-state disks or any other medium. They store desired program code in the form of computer-executable instructions or data structures which can be accessed by a general purpose or special purpose computer.
Further, upon reaching various computer system components, program code in the form of computer-executable instructions or data structures can be transferred automatically from transmission computer-readable media to physical computer-readable storage media (or vice versa). For example, computer-executable instructions or data structures received over a network or data link can be buffered in RAM within a Network Interface Module (NIC), and then eventually transferred to computer system RAM and/or to less volatile computer-readable physical storage media at a computer system. Thus, computer system components that also (or even primarily) utilize transmission media may include computer-readable physical storage media.
Computer-executable instructions comprise, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. The computer-executable instructions may be, for example, binary, intermediate format instructions such as assembly language, or even source code. Although the subject matter herein described is in a language specific to structural features and/or methodological acts, the described features or acts described do not limit the subject matter defined in the claims. Rather, the herein described features and acts are example forms of implementing the claims.
While this specification contains many specifics, these do not construe as limitations on the scope of the disclosure or of the claims, but as descriptions of features specific to particular implementations. A single implementation may implement certain features described in this specification in the context of separate implementations. Conversely, multiple implementations separately or in any suitable sub-combination may implement various features described herein in the context of a single implementation. Moreover, although features described herein as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination may in some cases be excised from the combination, and the claimed combination may be directed to a sub-combination or variation of a sub-combination.
Similarly, while operations depicted herein in the drawings in a particular order to achieve desired results, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the implementations should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems may be integrated together in a single software product or packaged into multiple software products.
Even though particular combinations of features are recited in the claims and/or disclosed in the specification, these combinations are not intended to limit the disclosure of possible implementations. Other implementations are within the scope of the claims. For example, the actions recited in the claims may be performed in a different order and still achieve desirable results. In fact, many of these features may be combined in ways not specifically recited in the claims and/or disclosed in the specification. Although each dependent claim may directly depend on only one claim, the disclosure of possible implementations includes each dependent claim in combination with every other claim in the claim set.
Further, a computer system including one or more processors and computer-readable media such as computer memory may practice the methods. In particular, one or more processors execute computer-executable instructions, stored in the computer memory, to perform various functions such as the acts recited in the embodiments.
Those skilled in the art will appreciate that the invention may be practiced in network computing environments with many types of computer system configurations including personal computers, desktop computers, laptop computers, message processors, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile telephones, PDAs, pagers, routers, switches, etc. Distributed system environments where local and remote computer systems, which are linked (either by hardwired data links, wireless data links, or by a combination of hardwired and wireless data links) through a network, both perform tasks may also practice the invention. In a distributed system environment, program modules may be located in both local and remote memory storage devices.
The following terms and phrases, unless otherwise indicated, shall be understood to have the following meanings.
As used herein, the term “Cryptographic protocol” is also known as security protocol or encryption protocol. It is an abstract or concrete protocol that performs a security-related function and applies cryptographic methods often as sequences of cryptographic primitives. A protocol describes usage of algorithms. A sufficiently detailed protocol includes details about data structures and representations, to implement multiple, interoperable versions of a program.
Secure application-level data transport widely uses cryptographic protocols. A cryptographic protocol usually incorporates at least some of these aspects: key agreement or establishment, entity authentication, symmetric encryption, and message authentication material construction, secured application-level data transport, non-repudiation methods, secret sharing methods, and secure multi-party computation.
Networking switches use cryptographic protocols, like Secure Socket Layer (SSL) and Transport Layer Security (TLS), the successor to SSL, to secure data communications over a wireless network.
As used herein, the term “Unauthorized access” is when someone gains access to a website, program, server, service, or other system using someone else's account or other methods. For example, if someone kept guessing a password or username for an account that was not theirs until they gained access, it is considered unauthorized access.
As used herein, the term “IoT” stands for Internet of Things which describes the network of physical objects “things” or objects embedded with sensors, software, and other technologies for the purpose of connecting and exchanging data with other devices and systems over the internet.
As used herein “Machine learning” refers to algorithms that give a computer the ability to learn without explicit programming, including algorithms that learn from and make predictions about data. Machine learning techniques include, but are not limited to, support vector machine, artificial neural network (ANN) (also referred to herein as a “neural net”), deep learning neural network, logistic regression, discriminant analysis, random forest, linear regression, rules-based machine learning. Naive Bayes, nearest neighbor, decision tree, decision tree learning, and hidden Markov, etc. For the purposes of clarity, part of a machine learning process can use algorithms such as linear regression or logistic regression. However, using linear regression or another algorithm as part of a machine learning process is distinct from performing a statistical analysis such as regression with a spreadsheet program. The machine learning process can continually learn and adjust the classifier as new data becomes available and does not rely on explicit or rules-based programming. The ANN may be featured with a feedback loop to adjust the system output dynamically as it learns from the new data as it becomes available. In machine learning, backpropagation and feedback loops are used to train the Artificial Intelligence/Machine Learning (AI/ML) model improving the model's accuracy and performance over time.
Statistical modeling relies on finding relationships between variables (e.g., mathematical equations) to predict an outcome.
As used herein, the term “Data mining” is a process used to turn raw data into useful information.
As used herein, the term “Data acquisition” is the process of sampling signals that measure real world physical conditions and converting the resulting samples into digital numeric values that a computer manipulates. Data acquisition systems typically convert analog waveforms into digital values for processing. The components of data acquisition systems include sensors to convert physical parameters to electrical signals, signal conditioning circuitry to convert sensor signals into a form that can be converted to digital values, and analog-to-digital converters to convert conditioned sensor signals to digital values. Stand-alone data acquisition systems are often called data loggers.
As used herein, the term “Dashboard” is a type of interface that visualizes particular Key Performance Indicators (KPIs) for a specific goal or process. It is based on data visualization and infographics.
As used herein, a “Database” is a collection of organized information so that it can be easily accessed, managed, and updated. Computer databases typically contain aggregations of data records or files.
As used herein, the term “Data set” (or “Dataset”) is a collection of data. In the case of tabular data, a data set corresponds to one or more database tables, where every column of a table represents a particular variable, and each row corresponds to a given record of the data set in question. The data set lists values for each of the variables, such as height and weight of an object, for each member of the data set. Each value is known as a datum. Data sets can also consist of a collection of documents or files.
As used herein, a “Sensor” is a device that measures physical input from its environment and converts it into data that is interpretable by either a human or a machine. Most sensors are electronic, which presents electronic data, but some are simpler, such as a glass thermometer, which presents visual data.
The term “infotainment system” or “in-vehicle infotainment system” (IVI) as used herein refers to a combination of vehicle systems which are used to deliver entertainment and information. In an example, the information may be delivered to the driver and the passengers of a vehicle/occupants through audio/video interfaces, control elements like touch screen displays, button panel, voice commands, and more. Some of the main components of an in-vehicle infotainment systems are integrated head-unit, heads-up display, high-end Digital Signal Processors (DSPs), and Graphics Processing Units (GPUs) to support multiple displays, operating systems, Controller Area Network (CAN), Low-Voltage Differential Signaling (LVDS), and other network protocol support (as per the requirement), connectivity modules, automotive sensors integration, digital instrument cluster, etc.
The term “environment” or “surrounding” as used herein refers to surroundings and the space in which a vehicle is navigating. It refers to dynamic surroundings in which a vehicle is navigating which includes other vehicles, obstacles, pedestrians, lane boundaries, traffic signs and signals, speed limits, potholes, snow, water logging etc.
The term “autonomous mode” as used herein refers to an operating mode which is independent and unsupervised.
The term “vehicle” as used herein refers to a thing used for transporting people or goods. Automobiles, cars, trucks, buses etc. are examples of vehicles.
The term “autonomous vehicle” also referred to as self-driving vehicle, driverless vehicle, robotic vehicle as used herein refers to a vehicle incorporating vehicular automation, that is, a ground vehicle that can sense its environment and move safely with little or no human input. Self-driving vehicles combine a variety of sensors to perceive their surroundings, such as thermographic cameras, Radio Detection and Ranging (RADAR), Light Detection and Ranging (LIDAR), Sound Navigation and Ranging (SONAR), Global Positioning System (GPS), odometry and inertial measurement unit. Control systems, designed for the purpose, interpret sensor information to identify appropriate navigation paths, as well as obstacles and relevant signage.
The term “communication module” or “communication system” as used herein refers to a system which enables the information exchange between two points. The process of transmission and reception of information is called communication. The elements of communication include but are not limited to a transmitter of information, channel or medium of communication and a receiver of information.
The term “autonomous communication” as used herein comprises communication over a period with minimal supervision under different scenarios and is not solely or completely based on pre-coded scenarios or pre-coded rules or a predefined protocol. Autonomous communication, in general, happens in an independent and an unsupervised manner. In an embodiment, a communication module is enabled for autonomous communication.
The term “connection” as used herein refers to a communication link. It refers to a communication channel that connects two or more devices for the purpose of data transmission. It may refer to a physical transmission medium such as a wire, or to a logical connection over a multiplexed medium such as a radio channel in telecommunications and computer networks. A channel is used for the information transfer of, for example, a digital bit stream, from one or several senders to one or several receivers. A channel has a certain capacity for transmitting information, often measured by its bandwidth in Hertz (Hz) or its data rate in bits per second. For example, a Vehicle-to-Vehicle (V2V) communication may wirelessly exchange information about the speed, location and heading of surrounding vehicles.
The term “communication” as used herein refers to the transmission of information and/or data from one point to another. Communication may be by means of electromagnetic waves. Communication is also a flow of information from one point, known as the source, to another, the receiver. Communication comprises one of the following: transmitting data, instructions, information or a combination of data, instructions, and information. Communication happens between any two communication systems or communicating units. The term communication, herein, includes systems that combine other more specific types of communication, such as: V2I (Vehicle-to-Infrastructure), V2N (Vehicle-to-Network), V2V (Vehicle-to-Vehicle), V2P (Vehicle-to-Pedestrian), V2D (Vehicle-to-Device), V2G (Vehicle-to-Grid), and Vehicle-to-Everything (V2X) communication.
Further, the communication apparatus is configured on a computer with the communication function and is connected for bidirectional communication with the on-vehicle emergency report apparatus by a communication line through a radio station and a communication network such as a public telephone network or by satellite communication through a communication satellite. The communication apparatus is adapted to communicate, through the communication network, with communication terminals.
The term “Vehicle-to-Vehicle (V2V) communication” refers to the technology that allows vehicles to broadcast and receive messages. The messages may be omni-directional messages, creating a 360-degree “awareness” of other vehicles in proximity. Vehicles may be equipped with appropriate software (or safety applications) that can use the messages from surrounding vehicles to determine potential crash threats as they develop.
The term “V2X communication” as used herein refers to transmission of information from a vehicle to any entity that may affect the vehicle, and vice versa. Depending on the underlying technology employed, there are two types of V2X communication technologies: cellular networks and other technologies that support direct device-to-device communication (such as Dedicated Short-Range Communication (DSRC), Port Community System (PCS), Bluetooth®, Wi-Fi®, etc.).
The term “protocol” as used herein refers to a procedure required to initiate and maintain communication; a formal set of conventions governing the format and relative timing of message exchange between two communications terminals; a set of conventions that govern the interactions of processes, devices, and other components within a system; a set of signaling rules used to convey information or commands between boards connected to the bus; a set of signaling rules used to convey information between agents; a set of semantic and syntactic rules that determine the behavior of entities that interact; a set of rules and formats (semantic and syntactic) that determines the communication behavior of simulation applications; a set of conventions or rules that govern the interactions of processes or applications between communications terminals; a formal set of conventions governing the format and relative timing of message exchange between communications terminals; a set of semantic and syntactic rules that determine the behavior of functional units in achieving meaningful communication; a set of semantic and syntactic rules for exchanging information.
The term “communication protocol” as used herein refers to standardized communication between any two systems. An example communication protocol is a DSRC protocol. The DSRC protocol uses a specific frequency band (e.g., 5.9 GHZ) and specific message formats (such as the Basic Safety Message, Signal Phase and Timing, and Roadside Alert) to enable communications between vehicles and infrastructure components, such as traffic signals and roadside sensors. DSRC is a standardized protocol, and its specifications are maintained by various organizations, including the IEEE and SAE International.
The term “bidirectional communication” as used herein refers to an exchange of data between two components. In an example, the first component can be a vehicle and the second component can be an infrastructure that is enabled by a system of hardware, software, and firmware.
The term “alert” or “alert signal” refers to a communication to attract attention. An alert may include visual, tactile, audible alert, and a combination of these alerts to warn drivers or occupants. These alerts allow receivers, such as drivers or occupants, the ability to react and respond quickly.
The term “in communication with” as used herein, refers to any coupling, connection, or interaction using signals to exchange information, message, instruction, command, and/or data, using any system, hardware, software, protocol, or format regardless of whether the exchange occurs wirelessly or over a wired connection.
As used herein, the term “network” refers to one or more data links that enable the transport of electronic data between computer systems and/or modules and/or other electronic devices. When a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) transfers or provides information to a computer, the computer properly views the connection as a transmission medium. A general purpose or special purpose computer access transmission media that can include a network and/or data links which carry desired program code in the form of computer-executable instructions or data structures. The scope of computer-readable media includes combinations of the above, that enable the transport of electronic data between computer systems and/or modules and/or other electronic devices. The network may include one or more networks or communication systems, such as the Internet, the telephone system, satellite networks, cable television networks, and various other private and public networks. In addition, the connections may include wired connections (such as wires, cables, fiber optic lines, etc.), wireless connections, or combinations thereof. Furthermore, although not shown, other computers, systems, devices, and networks may also be connected to the network. Network refers to any set of devices or subsystems connected by links joining (directly or indirectly) a set of terminal nodes sharing resources located on or provided by network nodes. The computers use common communication protocols over digital interconnections to communicate with each other. For example, subsystems may comprise the cloud. Cloud refers to servers that are accessed over the Internet, and the software and databases that run on those servers.
The term “electronic control unit” (ECU), also known as an “electronic control module” (ECM), is usually a module that controls one or more subsystems. Herein, an ECU may be installed in a car or other motor vehicle. It may refer to many ECUs, and can include but not limited to, Engine Control Module (ECM), Powertrain Control Module (PCM), Transmission Control Module (TCM), Brake Control Module (BCM) or Electronic Brake Control Module (EBCM), Central Control Module (CCM), Central Timing Module (CTM), General Electronic Module (GEM), Body Control Module (BCM), and Suspension Control Module (SCM). ECUs together are sometimes referred to collectively as the vehicles' computer or vehicles' central computer and may include separate computers. In an example, the electronic control unit can be an embedded system in automotive electronics. In another example, the electronic control unit is wirelessly coupled with automotive electronics.
The terms “non-transitory computer-readable medium” and “computer-readable medium” include a single medium or multiple media such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. Further, the terms “non-transitory computer-readable medium” and “computer-readable medium” include any tangible medium that is capable of storing, encoding, or carrying a set of instructions for execution by a processor that, for example, when executed, cause a system to perform any one or more of the methods or operations disclosed herein. As used herein, the term “computer readable medium” is expressly defined to include any type of computer readable storage device and/or storage disk and to exclude propagating signals.
The term “Vehicle Data bus” as used herein represents the interface to the vehicle data bus (e.g., CAN, LIN, Ethernet/IP, FlexRay, and MOST) that may enable communication between the Vehicle on-board equipment (OBE) and other vehicle systems to support connected vehicle applications.
The term, “handshaking” refers to an exchange of predetermined signals between agents connected by a communications channel to assure each that it is connected to the other (and not to an imposter). This may also include the use of passwords and codes by an operator. Handshaking signals are transmitted back and forth over a communications network to establish a valid connection between two stations. A hardware handshake uses dedicated wires such as the request-to-send (RTS) and clear-to-send (CTS) lines in an RS-232 serial transmission. A software handshake sends codes such as “synchronize” (SYN) and “acknowledge” (ACK) in a TCP/IP transmission.
The term “child safety seat” refers to a specialized seating device designed to protect infants and children in vehicles. It is specifically designed to provide optimal safety and protection in the event of a collision or sudden braking. Child safety seats are typically used to secure children who are too small to use the vehicle's seat belts effectively. Alternate terms for a child safety seat include, Child restraint system, Infant car seat, Toddler car seat, Baby seat, Car safety seat, Car seat for children, Child car seat, Booster seat (a type of child safety seat used for older children to elevate them for proper seat belt fit), Child harness, Infant carrier. These terms are often used interchangeably, and their usage may vary depending on the region and specific regulations governing child passenger safety.
As used herein, the term “driver” refers to such an occupant, even when that occupant is not actually driving the vehicle but is situated in the vehicle so as to be able to take over control and function as the driver of the vehicle when the vehicle control system hands over control to the occupant or driver or when the vehicle control system is not operating in an autonomous or semi-autonomous mode.
As used herein, the term “step-by-step instructions” refers to a set of clear and organized guidelines that break down a process or task into a series of sequential steps. These instructions provide a systematic approach to help users or individuals understand and perform a specific action or complete a task successfully. Each step is typically presented in a logical order, highlighting the actions required and providing any necessary details or explanations to ensure clarity. The purpose of step-by-step instructions is to provide a structured and easy-to-follow format that allows users to navigate through a process or task with confidence. The instructions aim to eliminate confusion or ambiguity by presenting a clear sequence of actions, enabling individuals to achieve the desired outcome.
As used herein, the term “digital model” refers to a computerized representation or simulation of an object, system, process, or concept. It is created using digital data and algorithms to replicate the characteristics and behavior of the real-world entity in a virtual environment. For example, digital models may be a 3D model representing objects or spaces in a three-dimensional format. They capture the shape, structure, and appearance of the physical entity and can be viewed and manipulated from different angles. For example, digital models may be simulation models to simulate the behavior or performance of a system or process. They may use mathematical algorithms and input data to predict outcomes or simulate real-world scenarios. Examples include virtual prototypes of products. They provide a virtual representation that can be analyzed, modified, and interacted with, offering valuable insights, predictions, and visualizations that aid in decision-making, design, analysis, and communication.
As used herein, the term “information system” refers to a set of interconnected components, including hardware, software, databases, networks, and people that work together to collect, store, process, transmit, and retrieve information in an organized and meaningful way. It involves the use of technology, processes, and resources to manage data and support decision-making, coordination, control, feedback, analysis, and other activities. For example, an infotainment system can be considered a type of information system. An infotainment system combines information and entertainment features within a vehicle or other consumer electronic devices. It typically includes components such as a display screen, audio system, navigation system, and connectivity features.
As used herein, the term “tautness” in relation to a seat belt refers to the state of the seat belt being properly and tightly secured around the occupant. When a seat belt is properly fastened, it should be taut or snug against the occupant's body, without any excessive slack or looseness. Ensuring the tautness of a seat belt is crucial for its effectiveness in providing protection during a vehicle collision or sudden stop. A properly tightened seat belt helps to restrain the occupant and prevent them from being thrown forward or out of their seat in the event of a crash. It is also referred to as tightness of the seat belt.
As used herein, the term “seat belt payout” refers to the process of the seat belt webbing being released from the retractor mechanism, allowing the occupant to pull the seat belt out and put it on. The payout of a seat belt is important because it determines how much slack or length of the belt is allowed to be released for the occupant to use. The payout mechanism is typically designed to be smooth and controlled, allowing the occupant to easily pull the belt out to the desired length and then locking in place when the occupant stops pulling or when the belt is subjected to sudden deceleration, such as in a crash.
As used herein, the term “attachment point” also known as child restraint anchor points or Lower Anchors and Tethers for Children (LATCH) system, refers to designated locations in a vehicle where the child safety seat can be securely installed. These attachment points provide a reliable and standardized method for installing child safety seats and are intended to enhance their stability and effectiveness in protecting children during travel. The LATCH system is a standardized method for installing child safety seats in vehicles. It provides an alternative to using the vehicle's seat belts to secure the child safety seat. The LATCH system comprises lower anchors and top tethers, which are built-in attachment points in both the vehicle and the child safety seat.
As used herein, the term “routing” refers to a process of correctly threading the vehicle's seat belt through the designated belt path of the child safety seat. This ensures the secure and proper installation of the child seat in the vehicle. Routing is guiding the seat belt through specific channels or guides on the child seat to ensure it is positioned correctly and tightly secured.
As used herein, the term “indicator”, refers to a device, instrument, or sign that provides information, signals, or evidence about a specific condition, state, or process. It is used to convey or display information visually, audibly, or through other means to indicate the presence, absence, level, quality, or status of something (example, installation accuracy). Indicators are commonly used to monitor, measure, and communicate important data or changes. They serve as visual or audible cues that help users make informed decisions, take appropriate actions, or understand the current state of a system or situation.
The term “computer vision module” or “computer vision system” allows the vehicle to “see” and interpret the world around it. This system uses a combination of cameras, sensors, and other technologies such as Radio Detection and Ranging (RADAR), Light Detection and Ranging (LIDAR), Sound Navigation and Ranging (SONAR), Global Positioning System (GPS), and Machine learning algorithms, etc. to collect visual data about the vehicle's surroundings and to analyze that data in real-time. The computer vision system is designed to perform a range of tasks, including object detection, lane detection, and pedestrian recognition. It uses deep learning algorithms and other machine learning techniques to analyze the visual data and make decisions about how to control the vehicle. For example, the computer vision system may use object detection algorithms to identify other vehicles, pedestrians, and obstacles in the vehicle's path. It can then use this information to calculate the vehicle's speed and direction, adjust its trajectory to avoid collisions, and apply the brakes or accelerate as needed. It allows the vehicle to navigate safely and efficiently in a variety of driving conditions.
The term “cyber security” as used herein refers to application of technologies, processes, and controls to protect systems, networks, programs, devices, and data from cyber-attacks.
The term “cyber security module” as used herein refers to a module comprising application of technologies, processes, and controls to protect systems, networks, programs, devices and data from cyber-attacks and threats. It aims to reduce the risk of cyber-attacks and protect against the unauthorized exploitation of systems, networks, and technologies. It includes, but is not limited to, critical infrastructure security, application security, network security, cloud security, Internet of Things (IoT) security.
The term “encrypt” used herein refers to securing digital data using one or more mathematical techniques, along with a password or “key” used to decrypt the information. It refers to converting information or data into a code, especially to prevent unauthorized access. It may also refer to concealing information or data by converting it into a code. It may also be referred to as cipher, code, encipher, encode. A simple example is representing alphabets with numbers-say, ‘A’ is ‘01’, ‘B’ is ‘02’, and so on. For example, a message like “HELLO” will be encrypted as “0805121215.” and this value will be transmitted over the network to the recipient(s).
The term “decrypt” used herein refers to the process of converting an encrypted message back to its original format. It is generally a reverse process of encryption. It decodes the encrypted information so that only an authorized user can decrypt the data because decryption requires a secret key or password. This term could be used to describe a method of unencrypting the data manually or unencrypting the data using the proper codes or keys.
The term “cyber security threat” used herein refers to any possible malicious attack that seeks to unlawfully access data, disrupt digital operations, or damage information. A malicious act includes but is not limited to damaging data, stealing data, or disrupting digital life in general. Cyber threats include, but are not limited to, malware, spyware, phishing attacks, ransomware, zero-day exploits, trojans, advanced persistent threats, wiper attacks, data manipulation, data destruction, rogue software, malvertising, unpatched software, computer viruses, man-in-the-middle attacks, data breaches, Denial of Service (DOS) attacks, and other attack vectors.
The term “hash value” used herein can be thought of as fingerprints for files. The contents of a file are processed through a cryptographic algorithm, and a unique numerical value, the hash value, is produced that identifies the contents of the file. If the contents are modified in any way, the value of the hash will also change significantly. Example algorithms used to produce hash values: the Message Digest-5 (MD5) algorithm and Secure Hash Algorithm-1 (SHA1).
The term “integrity check” as used herein refers to the checking for accuracy and consistency of system related files, data, etc. It may be performed using checking tools that can detect whether any critical system files have been changed, thus enabling the system administrator to look for unauthorized alteration of the system. For example, data integrity corresponds to the quality of data in the databases and to the level by which users examine data quality, integrity, and reliability. Data integrity checks verify that the data in the database is accurate, and functions as expected within a given application.
The term “alarm” as used herein refers to a trigger when a component in a system or the system fails or does not perform as expected. The system may enter an alarm state when a certain event occurs. An alarm indication signal is a visual signal to indicate the alarm state. For example, when a cyber security threat is detected, a system administrator may be alerted via sound alarm, a message, a glowing LED, a pop-up window, etc. Alarm indication signal may be reported downstream from a detecting device, to prevent adverse situations or cascading effects.
As used herein, the term “cryptographic protocol” is also known as security protocol or encryption protocol. It is an abstract or concrete protocol that performs a security-related function and applies cryptographic methods often as sequences of cryptographic primitives. A protocol describes how the algorithms should be used. A sufficiently detailed protocol includes details about data structures and representations, at which point it can be used to implement multiple, interoperable versions of a program. Cryptographic protocols are widely used for secure application-level data transport. A cryptographic protocol usually incorporates at least some of these aspects: key agreement or establishment, entity authentication, symmetric encryption, and message authentication material construction, secured application-level data transport, non-repudiation methods, secret sharing methods, and secure multi-party computation. Hashing algorithms may be used to verify the integrity of data. Secure Socket Layer (SSL) and Transport Layer Security (TLS), the successor to SSL, are cryptographic protocols that may be used by networking switches to secure data communications over a network.
The embodiments described herein can be directed to one or more of a system, a method, an apparatus, and/or a computer program product at any possible technical detail level of integration. The computer program product can include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the one or more embodiments described herein. The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. For example, the computer readable storage medium can be, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a superconducting storage device, and/or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium can also include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon and/or any suitable combination of the foregoing. A computer readable storage medium, as used herein, does not construe transitory signals per se, such as radio waves and/or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide and/or other transmission media (e.g., light pulses passing through a fiber-optic cable), and/or electrical signals transmitted through a wire.
Computer readable program instructions described herein are downloadable to respective computing/processing devices from a computer readable storage medium and/or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device. Computer readable program instructions for carrying out operations of the one or more embodiments described herein can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, configuration data for integrated circuitry, and/or source code and/or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and/or procedural programming languages, such as the “C” programming language and/or similar programming languages. The computer readable program instructions can execute entirely on a computer, partly on a computer, as a stand-alone software package, partly on a computer and/or partly on a remote computer or entirely on the remote computer and/or server. In the latter scenario, the remote computer can be connected to a computer through any type of network, including a local area network (LAN) and/or a wide area network (WAN), and/or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider). In one or more embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), and/or programmable logic arrays (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the one or more embodiments described herein.
Aspects of the one or more embodiments described herein are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to one or more embodiments described herein. Each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions. These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer and/or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, can create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein can comprise an article of manufacture including instructions which can implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks. The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus and/or other device to cause a series of operational acts to be performed on the computer, other programmable apparatus and/or other device to produce a computer Implemented process, such that the instructions which execute on the computer, other programmable apparatus and/or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality and/or operation of possible implementations of systems, computer-implementable methods and/or computer program products according to one or more embodiments described herein. In this regard, each block in the flowchart or block diagrams can represent a module, segment and/or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In one or more alternative implementations, the functions noted in the blocks can occur out of the order noted in the Figures. For example, two blocks shown in succession can be executed substantially concurrently, and/or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and/or combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that can perform the specified functions and/or acts and/or carry out one or more combinations of special purpose hardware and/or computer instructions.
While the subject matter described herein is in the general context of computer-executable instructions of a computer program product that runs on a computer and/or computers, those skilled in the art will recognize that the one or more embodiments herein also can be implemented in combination with one or more other program modules. Program modules include routines, programs, components, data structures, and/or the like that perform particular tasks and/or implement particular abstract data types. Moreover, other computer system configurations, including single-processor and/or multiprocessor computer systems, mini-computing devices, mainframe computers, as well as computers, hand-held computing devices (e.g., PDA, phone), microprocessor-based or programmable consumer and/or industrial electronics and/or the like can practice the herein described computer-implemented methods. Distributed computing environments, in which remote processing devices linked through a communications network perform tasks, can also practice the illustrated aspects. However, stand-alone computers can practice one or more, if not all aspects of the one or more embodiments described herein. In a distributed computing environment, program modules can be located in both local and remote memory storage devices.
As used in this application, the terms “component.” “system,” “platform,” “interface.” and/or the like, can refer to and/or can include a computer-related entity or an entity related to an operational machine with one or more specific functionalities. The entities described herein can be either hardware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program and/or a computer. By way of illustration, both an application running on a server and the server can be a component. One or more components can reside within a process and/or thread of execution and a component can be localized on one computer and/or distributed between two or more computers. In another example, respective components can execute from various computer readable media having various data structures stored thereon. The components can communicate via local and/or remote processes such as in accordance with a signal having one or more data packets (e.g., data from one component interacting with another component in a local system, distributed system and/or across a network such as the Internet with other systems via the signal). As another example, a component can be an apparatus with specific functionality provided by mechanical parts operated by electric or electronic circuitry, which is operated by a software and/or firmware application executed by a processor. In such a case, the processor can be internal and/or external to the apparatus and can execute at least a part of the software and/or firmware application. As yet another example, a component can be an apparatus that provides specific functionality through electronic components without mechanical parts, where the electronic components can include a processor and/or other means to execute software and/or firmware that confers at least in part the functionality of the electronic components. In an aspect, a component can emulate an electronic component via a virtual machine, e.g., within a cloud computing system.
As it is employed in the subject specification, the term “processor” can refer to any computing processing unit and/or device comprising, but not limited to, single-core processors; single-processors with software multithread execution capability; multi-core processors; multi-core processors with software multithread execution capability; multi-core processors with hardware multithread technology; parallel platforms; and/or parallel platforms with distributed shared memory. Additionally, a processor can refer to an integrated circuit, an application specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), a programmable logic controller (PLC), a complex programmable logic device (CPLD), a discrete gate or transistor logic, discrete hardware components, and/or any combination thereof designed to perform the functions described herein. Further, processors can exploit nano-scale architectures such as, but not limited to, molecular based transistors, switches and/or gates, in order to optimize space usage and/or to enhance performance of related equipment. A combination of computing processing units can implement a processor.
Herein, terms such as “store.” “storage.” “data store.” data storage,” “database.” and any other information storage component relevant to operation and functionality of a component refer to “memory components,” entities embodied in a “memory.” or components comprising a memory. Memory and/or memory components described herein can be either volatile memory or nonvolatile memory or can include both volatile and nonvolatile memory. By way of illustration, and not limitation, nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM), flash memory, and/or nonvolatile random access memory (RAM) (e.g., ferroelectric RAM (FeRAM). Volatile memory can include RAM, which can function as external cache memory, for example. By way of illustration and not limitation, RAM can be available in many forms such as synchronous RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), Synch link DRAM (SLDRAM), direct Rambus RAM (DRRAM), direct Rambus dynamic RAM (DRDRAM) and/or Rambus dynamic RAM (RDRAM). Additionally, the described memory components of systems and/or computer-implemented methods herein include, without being limited to including, these and/or any other suitable types of memory.
The embodiments described herein include mere examples of systems and computer-implemented methods. It is, of course, not possible to describe every conceivable combination of components and/or computer-implemented methods for purposes of describing the one or more embodiments, but one of ordinary skill in the art can recognize that many further combinations and/or permutations of the one or more embodiments are possible. Furthermore, to the extent that the terms “includes,” “has.” “possesses,” and the like are used in the detailed description, claims, appendices and/or drawings such terms are intended to be inclusive in a manner similar to the term “comprising” is interpreted when employed as a transitional word in a claim.
Installing a child safety seat correctly is crucial for ensuring your child's safety while traveling in a vehicle. The specific steps may vary depending on the type and model of the child safety seat, as well as the vehicle you are using.
By introduction of more advanced vehicle interior sensing capabilities by which a vehicle will be able to identify different features in the vehicle compartment such as visual appearance, shape, weight, movement, belt payout and other parameters. By use of one or more of these monitored parameters, the vehicle may advise the user on safe configuration of, for example, accessories such as child safety seats.
By the use of the vehicle sensing capabilities and learned recognition of a correct installation, the vehicle can advise the user of potential erroneous child seat installations. There are recommendations for how a child safety seat should be installed properly. The recommendations can vary both in regards to child safety seat brand, as well as car brand.
Several parameters are to be considered when judging whether a child safety seat is installed properly, some examples being:
When a user opens the door and places a child safety seat, the child safety seat detection and identification module 104 of the system recognizes the type of child safety seat that user is installing. The child safety seat detection and identification module 104 may be installed within the vehicle that is configured to determine the type of child safety seat. The child safety seat detection and identification module 104 of the system may interface with one or more sensors comprising a camera sensor, LIDAR sensors, radar, infrared sensor, and other sensors that are inside the vehicle, that are configured to recognize the type of a child safety seat that is being attached.
Child safety seats come in various types, each designed to cater to different age groups and developmental stages of children. The child safety seat detection and identification module 104 may recognize whether the child safety seat is an infant car seat, a convertible car seat, a booster seat, a combination seat, a 3-in-1, or all-in-one seat. Further, the child safety seat detection and identification module 104 may recognize a model, make, and retrieve information about a year of manufacture, a size, a shape, and a weight of the car seat from a database or identify directly from the child safety seat. According to an embodiment of the system, the child safety seat comprises one or more of a front facing car seat, a rear facing car seat, and a booster seat.
According to an embodiment of the system, the vehicle comprises sensors to detect the height of the child. According to an embodiment of the system, the child safety seat comprises sensors to detect the height of the child. According to an embodiment of the system, the child safety seat comprises a force measurement sensor. According to an embodiment of the system, the child safety seat comprises one or more of a front facing car seat, a rear facing car seat, and a booster seat.
According to an embodiment of the system, the vehicle comprises a Radio Frequency Identification tag reader operable to recognize an object based on the Radio Frequency Identification tag. According to an embodiment of the system, the system recognizes the child safety seat via a Radio Frequency Identification tag attached to the child safety seat. According to an embodiment of the system, the system identifies the child safety seat, by detecting a shape of the child safety seat via a camera; and by detecting a weight of the child safety seat via a weight sensor installed in a seat of the vehicle. According to an embodiment of the system, the sensor comprises one or more of a camera, a LiDAR, a radar, and a Radio Frequency Identification sensor.
Once the system determines the type of child safety seat that is being attached, then the system is configured to access an installation manual via an installation requirements module 106. Accessing the manual may be according to the following embodiments:
Installation requirements module 106 may further comprise instructions on child placement and harnessing. Further the manual may comprise height and weight recommendations. It may further comprise adjustable parts of the child safety seat and adjustment recommendations based on the weight and height of the child safety seat.
In an embodiment, the system recognizes the type of child safety seat that is being installed and extracts all the information about that child safety seat. Information extracted may be through cameras, connectors, RFID, near field communications, Bluetooth®, and a combination thereof. In an embodiment, the child safety seat communicates to the vehicle regarding the type of child safety seat, its shape, size, model, safety features, year of manufacture, installation procedure, etc.
According to an embodiment of the system, the system recognizes the child safety seat via a Radio Frequency Identification tag attached to the child safety seat. According to an embodiment of the system, the system identifies the child safety seat, by detecting a shape of the child safety seat via a camera; and by detecting the weight of the child safety seat via weight sensors installed in a seat of the vehicle.
Once the system determines the type of child safety seat that is being attached, then the system assists the user via installation display and checking module 108. The child safety seat may comprise a plurality of sensors which are coupled with the vehicle and provide feedback. The system may be configured to generate a digital model of the child safety seat and display step-by-step installation instructions by using the digital model. The digital model may be either generated by the system itself or may be accessed via the instruction manual. According to an embodiment of the system, the system finds an installation requirement based on a manufacturer's manual. According to an embodiment of the system, the manufacturer's manual is accessed via a local memory. According to an embodiment of the system, the manufacturer's manual is accessed via a network. Instructions may be a video or animation, a text, and an audio or a combination of all. In an embodiment, relevant portions where focus is required may be highlighted. For example, when a belt must pass through a certain portion of the child car seat, then the relevant portion on the child safety seat digital model may be highlighted and/or animated. Further the system may also highlight the relevant portion on the child safety seat itself. In an embodiment, the child safety seat comprises sensors and indicators coupled to the digital model of the child car seat such that when the digital model indicates a certain position on the child safety seat, an indicator may glow that portion on the child safety seat. According to an embodiment of the system, the step-by-step instructions comprise one or more of a text, a figure, an audio, and an animation.
According to an embodiment of the system, the digital model comprises a 3D image generated by capturing a plurality of 2D images of the child safety seat from a plurality of angles. According to an embodiment of the system, the system is operable to capture, via a camera, an interior of the vehicle. According to an embodiment of the system, the information system presents the step-by-step instructions in a user-friendly format. According to an embodiment of the system, the processor is further operable to receive feedback from the user regarding the quality and effectiveness of the step-by-step instructions presented on the information system, and to update the step-by-step instructions based on the feedback received. According to an embodiment of the system, the processor is operable to adjust a presentation of the step-by-step instructions and diagrams based on a proficiency level of the user, wherein the proficiency level is measured based on a time taken and an accuracy of the installation for each step of the installation.
According to an embodiment of the system, the system further comprises a memory module operatively connected to the processor, wherein the memory module stores a plurality of child safety seat installation procedures and protocols, and wherein the processor selects and displays a procedure and protocol based on the make and the model of the child safety seat. According to an embodiment of the system, the processor is operable to display the step-by-step instructions in multiple languages. According to an embodiment of the system, the processor is operable to present instructional videos and animations to enhance understanding of the user for installing the child safety seat.
A system for guiding installation of child safety seats includes sensors mounted on the child safety seat for detecting a progress in a plurality of sequential installation steps. The installation steps are required for installing the car safety seat on a vehicle seat. The car safety seat further includes light emitting elements arranged at various locations, each location corresponding to one of the installation steps. A processor is adapted to execute code instructions for, in response to outputs of the sensors, identifying completion of a current installation step. The processor is further adapted to instruct a suitable light emitting element to indicate a location corresponding to an installation step following the current installation step. The sensors may be coupled with the infotainment system of the vehicle and are correlated with the instructions for installation of the child safety seat. In an embodiment, the child safety seat may be referring to a combination of a child safety seat base and the child safety seat and are addressed independently for installation purpose via various sensors on each of the components.
Installation display and checking module 108, may further comprise displaying of instruction for placing and harnessing the child, checking for proper placing, and harnessing the child, a display for guiding the user for adjusting various parts of the child safety seat.
The system may display a step and provide time to the user to take action to complete the step. The system may provide a signal, for example, an alert and/or a certain message, to indicate whether the step is completed. For example, a one beep means the step is properly executed. Two beeps may mean the step is not complete or not executed properly. For example, the seat may not have been attached the way it is supposed to be. In an embodiment, the signal may be a visual cue, an audio cue, a tactical cue, and a combination thereof. The system may then proceed to provide the next step of the step-by-step instructions. Once the user completes a step successfully and correctly, then the system will proceed to the next step. If the user is not able to finish the step completely and accurately, or if the user is taking more than a predetermined time, the system may assist with additional information. During the installation process, at each step, sensors collect data, each step and sub-step is time stamped. According to an embodiment of the system, the processor is operable to provide a time-stamped record of the installation for each step, which can be accessed and reviewed at a future time by one or more of the users and a manufacturer of the child safety seat.
An alert is provided whether the seat is attached or not properly attached. Once the seat is properly attached then the system guides the seat for attachment points and a routing of the seat belt. The system then guides the points by highlighting animation on the digital model on the routing of the seat belt and checks whether the seat belt has gone through the designated points correctly. In an embodiment, various indicators are placed at the points where the seat belt must be routed. These points on the child safety seat may glow or provide a light to attract user attention. In an embodiment the indication may be a combination of a light cue, a sound cue, and a tactile cue. In an embodiment, one or more sensors are provided on the vehicle seat belt to provide check points for example on routing, crookedness, straightness, etc.
There are typically two types of attachment points in most vehicles:
Lower Anchors: These are metal bars or loops located in the vehicle's rear seat crease, between the seat cushion and seatback. They are specifically designed to anchor the lower attachments of a child safety seat. The lower attachments of the child seat are usually equipped with connectors that can be easily attached to these lower anchor points.
Tether Anchors: Tether anchors are metal bars, loops, or hooks located either on the vehicle's rear shelf or behind the rear seat. They are used to secure the upper tether strap of the child safety seat. The tether strap is connected to the top portion of the child seat and provides additional stability by limiting the forward movement of the seat in the event of a collision.
The attachment points are typically marked with universal symbols or labels, indicating their location and purpose. They are designed to meet specific safety standards and are intended to make the installation of child safety seats more convenient and secure. It is important to consult both the vehicle owner's manual and the instructions provided by the child safety seat manufacturer for the specific location and usage of the attachment points in your particular vehicle. Properly utilizing the attachment points and following the installation instructions will help ensure the optimal safety and effectiveness of the child safety seat.
ISOFIX is an international standard for the attachment of child safety seats in vehicles. It is also known as LATCH (Lower Anchors and Tethers for Children) in the United States. The ISOFIX system provides a standardized and simplified method for securely installing child safety seats without using the vehicle's seat belt. ISOFIX is designed to make the installation of child safety seats easier and more secure by providing a standardized and fool proof attachment system. It eliminates the need for using seat belts to secure the child seat, reducing the risk of incorrect installation. Other systems include, seat belt installation method, where the child seat is secured using the vehicle's seat belt. The seat belt is threaded through the appropriate belt path on the child seat and buckled; European Belt Routing is used in some European vehicles, involving specific belt routing paths or guides on the child seat. The belt is routed behind the child seat and buckled in a designated manner; Universal Anchorage System (UAS), used in Canada, is similar to ISOFIX and includes lower anchors and top tether anchor points. These systems provide standardized methods for securely installing child safety seats in vehicles, promoting proper installation, and enhancing child passenger safety.
According to an embodiment of the system, the attachment point comprises a standard belonging to one or more of an International Standard for attachment points for child safety seats (ISOFIX), Lower Anchors and Tethers for Children (LATCH), Lower Universal Anchorage System (LUAS), CANADAFIX (CANFIX), Universal Child Safety Seat System (UCSSS).
According to an embodiment of the system, the attachment point comprises an International Organization for Standardization standard ISO 13216 (ISOFIX).
Data from the sensors on the child safety seat, vehicle seat belt, attachment points are collected via a connector which would connect to the vehicle system to confirm that the seat is attached properly, the seat belt is straight and not crooked, its tautness etc. When the user wraps the vehicle seat belt around the child safety seat, the system provides the user feedback that informs whether the vehicle seat belt is routed properly. In an embodiment, a proper routing is based on the child safety seat model, size, and shape that is recognized by the system. The system measures the tightness (tautness) of the vehicle seat belt. In an embodiment, if the vehicle seat belt is loose, the system may provide feedback to the user to tighten the vehicle seat belt. In an embodiment, the system automatically adjusts the seat belt for required tautness. In an embodiment, if the system fails to adjust the vehicle seat belt to required tautness, the system provides feedback to the user of the same and informs the user to adjust the vehicle seat belt for the required tautness. In an embodiment, the required tautness is based on manufacturer's specifications. In an embodiment, it may be based on data collected over time and the seat movement based on vehicle seat belt tautness. The system learns the correlation among vehicle seat belt tautness, and the child safety seat movement over a time, safety, comfort, child's weight, height, and the behavior. The system may then recommend a correct level of tautness based on the learned data. In an embodiment, the system may learn using artificial intelligence models. In an embodiment, the system checks for a crookedness of the vehicle seat belt. The system determines installation requirements based on safety, comfort, the child's weight and height and the behavior of the child.
In an embodiment, based on the child's height the system determines a required distance of a seat that is in front of the child safety seat and recommendation for an adjustment of the seat. In an embodiment, the system automatically adjusts for a required distance of a seat that is in front of the child safety seat. The system may assume or recommend a height of the person that may be sitting in the seat that is in front of the child safety seat. In an embodiment, the system can recommend the child safety seat be installed in another vehicle seat. According to an embodiment of the system, the object in front of the child safety seat comprises an instrument panel. According to an embodiment of the system, the object in front of the child safety seat comprises a seat of the vehicle.
The vehicle comprises a method for determining a type of child safety seat. The vehicle comprises a method for determining whether the child safety seat is properly installed. The system and/or method may use cameras and LIDAR to determine a type of child safety seat and whether the child safety seat is properly installed.
In an embodiment, based on the child's weight, height, and the behavior, the system may recommend a change in the child safety seat is required. In an embodiment, based on the child's weight, height, and the behavior, the system may recommend a tautness of the vehicle seat belt. In an embodiment, based on the child's weight, height, and the behavior, the system may recommend a required distance of a seat that is in front of the child safety seat. In an embodiment, the recommendation may consider the past data collected over a period, wherein the data may comprise a first data while the vehicle is in motion, a second data while the vehicle is not in motion, a third data when a vehicle encountered crash. In an embodiment, the system is configured to recommend even when some data points or data sets are missing.
In an embodiment, the way a user would secure a child safety seat is using a seat belt. The child safety seat or the vehicle is not taking into consideration the size, the weight of the child, or how the child behaves before considering the use or proper use of the child safety seat.
In an embodiment, the child safety seat is configured for communication. In an embodiment, the child safety seat or the vehicle is configured for performing routing of the seat belt and adjustment of the seat belt. For example, the vehicle having a physical connector or Bluetooth connector or near field connector where as soon as the user places the child safety seat, the vehicle knows the kind of child safety seat, i.e., make, model, year of manufacture, size, shape, etc., and what features the child safety seat has. Further, the system may know whether the child safety seat is properly installed by the user or not. The system will make sure that the child safety seat is properly placed. The system continues to monitor the child safety seat via sensors.
The system guides the user on how to place the child safety seat and adjust properly. The systems may check various parameters after the child safety seat is placed to determine whether it is placed straight or crooked. The system may then provide feedback if the placement is proper and correct. In an embodiment, it is displayed on the infotainment system of the vehicle. A visual effect may be displayed on the infotainment on whether the installation is correct or where it is installed in the wrong manner and how to correct the same. When the installation is performed correctly, driver or the user, may get feedback that the installation is correct via an audio beep, or a voice message saying that the “installation is not done properly, the vehicle seat belt is crooked, please check” and may animate the digital model to highlight the portions providing focus on where the user needs to check.
The system may perform various checks. For example: Is the child safety seat attached properly? Did the vehicle seat belt route through the child safety seat properly? The checks may vary based on the type of seat, for example, a booster seat, a regular seat, forward-installation, backward installation, forward facing seat, rear facing seat, etc.
In an embodiment, the system may check for various parameters when the child gets seated into the child safety seat. In an embodiment the system checks for more than one child safety seat being installed. In an embodiment, the system would check for more than one child using the same child safety seat. In an embodiment, the system may adapt the installation requirements based on the child's weight and height. The system may adapt to it, meaning that a belt tautness or tautness for a 40-pound child may be different to the child who is 60-pound. Similarly, children of different heights require different tautness. In an embodiment, sensors in the vehicle and the child safety seat are configured to detect the child height and weight. In another embodiment, the user may be able to enter the height and weight via the infotainment system. In an embodiment, the system monitors the child movement and behavior and may consider the child movement and behavior in the child safety seat while determining the tautness requirements for the vehicle seat belt. Installation of a child safety seat may be different if a child is attempting to come out of the seat. Some children may have the strength, dexterity, or curiosity to unbuckle or loosen the harness straps, making it necessary to take additional precautions during the installation process. In an embodiment, the system guides the user to properly adjust and snugly secure the harness straps around the child's body. It may help the user to check for proper tension to make sure the straps are in the correct slots according to the child safety seat's instructions to help minimize the child's ability to wiggle out of the child safety seat or loosen the harness. Prior behavior of the child is monitored and factored in to determine an installation requirement or a parameter in the installation such as tautness of the vehicle seat belt. The system may output graphical, visual, and audio feedback based on accuracy of the installation.
Installation confirmation module 110, confirms whether all the steps of the installation are completed properly. It may generate a summary report with a checklist and time taken for each step. In an embodiment, the system checks if the child safety seat is securely installed by giving it a firm tug at the base and checking for any excessive movement. In an embodiment, the tug or the force is generated by actuators installed within the child safety seat or outside of the child safety seat within the vehicle. In another embodiment, the user may be guided to apply force at different points to check for the movement of the child safety seat. The system may also check and ensure that all straps, buckles, and attachments are properly fastened and adjusted.
According to an embodiment of the system, the processor generates a summary report of the placing and harnessing of the child in the child safety seat, wherein the summary comprises a checklist of the placing and harnessing of the child in the child safety seat and corresponding values for the checklist prepared from a real-time data of the placing and harnessing of the child in the child safety seat sensed via a first plurality of sensors of the child safety seat and a second plurality of sensors of the vehicle. According to an embodiment of the system, the processor generates a summary report of the adjustment of the adjustable parts of the child safety seat according to a height and a weight of the child.
In an embodiment, the child seat detection and installation system are coupled with the ignition system of the vehicle. The system may allow the driver to start the vehicle when it determines the installation is proper. The indication may be via a light in the key chain or near or around the ignition lock.
Data, from all the steps and tests of installation, may be collected and stored for later use by data collection module 112. In an embodiment, the data may be uploaded to a cloud or stored locally. System utilizes data transmission module 114 and communication module 116 for transmitting and communicating data from one component to other component or from one system to other system either internally or externally. Such data collected from a plurality of vehicles and child safety seats, by various users, may be collected on a cloud (a network) and analyzed for including but not limited to i) for understanding which steps were taken more time ii) which steps were mostly performed wrong and iii) which steps were easy iv) which steps were taken less time v) wrong installations etc. The data may further be used for i) improving the step-by-step instructions ii) sharing with manufacturers' for improving designs and sensor locations iii) classifying users into groups and providing various recommendations.
In an embodiment, the child safety seat may be checked for registration with the manufacturer. The system may connect with the manufacturer's website, check for any recall notices and update the user about the recent information on recalls, upgrades and any other relevant information on safety related to the child safety seat.
The system further comprises Information system module 118 comprises interconnected components, including hardware, software, databases, networks, and people that work together to collect, store, process, transmit, and retrieve information in an organized and meaningful way. It involves the use of technology, algorithms, processes, and resources to manage data and support decision-making, feedback, coordination, control, and analysis. An infotainment system may be considered a type of information system. An infotainment system combines information and entertainment features within a vehicle or other consumer electronic devices. It typically includes components such as a display screen, audio system, navigation system, and connectivity features. The display screen of the infotainment system may be used to show to the user instructions and how to execute the instruction of installing a child safety seat. It may comprise animations, voice commands, text, pictures, and combinations thereof. In an embodiment the system is enabled to take feedback from the user. In another embodiment, the infotainment system screen may be mirrored to a portable device, such as mobile phone so that the user may place at a point of view and convenience so that the user can install the seat and simultaneously check the display screen.
In an embodiment, it is a method, where the user opens the vehicle door and puts the child safety seat in the vehicle. The vehicle starts monitoring and determining the type of child safety seat. Once the system determines the type of child safety seat, and the specifications about the child safety seat, it starts gathering all that information on where the car seat is to be placed. Once the child safety seat is placed, the system may generate a graphic on the infotainment that is based on the type and model of the child safety seat. The infotainment system provides a 3D model of the child safety seat. According to an embodiment of the system, the processor is operable to display the digital model as a 3D model of the child safety seat to assist the user in performing the installation.
The system then monitors the parameters of installation and provides feedback to the user via a beeping, a light, a vibration or any indicator or combination of indicators to let the user know the installation accuracy. The user may get an indication whether the seat is properly placed, crooked, sideways etc. The user may be guided to route the vehicle seat belt and click and secure the child safety seat. The system will analyze through and determine whether the user has properly routed the vehicle seat belt and clicked and secured it. Once the system determines the step was properly executed, the user may further be guided to secure the seat belt to a required tautness. The system may determine that the seat belt tautness is proper based on prior knowledge acquired through the sensors over a period and manufacturer's specification. When the child safety seat is being installed for the first time, the system may not have any information, and may base the determination of tautness of the seat belt based on the weight of the child or might determine as soon as the user puts the child in the child safety seat. In an embodiment, the system may re-assess based on the child's weight, the seat belt tautness, the placement of the seat, did the child safety seat get moved, and then continuously monitor the parameters. In an embodiment, the system may automatically adjust the tautness of the seat belt, based on whether the child keeps moving or not, based on the driving path and behavior, based on whether the child safety seat is slipping.
By the capabilities offered by modern vehicles, the interior sensing of the vehicle will be much more mature. By combining the sensing capabilities from for instance, shape recognizing camera/radar; weight sensors in seat bolsters; belt payout measurement; force measurement; RFID tags etc., the vehicle will be able to detect the make and model of child safety seat, and whether it is correctly installed or not. If it is judged to be installed properly, the car will give the driver a signal that everything is in order. If not, the car will inform the driver that the child safety seat may not be properly installed and tell the driver what part of the seat installation needs attention. According to an embodiment of the system, the system comprises a computer vision module comprising a shape recognizing camera.
In an embodiment a method comprising a sequence of how the interior sensing could help the driver to detect if the child safety seat is properly installed are:
Child Safety Seat Detection and Identification Module:
Installation Requirements Module:
Installation Checking Module:
Installation Confirmation Module:
In an embodiment, the system may establish a communication with the child safety seat, and the child safety seat may transmit signals containing information related to the child safety seat. The processor 202 detects a type of child safety seat using an image sensor 206 and one or more sensors 204 or receives data of child safety seat through the connector 210. The system may communicate with the child safety seat and the vehicle control system 205 through the communication module 220 via the connector 210.
In an embodiment, the processor 202 is configured to detect a child safety seat at step 222. A start signal is sent from the system to the child safety seat. If the child safety seat is connected to the system through a connector, an acknowledgement is received from the child safety seat. Upon receiving the acknowledgement from the child safety seat, a secure connection is established between the child safety seat and the system, and a child safety seat installation manual is accessed via the connector, at step 224. The system then receives data of the child safety seat and generates a 3D model of the child safety seat, at step 226. The data may comprises one or more of a type of child safety seat, a make, a model, a year of manufacture, a size, a shape, safety features, a suitable position for installation, forward facing installation or rear facing installation, tautness of the belt, how to check for the correct installation, installation checklists, etc. Once the seat is occupied, data about the child is also monitored and may be received via the connector. The received data may be encoded for a secure data message using a protocol. The system may then generate step-by-step instructions for the installation of the child safety seat, at step 228 on the infotainment system of the vehicle. The system may provide time for the user to follow step-by-step instructions for installation of the child safety seat, at step 230. At step 232, the system may check for the accuracy of installation. In an embodiment, the check is performed at each step and after all the steps. A first signal is generated for each step to indicate whether the step is completed accurately or not. Similarly a second signal is generated after completing all the steps to indicate whether the process is completed accurately or not. In an embodiment, the data collected from sensors during installation may be transmitted in real time via the communication module to an application installed in a central server, thereon, the application is configured to receive the data from the central server. An embodiment relates to a system, wherein a system is configured to be a component of a vehicle.
The system comprises a sensor 204, an image sensor 206, a connector 210, a communication module and a processor 202. The processor 202 is configured to detect a child safety seat in the vehicle via the connector 210, establish a secure connection with the child safety seat through the connector 210, receive a first data of the vehicle from the sensor 204, receive a second data from the image sensor 206, process the first data and the second data, and notify a condition of child safety seat installation through the communication module. The vehicle seat comprises at least one of a normal car seat, a child car seat and a pet car seat. The vehicle seat comprises at least one of a front facing car seat, rear facing car seat and a booster seat. The system comprises a plurality of sensors in the vehicle. The sensor 204 comprises at least one of a seat belt sensor, a position sensor, a pressure sensor, a liquid detection sensor, weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor. The image sensor 206 comprises an infrared image sensor, and a thermal image sensor. The connector 210 comprises at least one of a wired or a wireless connector.
According to an embodiment of the system, the child safety seat comprises plurality of sensors, wherein the plurality of sensors comprises one or more of a seat belt sensor, a position sensor, a pressure sensor, a liquid detection sensor, a weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor. According to an embodiment of the system, the vehicle comprises plurality of sensors, wherein the plurality of sensors comprises a seat belt sensor, a position sensor, a pressure sensor, a liquid detection sensor, weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor. According to an embodiment of the system, a belt of a seat in the vehicle comprises a plurality of sensors, wherein the plurality of sensors comprises a position sensor, a pressure sensor, a liquid detection sensor, a weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor. According to an embodiment of the system, a belt of the child safety seat comprises plurality of sensors, wherein the plurality of sensors comprises a position sensor, a pressure sensor, a liquid detection sensor, a weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor.
In an embodiment, the second data comprises an image of the child safety seat's position, a second position of the occupant on the child safety seat, and a size of the child safety seat according to the height and weight of the occupant. The first data comprises at least one of a first position of the child safety seat, a second position of the occupant on the vehicle seat, a weight of the occupant, a height of the occupant, and a pressure on the seat belt.
The child safety seat detection module detects the child safety seat by exchanging handshaking signals to the vehicle seat through a connector 210. A flow chart for detection of the child safety seat comprises processor sending a start signal through the connector in order to detect a child safety seat; if there is a vehicle seat attached to the connector, the processor may receive an acknowledgement signal from the child safety seat; upon receiving the acknowledgement signal, the processor establishes a secured connection with the child safety seat. The processor may receive a signal at the communication module from the child safety seat. The processor may further automatically determine if the signal originates from inside the vehicle. If the signal does not originate from inside the vehicle, then the processor is configured to reject the signal. If the signal originates from inside the vehicle, the processor communicatively connects the communication module to the child safety seat. Then the processor is configured to receive data and information stored in its memory from the child safety seat. The communication transceivers may create a geo-fence (i.e., a virtual perimeter for a real-world geographic area) around the vehicle that allows the communication system to determine whether received signals are currently originating from inside or within a certain range of the location of the vehicle.
Although wireless communication between sensors and an infotainment system 240 of the vehicle are enabled, it is specifically contemplated that a sensor or group of sensors may instead be connected to an infotainment system 240 through a wired connection. For example, in the embodiment depicted in
The central processing hub/the vehicle infotainment system/ECU includes most of the software and programmatic logic of the systems and methods, and will generally be, or be integrated into, a vehicle system, a mobile device, or both. The vehicle infotainment system 240 generally comprises a logic unit or microprocessor, a wireless transmitter/receiver, and may optionally include a non-transitory computer-readable data storage system. This system may be integrated into the vehicle infotainment system. The vehicle infotainment system also generally comprises one or more software components or modules in the form of computer-readable instructions stored on a non-transitory computer-readable memory or storage media. It will be understood by one of ordinary skill in the art that the vehicle infotainment system will generally comprise additional components including, but not necessarily limited to, a bus to move data among components within the vehicle systems. In an embodiment, the wired port is a Universal Serial Board (USB) connector or a proprietary connector 249.
The joint interface 259, framed by a dash-and-dot line in
One purpose of the joint interface 259 includes the exchange of data between the child safety seat 256 and the vehicle 258, or at least, the emission of data, referred to as identity-data, from the child safety seat 256 to the vehicle systems 258. The term identity-data applies to all data items originating from the electronic unit 256-1 of the child safety seat 256 that are communicated to the vehicle systems 258-1, and to the data items received by the electronic unit 256-1 from the vehicle systems 258-1. As described herein, the identity-data includes at least child safety seat data, but may also include child safety seat data together with data selected alone and in combination from the group consisting of sensor data and device data.
Child Restraint Systems or CRS, are well known in the art of transporting children of different ages. To avoid confusion of terms, the term CRS also applies to “car seat”, “child seat”, “child safety seat”, “child restraint or CR”, and the like. Child restraint systems include, for example, rear-facing restraints (infant-only and convertible), forward-facing restraints (convertible, child seat, combination seat), car beds, harnesses, and boosters (belt-positioning and shield).
The vehicle 258 is fitted with various vehicle systems, possibly controlled by a processor and including a plurality of sensors, operable devices, and alert systems. The sensors of the vehicle systems, may include, for example, sensors configured for the detection of events including seat belts buckling status, ignition switch status and ignition key presence, load on seats, engine Revolutions Per Minute (RPM), gearbox shift position, parking brake status, window and door-lock positions, and smoke detection. These sensors are continuously or intermittently sampled under command of the vehicle systems. The operable devices of the vehicle systems may include many different items, including amongst others: engine ignition switch, ignition key switch retention mechanism, shift-interlock such as brake-to-shift or transmission shift, key-free system, gearbox functioning, seat restraint systems like the seat belt system and the airbag system, power window and door lock modules, devices for releasing the trunk-lid from inside trunk compartment, central doors-locking devices, power accessories like electrically operated roof-panels, climate control devices, communication systems to establish communication with communication networks, the notification system, the automatic collision notification system, internet communication systems, information systems like the driver message center, navigation systems, driving assisting systems like parking, imaging and observation system, parking aid systems, lanc departure and lane change systems, driver condition warning systems like for detecting driver intoxication and driver drowsiness, entertainment devices, information devices like belt reminder systems, occupant classification sensing devices, occupant detection devices, event data recording devices, audio systems, cigarette lighters, internal and external lights, the horn, the burglar alarm, the vehicle immobilizer system, the clock, and the timer. The alert systems of the vehicle systems may include, for example, visual or audible signals, dedicated vehicle warning lights, the interior lights of the vehicle, audible alerts, vocally recorded messages, screen readable messages, screen displayed images, warning labels and messages, operation of the audio system, and prevention of removal of the ignition key. Signals may also include the horn, the exterior lights, the vehicle's burglar alarm siren, and signals received by remote communication systems. Other signals, even though not perceptible by sight or sound, include disabling of the vehicle's door locking mechanism, and the operation of some elements out of the communication unit, such as for emitting signals to one or more remote stations. Other alert signals include tactile signals and vibration emitting signals.
In an embodiment, the processor 202 is configured to detect a make and a model of the child safety seat at step 262. It could be via a connector 210 which is one or more of a wired connection and a wireless connection. Once the user places a child in the child safety seat, the system will detect a weight and a height of the child at step 264 via sensors embedded in the child safety seat, in the vehicle, and a combination of both. In an embodiment, an image may be processed to find the height of the child. In an embodiment, the child safety seat may have patterns from which a height of the child may be determined while processing an image. In an embodiment, the height and weight data are used to recommend a suitable safety seat for the child, if the current safety seat is outgrown or not suitable due to its expiry date on the materials or damage to the child safety seat. The system then proceeds to generate a digital model of placing the child and harnessing the child at step 266. The digital model may be displayed on the information system associated with the vehicle and mirrored onto the user personal device. The system then proceeds to display step-by-step instructions for placing and harnessing the child at step 268. In this step, the digital model may present accurate positioning of each of the parts of the child in appropriate places. For example, head, torso, right leg, left leg, etc. Once the child is placed in the right manner, the system will then proceed to the next step. The system will provide time for the user to follow the step-by-step instructions for placing and harnessing the child at step 270. The system may guide on strapping the child, buckling the child, placing of chest clip, etc. Each step is displayed on the infotainment system for the user to follow. The system further checks the installation at step 272. Once the user completes a step the system will check and provide an indication via a signal whether the step was executed correctly or not. In an embodiment the system may further provide a second signal after completing all steps accurately. The indication or signal may be via an audio, video, a tactile cue, and a combination thereof.
According to an embodiment of the system, the processor is operable to adjust a presentation of the step-by-step instructions and diagrams based on proficiency level of the user, wherein the proficiency level is measured based on a time taken and an accuracy of the placing and harnessing of the child in the child safety seat after each step. According to an embodiment of the system, the system further comprises a memory module operatively connected to the processor, wherein the memory module stores procedures and protocols, a plurality of placing and harnessing of the child in the child safety seat data, and wherein the processor selects and displays an appropriate procedure and protocol based on the make and the model of the child safety seat.
According to an embodiment of the system, the system checks for a flat level and alignment of the child safety seat after the child is seated. According to an embodiment of the system, the step-by-step instructions comprise one or more of a text, a figure, an audio, and an animation. According to an embodiment of the system, the system further checks that the belt of the child safety seat is installed straight and aligned accurately. According to an embodiment of the system, the system is further configured to check a second parameter for a payout of a belt of the child safety seat, wherein the second parameter comprises a length of the belt of the child safety seat that is released for use before locking into place.
According to an embodiment of the system, the system recommends the placing and harnessing of the child in the child safety seat based on a manufacturer's manual. According to an embodiment of the system, the manufacturer's manual is accessed via a local memory. According to an embodiment of the system, the manufacturer's manual is accessed via a network.
According to an embodiment of the system, the processor is operable to display the step-by-step instructions in multiple languages. According to an embodiment of the system, the processor is operable to present instructional videos and animations to enhance understanding of the user for placing and harnessing the child in the child safety seat.
According to an embodiment of the system, the processor is operable to display the digital model as a 3D model of the child safety seat to assist the user in performing the placing and harnessing of the child in the child safety seat, wherein the processor is operable to provide reminders and alerts to the user to ensure compliance with requirements of the placing and harnessing of the child in the child safety seat. According to an embodiment of the system, the processor is operable to display visual aids and diagrams to educate the user about the child safety seat that is appropriate for the child.
According to an embodiment of the system, the processor is operable to provide an interactive interface for the user to enter personal details comprising a name and age of the child. According to an embodiment of the system, the processor is operable to present virtual reality simulations of the placing and harnessing of the child in the child safety seat.
In an embodiment, the processor 202 is configured to detect a make and a model of the child safety seat at step 282. It could be via a connector 210 which is one or more of a wired connection and a wireless connection. Once the user places a child in the child safety seat, the system will detect a weight and a height of the child at step 284 via sensors embedded in the child safety seat, in the vehicle, and a combination of both. In an embodiment, an image may be processed to find the height of the child. In an embodiment, the child safety seat may have patterns from which a height of the child may be determined while processing an image. The system then proceeds to generate a digital model of the child safety seat along with adjustable parts associated with the child safety seat at step 286. The digital model may be displayed on the information system associated with the vehicle and mirrored onto the user personal device. The system then proceeds to determine the adjustable parts of the child safety seat according to the height and weight of the child at step 288. Most child safety seats have adjustable features that can be modified based on the child's weight and height. These include the harness straps, which can be moved up or down to fit the child's shoulders properly. The position of the harness buckle can also be adjusted to align with the child's lap. Many seats have adjustable recline angles to provide comfort and support at different stages of development. Adjustable headrest or head support ensure proper head and neck support as the child grows. Some seats offer adjustable seat heights to accommodate leg length. The system provides instructions for specific guidance based on manufacturers' manual for adjusting these features for the child's safety and comfort. In this step, the digital model may present accurate positioning of each of the adjustable parts of the child safety seat. The system then displays step-by-step instructions for adjusting the adjustable parts of the child safety seat at step 290. The system will provide time for the user to follow the step-by-step instructions adjusting the adjustable parts of the child safety seat at step 292. In an embodiment, the system will automatically adjust the adjustable parts of the child safety seat. The system may guide on child safety seats adjustable features like harness straps, buckle position, recline angle, headrest position, and seat height to accommodate the child's weight and height. These adjustments ensure a secure and comfortable fit for the child at different stages of growth. The system further checks the installation at step 294. Once the user completes a step the system will check it and provide an indication via a signal on whether the step was executed correctly or not. In an embodiment the system may further provide a second signal after completing all steps accurately. The indication or signal may be via an audio, a video, a tactile cue, and a combination thereof.
According to an embodiment of the system, the adjustable part comprises one or more of a head rest, an angle for the child safety seat, a cross band for the child safety seat, and the routing of the belt of the child safety seat. According to an embodiment of the system, the system is further operable to check and adjust a distance of the child safety seat from an object in front of the child safety seat for leg room of the child. According to an embodiment of the system, the object in front of the child safety seat comprises an instrument panel. According to an embodiment of the system, the object in front of the child safety seat comprises a front seat of the vehicle.
It is important to note that the flowchart or the method discussed herein provides a general overview of the steps involved in a computer vision system for child safety seat detection and implementation of guidance and checklists for the child safety seat installation and harnessing the child. The specific implementation may vary depending on the chosen algorithms, hardware setup, and vehicle manufacturer's design.
According to an embodiment of the system, the processor is operable to provide reminders and alerts to the user to ensure compliance with requirements of the installation. According to an embodiment of the system, the processor is operable to display visual aids and diagrams to educate the user about the child safety seat and recommend a new child safety seat based on a height and a weight of the child. According to an embodiment of the system, the processor is operable to provide an interactive interface to the user to enter personal details comprising a name and age of a child. According to an embodiment of the system, the processor is operable to present virtual reality simulations of the installation of the child safety seat. According to an embodiment of the system, the processor is operable to monitor a comfort of the child in the child safety seat, wherein the comfort monitoring is via one or more of a first movement of the child, a second movement of a child in the child safety seat due to driving and a face expression of the child.
Child restraint system 300 may include seat 302. Seat 302 may have components attached to form an area contoured to support a body by the back, buttocks, and thighs and provide resting areas for the arms of the body. For example, seat 302 may include a head support 304, a back support 306, a torso support 308, a right leg support 310, a left leg support 312, a right arm support 314, and a left arm support 316. Each may function as their name describes. For example, head support 304 may support a child's head, back support 306 may support a child's back, and left leg support 312 may support a child's left leg. According to an embodiment of the system, the system further checks for heavy wear of the child to ensure that the belt of the child safety seat is securing the child.
Seat 302 additionally may include right slots 318, a right harness strap 320, left slots 322, a left harness strap 324, a crotch strap 326, a child seat buckle 328, a chest clip 330, a tether strap 332 having a hook 334, and a locking clip 336. Right slots 318 may provide a method to adjust a length of right harness strap 320 and left slots 322 may provide a method to adjust a length of left harness strap 324. Right harness strap 320 and left harness strap each may be attached to seat 302 and removably secured into child seat buckle 328. Child seat buckle 328 may be attached to crotch strap 326, which, in turn may be attached to seat 302. Chest clip 330 may removably secure right harness strap 320 and left harness strap 324 to each other. Tether strap 332 may be attached near head support 304, and hook 334 of tether strap 332 may be attached to latch anchor ring 394 to secure child restraint system 300 to vehicle 380.
Child restraint system 300 additionally may include base 338. Base 338 may be a pedestal upon which seat 302 may be secured. Base 338 may include a belt passageway 340 and a base hole 342. Lap/shoulder belt buckle tongue 386 and lap/shoulder belt 382 may be passed from back seat retractor 384 through belt passageway 340 and secured to vehicle seat belt buckle 388 to secure child restraint system 300 to vehicle 380. In those situations where lap/shoulder belt buckle tongue 386 slides freely along lap/shoulder belt 382 without locking into place, locking clip 336 may be threaded onto lap/shoulder belt 382 and slid to a position that is within about one-half an inch of vehicle seat belt buckle 388.
Child restraint system 300 may include one or more sensors to determine the presence of a child in seat 302, determine whether a child is sitting correctly in seat 302, determine whether any one of right harness strap 320, left harness strap 324, chest clip 330, tether strap 332, lap/shoulder belt 382, and locking clip 336 are properly secured. In particular, child restraint system 300 may include a back sensor 344 positioned in back support 306, a torso sensor 346 positioned in torso support 308, a right leg sensor 348 positioned in right leg support 310, and a left leg sensor 350 positioned in left leg support 312. Each sensor 344, 346, 348, and 350 may indicate a presence of an associated body part by detecting a force applied by that body part due to the weight of that body part. For example, back support 306 may detect that a child is leaning against seat 302 and right leg sensor 348 may detect a weight of a child's right leg as that leg dangles over right leg support 310.
In addition to sensors 344, 346, 348, and 350, child restraint system 300 may include a child seat buckle detector 352, a chest clip detector 354, a vehicle seat belt buckle detector 356, a locking clip detector 358, a latch anchor detector 360, an acceleration detector 362, first movement detector 364, a second movement detector 365, a controller 366, a speaker 368, a power source 370, and a data input/output port 372. Importantly, sensors 344, 346, 348, and 350, detectors 352, 354, 356, 358, 360, 362, 364, 365, controller 366, speaker 368, and power source 370 all may be contained within child restraint system 300. In an embodiment, some of the systems and sensors may be installed in the vehicle seat instead of child seat.
Both right buckle tongue and left buckle tongue may be configured to fit within the child seat buckle and be secured in a position that may be fixed relative to the buckle tongue detector. When the right buckle tongue and left buckle tongue are in this fixed position, the child seat buckle may be deemed to be properly secured. Both right buckle tongue and left buckle tongue may include material arranged to set up a magnetic field between right buckle tongue and left buckle tongue when these two elements are within a predetermined distance from each other. Buckle tongue detectors may be positioned in this magnetic field when the right buckle tongue and left buckle tongue are fixed in position relative to the buckle tongue detector. If either the right buckle tongue or left buckle tongue are moved relative to one another, that may indicate that the child seat buckle is not properly secured. If either the right buckle tongue or left buckle tongue are moved relative to one another, the magnetic field may change, and that change may be picked up by the buckle tongue detector. As a result of this change, buckle tongue detectors may generate a buckle tongue signal and send buckle tongue signals along wires. Buckle tongue signal may be a first buckle tongue signal to signal a modification to an existing magnetic field and may be a second buckle tongue signal to signal a non-existing magnetic field. To signal a modification to an existing magnetic field, at least one of right buckle tongue and left buckle tongue should be properly secured to child seat buckle and the remaining buckle tongue should be close enough to the properly secured buckle tongue to generate a magnetic field between right buckle tongue and left buckle tonguc.
Similarly, Chest clip detectors may have a configuration similar to child seat buckle detectors. Opposing chest clip buckle tongues may include material arranged to set up a magnetic field between the opposing chest clip buckle tongues when these two elements are within a predetermined distance from each other. A chest clip buckle detector may be positioned in the magnetic field to pick up any relative movement between the opposing chest clip buckle tongues. Relative movement between the opposing chest clip buckle tongues may indicate that the chest clip may not be properly installed, and a signal may be generated and sent to the controller. Similar arrangements can be performed using sensors for every check that is being made.
According to an embodiment of the system, the system further checks for a support for the head of the child to ensure that the head of the child is well supported and is accurately placed.
According to an embodiment of the system, the information system comprises an infotainment system of the vehicle.
In an embodiment, a computer vision system is used to detect various aspects of the installation. Vehicle interior sensing capabilities may include interior cameras and sensors that can be used to detect the presence of accessories such as child safety seats, passengers, to monitor their posture and movements, and to adjust the seat belts, airbags, and other safety systems accordingly. Advanced biometric sensors can identify individual passengers and customize the vehicle settings to their preferences, such as seat position. Advanced sensors and cameras can detect the presence of occupants in different seating positions within the vehicle. This information may be used to optimize safety features such as seat belt tension and adaptive restraints. Interior cameras are small cameras which may be strategically positioned within the vehicle to capture visual information. They may be used for various purposes, including child safety seat detection, child detection, occupant detection, gesture recognition, facial recognition, and monitoring the overall interior space. The cameras may utilize different technologies such as RGB (color) cameras, infrared cameras for night vision, or depth-sensing cameras for enhanced spatial understanding. Further, interior sensors are designed to detect and measure different parameters within the vehicle's interior. They can include pressure sensors, motion sensors, ambient light sensors, temperature sensors, humidity sensors, and air quality sensors, among others. These sensors provide data on occupant presence, seating positions, environmental conditions, and other relevant factors. The information captured by interior cameras and sensors is utilized by the vehicle's onboard systems and algorithms to enable child safety seat detection and to analyze the steps of installation and whether the user has installed the child safety seat correctly or not. For instance, the data from interior cameras can be processed to detect the seat belt and check whether the seat belt is passing through designated locations or not. It may check using a computer vision system whether the seat belt is crooked or not. Vehicle's interior sensing system can provide feedback or alerts to the driver if it detects any issues with the child seat installation.
Interior cameras can be used to detect the shape and size of a child seat and determine whether it is properly installed. They can recognize specific patterns or features associated with child seats and compare them to a database of known child seat models and installation guidelines. This allows the system to determine if the child seat is correctly positioned, secured, and adjusted according to recommended guidelines. According to an embodiment of the system, the processor is operable to capture, via a camera, an interior of the vehicle.
According to an embodiment of the system, the system comprises a computer vision module comprising a shape recognizing camera. According to an embodiment of the system, the processor is operable to capture, via a camera, an interior of the vehicle. According to an embodiment of the system, the information system comprises an infotainment system of the vehicle. According to an embodiment of the system, the system comprises a shape recognizing camera, wherein the shape recognizing camera comprises an image processing algorithm to identify and classify objects based on their shapes. According to an embodiment of the system, the child safety seat comprises weight sensors to determine the weight of the child. According to an embodiment of the system, the processor is operable to detect a position of a harness chest clip and guide for the optimal adjustment for accurate positioning.
Convolutional Neural Networks (CNNs) may be used in object detection tasks due to their ability to analyze visual data effectively. In the context of object detection, CNNs are trained using labeled datasets consisting of images and corresponding bounding box annotations. The CNN architecture includes layers for feature extraction, region proposal, and classification/localization. Initially, CNN extracts high-level features from input images, gradually learning more complex patterns. The region proposal network generates potential object bounding box proposals, and CNN classifies the proposed regions and refines the bounding box coordinates. Non-maximum suppression is applied to remove redundant detections. During inference, the trained CNN model processes new images to detect and localize objects, providing object labels and bounding box coordinates. CNNs enable accurate object detection by learning discriminative features and patterns, enhancing the performance of systems designed for object recognition and localization. A CNN architecture suitable for object detection is chosen. Popular architectures for object detection include Faster Region-Based Convolutional Neural Network (R-CNN), YOLO (You Only Look Once), and SSD (Single Shot MultiBox Detector). These architectures typically consist of convolutional layers for feature extraction, followed by region proposal or detection layers.
The system may monitor continuously and provide installation guidance and analysis at step 420. For this the system may provide a 3D model of the child car seat on the infotainment system. For installation analysis, the system may analyze the position and alignment of the detected child seat. It examines factors such as seat orientation, angle, and attachment points to assess if the seat is installed properly via computer vision algorithms and sensor data. Sensors may be located at various places including attachment points to provide installation checks. The system may then proceed to evaluate one or more sets of images and provide alerts and feedback at step 422. Based on the analysis of sensor data and image data, the system provides feedback or alerts to the driver or occupants. This feedback can be in the form of visual indicators on the vehicle's dashboard display or audible warnings to ensure that any issues with the child seat installation are addressed.
According to an embodiment of the system, the processor is operable to monitor a comfort of the child in the child safety seat, wherein the comfort monitoring comprises via one or more of a first movement of the child, a second movement of the child in the child safety seat due to driving and a face expression of the child. According to an embodiment of the system, the system is operable to capture, via the second sensor, an interior of the vehicle, wherein the second sensor comprises a camera.
The computer vision system continuously monitors the interior scene to detect any changes in the child seat position or installation status at step 424. It updates the analysis in real-time and provides ongoing feedback as necessary. The system may provide alerts on detecting changes to child safety seat installation at step 426. The data collected during installation and after installation when the vehicle is in motion is stored or saved for future use at step 428. The data may be stored locally or on the cloud network.
According to an embodiment of the system, the child safety seat is operable to collect real-time data about a child using the child safety seat, wherein the real-time data comprises one or more of a height, a weight, a movement, a health parameter, and a face detection. According to an embodiment of the system, the processor is operable to display real-time data from the child safety seat on the information system. According to an embodiment of the system, the processor is operable to detect an anomaly based on real-time data collected during the installation of the child safety seat. According to an embodiment of the system, the processor is operable to provide personalized recommendations to the user via the information system based on a history of the installation of the child safety seat and from results of real-time data collected by the child safety seat. According to an embodiment of the system, the processor is operable to provide decision support to the user by analyzing the real-time data of the child and recommending a new child safety seat according to the weight and the height of the child. According to an embodiment of the system, the real-time data collected from the child safety seat via the sensor is transferred via one or more of a connector, near field communication, and Bluetooth®.
According to an embodiment of the system, the child safety seat is operable to collect real-time data about the child using the child safety seat, wherein the real-time data comprises one or more of a height, a weight, a movement, a health parameter, and a face detection.
According to an embodiment of the system, the processor is operable to display real-time data from the child safety seat on the information system. According to an embodiment of the system, the processor is operable to detect an anomaly based on real-time data collected during the placing and harnessing of the child in the child safety seat. According to an embodiment of the system, the processor is operable to provide personalized recommendations to the user via the information system based on a history of the placing and harnessing of the child in the child safety seat of the child safety seat and from the real-time data collected by the child safety seat. According to an embodiment of the system, data collected from the child safety seat via the first sensor and the second sensor is transferred via one or more of a connector, a near field communication, and Bluetooth®.
According to an embodiment of the system, the system further comprises a data communication module operatively connected to the processor, wherein the data communication module is operable to transmit the real-time data collected during the installation of the child safety seat to a remote server for further analysis. According to an embodiment of the system, the information system is further operable to present warnings and alerts to the user based on real-time data collected by the child safety seat.
In an embodiment, the system may be designed to reset or re-evaluate the child seat detection process periodically or when triggered by specific events, such as a change in vehicle dynamics or system initialization.
According to an embodiment of the method, the method is operable for providing time for the user to follow each step of the step-by-step instructions; checking after each step of the installation of the child safety seat for accuracy of completion of each step; continue displaying a next step after completing a previous step; providing a first signal after completion of each step of the installation of the child safety seat; and generating a second signal after completing all the steps of the installation.
According to an embodiment of the method the step-by-step instructions for the installation of the child safety seat comprises: guiding a direction of a placement of the child safety seat; checking and confirming the direction of the placement of the child safety seat; guiding a connection of the child safety seat with an attachment point; checking and confirming that the child safety seat is accurately connected with the attachment point; guiding a routing of a vehicle seat belt to pass through one or more points on the child safety seat; checking and confirming the routing of the vehicle seat belt is accurate and is passing through the one or more points on the child safety seat; guiding the user for a tautness on the vehicle seat belt; and checking and confirming for the tautness of the vehicle seat belt; and guiding the user for a distance between the child safety seat and an object in front of the child safety seat; and checking and confirming the distance between the child safety seat and the object in front of the child safety seat.
According to an embodiment of non-transitory computer-readable medium, the non-transitory computer-readable medium is further comprising the operations for: providing time for the user to follow each step of the step-by-step instructions; checking after each step of the installation of the child safety seat for accuracy of completion of each step; continue displaying a next step after completing a previous step; providing a first signal after completion of each step of the installation of the child safety seat; and generating a second signal after completing all the steps of the installation.
According to an embodiment of non-transitory computer-readable medium, the step-by-step instructions for the installation of the child safety seat comprises: guiding a direction of a placement of the child safety seat; checking and confirming the direction of the placement of the child safety seat; guiding a connection of the child safety seat with an attachment point; checking and confirming that the child safety seat is accurately connected with the attachment point; guiding a routing of a vehicle seat belt to pass through one or more points on the child safety seat; checking and confirming the routing of the vehicle seat belt is accurate and is passing through the one or more points on the child safety seat; guiding the user for a tautness on the vehicle seat belt; and checking and confirming for the tautness on the vehicle seat belt; and guiding the user for a distance between the child safety seat and an object in front of the child safety seat; and checking and confirming the distance between the child safety seat and the object in front of the child safety seat.
According to an embodiment of the system, the processor is operable to automatically execute each step of the step-by-step instructions; check the installation after each step of the child safety seat for accuracy of completion of each step; provide a first signal after completion of each step of the installation of the child safety seat accurately; and generate a second signal after completing all the steps of the installation accurately.
According to an embodiment of the system, the step-by-step instructions for the installation of the child safety seat comprises: automatically place the child safety seat in a direction; automatically connect the child safety seat to an attachment point; automatically route of a vehicle seat belt to pass through one or more points on the child safety seat; automatically adjust the vehicle seat belt for tautness; and automatically adjust for a distance between the child safety seat and an object in front of the child safety seat.
According to an embodiment of the system, the processor is operable to: check and confirm the direction of a placement of the child safety seat; check and confirm that the child safety seat is accurately connected with the attachment point; check and confirm that the vehicle seat belt is passing accurately through the one or more points on the child safety seat; check and confirm for the tautness on the vehicle seat belt; and check and confirm the distance between the child safety seat and the object in front of the child safety seat.
According to an embodiment of the system, the processor is operable to provide time for the user to follow each step of the step-by-step instructions; continue displaying a next step after completing a previous step; check at an end of each step for accuracy of completion of each step; provide a first signal after completion of each step; and provide a second signal after completing all the steps.
According to an embodiment of the system, the step-by-step instructions comprises: guiding the placing and harnessing of the child in the child safety seat; checking and confirming the placing and harnessing of the child in the child safety seat; guiding a routing of a belt of the child safety seat around the child in the child safety seat; checking and confirming the belt of the child safety seat is routed accurately around the child; guiding for a tautness of the belt of the child safety seat around the child in the child safety seat; checking and confirming for the tautness on the belt of the child safety seat around the child; determining an adjustable part of the child safety seat; guiding to accurately adjust the adjustable part of the child safety seat according to the height of the child and the weight of the child; and checking and confirming that the adjustable part is accurately adjusted according to the height of the child and the weight of the child.
According to an embodiment of the system, the first sensor is further configured to recognize a size and a year of manufacture of the child safety seat. According to an embodiment of the system, the first sensor comprises one or more of a camera, a LiDAR, a radar, and a Radio Frequency Identification sensor configured to recognize the make and the model of the child safety seat. According to an embodiment of the system, the child safety seat comprises plurality of sensors, wherein the plurality of sensors comprises a seat belt sensor, a position sensor, a pressure sensor, a liquid detection sensor, a weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor.
According to an embodiment of the system, the vehicle comprises plurality of sensors, wherein the plurality of sensors comprises a seat belt sensor, a position sensor, a pressure sensor, a liquid detection sensor, weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor. According to an embodiment of the system, a belt of a seat in the vehicle comprises a plurality of sensors, wherein the plurality of sensors comprises a position sensor, a pressure sensor, a liquid detection sensor, a weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor.
According to an embodiment of the system, a belt of the child safety seat comprises plurality of sensors, wherein the plurality of sensors comprises a position sensor, a pressure sensor, a liquid detection sensor, a weight sensor, an infrared sensor, an optical sensor, a comfort detection sensor, a moisture sensor, a temperature sensor, and an audio sensor. According to an embodiment of the system, the first signal comprises one or more of a text message, a visual cue, a sound alert, a tactile cue, and a vibration. According to an embodiment of the system, the second signal comprises one or more of a text message, a visual cue, a sound alert, a tactile cuc, and a vibration. According to an embodiment of the system, an ignition system of the vehicle is operable to start upon completing all the steps of placing and harnessing the child in the child safety seat accurately.
According to an embodiment of the method, the method is operable to provide time for the user to follow each step of the step-by-step instructions; continue displaying a next step after completing a previous step; check after each step of placing the child in the child safety seat for accuracy of completion of each step; providing a first signal after completion of each step of placing of the child in the child safety seat; and generating a second signal after completing all the steps of the placing the child in the child safety seat.
According to an embodiment of the system, the digital model comprises a 3D image generated by capturing a plurality of 2D images of the child and the child safety seat from a plurality of angles. According to an embodiment of the system, the information system presents step-by-step instructions in a user-friendly format. According to an embodiment of the system, the processor is further operable to receive feedback from the user regarding the quality and effectiveness of the step-by-step instructions presented on the information system, and to update the step-by-step instructions based on the feedback received.
According to an embodiment of the method, the step-by-step instructions for the placing and harnessing the child in the child safety seat comprises, guiding the placing and harnessing of the child in the child safety seat; checking and confirming the placing and harnessing of the child in the child safety seat; guiding a routing of a belt of the child safety seat around the child in the child safety seat; checking and confirming the belt of the child safety seat is routed accurately around the child; guiding for a tautness of the belt of the child safety seat around the child in the child safety seat; checking and confirming for the tautness on the belt of the child safety seat around the child; determining an adjustable part of the child safety seat; guiding to accurately adjust the adjustable part of the child safety seat according to the height of the child and the weight of the child; and checking and confirming that the adjustable part is accurately adjusted according to the height of the child and the weight of the child.
According to an embodiment of the non-transitory computer-readable medium, the non-transitory computer-readable medium further comprising the operations for: provide time for the user to follow each step of the step-by-step instructions; continue displaying a next step after completing a previous step; check after each step of placing the child in the child safety seat for accuracy of completion of each step; providing a first signal after completion of each step of placing and harnessing of the child in the child safety seat; and generating a second signal after completing all the steps of placing and harnessing the child in the child safety seat.
According to an embodiment of the non-transitory computer-readable medium, the step-by-step instructions for the placing and harnessing the child in the child safety seat comprises, guiding the placing and harnessing of the child in the child safety seat; checking and confirming the placing and harnessing of the child in the child safety seat; guiding a routing of a belt of the child safety seat around the child in the child safety seat; checking and confirming the belt of the child safety seat is routed accurately around the child; guiding for a tautness of the belt of the child safety seat around the child in the child safety seat; checking and confirming for the tautness on the belt of the child safety seat around the child; determining an adjustable part of the child safety seat; guiding to accurately adjust the adjustable part of the child safety seat according to the height of the child and the weight of the child; and checking and confirming that the adjustable part is accurately adjusted according to the height of the child and the weight of the child.
According to an embodiment of the system, the processor is operable to automatically execute each step of the step-by-step instructions; check at an end of each step for accuracy of completion of each step; provide a first signal after completion of each step; and provide a second signal after completing all the steps.
According to an embodiment of the system, the step-by-step instructions comprises guiding the placing and harnessing of the child in the child safety seat; automatically routing of a belt of the child safety seat with the child in the child safety seat; automatically adjust for a tautness on the belt of the child safety seat around the child; determining an adjustable part of the child safety seat; and automatically adjust the adjustable part of the child safety seat.
According to an embodiment of the system, the processor is operable to: check and confirm the placing and harnessing of the child in the child safety seat; check and confirm the belt of the child safety seat is routed accurately around the child; check and confirm for the tautness on the belt of the child safety seat around the child; and check and confirm that the adjustable part is accurately adjusted according to the height of the child and the weight of the child.
According to an embodiment of the system, the system is further configured to check a parameter for a payout of a belt, wherein the parameter comprises a length of the belt that is released for use before locking a further release. According to an embodiment of the system, the system further checks for a front brace to stand on a vehicle seat accurately.
According to an embodiment of the system, the first signal comprises one or more of a text message, a visual cue, a sound alert, a tactile cue, and a vibration; and wherein the second signal comprises one or more of a text message, a visual cue, a sound alert, a tactile cue, and a vibration. According to an embodiment of the system, the sensor is further configured to recognize a size and a year of manufacture of the child safety seat. According to an embodiment of the system, an ignition system of the vehicle is coupled with the second signal and is operable upon completing all the steps of the installation accurately.
According to an embodiment of the system, the processor is operable to: provide time for the user to follow each step of the step-by-step instructions; check the installation of the child safety seat after each step for accuracy of completion of each step; continue displaying a next step after completing a previous step; provide a first signal after completion of each step of the installation of the child safety seat accurately; and generate a second signal after completing all the steps of the installation accurately.
According to an embodiment of the system, the step-by-step instructions for the installation of the child safety seat comprises: guiding a direction of a placement of the child safety seat; checking and confirming the direction of the placement of the child safety seat; guiding a connection of the child safety seat with an attachment point; checking and confirming that the child safety seat is accurately connected with the attachment point; guiding a routing of a vehicle seat belt to pass through one or more points on the child safety seat; checking and confirming the routing of the vehicle seat belt is accurate and is passing through the one or more points on the child safety seat; guiding the user for a tautness on the vehicle seat belt; and checking and confirming for the tautness on the vehicle seat belt; and guiding the user for a distance between the child safety seat and an object in front of the child safety seat; and checking and confirming the distance between the child safety seat and the object in front of the child safety seat.
The onboard computing platform 602 includes a processor 612 (also referred to as a microcontroller unit or a controller) and memory 614. In the illustrated example, processor 612 of the onboard computing platform 602 is structured to include the controller 612-1. In other examples, the controller 612-1 is incorporated into another ECU with its own processor and memory. The processor 612 may be any suitable processing device or set of processing devices such as, but not limited to, a microprocessor, a microcontroller-based platform, an integrated circuit, one or more field programmable gate arrays (FPGAs), and/or one or more application-specific integrated circuits (ASICs). The memory 614 may be volatile memory (e.g., RAM including non-volatile RAM, magnetic RAM, ferroelectric RAM, etc.), non-volatile memory (e.g., disk memory, FLASH memory, EPROMs, EEPROMs, memristor-based non-volatile solid-state memory, etc.), unalterable memory (e.g., EPROMs), read-only memory, and/or high-capacity storage devices (e.g., hard drives, solid state drives, etc.). In some examples, memory 614 includes multiple kinds of memory, particularly volatile memory, and non-volatile memory. Memory 614 is computer readable media on which one or more sets of instructions, such as the software for operating the methods of the present disclosure, can be embedded. The instructions may embody one or more of the methods or logic as described herein. For example, the instructions reside completely, or at least partially, within any one or more of memory 614, the computer readable medium, and/or within the processor 612 during execution of the instructions.
The HMI unit 604 provides an interface between the vehicle and a user. The HMI unit 604 includes digital and/or analog interfaces (e.g., input devices and output devices) to receive input from, and display information for, the user(s). The input devices include, for example, a control knob, an instrument panel, a digital camera for image capture and/or visual command recognition, a touch screen, an audio input device (e.g., cabin microphone), buttons, or a touchpad. The output devices may include instrument cluster outputs (e.g., dials, lighting devices), haptic devices, actuators, a display 616 (e.g., a heads-up display, a center console display such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, a flat panel display, a solid state display, etc.), and/or a speaker 618. For example, the display 616, the speaker 618, and/or other output device(s) of the HMI unit 604 are configured to emit an alert, such as an alert to request manual takeover, to an operator (e.g., a driver) of the vehicle. Further, the HMI unit 604 of the illustrated example includes hardware (e.g., a processor or controller, memory, storage, etc.) and software (e.g., an operating system, etc.) for an infotainment system that is presented via display 616.
Sensors 606 are arranged in and/or around the vehicle to monitor properties of the vehicle and/or an environment in which the vehicle is located. One or more of the sensors 606 may be mounted to measure properties around an exterior of the vehicle. Additionally, or alternatively, one or more of sensors 606 may be mounted inside a cabin of the vehicle or in a body of the vehicle (e.g., an engine compartment, wheel wells, etc.) to measure properties of the vehicle and/or interior of the vehicle. For example, the sensors 606 include accelerometers, odometers, tachometers, pitch and yaw sensors, wheel speed sensors, microphones, tire pressure sensors, biometric sensors, ultrasonic sensors, infrared sensors, Light Detection and Ranging (lidar), Radio Detection and Ranging System (radar), Global Positioning System (GPS), cameras and/or sensors of any other suitable type. In the illustrated example, sensors 606 include the range-detection sensors that are configured to monitor object(s) located within a surrounding area of the vehicle. In the illustrated example, sensors 606, provide interior sensing of the vehicle.
The ECUs 608 monitor and control the subsystems of the vehicle. For example, the ECUs 608 are discrete sets of electronics that include their own circuit(s) (e.g., integrated circuits, microprocessors, memory, storage, etc.) and firmware, sensors, actuators, and/or mounting hardware. The ECUs 608 communicate and exchange information via a vehicle data bus (e.g., the vehicle data bus 610). Additionally, the ECUs 608 may communicate properties (e.g., status of the ECUs, sensor readings, control state, error, and diagnostic codes, etc.) and/or receive requests from each other. For example, the vehicle may have dozens of the ECUs that are positioned in various locations around the vehicle and are communicatively coupled by the vehicle data bus 610.
In the illustrated example, the ECUs 608 include the autonomy unit 608-1 and a body control module 608-2. For example, the autonomy unit 608-1 is configured to perform autonomous and/or semi-autonomous driving maneuvers (e.g., defensive driving maneuvers) of the vehicle based upon, at least in part, instructions received from the controller 612-1 and/or data collected by the sensors 606 (e.g., range-detection sensors). Further, the body control module 608-2 controls one or more subsystems throughout the vehicle, such as power windows, power locks, an immobilizer system, power mirrors, child safety seat, vehicle seat belt, air bags etc. For example, the body control module 608-2 includes circuits that drive one or more relays (e.g., to control wiper fluid, etc.), brushed direct current (DC) motors (e.g., to control power seats, power locks, power windows, wipers, etc.), stepper motors, LEDs, safety systems (e.g., seat belt pretensioner, airbags, etc.), etc.
The vehicle data bus 610 communicatively couples the communication module 620, the onboard computing platform 602, the HMI unit 604, the sensors 606, and the ECUs 608. In some examples, the vehicle data bus 610 includes one or more data buses. The vehicle data bus 610 may be implemented in accordance with a controller area network (CAN) bus protocol as defined by International Standards Organization (ISO) 11898-1, a Media Oriented Systems Transport (MOST) bus protocol, a CAN flexible data (CAN-FD) bus protocol (ISO 11898-7) and/a K-line bus protocol (ISO 9141 and ISO 14230-1), and/or an Ethernet™ bus protocol IEEE 802.3 (2002 onwards), etc.
The communication module 620-1 is configured to communicate with other nearby communication devices. In the illustrated example, communication module 620 includes a dedicated short-range communication (DSRC) module. A DSRC module includes antenna(s), radio(s) and software to communicate with nearby vehicle(s) via vehicle-to-vehicle (V2V) communication, infrastructure-based module(s) via vehicle-to-infrastructure (V2I) communication, and/or, more generally, nearby communication device(s) (e.g., a mobile device-based module) via vehicle-to-everything (V2X) communication.
V2V communication allows vehicles to share information such as speed, position, direction, and other relevant data, enabling them to cooperate and coordinate their actions to improve safety, efficiency, and mobility on the road. V2V communication can be used to support a variety of applications, such as collision avoidance, lane change assistance, platooning, and traffic management. It may rely on dedicated short-range communication (DSRC) and other wireless protocols that enable fast and reliable data transmission between vehicles. V2V communication, which is a form of wireless communication between vehicles that allows vehicles to exchange information and coordinate with other vehicles on the road. V2V communication enables vehicles to share data about their location, speed, direction, acceleration, and braking with other nearby vehicles, which may help improve safety, reduce congestion, and enhance the efficiency of transportation systems.
V2V communication is typically based on wireless communication protocols such as Dedicated Short-Range Communications (DSRC) or Cellular Vehicle-to-Everything (C-V2X) technology. With V2V communication, vehicles can receive information about potential hazards, such as accidents or road closures, and adjust their behavior accordingly. V2V communication can also be used to support advanced driver assistance systems (ADAS) and automated driving technologies, such as platooning, where a group of vehicles travel closely together using V2V communication to coordinate their movements.
More information on the DSRC network and how the network may communicate with vehicle hardware and software is available in the U.S. Department of Transportation's Core June 2011 System Requirements Specification (SyRS) report (available at http://wwwits.dot.gov/meetings/pdf/CoreSystemSESyRSRevA%20 (2011-06-13).pdf). DSRC systems may be installed on vehicles and along roadsides on infrastructure. DSRC systems incorporating infrastructure information are known as a “roadside” system. DSRC may be combined with other technologies, such as Global Position System (GPS), Visual Light Communications (VLC), Cellular Communications, and short range radar, facilitating the vehicles communicating their position, speed, heading, relative position to other objects and to exchange information with other vehicles or external computer systems. DSRC systems can be integrated with other systems such as mobile phones.
Currently, the DSRC network is identified under the DSRC abbreviation or name. However, other names are sometimes used, usually related to a Connected Vehicle program or the like. Most of these systems are either pure DSRC or a variation of the IEEE 802.11 wireless standard. However, besides the pure DSRC system it is also meant to cover dedicated wireless communication systems between vehicles and roadside infrastructure systems, which are integrated with GPS and are based on an IEEE 802.11 protocol for wireless local area networks (such as 802.11p, etc.).
Additionally, or alternatively, the communication module 620-2 includes a cellular vehicle-to-everything (C-V2X) module. A C-V2X module includes hardware and software to communicate with other vehicle(s) via V2V communication, infrastructure-based module(s) via V2I communication, and/or, more generally, nearby communication devices (e.g., mobile device-based modules) via V2X communication. For example, a C-V2X module is configured to communicate with nearby devices (e.g., vehicles, roadside units, mobile devices, etc.) directly and/or via cellular networks. Currently, standards related to C-V2X communication are being developed by the 3rd Generation Partnership Project.
Further, the communication module 620-2 is configured to communicate with external networks. For example, the communication module 620-2 includes hardware (e.g., processors, memory, storage, antenna, etc.) and software to control wired or wireless network interfaces. In the illustrated example, the communication module 620-2 includes one or more communication controllers for cellular networks (e.g., Global System for Mobile Communications (GSM), Universal Mobile Telecommunications System (UMTS), Long Term Evolution (LTE), Code Division Multiple Access (CDMA)), Near Field Communication (NFC) and/or other standards-based networks (e.g., WiMAX (IEEE 802.16m), local area wireless network (including IEEE 802.11 a/b/g/n/ac or others), Wireless Gigabit (IEEE 802.11ad), etc.). In some examples, the communication module 620-2 includes a wired or wireless interface (e.g., an auxiliary port, a Universal Serial Bus (USB) port, a Bluetooth® wireless node, etc.) to communicatively couple with a mobile device (e.g., a smart phone, a wearable, a smart watch, a tablet, etc.). In such examples, the vehicle may communicate with the external network via the coupled mobile device. The external network(s) may be a public network, such as the Internet; a private network, such as an intranet; or combinations thereof, and may utilize a variety of networking protocols now available or later developed including, but not limited to, TCP/IP-based networking protocols.
In an embodiment of the system, the communication between the host vehicle and the target vehicle is via Vehicle-to-Vehicle (V2V) communication. In an embodiment of the system, the Vehicle-to-Vehicle (V2V) communication is based on a wireless communication protocol using at least one of a Dedicated Short-Range Communications (DSRC), and a Cellular Vehicle-to-Everything (C-V2X) technology. In an embodiment of the system, the communication between the host vehicle and the target vehicle is via an internet connection.
In an embodiment, the communication module is enabled for an autonomous communication, wherein the autonomous communication comprises communication over a period with minimal supervision under different scenarios. The communication module comprises a hardware component comprising, a vehicle gateway system comprising a microcontroller, a transceiver, a power management integrated circuit, an Internet of Things device capable of transmitting one of an analog and a digital signal over one of a telephone, a communication, either wired or wirelessly.
The autonomy unit 608-1 of the illustrated example is configured to perform autonomous and/or semi-autonomous driving maneuvers, such as defensive driving maneuvers, for the vehicle. For example, the autonomy unit 608-1 performs the autonomous and/or semi-autonomous driving maneuvers based on data collected by the sensors 606. In some examples, the autonomy unit 608-1 is configured to operate a fully autonomous system, a park-assist system, an advanced driver-assistance system (ADAS), and/or other autonomous system(s) such as automatic adjustments of the tautness of vehicle seat belt and/or child safety seat in the vehicle.
An ADAS is configured to assist a driver in safely operating the vehicle. For example, the ADAS is configured to perform adaptive cruise control, collision avoidance, lane-assist (e.g., lane centering), blind-spot detection, rear-collision warning(s), lane departure warnings and/or any other function(s) that assist the driver in operating the vehicle. To perform the driver-assistance features, the ADAS monitors objects (e.g., vehicles, pedestrians, traffic signals, etc.) and develops situational awareness around the vehicle. For example, the ADAS utilizes data collected by the sensors 606, the communication module 620-1 (e.g., from other vehicles, from roadside units, etc.), the communication module 620-2 from a remote server, and/or other sources to monitor the nearby objects and develop situational awareness.
Further, in the illustrated example, controller 612-1 is configured to monitor an ambient environment of the vehicle. For example, to enable the autonomy unit 608-1 to perform autonomous and/or semi-autonomous driving maneuvers, the controller 612-1 collects data that is collected by sensors 606 of the vehicle. In some examples, the controller 612-1 collects location-based data via the communication module 620-1 and/or another module (e.g., a GPS receiver) to facilitate the autonomy unit 608-1 in performing autonomous and/or semi-autonomous driving maneuvers. Additionally, the controller 612-1 collects data from (i) adjacent vehicle(s) via the communication module 620-1 and V2V communication and/or (ii) roadside unit(s) via the communication module 620-1 and V2I communication to further facilitate the autonomy unit 608-1 in performing autonomous and/or semi-autonomous driving maneuvers.
In operation, according to an embodiment, the communication module 620-1 performs V2V communication with an adjacent vehicle. For example, the communication module 620-1 collects data from the adjacent vehicle that identifies (i) whether the adjacent vehicle includes an autonomous and/or semi-autonomous system (e.g., ADAS), (ii) whether the autonomous and/or semi-autonomous system is active, (iii) whether a manual takeover request of the autonomous and/or semi-autonomous system has been issued, (iv) lane-detection information of the adjacent vehicle, (v) a speed and/or acceleration of the adjacent vehicle, (vi) a (relative) position of the adjacent vehicle, (vii) a direction-of-travel of the adjacent vehicle, (viii) a steering angle rate-of-change of the adjacent vehicle, (ix) dimensions of the adjacent vehicle, (x) whether the adjacent vehicle is utilizing stability control system(s) (e.g., anti-lock braking, traction control, electronic stability control, etc.), and/or any other information that facilitates the controller 612-1 in monitoring the adjacent vehicle.
Based at least partially on the data that the communication module 620-1 collects from the adjacent vehicle via V2V communication, the controller 612-1 can determine a collision probability for the adjacent vehicle. For example, controller 612-1 determines a collision probability for the adjacent vehicle in response to identifying a manual takeover request within the data collected by the communication module 620-1 from the adjacent vehicle. Additionally, or alternatively, the controller 612-1 determines a collision probability for the adjacent vehicle in response to identifying a discrepancy between (i) lane-marker locations determined by the controller 612-1 of the vehicle based on the sensors 606 and (ii) lane-marker location determined by the adjacent vehicle. Further, in some examples, the controller 612-1 determines the collision probability for the adjacent vehicle based on data collected from other sources, such as the sensors 606, e.g., range detector sensors 606-1 and/or other sensor(s) of the vehicle, roadside unit(s) in communication with the communication module 620-1 via V2I communication, and/or remote server(s) in communication with the communication module 620-1. For example, controller 612-1 determines the collision probability for the adjacent vehicle upon determining, based on data collected by the sensors of the vehicle and the adjacent vehicle, that the adjacent vehicle has not detected a nearby object.
In some examples, controller 612-1 determines the collision probability based on a takeover time for the adjacent vehicle and/or a time-to-collision of the adjacent vehicle. For example, the takeover time corresponds with a duration of time between (1) the adjacent vehicle emitting a request for a manual takeover to be performed and (2) an operator of the adjacent vehicle manually taking over control of the adjacent vehicle. The controller 612-1 is configured to determine the takeover time of the adjacent vehicle based on measured characteristics of the adjacent vehicle (e.g., velocity, acceleration, dimensions, etc.), the operator of the adjacent vehicle (e.g., a measured reaction time, etc.), and/or an environment of the adjacent vehicle (e.g., road conditions, weather conditions, etc.). Further, the time-to-collision corresponds with the time it would take for the adjacent vehicle to collide with another vehicle (e.g., a third vehicle) and/or object (e.g., a guardrail, a highway lane divider, etc.) if the current conditions were maintained.
Additionally, or alternatively, the controller 612-1 is configured to determine the time-to-collision of the adjacent vehicle based on a velocity, an acceleration, a direction-of-travel, a distance to the object, a required steering angle to avoid the object, a steering angle rate-of-change, and/or other measured characteristics of the adjacent vehicle that the communication module 620-1 collects from the adjacent vehicle via V2V communication. Further, controller 612-1 is configured to determine a collision probability for the vehicle based on the collision probability of the adjacent vehicle.
Upon determining the collision probability of the adjacent vehicle and determining that the collision probability is not as per threshold, the autonomy unit 608-1 autonomously performs (e.g., for the ADAS) a defensive driving maneuver to prevent the vehicle from being involved in a collision caused by the adjacent vehicle. For example, the autonomous defensive driving maneuver includes deceleration, emergency braking, changing of lanes, changing of position within a current lane of travel, etc. In some examples, the autonomy unit 608-1 is configured to initiate the defensive driving maneuver before the takeover time of the adjacent vehicle has been completed. That is, the controller 612-1 is configured to cause the autonomy unit 608-1 to perform the defensive driving maneuver before the operator of the adjacent vehicle manually takes over control of the adjacent vehicle. Further, in some examples, the controller 612-1 emits an audio, visual, haptic, and/or other alert (e.g., via an HMI unit 604) for the operator of the vehicle to request manual takeover in response to determining that the collision probability is less than the first threshold and greater than the second threshold. By emitting such an alert, controller 612-1 enables the operator of the vehicle to safely take control of the vehicle before the adjacent vehicle is potentially involved in a collision. Additionally, or alternatively, the controller 612-1 is configured to perform other defensive measures (e.g., prefilling brake fluid lines) in response to determining that the collision probability is greater than a threshold (e.g., the second threshold, a third threshold).
The communication module enables in-vehicle communication, communication with other vehicles, infrastructure communication, grid communication, etc., using Vehicle to network (V2N), Vehicle to infrastructure (V2I), Vehicle to vehicle (V2V), Vehicle to cloud (V2C), Vehicle to pedestrian (V2P), Vehicle to device (V2D), Vehicle to grid (V2G) communication systems. Then, the system notifies nearby or surrounding vehicles or vehicles communicating with the vehicle's communication module. The vehicle uses, for example, a message protocol, a message that goes to the other vehicles via a broadcast.
In an embodiment, a connection is established between a vehicle and a nearby vehicle, which is a surrounding car. A nearby vehicle is detected by the vehicle control system. The nearby vehicle is detected by exchanging handshaking signals. Handshaking is the automated process for negotiation of setting up a communication channel between entities. The processor sends a start signal through the communication channel in order to detect a nearby vehicle. If there is a nearby vehicle, the processor may receive an acknowledgement signal from the nearby vehicle. Upon receiving the acknowledgement signal, the processor establishes a secured connection with the nearby vehicle. The processor may receive a signal at the communication module from the nearby vehicle. The processor may further automatically determine the origin of the signal. The processor communicatively connects the communication module to the nearby vehicle. Then the processor is configured to send and/or receive a message to and/or from the nearby vehicle. The signals received by the communication module may be analyzed to identify the origin of the signal to determine the location of the nearby vehicle.
In an embodiment, the system is enabled for bidirectional communication. The system sends a signal and then receives a signal/communication. In an embodiment, the communication could be a permission for access to control the other vehicle. In another embodiment, the communication could be an incremental control communication, for example, an initial control of the speed up to 10 miles per hour, then further additional 10 miles per hour, and so on.
As a first step of the method according to the disclosure, a data link between the vehicle and nearby vehicle or any other external device is set up in order to permit data to be exchanged between the vehicle and the nearby vehicle or any other external device in the form of a bidirectional communication. This can take place, for example, via a radio link or a data cable. It is therefore possible for the nearby vehicle or any other external device to receive data from the vehicle or for the vehicle to request data from the nearby vehicle or any other external device.
In an embodiment, bidirectional communication comprises the means for data acquisition and are designed to exchange data bidirectionally with one another. In addition, at least the vehicle comprises the logical means for gathering the data and arranging it to a certain protocol based on the receiving entity's protocol.
Initially, a data link for bidirectional communication is set up. The vehicle and the nearby vehicle or any other external device can communicate with one another via this data link and therefore request or exchange data, wherein the data link can be implemented, for example, as a cable link or radio link.
Bidirectional communication has various advantages as described herein. In various embodiments, data is communicated and transferred at a suitable interval, including, for example, 200 millisecond (ms) intervals, 100 ms intervals, 50 ms intervals, 20 ms intervals, 10 ms intervals, or even more frequent and/or in real-time or near real-time, in order to allow a vehicle to respond to, or otherwise react to, data. Bidirectional Infrared (IR) communication may be used to facilitate data exchange.
The apparatus for the vehicle according to the embodiment that performs bidirectional communication may be by means of a personal area network (PAN) modem. Therefore, a user can have access to an external device using the vehicle information terminal, and can then store, move, and delete the user's desired data.
In an embodiment, the vehicle may transmit a message via a communication link. It can be using any combination of vehicle to vehicle (V2V), vehicle to everything (V2X) or vehicle to infrastructure (V2I) type of communication. In an embodiment, it uses vehicle-to-vehicle (V2V) communication that enables vehicles to wirelessly exchange information (communicate), for example, about their speed, location, and heading.
In an embodiment, messaging protocols comprise at least one of Advanced Message Queuing Protocol (AMQP), Message Queuing Telemetry Transport (MQTT), Simple (or Streaming) Text Oriented Message Protocol (STOMP), MQTT-S (is an extension of the open publish/subscribe MQTT), which are heavily used in IoT based technologies and edge networks.
According to an embodiment, there are other possible elements that can be included in each message format, for example, the BSM format may also include information on: acceleration, size and weight, vehicle safety extensions including Brakes, Lights, Wipers, Transmission and powertrain, Vehicle dimensions and Vehicle identification information including identification number and vehicle type.
There are several other message formats available in DSRC protocol besides the three examples provided earlier. Some of these message formats include MAP (Message Assistance for Path Provisioning) format: This message provides a map of the road network, including information about the road layout, speed limits, and other relevant details; CAM (Cooperative Awareness Message) format: Similar to the BSM message format, this message provides information about a vehicle's current status, such as speed, position, and heading. CAM messages are typically sent at a higher frequency than BSM messages to support more accurate situational awareness; DENM (Decentralized Environmental Notification Message) format: This message provides information about environmental conditions that may affect driving, such as weather conditions, visibility, and road surface conditions; EV (Emergency Vehicle) format: This message provides information about emergency vehicles, such as their location and direction of travel, to help other drivers safely navigate around them; TCI (Traffic Control Information) format: This message provides information about traffic conditions, such as congestion, accidents, and construction zones, to help drivers make informed decisions about their routes.
Overall, the various message formats available in DSRC protocol support a wide range of use cases, from basic vehicle-to-vehicle communication to more complex applications such as real-time traffic management and emergency response.
According to an embodiment of the system, the processor generates a summary report of the installation, wherein the summary report of the installation comprises a checklist of the installation and corresponding values for the checklist prepared from a real-time data of the installation sensed via a first plurality of sensors of the child safety seat and a second plurality of sensors of the vehicle.
According to an embodiment of the system, the processor generates a summary report of the placing and harnessing of the child in the child safety seat, wherein the summary comprises a checklist of the placing and harnessing of the child in the child safety seat and corresponding values for the checklist prepared from real-time data of the placing and harnessing of the child in the child safety seat sensed via a first plurality of sensors of the child safety seat and a second plurality of sensors of the vehicle.
According to an embodiment of the system, the summary report further comprises results from checking of the child safety seat for a movement of the child safety seat by applying forces at various points for an accuracy of the installation of the child safety seat. According to an embodiment of the system, the processor sends the summary report of the installation via a communication link to a third party for verification and confirmation. According to an embodiment of the system, the third party comprises one or more of a fire station and a police department. According to an embodiment of the system, the system further comprises a data communication module operatively connected to the processor, wherein the data communication module is operable to transmit the summary report collected during the installation of the child safety seat to a remote server for further analysis. According to an embodiment of the system, the system further comprises a data communication module operatively connected to the processor, wherein the data communication module is operable to transmit the real-time data collected during the placing and harnessing of the child in the child safety seat to a remote server for further analysis. According to an embodiment of the system, the information system is further operable to present warnings and alerts to the user based on real-time data collected by the child safety seat. According to an embodiment of the system, the processor is operable to provide decision support to the user by analyzing real-time data of the child and recommending an appropriate child safety seat according to the weight and the height of the child.
According to an embodiment of the system, the summary report further comprises results from checking the child safety seat for movement of the child safety seat by applying forces at various points and generates a report on accuracy of the placing and harnessing of the child in the child safety seat. According to an embodiment of the system, the processor is operable to provide the summary report of the placing and harnessing the child in the child safety seat with a checklist on the information system. According to an embodiment of the system, the system further comprises a data communication module operatively connected to the processor, wherein the data communication module is operable to transmit the summary report collected during the placing and harnessing of the child in the child safety seat to a remote server for further analysis. According to an embodiment of the system, the processor is operable to provide a time-stamped record for each step, which can be accessed and reviewed at a future time by one or more of the user and a manufacturer of the child safety seat.
Many times, users install the child safety seat thinking that they had it right and it really may not be installed right. However, there is no way for the user to know that until the child safety seat starts moving when the child gets in, and the vehicle is in motion. The user realizes that the child safety seat is not properly attached, the belt is a little bit loose, the belt is crooked or some problem in the installation. In an embodiment, using the infotainment system, the user can install the seat properly. In an embodiment, the system may check for whether the car seat belt is routed correctly for the make and model of the child safety seat. For example, in some child safety seats the vehicle seat belts are supposed to go through the seat, in others the vehicle seat belts must go around the seat, etc. The systems check all the aspects of the installation and generate the warning if any of the installation aspects are not according to the required standards or settings.
By the introduction of more advanced interior sensing capabilities, the vehicle is enabled to identify different features in the vehicle compartment such as visual appearance, shape, weight, movement, belt pay out and other parameters. By use of one or more of these monitored parameters, the vehicle can advise the user on safe configuration of, for example, accessories. It is vital that a child, when traveling in a car, is sitting properly in its seat. Since child safety seats are designed to adapt to different sizes of children, it can be hard to be assured that the child safety seat is adjusted properly to the child currently sitting in the seat.
In an embodiment, the vehicle is provided with sensing capabilities to detect the size of the child, the make and model of the child safety seat, and the child safety seat belt routing when a child is placed in the child safety seat. When all this is detected, the vehicle will be able to determine whether the seat is properly adjusted to the child, or if additional adjustments are required.
There are recommendations for how a child safety seat should properly be adjusted according to child parameters such as height and weight. For instance, it is usually described in a child safety seat manual what is the optimal height of a head rest in relation to the position of the head of the child. Other adjustments based on the child's size may be how much of the child safety seat belt is used (belt payout), if an inlay is used (additional components used in some child safety seats up until a certain age), to secure a proper space for the legs, angle of child safety seat, etc. In an embodiment interior sensing will be enabled and by combining different methods for sensing, for instance (but not limited to): shape recognizing camera/radar, weight sensors in seat bolsters, force measurement sensors, RFID tags, etc., the vehicle is enabled to detect one or more of a length of the child, a weight of the child, a make and model of child safety seat, position of adjustable parts in child safety seat, for example, head rest, belt, leg room, child safety, seat angle, etc.
Based on the detected information about the child and the child safety seat, the vehicle will be able to determine the optimal adjustment of the specific child safety seat for the specific child. And through information from adjustable parts of the child safety seat, the system can judge whether the child safety seat is adjusted properly. If not, it can instruct the adult occupants in the vehicle as to how the child safety seat should be adjusted to best fit the child; for instance, raise the headrest by one step, tighten the seat belt, create more leg room, etc. In another embodiment, the adjustments are enabled to be performed automatically by the vehicle control system.
In one aspect, the system guides on the placement of the child safety seat, recognizing the seat, and then to check whether the child safety seat is placed properly. In another aspect, the system suggests adjustments to the child safety seat installation and surrounding areas for legroom, etc., based on a child inside the child seat. Based on the length and the weight of the child, adjustments to the child seat installation are made. The adjustments are based on the way a user drives the vehicle, a place where the driver is planning to drive, a situation under which the driver is driving, a child's behavior (such as very active, not moving much, etc.), age of the child, calmness of the child, clothing of the child. The system determines whether a seat in front of the child safety seat is closer and not providing enough legroom. The system then adjusts the seats in front of the child safety seat automatically or may suggest to the user and guide him on proper adjustment. In an embodiment, the system may suggest a placement of the child safety seat based on other occupants in the vehicle. An (Artificial Intelligence) AI and machine learning models associated with the vehicle can recognize a child that is getting into the child safety seat, learn the parameters and behavior of the child and based on the parameter and behavior of the child, may determine any adjustments that need to be made to the child safety seat and the installation of the child safety seat.
Autonomous vehicles navigate and take actions without human intervention through the use of a combination of sensors, mapping technology, and artificial intelligence algorithms. Sensors gather information about the vehicle's interiors and environment, high-definition mapping technology is used to create a detailed 3D map of the interior of the vehicle and surroundings outside of the vehicle. This map is then used by the vehicle's software to navigate the vehicle and take necessary control actions. The use of advanced artificial intelligence algorithms to process the data from the sensors and the mapping technology enables the vehicle to make decisions about how to navigate the road, such as when to accelerate, brake, or turn. Control systems then manipulate the vehicle's steering, acceleration, and braking. All these systems are integrated with the vehicle's AI algorithms and work together to navigate the vehicle in real-time. The control unit or control module may be referring to an electronic control unit or a sub-system of the ECU and may be referring to a functional unit in an electronic control unit or a sub-system that controls one or more units of the vehicle's equipment.
An Autonomous vehicle comprises various sensors, such as ultrasonic sensor, lidar sensors (lidars), radar sensors, etc., actuators such as brake actuator, steering actuators, etc., and various subsystems such as propulsion system, steering system, brake sensor system, communication system, etc. Disclosed herein are sensors and actuators associated with the autonomous vehicle, which are neither limited by the systems depicted nor is it an exhaustive list of the sensors, actuators, and systems/sub-systems, and/or features of the autonomous vehicle. Further, there is no limitation in terms of the arrangement of any of the sensors, actuators, and systems/sub-systems depicted. These sensors, actuators, and systems/sub-systems can be arranged as suited for a purpose to be performed by the autonomous vehicle. Autonomous vehicles, also known as self-driving vehicles or driverless vehicles, are vehicles that can navigate and operate without human intervention. Sensors, for example, including cameras, lidars, radars, and ultrasonic sensors, enable autonomous vehicles to detect and recognize objects, obstacles, and pedestrians on the road. Autonomous vehicles use advanced control systems to make real-time decisions based on sensor data and pre-programmed rules or intelligence-based decision systems. These systems control, for example, acceleration, braking, steering, and communication of the vehicle. Navigation systems such as GPS, maps, and other location-based technologies help autonomous vehicles navigate and plan the optimal route to a destination. Communication systems of autonomous vehicles help them communicate with other vehicles and infrastructure, such as traffic lights and road signs, to exchange information and optimize traffic flow. Autonomous vehicles have several safety features, including collision avoidance systems, emergency braking, and backup systems in case of system failures. Autonomous vehicles are assisted by artificial intelligence and machine learning algorithms to analyze data, recognize patterns, and improve performance over time.
The methods depicted herein may include fusing the vehicle trip dynamic data, image data, and LiDAR data. In an exemplary embodiment, the data reception module may communicate with the neural network processing unit to provide artificial intelligence capabilities to conduct multimodal fusion. The data reception module may utilize one or more machine learning/deep learning fusion processes to aggregate the vehicle trip dynamic data, image data, and LiDAR data.
In particular, the neural network processing unit may execute machine learning/deep learning to determine one or more motion patterns from the fused data based on the evaluation of the fused data against the stored dynamic parameters, image recognition parameters, and object recognition parameters.
According to an embodiment of the system, a face detection algorithm is used to detect a child. According to an embodiment of the system, a camera is operable to capture an image of the child in the child safety seat. According to an embodiment of the system, the image is analyzed using a computer vision algorithm comprising pattern recognition techniques to detect a human, facial features of the human for at least one of an eye, a nose, a mouth, and an outline of a face, an car, a hair.
In an embodiment, ANN's may be a Deep-Neural Network (DNN), which is a multilayer tandem neural network comprising Artificial Neural Networks (ANN), Convolution Neural Networks (CNN) and Recurrent Neural Networks (RNN) that may recognize features from inputs, do an expert review, and perform actions that require predictions, creative thinking, and analytics. In an embodiment, ANNs may be Recurrent Neural Network (RNN), which is a type of Artificial Neural Networks (ANN), which uses sequential data or time series data. Deep learning algorithms are commonly used for ordinal or temporal problems, such as language translation, Natural Language Processing (NLP), speech recognition, and image recognition, etc. Like feedforward and convolutional neural networks (CNNs), recurrent neural networks utilize training data to learn. They are distinguished by their “memory” as they take information from prior input via a feedback loop to influence the current input and output. An output from the output layer in a neural network model is fed back to the model through the feedback. The variations of weights in the hidden layer(s) will be adjusted to fit the expected outputs better while training the model. This will allow the model to provide results with far fewer mistakes.
The neural network is featured with the feedback loop to adjust the system output dynamically as it learns from the new data. In machine learning, backpropagation and feedback loops are used to train an AI model and continuously improve it upon usage. As the incoming data that the model receives increases, there are more opportunities for the model to learn from the data. The feedback loops, or backpropagation algorithms, identify inconsistencies and feed the corrected information back into the model as an input.
Even though the AI/ML model is trained well, with large sets of labeled data and concepts, after a while the models' performance may decline while adding new, unlabeled input due to many reasons which include, but not limited to, concept drift, recall precision degradation due to drifting away from true positives, and data drift over time. A feedback loop to the model keeps the AI results accurate and ensures that the model maintains its performance and improvement, even when new unlabeled data is assimilated. A feedback loop refers to the process by which an AI model's predicted output is reused to train new versions of the model.
Initially, when the AI/ML model is trained, a few labeled samples comprising both positive and negative examples of the concepts (e.g., incorrect installations including harness not proper, crooked belt, buckle not properly fixed, chest clip not proper, child legs are not going through the belt system properly, etc.) are used that are meant for the model to learn. Afterward, the model is tested using unlabeled data. By using, for example, deep learning and neural networks, the model may then make predictions on whether the desired concept/s (e.g., crooked belt, loose harnessing, tight harnessing, a height of the child, an adjustable part in the seat, etc.) are in unlabeled images. Each image is given a probability score where higher scores represent a higher level of confidence in the models' predictions. Where a model gives an image a high probability score, it is auto labeled with the predicted concept. However, in the cases where the model returns a low probability score, this input may be sent to a controller (maybe a human moderator) which verifies and, as necessary, corrects the result. The human moderator may be used only in exceptional cases. The feedback loop feeds labeled data, auto-labeled or controller-verified, back to the model dynamically and is used as training data so that the system may improve its predictions in real-time and dynamically.
In an embodiment, the training data sample may also include current contextual information 906 relating to the surrounding environment. This may include, for example, location of the vehicle, current weather conditions, temperature, time of day, traffic conditions in the region, driver behavior, child behavior, number of children in the vehicle, etc. The system may also garner contextual information 906 from a device associated with the vehicle. For example, through an application installed on the device, such as Google® maps and location services, the system may know the vehicle details.
Real-time sensor data 908 may include, for example, video, image, audio, infrared, temperature, 3D modeling, and any other suitable types of data that capture the current state around the vehicle. In an embodiment, the real-time sensor data may be processed using one or more machine learning models 902 trained and based on similar types of data to predict real-time features of the installation requirements and anomalies/mistakes/improper installations of the child safety seat for a given model and make. The real-time features may include, for example, the child safety seat size, shape, dimensions, etc. Current information about the child safety seat may be used for generating guiding instructions, installation requirements, specific concentration areas based on common installation mistakes, etc. For example, currently detected sensor data and/or previously known information about the child safety seat class and/or installation requirements may be used to detect an improper installation.
Any of the aforementioned types of data (e.g., child data and child safety seat data 904, contextual information 906, sensor data 908, or any other data) may correlate with the requirements for child safety seat installation, and such correlations may be automatically learned by the machine learning model 902. In an embodiment, during training, the machine learning model 902 may process the training data sample (e.g., child data and child safety seat data 904, contextual information 906) and, based on the current parameters of the machine learning model 902, detect or predict an output 910 which may be a requirement of specific tautness for the seat belt of the child safety seat or an alert for improper installation of seat belt. The detection or prediction of installation requirements may depend on the training data with labels 912 associated with the training data sample 918. Predicting an improper seat belt tautness refers to predicting a future event based on past and present data and most commonly by analysis, estimation of trends or data patterns. Prediction or predictive analysis employs probability based on the data analyses and processing. Detection of seat belt tautness refers to an onset of the event and the system detecting the same. Predicted events may or may not turn into a reality based on how the turn of events occur. In an embodiment, during training, the detected event at 910 and the training data with labels 912 may be compared at 914. For example, comparison 914 may be based on a loss function that measures a difference between the detected event 910 and the training data with labels 912. Based on the comparison at 914 or the corresponding output of the loss function, a training algorithm may update the parameters of the machine learning model 902, with the objective of minimizing the differences or loss between subsequent predictions or detections of the event 910 and the corresponding labels 912. By iteratively training in this manner, the machine learning model 902 may “learn” from the different training data samples and become better at detecting various collision events at 910 that are similar to the ones represented by the training labels at 912. In an embodiment, the machine learning model 902 is trained using data which is specific to a type of target for which the model is used for detecting various improper installations, improper placement of child and harnessing of the child, improper child seat adjustments. In an embodiment, the machine learning model 902 is trained using data which is general to the child safety seat types and is used for detecting various improper installations, improper placement of child and harnessing of the child, improper child seat adjustments.
Using the training data, a machine learning model 902 may be trained so that it recognizes features of input data that signify or correlate to certain event types. For example, a trained machine learning model 902 may recognize data features that signify the likelihood of an improper child safety seat installation. Through training, the machine learning model 902 may learn to identify predictive and non-predictive features and apply the appropriate weights to the features to optimize the machine learning model's 902 predictive accuracy. In embodiments where supervised learning is used and each training data sample 918 has a label 912, the training algorithm may iteratively process each training data sample 918 (including child data and child safety seat data 904, contextual information 906, sensor data 908, or any other data), and generate a prediction of installation requirements 910 based on the model's 902 current parameters. Based on the comparison at 914 results, the training algorithm may adjust the model's 902 parameters/configurations (e.g., weights) accordingly to minimize the differences between the generated prediction of installation requirements 910 and the corresponding labels 912. Any suitable machine learning model and training algorithm may be used, including, e.g., neural networks, decision trees, clustering algorithms, and any other suitable machine learning techniques. Once trained, the machine learning model 902 may take input data associated with a child safety seat and output one or more predictions that indicate installation requirements and alerts for various improper installations.
As shown at 1004, the system may extract features from the received data according to a machine learning model. The machine learning model is able to automatically do so based on what it learned during the training process. In an embodiment, appropriate weights that were learned during the training process may be applied to the features. Extracting features include but are not limited to installation checks at various areas of interest on the child safety seat, for example, a belt crookedness or straightness, proper buckling, etc.
At step 1008, the machine learning model, based on the features of the received data, may generate a score representing a likelihood or confidence that the received data is associated with a particular event type, e.g., an improper installation where the belt tautness is not correct, where the child seat may be moving after installation, the belt is not routed properly, etc.
As shown at 1010, the system may determine whether the score is sufficiently high relative to a threshold or criteria to warrant certain action. If the score is not sufficiently high, thus indicating a false-positive, the system may return to step 1002 and continue to monitor subsequent incoming data. On the other hand, if the score is sufficiently high, then at step 1012 the system may generate an appropriate alert and/or determine an appropriate action/response. In an embodiment, the system may send alerts to appropriate recipients based on the detected event types. For instance, an alert is generated in the vehicle on the infotainment system saying that the belt of the child safety seat is not properly buckled, or the harness is too loose and the child may come out of the belts, etc.
In an embodiment, the system may repeat one or more steps of the method of
In an embodiment, the system may comprise a cyber security module. In one aspect, a secure communication management (SCM) computer device for providing secure data connections is provided. The SCM computer device includes a processor in communication with memory. The processor is programmed to receive, from a first device, a first data message. The first data message is in a standardized data format. The processor is also programmed to analyze the first data message for potential cyber security threats. If the determination is that the first data message does not contain a cyber security threat, the processor is further programmed to convert the first data message into a first data format associated with the vehicle environment and transmit the converted first data message into a first data format associated with the vehicle environment and transmit the converted first data message to the communication module using a first communication protocol associated with the negotiated protocol.
According to an embodiment, secure authentication for data transmissions comprises, provisioning a hardware-based security engine (HSE) located in the cyber security module, said HSE having been manufactured in a secure environment and certified in said secure environment as part of an approved network; performing asynchronous authentication, validation and encryption of data using said HSE, storing user permissions data and connection status data in an access control list used to define allowable data communications paths of said approved network, enabling communications of the cyber security module with other computing system subjects (e.g., communication module) to said access control list, performing asynchronous validation and encryption of data using security engine including identifying a user device (UD) that incorporates credentials embodied in hardware using a hardware-based module provisioned with one or more security aspects for securing the system, wherein security aspects comprising said hardware-based module communicating with a user of said user device and said HSE.
In an embodiment, the cyber security module further comprises an information security management module providing isolation between the system and the server.
In an embodiment,
In an embodiment, the integrity check is a hash-signature verification using a Secure Hash Algorithm 256 (SHA256) or a similar method. In an embodiment, the information security management module is configured to perform asynchronous authentication and validation of the communication between the communication module and the server.
In an embodiment, the information security management module is configured to raise an alarm if a cyber security threat is detected. In an embodiment, the information security management module is configured to discard the encrypted data received if the integrity check of the encrypted data fails.
In an embodiment, the information security management module is configured to check the integrity of the decrypted data by checking accuracy, consistency, and any possible data loss during the communication through the communication module.
In an embodiment, the server is physically isolated from the system through the information security management module. When the system communicates with the server as shown in
In an embodiment, the signature is realized by a pair of asymmetric keys which are trusted by the information security management module and the system, wherein the private key is used for signing the identities of the two communication parties, and the public key is used for verifying that the identities of the two communication parties are signed. Signing identity comprises a public and a private key pair. In other words, signing identity is referred to as the common name of the certificates which are installed in the user's machine.
In an embodiment, both communication parties need to authenticate their own identities through a pair of asymmetric keys, and a task in charge of communication with the information security management module of the system is identified by a unique pair of asymmetric keys.
In an embodiment, the dynamic negotiation key is encrypted by adopting an Rivest-Shamir-Adleman (RSA) encryption algorithm. RSA is a public-key cryptosystem that is widely used for secure data transmission. The negotiated keys include a data encryption key and a data integrity check key.
In an embodiment, the data encryption method is a Triple Data Encryption Algorithm (3DES) encryption algorithm. The integrity check algorithm is a Hash-based Message Authentication Code (HMAC-MD5-128) algorithm. When data is output, the integrity check calculation is carried out on the data, the calculated Message Authentication Code (MAC) value is added with the header of the value data message, then the data (including the MAC of the header) is encrypted by using a 3DES algorithm, the header information of a security layer is added after the data is encrypted, and then the data is sent to the next layer for processing. In an embodiment the next layer refers to a transport layer in the Transmission Control Protocol/Internet Protocol (TCP/IP) model.
The information security management module ensures the safety, reliability, and confidentiality of the communication between the system and the server through the identity authentication when the communication between the two communication parties starts the data encryption and the data integrity authentication. The method is particularly suitable for an embedded platform which has less resources and is not connected with a Public Key Infrastructure (PKI) system and may ensure that the safety of the data on the server cannot be compromised by a hacker attack under the condition of the Internet by ensuring the safety and reliability of the communication between the system and the server.
The descriptions of the one or more embodiments are for purposes of illustration but are not exhaustive or limiting to the embodiments described herein. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein best explains the principles of the embodiments, the practical application and/or technical improvement over technologies found in the marketplace, and/or to enable others of ordinary skill in the art to understand the embodiments described herein.
