116A).

In accordance with an embodiment, the image-capture device 112 may be configured to continuously or intermittently track a plurality of different spatial locations (in X, Y, and Z coordinates) of each face portion of the one or more occupants of the vehicle 102. In cases where a change in a spatial location is detected for one face portion or a plurality of face portions, the positioning and/or angle of the one or more servo-controlled vents may be updated in real time or near-real time to target the airflow to the changed spatial location of each face portion.

In another embodiment, instead of an image-capture device, a thermal sensor or imager may be used to determine portions of an individual that are hot. In cases where localized hot spots are detected, the positioning and/or angle of the one or more servo-controlled vents may be updated in real time or near-real time to target the airflow to the changed spatial location of each localized hot spot. When multiple hot spots are detected, the positioning and/or angle of the one or more servo-controlled vents may focus on one hot spot until it falls below a threshold level. Alternately, the positioning and/or angle of the one or more servo-controlled vents may cycle through multiple of the hot spots, or the angle of the vents may be widened.

In another example, the in-vehicle electronic device 114 may be configured to control the vehicle audio system to direct an audio output from a plurality of audio speakers of the vehicle audio system to a second body portion of the first occupant. In this case, the second body portion may refer to the middle portion of the face rectangle of the detected facial portion of the first occupant (such as the first user 116A). The audio output from the plurality of audio speakers may be directed toward the second body portion based on the estimated second Z-height (e.g., “Y” cm) of the second body portion (e.g., the middle portion of the face rectangle) of the first occupant and the determined associative relationship that the second Z-height is associated with the vehicle audio system. Thus, similar to the first occupant, different Z-heights are estimated for each occupant from the middle portion of the face rectangle to the reference position, and the vehicle audio system may be tuned in real time or near-real time for optimum audio performance and enhanced listening experience for the one or more occupants in the vehicle 102.

In accordance with an embodiment, the in-vehicle electronic device 114 may be configured to monitor, by use of the image-capture device 112, a plurality of defined metrics related to the driver, such as the first user 116A, of the vehicle 102. The plurality of defined metrics related to the driver of the vehicle 102 may include, but are not limited to a facial position, body language, a seating position, eye movement, body movement, health parameters, and a tone, or pitch of driver's voice. The in-vehicle electronic device 114 may detect a state of the driver of the vehicle 102 based on the analysis of the plurality of defined metrics. The in-vehicle electronic device 114 may be configured to utilize a machine learning system to detect if the driver is in normal state or in a distressed state when a sudden deviation in the plurality of defined metrics is detected. For example, based on historical data related to driver (such as the identified first user 116A), a baseline behavior, body language, seating position, eye movement, body movement, health parameters, and the tone, or pitch of driver's voice may be established as regular and tagged as normal. Thus, when a sudden deviation or anomaly in the plurality of defined metrics is detected, the in-vehicle electronic device 114 may generate and communicate a driver emergency alert signal to the vehicle audio system for output. The vehicle audio system may be activated and an audio alert, (e.g., “Are you OK, or shall I alert emergency services?”) may be outputted via one of the plurality of speakers of the vehicle audio system. This may occur when the driver is suspected to be in distressed state. Thereafter, the in-vehicle electronic device 114 may be configured to activate an emergency response (ERS) mode in the vehicle 102. The in-vehicle electronic device 114 may be configured to communicate a health emergency alert signal to the medical emergency center 106 if no response is received from the driver within a user specified or pre-defined time period. The health emergency alert signal may be referred to as emergency call systems, or simply eCall. eCall is an emergency response system known in the art. Typically, when vehicle crash sensors are triggered, the eCall system detects that the occupants are in distress and automatically calls emergency services to alert of possible injuries. The eCall system also transmits vehicle location (e.g., GPS coordinates) to the medical emergency center 106 (e.g., an emergency response team).

In accordance with an embodiment, when the ERS mode is activated and no response is received from the driver (e.g., the first user 116A) within the user specified or pre-defined time period, the in-vehicle electronic device 114 may be configured to communicate a self-diagnostic test start signal to an on-board diagnostics (OBD) system of the vehicle 102. The self-diagnostic test is done to determine whether the vehicle 102 is damaged or okay-to-drive in an autonomous mode or auto pilot (AP) mode. In cases where the vehicle 102 is damaged, the vehicle 102 remains parked, a health emergency alert signal is communicated to the medical emergency center 106. In cases where the vehicle 102 is diagnosed as okay-to-drive but the driver is unresponsive to the audio alert, the in-vehicle electronic device 114 may communicate an autonomous mode start signal to an engine control module (ECM) of the vehicle 102. This may cause the vehicle 102 to automatically drive itself to a nearest hospital or an emergency service provider, such as the medical emergency center 106. In certain scenarios, the driver profile may include user preferences related to handling of emergency response. For example, the driver, such as the first user 116A may feed information related to one or more hospitals of choice in an order of preference, a preferred health insurance network, contact numbers of friends and family, and the like, via a user interface rendered on the display (such as the display 210 of FIG. 2). In cases where such user preferences related to handling of emergency response is present, and the emergency response AP-mode is activated, the in-vehicle electronic device 114 may dynamically set a destination location in a navigation unit of the vehicle 102 to one of the preferred hospitals. The selection of the preferred hospital from the listed hospitals may be done based on a shortest distance between each location of the listed hospitals from a current location of the vehicle 102 and the order of preference. Thereafter, the in-vehicle electronic device 114 may communicate the autonomous mode start signal to the ECM of the vehicle 102 to cause the vehicle 102 to automatically drive itself to the set destination location of the selected hospital. The in-vehicle electronic device 114 may also communicate a route information from the current location of the vehicle 102 to the set destination location of the selected hospital, to the contact numbers of friends and family, as provided in the driver profile. The route information may be communicated via the wireless communication network 110, by use of a wireless communication system of the vehicle 102.

FIG. 2 is a block diagram that illustrates various exemplary components or systems of a vehicle, in accordance with an embodiment of the disclosure. FIG. 2 is explained in conjunction with elements from FIG. 1. With reference to FIG. 2, there is shown the vehicle 102. The vehicle 102 may comprise the in-vehicle electronic device 114. The in-vehicle electronic device 114 may be implemented as a part of the IVI system or as an ECU. The in-vehicle electronic device 114 may include circuitry 202, which may comprise at least a microprocessor. The in-vehicle electronic device 114 may also include a memory 204. The vehicle 102 may comprise an audio interface 206, an outside rear view mirror (ORVM) 208, and a display 210 communicatively coupled to the in-vehicle electronic device 114. In some embodiments, the display 210 may be part of the in-vehicle electronic device 114 (e.g., display of an infotainment head unit, where the in-vehicle electronic device 114 is implemented as a part of the IVI system). One or more user interfaces (UIs), such as the UI 210a, may be rendered on the display 210.

The vehicle 102 may further comprise a powertrain control system 212, a sensing system 214, and other systems, such as a plurality of in-vehicle systems 216. The powertrain control system 212 may include a steering system 218 and a braking system 220. The sensing system 214 may include a plurality of vehicle sensors 222, a plurality of external cameras, such as a plurality of external image-capture devices 224C, and an inner camera, such as the image-capture device 112 of FIG. 1. The plurality of in-vehicle systems 216 may include an HVAC system 226 and a vehicle audio system 228. The HVAC system 226 may include one or more servo motors, such as the servo-motor 230. The vehicle audio system 228 may include a plurality of speakers 232. The vehicle 102 may further comprise a vehicle power system 234, a battery 236, a wireless communication system 238, and an in-vehicle network 240.

The various components or systems may be communicatively coupled via the in-vehicle network 240, such as a vehicle area network (VAN), and/or an in-vehicle data bus. The circuitry 202, such as a microprocessor, may be communicatively coupled to the audio interface 206, the ORVM 208, the display 210, the sensing system 214, the plurality of in-vehicle systems 216, and the wireless communication system 238. The circuitry 202 may also be operatively connected with the powertrain control system 212, the steering system 218, and the braking system 220. The wireless communication system 238 may be configured to communicate with one or more external devices, such as the RSU 108 and the server 104 under the control of the circuitry 202. A person of ordinary skill in the art will understand that the vehicle 102 may also include other suitable components or systems, in addition to the components or systems which are illustrated herein to describe and explain the function and operation of the present disclosure.

The circuitry 202 may comprise suitable logic, circuits, interfaces, and/or code that may be configured to execute a set of instructions stored in the memory 204. The circuitry 202 may refer to a microprocessor. In accordance with an embodiment, the circuitry 202 may be configured to automatically control one or more components or systems, such as the powertrain control system 212, the steering system 218, the braking system 220, the sensing system 214, and/or the plurality of in-vehicle systems 216 of the vehicle 102, when the vehicle 102 is in an autonomous mode. Examples of the circuitry 202 may include, but are not limited to a microcontroller, a Reduced Instruction Set Computing (RISC) processor, an Application-Specific Integrated Circuit (ASIC) processor, a Complex Instruction Set Computing (CISC) processor, a microcontroller, a central processing unit (CPU), a graphics processing unit (GPU), a state machine, and/or other processors or circuits.

The memory 204 may comprise suitable logic, circuitry, and/or interfaces that may be configured to store a set of instructions executable by the circuitry 202. The memory 204 may store various types of information related to the vehicle 102. Various types of information may include Z-height information of a plurality of body portions of each occupant of the vehicle 102, and associative relationship between the Z-height information and corresponding in-vehicle system of the plurality of in-vehicle systems 216. Examples of implementation of the memory 204 may include, but are not limited to, Electrically Erasable Programmable Read-Only Memory (EEPROM), Random Access Memory (RAM), Read Only Memory (ROM), Hard Disk Drive (HDD), Flash memory, Solid-State Drive (SSD), and/or CPU cache memory.

The audio interface 206 may be connected to the vehicle audio system 228 or other device that may be configured to generate a sound. The audio interface 206 may also be connected to the microphone 224B or other device to receive a voice input from an occupant, such as the first user 116A and the second user 116B, of the vehicle 102. The audio interface 206 may also be communicatively coupled to the circuitry 202. The audio interface 206 may be a part of the IVI system or the infotainment head unit of the vehicle 102. The IVI system, for example, may include a combination of hardware devices and software that provides audio or video entertainment to occupants of a vehicle, such as the vehicle 102. In accordance with an embodiment, display 210 may also be communicatively coupled to the IVI system.

The display 210 may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to render various types of information and/or entertainment content via the UI 210a. The UI 210a may be a customized graphical user interface (GUI) configured to display the various types of information, driver profiles, and/or the entertainment content to occupants of the vehicle 102. The display 210 may be a touch screen configured to receive an input from the one or more occupants of the vehicle 102. Examples of the display 210 may include, but are not limited to a display of the infotainment head unit, a projection-based display, a see-through display, and/or an electro-chromic display.

The powertrain control system 212 may refer to an onboard computer of the vehicle 102 that controls operations of an engine and a transmission system of the vehicle 102. In some embodiments, the powertrain control system 212 may control ignition, fuel injection (in case of hybrid or non-electric vehicle), emission systems, and/or operations of a transmission system (when provided) and the braking system 220.

The sensing system 214 may comprise the image-capture device 112 and the plurality of vehicle sensors 222. The plurality of vehicle sensors 222 may include a seat occupancy sensor 224A, a microphone 224B, and a plurality of external image-capture devices 224C. The sensing system 214 may be communicatively coupled to the circuitry 202 to provide input signals to the circuitry 202. For example, the sensing system 214 may be used to sense or detect the sensor data by use of the plurality of vehicle sensors 222 and the selfie camera, such as the image-capture device 112. Other examples of the plurality of vehicle sensors 222, may include, but are not limited to a yaw rate sensor, a vehicle speed sensor, odometric sensors, a steering angle sensor, a vehicle travel direction detection sensor, a magnetometer, an image sensor, a touch sensor, an infrared (IR) sensor, Lidar, and a depth sensor.

The plurality of in-vehicle systems 216 may include at least the HVAC system 226 and the vehicle audio system 228. One or more vents may be connected to the HVAC system 226 so that hot, cold, and/or dehumidified air may be introduced in the interior of the vehicle 102 as per needs or as desired. The one or more vents may be servo-controlled vents that are controlled by one or more servo motors, such as the servo-motor 230. In some embodiments, a first vent may be coupled to the HVAC system 226 to generate a first plane of air (e.g., a horizontal plane) in the interior of the vehicle 102. A second vent may be coupled to the HVAC system 226 to generate a second plane of air (e.g., a vertical plane). The vehicle audio system 228 may include the plurality of speakers 232.

The steering system 218 may be configured to receive one or more control command from the circuitry 202. The steering system 218 may include a steering wheel and/or an electric motor (provided for a power-assisted steering) that may be used by the first user 116A to control movement of the vehicle 102 in manual mode or a semi-autonomous mode. In accordance with an embodiment, the movement or steering of the vehicle 102 may be automatically controlled when the vehicle 102 is in autonomous mode. Examples of the steering system 218 may include, but are not limited to, an autonomous steering control, a power-assisted steering system, a vacuum/hydraulic-based steering system, an electro-hydraulic power-assisted system (EHPAS), or a “steer-by-wire” system, or an autonomous steering system, known in the art.

The braking system 220 may be used to stop or slow down the vehicle 102 by application of resistive forces such as electromagnetic and/or frictional forces. The braking system 220 may be configured to receive a command from the powertrain control system 212 under the control of the circuitry 202, when the vehicle 102 is in an autonomous mode or a semi-autonomous mode. In accordance with an embodiment, the braking system 220 may be configured to receive a command from the circuitry 202 when the circuitry 202 preemptively detects a steep curvature based on the set current travel route of the vehicle 102, an obstacle, or other road hazards.

The vehicle power system 234 may regulate the charging and the power output of the battery 236 to various electric circuits and the loads of the vehicle 102. When the vehicle 102 is a hybrid vehicle or an autonomous vehicle, the vehicle power system 234 may provide the required voltage for certain components and enable the vehicle 102 to utilize the battery 236 power for a sufficient amount of time. In accordance with an embodiment, the vehicle power system 234 may correspond to power electronics, and may include a microcontroller that may be communicatively coupled (shown by dotted lines) to the in-vehicle network 240. In such an embodiment, the microcontroller may receive one or more commands from the powertrain control system 212 under the control of the circuitry 202.

The battery 236 may be a source of electric power for one or more electric circuits or loads (not shown). For example, the loads may include, but are not limited to various lights or lighting systems, such as headlights and interior cabin lights, electrically powered adjustable components, such as vehicle seats, mirrors, windows or the like, and/or other in-vehicle infotainment system, such as radio, speakers, electronic navigation system, electrically controlled, powered and/or assisted steering, such as the steering system 218. The battery 236 may be a rechargeable battery. The battery 236 may be a source of electrical power to the in-vehicle electronic device 114 (shown by dashed lines), the plurality of vehicle sensors 222, the image-capture device 112, and other hardware units, such as display 210. The battery 236 may be a source of electrical power to start an engine of the vehicle 102.

The wireless communication system 238 may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to communicate with other vehicles (a V2V communication) and one or more external devices (such as the RSU 108), and one or more cloud servers, such as the server 104, via the wireless communication network 110. The wireless communication system 238 may include, but is not limited to, an antenna, a telematics unit, a radio frequency (RF) transceiver, one or more amplifiers, one or more oscillators, a digital signal processor, a coder-decoder (CODEC) chipset, and/or a subscriber identity module (SIM) card. The wireless communication system 238 may wirelessly communicate by use of various communication protocols of the short or medium range communication channel and wireless communication network 110 (as described in FIG. 1).

The in-vehicle network 240 may include a medium through which the various control units, components, and/or systems of the vehicle 102 (such as the in-vehicle electronic device 114, the audio interface 206, display 210, the powertrain control system 212, the sensing system 214, the plurality of in-vehicle systems 216, and the wireless communication system 238) may communicate with each other. In accordance with an embodiment, in-vehicle communication of audio/video data for multimedia components may occur by use of Media Oriented Systems Transport (MOST) multimedia network protocol of the in-vehicle network 240 or other suitable networks for audio/video data communication. The MOST-based network may be a separate network from the controller area network (CAN). The MOST-based network may use a plastic optical fiber (POF) medium. In accordance with an embodiment, the MOST-based network, the CAN, and other in-vehicle networks may co-exist in a vehicle, such as the vehicle 102. The in-vehicle network 240 may facilitate access control and/or communication between the circuitry 202 and other ECUs, such as ECM or a telematics control unit (TCU) of the vehicle 102. Various devices or components in the vehicle I 02 may be configured to connect to the in-vehicle network 240, in accordance with various wired and wireless communication protocols. Examples of the wired and wireless communication protocols for the in-vehicle network 240 may include, but are not limited to, a vehicle area network (VAN), a CAN bus, Domestic Digital Bus (D2B), Time-Triggered Protocol (TTP), FlexRay, IEEE 1394, Carrier Sense Multiple Access With Collision Detection (CSMA/CD) based data communication protocol, Inter-Integrated Circuit (FC), Inter Equipment Bus (IEBus), Society of Automotive Engineers (SAE) J1708, SAE J1939, International Organization for Standardization (ISO) 11992, ISO 11783, Media Oriented Systems Transport (MOST), MOST25, MOST50, MOST150, Plastic optical fiber (POF), Power-line communication (PLC), Serial Peripheral Interface (SPI) bus, and/or Local Interconnect Network (LIN).

The functions and/or operations performed by the in-vehicle electronic device 114, as described in FIG. 1A, may be performed by the circuitry 202, such as a microprocessor. Other operations performed by the circuitry 202, are further described, for example, in FIGS. 3A to 3F.

FIGS. 3A to 3F illustrate exemplary scenarios for implementation of the disclosed personalization system and method for a vehicle based on spatial locations of body portions of occupants in the vehicle, in accordance with an embodiment of the disclosure. FIGS. 3A to 3F are explained in conjunction with elements from FIGS. 1 and 2.

With reference to FIG. 3A, there is shown an exemplary scenario 300A. The exemplary scenario 300A illustrates a portion 302 of the interior of the vehicle 102 to depict the location of mounting of the image-capture device 112 in the vicinity of a front mirror 304. There is also shown the display 210 of an infotainment head unit 306. The image-capture device 112 may be a wide-angle camera having a field-of-view 308 that is suited to capture a plurality of images of all the occupants of the vehicle 102 when the occupants are in a seated position.

With reference to FIG. 3B, there is shown an exemplary scenario 300B. FIG. 3B is explained in conjunction with elements from FIGS. 1, 2, and 3A. The exemplary scenario 300B includes a portion of the interior of the vehicle 102 to depict identification of a first occupant 310A in the vehicle 102 and tracking of a first facial portion 312A by the image-capture device 112. The first occupant 310A may correspond to the first user 116A (FIG. 1).

The image-capture device 112 may be configured to capture one or more images or a video of the first occupant 310A. The circuitry 202 may be communicatively coupled to the image-capture device 112. The circuitry 202 may be configured to identify a driver profile associated with the first occupant 310A based on facial recognition of the first occupant 310A. The circuitry 202 may be configured to match facial features of the first occupant 310A with stored images or facial features of different users for the identification of the first occupant 310A. In certain scenarios, for example, in low lighting conditions or at night, one or more other sensors, such as IR sensor, may be employed to aid in identification based on a comparison of an object boundary of the first occupant 310A and pre-stored boundary data of different users. In some embodiments, the image-capture device 112 may include night-vision functionalities to execute facial recognition at night or in low lighting conditions.

In cases where the driver profile of the first occupant 310A is identified based on facial recognition, the circuitry 202 may be configured to communicate an audio signal to the vehicle audio system 228 to output a customized audio greeting specific to the first occupant 310A. For example, the first occupant 310A may be notified of recognition confirmation with custom audio greeting, “Good morning, Fredrick; How are you doing today?” via at least one of the audio speakers of the plurality of speakers 232. Based on learned information received from the machine learning system in the memory 204, the circuitry 202 may be configured to predict that first occupant 310A intends to drive to the office address of the first occupant 310A. The learned information is generated by the machine learning system based on analysis of historical data related to a schedule of daily activities, user behavior, and a current time of day. In some embodiments, the circuitry 202 may be configured to automatically set the destination location in the navigation unit of the vehicle 102 and seek confirmation from the first occupant 310A for an autonomous ride. For example, the destination location automatically set to the office address when it is detected that the first occupant 310A usually takes an autonomous ride to office in the morning time between 8 AM and 9 AM, based on the analysis of the historical data.

In some embodiments, the circuitry 202 may be configured to execute a first level of customization in the vehicle 102 based on the defined user preferences in the identified driver profile of the first occupant 310A. For example, the electrically powered adjustable components, such as the driver seat, vehicle mirrors (e.g., the ORVM 208), front mirror, radio, music preferences, and driving mode preferences, may be adjusted in accordance with the user preferences in the driver profile of the first occupant 310A. The circuitry 202 may be configured to communicate a plurality of control signals to one or more other ECUs to initiate the adjustments in accordance with the user preferences in the driver profile of the first occupant 310A.

With reference to FIG. 3C, there is shown an exemplary scenario 300C. FIG. 3C is explained in conjunction with elements from FIGS. 1, 2, 3A, and 3B. The exemplary scenario 300B illustrates a portion of the interior of the vehicle 102 to depict determination of a plurality of Z-heights of a plurality of body portions of the first occupant 310A and a second occupant 310B in the vehicle 102.

In FIG. 3C, there is shown a first body portion, such as the first facial portion 312A of the first occupant 310A and a second facial portion 312B of the second occupant 310B. There is further shown a reference position 314, a second body portion, such as a first facial middle portion 318A and a second facial middle portion 318B, and face rectangles 316A and 316B.

In accordance with an embodiment, the circuitry 202 may be configured to estimate a first Z-height 320A (also represented by “XI” cm”) of the first facial portion 312A of the first occupant 310A from the reference position 314 in the vehicle, as shown. The circuitry 202 may be configured to continuously track the first facial portion 312A as represented by the face rectangle 316A. The first Z-height 320A of “XI” cm, may refer to a vertical height from the reference position 314 in the vehicle 102 to one side (e.g., the lower side) of the face rectangle 316A of the detected first facial portion 312A of the first occupant 310A. The reference position 314 corresponds a horizontal plane in the vehicle 102 from a seated position of the first occupant 310A, as shown, for example. A second Z-height 322A (also represented by “YI” cm”) of a second body portion, such as the first facial middle portion 318A, from the reference position 314 may also be estimated, as shown. Similar to the first Z-height 320A and the second Z-height 322A for different body portions of the first occupant 310A, the circuitry 202 may be further configured to estimate a third Z-height 320B of the second facial portion 312B of the second occupant 310B from the reference position 314. Accordingly, a fourth Z-height 322B of the second facial middle portion 318B from the reference position 314 may also be estimated.

In accordance with an embodiment, the plurality of Z-heights of the plurality of body portions may be estimated concurrently by face tracking based on the plurality of images captured by the image-capture device 112. It is to be understood by a person of ordinary skill in the art that only two body portions and two occupants are described above for exemplary and illustrative purposes only, and therefore, shall not be construed to limit the scope of the disclosure.

The circuitry 202 may be further configured to determine an associative relationship between the estimated plurality of Z-heights and the plurality of in-vehicle systems 216 of the vehicle 102. An example of the associative relationship between the estimated plurality of Z-heights and the plurality of in-vehicle systems 216 of the vehicle 102, is given in TABLE 1.

TABLE 1

Associative relationship between a Z-height of a body portion and corresponding mapped in-vehicle system

Occupants
Occupant_name
First_Z-height_B1
Vehicle_system_1
Second_Z-height_B2
Vehicle_system_2
. . .

D01
Fredrick
X1
HVAC
Y1
Audio
. . .

P01
Samantha
X2
HVAC
Y2
Audio
. . .

. . .
. . .
. . .
. . .
. . .
. . .
. . .

With reference to TABLE 1, the column “Occupants” denotes type of occupants (such as a driver) and an identification number of driver profile “DOI”. The column “Occupant_name” denotes name of the occupant as identified based on face recognition. In case an occupant is unidentified, the cell may be left blank or “O”. The column “First_Z-height_B1” includes the first Z-height 320A (also represented by “XI” cm”) of the first facial portion 312A of the first occupant 310A (e.g., having driver profile “DO I”). The column “First_Z-height_B1” also includes the third Z-height 320B (also represented by “X2” cm”) of the second facial portion 312B of the second occupant 310B (e.g., having a new passenger profile “POI”). The first body portion, such as both the facial portions 312A and 312B, are associated with the HVAC system 226 (an in-vehicle system of the plurality of in-vehicle systems 216 represented under column “Vehicle_system_1”) in the TABLE 1, as shown. Similarly, the second Z-height 322A (also represented by “Y1” cm”) of a second body portion, such as the first facial middle portion 318A and the fourth Z-height 322B (also represented by “Y2” cm”) of the second facial middle portion 318B are associated with the vehicle audio system 228.

With reference to FIG. 3D, there is shown an exemplary scenario 300D. FIG. 3D is explained in conjunction with elements from FIGS. 1, 2, 3A, 3B, and 3C. The exemplary scenario 300D illustrates a portion of the interior of the vehicle 102 to depict a precise personalization of in-vehicle systems based on Z-heights of body portions of vehicle occupants. There is further shown a HVAC unit 324 with a first set of vents 324A and a second set of vents 324B. There is also shown a custom output from the HVAC unit 324, such as a direction of a first airflow 326A to the first facial portion 312A of the first occupant 310A and a direction of a second airflow 326B to the second facial portion 312B of the second occupant 310B. A custom output from the vehicle audio system 228 to the first facial middle portion 318A and the second facial middle portion 318B, is also shown.

In accordance with an embodiment, the circuitry 202 may be configured to control the plurality of in-vehicle systems 216 to direct an output from a corresponding in-vehicle system of the plurality of in-vehicle systems 216 to a specific body portion of the plurality of body portions of each of the one or more occupants in the vehicle I 02. The output from a corresponding in-vehicle system, such as the HVAC system 226, may be directed to the specific body portion, such as the face portions, based on the estimated plurality of Z-heights and the determined associative relationship, as shown in TABLE 1, for example. In some embodiments, the plurality of in-vehicle systems 216 may be controlled concurrently to direct a plurality of output from the plurality of in-vehicle systems 216 such that output from one in-vehicle system, such as the HVAC system 226, do not interfere (and instead complement) with output of another in-vehicle system, such as the vehicle audio system 228, of the plurality of in-vehicle systems 216.

The circuitry 202, such as the microprocessor, may be configured to control an angle of the first set of vents 324A of the HVAC unit 324 to direct an airflow (such as the first airflow 326A) toward the first facial portion 312A of the first occupant 310A. The airflow (such as the first airflow 326A) may be directed toward the first facial portion 312A based on the estimated first Z-height 320A (e.g., “XI” cm) and the determined associative relationship that the first Z-height 320A (e.g., “XI” cm) is meant for the HVAC system 226 of the vehicle 102. The circuitry 202 may be configured to communicate a position control signal to the first set of vents 324A to automatically control positioning and/or angle of first set of vents 324A such that an airflow output from the first set of vents 324A is directed toward the first facial portion 312A. Similarly, the circuitry 202 may be configured to control an angle of the second set of vents 324B of the HVAC unit 324 to direct an airflow (such as the second airflow 326B) toward the second facial portion 312B of the second occupant 310B in accordance with the estimated third Z-height 320B (also represented by “X2” cm”). The positioning and/or angle of the servo-motor 230 controlled first set of vents 324A and the second set of vents 324B are vertically adjusted and updated continuously to control airflow in real time or near-real time based on face tracking and change in estimation of corresponding Z-heights of the facial portions 312A and 312B.

The control the plurality of in-vehicle systems 216 further includes control of the vehicle audio system 228 to direct an audio output from the plurality of speakers 232 of the vehicle audio system 228 toward the mid facial portions 318A and 318B of first occupant 310A and the second occupant 310B respectively. The directivity of the audio output may be based on the second Z-height 322A (also represented by “Y1” cm”) and the fourth Z-height 322B (also represented by “Y2” cm”) and the determined associative relationship that the “YI” and “Y2” are associated with the vehicle audio system 228 for optimum audio experience. Thus, the vehicle audio system 228 may be tuned in real time or near-real time for optimum audio performance and enhanced listening experience for the first occupant 310A and the second occupant 310B in the vehicle 102.

With reference to FIG. 3E, there is shown an exemplary scenario 300E. FIG. 3E is explained in conjunction with elements from FIGS. 1, 2, and 3A to 3D. The exemplary scenario 300E illustrates a top view of the interior of the vehicle 102 to depict a precise and a real time personalization of in-vehicle systems based on Z-heights of body portions of vehicle occupants, occupants positioning, and the number of occupants. There is further shown a first center of audio focus 330A, a second center of audio focus 330B and different directions of airflows 332A, 332B, 332C, and 332D based on positioning and the detected number of occupants, such as the first occupant 310A, the second occupant 310B, a third occupant 310C, and a fourth occupant 310D.

In accordance with an embodiment, in addition to the vertical Z-height based personalization, a horizontal (X, Y coordinates) occupant's position based personalization may also occur in the vehicle 102. For example, the circuitry 202 may be configured to determine and update an optimal location in real time or near-real time for a center of audio focus in the interior of the vehicle 102 based on a track of current positioning of one or more occupants in the vehicle 102. For example, when a single occupant, such as the first occupant 310A is present in the vehicle 102, the circuitry 202 may communicate a first control signal to the vehicle audio system 228 to focus the output from the plurality of speakers 232 to the first center of audio focus 330A. The circuitry 202 may also communicate a second control signal to the HVAC system 226 to selectively direct the airflow 332A from a front HVAC unit of the HVAC system 226 to the first facial portion 312A of the first occupant 310A. In some embodiments, both the first control signal and the second control signal may be communicated concurrently to respective in-vehicle systems.

In accordance with an embodiment, when the number of occupants or seating position of the occupants changes (an increase in this case) in the vehicle 102, the circuitry 202 may be configured to shift the first center of audio focus 330A to the second center of audio focus 330B, as shown in FIG. 3E. In some embodiments, a combination of seat occupancy sensors (such as the seat occupancy sensor 224A) and the face tracking feature of the image-capture device 112 may be utilized for an accurate occupant(s) position estimation.

Further, the output from different servo-controlled vents in the front or rear of the vehicle 102 may be controlled such that each of the first occupant 310A, the second occupant 310B, the third occupant 310C, and the fourth occupant 310D receive a personalized directed airflow (e.g., the different directions of airflows 332A, 332B, 332C, and 332D, as shown). The personalized directed airflow towards their facial portions may be outputted in accordance to estimated Z-heights of the facial portions, as discussed in FIGS. 3C and 3D, for example.

In accordance with an embodiment, Right-left (R-L) balance, Front-back (F-B) fade, and other audio settings may be adjusted for optimal listening experience for current positioning of the one or more occupants. Further, when the vehicle 102 stops and one passenger exits the vehicle 102, the image-capture device 112 may be configured to detect change in an occupant seating scenario. The circuitry 202, based on the detected change in the occupant seating scenario, may automatically update audio settings of the vehicle audio system 228 for the remaining occupants (i.e. new occupant seating scenario).

With reference to FIG. 3F, there is shown an exemplary scenario 300F. FIG. 3F is explained in conjunction with elements from FIGS. 1, 2, and 3A to 3E. The exemplary scenario 300F illustrates a portion of the interior of the vehicle 102 to depict monitoring of a driver state. There is shown the first occupant 310A in a distressed state in the vehicle 102.

In accordance with an embodiment, the circuitry 202 may be configured to monitor, by use of the image-capture device 112, a plurality of defined metrics related to the driver, such as the first occupant 310A, of the vehicle 102. The plurality of defined metrics related to the driver of the vehicle 102 may include, but are not limited to a facial position, body language, a seating position, eye movement, body movement, health parameters, and a tone, or pitch of driver's voice. In accordance to the exemplary scenario 300F, the driver, such as the first occupant 310A, is detected in a distressed state during after a crash. The circuitry 202 activates an emergency response (ERS) mode in the vehicle 102 and seeks response from the driver (e.g., the first occupant 310A) within the user specified or pre-defined time period. In other embodiments, a driver dozing off is identified through recognition of closing eyes or a bobbing head. In such a situation, an alert may be sounded, cabin temperature may be reduced, cold air may be blown on the driver, and the vehicle 102 may be brought to a stop in a safe manner, or another action may be taken.

Thereafter, the circuitry 202 may be configured to communicate a self-diagnostic test start signal to an on-board diagnostics (OBD) system of the vehicle 102. The self-diagnostic test is done to determine whether the vehicle 102 is damaged or okay-to-drive in an autonomous mode or auto pilot (AP) mode. In cases where the vehicle 102 is damaged, the vehicle 102 remains parked, and a health emergency alert signal is communicated to the medical emergency center 106, by the wireless communication system 238. In cases where the vehicle 102 is diagnosed as okay-to-drive but the first occupant 310A is unresponsive, the circuitry 202 may communicate an autonomous mode start signal to an engine control module (ECM) of the vehicle 102. This may cause the vehicle 102 to automatically drive itself to a preferred hospital based on the identified driver profile “DOI”.

FIGS. 4A, 4B, 4C, and 4D collectively, depict a flow chart that illustrates exemplary operations for personalization of a vehicle based on spatial locations of body portions of occupants in the vehicle, in accordance with an embodiment of the disclosure. With reference to FIGS. 4A, 4B, 4C, and 4D there is shown a flow chart 400. The flow chart 400 is described in conjunction with FIGS. 1, 2, and 3A to 3F. The operations, implemented at the in-vehicle electronic device 114 in association with the image-capture device 112, for personalization of a vehicle, begin at 402 and proceed to 404.

At 404, a plurality of images or a video of one or more occupants in the vehicle 102 may be captured. The image-capture device 112 may be configured to capture the plurality of images or the video of the one or more occupants in the vehicle 102. At 406, facial portion(s) of one or more occupants in the vehicle 102 may be detected based on the plurality of images or the video captured by the image-capture device 112.

At 408, at least a driver profile or a passenger profile (each could also be referred to as an occupant profile) associated with each occupant (who may be seated at a driver seat or one of the passenger seats) may be searched based on a comparison of facial features of the occupant with stored facial features of users related to a plurality of driver profiles and a plurality of passenger profiles. The circuitry 202, such as a microprocessor, may be configured to search for the driver profile and/or the passenger profile of each occupant based on the comparison of the facial features of the occupant, such as the first occupant 310A, with stored facial features of users related to the plurality of driver profiles stored in the memory 204. At 410, facial recognition is performed on the acquired data, such as the plurality of images or the video of the one or more occupants, to identify a driver profile and/or a passenger profile. The circuitry 202 may be configured to check whether the driver profile is identified based on facial recognition from the stored plurality of driver profiles in the memory 204. Similarly, the circuitry 202 may be further configured to check whether the passenger profile is identified based on facial recognition from the stored plurality of passenger profiles in the memory 204. A match of the facial features of an occupant, such as the first occupant 310A, with stored facial features of one user may result in the facial recognition. In cases where the driver profile and/or the passenger profile is identified, the control passes to 412 else to 416.

At 412, an audio signal may be communicated to the vehicle audio system 228 to output customized audio greeting to at least the first occupant 310A. The circuitry 202 may be configured to communicate the audio signal to the vehicle audio system 228 to output the customized audio greeting, for example, “Hello, Fredrick” to the first occupant 310A. At 414, a first level of customization may be executed in the vehicle 102 based on defined user-preferences in the identified driver profile or passenger profile of the one or more occupants, such as the first occupant 310A. For example, the electrically powered adjustable components, such as the driver seat, vehicle mirrors (e.g., the ORVM 208), front mirror, radio, music preferences, and driving mode preferences, may be adjusted in accordance with the user preferences in the driver profile of the first user 116A. The circuitry 202 may be configured to communicate a plurality of control signals to one or more other ECUs to initiate the adjustments in accordance with the user preferences in the driver profile of the first occupant 310A. In some embodiments, if there are more than one occupants in the vehicle 102, similar to the first occupant 310A, audio signal may be communicated to the vehicle audio system 228 to output customized audio greeting to each occupant. For example, in addition to custom audio greeting to the first occupant 310A, the second occupant 310B may also be greeted as, “Hello Samantha, how are you doing today?”, via an audio speaker that is in vicinity of the second occupant 310B.

At 416, an unrecognized occupant (e.g., a first occupant, a second occupant, or a new occupant) may be marked (or tagged) as a new user and a request to set a new profile may be generated on the display 210 of an infotainment head unit (e.g., the in-vehicle electronic device 114). In cases where there are multiple occupants, and one or more occupants are not identified, for example, a passenger seated at the front seat, the passenger may be tagged as new user and requested to set the new profile similar to the first occupant 310A, such as the driver. At 418, a plurality of Z-heights of a plurality of body portions of each of the one or more occupants in the vehicle 102 may be estimated. An example of the estimation of the plurality of Z-heights, has been shown and described in details in the FIG. 3C.

At 420, an associative relationship may be determined between the estimated plurality of Z-heights of the plurality of body portions of each of the one or more occupants and the plurality of in-vehicle systems 216 of the vehicle 102. An example of the associative relationship is depicted in TABLE 1 in the FIG. 3C. At 422, the plurality of in-vehicle systems 216 may be controlled to direct an output from a corresponding in-vehicle system of the plurality of in-vehicle systems 216 to a specific body portion of the plurality of body portions of each of the one or more occupants in the vehicle 102. An example of the control of the plurality of in-vehicle systems 216, such as the HVAC system 226 and the vehicle audio system 228, has been shown and described in the FIGS. 3D and 3E.

At 424, an optimal location to direct the audio in the interior of the vehicle 102 is determined, based on positioning of the one or more occupants in the vehicle 102. An example of the determination of the optimal location for the center of audio (or music) focus has been shown and described in FIG. 3E. In some embodiments, as the vehicle 102 includes the plurality of speakers 232, audio from all of the plurality of speakers 232 may be directed towards one location (or position). Alternatively, a same audio or different audio from the plurality of speakers 232 may be directed toward different locations in the interior of the vehicle 102 based on positioning of the one or more occupants in the vehicle 102. In cases where audio output from the plurality of speakers