FIG. 1F illustrates the POVC adjustment system 200 receiving head movement data 150. The head movement data 150 may indicate a direction in which the user 12 is moving his/her head. In some implementations, the POVC adjustment system 200 determines whether the head is moving in a direction of a correction. If the head is moving in the same direction as the correction, the POVC adjustment system 200 accelerates an increase in a level of the POVC in the Y axis. For example, the increase in the POVC of the Y axis from 0 to 1 occurs at an accelerated rate. By contrast, if the head is not moving in the direction of the correction (e.g., if the head is moving in an opposite direction), the POVC adjustment system 200 does not accelerate the increase in the level of the POVC in the Y axis (e.g., the increase from 0 to 1 occurs at a default rate).

FIG. 1G illustrates the POVC adjustment system 200 receiving eye tracking data 160. In some implementations, the POVC adjustment system 200 utilizes the eye tracking data 160 to determine whether the user 12 is blinking (e.g., to determine whether the user's eyes are closed at any given point of time). In some implementations, the POVC adjustment system 200 accelerates an increase in a level of the POVC in the Y axis while the user 12 is blinking (e.g., while the user's eyes are closed). For example, the increase in the POVC of the Y axis from 0 to 1 occurs at an accelerated rate. While the user 12 is blinking, the user 12 is unlikely to notice the accelerated increase in the level of the POVC in the Y axis. Hence, the transition can be accelerated without adversely impacting a user experience provided by the electronic device 20. By contrast, when the user 12 is not blinking, the user 12 may notice significant increases in the level of POVC in the Y axis. As such, while the user 12 is not blinking (e.g., while the user's eyes are open), the POVC adjustment system 200 does not accelerate the increase in the level of the POVC in the Y axis (e.g., the increase from 0 to 1 occurs at a default rate).

FIG. 1H illustrates the POVC adjustment system 200 receiving device usage data 170. In some implementations, the POVC adjustment system 200 utilizes the device usage data 170 to determine whether an accessibility mode has been activated (e.g., whether the user 12 has specifically activated the accessibility mode or whether to automatically activate the accessibility mode based on a detected impairment of the user 12). In some implementations, the POVC adjustment system 200 decelerates an increase in a level of the POVC in the Y axis when the accessibility mode is activated. For example, the increase in the POVC of the Y axis from 0 to 1 occurs at a decelerated rate. A person with an impairment may be more susceptible to the increase in the POVC value in the Y axis (e.g., the person may be more susceptible to feeling discomfort and/or get dizzy more easily). Hence, the transition can be decelerated in order to reduce a likelihood of causing discomfort to the user 12 if the user 12 has an impairment. By contrast, when the accessibility mode is not activated, the POVC adjustment system 200 does not decelerate the increase in the level of the POVC in the Y axis (e.g., the increase from 0 to 1 occurs at a default rate).

FIG. 2 is a block diagram of the POVC adjustment system 200 in accordance with some implementations. In various implementations, the POVC adjustment system 200 includes a data obtainer 210, a POVC transitioner 220 and an environment presenter 230. In some implementations, the data obtainer 210 obtains a user request 212 to switch from presenting a first type of environment to a second type of environment. For example, the user request 212 may include a request to switch from presenting an MR environment to a VR environment (e.g., a request to transition from the MR environment 30 shown in FIG. 1A to the VR environment 100 shown in FIG. 1C). As another example, the user request 212 may include a request to switch from presenting a VR environment to an MR environment (e.g., a request to transition from the VR environment 100 shown in FIG. 1C to the MR environment 30 shown in FIG. 1A).

In some implementations, the data obtainer 210 obtains contextual data that the POVC adjustment system 200 utilizes to transition between different types of environments. In some implementations, the contextual data includes the head movement data 150 shown in FIG. 1F, the eye tracking data 160 shown in FIG. 1G and/or the device usage data 170 shown in FIG. 1H. In various implementations, a speed at which the transition occurs is a function of the contextual data. For example, in some implementations, a rate at which a level of POVC is increased or decreased in an axis is based on the head movement data 150, the eye tracking data 160 and/or the device usage data 170.

In various implementations, the data obtainer 210 provides a transition trigger 214 to the POVC transitioner 220. In some implementations, the transition trigger 214 operates as a request to transition from presenting a first type of environment to presenting a second type of environment. In some implementations, the transition trigger 214 is based on the user request 212. For example, the data obtainer 210 generates the transition trigger 214 based on an explicit request from the user 12 to switch from displaying an MR environment to displaying a VR environment. Alternatively, in some implementations, the data obtainer 210 automatically determines the transition trigger 214. For example, the data obtainer 210 may automatically determine to switch from presenting a first type of environment to presenting a second type of environment. As an example, the data obtainer 210 may automatically determine to switch from the MR environment to the VR environment in response to detecting that a user interest in viewing a pass-through of the physical environment is less than an MR viewing interest threshold and/or a user interest in viewing the VR environment is greater than a VR viewing interest threshold.

In various implementations, the POVC transitioner 220 determines transition parameters 222 for the transition from the first type of environment to the second type of environment. In some implementations, the transition parameters 222 include a threshold amount of time 222a associated with the transition from the first type of environment to the second type of environment. In some implementations, the transition parameters 222 include transitional POVC values 222b (e.g., the MR POVC values 50, the intermediary POVC values 60 and the VR POVC values 70 shown in FIG. 1A, the POVC values shown in FIG. 1D, or the POVC values shown in FIG. 1E).

In some implementations, the threshold amount of time 222a indicates a time duration associated with the transition from the first type of environment to the second type of environment (e.g., an amount of time that passes between displaying an MR environment and a VR environment when transitioning from the MR environment to the VR environment). In some implementations, the threshold amount of time 222a indicates a time duration for displaying an intermediary environment 232 (e.g., the intermediary environment 90 shown in FIG. 1B) when transitioning from the first type of environment to the second type of environment. In some implementations, the threshold amount of time 222a specifies an amount of time that the POVC adjustment system 200 takes to gradually transition from the intermediary environment 232 to a target environment 234 (e.g., the VR environment 100 shown in FIG. 1C when transitioning from the MR environment 30 to the VR environment 100).

In various implementations, the threshold amount of time 222a is a function of the contextual data that the data obtainer 210 obtains. For example, the POVC transitioner 220 can elongate or shorten the threshold amount of time 222a from a default amount of time based on the contextual data obtained by the data obtainer 210. As discussed in relation to FIG. 1F, in some implementations, the POVC transitioner 220 shortens the threshold amount of time 222a when the head movement data 150 indicates that a head of the user 12 is moving in the same direction as the correction. As such, when the head movement is in the same direction as the correction, the transition between different POVC values may be accelerated. As discussed in relation to FIG. 1G, in some implementations, the POVC transitioner 220 shortens the threshold amount of time 222a when the eye tracking data 160 indicates that the user 12 is blinking. As such, the transition between different POVC values can be accelerated while the user's eyes are closed. As discussed in relation to FIG. 1H, in some implementations, the POVC transitioner 220 elongates the threshold amount of time 222a when the device usage data 170 indicates that an accessibility mode has been activated. As such, the transition between different POVC values may be decelerated in order to make the transition less noticeable for a user with a potential impairment.

In various implementations, the environment presenter 230 presents the intermediary environment 232 (e.g., the intermediary environment 90 shown in FIG. 1B) in accordance with the transitional POVC values 222b (e.g., in accordance with the intermediary POVC values 60 shown in FIG. 1A). In some implementations, the environment presenter 230 presents the intermediary environment 232 for an amount of time indicated by the threshold amount of time 222a. The environment presenter 230 gradually transitions from displaying the intermediary environment 232 to the target environment 234. In some implementations, the target environment 234 includes a VR environment 234a (e.g., the VR environment 100 shown in FIG. 1C) when the electronic device 20 is transitioning from MR to VR. In some implementations, the target environment 234 includes an MR environment 234b (e.g., the MR environment 30 shown in FIG. 1C) when the electronic device 20 is transitioning from VR to MR. In some implementations, the gradual transition from the intermediary environment 232 to the target environment 234 takes an amount of time indicated by the threshold amount of time 222a. In various implementations, the gradual transition from the intermediary environment 232 to the target environment 234 includes changing the level of POVC in accordance with the transitional POVC values 222b.

FIG. 3 is a flowchart representation of a method 300 for transitioning between presenting different types of environments. In various implementations, the method 300 is performed by the electronic device 20 shown in FIGS. 1A-1C and/or the POVC adjustment system 200 shown in FIGS. 1A-2. In some implementations, the method 300 is performed by processing logic, including hardware, firmware, software, or a combination thereof. In some implementations, the method 300 is performed by a processor executing code stored in a non-transitory computer-readable medium (e.g., a memory).

As represented by block 310, in various implementations, the method 300 includes presenting a first environment (e.g., a mixed reality (MR) environment) with partial point-of-view correction (POVC) (e.g., a first level of POVC). For example, as shown in FIG. 1A, the electronic device 20 presents the MR environment 30 and the POVC adjustment system 200 performs perspective correction in accordance with the MR POVC values 50 to content associated with the MR environment 30 (e.g., to representations of the first physical object 32 and the second physical object 34 depicted in the MR environment 30). In some implementations, the partial POVC includes less than full POVC in at least one axis. In some implementations, the partial POVC includes full POVC in a first axis (e.g., full POVC in the X axis as denoted by the MR X axis POVC value 52 shown in FIG. 1A), no POVC in a second axis (e.g., no POVC in the Y axis as denoted by the MR Y axis POVC value 54), and full POVC in a third axis (e.g., full POVC in the Z axis as denoted by the MR Z axis POVC value 56). In some implementations, the MR environment includes representations of physical objects in a physical environment of the device (e.g., the first physical object 32 and the second physical object 34 shown in FIG. 1A).

As represented by block 320, in some implementations, the method 300 includes determining to transition from the second environment with the partial POVC to a second environment (e.g., a virtual reality (VR) environment) with full POVC (e.g., a second level of POVC that is greater than the first level of POVC). For example, the device determines to switch presenting the MR environment with partial POVC to presenting the VR environment with full POVC. In some implementations, the determination to transition is based on a user request (e.g., the user request 212 shown in FIG. 2). Alternatively, in some implementations, the determination to transition is an automatic determination made by the device without an explicit request from the user to transition from the MR environment to the VR environment. For example, the device determines to transition to the VR environment based on a user interest in viewing the VR environment being greater than a user interest in viewing the MR environment. As another example, the device determines to transition to the VR environment based on an appearance of a virtual object being better than an appearance of the virtual object in the MR environment.

As represented by block 330, in some implementations, the method 300 includes presenting, for a threshold amount of time, an intermediary environment with intermediate POVC that is a function of the partial POVC and the full POVC (e.g., a third level of POVC that is a function of the first level of POVC and the second level of POVC). For example, as shown in FIG. 1B, the electronic device 20 presents the intermediary environment 90 when transitioning from the MR environment 30 shown in FIG. 1A to the VR environment 100 shown in FIG. 1C. Moreover, as illustrated in FIG. 1B, the POVC adjustment system 200 presents the intermediary environment 90 by performing perspective correction in accordance with the intermediary POVC values 60. As another example, as described in relation to FIG. 2, the environment presenter 230 presents the intermediary environment 232 for the threshold amount of time 222a prior to presenting the target environment 234. In various implementations, presenting the intermediary environment with the intermediate POVC tends to reduce a discomfort that may be caused due to an abrupt change from the partial POVC in the MR environment to the full POVC in the VR environment.

As represented by block 330a, in some implementations, transitioning from the partial POVC to the full POVC includes increasing an amount of POVC in a first axis while maintaining an amount of POVC in a second axis. For example, as shown in FIG. 1B, the POVC adjustment system 200 increases the POVC in the Y axis from 0 to 0.5 while maintaining the POVC in the X axis at full POVC (e.g., at 1.0). In some implementations, transitioning from the partial POVC to the full POVC further includes decreasing an amount of POVC in a third axis while increasing the amount of POVC in the first axis and maintaining the amount of POVC in the second axis. For example, as shown in FIG. 1B, the POVC adjustment system 200 decreases the POVC in the Z axis from 1.0 to 0.5 while maintaining the POVC in the X axis at 1.0. In some implementations, temporarily decreasing the POVC in the third axis allows the device to mask (e.g., reduce a noticeability of) the increase in the POVC in the first axis thereby reducing potential discomfort caused due to changes in the POVC in a single axis.

As represented by block 330b, in some implementations, the partial POVC includes full POVC in an X axis, no POVC in a Y axis, and full POVC in a Z axis (e.g., full X, 0 Y, full Z). For example, as shown in FIGS. 1A-1C, the MR POVC values 50 includes full POVC in the X axis, no POVC in the Y axis and full POVC in the Z axis. In some implementations, the full POVC includes full POVC in the X axis, full POVC in the Y axis and full POVC in the Z axis (e.g., full X, full y, full z). For example, as shown in FIGS. 1A-1C, the VR POVC values 70 include full POVC in the X axis, the Y axis and the Z axis. In some implementations, the intermediate POVC includes full POVC in the X axis, partial POVC in the Y axis, and partial POVC in the Z (e.g., full X, 0.5 y, 0.5 z). For example, as shown in FIGS. 1A-1C, the intermediary POVC values 60 includes full POVC in the X axis, partial POVC in the Y axis and partial POVC in the Z axis.

In some implementations, presenting the intermediary environment includes simultaneously decreasing the POVC in the Z axis from full POVC to partial POVC and increasing the POVC in the Y axis from no POVC to partial POVC. For example, as shown in FIGS. 1A-1B, the POVC adjustment system 200 decreases the POVC in the Z axis from the MR Z axis POVC value 56 to the intermediary Z axis POVC value 66 while increasing the POVC in the Y axis from the MR Y axis POVC value 54 to the intermediary Y axis POVC value 64. In some implementations, transitioning from the intermediary environment to the VR environment includes simultaneously increasing the POVC in the Z axis and the Y axis from partial POVC to full POVC. For example, as shown in FIGS. 1B-1C, the POVC adjustment system 200 increases the POVC in the Z axis from the intermediary Z axis POVC value 66 to the VR Z axis POVC value 76 while increasing the POVC in the Y axis from the intermediary Y axis POVC value 64 to the VR Y axis POVC value 74.

As represented by block 330c, in some implementations, the partial POVC includes full POVC in an X axis, no POVC in a Y axis, and no POVC in a Z axis (e.g., full X, 0 Y, 0 Z). In some implementations, the full POVC includes full POVC in the X axis, full POVC in the Y axis and full POVC in the Z axis (e.g., full X, full y, full z). In some implementations, the intermediate POVC includes full POVC in the X axis, partial POVC in the Y axis, and partial POVC in the Z (e.g., full X, 0.5 y, 0.5 z). In such implementations, presenting the intermediary environment includes simultaneously increasing the POVC in the Z axis and the Y axis from no POVC to partial POVC. For example, simultaneously increasing the POVC in the Y axis and the Z axis from 0 to 0.5. In such implementations, transitioning from the intermediary environment to the VR environment includes simultaneously increasing the POVC in the Z axis and the Y axis from partial POVC to full POVC. For example, simultaneously increasing the POVC in the Y axis and the Z axis from 0.5 to 1.0.

As represented by block 330d, in some implementations, presenting the intermediary environment with the intermediate POVC for the threshold amount of time prevents an abrupt transition from the partial POVC to the full POVC. Preventing abrupt transitions between respective perspective corrections associated with MR and VR tends to reduce discomfort associated with switching between MR and VR, for example, by reducing a likelihood of the user feeling dizzy due to sudden changes in the perspective corrections being applied to displayed content. As such, presenting the intermediary environment tends to enhance a user experience provided by the device. In some implementations, presenting the intermediary environment allows the user to use the device for a prolonged period of time thereby increasing a utility of the device.

As represented by block 340, in various implementations, the method 300 includes after presenting the intermediary environment for the threshold amount of time, transitioning from the intermediary environment with the intermediate POVC to the VR environment with the full POVC. For example, as shown in FIGS. 1B-IC, the electronic device 20 transitions from presenting the intermediary environment 90 shown in FIG. 1B to presenting the VR environment 100 shown in FIG. 1C. As another example, as shown in FIG. 2, the environment presenter 230 transitions to presenting the target environment 234 from the intermediary environment 232.

As represented by block 340a, in some implementations, transitioning from the intermediary environment to the VR environment includes displaying a gradual transition from the intermediate POVC to the full POVC. For example, as described in relation to FIGS. 1B and 1C, the POVC adjustment system 200 gradually adjusts the POVC from the intermediary POVC values 60 to the VR POVC values 70. As another example, as described in relation to FIG. 2, the environment presenter 230 gradually transitions from the intermediary environment 232 to the target environment 234 over the threshold amount of time 222a in order to provide a smooth transition (e.g., instead of an abrupt change that may cause discomfort to the user).

As represented by block 340b, in some implementations, transitioning from the intermediary environment to the VR environment includes displaying an angled zoom effect. More generally, in various implementations, transitioning from the intermediary environment to the VR environment results in a zoom effect when the partial POVC includes full POVC in a Z axis, the intermediate POVC includes partial POVC in the Z axis and the full POVC includes full POVC in the Z axis. For example, as illustrated in FIGS. 1A-1C, temporarily reducing the POVC in the Z axis provides an appearance of the zoom effect. While FIGS. 1A-1C illustrate a reduction in the POVC in the Z axis from 1.0 to 0.5, other degrees of reduction are also contemplated. For example, the device can reduce the POVC in the Z axis from 1 to 0.75, and subsequently increase the POVC in the Z axis from 0.75 to 1.

As represented by block 340c, in some implementations, the method 300 includes detecting a head motion of a user of the electronic device, and accelerating the transition from the intermediary environment with the intermediate POVC to the VR environment with the full POVC when the head motion is in a direction of a correction. For example, as described in relation to FIG. 1F, if the user is looking down and is expected to look up, the POVC adjustment system 200 may increase the POVC in the Y axis from 0 to 1 at an accelerated rate. As such, in some implementations, an amount of time associated with transitioning between MR and VR is a function of a head movement of the user.

In some implementations, the method 300 includes detecting that a user of the electronic device is blinking, and accelerating the transition from the intermediary environment with the intermediate POVC to the VR environment with the full POVC in response to detecting that the user is blinking. For example, as described in relation to FIG. 1G, if the user is blinking, the POVC adjustment system 200 may increase the POVC in the Y axis from 0 to 1 at an accelerated rate. As such, in some implementations, an amount of time associated with transitioning between MR and VR is a function of an eye blinking rate of the user.

In some implementations, the method 300 includes determining that an accessibility mode has been activated, and extending a time duration associated with the transitioning from the intermediary environment with the intermediate POVC to the VR environment with the full POVC in response to detecting that the accessibility mode has been activated. For example, as described in relation to FIG. 1H, if accessibility mode has been activated, the POVC adjustment system 200 may elongate a duration of the transition in order to reduce discomfort for a user with an impairment. For example, the transitions between MR and VR may take 30 seconds for a user without an impairment and one minute for a user with an impairment.

As represented by block 340d, in some implementations, the method 300 includes, while presenting the VR environment with the full POVC, determining to transition from the VR environment to the MR environment with the partial POVC. In some implementations, the method 300 includes presenting, for the threshold amount of time, another instance of the intermediary environment with the intermediate POVC that is a function of the partial POVC and the full POVC. For example, as shown in FIG. 1E, the intermediary POVC values 130 indicate temporarily reducing the POVC in the Z axis from 1.0 to 0.75. More generally, in some implementations, presenting the other instance of the intermediary environment includes maintaining full POVC in a first axis, lowering full POVC to partial POVC in a second axis and lowering full POVC to partial POVC in a third axis. In some implementations, the method 300 includes after presenting the intermediary environment for the threshold amount of time, transitioning from the intermediary environment with the intermediate POVC to the MR environment with the partial POVC. For example, with reference to FIG. 1E, the POVC adjustment system 200 restores the POVC in the Z axis from 0.75 to 1.0 while reducing the POVC in the Y axis to 0.0. More generally, in some implementations, transitioning from the intermediary environment to the MR environment includes maintaining the full POVC in the first axis, increasing the partial POVC to full POVC in the second axis and lowering the partial POVC to no POVC in the third axis.

FIG. 4 is a block diagram of a device 400 in accordance with some implementations. In some implementations, the device 400 implements the electronic device 20 shown in FIGS. 1A-1C and/or the POVC adjustment system 200 shown in FIGS. 1A-2. While certain specific features are illustrated, those of ordinary skill in the art will appreciate from the present disclosure that various other features have not been illustrated for the sake of brevity, and so as not to obscure more pertinent aspects of the implementations disclosed herein. To that end, as a non-limiting example, in some implementations the device 400 includes one or more processing units (CPUs) 401, a network interface 402, a programming interface 403, a memory 404, one or more input/output (I/O) devices 408, and one or more communication buses 405 for interconnecting these and various other components.

In some implementations, the network interface 402 is provided to, among other uses, establish and maintain a metadata tunnel between a cloud hosted network management system and at least one private network including one or more compliant devices. In some implementations, the one or more communication buses 405 include circuitry that interconnects and controls communications between system components. The memory 404 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices, and may include non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. The memory 404 optionally includes one or more storage devices remotely located from the one or more CPUs 401. The memory 404 comprises a non-transitory computer readable storage medium.

In some implementations, the one or more I/O devices 408 include a display (e.g., the display 22 shown in FIG. 1A). In some implementations, the display includes an extended reality (XR) display. In some implementations, the one or more I/O devices 408 include an image sensor. The image sensor may include a visible light camera and/or an infrared light camera for capturing image data.

In some implementations, the memory 404 or the non-transitory computer readable storage medium of the memory 404 stores the following programs, modules and data structures, or a subset thereof including an optional operating system 406, the data obtainer 210, the POVC transitioner 220 and the environment presenter