Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the art.

As set forth above, a variety of ultrasound systems exist including wired or wireless ultrasound probes for ultrasound imaging. Whether wired or wireless, an ultrasound system such as the foregoing requires a clinician to switch his or her spatial attention between different spatial regions, particularly between 1) a relatively close ultrasound probe being used for ultrasound imaging and 2) a relatively distant display rendering corresponding ultrasound images. Having to switch spatial attention between the ultrasound probe and the display can be difficult when ultrasound imaging and attempting to simultaneously establish an insertion site with a needle, place a VAD such as a catheter in a blood vessel of a patient at the insertion site, or the like. Such difficulties can be pronounced for less experienced clinicians, older clinicians having reduced lens flexibility in their eyes, etc. Ultrasound systems are needed that do not require clinicians to continuously switch their spatial attention between different spatial regions.

Disclosed herein are ultrasound systems and methods for sustained spatial attention. For example, an ultrasound system can include a console and an ultrasound probe. A display of the console can be configured to display ultrasound images and one or more still or moving images of a procedural field. The ultrasound probe can include a camera integrated into the ultrasound probe for recording the one-or-more still or moving images of the procedural field with a depth of field including a distal end of a probe head and a field of view including a spatial region about the probe head. With the one-or-more still or moving images displayed along with the ultrasound images, a clinician need not switch his or her spatial attention between spatial regions such as the procedural field and the display quite as frequently as with existing ultrasound systems, thereby sustaining spatial attention in one or more spatial regions. These and other features will become more apparent to those of skill in the art in view of the accompanying drawings and following description, which describe particular embodiments in greater detail.

Ultrasound Systems

FIGS. 1 and 3 illustrate an ultrasound system 100 including a console 102 and either a first ultrasound probe 104 or a second ultrasound probe 204 in accordance with some embodiments.

FIG. 2 illustrates a perspective view of the ultrasound probe 104 in accordance with some embodiments.

As shown, the ultrasound probe 104 includes a probe body 106, a probe head 108 extending from a distal end of the probe body 106, and a plurality of ultrasonic transducers 110 arranged in an array in the probe head 108.

The ultrasound probe 104 can also include a camera 112 integrated into a side of the ultrasound probe 104, a light-pattern projector 114 (e.g., a laser light-pattern projector) integrated into the side of the ultrasound probe 104, or both the camera 112 and the light-pattern projector 114 integrated into the side of the ultrasound probe 104. Notably, the side of the ultrasound probe 104 including the camera 112 or the light-pattern projector 114 is shown in FIG. 2 as a major side of the ultrasound probe 104, specifically a top side (or front face) of the ultrasound probe 104, which is convenient for an out-of-plane view of a needle 116 (see FIG. 6) when establishing an insertion site with the needle 116 as set forth in the method below. In addition, the foregoing side of the ultrasound probe 104 conveniently includes various buttons 118 of the ultrasound probe 104 useful for operating the ultrasound probe 104 or 204 or the ultrasound system 100 while establishing an insertion site with the needle 116. That said, the side of the ultrasound probe 104 including the camera 112 or the light-pattern projector 114 can alternatively be a minor side of the ultrasound probe 104, which is convenient for an in-plane view of the needle 116 when establishing an insertion site with the needle 116 as set forth in the method below.

The camera 112 is configured for recording one or more still or moving images 120 (see FIGS. 10 and 11) of a procedural field including a subject portion of a patient therein with a depth of field including a plane of a distal end of the probe head 108 and a field of view including a spatial region about the probe head 108. As set forth in more detail below, the one-or-more still or moving images 120 can be rendered on the display screen of the display 158 along with the ultrasound images 136 associated therewith, which allows a clinician to sustain spatial attention on the display 158 when establishing an insertion site with the needle 116, thereby obviating the clinician from frequently switching his or her spatial attention between the display 158 and the procedural field as done with existing ultrasound systems.

The light-pattern projector 114 is configured to project a light pattern 122 in the spatial region about the probe head 108 focused in the plane of the distal end of the probe head 108, thereby including the foregoing subject portion of the patient in the procedural field. The light pattern 122 is configured for guided insertion of the needle 116 into an anatomical target under the probe head 108 in the procedural field. Similar to the one-or-more still or moving images 120 when rendered on the display screen of the display 158, the light pattern 122 when projected in the spatial region about the probe head 108 allows a clinician to sustain spatial attention in the procedural field when establishing an insertion site with the needle 116 as set forth in the method below, thereby obviating the clinician from frequently switching his or her spatial attention between the procedural field and the display 158 as done with existing ultrasound systems.

FIG. 7 illustrates a schematic of a first light pattern 122a in accordance with some embodiments. FIG. 8 illustrates a schematic of a second light pattern 122b in accordance with some embodiments. Notably, when referring to a generic light pattern herein, the light pattern 122 is referenced. When referring to a specific light pattern herein, the light pattern 122a, 122b, or the like is referenced.

As shown, the light pattern 122a of 122b includes periodic hash marks 124 along one or more rays 126 radiating from a central axis of the ultrasound probe 104 in the plane of the probe head 108. Indeed, the light pattern 122a includes the hash marks 124 along one ray 126 radiating from the central axis of the ultrasound probe 104, whereas the light pattern 122b includes the hash marks 124 along three rays 126 radiating from the central axis of the ultrasound probe 104. As shown in FIG. 6, each hash mark of the hash marks 124 corresponds to a depth under the probe head 108 accessible by the needle 116 along an associated ray 126 at a needle-insertion angle with respect to the plane of the probe head 108.

FIG. 9 illustrates a schematic of a third light pattern 122c in accordance with some embodiments.

As shown, the light pattern 122c includes periodic concentric circular arcs 128 bound between two or more rays 126 radiating from the central axis of the ultrasound probe 104 in the plane of the probe head 108. Indeed, the light pattern 122c includes the circular arcs 128 bound between three rays 126 radiating from the central axis of the ultrasound probe 104. As shown in FIG. 6, each circular arc of the circular arcs 128 corresponds to a depth under the probe head 108 accessible by the needle 116 along an associated ray 126 at a needle-insertion angle with respect to the plane of the probe head 108. Notably, the associated ray 126 can be an intervening ray between the two-or-more rays 126 of the light pattern 122c radiating from the central axis of the ultrasound probe 104. The intervening ray need not be a visible ray of the light pattern 122c; the intervening ray can be envisioned between the two-or-more rays 126 of the light pattern 122c and followed with the needle 116 when establishing an insertion site therewith as set forth in the method below.

The ultrasound probe 104 can also include a needle-guide holder 130 extending from the side of the probe head 108 in common with the side of the ultrasound probe 104 including the camera 112, whether the foregoing side is the major or minor side of the ultrasound probe 104 including the camera 112 or the light-pattern projector 114.

The ultrasound probe 104 can also include a single-use needle guide 132 configured to couple to the needle-guide holder 130. The needle guide 132, the needle-guide holder 130, or a combination of the needle guide 132 and the needle-guide holder 130 can include at least one degree of freedom enabling the needle guide 132 to swivel between sides of the ultrasound probe 104. Indeed, the needle guide 132 can swivel between minor sides of the ultrasound probe 104 if the needle-guide holder 130 extends from a major side of the ultrasound probe 104. The needle guide 132 can alternatively swivel between major sides of the ultrasound probe 104 if the needle-guide holder 130 extends from a minor side of the ultrasound probe 104. To enable the needle guide 132 to swivel between the foregoing sides of the ultrasound probe 104, the needle guide 132 and the needle-guide holder 130 can include a joint (e.g., ball joint) formed therebetween that provides the degree of freedom needed. If the needle guide 132 is used with the needle 116 to establish an insertion site, the needle guide 132 can be advantageously swiveled along each circular arc of the circular arcs 128 of the light pattern 122c. The needle 116 can be subsequently inserted along any existing or envisioned ray of the light pattern 122c to establish an insertion site.

FIGS. 4 and 5 illustrate different views of the ultrasound probe 204 in accordance with some embodiments.

As shown, the ultrasound probe 204 includes a probe body 206, a probe head 208 extending from a distal end of the probe body 206, and the plurality of ultrasonic transducers 110 arranged in an array in the probe head 208. In addition, the ultrasound probe 204 can include the camera 112 integrated into a side of the ultrasound probe 204, the light-pattern projector 114 integrated into the side of the ultrasound probe 204, or both the camera 112 and the light-pattern projector 114 integrated into the side of the ultrasound probe 204. As such, the ultrasound probe 204 is like the ultrasound probe 104 in certain ways. Therefore, the description set forth above for the ultrasound probe 104 likewise applies to the ultrasound probe 204.

The ultrasound probe 204 also includes a display 134 integrated into the side of the ultrasound probe 204, specifically the top side (or front face) of the ultrasound probe 204, which differentiates the ultrasound probe 204 from the ultrasound probe 104. The display 134 is configured to render ultrasound images 136 on a display screen thereof, which allows a clinician to sustain spatial attention in the procedural field when establishing an insertion site with the needle 116 as set forth in the method below, thereby obviating the clinician from frequently switching his or her spatial attention between the procedural field, which includes the display 134, and another display (e.g., the display 158 of the console 102) as done with existing ultrasound systems. In addition, the display 134 is configured to render one or more overlying needle trajectories 138 over the ultrasound images 136. (See, for example, FIG. 11 for the one-or-more needle trajectories 138.) The one-or-more needle trajectories 138 are configured for guided insertion of the needle 116 into an anatomical target under the probe head 208 on the display 134. Indeed, the one-or-more needle trajectories 138 are in accordance with one or more depths accessible by the needle 116 as indicated by the light pattern 122.

Notably, the ultrasound probe 104 or 204 can include magnetic sensors to enhance guided insertion of the needle 116 into an anatomical target as set forth herein with magnetic-based needle guidance. Such magnetic-based needle guidance is disclosed in U.S. Pat. Nos. 8,388,541; 8,781,555; 8,849,382; 9,456,766; 9,492,097; 9,521,961; 9,554,716; 9,636,031; 9,649,048; 10,449,330; 10,524,691; and 10,751,509, each of which is incorporated by reference in its entirety into this application.

FIG. 12 illustrates a block diagram of the ultrasound system 100 in accordance with some embodiments.

As shown, the console 102 includes a variety of components including a processor 140 and memory 142 such as random-access memory (“RAM”) or non-volatile memory (e.g., electrically erasable programmable read-only memory [“EEPROM”]) for controlling various functions of the ultrasound system 100 during operation thereof. Indeed, the console 102 is configured to instantiate by way of executable instructions 144 stored in the memory 142 and executed by the processor 140 various processes for controlling the various functions of the ultrasound system 100.

As to the various processes for controlling the various functions of the ultrasound system 100, the various processes can include beamforming by way of a beamformer configured to drive the ultrasonic transducers 110, wherein driving the ultrasonic transducers 110 includes emitting generated ultrasound signals as well as receiving, amplifying, and digitizing reflected ultrasound signals; signal processing by way of a signal processor configured to detect an amplitude of each of the foregoing reflected ultrasound signals or the digitized signals corresponding thereto; and image processing by way of an image processor configured to manage storage of detected amplitudes and send the ultrasound images 136 corresponding to collections of the detected amplitudes to the display screen of the display 134 or 158 upon completion of the ultrasound images 136.

Further to the various processes for controlling the various functions of the ultrasound system 100, the various processes can include processing electrical signals corresponding to color and brightness data from an image sensor of the camera 112 of the ultrasound probe 104 or 204 into the one-or-more still or moving images 120; determining depths for various anatomical structures in the ultrasound images 136 by way of delays in time between emitting the generated ultrasound signals from the ultrasonic transducers 110 and receiving the reflected ultrasound signals by the ultrasonic transducers 110; adjusting a scale of the light pattern 122 projected from the light-pattern projector 114 in accordance with both the depths for the various anatomical structures in the ultrasound images 136 and a needle-insertion angle, wherein the needle-insertion angle is selected from a single ultrasound system-defined needle-insertion angle, a clinician-selected needle-insertion angle among various ultrasound system-defined needle-insertion angles, and a dynamic needle-insertion angle determined by way of magnetic-based needle guidance; adjusting a scale of the overlying pattern 160 lying over the one-or-more still or moving images 120 in accordance with both the depths for the various anatomical structures in the ultrasound images 136 and the needle-insertion angle; and adjusting a scale of the one-or-more needle trajectories 138 lying over the ultrasound images 136 in accordance with both the depths for various anatomical structures in the ultrasound images 136 and the needle-insertion angle.

The console 102 also includes a digital controller/analog interface 146 in communication with both the processor 140 and other system components to govern interfacing between the ultrasound probe 104 or 204 and the foregoing system components. Ports 148 are also included in the console 102 for connection with additional system components including optional system components such as a printer, storage media, a keyboard, etc. The ports 148 can be universal serial bus (“USB”) ports, though other types of ports can be used for these connections or any other connections shown or described herein.

A power connection 150 is included with the console 102 to enable an operable connection to an external power supply 152. An internal power supply 154 (e.g., a battery) can also be employed either with or exclusive of the external power supply 152. Power management circuitry 156 is included with the digital controller/analog interface 146 of the console 102 to regulate power use and distribution.

A display 158 integrated into the console 102 is configured to render on a display screen thereof a graphical user interface (“GUI”), the ultrasound images 136 attained by the ultrasound probe 104 or 204, the one-or-more still or moving images 120 of the procedural field attained by the camera 112 of the ultrasound probe 104 or 204, an overlying pattern 160 lying over the one-or-more still or moving images 120, the one-or-more needle trajectories 138 lying over the ultrasound images 136, etc. That said, the display 158 can alternatively be separate from the console 102 and communicatively coupled thereto. Regardless, control buttons (see FIGS. 1, 3, 10, and 11) accessed through a console button interface 162 of the console 102 can be used to immediately call up to the display screen a desired mode of the ultrasound system 100 for assisting with an ultrasound-based medical procedure such as that for establishing an insertion site with the needle 116, placing a VAD such as a catheter in a blood vessel of a patient at the insertion site, or the like. For example, a mode of the ultrasound system 100 for establishing an insertion site with the needle 116 can include rendering the one-or-more still or moving images 120 of the procedural field, the overlying pattern 160 lying over the one-or-more still or moving images 120, the one-or-more needle trajectories 138 lying over the ultrasound images 136, or a combination thereof.

FIGS. 10 and 11 illustrate guided insertion of the needle 116 into an anatomical target of an ultrasound image with the light pattern 122, specifically the light pattern 122a and 122c, respectively, as shown in the one-or-more still or moving images 120 adjacent the ultrasound image on the display 158.

When rendered on the display screen, the one-or-more still or moving images 120 show at least the needle 116 when the needle 116 is present in the spatial region about the probe head 108 or 208, which, even alone, allows a clinician to sustain spatial attention on the display 158 when establishing an insertion site with the needle 116. If the ultrasound probe 104 or 204 includes the light-pattern projector 114, however, the one-or-more still or moving images 120 can show both the light pattern 122 in the spatial region about the probe head 108 or 208 and the needle 116 in relation to the light pattern 122 for guided insertion of the needle 116 into an anatomical target under the probe head 108 or 208 on the display 158. Having both the light pattern 122 and the needle 116 shown in the one-or-more still or moving images 120 further allows a clinician to sustain spatial attention on the display 158 when establishing the insertion site with the needle 116, thereby obviating the clinician from frequently switching his or her spatial attention between the display 158 and the procedural field as done with existing ultrasound systems.

FIGS. 10 and 11 also illustrate guided insertion of the needle 116 into an anatomical target of an ultrasound image respectively with the overlying pattern 160, specifically the overlying pattern 160a and 160c, respectively, over the one-or-more still or moving images 120 adjacent the ultrasound image on the display 158.

Following on the foregoing, if the ultrasound probe 104 or 204 does not include the light-pattern projector 114, or if a clinician prefers not to use the light-pattern projector 114 of the ultrasound probe 104 or 204, the one-or-more still or moving images 120 can show the overlying pattern 160 lying thereover. When the needle 116 is present in the spatial region about the probe head 108 or 208, the one-or-more still or moving images 120 can thusly show both the overlying pattern 160 and the needle 116 in relation to the overlying pattern 160 for guided insertion of the needle 116 into an anatomical target under the probe head 108 or 208 on the display 158. Having both the overlying pattern 160 and the needle 116 shown in the one-or-more still or moving images 120 further allows a clinician to sustain spatial attention on the display 158 when establishing the insertion site with the needle 116, thereby obviating the clinician from frequently switching his or her spatial attention between the display 158 and the procedural field as done with existing ultrasound systems.

Like the light pattern 122a or 122b, the overlying pattern 160a or 160b includes the periodic hash marks 124 along one or more rays 126 radiating from the central axis of the ultrasound probe 104 or 204 in the plane of the probe head 108 or 208; however, unlike the light pattern 122a or 122b, the hash marks 124 and the one-or-more rays 126 are virtual, existing only on the display screen. By analogy to the light pattern 122a, the overlying pattern 160a likewise includes the hash marks 124 along one ray 126 radiating from the central axis of the ultrasound probe 104 or 204, and, by analogy to the light pattern 122b, the overlying pattern 160b likewise includes the hash marks 124 along three rays 126 radiating from the central axis of the ultrasound probe 104 or 204. Each hash mark of the hash marks 124 corresponds to a depth under the probe head 108 or 208 accessible by the needle 116 along an associated ray 126 at a needle-insertion angle with respect to the plane of the probe head 108 or 208.

Like the light pattern 122c, the overlying pattern 160c includes periodic concentric circular arcs 128 bound between two or more rays 126 radiating from a central axis of the ultrasound probe 104 or 204 in the plane of the probe head 108 or 208; however, unlike the light pattern 122c, the circular arcs 128 and the two-or-more rays 126 are virtual, existing only on the display screen. By analogy to the light pattern 122c, the overlying pattern 160c likewise includes the circular arcs 128 bound between three rays 126 radiating from the central axis of the ultrasound probe 104 or 204. Each circular arc of the circular arcs 128 corresponds to a depth under the probe head 108 or 208 accessible by the needle 116 along an associated ray 126 at a needle-insertion angle with respect to the plane of the probe head 108 or 208. Notably, the associated ray 126 can be an intervening ray between the two-or-more rays 126 of the overlying pattern 160c radiating from the central axis of the ultrasound probe 104 or 204. The intervening ray need not be a visible ray of the overlying pattern 160c; the intervening ray can be envisioned between the two-or-more rays 126 of the overlying pattern 160c and followed with the needle 116 when establishing an insertion site therewith as set forth in the method below.

As set forth above, the display 158 is configured to render on the display screen thereof the one-or-more needle trajectories 138 lying over the ultrasound images 136. The one-or-more needle trajectories 138 are configured for guided insertion of the needle 116 into an anatomical target under the probe head 108 or 208 on the display 158. Indeed, as shown in FIG. 11, the one-or-more needle trajectories 138 are in accordance with one or more depths accessible by the needle 116 indicated by the light pattern 122c or the overlying pattern 160c.

The needle trajectories 138 labeled ‘1’ in FIG. 11 are straightforwardly understood as being in a plane perpendicular to that of an ultrasound beam for a so called out-of-plane view with respect to the needle 116. Moving the needle 116 from circular arc 128 to circular arc 128 of the light pattern 122c or overlying pattern 160c of FIG. 11 toward the central axis of the ultrasound probe 104 or 204 while keeping the needle-insertion angle constant moves the needle 116 from trajectory to trajectory of the one-or-more needle trajectories 138 in a same direction (e.g., up) on the display screen. Indeed, inserting the needle 116 into a patient at the circular arc 128 nearest the central axis of the ultrasound probe 104 or 204 results in overshooting an anatomical target, for example, a blood vessel under the probe head 108 or 208. Notably, the needle 116 could still access the blood vessel but distal of the probe head 108 or 208. Similarly, moving the needle 116 from circular arc 128 to circular arc 128 of the light pattern 122c or overlying pattern 160c of FIG. 11 away from the central axis of the ultrasound probe 104 or 204 while keeping the needle-insertion angle constant moves the needle 116 from trajectory to trajectory of the one-or-more needle trajectories 138 in a same direction (e.g., down) on the display screen. Indeed, inserting the needle 116 into the patient at the circular arc 128 farthest from the central axis of the ultrasound probe 104 or 204 results in undershooting the blood vessel under the probe head 108 or 208. Notably, the needle 116 would still access the blood vessel but proximal of the probe head 108 or 208 and, ultimately, through a backwall of the blood vessel if the needle trajectory is completely followed.

The needle trajectories 138 labeled ‘2’ and ‘3’ in of FIG. 11 are in mirrored planes oblique to that of the ultrasound beam, and, as such, approach the blood vessel obliquely. However, like that set forth for the needle trajectories 138 labeled ‘1’ in FIG. 11, moving the needle 116 from circular arc 128 to circular arc 128 of the light pattern 122c or overlying pattern 160c of FIG. 11 toward the central axis of the ultrasound probe 104 or 204 while keeping the needle-insertion angle constant moves the needle 116 from trajectory to trajectory of the one-or-more needle trajectories 138 in a same direction (e.g., up) on the display screen. Moving the needle 116 from circular arc 128 to circular arc 128 of the light pattern 122c or overlying pattern 160c of FIG. 11 away from the central axis of the ultrasound probe 104 or 204 while keeping the needle-insertion angle constant moves the needle 116 from trajectory to trajectory of the one-or-more needle trajectories 138 in a same direction (e.g., down) on the display screen.

Adverting briefly back to the ultrasound probe 104 or 204, the ultrasound probe 104 or 204 includes the buttons 118 for operating the ultrasound probe 104 or 204 or the ultrasound system 100 of which the ultrasound probe 104 or 204 is part. For example, the buttons 118 can be configured for selecting a desired mode of the ultrasound system 100 as set forth above. The ultrasound probe 104 or 204 includes a button-and-memory controller 164 configured for operable communication with a probe interface 166 of the console