CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 13/574,723, filed Jan. 4, 2013, now U.S. Pat. No. 9,299,192, issued Mar. 29, 2016, which is a U.S. National Phase Application under 35 U.S.C. § 371 of International Application No. PCT/IL11/00574, filed Jul. 19, 2011, which claims priority to U.S. Provisional Patent Application No. 61/365,556, filed Jul. 19, 2010, the entire contents of which are incorporated herein by reference.

FIELD OF THE INVENTION

This invention relates to computer based methods and systems, particularly to computer based methods and systems that are useful in dentistry and other fields, and that are particularly useful in prosthodontics and/or orthodontics in particular.

BACKGROUND OF THE INVENTION

There are many procedures associated with the intra oral cavity in which a precise three-dimensional virtual representation of the intra oral cavity can be useful to the dental practitioner.

Such virtual representations (also referred to interchangeably herein as “virtual models”, “computer models”, “3D numerical entities”, and so on) enable the practitioner to study the intra oral cavity of individual patients via a computer system, in a similar manner to the study of the traditional physical plaster model. Furthermore, three-dimensional numerical entities of the intra oral cavity also allow the practitioner to study methods or approaches when dealing with particular dental problems of any given patient, and for the design of physical entities, for example prostheses, dental brackets, aligners and so on, in relation therewith. For example, in prosthodontics, a computer model of a patient's teeth may be manipulated to provide machining data to manufacture a physical model of the intra oral cavity, and/or to design and manufacture a coping and/or a prosthesis, while in orthodontics a computer model of a patient's teeth may be manipulated to enable a dental appliance, including for example orthodontic brackets and/or aligners, to be designed and manufactured, and/or for designing a treatment.

A parameter used in the design and manufacture of a dental prosthesis, such as a crown or bridge, is the finish line, or transition boundary between the prosthesis and the dental preparation, and this needs to be precisely defined in three-dimensions. Obtaining finish line coordinates from a computer virtual model is more efficient and often more accurate than from a plaster cast, and moreover facilitates the production of such a prosthesis, for example via CNC machining, rapid prototyping, or other computerized technologies, if desired.

However, it is often the case that when scanning the intra oral cavity to obtain 3D data of the preparation and finish line, on which the virtual model is based, part of the finish line, and possibly also the shoulder and other parts of the preparation, may be obscured by soft tissues such as the gum that, no longer being supported by the dental surfaces that have been removed, deform to cover at least a part of the finish line on the prepared dental site.

Additionally or alternatively, part or all of the finish line may be obscured by other agents or materials, including, for example, accumulation of one or more of saliva, blood, lubricant used with a dental drill, debris resulting from working the dental site, and so on.

Similar issues may arise when scanning the intra oral cavity to obtain 3D data of the position and orientation of a dental implant in relation to the surrounding portions of the intra-oral cavity, and in addition the corresponding impression abutment (also referred to herein as a scanning body) may partially obscure part of the intra-oral cavity.

Similarly, there are other situations in which a virtual model of a physical item, obtained from scanning the physical item, is partially obscured or incomplete, or in which part of the physical item needs to be subsequently modified after obtaining the virtual model. Such situations would conventionally require a rescanning of the entire physical item, and this may involve significant additional time, inconvenience and, where the physical item is a part of the body of a patient (such as for example the intra oral cavity), this may also involve significant patient discomfort.

SUMMARY OF THE INVENTION

Herein “intra oral cavity” (also referred to interchangeably herein as dental cavity) is taken to include, but not be limited to, one or more real teeth and/or one or more prosthetic teeth and/or part of one or more real teeth, of one jaw or of both jaws of a patient, and/or can also include all the real teeth and/or prosthetic teeth in one or both jaws, and/or adjacent gingiva and other adjacent objects of the patient, and/or can include a physical model or other physical representation of one or more or all the real teeth, and/or one or more or all of the prosthetic teeth, and/or part of one or more or all the real teeth, of one jaw or of both jaws, and/or of adjacent gingiva and/or other adjacent objects, of the patient.

Herein, “dental material” refers to any material associated with dental structures of the intra oral cavity, including but not limited to natural dental materials such as for example enamel, dentine, pulp, dental roots, and also including non-natural dental materials from which items such as for example metallic and non-metallic fillings, restorations, crowns, bridges, copings, preparations, and so on, are made from.

Herein, “dental clinic” refers to the interface between a dental practitioner and a patent, and thus includes any physical entity, in particular a clinic, in which there is interaction between a dental patient and a dental practitioner. While “dental practitioner” typically refers to a dentist, doctor or dental technician, it also includes herein all other caregivers, including for example dental surgeons, orthodontists, prosthodontists, dental assistants or any other caregiver or professional that may interact with a dental patient during the course of a dental treatment, or that may be involved in determining, preparing or providing dental treatment to a patient, particularly prosthodontic treatment and/or orthodontic treatment. While “dental patient” (also referred to interchangeably herein as “patient”) typically refers to a person requiring the dental services of a dental practitioner, it also includes herein any person regarding whom it is desired to create a 3D numerical model of the intra oral cavity thereof, for example for the purpose of practicing the same or for carrying out research.

The term “prosthesis” is herein taken to include any restoration and any onlays, such as crowns and bridges, for example, and inlays, such as caps, for example, or veneering, or any other artificial partial or complete denture.

The term “virtual”, applied herein with respect to models, manipulation of models, and so on, in particular 3D virtual models, for example, refers to being created, simulated, manipulated, carried out, and so on by means of a CAD/CAM system, a computer, a computer network, or the like, i.e., in a computer environment, particularly with reference to digital dentistry.

While the term “preparation” typically refers to the stump and including the finish line and shoulder that is left of the tooth that is to be replaced by the prosthesis—typically a crown—and on which the crown or other prosthesis is to be mounted or seated, the term “preparation” herein also includes artificial stumps, pivots, cores and posts, or other devices that may be implanted in the intraoral cavity in such a position or in a position that is optimal for implanting the crown or other prosthesis.

The term “prosthodontic procedure” refers, inter alia, to any procedure involving the intraoral cavity and directed to the design, manufacture or installation of a dental prosthesis at a dental site within the intraoral cavity, or a real or virtual model thereof, or directed to the design and preparation of the dental site to receive such a prosthesis.

The term “3D virtual model” is used herein synonymously with digital model, virtual model, 3D virtual model, 3D model, three dimensional model, 3D numerical entity, numerical entity, computer model, 3D computer model, dimensional data, 3D digitized data, 3D representation, and other such terms, and relates to a virtual representation in a computer environment of a real object, such as for example a dentition or at least a part of the intraoral cavity, or of a real (physical) model thereof, for example of a plaster model or a stone model of the dentition or any dental structure. In particular a virtual dental model is one example of such a 3D virtual model of a dental structure.

The term “physical part” is used herein, synonymously with “real part” to refer to a physical object, in particular a physical dental object having a real (physical) surface and included but not limited to part or all of the dentition of the intraoral cavity including dies, a coping, a prosthesis, and so on, or to a physical dental model of part or all of the dentition of the intraoral cavity including dies, a coping, a prosthesis, and so on.

The term “scanning” and its analogues refer to any procedure directed at obtaining 3D topographic data of a surface, particularly of a dental surface, wherein to provide a 3D virtual model, and thus includes mechanical-based or other contact systems and methods, typically based on 3D probes for example, and/or any other noncontact systems and methods included but not limited to optical-based systems and methods and/or radiation-based systems and methods, including for example confocal-based systems and methods, for example as disclosed in WO 00/08415, the contents of which are incorporated herein in their entirety by reference, x-ray systems and methods including CT systems and methods, laser scanners, ultrasound scanners, and/or indeed any other suitable system and method for providing 3D virtual model.

The terms “tool” and “machining tool” are taken herein interchangeably to include any tool that is adapted for material removal, and may include inter alia mechanical tools such as drills for example, laser tools such as for example laser drills or cutters, ultrasonic tools such as for example ultrasonic cutters, and so on. Preferably, the machining paths and material removal characteristics of such tools can be finely controlled, typically by computer systems or other automated means.

According to a first aspect of the invention there is provided a computer based method for modifying a virtual model of a physical structure, comprising:

- (A) displaying an image of said virtual model on a display operatively connected to a computer system;
- (B) identifying at least a portion of said virtual model that is desired to be modified by interacting with the displayed image,
- (C) modifying said virtual model by replacing in the computer system at least said portion of said virtual model with additional 3D data obtained from the physical structure to provide a modified virtual model.

For example, the physical structure can comprise any one of an intra-oral cavity of a patient and a physical dental model representative of said intra-oral cavity. Additionally or alternatively, said virtual model includes a first three dimensional (3D) virtual model representative of a first physical part of the physical structure, and step (A) comprises providing to the computer system said first 3D virtual model and displaying on said display a first display image corresponding to said first 3D virtual model.

For example, step (B) comprises identifying on said first display image at least a first display image portion thereof by interacting with said display, said first display image portion corresponding to said portion of said virtual model, and said portion of said virtual model being representative of a first physical portion of said first physical part, and optionally step (C) comprises, subsequent to step (B):

- causing the computer system to at least one of delete, remove and replace said portion of said virtual model by applying a corresponding function, i.e., a corresponding computer-implemented function (i.e. a delete function, a remove function or a replace function, respectively) to said first display image portion via interaction with said first display image on said display, to provide a modified first 3D virtual model;
- providing said additional 3D data in the form of a second 3D virtual model representative of a second physical part of said physical structure, wherein a spatial disposition of said second physical part with respect to said first physical part is known or determinable;
- virtually registering said second 3D virtual model with respect to said modified first 3D virtual model to provide said modified virtual model wherein said portion of said virtual model is replaced with a corresponding part of said second 3D virtual model representative of a second physical portion of said second physical part;
- outputting said modified virtual model from said computer system.

Alternatively, steps (B) and (C) comprise:

- providing said additional 3D data in the form of a second 3D virtual model representative of a second physical part of said physical structure, wherein a spatial disposition of said second physical part with respect to said first physical part is known or determinable;
- virtually registering said second 3D virtual model with respect to said first 3D virtual model and further displaying in said display a second display image corresponding to said second 3D virtual model in registry with said first 3D virtual model;
- identifying on said first display image at least a first display image portion thereof by interacting with said display, said first display image portion corresponding to said portion of said virtual model, and said portion of said virtual model being representative of a first physical portion of said first physical part;
- causing the computer system to at least one of delete, remove and replace said portion of said virtual model by applying a corresponding function, i.e., a corresponding computer-implemented function, i.e., a corresponding computer-implemented function (i.e. a delete function, a remove function or a replace function, respectively) to said first display image portion via interaction with said first display image on said display, to provide said modified virtual model, wherein said portion of said virtual model is replaced with a corresponding part of said second 3D virtual model representative of a second physical portion of said second physical part;
- outputting said modified virtual model from said computer system.

For example, said first display image is visually encoded in a different manner to said second display image to facilitate identifying said first display image portion.

Additionally or alternatively, said second physical part at least partially overlaps said first physical portion of said first physical part of said physical structure to provide data on said spatial disposition of said second physical part with respect to said first physical part.

Additionally or alternatively, said second physical portion of said second physical part spatially corresponds to but is topographically different from said first physical portion of said first physical part.

Additionally or alternatively, said corresponding part of said second 3D virtual model spatially corresponds to but is topographically different from said portion of said virtual model.

Additionally or alternatively, said first virtual model part represents a corresponding said first physical part of the physical structure, wherein said first virtual model part is considered to fail to comply with a predetermined requirement therefor. For example, said predetermined requirement comprises providing high surface definition of a surface of interest in said first physical part of the physical structure. For example, at least a part of said surface of interest in said first portion of said first physical part was obscured when the said first 3D virtual model was created, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said at least a part of said surface of interest is now unobscured. For example, said first portion of said first physical part was obscured with a material including one or more of saliva, debris, blood, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said material has been removed from said surface of interest. For example, said first portion of said first physical part was obscured with an artifact, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said artifact has been removed. For example, said artifact comprises an impression abutment or any other structure mounted onto a dental implant that is embedded in said physical structure.

Additionally or alternatively, said predetermined requirement comprises providing a surface of interest in said first physical part of the physical structure that is configured for enabling a prosthesis to be mounted with respect thereto. For example, at least a part of said surface of interest in said first portion of said first physical part is inadequate for enabling a prosthesis to be mounted with respect thereto, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said at least a part of said surface of interest has been physically altered. For example, where said at least a part of said surface of interest has been physically altered via a material removal operation wherein to modify the topology of said at least a part of said surface of interest. An example of this is where said at least a part of said surface of interest comprises a finish line of a tooth onto which it is desired to mount the prosthesis, and said finish line is inadequately defined in said first portion of said first physical part, but where said finish line is adequately defined in said second portion of said second physical part.

For example, said at least part of said surface of interest comprises a preparation surface of a preparation of a tooth onto which it is desired to mount the prosthesis, wherein in said first portion of said first physical part said preparation surface is inadequate for mounting the prosthesis thereto, and wherein in said second portion of said second physical part said preparation surface is inadequate for mounting the prosthesis thereto.

Additionally or alternatively, said first virtual model part is distorted or deficient and fails to properly represent a corresponding said first physical part of the physical structure.

Additionally or alternatively, the method further comprises manufacturing a physical dental model of the intra oral cavity based on said modified virtual model.

Additionally or alternatively, the method further comprises designing an orthodontic treatment plan based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing a dental aligner based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing orthodontic appliances based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing a dental prosthesis based on said modified virtual model.

According to the first aspect of the invention there is also provided a computer system configured for modifying a virtual model of a physical structure, comprising:

- a display configured for displaying a display image of said virtual model and for identifying at least a portion of said virtual model that is desired to be modified responsive to interaction of a user with the displayed display image, and further configured for modifying said virtual model by replacing in the computer system at least said identified portion of said virtual model with additional 3D data obtained from the physical structure to provide a modified virtual model.

For example, the computer system can configured for applying a computer implemented method as defined above for the first aspect of the invention, mutatis mutandis.

According to the first aspect of the invention there is also provided a computer readable medium that embodies in a tangible manner a program executable for:

- (A) enabling displaying a display image of a virtual model of a physical structure;
- (B) enabling interaction with the displayed display image to identify at least a portion of said virtual model that is desired to be modified
- (C) enabling modifying said virtual model by replacing at least said identified portion of said virtual model with additional 3D data obtained from the physical structure to provide a modified virtual model.

For example, the program can be configured for applying a computer implemented method as defined above for the first aspect of the invention, mutatis mutandis. Additionally or alternatively, the computer readable medium comprises any one of optical discs, magnetic discs, magnetic tapes, or solid state memory storage.

According to a second aspect of the invention there is provided a computer based method for modifying a virtual model of a physical structure, comprising:

- (A) providing to the computer system said virtual model obtained from the physical structure;
- (B) providing to the computer system additional 3D data obtained from at least a part of the physical structure;
- (C) identifying at least one portion of the virtual model that is desired to be modified with at least a part of said additional 3D data; and
- (D) modifying the virtual model in the computer system at least by replacing said at least one identified portion of said virtual model with said at least part of said 3D data to provide a modified virtual model.

For example, step (A) comprises displaying a display image of said virtual model on a display operatively connected to a computer system. For example, step (B) comprises displaying a display image of said modified virtual model on said display. For example, step (C) comprises identifying said at least one portion of the virtual model on said display. For example, step (C) comprises interacting with said display images on said display to thereby replace said corresponding portion of said virtual model with said portion of said additional 3D data.

Additionally or alternatively, said additional 3D data includes at least one portion thereof that corresponds to but is different from a corresponding portion of said virtual model.

For example, said physical structure comprises any one of an intra-oral cavity of a patient and a physical dental model representative of said intra-oral cavity.

Additionally or alternatively, said virtual model includes a first three dimensional (3D) virtual model representative of a first physical part of the physical structure, and step (A) comprises providing to the computer system said first 3D virtual model and displaying on said display a first display image corresponding to said first 3D virtual model. For example, the method can comprise identifying on said first display image at least a first display image portion thereof by interacting with said display, said first display image portion corresponding to said portion of said virtual model, and said portion of said virtual model being representative of a first physical portion of said first physical part.

For example, step (C) comprises:

- causing the computer system to at least one of delete, remove and replace said portion of said virtual model by applying a corresponding function, i.e., a corresponding computer-implemented function (i.e. a delete function, a remove function or a replace function, respectively) to said first display image portion via interaction with said first display image on said display, to provide a modified first 3D virtual model;
- providing said additional 3D data in the form of a second 3D virtual model representative of a second physical part of said physical structure, wherein a spatial disposition of said second physical part with respect to said first physical part is known or determinable;
- virtually registering said second 3D virtual model with respect to said modified first 3D virtual model to provide said modified virtual model wherein said portion of said virtual model is replaced with a corresponding part of said second 3D virtual model representative of a second physical portion of said
- outputting said modified virtual model from said computer system.

For example, steps (B) and (C) comprise:

- providing said additional 3D data in the form of a second 3D virtual model representative of a second physical part of said physical structure, wherein a spatial disposition of said second physical part with respect to said first physical part is known or determinable;
- virtually registering said second 3D virtual model with respect to said first 3D virtual model and further displaying in said display a second display image corresponding to said second 3D virtual model in registry with said first 3D virtual model;
- identifying on said first display image at least a first display image portion thereof by interacting with said display, said first display image portion corresponding to said portion of said virtual model, and said portion of said virtual model being representative of a first physical portion of said first physical part;
- causing the computer system to at least one of delete, remove and replace said portion of said virtual model by applying a corresponding function (i.e. a delete function, a remove function or a replace function, respectively) to said first display image portion via interaction with said first display image on said display, to provide said modified virtual model, wherein said portion of said virtual model is replaced with a corresponding part of said second 3D virtual model representative of a second physical portion of said second physical part;
- outputting said modified virtual model from said computer system.

For example, said first display image is visually encoded in a different manner to said second display image to facilitate identifying said first display image portion.

Additionally or alternatively, corresponding part of said second 3D virtual model spatially corresponds to but is topographically different from said portion of said virtual model.

For example, said at least a part of said surface of interest comprises a preparation surface of a preparation of a tooth onto which it is desired to mount the prosthesis, wherein in said first portion of said first physical part said preparation surface is inadequate for mounting the prosthesis thereto, and wherein in said second portion of said second physical part said preparation surface is inadequate for mounting the prosthesis thereto.

Additionally or alternatively, said first virtual model part is distorted or deficient and fails to properly represent a corresponding said first physical part of the physical structure.

Additionally or alternatively, the method further comprises manufacturing a physical dental model of the intra oral cavity based on said modified virtual model.

Additionally or alternatively, the method further comprises designing an orthodontic treatment plan based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing a dental aligner based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing orthodontic appliances based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing a dental prosthesis based on said modified virtual model.

According to the second aspect of the invention there is also provided a computer system configured for modifying a virtual model of a physical structure, the system:

- (A) configured for enabling said virtual model obtained from the physical structure to be provided thereto;
- (B) configured for enabling additional 3D data obtained from at least a part of the physical structure to be provided thereto;
- (C) configured for enabling identifying at least one portion of the virtual model that is desired to be modified with at least a part of said additional 3D data;
- (D) configured for modifying the virtual model at least by replacing said corresponding portion of said virtual model with said portion of said additional 3D data to provide a modified virtual model.

For example, the computer system comprises a display operatively connected to the computer system, and the computer system can configured for applying a computer implemented method as defined above for the second aspect of the invention, mutatis mutandis.

According to the second aspect of the invention there is also provided a computer readable medium that embodies in a tangible manner a program executable for:

- (A) enabling a virtual model obtained from the physical structure to be provided thereto;
- (B) enabling additional 3D data obtained from at least a part of the physical structure to be provided thereto;
- (C) enabling identifying at least one portion of the virtual model that is desired to be modified with at least a part of said additional 3D data;
- (D) enabling modifying the virtual model at least by replacing said corresponding portion of said virtual model with said portion of said additional 3D data to provide a modified virtual model.

For example, the program can be configured for applying a computer implemented method as defined above for the second aspect of the invention, mutatis mutandis. Additionally or alternatively, the computer readable medium comprises any one of optical discs, magnetic discs, magnetic tapes, or solid state memory storage.

According to a third aspect of the invention there is provided a computer based method for modifying a virtual model of a physical structure, comprising:

- (A) providing to the computer system said virtual model obtained from the physical structure;
- (B) providing to the computer system additional 3D data obtained from the physical structure, said additional 3D data including at least one portion thereof that corresponds to but is different from a corresponding portion of said virtual model;
- (C) modifying the virtual model in the computer system at least by replacing said corresponding portion of said virtual model with said portion of said additional 3D data to provide a modified virtual model.

For example, step (A) comprises displaying a display image of said virtual model on a display operatively connected to a computer system For example, step (B) comprises identifying said corresponding portion of said virtual model on said display.

Additionally or alternatively step (C) comprises interacting with said display image on said display to thereby replace said corresponding portion of said virtual model with said portion of said additional 3D data.

Additionally or alternatively said physical structure comprises any one of an intra-oral cavity of a patient and a physical dental model representative of said intra-oral cavity.

Additionally or alternatively said virtual model includes a first three dimensional (3D) virtual model representative of a first physical part of the physical structure, and step (A) comprises providing to the computer system said first 3D virtual model and displaying on said display a first display image corresponding to said first 3D virtual model. For example, the method comprises identifying on said first display image at least a first display image portion thereof by interacting with said display, said first display image portion corresponding to said portion of said virtual model, and said portion of said virtual model being representative of a first physical portion of said first physical part.

For example, step (C) comprises:

- causing the computer system to at least one of delete, remove and replace said portion of said virtual model by applying a corresponding function, i.e., a corresponding computer-implemented function (i.e. a delete function, a remove function or a replace function, respectively) to said first display image portion via interaction with said first display image on said display, to provide a modified first 3D virtual model;
- providing said additional 3D data in the form of a second 3D virtual model representative of a second physical part of said physical structure, wherein a spatial disposition of said second physical part with respect to said first physical part is known or determinable;
- virtually registering said second 3D virtual model with respect to said modified first 3D virtual model to provide said modified virtual model wherein said portion of said virtual model is replaced with a corresponding part of said second 3D virtual model representative of a second physical portion of said second physical part;
- outputting said modified virtual model from said computer system.

For example, steps (B) and (C) comprise:

- providing said additional 3D data in the form of a second 3D virtual model representative of a second physical part of said physical structure, wherein a spatial disposition of said second physical part with respect to said first physical part is known or determinable;
- virtually registering said second 3D virtual model with respect to said first 3D virtual model and further displaying in said display a second display image corresponding to said second 3D virtual model in registry with said first 3D virtual model;
- identifying on said first display image at least a first display image portion thereof by interacting with said display, said first display image portion corresponding to said portion of said virtual model, and said portion of said virtual model being representative of a first physical portion of said first physical part;
- causing the computer system to at least one of delete, remove and replace said portion of said virtual model by applying a corresponding function, i.e., a corresponding computer-implemented function (i.e. a delete function, a remove function or a replace function, respectively) to said first display image portion via interaction with said first display image on said display, to provide said modified virtual model, wherein said portion of said virtual model is replaced with a corresponding part of said second 3D virtual model representative of a second physical portion of said second physical part;
- outputting said modified virtual model from said computer system.

For example, said first display image is visually encoded in a different manner to said second display image to facilitate identifying said first display image portion.

Additionally or alternatively, said corresponding part of said second 3D virtual model spatially corresponds to but is topographically different from said portion of said virtual model.

For example, said predetermined requirement comprises providing high surface definition of a surface of interest in said first physical part of the physical structure. For example, at least a part of said surface of interest in said first portion of said first physical part was obscured when the said first 3D virtual model was created, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said at least a part of said surface of interest is now unobscured. For example, said first portion of said first physical part was obscured with a material including one or more of saliva, debris, blood, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said material has been removed from said surface of interest. For example, said first portion of said first physical part was obscured with an artifact, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said artifact has been removed. For example, said artifact comprises an impression abutment or any other structure mounted onto a dental implant that is embedded in said physical structure.

For example, said predetermined requirement comprises providing a surface of interest in said first physical part of the physical structure that is configured for enabling a prosthesis to be mounted with respect thereto. For example, at least a part of said surface of interest in said first portion of said first physical part is inadequate for enabling a prosthesis to be mounted with respect thereto, and wherein said second portion of said second physical part corresponds to said first portion of said first physical part wherein said at least a part of said surface of interest has been physically altered. For example, where said at least a part of said surface of interest has been physically altered via a material removal operation wherein to modify the topology of said at least a part of said surface of interest. An example of this is where said at least a part of said surface of interest comprises a finish line of a tooth onto which it is desired to mount the prosthesis, and said finish line is inadequately defined in said first portion of said first physical part, but where said finish line is adequately defined in said second portion of said second physical part.

Additionally or alternatively, said first virtual model part is distorted or deficient and fails to properly represent a corresponding said first physical part of the physical structure.

Additionally or alternatively, the method further comprises manufacturing a physical dental model of the intra oral cavity based on said modified virtual model.

Additionally or alternatively, the method further comprises designing an orthodontic treatment plan based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing a dental aligner based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing orthodontic appliances based on said modified virtual model.

Additionally or alternatively, the method further comprises manufacturing a dental prosthesis based on said modified virtual model.

According to the third aspect of the invention there is also provided a computer system configured for modifying a virtual model of a physical structure, the system being:

- (A) configured for enabling said virtual model obtained from the physical structure to be provided thereto;
- (B) configured for enabling additional 3D data obtained from the physical structure to be provided thereto, said additional 3D data including at least one portion thereof that corresponds to but is different from a corresponding portion of said virtual model;
- (C) configured for modifying the virtual model at least by replacing said corresponding portion of said virtual model with said portion of said additional 3D data to provide a modified virtual model.

According to the third aspect of the invention there is also provided a computer readable medium that embodies in a tangible manner a program executable for:

- (A) enabling said virtual model obtained from the physical structure to be provided thereto;
- (B) enabling additional 3D data obtained from the physical structure to be provided thereto, said additional 3D data including at least one portion thereof that corresponds to but is different from a corresponding portion of said virtual model;
- (C) modifying the virtual model at least by replacing said corresponding portion of said virtual model with said portion of said additional 3D data to provide a modified virtual model.

For example, the program can be configured for applying a computer implemented method as defined above for the third aspect of the invention, mutatis mutandis. Additionally or alternatively, the computer readable medium comprises any one of optical discs, magnetic discs, magnetic tapes, or solid state memory storage.

It is readily apparent that in at least some embodiment according to one or more of the first, second or third aspects of the invention, the second 3D virtual model contains new or additional 3D data of the first physical part of said physical structure in a region thereof corresponding to the first virtual model part that was deleted or removed or replaced. Said differently, the second 3D virtual model contains 3D data representative of a region of the first physical part of said physical structure having a spatial relationship with the rest of the first physical part corresponding to the virtual spatial relationship of first virtual model part of said first 3D virtual model (that was deleted or removed or replaced) with respect to the respective rest of the first 3D virtual model.

In at least some embodiments of the invention, said physical structure is a dental structure. For example, said physical structure comprises at least a part of an intra-oral cavity of a patient. For example, said physical structure comprises a physical dental model representative of at least a part of an intra-oral cavity of a patient. In other embodiments of the invention, the physical structure may be a non-dental structure.

It is readily apparent that in at least some embodiment according to one or more of the first, second or third aspects of the invention, the first 3D virtual model is analyzed by a user with respect to criteria to determine the suitability of the first physical part for the purpose of allowing a prosthesis to be seated thereon. While this analysis may be a visual and intuitive analysis by the user, the analysis may be optionally carried out by the computer system (or indeed by a different computer system) using suitable software, wherein the analysis may be fully automated or interactive with the user. The analysis may also be configured for identifying regions of the first physical part (i.e., on the first 3D virtual model) that require physical change—for example, the criteria may include the amount of original tooth reduction required at various points on the tooth to allow for good prosthesis seating and to allow for a minimum prosthetic thickness that is consistent with mechanical integrity standards therefor. The analysis software may further identify these regions and mark them automatically. Furthermore, the deleting/removing/replacing step can also be carried out automatically once these regions are marked, either immediately, or following a confirmation command from the user. Thereafter the user can rework the physical part, in particular the preparation in the regions thereof previously identified by the analysis software and now erased and missing in the modified first 3D virtual model.

Some specific embodiments according to at least one of the first, second or third aspect of the invention are provided below:

Embodiment A

(a) A first virtual model (computer 3D model) VM1 of a physical part RM1 of the intra-oral cavity (typically of a patient, in vivo, but alternatively the scan may be of a physical dental model, or of an impression of the intra oral cavity, or of an impression a physical dental model) including tooth or teeth of interest is created, for example by scanning with an optical scanner, x-ray scanner, laser scanner or other scanner.

(b) Virtual model VM1 is displayed (and optionally magnified and/or manipulated) to visually check the model.

(c) A part DVMI of the virtual model is “deleted” (or otherwise removed) interactively on the screen by the user, resulting in a modified first virtual model VM1′.

(d) For example, this deleted part DVM1 of the model may not be acceptable and needs to be better defined for some dental procedure. The deleted part DVM1 may correspond, for example, to a part of a dental surface DRM1 that was not clearly defined in the first virtual model VM1 because, for example, during the initial scan that resulted in VM1, the corresponding part DRM1 of the physical dental surface was covered with saliva, blood, debris, or otherwise obscured by another element such as for example part of the gums, cheek, tongue, dental instruments etc.

(e) For example, the dental procedure may be providing a dental prosthesis, and the deleted part DVM1 may be part of the finish line that was not clear.

(f) A second virtual model VM2 is created, representing the part DRM1 of the physical dental surface plus additional identifying surface data ID.

(g) For example, the part DRM1 of the physical dental surface is cleaned up and/or unobstructed, and then rescanned. The scanning procedure also includes scanning an additional part P2 the real dental surface surrounding the part DRM1 to obtain additional identifying surface data ID.

(h) The second virtual model VM2 is then manipulated in the computer system to register it onto the modified first virtual model VM1′. In this connection, the identifying surface data ID of second virtual model VM2 may be useful as it may be aligned with corresponding parts of the modified first virtual model VM1′, since the surface data for part P2 of the real physical dental surface should be nominally identical in both scans.

(j) In this aligned position, a part DVM2 of the second virtual model VM2 fits in and corresponds to the deleted portion DVM1, and part DVM2 is then stitched to modified first virtual model VM1′ to create a further modified first virtual model VM1″. The remainder of the second virtual model VM2, including the identifying surface data ID may then be discarded.

(k) The further modified first virtual model VM1″ thus replaces the undesired part DVM1 of the original virtual model VM1 with new data.

(l) The above steps (b) to (k) may be repeated as often as desired.

A feature of at least this embodiment is that the user only needs to “correct” parts of the original virtual model of the dental surface, and does not need to rescan everything, should part of the virtual model not be acceptable.

Embodiment B

(A) This is similar to Embodiment A, mutatis mutandis, the main difference being that the physical part RM1 of the intra-oral cavity includes a removable artifact which may be temporarily obscuring part of the dental surfaces.

(B) For example, the artifact may be a scanning body or impression abutment or any other structure that is mounted onto a dental implant and projects into the intra oral cavity so that the spatial orientation and other characteristics of the implant (which is already anchored in the jaw and thus cannot be seen) with respect to the dental surfaces may be derived from the position/orientation of the artifact. Alternatively, the artifact may be a prosthesis, such as a crown for example, that is mounted to the implant or that is temporarily seated onto a preparation.

(C) The first virtual scan thus includes the artifact and all the other dental areas of interest, but the presence of the artifact makes it difficult to obtain a full scan of the dental surface as the artifact may be too close in parts to the dental surfaces (e.g. an adjacent tooth).

(D) The part of the virtual model corresponding to the dental surface (and possibly also part of the artifact) is deleted or otherwise removed interactively in a similar manner to steps (b) and (c) above for Embodiment A, mutatis mutandis.

(E) The artifact is removed from the intraoral cavity and an area of the dental surfaces including the area that was not fully defined previously is scanned, and in the absence of the artifact, full definition should be achieved.

(F) The original virtual model in (A) for Embodiment B is then modified with the new scan data obtained in (E), in a manner similar to steps (f) to (j) above for Embodiment A, mutatis mutandis.

(G) If necessary, the artifact itself (or part thereof) may also be scanned separately to further modify the original virtual model, if part of the artifact was deleted in step (D).

A feature of at least this embodiment is that it allows obtaining a virtual model of the intra oral cavity including such an artifact, wherein even the parts of the dental surfaces originally obscured by the artifact can be fully defined with respect thereto.

Embodiment C

(i) This is also similar to Embodiment A, mutatis mutandis, the main difference being that the physical part RM1 of the intra-oral cavity is well defined in the virtual model, but the physical part RM1 is not suitable for the dental procedure.

(ii) For example, the part RM1 may be a dental preparation for a dental prosthesis (e.g. a crown), and analysis of the first dental model with respect to a virtual model of the opposing dentition of the opposite jaw reveals that the form of the preparation would result in an inadequate structure for the prosthesis. For example, the dental preparation is too long, and would result in the thickness of the crown at the cusp being too thin and thus mechanically weak.

(iii) For example, a technique based on the virtual occlusion map invention, as disclosed in U.S. Pat. No. 6,334,853, assigned to Cadent Ltd, may be used for determining the distances between the preparation and the opposed dental surfaces, which provides a measure of the corresponding thickness of the respective dental prosthesis.

(iv) The part of the first virtual model that corresponds to the unsuitable part of the dental preparation is then deleted, as in step (c) above for Embodiment A, mutatis mutandis.

(v) The real dental preparation is also modified by the dental practitioner in the areas found to be unsuitable in (ii), and thereafter the preparation is scanned in the newly worked area, also including additional part of the preparation that was not altered.

(vi) The scan data corresponding to the unaltered area is used for aligning the new scan data for the worked part of the dental preparation in a similar manner to (h), (j), (k) above for Embodiment A, mutatis mutandis, to provide a modified virtual model.

(vii) The newly modified virtual model of (vi) is checked as in (ii) and (iii), and if necessary, steps (ii) to (vi) repeated as often as required, until the newly modified virtual model has a geometry for the dental preparation (corresponding to the real geometry of the dental preparation) that is adequate for a prosthesis.

In an alternative application of embodiment C in orthodontics, a patient's dentition is scanned and an orthodontic treatment is planned. Prior to commencing the treatment it is determined that the treatment may be improved by removing or filing some teeth. In such a case the areas including the removed/modified teeth are rescanned and these replace the parts of the original virtual model corresponding to these teeth. A new orthodontic treatment can then be planned based on the updated virtual model, and aligners and/or other orthodontic appliances can then be manufactured.

A feature of at least this embodiment is that it allows the dental practitioner to modify a dental structure (such as for example a dental preparation or a missing or modified tooth) in a quick and easy manner with a minimum of scanning after the initial virtual scan.

According to at least one aspect of the invention there is provided a system and method are provided for modifying a virtual model of a physical structure by displaying an image of the virtual model, deleting 3D data of parts of the virtual model by interacting with the displayed image, and replacing at least a portion of the deleted 3D data with new 3D data obtained from the physical structure to provide a modified virtual model.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to understand the invention and to see how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which:

FIG. 1 shows, by way of a flow chart, a method m accordance with a first embodiment of the invention.

FIG. 2 shows various elements of a system used for providing and manipulating a virtual dental model according to the embodiment of FIG. 1.

FIG. 3 schematically illustrates providing a first virtual model to the computer system of FIG. 2, and interacting with the display thereof.

FIG. 4 schematically illustrated a modified first computer model as displayed by the computer system of FIG. 2.

FIG. 5 schematically illustrates providing a second virtual model to the computer system of FIG. 2.

FIG. 6 schematically illustrates manipulating the second virtual model of FIG. 5 into registration with the modified computer model of FIG. 4.

FIG. 7 schematically illustrates an example of physical part used in conjunction with a second embodiment of the invention.

FIG. 8 schematically illustrates an example of physical part used in conjunction with a third embodiment of the invention.

FIG. 9 shows, by way of a flow chart, a method in accordance with an alternative variation of the first embodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

A computer-based method, particularly useful for creating, manipulating and refining a virtual dental model, according to a first embodiment of the invention and designated with reference numeral 400 is illustrated in FIG. 1.

In step 410 carried out by the method 400, an accurate 3D representation, i.e., a first 3D virtual model of a physical structure, in this example the intraoral cavity, is obtained. This first 3D virtual model is generally designated with the numeral VM1 in the accompanying figures. As used herein, and as already discussed, the intra oral cavity can include one or more real teeth and/or one or more prosthetic teeth and/or part of one or more real teeth of one jaw or of both jaws of a patient, and/or can also include all the real teeth and/or prosthetic teeth in one or both jaws, and/or adjacent gingiva and other adjacent objects of the patient, and/or can include a physical model or other physical representation of one or more or all the real teeth, and/or one or more or all of the prosthetic teeth, and/or part of one or more or all the real teeth, of one jaw or of both jaws, and/or of adjacent gingiva and/or other adjacent objects, of the patient.

Referring also to FIG. 3, the first 3D virtual model VM1 is thus representative of a physical part RM1 of the intra-oral cavity (typically of a patient, in vivo, but alternatively the first 3D virtual model VM1 may be of a physical dental model, as will become clearer below) including a tooth or teeth of interest.

The first 3D virtual model VM1, i.e. the 3D digitized data of the intraoral cavity, including the dentition and associated anatomical structures of a patient, may be provided using any suitable scanning equipment for scanning a patient's teeth, for example by scanning the intra oral cavity of the patient in vivo, or via scanning of a physical model or an impression thereof. Referring to FIG. 2, this may be done for example at a dental clinic 22 by the dentist or another dental practitioner. The dental clinic 22 is typically linked to one or more dental labs 26, and possibly also to a dental service center 23 via a communication means or network such as for example the Internet or other suitable communications medium such as an intranet, local access network, public switched telephone network, cable network, satellite communication system, and the like, indicated by the cloud at 24. The dental lab 26 is particularly adapted for defining the finish line, as well as for other tasks such as designing prostheses, designing and manufacturing physical models of the dentition, and possibly also for manufacturing at least an external profile of the prostheses. The dental service center 23 is particularly adapted for manufacturing dental hardware that requires a very high degree of precision, for example inner surfaces of prostheses that are required to match external surfaces of copings, and possibly also the copings themselves.

Such scanning equipment may include any suitable scanner, for example, an optical hand-held scanner 31 (or any other suitable optical scanner, mechanical scanner, ultrasound scanner, radiation-based scanner, including for example x-ray scanner, or other laser scanner, or any other suitable scanner) that is used by the practitioner to acquire the 3D data for example by directly scanning the patient's oral cavity. For example, a hand held apparatus including a probe for determining three dimensional structure by confocal focusing of an array of light beams can be used, for example as manufactured under the name of CB-CAD or as disclosed in WO 00/08415, the contents of which are incorporated herein by reference in their entirety, and in which in at least one embodiment, the apparatus is configured for determining surface topology of a portion of a three-dimensional structure, such as the intra oral cavity for example, the apparatus comprising:

- a probing member with a sensing face;
- an illumination unit for providing an array of incident light beams transmitted towards the structure along an optical path through said probing unit to generate illuminated spots on said portion;
- a light focusing optics defining one or more focal planes forward said probing face at a position changeable by said optics, each light beam having its focus on one of said one or more focal plane;
- a translation mechanism for displacing said focal plane relative to the structure along an axis defined by the propagation of the incident light beams;
- a detector having an array of sensing elements for measuring intensity of each of a plurality of light beams returning from said spots propagating through an optical path opposite to that of the incident light beams;
- a processor coupled to said detector for determining for each light beam a spot-specific position, being the position of the respective focal plane of said one or more focal planes yielding maximum measured intensity of the returned light beam, and based on the determined spot-specific positions, generating data representative of the topology of said portion.

The 3D data obtained by the scanner 31 may then be stored in a suitable storage medium, for example a memory in a computer workstation or system 32, which includes a display 33, such as for example a computer screen, operatively connected thereto. Typically, the 3D data can be sent over a suitable communication network 24 to the dental lab 26, for further processing. Optionally, the 3D data may be sent via communication network 24 to the dental service center 23, for the further processing.

The computer system 32 is configured for enabling the user to interact with images displayed in the display 33, and comprises an input device 40 configured for enabling the user to point to displayed objects on the display, and/or to interact with the display 33 to at least enable deletion and/or replacement of images thereon, as will become clearer below. The input device 40 may comprise, for example, a wand 34 (for example a light sensitive wand, or light pen) and/or a mouse 35, and/or the display 33 may incorporate the input device, being configured as a touch sensitive screen configured for at least enabling deletion and/or replacement of images thereon wherever a displayed image on the screen is touched or stroked by the user.

Optionally, color data of the intraoral cavity may also provided together with the 3D data, and thus the virtual model comprises coordinates and corresponding color information of the dental surfaces scanned. Examples of such scanners are disclosed in co-pending application entitled “METHOD AND APPARATUS FOR COLOUR IMAGING A THREE-DIMENSIONAL STRUCTURE”, published under US 2006-0001739, and which is assigned to the present Assignee. The contents of the aforesaid co-pending application are incorporated herein by reference in their entirety, and at least one embodiment of such a scanner comprises a device configured for determining the surface topology and associated color of at least a portion of a three dimensional structure, such as the intra oral cavity for example, comprising:

- (a) scanning means adapted for providing depth data of said portion corresponding to a two-dimensional reference array substantially orthogonal to a depth direction;
- (b) imaging means adapted for providing two-dimensional color image data of said portion associated with said reference array; wherein the device is adapted for maintaining a spatial disposition with respect to said portion that is substantially fixed during operation of said scanning means and said imaging means.

Such scanning means (a) may comprise the at least one embodiment of the apparatus disclosed in disclosed in WO 00/08415 and for example as defined above in connection therewith.

Alternatively or additionally, the clinic 22 may include equipment for obtaining a negative casting of a patient's teeth. In this case, the negative cast or impression can be taken of the patient's teeth, in a manner known in the art, and this physical negative model is dispatched to one of the dental labs 26 that is equipped to prepare from the negative model a physical positive cast suitable for scanning. The positive cast may be scanned at the dental lab 26 by any method known in the art, including for example x-ray scanning, laser scanning or using the aforesaid probe manufactured under the name of CB-CAD or as disclosed in WO 00/08415 and referred to above. The 3D data is then transmitted over the network 24 to the service center 23. Alternatively, the positive cast may be dispatched to the service center 23 by the dental clinic 22 and scanned at the service center 23 to obtain the 3D data. Alternatively, the service center 23 produces a positive model from the negative model and is scanned thereat, or sent to the dental clinic 22 to be scanned thereat. Alternatively, the negative model is scanned, either at the dental lab 26 or at the service center 23.

Alternatively, the negative model provided by the clinic 22 is sent to the service center 23, either directly by the clinic 22, or indirectly via the dental lab 26, and a composite physical positive-negative model may be manufactured from the original negative model. Thereafter, the positive-negative model may be processed to obtain 3D digitized data, for example as disclosed in U.S. Pat. No. 6,099,314, assigned to the present Assignee, and the contents of which are incorporated herein in their entirety.

Alternatively, the 3D first virtual model VM1 may be obtained in any other suitable manner, including other suitable intra oral scanning techniques, based on optical methods, direct contact or any other means, applied directly to the patient's dentition. Alternatively, X-ray based, CT based, MRI based, or any other type of scanning of the patient or of a positive and/or negative model of the intra-oral cavity may be used. As is clear from the aforegoing, the dimensional data of the respective virtual model may be associated with a complete dentition, or of a partial dentition, for example such as a preparation only of the intra oral cavity.

Once the 3D digitized data is obtained, the virtual model VM1 is input to suitable computer system 32, and the next steps 420 to 470, are performed with the aid of computer system 32. In alternative variations of this embodiment, the scanner 31 provides raw data to the computer system 32 which then generates the first virtual model VM1 therein from this raw data.

In step 420, the first virtual model VM1 is displayed (and optionally magnified and/or manipulated) in display 33 as a first display image DI1 corresponding to the first virtual model VM1.

For example, the display 33 can be a 2D display such as conventional 2D display screen, and thus the images are 2D images. Alternatively, the display can be a 3D display and the images are also 3D images. Alternatively, the display can be a 2D stereoscopic display and the images are also 2D stereoscopic images.

The first virtual model VM1 can then be checked visually by the user via the image DI1 on the display 33. This image DI1 can be virtually manipulated on the display 33 with respect to up to six degrees of freedom (i.e., translated and/or rotated with respect to one or more of three mutually orthogonal axes) by suitably manipulating the first virtual model VM1 within the computer environment of system 32, using suitable user controls (hardware and/or virtual) to enable viewing the first virtual model VM1 from any desired direction on the screen 33 via the corresponding display image DI1 on the display 33, enabling the first virtual model VM1 to be visually checked by the user.

According to this embodiment, steps 430 to 470 are implemented when part of the first virtual model VM1, designated DVM1, is considered to be unsuitable or undesired, while concurrently it is desired to retain another part of the first virtual model VM1.

For example, this part DVM1 of the first virtual model VM1 may be considered by the user as not acceptable or desirable and needing to be better defined for a particular dental procedure of interest. The part DVM1 can correspond, for example, to a part of a real dental surface DRM1 of the real (physical) part RM1 of the intra-oral cavity that was not sufficiently clearly defined in the first virtual model VM1. For example, during the initial 3D data collection step, for example via scanning, that resulted in the first virtual model VM1 being generated, the corresponding part DRM1 of the physical dental surface was covered with foreign material, such as for example saliva, blood, debris, or was otherwise obscured by another element such as for example part of the gums, cheek, tongue, dental instruments, artifacts, etc. Alternatively, for example, during the initial 3D data collection step, for example via scanning, that resulted in the first virtual model VM1 being generated, the virtual part DVM1 may be distorted or otherwise defective and does not properly correspond to real part DRM1, for example due to some defect in the actual scanning process, while the real part DRM1 itself is acceptable.

In step 430 this part DVM1 of the first virtual model VM1 is marked on the first image of the first virtual model VM1 on the display 33. By “marked” it is meant that this zone or area of the first image DI1 is at least identified by the user, and may optionally include interacting with the display 33 so that a visual mark is included in the image to show and demarcate this area on the image DI1 that is on the display 33. For example, wand 34, operatively connected to the computer system 32 can be used for interacting with the display 33, wherein a visual mark is displayed wherever the tip 39 of the wand 34 touches the image DI1 on the display 33.

In step 440, and referring also to FIG. 4, part DVM1 of the first virtual model VM1 is then “deleted” or otherwise removed or replaced interactively on the display 33 by the user, resulting in the first virtual model VM1 being modified to become a modified first virtual model VM1′, by passing the tip of the wand 34 over the marked area of the image DI1. The deletion, removal or replacement of part DVM1 is responsive to the application of a special corresponding computer-implemented function (i.e. a corresponding deletion function, removal function or replacement function) via the computer system 32. The special computer-implemented function is, for ease of reference referred to herein as the “delete” function (and includes at least one of a remove function, remove command, delete command, replace command, or replace function) of the computer system 32, and operates to modify for example the first virtual model VM1 by at least one of deleting, removing or replacing a part thereof when “delete” function is activated, i.e., when the “delete” function is applied to the marked area of the image DI1.

According to this special “delete” function, the computer system 32 is configured for causing at least the deletion and/or removal and/or replacement of data corresponding to part DVM1 of the first virtual model VM1, when a corresponding part of the display image DI1 on the display 33 is correspondingly deleted or removed or replaced on the display 33, which in turn is accomplished by interaction by the user, such as touching the desired parts of the image DI1 on the display 33 with the wand 34 when the “delete” function is activated.

Although in at least one embodiment the display image DI1 is a two dimensional image, each element or pixel of such a 2D display image DI1 corresponds to a unique part of the three-dimensional data of the first virtual model VM1, as viewed in a viewing direction corresponding to image DI1, and thus the computer system is configured for deleting or removing or replacing such parts of the three-dimensional data from the first virtual model VM1 when the corresponding elements or pixels in the image DI1 are “touched” on the display 33 and the computer system 32 has the special “delete” function activated.

Particularly where the first virtual model VM1 represents a three dimensional surface of the physical part RM1, it is readily understood that the deleted or removed or replaced portions of the first virtual model VM1 are also three dimensional surfaces.

The above interaction for deletion or removal with respect to image DI1 can alternatively be accomplished without recourse to touching the display 33. For example, the computer system may be additionally or alternatively configured for enabling parts of the image DI1 to be deleted or removed by interaction therewith via mouse 35 or any other suitable input device 40.

The first virtual model VM1 is thus modified by the loss of the three dimensional data corresponding to part DVM1, effectively generating a modified first 3D virtual model VM1′.

For example, the dental procedure of interest may be providing a dental prosthesis, and the deleted or removed part DVM1 may be part of the finish line 550 of a preparation 555 that exists in real dental surface DRM1, but failed to be represented at all, or to be clearly represented, in the first virtual model VM1, for example due to obfuscation thereof by foreign material, distortion of the scanned data, etc, as discussed above, for example.

The dental surface DRM1 is thus considered the “first physical portion” of step 440.

In step 450, and referring also to FIG. 5, a second virtual model VM2 is created, representing a second part RM2 of the physical dental structure. The second virtual model VM2 comprises a virtual part DVM2 that represents the part DRM1 of the physical dental surface, plus additional identifying surface data ID that represents a part P2 of the real dental surface in proximity to part DRM1, and thus second part RM2 at least partially overlaps with the physical part RM1. Before doing so, the part DRM1 of the physical dental surface is cleaned up and/or unobstructed, and for example rescanned to obtain second virtual model VM2. The scanning procedure thus also includes scanning the additional part P2 the real dental surface surrounding the part DRM1 to obtain additional identifying 3D surface data ID.

It is to be noted that in a variation of step 450, for example the virtual part DVM1 may be distorted or otherwise defective and does not properly correspond to real part DRM1, for example due to some defect in the actual scanning process thereof, while the real part DRM1 itself is acceptable. In such a case, second virtual model VM2 is created, representing a second part RM2 of the physical dental structure, and likewise the second virtual model VM2 comprises a virtual part DVM2 that represents the same part DRM1 of the physical dental surface, plus additional identifying surface data ID that represents a part P2 of the real dental surface in proximity to part DRM1, and thus second part RM2 at least partially overlaps with the physical part RM1. While scanning to provide the second virtual model VM2, it is now ensured that second virtual model VM2 is free from distortions or imperfections that originate from the scanning procedure itself.

In step 460, and referring also to FIG. 6, the second 3D virtual model VM2 is spatially registered with respect to the modified first 3D virtual model VM1′ to provide a composite third 3D virtual model VM3, wherein the part DVM1 that was previously deleted/removed is at least partially replaced with a corresponding part the second 3D virtual model VM2. In particular, the second virtual model VM2 is manipulated in the computer system 32 to register the second virtual model VM2 onto the modified first virtual model VM1′. In this connection, the identifying surface data ID of second virtual model VM2 may be useful as it may be aligned with corresponding parts of the modified first virtual model VM1′, since the surface data for part P2 of the real physical dental surface should be nominally identical in both scans. In this aligned position, part DVM2 of the second virtual model VM2 fits in and corresponds to at least a portion of the deleted portion DVM1, and part DVM2 is then stitched to modified first virtual model VM1′ in a virtual manner to create a further modified first virtual model, i.e., composite third 3D virtual model VM3. The remainder of the second virtual model VM2, including the identifying surface data ID may then be discarded.

Alternatively, it may not be necessary that second part RM2 at least partially overlaps with the physical part RM1, and instead the 3D data defining each respective virtual model can be referred to the same global coordinate system in a different manner, for example via an optical marker whose 3D coordinates are known with respect to a global coordinate system, and which is scanned together with each one of second part RM2 and physical part RM1.

Thus, the composite third 3D virtual model VM3 replaces the undesired part DVM1 of the original virtual model VM1 with new 3D data provided by part DVM2.

It is readily evident that by carrying out steps 430 to 460, the user only needs to “correct” or modify parts of the original virtual model VM1 of the dental surface i.e. of physical part RM1, and does not need to obtain a new virtual model of the whole of physical part RM1 from scratch, should even a small part of the virtual model VM1 not be acceptable.

In alternative variations of this embodiment, steps 430 to 460 may be implemented in a different manner. For example, and referring to FIG. 9, steps 430 to 460 may be replaced with steps 430′ to 460′ of modified method 400′, which can include steps 410′, 420′ and 470′ which are respectively identical to steps 410, 420, 470 of method 400 as disclosed herein, mutatis mutandis.

Step 430′ comprises all the elements and features of step 450 as disclosed herein, mutatis mutandis, with the main difference that step 430′ is implemented immediately following step 420′. In other words, and having carried out steps 410′ and 420′, the second virtual model VM2 is created, representing a second part RM2 of the physical dental structure. Again, the second virtual model VM2 comprises a virtual part DVM2 that represents the part DRM1 of the physical dental surface, plus additional identifying surface data ID that represents a part P2 of the real dental surface in proximity to part DRM1, and thus second part RM2 at least partially overlaps with the physical part RM1. Before doing so, the part DRM1 of the physical dental surface is cleaned up and/or unobstructed, and for example rescanned to obtain second virtual model VM2. The scanning procedure thus also includes scanning the additional part P2 the real dental surface surrounding the part DRM1 to obtain additional identifying 3D surface data ID.

Then, in step 440′, second virtual model VM2 is virtually registered with the first virtual model VM1. In particular, the second virtual model VM2 is manipulated in the computer system 32 to register the second virtual model VM2 onto the first virtual model VM1. In this connection, the identifying surface data ID of second virtual model VM2 may be useful as it may be aligned with corresponding parts of the first virtual model VM1, since the surface data for part P2 of the real physical dental surface should be nominally identical in both scans. In this aligned position, part DVM2 of the second virtual model VM2, corresponds to, in particular spatially corresponds to, and is different from, in particular is topographically different from, at least a portion of the portion DVM1 of the first virtual model VM1 (as is the case also in steps 430 to 460 of method 400, mutatis mutandis). At this point, portion DVM1 has not yet been deleted, removed or identified.

In step 440′, the second virtual model VM2 is also displayed (and optionally magnified and/or manipulated) in display 33 as a second display image DI2 corresponding to the second virtual model VM2, wherein display image DI2 is similar to first display image DI1 as disclosed herein, mutatis mutandis, but corresponds to the second virtual model VM2 rather than the first virtual model VM1. For example when using a 2D display, the second display image DI2 is also a two-dimensional image, but in 3D displays the second display image DI2 can be a 3D image as well, or in 2D stereoscopic displays the second display image DI2 can be a 2D stereoscopic image as well for example.

Both the second virtual model VM2 and the first virtual model VM1 are viewable on the display 33 via their respective images DI2 and DI1, either together in registry, or may be selectively viewed separately, in different display windows on the same display 33, for example, or alternately on the same display, or in different displays, and so on. To facilitate viewing the images in 3D registry, the images DI2 and DI1 may be visually encoded, each in a different manner. For example, the images DI2 and DI1 may be encoded each in a different color or shade of gray. Alternatively, at least parts of the images DI2 and DI1 which do not exactly correspond to one another may be color encoded in this manner to highlight the corresponding topographical differences between the real first part RM1 and the real second part RM2 of the physical dental structure.

In step 450′, part DVM1 of the first virtual model VM1 is marked by the user on the first image of the first virtual model VM1 on the display 33, this part DVM1 having first been visually identified by the user from the images DI1 and DI2 displayed in step 440′. Thus, step 450′ is similar to step 430 as disclosed herein, mutatis mutandis, and thus by “marked” it is meant that the user may optionally interact with this area of the first image DI1 in the display 33 so that a visual mark is included in the image to show and demarcate this area on the image DI1 that is on the display 33. For example, wand 34, operatively connected to the computer system 32 can be used for interacting with the display 33, wherein a visual mark is displayed wherever the tip 39 of the wand 34 touches the image DI1 on the display 33.

Step 460′ is similar to step 440 as disclosed herein, mutatis mutandis, and thus part DVM1 of the first virtual model VM1 is then “deleted” or otherwise removed or replaced interactively on the display 33 by the user, resulting in the first virtual model VM1 being modified to become a modified first virtual model VM1′, for example by passing the tip of the wand 34 over the marked area of the image DI1, when a special “delete” function (also referred to interchangeably herein as a remove function, remove command, or deleted command, or replace function, or replace command) of the computer system 32 is activated, i.e., when a corresponding function (delete function or remove function or replace function) is applied to the marked area of the image DI1. Step 460′ in addition comprises part of step 460 as disclosed herein, mutatis mutandis, and, with the second 3D virtual model VM2 already registered with respect to the modified first 3D virtual model VM1 (step 440′), the part DVM1 that was previously deleted/removed is at least partially replaced with a corresponding part of the second 3D virtual model VM2. Alternatively, this function operates as a unified replacement function in which DVM1 is replaced in one operation with part DVM2.

In the aligned position of the registered modified first virtual model VM1′ with second virtual model VM2, part DVM2 of the second virtual model VM2 virtually fits in and corresponds to at least a portion of the deleted portion DVM1, and part DVM2 is then stitched to modified first virtual model VM1′ in a virtual manner to create a further modified first virtual model, i.e., composite third 3D virtual model VM3. The remainder of the second virtual model VM2, including the identifying surface data ID may then be discarded.

Thus, in step 470′, a composite third 3D virtual model VM3 (comprising modified first virtual model VM1′ part DVM2) effectively replaces the undesired part DVM1 of the original virtual model VM1 with new 3D data provided by part DVM2.

It is to be noted that at least in some alternative variations of the method 400′, step 420′ and/or step 440′ can be omitted. For example, the user can scan the first physical part of the structure in step 410′ and then without displaying the respective first 3D virtual model, proceed with scanning the second part of the physical structure in step 430′ to provide the second 3D virtual model, also without displaying the respective second 3D virtual model. Thus, so long as the first 3D virtual model and the second 3D virtual model can be spatially registered (and thus the first physical part corresponds to (in particular spatially corresponds to) but may be different from (in particular topographically different from) the second physical part), step 460′ can be implemented automatically and the first 3D virtual model replaces parts thereof with the second 3D virtual model, without the need to have these parts or the first 3D virtual model or the second 3D virtual model displayed, identified or marked. Such a situation may arise, for example, where the user suspects or knows (for example during or after scanning to provide the first 3D virtual model) that some portions of the scanned first part of the physical structure were for example obscured, ill-defined, badly scanned, and so on and need to be rescanned. The user can then go back to these portions of the physical structure and rescan those portions to provide the second 3D virtual model which then automatically replaces corresponding parts of the first 3D virtual model.

In a similar manner, mutatis mutandis, in at least in some alternative variations of the method 400, step 420 can be omitted, and steps 440 and 460 can be modified so that the interaction with the display is omitted, and the first 3D virtual model replaces parts thereof with the second 3D virtual model automatically via registration therewith, rather than implementing a delete function first, and a stitching function later.

Referring to FIG. 7, a second embodiment of the invention has all the elements, features and steps of the first embodiment including steps 410 to 470 or alternative variations thereof, for example steps 410′ to 470′, mutatis mutandis, the main difference being that in the second embodiment the physical part RM1 of the intra-oral cavity includes a removable physical artifact which may be temporarily obscuring part of the dental surfaces.

For example, the artifact may be a scanning body or impression abutment 600 (or any other structure) that is mounted onto a dental implant and projects into the intra oral cavity so that the spatial orientation and/or other characteristics of the implant 620 (which is already anchored in the jaw 630 and thus cannot be seen) with respect to the dental surfaces may be derived from the position/orientation of the artifact 600.

The first virtual model VM1 for this embodiment thus also includes a virtual representation of the artifact 600, as well as all the other dental areas of interest of the physical part RM1, but the presence of the artifact 600 may render it difficult or impossible to obtain at the same time a full scan of the physical part RM1, as the artifact 600 may be too close in parts to the dental surfaces (e.g. adjacent teeth 640, 650) and thus obscures or blocks the ability of a scanner to scan such areas.

In this embodiment, and in applying method 400 to this embodiment, in steps 420 and 430, each part of the virtual model corresponding to an obscured area (and possibly also corresponding to the artifact 600) is deleted interactively in a similar manner that disclosed above for the first embodiment, mutatis mutandis, to provide the corresponding modified first virtual model VM1′.

Then, and prior to step 440, the artifact 600, which is considered the “first physical portion” in step 440, is physically removed from the intraoral cavity and an area of the physical part RM1 including the previously obscured areas that were not fully defined previously in the first virtual model VM1 is scanned, in the absence of the artifact, enabling full definition of this area to be achieved in the corresponding second virtual model VM2 thereby generated.

Thereafter, in step 460, second virtual model VM2 is registered with the modified first virtual model VM1′, in a manner similar to that disclosed above for the first embodiment, mutatis mutandis, to provide the corresponding the corresponding composite third virtual model VM3.

If necessary or desired, the artifact 600 itself (or part thereof) may also be scanned separately to obtain a virtual model thereof. This may be used to further modify the composite third virtual model, if for example part of the artifact was deleted in step 440.

Method 400′ may be applied m a corresponding manner to the second embodiment, mutatis mutandis.

It is readily evident that by carrying out this embodiment of the invention, it allows obtaining a virtual model of the intra oral cavity including such an artifact, wherein even the parts of the dental surfaces obscured by the artifact can be fully defined with respect thereto, even when originally obscured by the artifact.

Referring to FIG. 8, a third embodiment of the invention has all the elements, features and steps of the first embodiment including steps 410 to 470 or alternative variations thereof, for example steps 410′ to 470′, mutatis mutandis, the main difference being that the physical part RM1 in the third embodiment is considered to be well defined in the first virtual model VM1, i.e., faithfully represents the surfaces of interest of the physical part RM1; however, a first physical portion of the physical part RM1 is not considered suitable for a dental procedure.

For example, the physical part RM1 may be a dental preparation 700 for a dental prosthesis (e.g. a crown), and analysis of the first dental model with respect to a virtual model of the opposing dentition of the opposite jaw reveals that the form of the preparation would result in an inadequate structure for the prosthesis. For example, the dental preparation is too long and/or too thick, and would result in the thickness of the crown at the cusp being too thin, and thus mechanically weak.

In this connection, the distances between the preparation 700 and the opposed dental surfaces may be determined, for example, in a manner as disclosed in U.S. Pat. No. 6,334,853, the contents of which are incorporated herein in their entirety, which in turn can provide a measure of the corresponding thickness of the respective dental prosthesis. In at least one embodiment disclosed in U.S. Pat. No. 6,334,853, there is provided a method for obtaining a dental occlusion map of a three-dimensional virtual computer model of teeth of upper and lower jaws of a mouth, said occlusion map indicative of distances between opposite regions on facing surfaces of opposite teeth of the upper and lower jaws of the mouth, said method comprising the steps of:

- (i) determining said distances between opposite regions on opposite teeth of the upper and lower jaws of the mouth; and
- (ii) setting up a correspondence between said determined distances and regions on a mapping surface.

The part of the first 3D virtual model that corresponds to the unsuitable portion of the dental preparation 700 is then deleted or removed or replaced in steps 430 and 440 in applying method 400 to this embodiment, in a manner similar to that disclosed above for the first embodiment, mutatis mutandis.

The real dental preparation 700 is also physically modified by the dental practitioner in the areas found to be unsuitable for the prosthesis, for example via a material removal operation such as by using dental drills or dental lasers, for example, to provide a modified physical preparation 700′.

Thereafter, in step 450, a second virtual model VM2 corresponding to the modified preparation 700′ is obtained, for example by scanning the newly worked area of the modified preparation 700′, but also including additional part 750 of the preparation that was not altered in the material removal; process.

In step 460, second virtual model VM2 is registered with the modified first virtual model VM1′, in a manner similar to that disclosed above for the first embodiment, mutatis mutandis, to provide the corresponding the corresponding composite third virtual model VM3.

A new cycle of checking and modifying the preparation can be initiated if desired or necessary, wherein the third virtual model previously generated can be considered to be a “first virtual model” for the new cycle, and checked as in step 420, mutatis mutandis, and if necessary, steps 430 to 460 repeated as often as required, each time providing a new third virtual model than can be considered, if desired as a new first virtual model, until the newly modified third virtual model has a geometry for the dental preparation (corresponding to the geometry of the real dental preparation) that is adequate for receiving a prosthesis, according to criteria.

It is also readily evident that rather than modifying the whole preparation, only part of the preparation, for example a part of the finish line, can be modified instead, and the method applied to this part only, saving considerable time by not having to scan the remainder of the preparation (that is considered acceptable) or surrounding areas, i.e., the whole physical part RM1 again each time.

Method 400′ may be applied in a corresponding manner to the third embodiment, mutatis mutandis.

It is also readily evident that by carrying out this embodiment of the invention, it allows the dental practitioner to modify a dental structure such as dental preparation in a quick and easy manner with a minimum of scanning after the initial virtual scan. i.e., without the need to rescan the whole physical part RM1 again each time.

It also readily evident that parts or all of the method steps according to each of the first, second and third embodiments and/or alternative variations thereof may be applied to one or more of the other embodiments as well.

It is also readily evident that the method (and corresponding system) according to each of the first, second and third embodiments and/or alternative variations thereof may further comprise a manufacturing step, in which a dental object may be manufactured based on the respective composite third 3D virtual model VM3 under computer aided manufacture (CAM). Such a dental object may be manufactured, for example, based on a material removal operation that is performed by a computer aided removal operation machine having a suitable machining tool, using any suitable CAM (Computer Aided Manufacturing) technology, typically a CNC milling machine, on a blank of material. This material is typically plaster or any other type of material commonly used for dental models, however any other suitable material may be used. Alternatively, other CAM-based techniques may be used, for example rapid prototyping or any other suitable 3D printing technique, for creating the dental object. Accordingly, a dental object corresponding to composite third 3D virtual model VM3 or associated with the composite third 3D virtual model VM3 can be manufactured.

For example, the dental object may comprise a physical model of the intraoral cavity, and thus composite third 3D virtual model VM3 can be used directly to provide the necessary data for the CAM process.

In another example, and where the composite third 3D virtual model VM3 is based on one or more teeth requiring a prosthesis, and thus comprise a suitable preparation. A dental object in the form of the respective prosthesis may be prepared based on information from the composite third 3D virtual model VM3. The dentist or a technician may generate a 3D virtual prosthesis model of a crown to be fitted on a tooth stump (or of a bridge to be fitted on the tooth surface, or of any other prosthesis to be fitted to the tooth/teeth including any restoration and/or any onlays, and/or any inlays, such as caps, for example, or veneering, or any other artificial partial or complete denture), to generate a digital file. Alternatively, the outer surface of the prosthesis may be designed manually if desired. The prosthesis may then be manufactured using any suitable CAM techniques, for example as disclosed above, mutatis mutandis, and in a further step, the prosthesis may be installed in the oral cavity of the patient. Optionally, the virtual prosthesis model may also include a virtual model of a coping plus a virtual model of a cap that is to be mounted onto the coping. The coping may be manufactured using any suitable method, for example as disclosed in WO 2004/087000, also assigned to the present Assignee, and the contents of which are incorporated herein in their entirety. The cap or full prosthesis may be manufactured using any suitable method, for example as disclosed in U.S. Ser. No. 11/046,709 or in U.S. Provisional Application No. 60/632,350, also assigned to the present Assignee, and the contents of which are incorporated herein in their entirety.

In another example, and where the composite third 3D virtual model VM3 is based on one or more teeth requiring an orthodontic treatment, a set of aligners may be manufactured based on the composite third 3D virtual model VM3. For example, the teeth shown in the 3D virtual model, which normally would be of a patient's teeth in their initial positions, can be segmented (i.e. digitally cut into separate objects). The resultant digital data can then be used for orthodontic treatment planning. The individual teeth can be moved by a computer program and/or by an operator into a desired final setup. Then a number of digital intermediate tooth arrangements can be generated. These digital intermediate and final tooth arrangements of the treatment plan can be used to fabricate positive molds of intermediate arrangements (such as by using rapid proto typing equipment or milling machines) which are used to form aligners for moving teeth or they can be used to directly form aligners.

Alternatively, where the composite third 3D virtual model VM3 is based on one or more teeth requiring an orthodontic treatment, dental objects in the form of a set of orthodontic appliances, for example brackets, may be virtually designed and/or manufactured (for example using suitable CAM-based techniques) based on the composite third 3D virtual model VM3.

Furthermore, where the composite third 3D virtual model VM3 is based on one or more teeth requiring an orthodontic treatment, such an orthodontic treatment may be designed using a computer system based on third 3D virtual model VM3. For example such an orthodontic treatment may be provided by implementing a method for virtual orthodontic treatment, for example as disclosed in U.S. Pat. No. 6,739,869, also assigned to the present Assignee, and the contents of which are incorporated herein in their entirety, and at least one embodiment of such a method for virtual orthodontic treatment comprises:

- (a) providing a first virtual three-dimensional (3D) image indicative of a 3D model of all teeth of at least one jaw, the model being manipulable so as to allow its viewing from a desired direction—for example such a first virtual three-dimensional (3D) image may be based on the composite third 3D virtual model VM3;
- (b) selecting a virtual set of orthodontic components, comprising (i) brackets, one for each tooth in said first image, for attachment to teeth of said image, each of said brackets having a slot for engaging an arch wire, and (ii) one or two arch wires, one for each jaw of said first image;
- (c) associating the brackets with the teeth of said first image so as to obtain a second image of said virtual 3D model with the brackets associated with the teeth of the model, one bracket on each teeth in said model; and
- (d) using a set of rules including a rule that requires each slot to engage the wire, computing the manner of movement of each tooth with the bracket associated therewith, so as to obtain a third image comprising the teeth model following the virtual treatment.

It is also readily evident that the method (and corresponding system) according to at least one embodiment of the present invention may be applied to obtaining a 3D virtual model of any physical structure, including non-dental structures, and in which it may be desired or necessary to re-scan a part of the structure, without the need to rescan the whole structure again to obtain an updated 3D virtual model of the physical structure. Such method (and corresponding system) may optionally be further used for manufacturing a physical object based on or associated with the updated 3D virtual model of the physical structure.

For example, the method (and corresponding system) according to at least one embodiment of the invention may be applied to scanning a complex circuit board comprising a plurality of chips mounted thereon, replacing one such ship and scanning the new chip in situ, and modifying the original 3D virtual model to replace the part thereof corresponding to the old chip with the 3D data corresponding to the new chip.

In another example, the method (and corresponding system) according to at least one embodiment of the invention may be applied to scanning a complex geometrical physical structure comprising a plurality of geometrical entities mounted or formed thereon, adding or removing a geometrical physical entity with respect to the structure, and scanning the modified physical structure in the area that includes the new geometrical entity or that includes the modification of the physical structure arising from the removal of the geometrical entity, respectively, and modifying the original 3D virtual model to replace a corresponding part thereof with the 3D data corresponding to the aforesaid scanned area.

In the method claims that follow, alphanumeric characters and Roman numerals used to designate claim steps are provided for convenience only and do not imply any particular order of performing the steps.

Finally, it should be noted that the word “comprising” as used throughout the appended claims is to be interpreted to mean “including but not limited to”.

While there has been shown and disclosed some embodiments in accordance with the invention, it will be appreciated that many changes may be made therein without departing from the spirit of the invention.