Contour triangulation system and method
A method and apparatus for reconstructing a surface shape of an object having contour lines, includes assigning points to each contour line. A first triangulation scheme is performed with respect to respective points on two adjacently-positioned contour lines, to determine a first surface shape for a portion of the object corresponding to the two contour lines. The first surface shape is checked to determine if the first surface shape is in error. If the first surface shape is not in error, the first surface shape is outputted for the portion of the object as determined by the first triangulation scheme, as a reconstructed surface shape for that portion of the object. If the first surface shape is in error, a second triangulation scheme is performed with respect to the respective points on the two contour lines, to determine a second surface shape for that portion of the object, and the second surface shape is outputted for that portion of the object as determined by the second triangulation scheme, as a reconstructed surface shape.
Latest Patents:
1. Field of the Invention
The invention relates to a system and method for constructing a surface shape from a plurality of contour lines provided on parallel or substantially parallel planes.
2. Description of Related Art
In the area of biomedicine, acquiring an accurate three dimensional (3D) surface of the human anatomy (e.g., bones, tumors, tissues) is very helpful in image-guided therapy, such as image-guided surgery, and radiation therapy planning. Computed Tomography (CT), Magnetic Resonance Imaging (MRI), Positron Emission Tomography (PET), Single Photon Emission Computed Tomography (SPECT), and some ultrasound techniques make it possible to obtain cross sections of the human body.
A suitable approach for constructing a three dimensional surface of the human anatomy is made from the contour lines of human anatomy by the triangulation of a set of contours created from parallel slices corresponding to different levels. It can be briefly described as joining points of neighboring contour lines to generate triangles. The surface is represented by tessellating those contours, in which triangular elements are obtained to delimit a polyhedron approximating the surface of interest. The major problem in surface triangulation is the accuracy of the reconstructed surface and the reliability and complexity of the algorithm.
In view of the foregoing, a need exists for a contour triangulation system and method that can generate any complex surface with very good accuracy. The generation of the complex surface preferably will be fast and reliable and suitable for real time application.
SUMMARY OF THE INVENTIONAn aspect of the present invention relates to a method of reconstructing a surface shape of an object from a plurality of contour lines. The method includes obtaining the plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data to obtain the contour lines. The method also includes assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines. The method further includes performing a first triangulation scheme with respect to respective points on two adjacently-positioned contour lines, to determine a first surface shape for a portion of the object corresponding to the two adjacently-positioned contour lines. The method still further includes checking the first surface shape to determine if the first surface shape is in error. If the first surface shape is not in error, the method includes outputting the first surface shape for the portion of the object as determined by the first triangulation scheme, as a reconstructed surface shape for the portion of the object. If the first surface shape is in error, the method includes performing a second triangulation scheme with respect to the respective points on the two adjacently-positioned contour lines, to determine a second surface shape for the portion of the object corresponding to the two adjacently-positioned contour lines, and outputting the second surface shape for the portion of the object as determined by the second triangulation scheme, as a reconstructed surface shape for the portion of the object.
Yet another aspect of the present invention relates to a method of reconstructing a surface shape of an object from a plurality of contour lines. The method includes obtaining the plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data to obtain the contour lines. The method also includes assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines. The method further includes performing a shortest distance triangulation scheme with respect to respective points on two adjacently-positioned contour lines that correspond to first and second contour lines, to determine a first surface shape for a portion of the object corresponding to the first and second contour lines. The shortest distance triangulation scheme includes:
a) for each point on the first contour line, determining a point on the second contour line that is closest to the point on the first contour line;
b) setting a first triangle leg as a line that connects the point on second contour line that is closest to the point on the first contour line;
c) comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line;
d) based on the comparing step, setting a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
e) repeating steps a) through d) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
Yet another aspect of the present invention relates to a method of reconstructing a surface shape of an object from a plurality of contour lines. The method includes obtaining the plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data to obtain the contour lines. The method also includes assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines. The method further includes performing a closest orientation triangulation scheme with respect to respective points on two adjacently-positioned contour lines that correspond to first and second contour lines, to determine a first surface shape for a portion of the object corresponding to the first and second contour lines. The closest orientation triangulation scheme includes:
a) for each point on the first contour line, determining an orientation of a centroid vector of the point on the first contour line to each contour point on the second contour line;
b) determining a closest orientation of the point on the first contour to a point on the second contour line;
c) repeating steps a) and b) until a closest orientation for all points on the first contour line have been determined;
d) setting a first triangle leg as a line that connects the point on second contour line that has the closest orientation to the point on the first contour line;
e) comparing a first orientation from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second orientation from an adjacent point on the second contour line to the point on the first contour line;
f) based on the comparing step, setting a second triangle leg as a line that connects the shorter orientation of the first and second orientations, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
g) repeating steps d) through f) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
BRIEF DESCRIPTION OF THE DRAWINGSThe accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain principles of the invention.
Presently preferred embodiments of the invention are illustrated in the drawings. Although this specification refers primarily to obtaining a surface image of a bone, it should be understood that the subject matter described herein is applicable to other parts of the body, such as, for example, organs, intestines or muscles.
The first embodiment is directed to reconstructing a complex surface from a set of parallel contour lines obtained from scanning an object, such as a bone of a patient. By way of example and not by way of limitation, a CT scan of a patient's anatomy, such as the patient's knee, is made, in a raw data obtaining step, with the scanned data stored in a CT scan file. From that CT scan, the first embodiment reconstructs a 3D surface of the patient's knee, such as the outer surface of the femur and tibia bone. The format of the CT scan file can be obtained in any particular format that is readable by a general purpose computer, such as an Image Guidance System (IGS) format that is converted from a Digital Imaging and Communications in Medicine (DICOM) format, whereby such formats are well known to those skilled in the art.
The computer may be any known computing system but is preferably a programmable, processor-based system. For example, the computer may include a microprocessor, a hard drive, random access memory (RAM), read only memory (ROM), input/output (I/O) circuitry, and any other well-known computer component. The computer is preferably adapted for use with various types of storage devices (persistent and removable), such as, for example, a portable drive, magnetic storage (e.g., a floppy disk), solid state storage (e.g., a flash memory card), optical storage (e.g., a compact disc or CD), and/or network/Internet storage. The computer may comprise one or more computers, including, for example, a personal computer (e.g., an IBM-PC compatible computer) or a workstation (e.g., a SUN or Silicon Graphics workstation) operating under a Windows, UNIX, Linux, or other suitable operating system and preferably includes a graphical user interface (GUI).
Once the raw data has been obtained and has been loaded onto the computer, or onto a memory accessible by the computer, a surface construction of the raw data is made by way of the first embodiment, which may be embodied in program code executable by the computer. From the CT scan file data, a set of parallel slices (which can be in any orientation, transverse, sagittal, coronal, or oblique), also referred to herein as contour lines, are selected to encompass the entire femur or tibia bone. The number of slices can be determined by a trade-off of the work load of femur and tibia segmentation and the resolution of the reconstructed 3D surface. After the number and the position of slices are set, a manual segmentation is performed to separate the femur and tibia bone from the rest of the image. Any of a number of segmentation schemes can be employed to produce a set of contours in parallel planes, with one contour per plane. For example, “Live Wire” segmentation (edge measurement scheme) or “Snakes” segmentation (minimization scheme) may be performed, whereby these segmentation schemes are well known to those skilled in the art. The output obtained from scanning an object is a series of parallel images, whereby these images are input to a contouring process (any of ones known to those skilled in the art, such as the ones described above) that produces the contour lines. Each contour is represented by a set of contour points. The 3D coordinates (x, y, z) of each contour point are saved as the input to a triangulation processing unit according to the first embodiment. In the first embodiment, these contour points are ordered in the counter-clockwise (CCW) direction. Alternatively, they can be ordered in the clockwise (CW) direction. The triangulation processing unit according to the first embodiment can be embodied as program code executable by a computer. Contour lines can be concave in some areas, flat in other areas, and convex in yet other areas of a segmented scanned image, whereby each contour line is closed (e.g., the first point connects with the second point, the second point connects with the third point, . . . , and the last point connects with the first point on the same contour line) and non-intersecting with other contour lines.
In the first embodiment, a ‘shortest distance’ triangulation approach is provided by way of the triangulation processing unit of the computer, which generates a triangle strip between pairs of adjacent parallel contours. The ‘shortest distance’ triangulation approach according to the first embodiment is explained in detail hereinbelow.
Referring now to
A first step in the shortest distance scheme according to the first embodiment is the selecting of the initial points. This initial point determination is done according to the following:
- 1) Set the minimum distance dmin to a large number (e.g., 216−1 for a computer using 16-bit data words).
- 2) Start from one contour point on contour1, compute the distance to each contour point on contour2, and record the shortest distance as ds.
- 3) If ds is less than dmin, set dmin to the ds. Record the position of contour points on contour1 and contour2, by storing them in a memory accessible by the computer.
- 4) Move to another contour point in contour1, repeat steps 2) and 3).
- 5) Stop when all contour points on contour1 are checked.
Once the initial points have been determined for all points on the contours, the following shortest distance determination steps are performed in the first embodiment.
- 1) Select the two points Pi and Qj with the closest distance on contour1 and contour2, respectively.
- 2) Compare the distance from Pi to Qj1, and the distance from Pi1 to Qj. If Pi and Qj1 has shorter distance, then select Qj1 to generate triangle patch PiQjQj1. If Pi1 and Qj has shorter distance, then select Pi1 to generate triangle patch PiPi1Qj. See
FIG. 2 , which shows the two possible selections as dashed lines in that figure. - 3) Perform steps 1) and 2) iteratively until all contour points have been selected for triangulation.
- 4) If one contour runs out of contour points, then stay at the end point at that contour and only select the neighboring point on the other contour to generate triangle patches in next iterations.
- 5) Stop when all contour points have been selected for triangulation.
The shortest distance solution according to the first embodiment assumes that triangulations generated by shortest distance have the closest approximation to the actual 3D surface. This is true in most cases. Thus, it generates visually a smooth surface that can approximate virtually any complex 3D surface, such as a tibia or femur of a patient's knee.
The shortest distance approach is continued for each respective contour, in order to generate a 3D shape that reasonably approximates the true shape of the object that was scanned by a CT scanner, for example.
In a second embodiment, a ‘closest orientation’ triangulation approach is provided by way of the triangulation processing unit of the computer, which generates a triangle strip between pairs of adjacent parallel contours. The ‘closest orientation’ triangulation approach according to the second embodiment is explained in detail hereinbelow. The second embodiment provides a surface shape that reasonably approximates the true surface shape of a scanned object, similar to the purpose of the first embodiment. The triangulation processing unit of the second embodiment can be embodied as program code executable by a computer.
A first step in the closest orientation scheme according to the second embodiment is the selecting of the initial points. This initial point determination is done according to the following:
- 1) Set the closest orientation Orientmax to 0.
- 2) Start from one contour i point on contour1, compute the orientation of vector Vci to each contour point j on contour2. The orientation is the dot product of vectors Vci and Vcj. Store the closest orientation as Orientclosest.
- 3) If Orientclosest is larger than Orientmax, set Orientmax to the Orientclosest. Store the position of contour points on contour1 and contour2.
- 4) Move to another contour point in contour1, and repeat steps 2) and 3).
- 5) Stop when all contour points on contour1 are checked.
Once the initial points have been determined for all points on the contours, the following closest orientation determination steps are performed in the second embodiment.
- 1) This scheme starts from two points Pi and Qj with closest orientation related to the centroids of contour1 and contour2, respectively.
- 2) The next step compares the orientation of vector pair (Vci, Vcj1) and (Vcj, Vci1). If (Vci, Vcj1) has closer orientation, the next step will select Qj1 to generate triangle patch PiQjQj1. If (Vcj, Vci1) has closer orientation, the next step will select Pi1 to generate triangle patch PiPi1Qj.
- 3) These steps are run iteratively until all contour points are selected for triangulation.
- 4) If one contour runs out of contour points, the closest orientation scheme stays at the end point on that contour and select the neighboring point on the other contour to generate triangle patches in next iterations.
- 5) The closest orientation determination scheme stops when all contour points have been selected for triangulation.
The following is pseudo code that may be used for the closest orientation scheme of the second embodiment.
The closest orientation solution generates triangulations that are evenly distributed along the orientation related to the centroid of the contour. Thus, the closest orientation scheme is sufficient when contours have similar shape and orientation and are mutually centered.
A third embodiment of the invention will now be described in detail. The third embodiment obtains scanned data scanned (e.g., data obtained from a CT scan) from a patient, similar to the first and second embodiments. From that scanned data, a triangulation scheme is performed in order to obtain a surface structure from the scanned data. In the third embodiment, the shortest distance scheme as described with respect to the first embodiment is performed first. If the results of that scheme are acceptable, then the process is finished. If the results of that scheme are unacceptable, then the third embodiment performs a closest orientation scheme of the same scanned data, and outputs the results as the surface contour data.
The reasoning behind the third embodiment is explained hereinbelow. The shortest distance scheme of the first embodiment works well for many complex 3D surface approximations. However, when two neighboring contours have a large difference in the number of contour points (e.g., one contour much shorter than a neighboring contour), and one contour is close to one side of the other contour, many points on the shorter contour connect to the contour points on the wrong side of the other contour by the shortest distance scheme. This is shown in
One feature of the third embodiment is the determination of when the first triangulation scheme has provided a ‘wrong’ result. This can be done by checking the respective centroid vectors of the connected points on the two adjacent contours. If the respective centroid vectors point in directions that are at least 90 degrees different from each other, then a wrong result is detected. For example, turning now to
A more detailed description of how an error may be detected by a checking step or checking unit in an output of a shortest distance triangulation scheme is provided below.
a) For each point on the first contour line, determine a point on the second contour line that is closest to the point on the first contour line.
b) Set a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line.
c) Compare a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line.
d) Based on the comparing performed in step c), set a second triangle leg as a line that connects the shorter one of the first and second distances, and set a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line.
e) Check the orientation of the centroid vector for the point on the first contour line to the centroid vector for the point on the second contour line, if orientation is larger than a predetermined value (e.g., 90 degrees), the surface shape is in error, otherwise the surface shape is correct; wherein the orientation is determined by computing the dot product of the centroid vector of the point on the first contour line with the centroid vector of the point on the second contour line, wherein the negative dot product corresponds to the orientation larger than the predetermined value (e.g., 90 degrees).
f) Repeat steps a) through e) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
The output of the triangulation scheme of the shortest distance approach and the closest orientation approach is a ‘set of triangles’ list. The coordination of three vertices are saved in memory, and are then used for surface rendering, for display on a display (e.g., computer monitor).
Thus, embodiments of the present invention provide a contour triangulation apparatus and method in order to obtain a surface structure from scanned image data that includes plural contour lines. Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only.
Claims
1. A method of reconstructing a surface shape of an object from a plurality of contour lines, comprising:
- obtaining the plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data;
- assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines;
- performing a first triangulation scheme with respect to respective points on two adjacently-positioned contour lines, to determine a first surface shape for a portion of the object corresponding to the two adjacently-positioned contour lines;
- checking the first surface shape to determine if the first surface shape is in error;
- if the first surface shape is not in error, outputting the first surface shape for the portion of the object as determined by the first triangulation scheme, as a reconstructed surface shape for the portion of the object; and
- if the first surface shape is in error, performing a second triangulation scheme with respect to the respective points on the two adjacently-positioned contour lines, to determine a second surface shape for the portion of the object corresponding to the two adjacently-positioned contour lines; and outputting the second surface shape for the portion of the object as determined by the second triangulation scheme, as a reconstructed surface shape for the portion of the object.
2. The method according to claim 1, wherein the first triangulation scheme is a shortest distance scheme, and wherein the second triangulation scheme is a closest orientation scheme.
3. The method according to claim 1, wherein the scanning step is accomplished by performing a CT scan of the object.
4. The method according to claim 1, wherein the object includes a bone structure of a patient.
5. The method according to claim 1, further comprising:
- performing either or both of the first triangulation scheme or the second triangulation scheme with respect to respective points on each two adjacently-positioned contour lines of the plurality of contour lines, in order to obtain a full reconstructed surface shape of the object.
6. The method according to claim 1, wherein one of the first triangulation scheme and the second triangulation scheme includes a shortest distance triangulation scheme comprising:
- a) for each point on the first contour line, determining a point on the second contour line that is closest to the point on the first contour line;
- b) setting a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line;
- c) comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line;
- d) based on the comparing step, setting a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
- e) repeating steps a) through d) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
7. The method according to claim 1, wherein one of the first triangulation scheme and the second triangulation scheme includes a closest orientation triangulation scheme comprising:
- a) for each point on the first contour line, determining an orientation of a centroid vector of the point on the first contour line to each contour point on the second contour line;
- b) determining a closest orientation of the centroid vector of the point on the first contour line to a centroid vector of a point on the second contour line;
- c) repeating steps a) and b) until a closest orientation for all points on the first contour line have been determined;
- d) setting a first triangle leg as a line that connects the point on the second contour line that has the closest orientation to the point on the first contour line;
- e) comparing a first orientation from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second orientation from an adjacent point on the second contour line to the point on the first contour line;
- f) based on the comparing step, setting a second triangle leg as a line that connects the closest orientation of the first and second orientations, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
- g) repeating steps d) through f) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
8. The method according to claim 6, wherein the other of the first triangulation scheme and the second triangulation scheme includes a closest orientation triangulation scheme comprising:
- a) for each point on the first contour line, determining an orientation of a centroid vector of the point on the first contour line to each contour point on the second contour line;
- b) determining a closest orientation of the centroid vector of the point on the first contour line to a centroid vector of a point on the second contour line;
- c) repeating steps a) and b) until a closest orientation for all points on the first contour line have been determined;
- d) setting a first triangle leg as a line that connects the point on the second contour line that has the closest orientation to the point on the first contour line;
- e) comparing a first orientation from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second orientation from an adjacent point on the second contour line to the point on the first contour line;
- f) based on the comparing step, setting a second triangle leg as a line that connects the closest orientation of the first and second orientations, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
- g) repeating steps d) through f) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
9. The method according to claim 1, further comprising:
- creating a model of the object from multiple pairs of triangulated contours, wherein the multiple pairs of triangulated contours are stacked on top of each other.
10. The method according to claim 9, further comprising:
- closing top and bottom contours of the stacked triangulated contours by using a respective centroid point as an apex of multiple triangles each formed from adjacent points on the respective top and bottom contours.
11. The method according to claim 1, wherein the checking step comprises:
- a) for each point on the first contour line, determining a point on the second contour line that is closest to the point on the first contour line;
- b) setting a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line;
- c) comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line;
- d) based on the comparing step, setting a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line;
- e) checking the orientation of the centroid vector for the point on the first contour line to the centroid vector for the point on the second contour line, if orientation is larger than 90 degrees, the surface shape is in error, otherwise the surface shape is correct; wherein the orientation is determined by computing a dot product of the centroid vector of the point on the first contour line with the centroid vector of the point on the second contour line, wherein the negative dot product corresponds to the orientation larger than 90 degrees;
- f) repeating steps a) through e) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
12. A method of reconstructing a surface shape of an object from a plurality of contour lines, comprising:
- obtaining the plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data;
- assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines;
- performing a shortest distance triangulation scheme with respect to respective points on two adjacently-positioned contour lines that correspond to first and second contour lines, to determine a first surface shape for a portion of the object corresponding to the first and second contour lines,
- wherein the shortest distance triangulation scheme comprises: a) for each point on the first contour line, determining a point on the second contour line that is closest to the point on the first contour line; b) setting a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line; c) comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line; d) based on the comparing step, setting a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and e) repeating steps a) through d) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
13. The method according to claim 12, wherein the scanning step is accomplished by performing a CT scan of the object.
14. The method according to claim 12, wherein the object includes a bone structure of a patient.
15. The method according to claim 12, further comprising:
- creating a model of the object from multiple pairs of triangulated contours, wherein the multiple pairs of triangulated contours are stacked on top of each other.
16. The method according to claim 15, further comprising:
- closing top and bottom contours of the stacked triangulated contours by using a respective centroid point as an apex of multiple triangles each formed from adjacent points on the respective top and bottom contours.
17. A method of reconstructing a surface shape of an object from a plurality of contour lines, comprising:
- obtaining the plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data;
- assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines;
- performing a closest orientation triangulation scheme with respect to respective points on two adjacently-positioned contour lines that correspond to first and second contour lines, to determine a first surface shape for a portion of the object corresponding to the first and second contour lines,
- wherein the closest orientation triangulation scheme comprises: a) for each point on the first contour line, determining an orientation of a centroid vector of the point on the first contour line to each contour point on the second contour line; b) determining a closest orientation of the centroid vector of the point on the first contour line to a centroid vector of a point on the second contour line; c) repeating steps a) and b) until a closest orientation for all points on the first contour line have been determined; d) setting a first triangle leg as a line that connects the point on the second contour line that has the closest orientation to the point on the first contour line; e) comparing a first orientation from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second orientation from an adjacent point on the second contour line to the point on the first contour line; f) based on the comparing step, setting a second triangle leg as a line that connects the closest orientation of the first and second orientations, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and g) repeating steps d) through f) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
18. The method according to claim 17, wherein the scanning step is accomplished by performing a CT scan of the object.
19. The method according to claim 17, wherein the object includes a bone structure of a patient.
20. The method according to claim 17, wherein the closest orientation of the centroid vector of the point on the first contour line to the centroid vector of a point on the second contour line is determined by computing a dot product of the centroid vector of the point on the first contour line with a centroid vector of each point on the second contour line, wherein the point on the second contour line having the smallest dot product corresponds to the closest orientation.
21. The method according to claim 17, further comprising:
- creating a model of the object from multiple pairs of triangulated contours, wherein the multiple pairs of triangulated contours are stacked on top of each other.
22. The method according to claim 21, further comprising:
- closing top and bottom contours of the stacked triangulated contours by using a respective centroid point as an apex of multiple triangles each formed from adjacent points on the respective top and bottom contours.
23. A computer program product executable on a computer and configured to compute a surface shape of an object, the computer program product, when executed on the computer, performing the steps of:
- obtaining a plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data;
- assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines;
- performing a first triangulation scheme with respect to respective points on two adjacently-positioned contour lines, to determine a first surface shape for a portion of the object corresponding to the two adjacently-positioned contour lines;
- checking the first surface shape to determine if the first surface shape is in error;
- if the first surface shape is not in error, outputting the first surface shape for the portion of the object as determined by the first triangulation scheme, as a reconstructed surface shape for the portion of the object; and
- if the first surface shape is in error, performing a second triangulation scheme with respect to the respective points on the two adjacently-positioned contour lines, to determine a second surface shape for the portion of the object corresponding to the two adjacently-positioned contour lines; and outputting the second surface shape for the portion of the object as determined by the second triangulation scheme, as a reconstructed surface shape for the portion of the object.
24. The computer program product according to claim 23, wherein the first triangulation scheme is a shortest distance scheme, and wherein the second triangulation scheme is a closest orientation scheme.
25. The computer program product according to claim 23, wherein the scanning step is accomplished by performing a CT scan of the object.
26. The computer program according to claim 23, wherein the object includes a bone structure of a patient.
27. The computer program product according to claim 23, further comprising:
- performing either or both of the first triangulation scheme or the second triangulation scheme with respect to respective points on each two adjacently-positioned contour lines of the plurality of contour lines, in order to obtain a full reconstructed surface shape of the object.
28. The computer program product according to claim 23, wherein one of the first triangulation scheme and the second triangulation scheme includes a shortest distance triangulation scheme comprising:
- a) for each point on the first contour line, determining a point on the second contour line that is closest to the point on the first contour line;
- b) setting a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line;
- c) comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line;
- d) based on the comparing step, setting a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
- e) repeating steps a) through d) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
29. The computer program product according to claim 23, wherein one of the first triangulation scheme and the second triangulation scheme includes a closest orientation triangulation scheme comprising:
- a) for each point on the first contour line, determining an orientation of a centroid vector of the point on the first contour line to each contour point on the second contour line;
- b) determining a closest orientation of the centroid vector of the point on the first contour line to a centroid vector of a point on the second contour line;
- c) repeating steps a) and b) until a closest orientation for all points on the first contour line have been determined;
- d) setting a first triangle leg as a line that connects the point on the second contour line that has the closest orientation to the point on the first contour line;
- e) comparing a first orientation from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second orientation from an adjacent point on the second contour line to the point on the first contour line;
- f) based on the comparing step, setting a second triangle leg as a line that connects the closest orientation of the first and second orientations, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
- g) repeating steps d) through f) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
30. The computer program product according to claim 28, wherein the other of the first triangulation scheme and the second triangulation scheme includes a closest orientation triangulation scheme comprising:
- a) for each point on the first contour line, determining an orientation of a centroid vector of the point on the first contour line to each contour point on the second contour line;
- b) determining a closest orientation of the centroid vector of the point on the first contour line to a centroid vector of a point on the second contour line;
- c) repeating steps a) and b) until a closest orientation for all points on the first contour line have been determined;
- d) setting a first triangle leg as a line that connects the point on the second contour line that has the closest orientation to the point on the first contour line;
- e) comparing a first orientation from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second orientation from an adjacent point on the second contour line to the point on the first contour line;
- f) based on the comparing step, setting a second triangle leg as a line that connects the closest orientation of the first and second orientations, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and
- g) repeating steps d) through f) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
31. The computer program product according to claim 23, further comprising:
- creating a model of the object from multiple pairs of triangulated contours, wherein the multiple pairs of triangulated contours are stacked on top of each other.
32. The computer program product according to claim 31, further comprising:
- closing top and bottom contours of the stacked triangulated contours by using a respective centroid point as an apex of multiple triangles each formed from adjacent points on the respective top and bottom contours.
33. The computer program product according to claim 23, wherein the checking step comprises:
- a) for each point on the first contour line, determining a point on the second contour line that is closest to the point on the first contour line;
- b) setting a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line;
- c) comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line;
- d) based on the comparing step, setting a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line;
- e) checking the orientation of the centroid vector for the point on the first contour line to the centroid vector for the point on the second contour line, if orientation is larger than 90 degrees, the surface shape is in error, otherwise the surface shape is correct; wherein the orientation is determined by computing a dot product of the centroid vector of the point on the first contour line with the centroid vector of the point on the second contour line, wherein the negative dot product corresponds to the orientation larger than 90 degrees;
- f) repeating steps a) through e) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
34. A computer program product executable on a computer and configured to compute a surface shape of an object, the computer program product, when executed on the computer; performing the steps of:
- obtaining a plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data;
- assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines;
- performing a shortest distance triangulation scheme with respect to respective points on two adjacently-positioned contour lines that correspond to first and second contour lines, to determine a first surface shape for a portion of the object corresponding to the first and second contour lines,
- wherein the shortest distance triangulation scheme comprises: a) for each point on the first contour line, determining a point on the second contour line that is closest to the point on the first contour line; b) setting a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line; c) comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line; d) based on the comparing step, setting a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and e) repeating steps a) through d) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
35. The computer program product according to claim 34, wherein the scanning step is accomplished by performing a CT scan of the object.
36. The computer program product according to claim 34, wherein the object includes a bone structure of a patient.
37. The computer program product according to claim 34, further comprising:
- creating a model of the object from multiple pairs of triangulated contours, wherein the multiple pairs of triangulated contours are stacked on top of each other.
38. The computer program product according to claim 37, further comprising:
- closing top and bottom contours of the stacked triangulated contours by using a respective centroid point as an apex of multiple triangles each formed from adjacent points on the respective top and bottom contours.
39. A computer program product executable on a computer and configured to compute a surface shape of an object, the computer program product, when executed on the computer, performing the steps of:
- obtaining a plurality of contour lines by scanning the object to obtain scan data and segmenting the scan data;
- assigning points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines;
- performing a closest orientation triangulation scheme with respect to respective points on two adjacently-positioned contour lines that correspond to first and second contour lines, to determine a first surface shape for a portion of the object corresponding to the first and second contour lines,
- wherein the closest orientation triangulation scheme comprises: a) for each point on the first contour line, determining an orientation of a centroid vector of the point on the first contour line to each contour point on the second contour line; b) determining a closest orientation of the centroid vector of the point on the first contour line to a centroid vector of a point on the second contour line; c) repeating steps a) and b) until a closest orientation for all points on the first contour line have been determined; d) setting a first triangle leg as a line that connects the point on the second contour line that has the closest orientation to the point on the first contour line; e) comparing a first orientation from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second orientation from an adjacent point on the second contour line to the point on the first contour line; f) based on the comparing step, setting a second triangle leg as a line that connects the closest orientation of the first and second orientations, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line; and g) repeating steps d) through f) by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
40. The computer program product according to claim 39, wherein the scanning step is accomplished by performing a CT scan of the object.
41. The computer program product according to claim 39, wherein the object includes a bone structure of a patient.
42. The computer program product according to claim 39, wherein the closest orientation of the centroid vector of the point on the first contour line to the centroid vector of a point on the second contour line is determined by computing a dot product of the centroid vector of the point on the first contour line with a centroid vector of each point on the second contour line, wherein the point on the second contour line having the smallest dot product corresponds to the closest orientation.
43. The computer program product according to claim 39, further comprising:
- creating a model of the object from multiple pairs of triangulated contours, wherein the multiple pairs of triangulated contours are stacked on top of each other.
44. The computer program product according to claim 43, further comprising:
- closing top and bottom contours of the stacked triangulated contours by using a respective centroid point as an apex of multiple triangles each formed from adjacent points on the respective top and bottom contours.
45. An apparatus for reconstructing a surface shape of an object from a plurality of contour lines, comprising:
- a scanner unit configured to obtain the plurality of contour lines by scanning the object to obtain scan data and to segment the scan data;
- an assigning unit configured to assign points to each of the plurality of contour lines obtained from the segmented scan data, wherein each of the contour lines is closed and non-intersecting with respect to others of the contour lines;
- a first triangulation computation unit configured to perform a first triangulation scheme with respect to respective points on two adjacently-positioned contour lines, to determine a first surface shape for a portion of the object corresponding to the two adjacently-positioned contour lines;
- a checking unit configured to check the first surface shape to determine if the first surface shape is in error;
- a second triangulation computation unit configured to perform a second triangulation scheme with respect to the respective points on the two adjacently-positioned contour lines, to determine a second surface shape for the portion of the object corresponding to the two adjacently-positioned contour lines; and
- an output and display unit configured to output and display either the first surface shape as output by the first triangulation computation unit or the second surface shape as output by the second triangulation computation unit, as a reconstructed surface shape for the portion of the object.
46. The apparatus according to claim 45, wherein the first triangulation computation unit performs a shortest distance triangulation, and wherein the second triangulation computation unit performs a closest orientation triangulation.
47. The apparatus according to claim 45, wherein the scanner unit includes a CT scanner.
48. The apparatus according to claim 45, wherein the object includes a bone structure of a patient.
49. The apparatus according to claim 45, further comprising:
- an object model creating unit configured to create a model of the object from multiple pairs of triangulated contours, wherein the multiple pairs of triangulated contours are stacked on top of each other.
50. The apparatus according to claim 49, wherein the object model creating unit creates top and bottom portions of the model by closing top and bottom contours of the stacked triangulated contours by using a respective centroid point as an apex of multiple triangles each formed from adjacent points on the respective top and bottom contours.
51. The apparatus according to claim 45, wherein the checking unit comprises:
- means for determining, for each point on the first contour line, a point on the second contour line that is closest to the point on the first contour line;
- means for setting a first triangle leg as a line that connects the point on the second contour line that is closest to the point on the first contour line;
- means for comparing a first distance from the point on the second contour line to an adjacent point on the first contour line that is adjacent the point on the first contour line, to a second distance from an adjacent point on the second contour line to the point on the first contour line;
- means for setting, based on the comparing step, a second triangle leg as a line that connects the shorter one of the first and second distances, and setting a third triangle leg as a line that connects either the point and the adjacent point on the first contour line, or the point and the adjacent point on the second contour line;
- means for checking the orientation of the centroid vector for the point on the first contour line to the centroid vector for the point on the second contour line, if orientation is larger than 90 degrees, the surface shape is in error, otherwise the surface shape is correct; wherein the orientation is determined by computing a dot product of the centroid vector of the point on the first contour line with the centroid vector of the point on the second contour line, wherein the negative dot product corresponds to the orientation larger than 90 degrees,
- wherein the checking unit performs checking by moving to a next point in either a clockwise direction or a counterclockwise direction on either the first contour line or the second contour line, until all points on the first and second contour lines have been connected to another point on the other of the first and second contour lines.
Type: Application
Filed: Apr 27, 2006
Publication Date: Nov 1, 2007
Patent Grant number: 7623702
Applicant:
Inventors: Louis Arata (Mentor, OH), Min Wu (Davie, FL)
Application Number: 11/411,951
International Classification: G06K 9/00 (20060101);