Patent Application
20250111506
This nonprovisional application is based on Japanese Patent Application No. 2023-167786 filed with the Japan Patent Office on Sep. 28, 2023, the entire contents of which are hereby incorporated by reference.
The present disclosure relates to a data generation method, a non-transitory computer-readable storage medium storing a data generation program, and a data generation apparatus configured to generate image data for checking a state of a biological tissue including a tooth and a gingiva.
A periodontal disease is an infectious inflammatory disease caused by periodontal pathogenic bacteria. The periodontal disease includes diseases caused in the periodontium composed of a gingiva, cementum, a periodontal membrane, and an alveolar bone, necrotizing periodontal diseases, abscesses of the periodontium, combined periodontic-endodontic lesions, gingival recession (for example, lowering of the gingiva), recession of the alveolar bone (for example, lowering of the alveolar bone), and occlusal trauma caused by strong occlusal force or abnormal force. Progress of the periodontal disease causes inflammation of the gingiva, tooth mobility, or recession of the alveolar bone. With progress of recession of the alveolar bone, standing of a tooth becomes unstable and the tooth may come off.
A method of measuring a crown root ratio is used for evaluation of stability of the tooth affected by the periodontal disease. This method uses a ratio between a length of a root portion of a tooth buried in the alveolar bone and a length of a crown portion of the tooth exposed on the outside of the alveolar bone, as an index of evaluation of stability of the tooth. Such a crown root ratio has conventionally usually been measured based on combination of examination of a radiographic image and measurement of a periodontal pocket or the like. For example, Japanese Patent Laying-Open No. 10-174693 discloses examination of a state of a tooth and a gingiva by measurement by an operator such as a dentist, of a depth of a periodontal pocket by insertion of a hand-held probe into the periodontal pocket.
In a method of examination for a periodontal disease disclosed in Japanese Patent Laying-Open No. 10-174693, the probe should be inserted in the periodontal pocket, which imposes great burdens on a patient. In addition, a result of examination for the periodontal disease may vary depending on skills of an operator who measures the depth of the periodontal pocket. The probe is inserted in and taken out of the periodontal pocket where pathogenic bacteria are present. Therefore, when the pathogenic bacteria enter a tooth with minor or no symptom via the probe, the tooth may be infected by the periodontal disease. Furthermore, in measurement of the depth of the periodontal pocket, the patient may feel pain or experience bleeding. When the patient experiences bleeding, the pathogenic bacteria may also enter the blood. When the depth of the periodontal pocket is measured at a plurality of locations of each tooth, a time period for measurement may be long. In measurement of the crown root ratio in the examination of the radiographic image, only a state of the tooth viewed in a direction of incidence of X-rays has been observed and only an image superimposed in the direction of incidence of X-rays has been obtained, and hence it is difficult to accurately measure the crown root ratio.
The present disclosure was made to solve such a problem, and an object thereof is to provide a technique that allows easy and accurate measurement of a crown root ratio.
According to one example of the present disclosure, a data generation method of generating image data for checking a state of a biological tissue including a tooth and a gingiva is provided. The data generation method includes, as processing to be performed by a processing circuitry, a display step of showing on a display, an oral cavity image three-dimensionally showing the inside of an oral cavity including the biological tissue, a spot setting step of setting in the oral cavity image, a first spot indicating a top of a crown portion, a second spot indicating a top of an alveolar bone or a junction between the tooth and the gingiva, and a third spot indicating a root apex portion, based on a user input or machine learning, and a calculation step of calculating a ratio between a first distance between the first spot and the second spot and a second distance between the second spot and the third spot.
According to one example of the present disclosure, a non-transitory computer-readable storage medium storing a data generation program that generates image data for checking a state of a biological tissue including a tooth and a gingiva is provided. The data generation program causes a processing circuitry to perform a display step of showing on a display, an oral cavity image three-dimensionally showing an oral cavity including the biological tissue, a spot setting step of setting in the oral cavity image, a first spot indicating a top of a crown portion, a second spot indicating a top of an alveolar bone or a junction between the tooth and the gingiva, and a third spot indicating a root apex portion, based on a user input or machine learning, and a calculation step of calculating a ratio between a first distance between the first spot and the second spot and a second distance between the second spot and the third spot.
According to one example of the present disclosure, a data generation apparatus that generates image data for checking a state of a biological tissue including a tooth and a gingiva is provided. The data generation apparatus includes a display that shows an image, an input device that receives a user input, and a control device that controls the display based on the user input. The control device is configured to cause the display to show an oral cavity image three-dimensionally showing the inside of an oral cavity including the biological tissue, to set in the oral cavity image, a first spot indicating a top of a crown portion, a second spot indicating a top of an alveolar bone or a junction between the tooth and the gingiva, and a third spot indicating a root apex portion, based on the user input or machine learning, and to calculate a ratio between a first distance between the first spot and the second spot and a second distance between the second spot and the third spot.
The foregoing and other objects, features, aspects and advantages of the present disclosure will become more apparent from the following detailed description of the present disclosure when taken in conjunction with the accompanying drawings.
An embodiment of the present disclosure will be described in detail with reference to the drawings. The same or corresponding elements in the drawings have the same reference characters allotted and description thereof will not be repeated.
An application of a data generation apparatus 1 according to the embodiment will be described with reference to
The “user” includes an operator (a doctor or the like) or an assistant (a dental nurse, a dental technician, a nurse, or the like) in various fields such as dentistry, dental surgery, orthopedics, plastic surgery, and cosmetic surgery. The “subject” includes a patient of dentistry, dental surgery, orthopedics, plastic surgery, and cosmetic surgery. An expression “a user does something” below encompasses an example in which a user gives an execution command to have an apparatus or a program perform processing or operate.
The three-dimensional scanner is what is called an intraoral scanner capable of optically picking up an image of the inside of the oral cavity of a subject by a confocal method or triangulation, and it is capable of obtaining position information of each point in the point group that defines the surface of the biological tissue (for example, the tooth and the gingiva in the oral cavity) set in a certain coordinate space that is to be scanned. Optical imaging and scanning of the inside of the oral cavity is also referred to as intraoral scan (IOS). The user can generate a rendered image (an appearance image) showing a three-dimensional geometry of the biological tissue based on three-dimensional data obtained by the three-dimensional scanner. The “rendered image” is an image generated by processing or edition of certain data. For example, the user can generate a rendered image showing a biological tissue (a part of the biological tissue that can be shown based on IOS data) viewed from a prescribed point of view by processing or edition of three-dimensional data of the biological tissue obtained by the three-dimensional scanner. Furthermore, the user can generate, by varying the prescribed point of view in multiple directions, a plurality of rendered images showing the biological tissue viewed in multiple directions. The rendered image may be a two-dimensional image. The two-dimensional image may be an image obtained by projection of image data on a projection plane for coordinate operation that intersects in a direction of line of sight. For example, the rendered image may be generated as a three-dimensional image that can stereoscopically be observed with a viewer such as general-purpose VR goggles.
The user can also obtain three-dimensional volume (voxel) data of a hard tissue portion (a bone, a tooth, or the like) around a maxilla and a mandible of a subject by imaging the maxilla and the mandible of the subject with a not-shown computed tomography (CT) scanner. The CT scanner is “X-ray equipment” that takes a CT of the maxilla and the mandible of the subject by rotation around the face of the subject, of a transmitter and a receiver of X rays which are a kind of radioactive rays. The user can generate the rendered image (a CT image or an appearance image) showing the three-dimensional geometry of the biological tissue based on volume data obtained by the CT scanner, of the biological tissue which is an imaging target. For example, the user can generate a rendered image showing the biological tissue (a part of the biological tissue that can be shown based on the CT data) viewed from a prescribed point of view by processing or edition of volume data of the biological tissue obtained by the CT scanner. Furthermore, the user can generate, by varying the prescribed point of view in multiple directions, a plurality of rendered images showing the biological tissue viewed from multiple directions. Similarly to the case of the IOS data, the rendered image may be a two-dimensional image or a three-dimensional image.
The three-dimensional data including position information of each point in a point group indicating the surface of the biological tissue, the position information being obtained by the three-dimensional scanner, is also referred to as “IOS data,” and the rendered image generated based on the IOS data is also referred to as an “IOS image” below. The three-dimensional volume data obtained by the CT scanner is also referred to as “CT data” and the rendered image generated based on the CT data is also referred to as a “CT image.” The IOS image can show in a very detailed manner, a surface geometry of the biological tissue to be scanned, whereas it cannot show an internal construction (an alveolar bone, a root apex portion, or the like) that does not appear at the surface of the biological tissue. The CT image can show the hard tissue portion (the bone, the tooth, or the like) of an imaging target relatively in detail, whereas it cannot show a soft tissue portion (the skin, the gingiva, or the like) in a manner as detailed as the hard tissue portion.
The user can generate oral cavity image data by combining the IOS data and the CT data obtained for the same subject. The IOS data and the CT data are different from each other in data format. Therefore, the user generates the oral cavity image data which is combination of the IOS data and the CT data, for example, by converting the data format of the IOS data into the data format of the CT data and subjecting the three-dimensional geometry of the surface of the biological tissue to pattern matching with the use of converted data of both of them. In one embodiment, the user may generate the oral cavity image data by converting the data format of the CT data into the data format of the IOS data and subjecting the three-dimensional geometry of the surface of the biological tissue to pattern matching with the use of converted data of both of them. In one embodiment, the user may generate the oral cavity image data by converting the data formats of the CT data and the IOS data into a common data format and subjecting the three-dimensional geometry of the surface of the biological tissue to pattern matching with the use of converted data of both of them. How to process a data format may be determined on a program side.
The user can generate a rendered image (for example, an oral cavity image shown in
Data generation apparatus 1 may obtain the IOS data from the three-dimensional scanner, obtain the CT data from the CT scanner, and generate the oral cavity image data based on the obtained IOS data and CT data in accordance with a user input. In one embodiment, data generation apparatus 1 may obtain from another apparatus, the oral cavity image data generated by the user with another apparatus, without obtaining the IOS data and the CT data.
The oral cavity image shows based on the CT data, the three-dimensional geometry of the hard tissue portion such as the alveolar bone and the root apex portion and shows based on the IOS data, the three-dimensional geometry of the soft tissue portion such as the gingiva that cannot be shown based on the CT data. The oral cavity image can thus show in detail also the soft tissue portion such as the gingiva that cannot be shown only based on the CT data, owing to supplement by the IOS data, together with the hard tissue portion such as the alveolar bone and the root apex portion.
As shown in
Data generation apparatus 1 may perform segmentation for each anatomical element shown in the oral cavity image, in generating the oral cavity image based on the IOS data and the CT data. For example, segmentation may be various, such as segmentation of each of a hard tissue and a soft tissue, segmentation of each of a maxillary hard tissue and a mandibular hard tissue, segmentation of each of the dentition and the alveolar bone, segmentation of each of the dentition in the maxilla and the dentition in the mandible, and segmentation of each of teeth. For example, data generation apparatus 1 may recognize an area of the dentition in the maxilla, the dentition in the mandible, each tooth included in the dentition in the maxilla, and each tooth included in the dentition in the mandible which are segmented by the user, segment each part of them, and show the part in the oral cavity image, based on the user input.
In one embodiment, data generation apparatus 1 may automatically segment each part based on artificial intelligence (AI) technology, without obeying the user input. For example, data generation apparatus 1 may be provided with an estimation model including a neural network for identification of the dentition in the maxilla, the dentition in the mandible, and each of teeth shown in the oral cavity image, based on the oral cavity image data. The estimation model is trained in machine learning so as to segment the dentition in the maxilla, the dentition in the mandible, and each of teeth shown in the oral cavity image based on the inputted oral cavity image data, with training data in which a plurality of oral cavity images and ground truth data indicating an area of each segmented part shown in each of the plurality of oral cavity images are defined as a set. With such an estimation model, the user can obtain the oral cavity image showing the dentition in the maxilla, the dentition in the mandible, and each of teeth segmented by the estimation model of a control device 10, by inputting the oral cavity image data to data generation apparatus 1.
A configuration of data generation apparatus 1 according to the embodiment will be described with reference to
As shown in
Control device 10 includes a computing device 11, a memory 12, a storage device 13, a display interface 14, an input device interface 15, a storage medium interface 16, and a communication device 17.
Computing device 11 is a computing entity (computer) that performs various types of processing by executing various programs. Computing device 11 is implemented by a processor such as a central processing unit (CPU), a micro processing unit (MPU), a tensor processing unit (TPU), or a graphics processing unit (GPU). Though the processor which represents an exemplary computing device 11 performs functions to perform various types of processing by executing a program, some or all of these functions may be performed by dedicated hardware circuitry such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The “processor” is not limited to a processor in a narrow sense that performs processing in accordance with a stored program architecture like the CPU, the MPU, the TPU, or the GPU, but may encompass hard-wired circuitry such as the ASIC or the FPGA. Computing device 11 is not limited to a von Neumann computer such as the CPU or the GPU but may be implemented by a non von Neumann computer such as a quantum computer or an optical computer. Computing device 11 as described above can also be read as processing circuitry that performs prescribed processing. Computing device 11 may be implemented by a single chip or a plurality of chips. Furthermore, the processor and relating processing circuitry may be implemented by a plurality of computers connected to one another through wires or wirelessly over a local area network or a wireless network. The processor and the relating processing circuitry may be implemented by a cloud computer that performs remote computation based on input data and outputs a result of computation to another device located at a remote position. Execution of various programs by computing device 11 also corresponds to various programs causing computing device 11 to perform various types of processing.
Memory 12 includes a volatile storage area (for example, a working area) where a program code or a work memory is temporarily stored in execution of various programs by computing device 11. Examples of memory 12 include a volatile memory such as a dynamic random access memory (DRAM) or a static random access memory (SRAM) or a non-volatile memory such as a read only memory (ROM) or a flash memory.
Various programs to be executed by computing device 11 or various types of data are stored in storage device 13. Storage device 13 may be implemented by one or more non-transitory computer readable media or one or more computer readable storage media. Examples of storage device 13 include a hard disk drive (HDD) and a solid state drive (SSD).
A data generation program 100 is stored in storage device 13. Contents of data generation processing for generation of oral cavity image data for calculation of the crown root ratio of a tooth and representation of the calculated crown root ratio by computing device 11 are described in data generation program 100.
Display interface 14 is an interface for connection of display 20. Display interface 14 implements input and output of data between control device 10 and display 20. For example, control device 10 causes display 20 to show the oral cavity image based on oral cavity image data through display interface 14.
Input device interface 15 is an interface for connection of input device 30 such as a keyboard 31 and a mouse 32. Input device interface 15 implements input and output of data between control device 10 and input device 30. For example, the user can use input device 30 such as keyboard 31 and mouse 32 to input a desired command through input device interface 15, so as to have control device 10 generate and edit the oral cavity image data based on the command. Inputting by the user to control device 10 through input device 30 or data (command) inputted to control device 10 by the user is also referred to as the “user input.”
Storage medium interface 16 reads various types of data stored in a storage medium 40 such as a removable disc or writes various types of data into storage medium 40. For example, data generation apparatus 1 may obtain data generation program 100 from storage medium 40 through storage medium interface 16 or write oral cavity image data indicating the crown root ratio of the tooth into storage medium 40 through storage medium interface 16. Storage medium 40 may be implemented by one or more non-transitory computer readable media or one or more computer readable storage media. Control device 10 may obtain the IOS data, the CT data, or combined data of the IOS data and the CT data from storage medium 40 through storage medium interface 16.
Communication device 17 transmits and receives data to and from an external apparatus through wired or wireless communication. For example, control device 10 may receive data generation program 100 from an external apparatus through communication device 17 or transmit oral cavity image data indicating the crown root ratio of the tooth to an external apparatus through communication device 17. Control device 10 may obtain the IOS data, the CT data, or combined data of the IOS data and the CT data from an external apparatus through communication device 17.
Exemplary measurement of the crown root ratio by data generation apparatus 1 will be described with reference to
When data generation apparatus 1 sets the measurement direction, it sets a plurality of planes at heights different from one another along the measurement direction, based on the user input. For example, the user uses input device 30 to designate the plurality of planes along the measurement direction in data generation apparatus 1 for each tooth while viewing the oral cavity image. Data generation apparatus 1 sets the plurality of planes designated by the user, based on the user input. The plurality of planes described above include a crown top surface, an alveolar bone top surface, a gingival junction surface, and a root apex surface that are orthogonal to the tooth axis. An image obtained by segmentation of an individual tooth may be used as an image of the tooth shown in the oral cavity image.
The crown top surface is an exemplary “first plane” and passes through a position (for example, the height) of the top of the crown portion in the measurement direction. Data generation apparatus 1 can set a spot (an exemplary “first spot”) indicating the top of the crown portion on the first plane based on the user input. For example, while the user views the oral cavity image, the user uses input device 30 to designate the crown top surface in data generation apparatus 1 such that it passes through the top of the crown portion of each tooth. Data generation apparatus 1 can set the spot indicating the top of the crown portion by setting the crown top surface designated by the user in each tooth based on the user input. Data generation apparatus 1 may directly set the spot indicating the top of the crown portion based on the user input, rather than setting the crown top surface that passes through the top of the crown portion. In other words, the user may directly designate the spot indicating the top of the crown portion in data generation apparatus 1, rather than designating the crown top surface in data generation apparatus 1.
The alveolar bone top surface is an exemplary “second plane” and passes through a position (for example, the height) of the top of the alveolar bone in the measurement direction. Data generation apparatus 1 can set a spot (an exemplary “second spot”) indicating the top of the alveolar bone on the second plane based on the user input. For example, while the user views the oral cavity image, the user uses input device 30 to designate the alveolar bone top surface in data generation apparatus 1 such that it passes through the top of the alveolar bone of each tooth. Data generation apparatus 1 can set the spot indicating the top of the alveolar bone by setting the alveolar bone top surface designated by the user in each tooth based on the user input. Data generation apparatus 1 may directly set the spot indicating the top of the alveolar bone based on the user input, rather than setting the alveolar bone top surface that passes through the top of the alveolar bone. In other words, the user may directly designate the spot indicating the top of the alveolar bone in data generation apparatus 1, rather than designating the alveolar bone top surface in data generation apparatus 1.
The gingival junction surface is an exemplary “second plane” and passes through a position (for example, the height) of the junction (a bottom portion of the periodontal pocket) between the tooth and the gingiva in the measurement direction. Data generation apparatus 1 can set a spot (an exemplary “second spot”) indicating the junction between the tooth and the gingiva on the second plane based on the user input. For example, while the user views the oral cavity image, the user uses input device 30 to designate the gingival junction surface in data generation apparatus 1 such that it passes through the junction between the tooth and the gingiva in each tooth. Data generation apparatus 1 can set the spot indicating the junction between the tooth and the gingiva by setting the gingival junction surface designated by the user in each tooth based on the user input. Data generation apparatus 1 may directly set the spot indicating the junction between the tooth and the gingiva based on the user input, rather than setting the gingival junction surface that passes through the junction between the tooth and the gingiva. In other words, the user may directly designate the spot indicating the junction between the tooth and the gingiva in data generation apparatus 1, rather than designating the gingival junction surface in data generation apparatus 1.
The root apex surface is an exemplary “third plane” and passes through a position (for example, the height) of the root apex portion in the measurement direction. Data generation apparatus 1 can set a spot (an exemplary “third spot”) indicating the root apex portion on the third plane based on the user input. For example, while the user views the oral cavity image, the user uses input device 30 to designate the root apex surface in data generation apparatus 1 such that it passes through the root apex portion of each tooth. Data generation apparatus 1 can set the spot indicating the root apex portion by setting the root apex surface designated by the user in each tooth based on the user input. Data generation apparatus 1 may directly set the spot indicating the root apex portion based on the user input, rather than setting the root apex surface that passes through the root apex portion. In other words, the user may directly designate the spot indicating the root apex portion in data generation apparatus 1, rather than designating the root apex surface in data generation apparatus 1.
When there is no periodontal pocket or the depth of the periodontal pocket is extremely small, the alveolar bone top surface and the gingival junction surface are flush or substantially flush with each other, and a difference between the position of the alveolar bone top surface and the position of the gingival junction surface is smaller than a prescribed threshold value.
Data generation apparatus 1 calculates a distance a along the measurement direction between the crown top surface and the gingival junction surface or the alveolar bone top surface as a crown length, and calculates a distance b along the measurement direction between the gingival junction surface or the alveolar bone top surface and the root apex surface as a root length. The crown length (distance a) is an exemplary “first distance.” The root length (distance b) is an exemplary “second distance.” Furthermore, data generation apparatus 1 calculates a ratio (a:b) between the crown length (distance a) and the root length (distance b) as the crown root ratio.
Calculation of the ratio (a:b) between the crown length (distance a) and the root length (distance b) is suitable when the alveolar bone top surface and the gingival junction surface are expected to be flush or substantially flush. When the alveolar bone top surface and the gingival junction surface are expected to be different, however, data generation apparatus 1 calculates a distance a′ along the measurement direction between the crown top surface and the alveolar bone top surface as the crown length and calculates a distance b′ along the measurement direction between the alveolar bone top surface and the root apex surface as the root length. Furthermore, data generation apparatus 1 calculates a ratio (a′:b′) between the crown length (distance a′) and the root length (distance b′) as the crown root ratio. For example, data generation apparatus 1 may determine whether or not the alveolar bone top surface and the gingival junction surface are flush or substantially flush by conducting pocket measurement.
For example, as shown in
When data generation apparatus 1 sets the tooth axis, the crown top surface, the alveolar bone top surface, and the root apex surface based on the user input, it calculates the distance along the tooth axis between the crown top surface and the alveolar bone top surface as the crown length and calculates the distance along the tooth axis between the alveolar bone top surface and the root apex surface as the root length. In the example in
As shown in
In the example in
Data generation apparatus 1 can thus show on display 20, the biological tissue shown in the oral cavity image, as being zoomed-up. Therefore, the user can set the crown top surface, the alveolar bone top surface, and the root apex surface at the more appropriate positions while viewing the zoomed-up biological tissue shown in the oral cavity image. The user can thus more accurately measure the crown root ratio.
As shown in
When data generation apparatus 1 sets the tooth axis, the crown top surface, the gingival junction surface, and the root apex surface based on the user input, it calculates the distance along the tooth axis between the crown top surface and the gingival junction surface as the crown length and calculates the distance along the tooth axis between the gingival junction surface and the root apex surface as the root length. In the example in
Since data generation apparatus 1 can thus set any of the alveolar bone top surface and the gingival junction surface, the user can measure the crown root ratio with the alveolar bone top surface being defined as a boundary or measure the crown root ratio with the gingival junction surface being defined as the boundary, depending on the state of the tooth and the gingiva.
As shown in
When data generation apparatus 1 sets the tooth axis, the crown top surface, the alveolar bone top surface, and the root apex surface based on the user input, it calculates the distance along the tooth axis between the crown top surface and the alveolar bone top surface as the crown length and calculates the distance along the tooth axis between the alveolar bone top surface and the root apex surface as the root length. In the example in
Data generation apparatus 1 can thus show on display 20, the oral cavity image viewed from a plurality of points of view based on the user input and set the crown top surface, the alveolar bone top surface, the gingival junction surface, and the root apex surface in the oral cavity image viewed from a specific point of view selected from among the plurality of points of view, and show on display 20, the oral cavity image viewed from the plurality of points of view based on the user input and set the first spot, the second spot, and the third spot in the oral cavity image viewed from the specific point of view selected from among the plurality of points of view. Therefore, the user can measure the crown root ratio when the tooth is viewed from any direction.
Processing performed by data generation apparatus 1 according to the embodiment will be described with reference to
As shown in
Data generation apparatus 1 sets the tooth axis in the tooth the crown root ratio of which is to be measured, in the oral cavity image shown on display 20, based on the user input provided through input device 30 (S2). Data generation apparatus 1 sets the crown top surface, the gingival junction surface or the alveolar bone top surface, and the root apex surface that are orthogonal to the tooth axis in the oral cavity image, based on the user input provided through input device 30 (S3). Processing in S3 is an exemplary “spot setting step.” Data generation apparatus 1 performs processing for adding a color in accordance with the ratio between the first distance and the second distance to the measurement target tooth shown in the oral cavity image. Data generation apparatus 1 performs processing for adding a numerical value in accordance with the ratio between the first distance and the second distance to the measurement target tooth shown in the oral cavity image.
Data generation apparatus 1 calculates the crown root ratio based on the crown top surface, the gingival junction surface or the alveolar bone top surface, and the root apex surface (S4). Processing in S4 is an exemplary “calculation step.” Data generation apparatus 1 determines whether or not the crown root ratio is lower than 1/2 (S5). When the crown root ratio is lower than 1/2 (YES in S5), data generation apparatus 1 adds a first color (for example, a green color) in accordance with the crown root ratio to the measurement target tooth shown in the oral cavity image (S6). In other words, in order to show that the crown root ratio has a normal value, data generation apparatus 1 shows the measurement target tooth as being colored with the first color (for example, the green color).
When the crown root ratio is equal to or higher than 1/2 (NO in S5), data generation apparatus 1 determines whether or not the crown root ratio is equal to or higher than 1/2 and lower than 1 (S7). When the crown root ratio is equal to or higher than 1/2 and lower than 1 (YES in S7), data generation apparatus 1 adds a second color (for example, an orange color) in accordance with the crown root ratio to the measurement target tooth shown in the oral cavity image (S8). In other words, in order to call attention because of the crown root ratio being closer to an abnormal value, data generation apparatus 1 shows the measurement target tooth as being colored with the second color (for example, the orange color).
When the crown root ratio is equal to or higher than 1 (NO in S7), data generation apparatus 1 adds a third color (for example, a red color) in accordance with the crown root ratio to the measurement target tooth shown in the oral cavity image (S9). In other words, in order to show that the crown root ratio has the abnormal value, data generation apparatus 1 shows the measurement target tooth as being colored with the third color (for example, the red color).
After processing in S6, S8, or S9, as illustrated in
As set forth above, data generation apparatus 1 can show on display 20, the oral cavity image viewed from the specific point of view selected from among the plurality of points of view and can set the crown top surface, the alveolar bone top surface or the gingival junction surface, and the root apex surface in the oral cavity image, based on the user input. Furthermore, data generation apparatus 1 can calculate the crown root ratio of the measurement target tooth based on the set crown top surface, alveolar bone top surface or gingival junction surface, and root apex surface, add the color in accordance with the calculated crown root ratio to the measurement target tooth, and show on display 20, the numerical value indicating the crown root ratio. The user thus does not have to measure the crown root ratio by calculating a value obtained by measuring the depth of the periodontal pocket or by manually designating a spot in a target shown in a radiographic image and conducting manual measurement, and can easily and accurately measure the crown root ratio of a desired tooth.
The present disclosure is not limited to examples above, but can variously be modified and applied. Modifications applicable to the present disclosure will be described below.
Though data generation apparatus 1 is configured to set the tooth axis manually designated by the user, it may automatically set the tooth axis based on the AI technology or the like, without obeying the user input. For example, data generation apparatus 1 (control device 10) may be provided with a not-shown estimation model for estimation based on the oral cavity image, of the tooth axis of the tooth shown in the oral cavity image. The estimation model is trained in machine learning to estimate the tooth axis of the tooth shown in the oral cavity image based on inputted oral cavity image data, with training data where a plurality of oral cavity images and ground truth data indicating the tooth axis of the tooth shown in each of the plurality of oral cavity images are defined as a set. With the use of such an estimation model, the user can automatically set in the oral cavity image, the tooth axis estimated by the estimation model of control device 10 by inputting oral cavity image data to data generation apparatus 1.
Though data generation apparatus 1 is configured to set the first spot (the crown top surface) indicating the top of the crown portion, the second spot (the alveolar bone top surface or the gingival junction surface) indicating the top of the alveolar bone or the junction between the tooth and the gingiva, and the third spot (the root apex surface) indicating the root apex portion that are manually designated by the user, it may set each spot (each plane) described above automatically based on the AI technology or the like, without obeying the user input. For example, data generation apparatus 1 (control device 10) may be provided with a not-shown estimation model for estimation of the first spot (the crown top surface), the second spot (the alveolar bone top surface or the gingival junction surface), and the third spot (the root apex surface) for the tooth shown in the oral cavity image, based on the oral cavity image. The estimation model is trained in machine learning to estimate the first spot (the crown top surface), the second spot (the alveolar bone top surface or the gingival junction surface), and the third spot (the root apex surface) shown in the oral cavity image, based on the inputted oral cavity image data, with training data where a plurality of oral cavity images and ground truth data indicating the first spot (the crown top surface), the second spot (the alveolar bone top surface or the gingival junction surface), and the third spot (the root apex surface) in the tooth shown in each of the plurality of oral cavity images are defined as a set. With such an estimation model, the user can automatically set in the oral cavity image, the first spot (the crown top surface), the second spot (the alveolar bone top surface or the gingival junction surface) and the third spot (the root apex surface) estimated by the estimation model of control device 10, by inputting the oral cavity image data in data generation apparatus 1.
In one embodiment, the estimation model described above may estimate the first spot (crown top surface) and the third spot (root apex surface) based on a result of measurement using a bounding box. For example, the estimation model has a tooth shown in each of the plurality of oral cavity images surrounded by a three-dimensional bounding box for computation during training. The estimation model is subjected to machine learning to estimate the tooth axis, the first spot, and the third spot with a shape of the bounding box being defined as the reference. For example, the estimation model divides an area occupied by the bounding box in two areas in a predetermined direction, calculates a three-dimensional center of gravity of the tooth in each area, and estimates a straight line that passes through the centers of gravity as the tooth axis. The estimation model may set two areas at predetermined positions, without necessarily dividing the area into two areas. The estimation model may set more than two areas and determine a general center of gravity. The estimation model is subjected to machine learning to set the tooth axis and to estimate a surface at which distance from an end surface on a crown side of the bounding box is the crown top surface and a surface at which distance from an end surface on a root side thereof is the root apex surface. Since image data of the alveolar bone top surface and the gingival junction surface is available for the second spot, the estimation model can estimate the position thereof by using this data.
The configuration of data generation apparatus 1 described above may be provided in X-ray equipment (CT imager). For example, the X-ray equipment includes an imaging unit to image the maxilla and the mandible of a subject. The X-ray equipment may obtain CT data representing the hard tissue portion (the bone, the teeth, or the like) around the maxilla and the mandible of the subject by imaging by the imaging unit, generate the oral cavity image based on the obtained CT data and the IOS data obtained by a three-dimensional scanner, and show the oral cavity image on display 20. Furthermore, the X-ray equipment may set the first spot (the crown top surface), the second spot (the alveolar bone top surface or the gingival junction surface), and the third spot (the root apex surface) in the oral cavity image shown on display 20 based on the user input and calculate the crown root ratio. The crown root ratio may also be calculated by setting the first plane, the second plane, and the third plane, based on the user input.
It should be understood that the embodiment disclosed herein is illustrative and non-restrictive in every respect. The scope of the present disclosure is defined by the terms of the claims rather than the description above and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims. The configuration illustrated in the present embodiments and the configuration illustrated in the modifications can be combined as appropriate.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2023-167786 | Sep 2023 | JP | national |
