The present disclosure relates to an assistance tool that is suitable for imaging an oral cavity of a subject person and assists in the imaging, and an imaging device, a program, and a method for imaging an inner side of the oral cavity using the assistance tool.
Conventionally, it has been known that doctors diagnose, for example, a viral cold or the like by observing a change in a state of an oral cavity of a subject person. Non Patent Literature 1 (Non Patent Literature 1: Miyamoto and Watanabe, “Posterior Pharyngeal Wall Follicles as a Diagnostic Marker of Influenza During Physical Examination: Considering Their Meaning and Value” Journals of Nihon University Medical Association 72 (1): 11-18 (2013)) reports that there is a specific pattern for influenza in lymphatic follicles appearing at a deepest part of a pharynx located inside an oral cavity. The lymphatic follicles having this specific pattern are called influenza follicles, which are a characteristic sign of influenza, and are said to appear about 2 hours after onset. However, such pharynx portion has been diagnosed by the doctors through direct visual inspection, and diagnosis using images has not been made.
Therefore, based on the technology as described above, an object of the present disclosure is to provide an assistance tool that is suitable for imaging an oral cavity of a subject person and assists in the imaging, and an imaging device, a program, and a method for imaging an inner side of the oral cavity using the assistance tool, according to various embodiments.
According to one aspect of the present disclosure, provided is “an assistance tool to be inserted into an oral cavity for imaging an inner side of the oral cavity by an imaging device, the assistance tool including: a main body having a shape; an opening being formed at an end portion of the main body in a direction opposite to a direction where the assistance tool is inserted into the oral cavity in a manner that the imaging device can be inserted into an interior of the main body; a cover being formed at an end portion of the main body in the direction where the assistance tool is inserted into the oral cavity in a manner that light detected by the imaging device can pass through the cover; and a cover collar being formed to connect the main body and the cover in a manner that the cover is disposed at the end portion of the main body in the direction where the assistance tool is inserted into the oral cavity, and in a manner that at least a part of the cover collar is reflected within an angle of view imaged by the imaging device inserted from the opening”.
According to one aspect of the present disclosure, provided is “imaging device configured to be inserted into an interior of a main body of an assistance tool from an opening of the assistance tool, the assistance tool being inserted into an oral cavity for imaging an inner side of the oral cavity, and including: the main body having a shape; the opening being formed at an end portion of the main body in a direction opposite to a direction where the assistance tool is inserted into the oral cavity; a cover being formed at an end portion of the main body in the direction where the assistance tool is inserted into the oral cavity; and a cover collar being formed to connect the main body and the cover in a manner that the cover is disposed at the end portion of the main body in the direction where the assistance tool is inserted into the oral cavity, the imaging device comprising: at least one processor, wherein the at least one processor is configured to execute computer readable instructions so as to: start capturing a subject image by receiving an operation input by a user, and based on the captured subject image, output information indicating that the imaging device is not inserted into the assistance tool in a case where at least a part of the cover collar is not included as a result of determining whether or not at least the part of the cover collar is included in the subject image”.
According to one aspect of the present disclosure, provided is “a computer program product embodying computer readable instructions stored on a non-transitory computer-readable storage medium for causing an imaging device to be inserted into an interior of a main body of an assistance tool from an opening of the assistance tool, the imaging device configured to perform the steps of: starting capturing a subject image by receiving an operation input by a user, and based on the captured subject image, outputting information indicating that the imaging device is not inserted into an assistance tool in a case where at least a part of a cover collar is not included as a result of determining whether or not at least the part of the cover collar is included in the subject image, wherein the assistance tool is inserted into an oral cavity for imaging an inner side of the oral cavity, and includes: the main body in a cylindrical shape; the opening being formed at an end portion of the main body in a direction opposite to a direction where the assistance tool is inserted into the oral cavity; a cover being formed at an end portion of the main body in the direction where the assistance tool is inserted into the oral cavity; and the cover collar being formed to connect the main body and the cover in a manner that the cover is disposed at the end portion of the main body in the direction where the assistance tool is inserted into the oral cavity”.
According to one aspect of the present disclosure, provided is “a method executed by at least one processor, the method for causing the processor in an imaging device to execute a process, the imaging device being inserted into an interior of a main body of an assistance tool from the opening of an assistance tool, the assistance tool being inserted into an oral cavity for imaging an inner side of the oral cavity, and including: the main body in a cylindrical shape; the opening being formed at an end portion of the main body in a direction opposite to a direction where the assistance tool is inserted into the oral cavity; a cover being formed at an end portion of the main body in the direction where the assistance tool is inserted into the oral cavity; and a cover collar being formed to connect the main body and the cover in a manner that the cover is disposed at the end portion of the main body in the direction where the assistance tool is inserted into the oral cavity, the method comprising the computer readable instructions on the processor the steps of: starting capturing a subject image by receiving an operation input by a user, and outputting information indicating that the imaging device is not inserted into the assistance tool in a case where at least a part of the cover collar is not included as a result of determining whether or not at least the part of the cover collar is included in the subject image based on the captured subject image”.
According to the present disclosure, it is possible to provide the assistance tool that is suitable for imaging the oral cavity of the subject person and assists in the imaging, and the imaging device, the program, and the method for imaging the inner side of the oral cavity using the assistance tool.
Note that the above effects are merely exemplary for convenience of description, and are not restrictive. In addition to or instead of the above effects, any effect described in the present disclosure or any effect obvious to a person skilled in the art can also be exhibited.
Various embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that common components in the drawings are denoted by the same reference numerals.
The processing system 1 according to the present disclosure is mainly used to obtain a subject image in which an inner portion of an oral cavity of a subject person is imaged. In particular, the processing system 1 is used to image a back of a throat area of the oral cavity, specifically, a pharynx. Accordingly, in the following description, a case where the processing system 1 according to the present disclosure is used for imaging the pharynx will be mainly described. However, the pharynx is merely an example of a site to be imaged, and as a matter of course, the processing system 1 according to the present disclosure can be suitably used for other sites such as tonsils in the oral cavity.
The processing system 1 according to the present disclosure is used to determine a possibility of contracting a predetermined disease from a subject image obtained by imaging a subject including at least a pharyngeal area of the oral cavity of the subject person, and to diagnose or assist the diagnosis for the predetermined disease. An example of the disease determined by the processing system 1 is influenza. Usually, the possibility of contracting the influenza is diagnosed by examining the pharynx or a tonsil area of the subject person or determining presence or absence of findings such as follicles in the pharyngeal area. However, it is possible to perform the diagnosis or the assistance of the diagnosis by determining the possibility of contracting the influenza using the processing system 1 and outputting a result of the determination. Note that the determination of the possibility of contracting the influenza is an example. The processing system 1 can be suitably used to determine any disease in which differences appear in findings in the oral cavity due to the contracting. Note that the difference in the findings are not limited to those found by a doctor or the like, and medically known to exist. For example, a difference that can be recognized by a person other than a doctor or a difference that can be detected by artificial intelligence or image recognition technology can be suitably applied to the processing system 1. Examples of such disease include, in addition to the influenza, a hemolytic streptococcal infection, an adenovirus infection, an EB virus infection, a mycoplasma infection, infections such as a hand, foot and mouth disease, herpangina and candidiasis, diseases exhibiting vascular disorders or mucosal disorders such as arteriosclerosis, diabetes and hypertension, and tumors such as oral cancer, tongue cancer and pharyngeal cancer.
Note that, in the present disclosure, terms such as “determination” and “diagnosis” for a disease are used, but these terms do not necessarily mean a definite determination or diagnosis by a doctor. For example, it is also possible to naturally include determination and diagnosis with a processing device 100 included in the processing system 1 with the processing system 1 of the present disclosure used by the subject person himself/herself or used by a user other than a doctor.
Further, in the present disclosure, the subject person to be imaged by the imaging device 200 can include any human such as a patient, an examinee, a diagnostic user, and a healthy person. Further, in the present disclosure, a user who holds the imaging device 200 and performs imaging operation is not limited to a medical worker such as a doctor, a nurse, or a laboratory technician, and can include any human such as the user himself/herself. The processing system 1 according to the present disclosure is typically assumed to be used in a medical institution. However, the present disclosure is not limited to this case, and the place for using the processing system may be any place such as the user's home, school, or workplace.
Further, in the present disclosure, each of the subject person and the user is merely used as a term for distinguishing each of the humans, and the subject person and the user may be different from each other or may be the same. In other words, in a case where a person captures an image of an inner side of his/her oral cavity using the imaging device, the person can be both the subject person and the user.
Further, in the present disclosure, as described above, the subject may include at least a part of the oral cavity of the subject person. Further, the disease to be determined may be any disease in which differences appear in the findings in the oral cavity. However, in the following description, a case will be described in which the subject includes the pharynx or a pharyngeal area and the possibility of contracting the influenza as the disease is determined.
Further, in the present disclosure, the subject image or a determination image may be one or a plurality of moving images or one or a plurality of still images. As examples of operations, if a power button is pressed down, a through image is fetched by a camera, and the captured through image is displayed on a display 203. Thereafter, if a capture button is pressed down by the user, the one or the plurality of still images are captured by the camera, and the captured image is displayed on the display 203. Alternatively, if the capture button is pressed down by the user, capture of a moving image is started, and the image being captured by the camera during that period is displayed on the display 203. Then, if the capture button is pressed down again, the capture of the moving image ends. In this way, in a series of the operations, various images such as the through image, the still image, and the moving image are captured by the camera, and displayed on the display. Moreover, there may be a processed image obtained by subjecting the subject images or the determination images to various image processes for the display and the process according to the present disclosure. However, the subject images and the determination images do not refer to only a specific image among these images, but can include all of these images captured by the camera. Further, such subject images do not all need to include at least a part of the oral cavity, and as described above, there is also a case where at least the part of the oral cavity is not included in the through image or the like.
The captured subject image (typically, an image including the pharynx 715) is transmitted from the imaging device 200 to the processing device 100 communicably connected via a wired or wireless network. The processor of the processing device 100 that has received the subject image processes a program stored in a memory, to select the determination image to be used for the determination from the subject images, and determine the possibility of contracting the predetermined disease using the determination image. Then, a result is output to the display or the like.
Further, if the user 600 holds the grip 202 in a direction where the subject image is displayed in a normal direction on the display 203, a capture button 220 is configured to be disposed on an upper surface side of the grip. Therefore, when the user 600 holds the grip, the user 600 can easily press down the capture button 220 with an index finger or the like.
The distal end of the imaging device 200 is inserted into the oral cavity of the subject person to image the inner side of the oral cavity, particularly the pharynx. A specific process thereof will be described later. The captured subject image is transmitted to the processing device 100 via the wired or wireless network.
Note that the processing system 1 can further include a mounting table 400 as necessary. The imaging device 200 can be stably mounted on the mounting table 400. Further, the mounting table 400 is connected to a power source via a wired cable, whereby power can be supplied from a power supply terminal of the mounting table 400 to the imaging device 200 through a power supply port of the imaging device 200.
The processing system 1 according to the present disclosure includes the imaging device 200 that captures an image to be processed by the processing device 100.
According to
The main body 201 is formed in a columnar shape as a hollow cylindrical shape with a cross section being a perfect circle. A wall portion 224 may be made of any material as long as the material can guide the light into the wall portion, and as an example, the wall portion can be obtained using a thermoplastic resin. As the thermoplastic resin, polyolefin-based resins such as a chain polyolefin-based resin (a polypropylene-based resin or the like) and a cyclic polyolefin-based resin (a norbornene-based resin or the like), cellulose ester-based resins such as triacetyl cellulose and diacetyl cellulose, polyester-based resins, polycarbonate-based resins, (meth) acrylic resins, polystyrene-based resins, or mixtures and copolymers thereof are used. In other words, the wall portion 224 of the main body 201 functions as a light guide body for guiding the light emitted from the light source into the oral cavity or toward a direction of a diffusion plate.
Since the main body 201 is formed in a hollow shape, an accommodation space 223 is formed therein with the wall portion 224. A camera 211 is accommodated in the accommodation space 223. Note that the main body 201 only needs to be formed in a columnar shape with the accommodation space 223. Accordingly, the accommodation space 223 does not need to have a cylindrical shape with a cross section being a perfect circle, and may have an elliptical or polygonal cross section. Further, an inner portion of the main body 201 does not necessarily need to be formed hollow.
A distal end of the grip 202 is connected to the proximal end 225 of the main body 201. The user holds the grip 202, and performs operations such as insertion and removal of the imaging device 200. The grip 202 is formed in a columnar body having a predetermined length in the direction substantially parallel to the insertion direction H in the oral cavity, that is, along a longitudinal direction of the main body 201, and disposed on the same straight line as the main body 201 in the direction H. Note that, in the present embodiment, a cross section of the grip 202 in a vertical direction is formed to be substantially elliptical, but the cross section is not necessarily elliptical, and may be a perfect circle, an ellipse, or a polygon.
In the grip 202, a connecting portion 230 is formed at a position closest to the proximal end 225 of the main body 201, and the grip 202 is connected to the main body 201 with the connecting portion 230 therebetween. Engagement protrusions 217 (217-1 to 217-4) for positioning the assistance tool 300 and a positioning protrusion 218 are formed on an outer periphery of the connecting portion 230. The engagement protrusions 217 engage with engagement protrusions 318 (318-1 to 318-4) formed on the assistance tool 300. Further, the positioning protrusion 218 is inserted into an insertion hole 330 formed in the assistance tool 300 to position the imaging device 200 and the assistance tool 300 with respect to each other. Note that, in the present embodiment, as the engagement protrusions 217 of the main body 201, four engagement protrusions (the engagement protrusions 217-1 to 217-4) in total are arranged at equal intervals on a surface of the grip 202 at a position close to the proximal end 225 of the main body 201. Further, one positioning protrusion 218 is disposed between the engagement protrusions 217 on the surface of the grip 202 at the position close to the proximal end 225 of the main body 201. However, the present disclosure is not limited thereto, and it is also possible to dispose only one of the engagement protrusions 217 and the positioning protrusion 218. Further, the number of the engagement protrusions 217 and the positioning protrusion 218 may be one or more, and may be any number.
Further, the grip 202 includes the capture button 220 at a position close to the proximal end 225 of the main body 201 on the upper surface of the grip, that is, near the distal end of the grip 202 in the insertion direction H in the oral cavity. In this way, when the user 600 holds the grip, the user 600 can easily press down the capture button 220 with the index finger or the like. Further, a power button 221 is disposed on the upper surface of the grip 202 at a position close to the display 203, that is, at a position opposite to the capture button 220 of the grip 202. In this way, it is possible to prevent the power button 221 from being erroneously pressed down when the user 600 holds the grip and performs the imaging.
The display 203 has a substantially rectangular parallelepiped shape as a whole, and is disposed on the same straight line as the main body 201 in the direction H. Further, the display 203 includes a display panel on a surface in a direction (that is, a direction toward the user) opposite to the insertion direction H in the oral cavity. Accordingly, the display 203 is formed in a manner that a surface including the display panel is substantially perpendicular to the longitudinal direction of the main body 201 and the grip 202 formed to be substantially parallel to the insertion direction H in the oral cavity. Then, the display is connected to the grip 202 on a side opposite to the oral cavity of the grip 202 on a surface facing the surface including the display panel. Note that a shape of the display is not limited to the substantially rectangular parallelepiped shape, and may be any shape such as a cylindrical shape.
Here, the imaging device 200 can be mounted in a perpendicular direction so that the surface including the display panel is in contact with a mounting surface. Therefore, at least an outer periphery of the surface including the display panel of the display 203 is formed on a substantially plane suitable for the mounting.
A diffusion plate 219 is disposed at the distal end 222 of the main body 201, and diffuses the light emitted from the light source 212 and passing through the main body 201 toward the inner side of the oral cavity. The diffusion plate 219 has a shape corresponding to a cross-sectional shape of a portion of the main body 201 capable of guiding the light. In the present embodiment, the main body 201 is formed in a hollow cylindrical shape. Accordingly, a cross section of the diffusion plate 219 is also formed in a hollow shape corresponding to that shape.
The camera 211 is used to generate the subject image by detecting reflected light diffused from the diffusion plate 219, emitted into the oral cavity, and reflected on the subject. The camera 211 is disposed on the same straight line as the main body 201 in the direction H inside the wall portion 224 of the main body 201, that is, in the accommodation space 223 formed inside the main body 201. Note that although only one camera 211 is described in the present embodiment, the imaging device 200 may include a plurality of cameras. By generating the subject image using the plurality of cameras, the subject image includes information related to a three-dimensional shape. Further, in the present embodiment, the camera 211 is disposed in the accommodation space 223 of the main body 201, but the camera 211 may be disposed at the distal end 222 of the main body 201 or on the main body 201 (may be inside the main body 201 or on an outer periphery of the main body 201).
In the present embodiment, the assistance tool 300 is manufactured by integral molding of a resin. However, the assistance tool may be manufactured by other materials such as paper, cloth, and metal, or a combination thereof. Further, the assistance tool 300 is desirably a disposable type, but may be a reusable type. Examples of such resin include the thermoplastic resin. As the thermoplastic resin, the polyolefin-based resins such as the chain polyolefin-based resin (the polypropylene-based resin or the like) and the cyclic polyolefin-based resin (the norbornene-based resin or the like), the cellulose ester-based resins such as the triacetyl cellulose and the diacetyl cellulose, the polyester-based resins, the polycarbonate-based resins, the (meth) acrylic resins, the polystyrene-based resins, vinyl-based resins, nylon-based resins, polyurethane, fluorine-based resins or mixtures and copolymers thereof are used. Note that, in the present embodiment, it is preferable to configure the assistance tool 300 that is easily deformed according to selection of a material or a thickness of the material during processing. With such configuration, it is possible to easily dispose the assistance tool 300, for example, in a case where the assistance tool is the disposable type as described above.
According to
Since the main body 312 is formed to cover at least a part of the main body 201 on the distal end 222 side of the imaging device 200 inside thereof, the main body is formed in a cylindrical shape having a predetermined length along the direction H that is the direction where the assistance tool 300 is inserted into the oral cavity, corresponding to the length of the main body 201. Then, an opening 320 for inserting the imaging device 200 is disposed on the proximal end 316 side, and a cover 313 for passing irradiation light from the light source 212 of the imaging device 200 and reflected light from the subject is disposed on the distal end 314 side. Note that, in the present embodiment, the assistance tool 300 is inserted into the oral cavity from the distal end 314.
Further, in the present embodiment, the main body 201 of the imaging device 200 has a substantially constant inner diameter and outer diameter from the proximal end 225 to the distal end 222. Accordingly, the main body 312 of the assistance tool 300 is also correspondingly shaped so that the inner diameter and the outer diameter are substantially constant along the longitudinal direction. Note that a cross-sectional shape of the main body 312 is preferably formed corresponding to a cross-sectional shape of the main body 201 of the imaging device 200, but may be any shape as long as the main body 201 can be inserted, and may be any shape such as a perfect circle, an ellipse, or a polygon.
The pair of gripping plates 311 is formed along the proximal end 316 of the main body 312, to extend toward an outer side of the main body 312 in the direction perpendicular or substantially perpendicular to a direction (that is, the direction H) where the assistance tool 300 is inserted into the oral cavity. In other words, with this configuration, the gripping plates 311 are used to be held by a hand when the user inserts the assistance tool 300 into the oral cavity of the subject person. In the present embodiment, when the assistance tool 300 is inserted into the oral cavity, surfaces on distal end sides of the gripping plates 311 are in contact with lips of the subject person or the like, and thus the gripping plates also function as a restricting member for restricting further insertion of the assistance tool 300 and is capable of preventing aspiration. Further, since the gripping plates 311 are formed to extend outward, it is possible to prevent the assistance tool 300 itself from rolling on a floor surface or the like. Note that, in the present embodiment, the pair of gripping plates 311 is disposed on the proximal end 316 side of the main body 312 to be symmetric in an up-and-down direction, but may be formed in a doughnut shape along the proximal end 316 of the main body 312, and may have any shape.
The tongue depressor 315 is disposed at a lower portion of the main body 312 (a side in a lingual direction in the oral cavity), and is formed on a blade toward the lingual direction. During the imaging with the imaging device 200, the tongue of the subject person moves in front of the imaging device 200, whereby the imaging in the oral cavity is inhibited. The tongue depressor 315 pushes the tongue downward to restrict movement of the tongue in the oral cavity and prevent the tongue from being located in front of the imaging device 200. Accordingly, in the present embodiment, the tongue depressor 315 is formed in a blade shape, but may have any shape as long as this function can be implemented.
Further, a mechanism for positioning when the imaging device 200 is inserted from the proximal end 316 side is disposed on the proximal end 316 side of the main body 312. Specifically, the main body 312 includes a pair of grooves 319 formed in a predetermined length in a direction perpendicular to the outer periphery of the main body 312, pieces 317 thus formed, the engagement protrusions 318 respectively disposed on the pieces 317 and formed to engage with each of the engagement protrusions 217 disposed at the distal end of the grip 202 of the imaging device 200, and the insertion hole 330 into which the positioning protrusion 218 of the grip 202 is inserted.
The engagement protrusions 318 are disposed at a position corresponding to each of the engagement protrusions 217 disposed on the grip 202 of the imaging device 200 to protrude in a direction toward an interior of the main body 312. Accordingly, in the present embodiment, four engagement protrusions 318-1 to 318-4 are arranged at positions corresponding to the four engagement protrusions 217-1 to 217-4. Further, the insertion hole 330 is disposed at a position corresponding to the positioning protrusion 218 disposed on the grip 202 of the imaging device 200. Accordingly, in the present embodiment, one insertion hole 330 is disposed at a position corresponding to one positioning protrusion 218.
Next, if the imaging device 200 is inserted beyond the engagement protrusions 318 of the assistance tool 300, the positioning protrusion 218 disposed on the grip 202 of the imaging device 200 to protrude outward is inserted into the insertion hole 330 of the assistance tool 300. Then, the positioning protrusion 218 of the imaging device 200 is in contact with a wall surface of the insertion hole 330 formed on the distal end 314 side. In this way, the imaging device 200 is restricted without being further inserted in a direction of the distal end 314 of the assistance tool 300.
In other words, in the present embodiment, in a state where the imaging device 200 is completely inserted into the assistance tool 300, movement of the imaging device 200 in the direction where the imaging device 200 is inserted is restricted by the positioning protrusion 218 and the insertion hole 330, and movement of the imaging device 200 in a direction opposite to the direction, that is, in a direction where the imaging device 200 is removed is restricted by the engagement protrusions 217 and the engagement protrusions 318. Such positioning protrusion 218 and insertion hole 330 are installed, in a circumferential direction of the imaging device 200 and the assistance tool 300, preferably at one location or asymmetrically in a case of being installed at a plurality of locations. With such installation, it is possible to restrict a circumferential position and movement of the assistance tool 300 with respect to the imaging device 200. In other words, an up-and-down direction of the imaging device 200 and an up-and-down direction of the assistance tool 300 can be always kept constant, and for example, the tongue depressor 315 can be installed to be always located below the display 203 of the imaging device 200.
Here,
Further, in the assistance tool 300 into which the imaging device 200 having the notifier 226 is inserted, a notification window 322 is included near the gripping plates 311 on the proximal end 316 side. As an example, the notification window 322 may be formed as a through hole penetrating the assistance tool 300 in a thickness direction, or may be made of a material having a higher transmittance of the light emitted from the notifier 226 with respect to a peripheral area thereof. Conversely, in the assistance tool 300, an area excluding the notification window 322 and the cover 313 (
Moreover, in a state where the imaging device 200 is inserted from the opening of the assistance tool 300, and the notifier 226 and the notification window 322 are positioned with respect to each other by the engagement protrusions 217 of the imaging device 200 and the engagement protrusions 318 of the assistance tool 300, the notifier and the notification window are positioned to vertically overlap with each other. In other words, in such state, the notification window 322 of the assistance tool 300 is disposed at a position facing a disposition position of the notifier 226 of the imaging device 200, whereby the light emitted from the notifier 226 can be visually recognized through the notification window 322. In this way, the user can visually check that the assistance tool is attached to the imaging device 200.
Note that, in the example of
According to
Further, the assistance tool 300 includes the cover 313 through which the light detected by the imaging device 200 can pass at the distal end 314 which is the end portion in the direction where the assistance tool 300 is inserted into the oral cavity. Such cover 313 is formed along the cross-sectional shape of the main body 312 in a direction perpendicular to a direction where the assistance tool 300 is inserted into the oral cavity. Note that naturally, the shape is not limited to a shape along the cross-sectional shape of the main body 312. Any shape may be used as long as the shape does not excessively inhibit the imaging of the subject image by the imaging device 200.
The assistance tool 300 includes a cover collar 321 that is disposed around the cover 313 and connects the main body 312 and the cover 313, so that such cover 313 is disposed at the end portion in the direction where the assistance tool 300 is inserted into the oral cavity. A shape of the cover collar on a side in contact with the main body 312 is formed in a shape along the cross section of the main body 312, and the shape of the cover collar on a side in contact with the cover 313 is formed in a shape along an outer shape of the cover 313. Such cover collar 321 is not necessarily formed as a component clearly distinguishable from the main body 312 or the cover 313, and may refer to an area in contact with the cover 313 as a portion of the main body 312 or an area in contact with the main body 312 as a part of the cover 313.
In a case where the imaging device 200 is inserted into and positioned with respect to the assistance tool 300, the cover collar 321 has, in at least a part thereof, an appearing-in-image area that is included within an angle of view captured by the imaging device 200. In an example of
Here,
Note that, as illustrated in
Returning to
Note that, in examples of
According to
The antifogging agent has a function of imparting an antifogging property by forming a coating layer on the outer surface or the inner surface of the cover 313 by laminating the antifogging agent to improve wettability. Such antifogging agent is not particularly limited to those exemplified below, but an antifogging agent of a silicon-based material, a high-molecular type or low-molecular type hydrophilic material (for example, a nonionic antifogging agent containing, as a main component, sucrose fatty acid ester, glycerin fatty acid ester, polyglycerin fatty acid ester, sorbitan fatty acid ester, polyoxyethylene alkyl ether, polyoxyethylene alkylphenyl ether, a polyoxyethylene polyoxypropylene block copolymer, polyethylene glycol fatty acid ester, polyoxyethylene sorbitan fatty acid ester, polyoxyethylene glycerin fatty acid ester, polyoxyethylene polyglycerin fatty acid ester, fatty acid alkanolamide, or a combination thereof; and an amphoteric antifogging agent containing, as a main component, an alkyl betaine such as lauryldimethylaminoacetic acid betaine or stearyldimethylaminoacetic acid betaine, fatty acid amidopropyl betaine such as cocamidopropyl betaine, alkyl imidazole such as 2-alkyl-N-carboxymethyl-N-hydroxyethylimidazolinium betaine, amino acid such as sodium lauroyl glutamate, amine oxide such as lauryl dimethylamine N-oxide or oleylemethylamine N-oxide, or a combination thereof) typified by a surfactant, an MCP polymer-based antifogging agent, or a combination thereof is appropriately used.
Such antifogging agent may be applied to the cover 313 in advance or may be applied later. Further, the present disclosure is not limited to a case of applying a liquid antifogging agent, and a sheet-like material on which the antifogging agent is laminated in advance may be laminated.
Here, even in a case where the antifogging agent is laminated on the cover 313 or in a case where only the cover 313 is used without laminating the antifogging agent, an iridescent interference pattern may be generated under influence of the light emitted from the imaging device 200, light reflected on the subject, or the like, and may adversely affect the imaging by the imaging device 200. Therefore, as illustrated in (a) and (b) of
Further, by inserting the cover 313 into the oral cavity, as described above, the assistance tool is affected by the exhalation of the subject person, a smooth water film is formed on the antifogging agent or the surfaces of the cover 313, and thus an iridescent pattern or the like may be generated and adversely affect the imaging. Therefore, it is desirable that irregularities exist at predetermined intervals or randomly on a boundary surface of the antifogging agent or the cover, and the light is diffusely reflected. Specifically, it is desirable to form the irregularities at the predetermined intervals or randomly as described above in a boundary surface between the antifogging agent and the water film formed by the exhalation, a boundary surface between the antifogging agent and the cover 313, a boundary surface between the cover 313 and the water film formed by the exhalation (in a case where the antifogging agent is not applied), or a combination thereof. As an example, a coating layer 326 laminated by applying the antifogging agent to a surface of the base material of the translucent resin layer 327 may be formed on the cover 313, and recesses 325 may be arranged at predetermined intervals or randomly on a surface of the coating layer 326. An interval between two of the recesses 325 is, on average, an interval wider than a wavelength band of the light detected by the imaging device 200 (for example, a wavelength band of red light of 830 nm or more), and more preferably an interval wider than twice the wavelength band. By forming the recesses 325 at such intervals, it is possible to prevent the generation of the interference pattern due to diffuse reflection of the light.
Further, a thickness of the coating layer 326 can be adjusted based on a coherence length calculated from the wavelength band of the light detected by the imaging device 200, and is preferably 10 μm or more as an example.
Note that, in an example of
Further, in
Here,
At this time, the wall portion 224 of the main body 201 has a function of guiding the light emitted from the light sources 212-1 to 212-4 to the diffusion plate 219 as described above, and may have a first polarizing plate 233 at a part or an end portion of the wall portion. Further, the sensor of the camera 211 is disposed in the accommodation space 223 formed by the wall portion 224 of the main body 201, and the imaging device 200 may have a second polarizing plate 234 on the subject side than the sensor. At this time, the first polarizing plate 233 and the second polarizing plate 234 are arranged to make their polarization axes orthogonal to each other at 90°. In this way, it is possible to suppress reflection of the light sources 212-1 to 212-4 due to regular reflected light (linearly polarized light) generated when light incident on the subject via the first polarizing plate 233 is reflected by the subject, and it is possible to obtain a better subject image.
The positioning mechanism 329 includes the gripping plate 311 formed to extend toward the outer side of the main body 312 in a direction perpendicular or substantially perpendicular to the direction where the assistance tool 300 is inserted into the oral cavity, a positioning piece 331 for positioning the imaging device 200 and the assistance tool 300, and connecting pieces 328 (a connecting piece 328a to a connecting piece 328d) for connection to the main body 312. Each of the connecting pieces 328 has one end connected to a main body portion of the positioning mechanism 329, and the other end connected to the main body 312, thereby connecting the positioning mechanism 329 and the main body 312. Here, as illustrated in
Here,
If the imaging device 200 is inserted into the assistance tool 300 and positioned by the positioning piece 331, it is difficult to remove the assistance tool 300 from the imaging device 200 due to fitting between the projection on the imaging device 200 side and the recess 331b of the positioning piece 331. Therefore, the user applies a load to the positioning mechanism 329 by pushing the gripping plates 311 of the positioning mechanism 329 in a direction F. Accordingly, the connecting piece 328a to the connecting piece 328d in which the notch 333a and the notch 333b and the thin-walled area 332 are formed are deformed or cut, whereby the positioning mechanism 329 connected to the main body 312 rises upward, and the fitting between the projection on the imaging device 200 side and the recess 331b of the positioning piece 331 is released.
Note that, in an example of
According to
Further, according to
Note that, in the example of
In the imaging device 200, the camera 211 functions as an imaging unit that generates the subject image by detecting the reflected light reflected on the oral cavity which is the subject. In order to detect the light, the camera 211 includes, as an example, a CMOS image sensor, a lens system, and a drive system for implementing a desired function. The image sensor is not limited to the CMOS image sensor, and other sensors such as a CCD image sensor can also be used. Further, it is also possible to additionally use an imaging element according to a band of the reflected light to be detected. Although not specifically illustrated, for example, the camera 211 can have an autofocus function, and it is preferable that a focus of the camera be set, for example, on the front of the lens to match a specific site. In the camera, the CMOS image sensor, which is the imaging element that detects a wavelength in a near-infrared light band from a wavelength in a visible light band, and a sensor, which is an infrared light imaging element that detects a wavelength in an infrared light band may be arranged adjacent to each other on an image sensor substrate. Further, the camera 211 can have a zoom function, and is preferably set to performing the imaging at an appropriate magnification according to a size of the pharynx or the influenza follicle.
Here, it has been known that there is the specific pattern for the influenza in the lymphatic follicles appearing at the deepest part of the pharynx located inside the oral cavity. The lymphatic follicles having this specific pattern are called the influenza follicles, which are the characteristic sign of the influenza, and are said to appear about 2 hours after the onset. As described above, the processing system 1 of the present embodiment is used to determine the possibility of the subject person contracting the influenza by imaging the pharynx of the oral cavity and detecting the above follicles, for example. Therefore, if the imaging device 200 is inserted into the oral cavity, a distance between the camera 211 and the subject becomes relatively short. Accordingly, the camera 211 preferably has an angle of view (2θ) at which a value calculated by [(distance from the distal end portion of the camera 211 to a rear wall of the pharynx)*tan θ] is 20 mm or more in a vertical direction and 40 mm or more in a horizontal direction. By using the camera having such angle of view, even if the camera 211 and the subject are close to each other, it is possible to image a wider range. In other words, as the camera 211, a normal camera can be used, but a camera called a wide-angle camera or a super-wide-angle camera can also be used.
The light source 212 is driven by an instruction from the processing device 100 or the imaging device 200, and functions as a light source unit for irradiating the oral cavity with the light. The light source 212 includes one or a plurality of light sources 212. In the present embodiment, the light source 212 includes one or a plurality of LEDs, and light having a predetermined frequency band is emitted from each of the LEDs in a direction of the oral cavity. As the light source 212, light having a desired band among an ultraviolet light band, a visible light band, and an infrared light band, or a combination thereof is used. In a case of irradiating a plurality of bands, the plurality of LEDs set in advance to emit the light in each of the bands are switched to display.
The processor 213 functions as a control unit that controls other components of the imaging device 200 based on a program stored in the memory 214. The processor 213 controls driving of the camera 211 and driving of the light source 212 based on the program stored in the memory 214, and controls storage of the subject image captured by the camera 211 in the memory 214. Specifically, the processor 213 executes, a process of starting capturing the subject image by receiving an operation input by the user, a process of determining whether or not at least a part of the cover collar 321 of the assistance tool 300 is included in the subject image based on the captured subject image, a process of outputting information indicating that the imaging device 200 is not inserted into the assistance tool 300 in a case where a determination result is that at least a part of the cover collar 321 of the assistance tool 300 not included, and the like. The processor 213 mainly includes one or a plurality of CPUs, and may be appropriately combined with other processors.
The memory 214 includes a RAM, a ROM, a nonvolatile memory, an HDD, and the like, and functions as a storage unit. The memory 214 stores, as a program, instruction commands for various control operations of the imaging device 200. Specifically, the memory 214 stores a program for executing the process of starting capturing the subject image by receiving the operation input by the user, the process of determining whether or not at least a part of the cover collar 321 of the assistance tool 300 is included in the subject image based on the captured subject image, the process of outputting information indicating that the imaging device 200 is not inserted into the assistance tool 300 in the case where a determination result is that at least a part of the cover collar 321 of the assistance tool 300 is not included, and the like.
The display panel 215 is disposed on the display 203, and functions as a display unit for displaying the subject image captured by the imaging device 200 and the information indicating that the imaging device 200 is not inserted into the assistance tool 300. The display panel 215 includes a liquid crystal panel, but is not limited to the liquid crystal panel, and may include an organic EL display, a plasma display, or the like.
The input interface 210 functions as an input unit that receives an instruction input of the subject person to the processing device 100 and the imaging device 200. Examples of the input interface 210 include physical key-buttons such as a “capture button” for instructing start/end of recording by the imaging device 200, a “power button” for turning on/off the power of the imaging device 200, a “confirmation button” for performing various selection operations, a “return/cancel button” for returning to a previous screen or canceling an input confirmation operation, and a cross key-button for moving an icon or the like displayed on the display panel 215. Note that these various buttons/keys may be physically prepared, or may be displayed as an icon on the display panel 215 and selectable using a touch panel or the like arranged as the input interface 210 in a superimposed manner on the display panel 215. A method of detecting the instruction input of the subject person by the touch panel may be any method such as a capacitance type or a resistive film type.
The communication interface 216 functions as a communication unit for transmitting and receiving information to and from the processing device 100 and/or other devices. Examples of the communication interface 216 include various elements, for example, a connector for wired communication such as a USB and an SCSI, a transmission/reception device for wireless communication such as a wireless LAN, Bluetooth (registered trademark), and an infrared ray, and various connection terminals for a printed mounting board and a flexible mounting board.
According to
Meanwhile, if the processor 213 determines that the input by the user is received, the processor outputs a standby screen to the display panel 215 (S212). The standby screen (not illustrated) includes a through image captured via the camera 211. Then, the processor 213 receives the operation input by the user via the input interface 210, and receives selection of information for specifying the subject person with the oral cavity to be imaged (S213). If the subject person to be imaged is selected, the processor 213 outputs the standby screen to the display panel 215 again (S214).
Next, the user covers the distal end of the imaging device 200 with the assistance tool 300, and inserts the imaging device 200 into the oral cavity of the subject person to a predetermined position. Then, the processor 213 determines whether or not the assistance tool 300 is attached to the imaging device 200 based on the subject image (the through image) captured by the camera 211 (S215). For example, the determination is performed by inputting the captured subject image to a learned assistance tool attachment determination model stored in the memory 214. Note that use of the learned assistance tool attachment determination model for the determination is merely an example, and the processor may determine whether or not at least the part of the cover collar is included in the subject image by a rule-based image analysis process, and may determine whether or not the assistance tool 300 is attached to the imaging device 200. Further, it is not necessary for the processor 213 of the imaging device 200 to execute the process in both a case of using the learned assistance tool attachment determination model and a case of using the rule-based image analysis process. In other words, the process related to the determination may be made by transmitting the subject image captured by the imaging device 200 to a server device connected via a network, and applying the subject image to the learned assistance tool attachment determination model or the rule-based image analysis process in the server device, and the imaging device 200 may receive a determination result from the server device.
Here,
According to
Once the determination image for learning and the correct answer label information associated with the determination image for learning are respectively obtained, the processor executes a step of performing machine learning of an attachment determination pattern of the assistance tool 300 using the determination image for learning and the correct answer label information (S314). As an example, the machine learning is performed by giving a set of these pieces of information to a neural network in which neurons are combined, and repeating learning while adjusting parameters of each of the neurons to make an output from the neural network become the same as the correct answer label information. Then, a step of acquiring the learned assistance tool attachment determination model is executed (S315). The acquired assistance tool attachment determination model is stored in the memory 214 of the imaging device 200 or another processing device connected to the imaging device 200 via a wired or wireless network. In this way, by using the learned assistance tool determination model, it is possible to determine whether or not the subject image captured by the camera 211 is the image in which at least a part of the cover collar 321 of the assistance tool 300 is included.
Further,
Note that, as illustrated in
Further, in an example of
Returning to
Here,
Note that, in an example of
Returning to
Here, the user can take out the imaging device 200 from the oral cavity together with the assistance tool 300, check the subject image output to the display panel 215, and input a reimaging instruction in a case where the desired image is not obtained. Therefore, the processor 213 determines whether or not the input of the reimaging instruction by the user is received via the input interface 210 (S219). In a case where the input of the reimaging instruction is received, the processor 213 displays the standby screen in S215 again to enable the capture of the subject image.
Meanwhile, in a case where the input of the reimaging instruction is not received, the imaging device 200 is returned to the mounting table 400 by the user, and an instruction to finish the imaging is received from the processing device 100, the processor 213 transmits the subject image stored in the memory 214 and the subject person ID information associated with the subject image to the processing device 100 via the communication interface 216 (S220). Thus, the processing flow ends.
Note that, although not particularly illustrated, if the subject image captured in this way is transmitted to the processing device 100, the processor of the processing device 100 selects the determination image to be used for the determination, and determines the possibility of contracting the predetermined disease using the determination image. Then, a determination result is output to the display or the like. Further, this determination may be made by the rule-based image analysis process, or may be made by using a learned determination model obtained by machine learning using a subject image for learning in which disease information such as the influenza is associated as the correct answer label.
In this way, in the present embodiment, it is possible to provide the assistance tool that is suitable for imaging the oral cavity of the subject person and assists in the imaging, and the imaging device, the program, and the method for imaging the inner side of the oral cavity using the assistance tool.
In the example of
Note that these variations are similar to the configurations, the processes, and the procedures in one embodiment described with reference to
The processes and the procedures described in the present description can also be implemented not only by those explicitly described in the embodiments but also by software, hardware, or a combination thereof. Specifically, the processes and the procedures described in the present description are implemented by installing logic corresponding to the processes on a medium such as an integrated circuit, a volatile memory, a nonvolatile memory, a magnetic disk, or an optical storage. Further, the processes and the procedures described in the present description can be implemented as a computer program and executed by various computers including the processing device and the server device.
Even if it is described that the processes and the procedures described in the present description are executed by a single device, software, a component, or a module, such processes or procedures can be executed by a plurality of devices, a plurality of pieces of software, a plurality of components, and/or a plurality of modules. Further, even if it is described that various types of information described in the present description are stored in a single memory or storage unit, such information can be stored in a distributed manner in a plurality of memories included in a single device or the plurality of memories arranged in a distributed manner in a plurality of devices. Moreover, software and hardware elements described in the present description can be achieved by integrating the elements into fewer components or decomposing the elements into more components.
The present application is a continuation application of International Application No. PCT/JP2022/010014, filed on Mar. 8, 2022, which is expressly incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2022/010014 | Mar 2022 | WO |
Child | 18823997 | US |