The present disclosure relates to a measurement technology using image processing. In particular, the present disclosure relates to a method for measuring foot size of a measured person.
Wearing shoes of inappropriate size for one's feet not only makes walking difficult, but may also affect one's health. In recent years, purchase of shoes through online shopping has become common but, unlike in-store purchases, many people purchase shoes without trying them on. If more people purchase shoes of inappropriate sizes as a result of purchasing without trying them on, it will lead to an increase in returns. Therefore, allowing purchasers to make purchases based on proper foot size measurement is desirable.
Meanwhile, a system is known to calculate foot size and shoe size based on an image of the foot taken by a customer using a mobile terminal (see Patent Literature 1, for example).
Patent Literature 1: Japanese Unexamined Patent Application Publication No. 2019-45463
In the technology of Patent Literature 1, however, the foot size is measured and displayed after all the image shooting is completed, so that the measured person cannot know the foot size until all the image shooting is completed. Therefore, even if an image shooting error or a measurement error has occurred in some parts, the error could not be recognized until the end. Accordingly, all the image shooting would need to be performed again from the beginning to measure the foot size, for example, which has been inconvenient.
The present disclosure has been made in view of such a situation, and a purpose thereof is to provide a technology for improving foot size measurement efficiency.
In response to the above issue, a foot size measurement device according to one aspect of the present invention includes: a measurement unit that selectively measures one or more of multiple measurement elements to be measured as feature values defining one foot size, based on a one-foot image of a measured person; an information generator that generates foot size information based on one or more measurement elements selectively measured by the measurement unit, among the multiple measurement elements; and an output unit that outputs the foot size information.
The “multiple measurement elements” may be, for example, measurable elements, such as the foot width, foot length, ball girth, heel width, foot height, heel inclination angle, hallux abduction angle, and arch height of one foot. Also, the “measurement based on the one-foot image” may be processing for obtaining the length or size of each measurement element by comparison with a predetermined reference object through image processing. For the comparison, the “one-foot image” may be shot by a measured person such that the predetermined reference object to be compared appears in the “one-foot image”. According to this aspect, one or more of the multiple measurement elements can be selected and measured, and, based on the one or more measurement elements, the foot size information can be generated, so that the foot size measurement efficiency can be improved.
When the number of measurement elements that have been selectively measured by the measurement unit among the multiple measurement elements is more than one, the information generator may generate, as the foot size information, content that depends on a combination of the measured measurement elements. The measurement unit may selectively measure one or more of multiple measurement elements including a foot width and a foot length of one foot of a measured person. The information generator may include, in the foot size information, information regarding the measured element when only one of the foot width and the foot length has been measured and may include, in the foot size information, evaluation information regarding the wideness of the foot width with respect to the foot length, in addition to information regarding the measured elements, when both the foot width and the foot length have been measured. The “evaluation information” may be information related to wideness or narrowness of a foot width with respect to a foot length, for example. According to this aspect, at the time when one or more measurement elements are shot, the measurement elements are measured and displayed, and, in addition, when other measurement elements are shot, information that can only be obtained by combining the measurement elements can be immediately displayed, thereby enhancing the convenience.
The measurement unit may be capable of selectively re-measuring a measured element among the multiple measurement elements. Also, when one or more measurement elements are re-measured by the measurement unit, the information generator may re-generate the foot size information based on one or more measurement elements including the one or more re-measured measurement elements. In this case, when the number of measured measurement elements after the re-measurement is one, the foot size information may be re-generated based on the one measurement element; when the number of measured measurement elements after the re-measurement is more than one, the foot size information may be re-generated based on a combination of the multiple measurement elements. According to this aspect, the measured person can select one or more measurement elements for re-shooting and re-measurement and need not waste past measurements by measuring all the measurement elements again from the beginning, enabling efficient measurement.
Another aspect of the present invention relates to a foot size measurement method. The method includes: measuring selectively one or more of multiple measurement elements to be measured as feature values defining one foot size, by image processing based on a one-foot image of a measured person; generating, by predetermined arithmetic processing, foot size information based on one or more measurement elements selectively measured in the measuring, among the multiple measurement elements; and outputting the foot size information by a predetermined output means. According to this aspect, one or more of the multiple measurement elements can be selected and measured, and, based on the one or more measurement elements, the foot size information can be generated, so that the foot size measurement efficiency can be improved.
Optional combinations of the aforementioned constituting elements, and implementation of the present disclosure, including the constituting elements and expressions, in the form of methods, apparatuses, programs, transitory or non-transitory storage medium storing programs, or systems may also be practiced as additional modes of the present disclosure.
Embodiments will now be described, by way of example only, with reference to the accompanying drawings which are meant to be exemplary, not limiting, and wherein like elements are numbered alike in several figures, in which:
The invention will now be described by reference to the preferred embodiments. This does not intend to limit the scope of the present invention, but to exemplify the invention.
In the following, a foot size measurement system and a foot size measurement program will be illustratively described. The foot size measurement system and the foot size measurement program in the present embodiment allow measurement while multiple measurement elements to be measured as feature values defining foot size can be freely selected, thereby improving the flexibility and efficiency of the size measurement.
Each of the user terminal 10 and the foot size measurement server 20 may be constituted by a mobile terminal or a computer including a central processing unit (CPU), a graphics processing unit (GPU), a random access memory (RAM), a read only memory (ROM), an auxiliary storage device, a display device, a communication device, and the like, and by a program stored in the mobile terminal or computer. For example, a program executed on the foot size measurement server 20 side may be used from the user terminal 10 side via the network 18. Also, the foot size measurement system may be implemented by a stand-alone device equipped with all the functions of the user terminal 10 and the foot size measurement server 20, and a measured person may be able to directly operate the stand-alone device to execute the foot size measurement program. The stand-alone device may be provided in the form of, besides a personal computer, a mobile terminal, such as a smartphone, or a tablet terminal, along with a program stored in the computer or terminal. Alternatively, the device may be implemented in the form of a terminal installed in a shoe store and operated by an assistant such as a salesperson, along with a program stored in the terminal.
In the present embodiment, the multiple measurement elements to be measured as feature values defining one foot size may be the foot width and foot length of a foot, for example. Since the foot width and foot length are measured for each of the left and right feet, up to a maximum of four measurement elements are to be measured. However, the measured person may select and measure only some of the multiple measurement elements and check the foot size. In a modification, the multiple measurement elements may further include the ball girth instead of or in addition to the foot width. The measured person selects one of the left and right foot widths and foot lengths to shoot an image therefor using the user terminal 10 and obtains the measurement result. If the measured person desires to know only some of the measurement elements, the measured person may terminate the process after the image shooting and measurement of the some measurement elements is completed. Alternatively, the measured person may terminate the process after the image shooting and measurement of all the four measurement elements is completed. Also, an arbitrary measurement element that has been measured once may be re-shot and re-measured. Therefore, even if an image shooting error or a measurement error is found in some measurement elements, only such measurement elements may be re-shot and re-measured, and re-shooting of all the measurement elements is unnecessary.
The user terminal 10 includes an image acquirer 30, a display unit 32, a communication unit 34, and an operation processing unit 36. The operation processing unit 36 accepts operation input from a measured person. The operation processing unit 36 accepts an instruction from the measured person for the start of a series of processes in the foot size measurement program. Based on the instruction, the display unit 32 starts screen display of contents of the foot size measurement program and displays contents related to the measurement procedure. The operation processing unit 36 and the display unit 32 may be constituted by a touch panel, for example, in terms of hardware.
The display unit 32 displays, as options for the multiple measurement elements to be measured, the left foot width, left foot length, right foot width, and right foot length, with images and character strings. The operation processing unit 36 accepts from the measured person an instruction regarding which of the multiple measurement elements to perform image shooting and measurement for. Based on the selection instruction from the operation processing unit 36, the display unit 32 displays shooting procedure for the selected measurement element.
The image acquirer 30 captures an image of one foot of the measured person to acquire a one-foot image. The image acquirer 30 may be constituted by a camera module, for example, in terms of hardware. The communication unit 34 transmits the one-foot image to the foot size measurement server 20 via the network 18 and receives the measurement results and evaluation information from the foot size measurement server 20 to transmit the results and information to the display unit 32. The communication unit 34 may be constituted by a wireless communication module for wireless LAN communication or cellular phone communication, for example, in terms of hardware. The display unit 32 displays, on the screen, the one-foot image of the measured person, the size of the one foot as the measurement results, and the evaluation information.
The foot size measurement server 20 includes a communication unit 40, a measurement unit 42, an information generator 50, a storage unit 56, and an output unit 58. The communication unit 40 receives a one-foot image from the user terminal 10 and transmits the measurement results and evaluation information, which will be described later, to the user terminal 10. The communication unit 40 may be constituted by a communication module for a wired LAN, for example, in terms of hardware.
The measurement unit 42 selectively measures one or more of the multiple measurement elements to be measured as feature values defining one foot size, based on the one-foot image of the measured person. The measurement unit 42 includes an element selector 44, a foot width measurer 46, and a foot length measurer 48.
The element selector 44 transmits, to the user terminal 10 via the communication unit 40, a selection screen on which one of the multiple measurement elements is selected and receives an instruction from the user terminal 10 to select one of the multiple measurement elements as a measurement target. When the element selector 44 receives a measurement instruction for a measurement element that has already been measured among the multiple measurement elements, the element selector 44 selects the indicated measurement element as a re-measurement target.
When the measurement target is the left foot width or the right foot width, the foot width measurer 46 transmits, to the user terminal 10 via the communication unit 40, a screen for describing a procedure regarding image shooting for the left foot width or the right foot width and acquires a one-foot image of the left foot or the right foot captured by the user terminal 10. The one-foot image shows one foot along with a predetermined reference object as described below. The “reference object” is an object to be captured together with one foot in the image, as a comparison object used to measure the foot width or foot length of the one foot based on the image, and is a planar or three-dimensional object of which the size and shape are defined in advance. The “reference object” may be a general-purpose product as long as the size and shape thereof are defined or may be an exclusive product of which the size and shape are defined exclusively for the measurement in the present embodiment. As a reference object in the present embodiment, a planar object of predefined size and shape, such as A4 size (210 mm×297 mm) paper, may be used. The color of the paper may preferably be white but may be another color. It is premised that a one-foot image in the present embodiment is obtained by shooting one foot along with the entire A4 white paper as the reference object on which the one foot is placed. It is also premised that the A4 white paper is placed on a non-white floor during a shoot, so that the A4 white paper can be accurately extracted from the one-foot image by image recognition. The foot width measurer 46 extracts the reference object from the one-foot image and measures the size of the foot width based on comparison with the reference object. As a modification, the foot width measurer 46 may determine, by image recognition, whether or not the one foot in the one-foot image is wearing a sock. Upon judging that the foot is wearing a sock, the foot width measurer 46 may estimate the foot width with the thickness of the sock taken into consideration.
When the measurement target is the left foot length or the right foot length, the foot length measurer 48 transmits, to the user terminal 10 via the communication unit 40, a screen for describing a procedure regarding image shooting for the left foot length or the right foot length and acquires a one-foot image of the left foot or the right foot captured by the user terminal 10. The foot length measurer 48 extracts the reference object (such as A4 white paper) from the one-foot image and measures the size of the foot length based on comparison with the reference object. As a modification, the foot length measurer 48 may determine, by image recognition, whether or not the one foot in the one-foot image is wearing a sock. Upon judging that the foot is wearing a sock, the foot length measurer 48 may estimate the foot length with the thickness of the sock taken into consideration.
The information generator 50 generates foot size information based on the measurement result of one or more measurement elements selectively measured by the measurement unit 42, among the multiple measurement elements, and stores the foot size information in the storage unit 56. The stored foot size information is transmitted to the user terminal 10 via the output unit 58. The information generator 50 includes a foot size generator 52 and a result generator 54.
The foot size generator 52 generates foot size information including the measurement results of some or all of the measurement elements selectively measured by the measurement unit 42. For example, when only some measurement elements have been measured, foot size information that only includes the size of the some measurement elements is generated. When the number of elements that have been selectively measured among the multiple measurement elements is more than one, the result generator 54 generates foot size information that includes evaluation information of which content depends on the combination of the measured measurement elements. When both the foot width and the foot length of either the left or right foot are measured, for example, the evaluation information may relate to wideness or narrowness of the foot width with respect to the foot length; for example, when the foot width is wider or narrower by a predetermined percentage or more than an average of the foot width for the same foot length, the evaluation information may include the evaluation of “wider than average” or “narrower than average”.
When a measured measurement element is re-shot and re-measured by the measurement unit 42, the foot size generator 52 re-generates the foot size information based on one or more measurement elements including the re-measured measurement element and updates or overwrites and saves the foot size information before the re-measurement.
To select and execute a “full measurement mode” in which all of the multiple measurement elements are shot in a predetermined order to be measured, the measured person presses the first start button 102. Meanwhile, to select and execute a “partial measurement mode” in which one or more of the multiple measurement elements are selected and shot in an arbitrary order to be measured, the measured person presses the second start button 103. In the following, the partial measurement mode executed when the second start button 103 is pressed will be described, and the explanation of the full measurement mode executed when the first start button 102 is pressed will be omitted. The present embodiment describes, as an example, a method in which the foot size measurement procedures in the full measurement mode and the partial measurement mode are provided and the measured person selects one of the modes. However, a modification may employ a method in which the full measurement mode is omitted, i.e., a method in which the measured person selects a measurement target each time, as in the partial measurement mode. Alternatively, a method may be employed in which, after all the measurement elements are measured once in the full measurement mode, the partial measurement mode is executed only when some of the measurement elements are to be re-measured. Alternatively, a method may be employed in which the full measurement mode is automatically started without requesting the mode selection from the measured person, and the partial measurement mode is executed only when the measured person performs a predetermined operation to order the partial measurement mode during the full measurement mode.
A result display button 115 is a button used for shifting to a screen displaying a measurement result; however, before the measurement, the button is grayed out and the pressing thereof is disabled. A guide display button 116 is a button used to order the returning to the start screen 101 shown in
The image acquirer 30 may recognize the shape and the ratio of two sides of the white paper 134 as the reference object on the image and may perform shutter operation to acquire a one-foot image upon recognition of satisfying a predetermined condition indicating that the image contains the reference object of appropriate shape and size. The predetermined condition indicating that the image contains the reference object of appropriate shape and size may be, for example, a condition that defines a rectangular shape and a ratio of two sides thereof assumed to be obtained when the white paper 134 as the reference object is shot from directly above. Also when the image shooting for the right foot width is performed, similar screens are displayed and image shooting is performed following a similar procedure.
The shooting result screen 136 shows a one-foot image 137 in an upper center part thereof and also shows measurement support lines 138, which are two vertical lines positioned respectively at the left and right ends of the instep of the foot 133 recognized by the foot width measurer 46 based on the one-foot image 137. The one-foot image 137 illustrated in
The measurement result screen 140 is a screen that shows the measurement results and evaluation information as foot size information. On the measurement result screen 140, a foot figure column 141 is displayed in an upper center part, a comment column 146 is displayed in a lower center part, and a back button 147 is displayed further therebelow. The foot figure column 141 at the time as shown in
In the comment column 146, the evaluation information is displayed. For example, the comment column 146 shows a character string, such as “The width of your foot is 10.3 cm (left). Let's measure the length of your foot as well.” Since whether the foot width is wider or narrower than average is determined by the contrast between the foot length and the foot width, the wideness of the foot width cannot be technically evaluated at the time when only the foot width has been measured and the foot length has not been measured yet. Therefore, when either the foot width or the foot length has not been measured, initial content as shown in
When the measured person presses the back button 147, the screen returns to the selection screen 110 shown on the left in
On the selection screen 110, when the measured person presses the first element selection button 111, which indicates that measurement therefor has been performed, the screen shifts to a re-shooting screen for the left foot width, and the measured person can perform re-shooting and re-measurement. Meanwhile, if the measured person only desires the measurement of the left foot width, the measured person may finish the measurement at this point. In the following, an example of a case will be described in which, subsequent to the measurement of the left foot width, image shooting and measurement for the right foot width is also performed. Since the shooting method for the right foot width is the same as illustrated in
In the example of the measurement result screen 140 in
On the selection screen 110, when the measured person presses one of the first element selection button 111 and the third element selection button 113, which each indicate that measurement therefor has been performed, the screen shifts to the re-shooting screen for the measurement element corresponding to the pressed button, and the measured person can perform re-shooting and re-measurement. Meanwhile, if the measured person only desires the measurement of the left and right foot widths, the measured person may finish the measurement at this point. In the following, an example of a case will be described in which, subsequent to the measurement of the right foot width, image shooting and measurement for the right foot length is further performed.
The image acquirer 30 may recognize the shape and the ratio of two sides of the white paper 134 as the reference object on the image and may perform shutter operation to acquire a one-foot image upon recognition of satisfying a predetermined condition indicating that the image contains the reference object of appropriate shape and size. The predetermined condition indicating that the image contains the reference object of appropriate shape and size may be, for example, a condition that defines a trapezoidal shape and a ratio of two sides thereof assumed to be obtained when the white paper 134 as the reference object is shot from diagonally above. Also when the image shooting for the left foot length is performed, similar screens are displayed and image shooting is performed following a similar procedure.
The shooting result screen 136 shows the one-foot image 137 in an upper center part thereof and also shows the measurement support lines 138, which are two vertical lines positioned respectively at the toe and the heel of the foot 133 recognized by the foot length measurer 48 based on the one-foot image 137. When misidentification has occurred in the foot length measurement or when the measured person desires re-shooting for a clearer image, by pressing the re-shooting button 139, the measured person can return to the image shooting screen 130 again to perform re-shooting. When there is no problem with the one-foot image 137, the measured person presses the back button 135 to shift to the selection screen 110 shown in
In the example of the measurement result screen 140 in
When the foot width is wider than average, the displayed character string is changed to a character string such as “Your foot width is wider than average. Selecting a generous size is recommended, as your foot width, instep, and heel tend to be tight.” or “Your foot width is very wider than average. Selecting a size that matches your foot width, with a large margin at the toe, is recommended, as your foot width, instep, and heel tend to be tight.” In this case, the comment column 146 also shows a link to recommended products of shoes designed wider than average, with a character string such as “Click here for wide type shoes” or “Click here for extra-wide shoes”, and a comment such as “Considering your foot width, a size slightly larger than your foot length-based size is recommended.” or “Since your foot width is very wide, a size larger than your foot length-based size is recommended.” When the measured person presses the back button 147, the screen returns to the selection screen 110 shown on the left in
On the selection screen 110, when the measured person presses one of the first element selection button 111, the third element selection button 113, and the fourth element selection button 114, which each indicate that measurement therefor has been performed, the screen shifts to the re-shooting screen for the measurement element corresponding to the pressed button, and the measured person can perform re-shooting and re-measurement. Meanwhile, if the measured person only desires the measurement of the left and right foot widths and the right foot length, the measured person may finish the measurement at this point. In the following, an example of a case will be described in which, subsequent to the measurement of the right foot length, image shooting and measurement for the left foot length is further performed. Since the shooting method for the left foot length is the same as illustrated in
In the example of the measurement result screen 140 in
On the selection screen 110, when the measured person presses one of the first element selection button 111, the second element selection button 112, the third element selection button 113, and the fourth element selection button 114, which each indicate that measurement therefor has been performed, the screen shifts to the re-shooting screen for the measurement element corresponding to the pressed button, and the measured person can perform re-shooting and re-measurement.
When the measured person selects, on the selection screen 110 in S14, one of the first element selection button 111, the second element selection button 112, the third element selection button 113, and the fourth element selection button 114 (Y at S18), the explanation screen 120 is displayed (S20), and image shooting is performed on the image shooting screen 130 (S22). After the image shooting, the one-foot image 137 is displayed on the shooting result screen 136 (S24) and, if the measured person selects re-shooting (Y at S26), the process returns to S22 to perform re-shooting. If the measured person does not select re-shooting (N at S26) and returns to the selection screen 110 (S28) and if the measured person presses the result display button 115 (Y at S30), the measurement result screen 140 is displayed (S32). Then, if the back button 147 is pressed (Y at S34), the process returns to S28, and, if the back button 147 is not pressed (N at S 34), the measurement is terminated. In the step S30, if the measured person does not press the result display button 115 (N at S30), the process returns to S18, and, thereafter, the selection of the measurement element to be measured will be repeated. In the step S18, if the selection of the measurement element is not performed (N at S18) and if returning to the guide is selected (Y at S36), the process returns to S10. If the returning to the guide is not selected either (N at S36), the measurement is terminated.
In the present embodiment, one or more of the multiple measurement elements can be selected and measured, and, based on the one or more measurement elements, the foot size information can be generated. Also, some of the measurement elements can be re-measured at arbitrary timing. Accordingly, even when measuring only some of the measurement elements is sufficient or even when a measurement error has occurred in only some of the measurement elements, measuring all the measurement elements from the beginning is unnecessary. Therefore, the efficiency of the foot size measurement can be improved.
The present disclosure has been described with reference to an embodiment. The embodiment is intended to be illustrative only, and it will be obvious to those skilled in the art that various modifications to a combination of constituting elements or processes could be developed and that such modifications also fall within the scope of the present disclosure.
Number | Date | Country | Kind |
---|---|---|---|
2021-097824 | Jun 2021 | JP | national |