Method of Converting Photo Image Into Realistic and Customized Embroidery

Abstract

Software converts a photographic image into realistic and customized embroidery. Software reads photographic image, down-sampling or up-sampling so that a single pixel has a Density, One Grayscale image is created to calculate derivatives for each pixel using Sobel operator to calculate angle and magnitude and stores in a Sobel table. One Color Image is created to materialize and reduce color selection. A series of polylines are calculated to connect same-color pixels using the pixel's angle from the Sobel table. Polylines are reduced to a manageable size first by multiplying all points by Density resulting in stitch data in physical units, and by using a series of rules and formulas involving angles and magnitudes of each pixel from the Sobel table, Commands are appended to an embroidery machine to generate the final embroidery.

Description

FEDERALLY SPONSORED RESEARCH

Not Applicable

SEQUENCE LISTING OR PROGRAM

Not Applicable

BACKGROUND

The invention relates to a system and method for taking any photo-image and turning it into realistic and customized embroidery, with the use of software, which is then framed and delivered to the user.

Known is a web based embroidery system and method. U.S. Pat. No. 6,196,146 B1 by Goldberg teaches a web based embroidery system capable of creating and automatically fulfilling a user customized embroidery order for a selectable garment over the internet. The system includes the ability to select the garment to be customized over the internet, to selectively locate an embroidery area on that garment, to select a customized embroidery pattern over the internet to be located in the user selected embroidery area, the ability to display an embroided simulation of the user located customized embroidery pattern on the selected garment, and the ability to provide embroidery pattern controlled signals over the internet to a remotely located embroidery machine for automatically stitching the user located customized embroidery pattern on an actual garment corresponding to the selected garment based on the displayed embroidered simulation, which may be a three dimensional simulation. In addition, customized embroidery lettering can be created and may be combined with a preexisting embroidery pattern. Furthermore, on-line editing may be employed as well as individual colorizing by the user. This can be accomplished on customized web sites as well as templated websites. In addition, a system is enclosed which permits auto-digitizing of user generated images over the internet which may be automatically converted into embroidery patterns, cost estimates based thereon and, after confirmation by the user, used to automatically generate embroidery patterns on actual garments.

Unlike Goldberg, the present invention involves software that uses a special technique to generate the embroidery, which makes it truly realistic and more detailed. This present invention is available for smart phones and tablets, in addition to conventional computers.

DRAWINGS

FIG. 1 is a flow chart of a software application for creating a user-customized embroidery file based on a photographic image, for use by production facilities in creating an embroidered product.

FIG. 2 shows the image data for a Color Image (C1)

FIG. 3 shows the image data for a Grayscale Image (G1)

FIG. 4 shows a SOBEL table

FIG. 5 illustrates the joining of two polylines where points come close.

FIG. 6 illustrates the joining of pairs of polylines (Polyline 1, Polyline 2) with the same color where there is a path (p1-start->p2-start, p1-start->p2-end, p1-end->p2-start, p1-end->p2-end) that passes underneath pixels that will be covered later in a sequence.

DESCRIPTION

The method of converting a photographic image into realistic and customized embroidery is best exemplified within the context of a person wishing to acquire a framed embroidered picture based on a photographic image. Computer software reads a photographic image, pre-stored or captured onto a computer, including a mobile smart phone. The required embroidery size is determined in mm, calculated from a frame selected by the user. The computer software then generates an embroidery file. The user may preview a virtual realistic rendering of the framed embroidered picture. The embroidery file is then sent to a location where the physical embroidered picture is framed or manufactured, and then shipped to the user.

First, the photographic image is down-sampled or up-sampled (as needed) so that a single pixel of the image has a predefined size in mm (called Density). The single pixel should be close to 0.6 mm, resulting in a photographic image close to 42.3 DPI. Two copies of the photographic image are stored, one as Color image (C1) and one as Grayscale image (G1) as shown in FIGS. 1 and 2, respectively.

Then, for each pixel of the Grayscale image (G1) the software calculates the partial derivatives (dx and dy) of the photographic image using the well known SOBEL operator (https://en.wikipedia.org/wiki/Sobel_operator). From the two partial derivatives (dx and dy), the software calculates the Sobel Angle, which is a tan 2(dy,dx), and the magnitude (M), which is sqrt(dx̂2+dŷ2), and stores them to a table (Sobel table (S1)) shown in FIG. 4. The angle calculated is perpendicular to the direction an imaginative brush would move to paint the image.

The software or user selects the number of colors to be used (usually between 10 and 15 as selected by the user) and then the software materializes the color selection and reduction of the C1 image, using a median-cut algorithm (https://en.wikipedia.org/wiki/Median_cut). [See “dithering” using the Floyd-Steinberg algorithm (https://en.wikipedia.org/wiki/Floyd-Steinberg_dithering)]

Then, the software calculates a series of open polylines that connect same-color pixels:

• • I. Start from an unused pixel closest to the lowest left corner of the photographic image and mark it as used (PIXEL)
  • II. Read its SOBEL Angle of the PIXEL from the Sobel table (S1).
  • III. Find a new unused pixel near the PIXEL with the same color, favoring the pixel TOWARDS the SOBEL Angle, mark it as used and add it as a point to the polyline. The nearby distance is user-defined and usually is set to 4 pixels (0.6 mm×4=2.4 mm distance)
  • IV. Continue with Step II until all closest pixels (max. 3 pixels distance) are gathered. The stored polyline is the same color as the pixels this polyline was generated.
  • V. Start a new polyline from Step I for as long as unused pixels exist.

Referring to FIG. 5, if two separate polylines of the same color (p1,p2), generated from Step 5, have a point where they come close (less than 2.5 mm), join them at this point into one polyline (P-result). Some parts of the original polylines have to be travelled twice.

If there is a very small polyline (less than 7 points) and can be joined to a similar (not same) color polyline, join it. The color of the resulting polyline is the color of the largest of the two (joined) polylines. One or two-point polylines that survived Step 6 and 7 as separate entities are discarded.

Group the polylines by color. Sort the color polyline groups from dark to light (if base fabric color is dark) or from light to dark (if base fabric color is light). So the polylines are put into one sequence.

Referring to FIG. 6, get pairs of polylines (Polyline 1, Polyline 2) with the same color and determine if there is any path (p1-start->p2-start, p1-start->p2-end, p1-end->p2-start, p1-end->p2-end) that passes underneath pixels that will be covered later in the sequence. If this is true, join the two polylines. If more than one path satisfies this criteria, select the shortest (P1-start->P2-end). In other words if a polyline (e.g., Polyline 3) which will be embroidered later can cover with its thread the connection of two other polylines, it is valid to connect those two polylines (p1,p2). The objective is to minimize the number of polylines from a huge number to a more manageable size. Different polylines have to instruct the machine to trim the thread (in the next step), a process that is costly in time.

Generate the final embroidery with an embroidery machine using the following procedure.

• • a. All points of the polylines have their coordinates multiplied by density on output, so that the resulting stitch data will be in physical units (mm).
  • b. For each of the polylines: Output the first point of the polyline as-is;
  • c. For all the other points of the polyline;
    • (I) Read the SOBEL Angle and Magnitude of the point from SOBEL table (S1);
    • (II) if the magnitude is too low (less than 0.0001) output the point as-is, continue with next point from (I)
    • (III) Move the point a pre-defined distance (user-definable something close to 2.0 mm) perpendicular to the SOBEL Angle defined in the SOBEL table (S1). For odd points, add 90 degrees to the SOBEL angle, for even points, subtract 90 degrees from the SOBEL angle to calculate the resulting perpendicular angle.
    • (IV) Output the point and jump to (I)
  • d. Append the appropriate embroidery command to the embroidery machine as follows:
    • (V) If the polyline is the last add END command
    • (VI) If the following polyline has the same color add the THREAD TRIM command, and jump to step (a), above.
    • (VII) if the following polyline has a different color add a COLOR_CHANGE command, and jump to step (a), above.

With regard to c, above, embroidery machines have a list of commands to operate on. The list is generated by the computer software and can be sent via usb-stick, floppy disk, paper-tape or directly via cable and now via Wi-Fi. This list of commands is a series of 2-D coordinates for the machine to move and do stitching. Some of these commands contain extra information for the machine and are usually called “special functions.” Different companies call them with different names. The most usual special functions are:

• • THREAD_TRIM command instructs the machine to cut the thread. If the machine has automatic thread trimmer, will cut the thread, otherwise will instruct the operator to do so.
  • COLOR_CHANGE command instructs the machine to change thread color. If the machine has multicolor it will cut the previous thread and automatically switch to a new color, otherwise instruct the operator to change the thread.
  • END command signals the end of the command list to the machine and finish.

While the invention perceives the use of the embroidered image on a picture frame, it should be noted that the embroidered image can also appear on non-traditional picture frames, such as pillows, blankets, walls, clothing, and any item on which a photographic image may appear on textile. By this definition, a “frame” can be a pillow, blanket, wall, or shirt.

Claims

1. A method of converting a photographic Image Into realistic and customized embroidery using software to perform the following: a) computer software reads a photographic image and calculates the size of an embroidered product based on a frame size selected by a user;b) said photographic image is down-sampled or up-sampled so that a single pixel of said photographic image has a predefined size approximately 0.06 mm, defined as Density, resulting in a photographic image close to 42.3 DPI;c) two copies of said image are stored, one as color image (C1) and one as grayscale image (G1);d) for each pixel of the grayscale image (G1), the software calculates the partial derivatives (dx and dy) of said photographic image using a SOBEL operator; from the two partial derivatives (dx and dy), the software calculates a SOBEL Angle, which is a tan 2(dy,dx) and the magnitude (M), which is sqrt(dx̂2+dŷ2), and stores them to a table (SOBEL table);e) the software or user selects the number of colors to be used (usually between 10 and 15 colors) and then the software materializes the color selection and reduction of the C1 image, using a median-cut algorithm;f) the software then calculates a series of open polylines that connect same-color pixels using the following method: i. start from an unused pixel closest to the lowest left corner of the photographic image and mark it as used (PIXEL);ii. read the SOBEL Angle of the PIXEL from the SOBEL table;iii. find a new unused pixel near the PIXEL with the same color, favoring the pixel towards the SOBEL Angle, mark it as used and add it as a point to the polyline;iv. continue with step ii until all closest pixels (max. 3 pixels distance) are gathered, resulting in a stored polyline that is the same color as the pixels from which this polyline was generated;v. start a new polyline from step i for as long as unused pixels exist;g) the software minimizes the number of resulting polylines to a manageable size using the following rules: i. if two separate polylines of the same color (p1, p2) have a point where they come close (less than 2.5 mm), join them at said point into one polyline (P-result);ii. if there is a very small polyline that has less than 7 points, join said very small polyline to any similar color polyline, so that the color of the resulting polyline remains the color of the largest of the two (joined) polylines;iii. discard polylines with only one or two points;iv. group the polylines by color and place the color polyline groups from dark to light, if the base fabric color is dark, or from light to dark, if the base fabric color is light, so that the color polyline groups are put into one sequence;v. get pairs of polylines with the same color and determine if there is any path that passes underneath pixels that will be covered later in the sequence; if this is true, join the two polylines at such path; where more than one path satisfies this criteria, join the polylines at the shortest path; andh) the software generates the embroidery using an embroidery machine to execute the following procedure: i. all points of the polylines have their coordinates multiplied by the Density on output, so that the resulting stitch data is in physical units (mm);ii. for each of the polylines, output the first point of the polyline as-is to the embroidery machine;iii. for all other points of the polyline, the software executes the following: a. read the SOBEL Angle and the Magnitude of the point from the SOBEL table;b. If the Magnitude is less than 0.0001, output the point as-is, then continue with the next point from step a;c. Move the point to a pre-defined distance close to 2.0 mm, perpendicular to the SOBEL angle defined in the SOBEL table; for odd points, add 90 degrees to the SOBEL Angle, for even points, subtract 90 degrees from the SOBEL Angle to calculate the resulting perpendicular angle;d. Output the point to the embroidery machine and return to step a; andiv. append embroidery commands to the embroidery machine as follows: a. if the polyline is the last, the software signals an end of a command list to the embroidery machine and finish;b. if the following polyline has the same color, the software instructs the embroidery machine or a user to cut the thread and jump to step h(i) and;c. if the following polyline has a different color, the software instructs the embroidery machine or user to change the thread color and jump to step h(i).