Patent Application
20210157533
This patent application is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application No. 2019-212754, filed on Nov. 25, 2019, in the Japan Patent Office, the entire disclosure of which is hereby incorporated by reference herein.
Embodiments of the present disclosure relate to an information processing device and an information processing system.
in recent years, as laptop personal computers become compact and smart devices have spread, compactness and portability of printers are desired. There are handheld printers from which a paper conveyance mechanism is omitted for enhancing compactness and portability. Such a handheld printer receives data of image to be printed from, for example, a smart device or a personal computer. A user holds a housing of the handheld printer with hand and operates the printer on a print medium such as a notebook or paper.
According to an embodiment of this disclosure, an information processing device includes circuitry configured to communicate with a printer. The circuitry is configured to generate print data including image data of a print target and operation direction information indicating an operation direction of the printer on a print medium for each print target, and transmit the print data to the printer. The printer is configured to print the print target based on the image data on the print medium while being operated in a direction indicated by the operation direction information on the print medium
Another embodiment provides a non-transitory recording medium storing a plurality of program codes which, when executed by one or more processors, causes the processors to perform a method. The method includes communicating with a printer configured to print a print target on a print medium while being operated in a predetermined direction on the print medium; generating print data including image data of the print target and operation direction information indicating an operation direction of the printer for each print target; and transmitting the print data to the printer.
A more complete appreciation of the disclosure and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein:
The accompanying drawings are intended to depict embodiments of the present disclosure and should not be interpreted to limit the scope thereof. The accompanying drawings are not to be considered as drawn to scale unless explicitly noted.
In describing embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this patent specification is not intended to be limited to the specific terminology so selected, and it is to be understood that each specific element includes all technical equivalents that have the same function, operate in a similar manner, and achieve a similar result.
Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views thereof, embodiments of this disclosure are described. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
Hereinafter, a printing system according to an embodiment of the present disclosure is described with reference to the accompanying drawings.
System Configuration
The handheld printer 2 is a lightweight and compact printer. As illustrated in
Hardware Configuration of Mobile Communication Terminal
The CPU 401 controls the entire operation of the mobile communication terminal 1. The ROM 402 stores programs used by the CPU 401 or used by an initial program loader (IPL) to boot the CPU 401. The RAM 403 is used as a work area for the CPU 401. The EEPROM 404 performs reading or writing of various data such as a mobile communication terminal program under control of the CPU 401.
Further, the EEPROM 404 stores a print navigation program for navigating the operation of the handheld printer 2. As will be described later, as the CPU 401 executes the print navigation program to control each part of the mobile communication terminal 1, the CPU 401 instructs the user of print contents (a letter, a symbol, and an image to be printed), the position of printing, and the direction in which the handheld printer 2 is to be operated. The user operates the handheld printer 2 in the instructed direction, at the instructed print position. As a result, the user can print a letter or an image recognized in advance, at the positions recognized in advance.
The CMOS sensor 405 generates image data corresponding to image capture light from a subject under the control of the CPU 401. In addition or alternative to the CMOS sensor, a different image capture device such as a charge-coupled device (CCD) image sensor may be used.
The image sensor I/F 406 is an interface for connecting the CMOS sensor 405 to a bus line 410. Examples of the acceleration and orientation sensor 407 include various sensors such as an electromagnetic compass to detect geomagnetism, a gyrocompass, and an accelerometer. The media I/F 409 is an interface for connecting a recording medium 408 such as a flash memory to the bus line 410. To and from the recording medium 408, for example, data of an image to be printed is written and read out via the media I/F 409. The image data can be stored in another storage area such as the ROM 402 or the RAM 403. The GPS receiver 411 receives a GPS signal from a GPS satellite.
The mobile communication terminal 1 further includes a communication circuit 412, a CMOS sensor 413, an image sensor I/F 414, a microphone 415, a speaker 416, an audio input/output I/F 417, a display 418, an external device I/F 419, a short-range communication circuit 420, an antenna 420a for the short-range communication circuit 420, and a touch panel 421.
As will be described later, the display 418 displays an input screen for inputting a desired print mode based on the print navigation program. Based on the print navigation program, the CPU 401 lets the user to recognize, via the input screen, the print position and the operation direction of the handheld printer 2 to attain the form of print input by the user. As a result, the user can print desired letters, images, and the like at a desired position, which is displayed on the input screen, without a deviation.
The communication circuit 412 communicates with other devices via a communication network 412a. The CMOS sensor 413 captures an image of a subject and generates image data under the control of the CPU 401. The image sensor I/F 414 is an interface for connecting the CMOS sensor 413 to the bus line 410. The microphone 415 generates an audio signal which is an electric signal corresponding to collected voice. The speaker 416 outputs sound such as music or voice corresponding to the audio signal. The audio input/output I/F 417 is a circuit for inputting and outputting an audio signal between the microphone 415 and the speaker 416 under control of the CPU 401.
The display 418, such as a liquid crystal display or an organic electro luminescence (EL) display, displays an image of a subject or various icons. The external device/F 419 is an interface for connection with various external devices. The short-range communication circuit 420 is a communication circuit in compliance with the near field communication (NFC), the Bluetooth (registered trademark), and the like. The touch panel 421 is disposed on the display 418 and detects a touch (contact operation) of the user.
The mobile communication terminal 1 further includes the bus line 410. The bus line 410 is, e.g., an address bus or a data bus configured to electrically connect the components such as the CPU 401 illustrated in
Software Configuration of Mobile Communication Terminal
The input operation acquisition unit 21 acquires the information input by the user via the above-mentioned input screen. The program activation control unit 22 controls activation of the print navigation program. The display control unit 23 displays the above-mentioned input screen or the like on the display 418. The communication control unit 24 controls short-range wireless communication, such as Bluetooth (registered trademark) communication, with the handheld printer 2, via the short-range communication circuit 420. The storing control unit 25 controls reading of image data to be transmitted to the handheld printer 2, and writing and reading of the information input by the user via the input screen to a storage area such as the RAM 403.
Although the description above concerns an example in which the input operation acquisition unit 21 to the storing control unit 25 are implemented by software, alternatively, some or all of these functions can be implemented by hardware such as an integrated circuit (IC).
In another example, the print navigation program is stored in a computer-readable recording medium such as a compact disc read only memory (CD-ROM) and a flexible disk (FD), in an installable or executable file format, for distribution. In still another example, the print navigation program is stored in a computer-readable recording medium such as a compact disc-recordable (CD-R), a digital versatile disk (DVD), a Blu-ray Disc (registered trademark), and a semiconductor memory, for distribution. In still another example, the print navigation program is installed through a network such as the Internet or preloaded in a ROM, etc., of the device.
The print start button 13 also serves as an answerback button when data is received from the mobile communication terminal 1. Specifically, when the CPU 401 receives the print data from the mobile communication terminal 1, the CPU 401 causes the print start button 13 to blink a predetermined number of times, for example, five times, to notify the user of the reception of the print data. Further, when the print start button 13 is operated, the CPU 401 controls printing according to the operation of the handheld printer 2.
An inkjet recording head 33 (illustrated in
Further, when the housing 11 is moved in a direction other than the direction indicated by arrow SD in
Further, a guide 14 is disposed on a lateral side face 2c of the housing 11 facing in the print direction indicated by arrow SD in
The guide unit 14 has a width PW that is a print width in which printing is performed in one operation. At a center of the guide 14 in the width direction, a center line CL extending from the lateral side face 2c toward the operation direction is provided. As one example, this center line CL is a thin red line. As described above, the width PW of the guide 14 indicates the width printed by one operation. Therefore, the center line CL indicates the center of the width PW printed by one operation. Therefore, the user aligns the center line CL with the center of the printing start position and moves the handheld printer 2. As a result, letters, images, and the like can be printed with the center positions aligned.
Hardware Configuration of Handheld Printer
The power supply 31 is a rechargeable so-called secondary battery, and generates a drive power for the handheld printer 2. The power supply circuit 32 supplies the power from the power supply 31 to necessary components. The inkjet recording head 33 discharges ink to the print medium 3 by an inkjet method, to print letters, images, or the like. The inkjet recording head drive circuit 34 controls driving of the inkjet recording head 33 in accordance with the letters or images to be printed. The controller 35 controls the entire handheld printer 2.
The communication I/F 36 is for wireless communication with the mobile communication terminal 1 by short-range wireless communication such as Bluetooth (registered trademark). The OPU 37 includes an LED for displaying the state of the handheld printer 2, a switch for the user to instruct the handheld printer 2 to form an image, and the like. However, the OPU 37 is not limited thereto, and may further include a liquid crystal display or a touch panel. The OPU 37 may further has an audio input function.
The navigation sensor 38 is configured to detect the amount of movement of the handheld printer 2 in the X-axis direction and in the Y-axis direction. For example, the X-axis direction is the operation direction SD in
In the handheld printer 2 having the above-described configuration, in response to a reception of image data (print job) from the mobile communication terminal 1, the controller 35 calculates the position of each nozzle of the inkjet recording head 33 based on information input from the navigation sensor 38 and the gyro sensor 39. While the user operates the handheld printer 2, the controller 35 continuously calculates the position of each nozzle and acquires only the image corresponding to the calculated position from the DRAM 40. Then, the controller 35 compares the position of the acquired image with the position of each nozzle. When determining the agreement between the compared positions, the controller 35 supplies the image data for the nozzle to the inkjet recording head drive circuit 34.
The inkjet recording head drive circuit 34 supplies print timing information together with image data to the inkjet recording head 33. Based on the print timing information, the inkjet recording head 33 discharges ink corresponding to the image data onto the print medium 3. As a result, an image is recorded on the print medium 3 according to the image data designated by the user.
Configuration of Controller
The SoC 50 includes, in addition to a CPU 52, a position calculation circuit 53 that performs position calculation, a memory controller 54 that controls writing to and reading from an external memory such as a DRAM, and a ROM controller 55 that controls writing and reading of data to and from the ROM 41.
The ASIC/FPGA 70 includes a navigation sensor I/F 72, a timing generator 73, an inkjet recording head controller 74, a gyro sensor VF 75, an image RAM 76, a direct memory access controller (DMAC) 77, a rotator 78, and an interrupt controller 79.
The navigation sensor I/F 72 stores a movement amount ΔX in the X-axis direction and a movement amount ΔY in the Y-axis direction of the handheld printer 2 in an internal register. The gyro sensor I/F 75 stores an angular velocity co received from the gyro sensor 39 in an internal register. The timing generator 73 notifies the navigation sensor I/F 72 of the timing of reading of the information from the navigation sensor 38, and notifies the inkjet recording head controller 74 of the drive timing for printing.
The DMAC (CACHE) 77 and the rotator 78 read the image data around each nozzle of the inkjet recording head 33 from the memory 40 (or the ROM 41) based on the position information calculated by the position calculation circuit 53 of the SoC 50. Then, the DMAC (CACHE) 77 and the rotator 78 rotate the read image data according to the position and inclination of the inkjet recording head 33, and supply the read image data to the inkjet recording head controller 74.
The image RAM 76 temporarily stores the image data read from the memory 40 by the DMAC (CACHE) 77. The inkjet recording head controller 74 supplies control signals and image data to the inkjet recording head drive circuit 34. In response to completion of the communication between the navigation sensor I/F 72 and the navigation sensor 38, the interrupt controller 79 notifies the SoC 50 of the completion of the communication therebetween. The interrupt controller 79 also notifies the SoC 50 of a status such as an error.
Print Navigation
Next, a description is given of the print navigation in the printing system having the above-described configuration, according to the present embodiment.
In response to the activation of the print navigation program, the communication control unit 24 controls the short-range communication circuit 420 to establish, for example, a Bluetooth communication line with the handheld printer 2 (S3). In addition, the display control unit 23 displays an input screen for inputting print contents on the display 418 (S4).
The display control unit 23 displays, in the middle area, various setting items such as print sheet setting for selecting sheet type such as postcard, envelope, or A4 size sheet used for printing and setting of whether to perform recipient printing or sender printing. The setting items displayed by the display control unit 23 in the middle area further includes setting of postal code style such as Chinese numerals or Arabic numerals, and setting of title or honorific (Japanese honorifics examples include “sama,” “onchu,” and “sensei”). The setting items displayed by the display control unit 23 in the middle area further includes font setting such as HG Gothic B and Mincho style, direction of letters (style) such as columnar writing or horizontal writing.
The user inputs desired values for such various setting items, that is, inputs print contents (S5). In the example illustrated in
As one example, the storage area (a predetermined area in the storage area) of the mobile communication terminal 1 stores an address book in which contact information, such as addresses, names, phone numbers, and email addresses, of friends, acquaintances, and relatives are recorded. The display control unit 23 reflects, in the preview image in the upper area, the address and the like of the first entry (i.e., a predetermined recipient) in the address book, or those of the entry (i.e., a predetermined recipient) selected in advance by the user of the mobile communication terminal 1, according to the set values of the various settings described above (S6).
That is, in the example illustrated in
In response to the operation of the print button, the storing control unit 25 reads out text data such as an address and a name from the address book in the storage area described above. The print data generation unit 26 converts the text data into image data (i.e., print data) for printing, that is, generates print data (S8A). Further, as illustrated in
That is, print direction data indicating a default print direction (e.g., horizontal direction) set for, for example, postal code, or a print direction (vertical direction or horizontal direction) set by the user, in addition to the print order data, is transmitted together with each print data.
In response to a reception of such print data, the CPU 52 of the handheld printer 2 controls the print start button 13 illustrated in
Next, the display control unit 23 displays a navigation image (horizontal writing preview) indicating the print position of the print data and the operation direction of the handheld printer 2 on the display 418 according to the print order (S9). Specifically, in this example, the print order data indicating “first” is added to the print data of the postal code. Therefore, as illustrated in
Such a navigation image can let the user recognize the print contents (in this case, postal code), the print position (in this case, the postal code print area PCA), and the operation direction of the handheld printer 2 (in this case, the horizontal direction). Therefore, the user operates the print start button 13 illustrated in
When the handheld printer 2 completes printing of the postal code assigned with “first” printing order in this example, the handheld printer 2 reports the completion of printing to the mobile communication terminal 1 (S11). Specifically, a print completion notification is transmitted to the mobile communication terminal 1 via the communication I/F 36 in response to a detection of the separation of the handheld printer 2 from the postcard by the gyro sensor 39.
Alternatively, the print completion notification may be sent to the mobile communication terminal 1 in response to further operation of the print start button 13 by the user, or may be sent to the mobile communication terminal 1 in response to completion of printing according to all the print data.
Next, as illustrated in
Such a navigation image can let the user recognize the print contents (in this case, address), the print position (in this case, the address print area ADA in the right end area of the postcard), and the operation direction of the handheld printer 2 (in this case, the vertical direction). Therefore, the user operates the print start button 13 illustrated in
When the handheld printer 2 completes printing of the address assigned with “second” printing order in this example, the handheld printer 2 reports the completion of printing to the mobile communication terminal 1 (S14).
Next, as illustrated in
Such a navigation image can let the user recognize the print content (in this case, the recipient name), the print position (in this case, the print area NPA at the center of the postcard), and the operation direction of the handheld printer 2 (in this case, the vertical direction). Therefore, the user operates the print start button 13 illustrated in
When the handheld printer 2 completes printing of the recipient name assigned with “third” printing order in this example, the handheld printer 2 reports the completion of printing to the mobile communication terminal 1 (S17).
In the description of the flowchart illustrated in
Further, when displaying the navigation image, as illustrated in
A description is given below of print operation performed by the handheld printer 2 with reference to
In S101, the user presses the power button 12 of the handheld printer 2. In response to this operation, power is supplied to each part from the power supply 31 of the handheld printer 2. The SoC 50 (the CPU 52) initializes each electronic device and starts up each device (S201 and S202). After the initialization is completed, for example, the power button 12 is lit up to notify the user that the printing is feasible (S203).
The user selects an image to be printed from an image input device such as a personal computer or the mobile communication terminal 1 (S102). As the user instructs execution of a print job, the mobile communication terminal 1 transmits image data in the format of, for example, tagged image file format (TIFF) or Joint Photographic Experts Group (JPEG) based on the above-mentioned print navigation program or printer driver via wireless communication (S103). In response to a reception of the image data, the SoC 50 (the CPU 52) of the handheld printer 2 notifies the user of the reception by, for example, blinking of the print start button 13 (S204).
The user determines the initial position of the handheld printer 2 on the print medium 3 on which printing is performed (S104), and operates (e.g., presses) the print start button 13 (S105). After that, the user moves the handheld printer 2 (performs freehand scanning) on the print medium 3. As a result, the image corresponding to the image data is printed on the print medium 3 (S106).
In response to the operation of the print start button 13, the SoC 50 (CPU 52) of the handheld printer 2 instructs each sensor 1F in the ASIC/FPGA 70 to read the information necessary for the position calculation of the navigation sensor 38. The navigation sensor 38 and the gyro sensor 39 start detecting the position information necessary for position calculation and store the position information in an internal memory (S218),
where dθ represents rotation angle for each sampling period, and dt represents a sampling time. Therefore, the rotation angle dθ for each sampling period is expressed as follows.
dθ=ω×dt Equation 2
Then, a current angle θ (time t=0 to N) is expressed as follows.
The angle dθ obtained from Equation 2 and the current angle θ obtained from Equation 3 are substituted into Equations 4 to 7 to calculate the two-dimensional coordinates (X1,Y1) from the origin (X0,Y0).
dX
0
=dx
s0×cos θ+dys0×sin θ Equation 4
dY
0
=−dx
s0×sin θ+dys0×cos θ Equation 5
X1=X0+dX0 Equation 6
Y1=Y0+dY0 Equation 7
When the coordinates of the navigation sensor 38 is calculated, the coordinates of each nozzle can be calculated by a known calculation based on the positional relationship between the navigation sensor 38 and the nozzle, which are mechanical (physical), since the layout of the devices are determined in advance.
Next, the navigation sensor I/F 72 communicates with the navigation sensor 38 and reads, as position information, the movement amount ΔX in the X-axis direction and the movement amount ΔY in the Y-axis direction of the handheld printer 2. Further, the gyro sensor I/F 75 communicates with the gyro sensor 39 and reads, as position information, the angular velocity ω of the handheld printer 2 (S205). The navigation sensor I/F 72 and the gyro sensor I/F 75 set the position based on the read information as the initial position having, for example, the X coordinate and the Y coordinate “0,0” (S206). After that, the timing generator 73 (a timing generation circuit) inside the ASIC/FPGA 70 measures time (S207). In S208, the SoC 50 determines whether it is the read timing set for each sensor. At each read timing set for each sensor (Yes in S208), the navigation sensor I/F 72 and the gyro sensor I/F 75 repeat reading of the above-mentioned information (S209).
The value detected by the navigation sensor 38 (movement amounts in the X-axis direction and Y-axis directions) and the value detected by the gyro sensor 39 (angular velocity ω) are necessary for calculating the current two-dimensional position coordinates with respect to the origin. Accordingly, preferably, such information (values) are read simultaneously.
The SoC 50 (CPU 52) reads information from the ASIC/FPGA 70, calculates the current position of the handheld printer 2 from the previously calculated position (X,Y), the movement amount (ΔX, ΔY) read at that time, and the angular velocity ω read at that time, and store the current position in the storage area (S210).
The SoC 50 (CPU 52) transmits the calculated current position information of the handheld printer 2 to the ASIC/FPGA 70. The ASIC/FPGA 70 calculates the position coordinates of each nozzle (current nozzle position) of the inkjet recording head 33 based on the predetermined relationship between the installation positions of the navigation sensor 38 and the inkjet recording head 33 (S211).
The DMAC (CACHE) 77 and the rotator 78 of ASIC/FPGA 70 read image data around each nozzle of the inkjet recording head 33 from the storage area based on the position information, and rotate the image data (convert the coordinates) in accordance with the designated position and tilt of the inkjet recording head 33 (S212). After that, the CPU 52 compares the image data with the coordinates of each nozzle position (S213). In response to a determination that a set discharge condition is satisfied (S214: Yes), the image data is transmitted to the inkjet recording head controller 74 (S215).
By repeatedly executing the processes from S208 to S215, the CPU 52 controls printing of the image on the print medium 3. In response to a determination that the printing of the entire image is completed (S216: Yes), the SoC 50 (the CPU 52) controls the power button 12 or the print start button 13 to blink (S217) to notify the user of the completion of printing.
Even when the printing of the entire image has not been completed, the user may determine that subsequent printing is unnecessary and operate the print start button 13. As a result, subsequent printing is cancelled. Processing in the flowchart illustrated in
As described above, the printing system according to the present embodiment displays the print contents such as letters, symbols, and images to be printed, the position where printing is performed, and the direction in which the handheld printer 2 is operated on the display 418 of the mobile communication terminal 1. With such a display, the user can recognize the print position and the operating direction of the handheld printer 2 in advance and accurately print letters and the like of desired print contents in a desired print area. Further, since the user only needs to operate the handheld printer 2 at the print position displayed on the display 418 and in the operation direction displayed on the display 418, the usability (operability) can be improved.
Finally, the above-described embodiments are presented as examples and are not intended to limit the scope of the present invention. The above-described embodiments can be implemented in other various forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. In addition, the embodiments and modifications or variations thereof are included in the scope and the gist of the invention, and are included in the invention described in the claims and the equivalent scopes thereof.
Any one of the above-described operations may be performed in various other ways, for example, in an order different from the one described above.
The above-described embodiments are illustrative and do not limit the present disclosure. Thus, numerous additional modifications and variations are possible in light of the above teachings. For example, elements and/or features of different illustrative embodiments may be combined with each other and/or substituted for each other within the scope of the present disclosure.
Each of the functions of the described embodiments may be implemented by one or more processing circuits or circuitry. Processing circuitry includes a programmed processor, as a processor includes circuitry. A processing circuit also includes devices such as an application specific integrated circuit (ASIC), digital signal processor (DSP), field programmable gate array (FPGA) and conventional circuit components arranged to perform the recited functions.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2019-212754 | Nov 2019 | JP | national |
