This patent application is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application Nos. 2020-078716, filed on Apr. 27, 2020, and 2020-162236, filed on Sep. 28, 2020, in the Japan Patent Office, the entire disclosure of which is hereby incorporated by reference herein.
The present disclosure relates to an information processing apparatus, an information processing system, and a method for processing information.
In recent years, as laptop personal computers become compact and smart devices have spread, compactness and portability of printers are desired. For example, there are handheld printers from which a paper conveyance mechanism is omitted for enhancing compactness and portability.
Such a handheld printer receives a print request including data of an image to be printed from, for example, a smart device or a personal computer. In the present disclosure, an “image” is an example of information targeted for printing processing (printing target information) on a recording medium, and “print request” include data used to control a recording head or the like for printing the information. A user holds a housing of the handheld printer with hand and operates the printer on a recording medium such as a notebook or paper. As a result, ink is discharged according to the amount of operation (movement of the handheld printer), and the information targeted for printing is printed on the recording medium.
Further, there are speech recognition result output devices that enables a user to obtain a print using speech recognition without any manual operation.
An embodiment of the present disclosure provides an information processing apparatus that includes a voice input device configured to acquire voice, and circuitry. The circuitry is configured to identify, in a storage area, information as a printing target by a printer based on a recognition result of the voice acquired by the voice input device; transmit, to the printer, a print request of the identified information; and display a screen presenting the identified information on a display in response to transmission of the print request.
A more complete appreciation of the disclosure and many of the attendant advantages and features thereof can be readily obtained and understood from the following detailed description with reference to the accompanying drawings, wherein:
The accompanying drawings are intended to depict embodiments of the present invention and should not be interpreted to limit the scope thereof. The accompanying drawings are not to be considered as drawn to scale unless explicitly noted. Also, identical or similar reference numerals designate identical or similar components throughout the several views.
In describing embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that have a similar function, operate in a similar manner, and achieve a similar result.
Referring now to the drawings, embodiments of the present disclosure are described below. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
A printing system according to a first embodiment of the present disclosure is described with reference to the accompanying drawings.
System Configuration
The handheld printer 2 is made lightweight and compact by omitting a mechanism to convey a medium (a sheet) on which printing is performed. As illustrated in
Hardware Configuration of Mobile Communication Terminal
The CPU 401 controls the entire operation of the mobile communication terminal 1. The ROM 402 stores programs of an operating system (OS) used by the CPU 401 or by an initial program loader (IPL) to boot the CPU 401. Further, as an example, the OS includes a speech recognition program for recognizing voice. When the mobile communication terminal 1 performs speech recognition, the mobile communication terminal 1 performs speech recognition according to the speech recognition program. Specifically, the CPU 401 (a speech recognition processing unit 151 in
Alternatively, for example, a speech recognition server 601 (an external speech recognition device) connected to a public network such as the Internet or a private network such as a local area network (LAN) may store the speech recognition program to implement the speech recognition function. In this case, the CPU 401 of the mobile communication terminal 1 transmits the voice acquired from the microphone 415 to the speech recognition server 601 via the base transceiver station 602 and the network 600. The CPU of the speech recognition server 601 recognizes the speech received from the mobile communication terminal 1 according to the speech recognition program stored in the storage area of the speech recognition server 601 and transmits the recognition result to the mobile communication terminal 1 via the network 600 and the base transceiver station 602. The CPU 401 of the mobile communication terminal 1 acquires printing target information, such as an image, corresponding to the recognition result of speech received from the speech recognition server 601, from the data storage area 803, generates a print request of the information, and transmits the print request to the handheld printer 2.
At this time, it is difficult for the user to know whether or not the printing target information, identified based on the speech recognition result, matches the information intended by the user for panting. Therefore, at this time, the CPU 401 displays a preview of a printed state of the printing target information, on the display 418, which will be described in detail with reference to
The RAM 403 is used as a work area for the CPU 401. The EEPROM 404 performs reading or writing of various data such as a mobile communication terminal program under control of the CPU 401. Further, the EEPROM 404 stores a data generation program (an example of information processing program) for generating a print request of information targeted for printing, to be transmitted to the handheld printer 2.
The CMOS sensor 405 generates image data corresponding to image capture light from a subject, under the control of the CPU 401. In addition to the CMOS sensor, or alternative to the CMOS sensor, a different image capture device such as a charge-coupled device (CCD) image sensor may be used.
The image sensor I/F 406 is an interface for connecting the CMOS sensor 405 to a bus line 410. Examples of the acceleration and orientation sensor 407 include various sensors such as an electromagnetic compass to detect geomagnetism, a gyrocompass, and an accelerometer. The media I/F 409 is an interface for connecting a recording medium 408 such as a flash memory to the bus line 410. To and from the recording medium 408, for example, printing target information is written and read out via the media I/F 409. The printing target information can be stored in another storage area such as the ROM 402 or the RAM 403. The GPS receiver 411 receives a GPS signal from a GPS satellite.
The mobile communication terminal 1 further includes a long-range communication circuit 412, a CMOS sensor 413, an image sensor I/F 414, a microphone 415, a speaker 416, a sound input/output I/F 417, a display 418, an external device I/F 419, a short-range communication circuit 420, an antenna 420a for the short-range communication circuit 420, and a touch panel 421.
The long-range communication circuit 412 communicates with other devices via a communication network 412a. The CMOS sensor 413 captures an image of a subject and generates image data under the control of the CPU 401. The image sensor I/F 414 is an interface for connecting the CMOS sensor 413 to the bus line 410. The microphone 415 functions as a voice input device, and collects voice of a user designating the information targeted for printing, such as an image or text. The speaker 416 outputs sound such as music or voice corresponding to the audio signal. The sound input/output I/F 417 is a circuit for inputting and outputting an audio signal between the microphone 415 and the speaker 416 under control of the CPU 401.
The display 418 can be, for example, a liquid crystal display, an organic electro luminescence (EL) display, or the like. The external device I/F 419 is an interface for connection with various external devices. The short-range communication circuit 420 is a communication circuit in compliance with the near field communication (NFC), the Bluetooth (registered trademark), and the like. The touch panel 421 is disposed on the display 418 and detects a touch (contact operation) of the user.
The mobile communication terminal 1 further includes the bus line 410. The bus line 410 is, e.g., an address bus or a data bus configured to electrically connect the components such as the CPU 401 illustrated in
Functional Configuration of Mobile Communication Terminal
As described above, in the case of the mobile communication terminal 1 having the speech recognition function, the speech recognition processing unit 151 recognizes the speech acquired by the microphone 415. On the other hand, in the case where the speech recognition server 601 on the network 600 has the speech recognition function, the speech recognition processing unit 151 transmits the voice acquired by the microphone 415 via the communication control unit 153 to the speech recognition server 601. Then, the speech recognition processing unit 151 acquires a speech recognition result returned from the speech recognition server 601.
The data identification unit 152 serving as an identifying unit identifies, among information stored in the data storage area 803, printing target information targeted for printing, such as an image or text, corresponding to the speech (recognition result) recognized by the speech recognition processing unit 151. The communication control unit 153 communicates with the speech recognition server 601 via the base transceiver station 602 and the network 600.
The display control unit 154 displays, on the display 418, for example, a list screen of information targeted for printing and screens corresponding to a speech recognition process and transfer of a print request of information. In addition, the display control unit 154 displays, on the display 418, a preview of the information, such as an image or text, identified as the target of printing. The cancellation processing unit 155 cancels the current operation in response to an instruction of cancellation by speech or operation of a button.
Each of the speech recognition processing unit 151 to the cancellation processing unit 155 illustrated in
In another example, the data generation program is stored in a computer-readable recording medium such as a compact disc read only memory (CD-ROM) and a flexible disk (FD), in an installable or executable file format, for distribution. In still another example, the data generation program is stored in a computer-readable recording medium such as a compact disc-recordable (CD-R), a digital versatile disk (DVD), a Blu-ray Disc (registered trademark), and a semiconductor memory, for distribution. In still another example, the data generation program is installable through a network such as the Internet. In still another example, the data generation program is preloaded in a ROM, etc., of the mobile communication terminal 1.
(Storing Printing Target Information)
Next, a description is given of printing target information, which is stored in the data storage area 803 of the EEPROM 404 of the mobile communication terminal 1.
Specifically, for example, text data of an address “Ebina-shi, Kanagawa-ken . . . ” is association with the title “A” and stored in the data storage area 803. A QR code (registered trademark) (and an error correction code) is associated with the title “B” and stored in the data storage area 803. Further, an image (and a physical address of the storage location thereof) is associated with the title “J” and stored in the data storage area 803. Further, a stamp (and a physical address of the storage location thereof) is associated with the title “C” and stored in the data storage area 803. Further, data indicating the printing direction, a postal code, and an address are associated with the title “P” and stored in the data storage area 803.
In the example illustrated in
External Configuration of Handheld Printer
The period from the operation of the power button 12 to the next operation of the power button 12 is the power-on period of the handheld printer 2. The power button 12 is lit during the power-on period.
The print start button 13 also serves as an answerback button when a print request of information is received from the mobile communication terminal 1. Specifically, when the handheld printer 2 receives a print request of information from the mobile communication terminal 1, a controller 35 (
Alternatively, the housing 11 of the handheld printer 2 may include a display to indicate the reception of a print request of information. Yet alternatively, the handheld printer 2 may include a speaker to output a sound indicating the reception of a print request of information.
Further, when the print start button 13 is operated, the handheld printer 2 performs printing according to the operation of the handheld printer 2 by the user. An inkjet recording head is disposed on a bottom face 2b of the handheld printer 2. The recording head performs printing according to the movement of the handheld printer 2 operated by the user. Further, the operation direction of the handheld printer 2 is usually fixed in the direction indicated by arrow SD in
Further, when the housing 11 is moved in a direction other than the direction indicated by arrow SD in
Further, a guide 14 is disposed on a lateral side face 2c of the housing 11 facing in the print direction indicated by arrow SD in
The guide 14 has a width that represents a print width in which printing is performed in one operation. At a center of the guide 14, a center line CL extending from the lateral side face 2c toward the operation direction is provided. As one example, the center line CL is a thin red line. As described above, the width of the guide 14 indicates the width printed by one operation. Therefore, the center line CL indicates the center of the width printed by one operation. Therefore, the user aligns the center line CL with the center of the print start position and moves the handheld printer 2. As a result, information targeted for printing, such as an image or text, can be printed with the center positions aligned.
Further, the handheld printer 2 includes a head cap 16 that covers the bottom face 2b when printing is not performed. Covering the bottom face 2b with the head cap 16 can prevent the recording head from extremely drying in a non-printing period and the inconvenience that the recording head is dusted or scratched.
Hardware Configuration of Handheld Printer
The power supply 31 is rechargeable battery (secondary battery) and generates driving power for the handheld printer 2. The power supply circuit 32 supplies the power from the power supply 31 to necessary components. The inkjet recording head 33 discharges ink to the recording medium 3 by an inkjet method, to print the information targeted for printing, such as an image or text. The inkjet recording head drive circuit 34 controls driving of the inkjet recording head 33 in accordance with the information targeted for printing, such as an image or text. The controller 35 controls the entire handheld printer 2.
The communication I/F 36 is for wireless communication with the mobile communication terminal 1 by short-range wireless communication such as BLUETOOTH (registered trademark). The OPU 37 includes a light emitting diode (LED) for displaying the state of the handheld printer 2, a switch for the user to instruct the handheld printer 2 to start printing, and the like, such as the power button 12 and the print start button 13. The OPU 37 can further include a liquid crystal display or a touch panel. The OPU 37 may further has a voice input capability.
The navigation sensor 38 includes an accelerometer. The navigation sensor 38 detects the amount of movement of the handheld printer 2 in the X-axis direction and the amount of movement in the Y-axis direction, based on the acceleration during the operation of the handheld printer 2. The gyro sensor 39 is configured to detect the angular velocity applied to the handheld printer 2. The DRAM 40 and ROM 41 are storage areas for, for example, print data and operation direction information indicating the operation direction of the handheld printer 2 at the time of printing. Further, the ROM 41 stores a print control program and drive waveform data of the inkjet recording head 33.
In the handheld printer 2 having the above-described configuration, in response to a reception of print request of information from the mobile communication terminal 1, the controller 35 stores generated print data in the DRAM 40 or the like and calculates the position of each nozzle of the inkjet recording head 33 based on information input from the navigation sensor 38 and the gyro sensor 39. While the user operates the handheld printer 2, the controller 35 continuously calculates the position of each discharge nozzle and acquires only the print data corresponding to the calculated position from the DRAM 40. Then, the controller 35 compares the position of the acquired image with the position of each nozzle. When determining the agreement between the compared positions, the controller 35 supplies the print data of the nozzle to the inkjet recording head drive circuit 34.
The inkjet recording head drive circuit 34 supplies print timing information together with the print data to the inkjet recording head 33. Based on the print timing information, the inkjet recording head 33 discharges ink corresponding to the print data onto the recording medium 3. As a result, an image or text is recorded on the recording medium 3 according to the print data designated by the user.
The head cap detector 43 detects whether or not the head cap 16 is attached to the handheld printer 2. The timer 42 measures the time and supplies measured time information to the controller 35. The controller 35 monitors the dry state of the inkjet recording head 33, based on the timekeeping information and whether or not the head cap 16 is attached, and performs warning control or the like at a predetermined timing.
Functional Configuration of Controller
The SoC 50 includes, in addition to a CPU 52, a position calculation circuit 53 that performs position calculation, a memory controller 54 that controls writing and reading of data to and from an external memory such as a DRAM, and a ROM controller 55 that controls writing and reading of data to and from the ROM 41.
The ASIC/FPGA 70 includes a navigation sensor I/F 72, a timing generator 73 (e.g., a circuit) for print timing and sensing timing, an inkjet recording head controller 74, a gyro sensor I/F 75, an image RAM 76, a direct memory access controller (DMAC) 77, a rotator 78, and an interrupt controller 79.
The navigation sensor I/F 72 stores a movement amount ΔX in the X-axis direction and a movement amount ΔY in the Y-axis direction of the handheld printer 2 in an internal register. The gyro sensor I/F 75 stores an angular velocity ω received from the gyro sensor 39 in an internal register. The timing generator 73 notifies the navigation sensor I/F 72 of the timing of reading of the information from the navigation sensor 38, and notifies the inkjet recording head controller 74 of the drive timing for printing.
The DMAC (CACHE) 77 and the rotator 78 read the print data around each nozzle of the inkjet recording head 33 from the DRAM 40 (or the ROM 41) based on the position information calculated by the position calculation circuit 53 of the SoC 50. Then, the DMAC (CACHE) 77 and the rotator 78 rotate the read print data according to the position and inclination of the inkjet recording head 33, and supply the read image data to the inkjet recording head controller 74.
The image RAM 76 temporarily stores the print data read from the DRAM 40 by the DMAC (CACHE) 77. The inkjet recording head controller 74 (a discharge control unit) supplies control signals and the print data to the inkjet recording head drive circuit 34. In response to completion of the communication between the navigation sensor I/F 72 and the navigation sensor 38, the interrupt controller 79 notifies the SoC 50 of the completion of the communication therebetween. The interrupt controller 79 also notifies the SoC 50 of a status such as an error.
Printing Operation of Handheld Printer
A description is given below of print operation performed by the handheld printer 2 with reference to
In S100, as the user presses the power button 12 of the handheld printer 2, in the handheld printer 2, the power supply 31 supplies power to each part. Then, the SoC 50 (the CPU 52) initializes each electronic device and starts up each device (S201). After the initialization is completed (Yes in S202, for example, the power button 12 is lit up to notify the user that the handheld printer 2 is turned on (S203).
The user inputs voice (speech) to an image input device such as the mobile communication terminal 1 or a personal computer, to designate printing target information in S101. According to the data generation program (or printer driver), the mobile communication terminal 1 reads out printing target information, such as an image or text, designated by speech of the user from the data storage area 803 and displays the information. The user determines the printing target information in S102. Identifying the printing target information, on the mobile communication terminal 1, will be described later with reference to
In response to the reception of the print request of printing target information from the mobile communication terminal 1, the SoC 50 (the CPU 52) of the handheld printer 2 performs, for example, blinking of the print start button 13, thereby notifying the user of the reception of the print request (S204). Further, the CPU 52 of the handheld printer 2 generates the print data of the printing target information, based on the print request received from the mobile communication terminal 1 (S219). Alternatively, the mobile communication terminal 1 may generate the print data.
As the user moves (operates) the handheld printer 2, the printing target information, such as an image or text, is printed according to the generated print data on the recording medium 3.
The print operation is described in detail. In S205, the SoC 50 (the CPU 52) of the handheld printer 2 instructs each sensor I/F in the ASIC/FPGA 70 to read the information necessary for the position calculation of the navigation sensor 38, with reference to the print start position. The navigation sensor 38 and the gyro sensor 39 start detecting the position information necessary for position calculation and store the position information in an internal memory (S218).
where dθ represents rotation angle for each sampling period, and dt represents a sampling time. Therefore, an angle dθ for each sampling period is expressed as Equation 2.
dθ=ω×dt Equation 2
Then, a current angle θ (time t=0 to N) is expressed as Equation 3.
The angle dθ obtained from Equation 2 and the current angle θ obtained from Equation 3 are substituted into Equations 4 to 7 to calculate the two-dimensional coordinates (X1,Y1) from the origin (X0,Y0).
dX
0
=dx
s0×cos θ+dys0×sin θ Equation 4
dY
0
=dx
s0×sin θ+dys0×cos θ Equation 5
X1=X0+dX0 Equation 6
Y1=Y0+dY0 Equation 7
When the coordinates of the navigation sensor 38 are calculated, the coordinates of each nozzle can be calculated by a known calculation based on the mechanical (physical) positional relationship between the navigation sensor 38 and the nozzle since the layout of the devices are determined in advance.
Next, the navigation sensor I/F 72 communicates with the navigation sensor 38 and reads, as position information, the movement amount ΔX in the X-axis direction and the movement amount ΔY in the Y-axis direction of the handheld printer 2. Further, the gyro sensor I/F 75 communicates with the gyro sensor 39 and reads, as position information, the angular velocity co of the handheld printer 2 (S205). The navigation sensor I/F 72 and the gyro sensor I/F 75 set the position based on the read information as the initial position having, for example, the X coordinate and the Y coordinate “0,0” (S206). After that, the timing generator 73 (a timing generation circuit) inside the ASIC/FPGA 70 measures time (S207). At each read timing set to each sensor (Yes in S208), the navigation sensor I/F 72 and the gyro sensor I/F 75 repeat reading of the above-mentioned information (S209).
The value detected by the navigation sensor 38 (movement amounts in the X-axis direction and Y-axis directions) and the value detected by the gyro sensor 39 (angular velocity co) are necessary for calculating the current two-dimensional position coordinates with respect to the origin. Accordingly, preferably, such information (values) are read simultaneously.
The SoC 50 (the CPU 52) reads information from the ASIC/FPGA 70 and calculates the current position of the handheld printer 2 from the previously calculated position (X,Y), the movement amount (ΔX, AY) read at that time, and the angular velocity co read at that time. Then, the SoC 50 stores the current position in the storage area (S210).
The SoC 50 (the CPU 52) transmits the calculated current position information of the handheld printer 2 to the ASIC/FPGA 70. The ASIC/FPGA 70 calculates the position coordinates of each nozzle (current nozzle position) of the inkjet recording head 33 based on the predetermined relationship between the installation positions of the navigation sensor 38 and the inkjet recording head 33 (S211).
The DMAC (CACHE) 77 and the rotator 78 of ASIC/FPGA 70 read image data around the nozzles of the inkjet recording head 33 from the storage area based on the position information, and rotate the image data (convert the coordinates) in accordance with the designated position and tilt of the inkjet recording head 33 (S212). Then, the coordinates of the image data and each nozzle position are compared (S213). In response to a determination that a set discharge condition is satisfied (S214: Yes), the print data is transmitted to the inkjet recording head controller 74 (S215).
By repeatedly executing the processes from S208 to S215, the SoC 50 (the CPU 52) controls printing of the printing target information (e.g., an image or text) on the recording medium 3. In response to a determination that the printing of the entire image is completed (S216: Yes), the SoC 50 (the CPU 52) controls the power button 12 or the print start button 13 to blink (S217) in order to notify the user of the completion of printing.
Even when the printing of the entire image has not been completed, the user may determine that subsequent printing is unnecessary and operate the print start button 13. As a result, subsequent printing is cancelled. Processes in the flowchart illustrated in
(Operation of Mobile Communication Terminal for Printing)
The user first operates the mobile communication terminal 1 to instruct print start. The operation for instructing print start may be operating a hardware or software button, or may be voice input. In response to a reception of a print start instruction, the display control unit 154 of the mobile communication terminal 1 illustrated in
The default screen includes a voice input button 800 for designating voice input. When the user designates voice input, the user operates the voice input button 800. In S2 of the flowchart of
On the other hand, in response to a detection of the operation of the voice input button 800 (S2: Yes), the display control unit 154 displays a voice input screen illustrated in
When the voice input screen is displayed, the user inputs, to the microphone 415 of the mobile communication terminal 1, speech to designate printing target information, such as an image or text. In S4, the speech recognition processing unit 151 determines the presence or absence of the speech of the user.
As illustrated in
In response to a detection, by the speech recognition processing unit 151, of speech input from the user (S4: Yes), the data identification unit 152 determines whether any of the various information registered in the data storage area 803 matches the speech of the user, and identifies the information matching the recognition result of the input speech by the user, based on the determination result (S5).
Specifically, in the case of speech recognition on the mobile communication terminal 1 side, the speech recognition processing unit 151 recognizes the input speech based on the speech recognition function included in the OS. Then, the speech recognition processing unit 151 refers to the data storage area 803 based on the recognition result, and identifies the information corresponding to the input speech.
On the other hand, in the case of speech recognition on the speech recognition server 601 side, the speech recognition processing unit 151 transmits the speech acquired by the microphone 415, via the communication control unit 153 and the long-range communication circuit 412, to the speech recognition server 601. The speech recognition server 601 recognizes the received speech according to the speech recognition program and returns the recognition result to the mobile communication terminal 1. The speech recognition processing unit 151 of the mobile communication terminal 1 refers to the data storage area 803 based on the recognition result received from the speech recognition server 601 and identifies the information corresponding to the input speech.
Specifically, as described with reference to
Therefore, in response to an input speech of the title “A” by the user, the data identification unit 152 identifies the text data of the address associated with the title “A” from the data storage area 803. Further, in response to an input speech of the title “F,” the data identification unit 152 identifies the QR code (registered trademark) associated with the title “F” from the data storage area 803.
When none of information stored in the data storage area 803 matches the recognition result of the input speech, the data identification unit 152 does not identify the information corresponding to the input speech in the data storage area 803 (S6: No). In this case, the display control unit 154 displays, for example, an error screen illustrated in
When the data storage area 803 stores the information that matches the recognition result of the input speech, and the information corresponding to the input speech is identified in the data storage area 803 (S6: Yes), the communication control unit 153 controls the short-range communication circuit 420 (an example of a transmission unit) to transmit a print request of the identified printing target information to the handheld printer 2 (S7). That is, in the above example, since “A” is input by speech, the text data of the address associated with the title “A” is transmitted to the handheld printer 2.
In response to transmission of the print request, the display control unit 154 displays a preview screen for displaying the printing target information, such as an image or text. In addition, while the data is being transferred, the display control unit 154 indicates that the print request is being transmitted on the display 418. For example, the display control unit 154 displays a transmission dialog such as that illustrated in
Next, in S8, the communication control unit 153 determines whether or not the data transmission to the handheld printer 2 is completed. In response to a determination, by the communication control unit 153, that the transmission of the printing target information to the handheld printer 2 is completed (S8: Yes), the display control unit 154 hides the transmission dialog superimposed on the preview screen (S9). In the present embodiment, the transmission dialog is superimposed on the preview screen, but the manner of display is not limited thereto. Alternatively, for example, only the transmission dialog is displayed, and, after the transmission is completed, the transmission dialog is hidden, and the preview screen is displayed.
For example,
Further, based on the above-mentioned print direction data, the display control unit 154 displays the print direction of the address (that is, the operation direction of the handheld printer 2) by an animation in which the arrow icon moves from the left to the right on the surface on which
Further,
Further, the display control unit 154 displays a cancel button 801 for instructing the cancellation of printing, on the display 418, together with such a preview screen.
In response to a detection, by the display control unit 154, of the operation of the cancel button 801 (S10: Yes), the communication control unit 153 transmits, to the handheld printer 2, a notification of the cancellation of the print request (S16). Thus, the communication control unit 153 controls the handheld printer 2 to delete the data (identified information) acquired from the mobile communication terminal 1. Further, when the notification of the cancellation of the print request is transmitted to the handheld printer 2, the display control unit 154 hides the above-mentioned preview screen in S15. Thus, the flow of operations in the flowchart of
With the preview display, the user recognizes the printing direction and the size of printing target information, such as an image or text, and operates the handheld printer 2 to print the information designated by speech input. When the printing is completed, the handheld printer 2 transmits a print completion notification to the mobile communication terminal 1. The display control unit 154 monitors the presence or absence of the print completion notification from the handheld printer 2 (S14). In response to a reception of the print completion notification (S14: Yes), in S15, the display control unit 154 displays the above-mentioned preview screen. Then, the flow of operations in the flowchart of
The first embodiments provides the following effects.
As described above, the printing system of the first embodiment displays, on the display 418, a preview of printing target information, such as an image, designated to be printed by a speech input by the user, before the handheld printer 2 performs the printing. As a result, the user can confirm the printing target information, such as an image to be printed, before the handheld printer 2 actually performs the printing. Thus, printing failure can be prevented.
A description is given of a second embodiment of the present disclosure.
In the first embodiment, a plurality of information classified in different classifications have titles different from each other. The second embodiment is different from the first embodiment in that when the classifications are different, there are two or more different printing target information having the same title. In the following description of the second embodiment, descriptions of the same parts as in the first embodiment will be omitted, and portions different from the first embodiment will be described.
Specifically, for example, the text data “ABC-12345-DE” is associated with the title “Part A” in the text classification and stored in the data storage area 803. Further, a QR code (and an error correction code) is associated with the title “Part A” in the QR code classification and stored in the data storage area 803.
That is, in the example illustrated in
A description is given of print processing operations performed by the mobile communication terminal 1, corresponding to voice input.
In response to a detection of a user's speech by the speech recognition processing unit 151 (S4: Yes), the data identification unit 152 determines whether information matching the input user' speech is present among the various information registered in the data storage area 803, and identifies information matching the recognition result of the input user's speech based on the determination result (S20). The processes for identifying the information in S20 in the present embodiment are described in detail below.
In response to a determination that there is a title matching the speech input in the classification of the classification code “1” (S22: Yes), the data identification unit 152 identifies the printing target information associated with the title (S23). Then, the process proceeds to S24.
On the other hand, in response to a determination that there is no title matching the speech input in the classification of the classification code “1” (S22: No), the data identification unit 152 proceeds the process directly to S24.
In S24, the data identification unit 152 determines whether the value N of the classification code is the maximum value (“3” in this example).
In response to a determination that the value N of the classification code is not the maximum value (“3” in this example) (S24: No), the data identification unit 152 increments the value N of the classification code by “1” (S25), and returns to S22.
On the other hand, in response to a determination that the value N of the classification code is the maximum value (“3” in this example) (S24: Yes), the data identification unit 152 ends the processes in S20, and returns to S6.
Specifically, as described above with reference to
As described above, in the present embodiment, since one title may be associated with a plurality of printing target information, the process of displaying a preview screen is different from that of the first embodiment. A description is given in detail below of the operation of the display control unit 154 performed in S30, to display a preview screen in the present embodiment.
When the display control unit 154 determines there is not a plurality of transmitted printing target information (S31: No), the display control unit 154 displays, on the display 418, a preview screen of single printing target information (S32), and ends the processes in S30. Then, the display control unit 154 proceeds the process to S10.
On the other hand, when the display control unit 154 determines that there is a plurality of printing target information having the same title (S31: Yes), the display control unit 154 determines whether to perform one-pass print or multi-pass print (S33).
The determination of whether to print the information in one pass or multiple passes is not limited to the above-described example in which, at each determination that there is a plurality of information, the confirmation screen is displayed and the operator is required to input the confirmation. Alternatively, the display control unit 154 displays, for example, an initial setting screen that allows the user to preliminarily set whether to print a plurality of printing target information in one pass or multiple passes. Based on such a setting, the display control unit 154 can determine whether to print the information in one pass or multiple passes.
When the display control unit 154 determines that the information is to be printed in one pass (S33: Yes), the display control unit 154 displays a preview screen including previews of all the printing target information on the display 418 (S34), and proceeds to S35.
In S35, the display control unit 154 waits for the operation of changing the print order of the plurality of printing target information having the same title. For example, the following operation is performed for changing the print order of the plurality of printing target information having the same title. For example, as illustrated in
For example, the print order of a plurality of printing target information can be changed by the following method. For example, the operator drags and drops the preview of the printing target information displayed on the preview screen, to change the print order. As another method, the operator assigns a sequence number to each of the previews of the plurality of printing target information displayed on the preview screen, to change the print order. As yet another method, the operator sequentially operates the respective previews of the plurality of printing target information displayed on the preview screen, to change the print order.
When the display control unit 154 detects the above-described operation to change the print order of the plurality of printing target information having the same title (S35: Yes), the display control unit 154 receives the changed print order (S36). Then, the display control unit 154 returns to S34 and displays a preview screen including the previews of the plurality of printing target information in which the print order has been changed. In the example illustrated in
On the other hand, for example, when the operator operates the “No” button B4 and does not perform an operation for changing the print order of the plurality of printing target information having the same title (S35: No), the display control unit 154 ends the process of S30 and the proceeds to S10.
Further, when the display control unit 154 determines that the information is to be printed in a plurality of passes (S33: No), the display control unit 154 sequentially displays a preview screen presenting a preview of one piece of printing target information in each print pass (S37). Then, the process proceeds to S38.
In S38, the display control unit 154 waits for the operation of changing the print order of the plurality of printing target information having the same title. For example, the following operation is performed for changing the print order of the plurality of printing target information. For example, as illustrated in
For example, the print order of a plurality of printing target information can be changed by the following method. For example, the operator assigns sequence numbers to the plurality of printing target information, respectively, displayed on the preview screen, to change the print order.
When the display control unit 154 detects the above-described operation to change the print order of the plurality of printing target information having the same title (S38: Yes), the display control unit 154 receives the changed print order (S39). Then, the display control unit 154 returns to S37 and sequentially displays, for each pass, a preview screen presenting a preview of printing target information in which the print order has been changed.
On the other hand, for example, when the operator operates the “No” button B4 and does not perform an operation for changing the print order of the plurality of printing target information having the same title (S38: No), the display control unit 154 ends the process of S30 and the proceeds to S10.
In the case of printing a plurality of printing target information in a plurality of passes, between the process of S10 and the process of S14, the mobile communication terminal 1 receives a print completion notification from the handheld printer 2, and displays a preview screen for the next pass.
Note that, in the case where the print order is not changed, the printing system may be configured to perform the printing in the presented order when the handheld printer 2 is operated (moved), without receiving operation (e.g., pressing) of the “Yes” button B3 or the “No” button B4.
As described above, the printing system according to the present embodiment displays, on the display 418, respective previews of a plurality of printing target information, such as images, having the same title, designated to be printed by a speech input by the user, before the handheld printer 2 performs the printing. As a result, regarding the plurality of printing target information having the same tile, the operator can confirm the printing target information, such as images to be printed, before the handheld printer 2 actually performs the printing. Thus, printing failure can be prevented.
Although the exemplary embodiments have been described above, such descriptions are not intended to limit the scope of the present disclosure to the illustrated embodiments. The above-described embodiments can be implemented in other various forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention.
For example, the above descriptions concern an example in which the mobile communication terminal 1 performs speech recognition and previews the printing target information, such as a text to be printed. Alternatively, the handheld printer 2 may perform speech recognition and preview the printing target information, such as the text to be printed, on a display of the handheld printer 2.
It is therefore to be understood that each embodiment and each modification thereof are within the scope and summary of the disclosure and within the scope of the appended claims and equivalents thereof. Any one of the above-described operations may be performed in various other ways, for example, in an order different from the one described above.
Each of the functions of the described embodiments may be implemented by one or more processing circuits or circuitry. Processing circuitry includes a programmed processor, as a processor includes circuitry. A processing circuit also includes devices such as an application specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), and conventional circuit components arranged to perform the recited functions.
Number | Date | Country | Kind |
---|---|---|---|
2020-078716 | Apr 2020 | JP | national |
2020-162236 | Sep 2020 | JP | national |