Patent Grant
11922929
The present invention relates to a presentation support system.
JP-A-2002-259635 describes a system that displays keywords from statements made by participants in an argument during the argument in combination of drawing objects and texts.
JP-A-2017-224052 describes a presentation evaluation device using a voice analysis terminal.
In a usual presentation material, such as PowerPoint (registered trademark), an order of materials is fixed, and the presentation material cannot be flexibly varied according to an audience and a description by a presenter. Additionally, even using correct terms in a presentation, there may be a case that the terms carry conviction or do not carry conviction depending on a direction of the conversation.
Accordingly, it is preferred that the presentation material can be guided along a further attractive story. Especially, it is preferred that the presentation material can be dynamically varied according to the terms used in the presentation. Further, when the presentation is performed, fulfillment of a duty for explanation can be preferably easily checked. An object of this Specification is to provide any of a system that can perform these preparations and a system that can perform these processes.
Analyzing association of related terms and displaying a related term to be used next to a certain related term allow promoting a further attractive presentation material. Additionally, a record that respective terms have been described can be kept.
An aspect described in this Specification relates to a presentation support system 1. This presentation support system 1 includes a presentation material storage unit 3, a related term storage unit 5, a subsequent information storage unit 7, a term analysis unit 9, a related term analysis unit 11, a display unit 13, and a subsequent related term selection unit 15.
Presentation Support System 1
The presentation support system is a system using a computer for support when a speaker (presenter) gives a description or a presentation using a presentation material. The presentation support system 1 especially relates to a system that recognizes the presentation by the presenter by voice by the computer and extracts a presentation material (or a candidate for the presentation material) preferred to be displayed next by the computer using terms included in the presentation recognized by voice for support such that the presentation can be resourcefully and dynamically performed.
The presentation material storage unit 3 is an element configured to store a presentation material.
The related term storage unit 5 is an element configured to store a plurality of related terms related to the presentation material stored by the presentation material storage unit 3.
The subsequent information storage unit 7 is an element configured to store information on a subsequent related term as one or a plurality of related terms preferred to be used next to each of the plurality of related terms stored by the related term storage unit 5.
The term analysis unit 9 is an element configured to analyze a word included in a conversation to obtain conversation information.
The related term analysis unit 11 is an element configured to analyze whether the word analyzed by the term analysis unit 9 is any of the plurality of related terms.
The display unit 13 is an element configured to display the presentation material.
The subsequent related term selection unit 15 is an element configured to select the subsequent related term related to the analyzed related term from the subsequent information storage unit 7 based on information on the analyzed related term as the related term analyzed by the related term analysis unit.
With such a configuration, the system of this aspect allows preparation to appropriately and resourcefully adjust an order of the presentation materials and a related presentation material used according to the presentation.
A preferred aspect of the above-described presentation support system 1 further includes a related term display control unit 17 configured to cause the display unit 13 to display the subsequent related term related to the analyzed related term selected by the subsequent related term selection unit 15.
A preferred aspect of the above-described presentation support system 1 relates to the following. The presentation material storage unit 3 is configured to associate each related presentation material included in the presentation material with any of the plurality of related terms and store the related presentation material. The system includes a related presentation material display control unit 19. The related presentation material display control unit is an element configured to cause the display unit 13 to display the related presentation material related to the subsequent related term using the information on the subsequent related term related to the analyzed related term selected by the subsequent related term selection unit 15.
Since this related presentation material display control unit is provided, the system of this aspect allows appropriately and resourcefully adjusting the order of the presentation materials and the related presentation material used and displaying them according to the presentation.
A preferred aspect of the above-described presentation support system 1 further includes a used related term storage unit 21 configured to associate the related term analyzed by the related term analysis unit with the conversation information and store the related term. Since which related term was spoken related to the conversation information (for example, who has given a description to whom) can be stored, whether accountability has been responded can be quickly checked.
In a preferred aspect of the above-described presentation support system 1, the plurality of related terms include a taboo word prohibited to be used related to the presentation material. The subsequent information storage unit includes a correction word as information on the subsequent related term related to the taboo word. The system further includes a correction guide unit 23. The correction guide unit 23 is configured such that when the word analyzed by the related term analysis unit is the taboo word, the correction guide unit 23 causes the display unit 13 to display the correction word. The correction guide unit may further output any alert.
In a preferred aspect of the above-described presentation support system 1, the information on the subsequent related term stored by the subsequent information storage unit 7 is updated by analyzing an order of appearance of the plurality of related terms included in a plurality of conversations related to the presentation material.
For example, conversations of a person in charge who had a good record can be analyzed and a recommendation (subsequent related term) can be updated.
In a preferred aspect of the above-described presentation support system 1, the subsequent information storage unit 7 is configured to store a plurality of patterns of the information on the subsequent related terms. The subsequent related term selection unit 15 is configured such that when any of the plurality of patterns is selected, the subsequent related term selection unit 15 selects the subsequent related term related to the selected pattern.
In view of this, for example, as a plurality of patterns (modes), the plurality of patterns, such as a standard mode, a capable mode, a beginner-friendly mode, a mode for specialist, a cheerful mode, and a slow mode, are prepared in advance, and the presentation can be performed according to a physical condition and preference of the other person and the presenter.
With this Specification, the system that can guide the presentation material along a further attractive story can be provided. The system that can dynamically vary the presentation material according to the terms used in the presentation can be provided. Additionally, this ensures providing the system that can easily check that duty for explanation has been fulfilled when the presentation has been performed.
Hereinafter, configurations to embody the present invention will be described using the drawings. The present invention is not limited to the configurations described below and includes configurations appropriately modified within a scope apparent by the person skilled in the art from the following configurations.
Aspects described in this Specification relate to the presentation support system 1.
This system includes a computer, and respective elements described below are elements implemented by the computer. The computer may be any of various terminals, a mobile terminal, a notebook computer, a personal computer, and a server.
Presentation Support System 1
The presentation support system is a system using a computer for support when a speaker (presenter) gives a description or a presentation using a presentation material. The presentation support system 1 especially relates to a system that recognizes the presentation by the presenter by voice by the computer and extracts a presentation material (or a candidate for the presentation material) preferred to be displayed next by the computer using terms included in the presentation recognized by voice for support such that the presentation can be resourcefully and dynamically performed.
The presentation material storage unit 3 is an element to store the presentation material. For example, the storage unit in the computer functions as a presentation material storage unit. An example of the presentation material is each page of PowerPoint (registered trademark). The presentation material may be a material, such as PowerPoint including a plurality of pages. That is, the presentation material may be a collection of a sequence of page candidates including a plurality of display elements displayed as the presentation. The presentation material is a material stored in the computer and displayed in the display unit to ensure performing the presentation to the speaker himself/herself, a person in conversation, or an audience.
The related term storage unit 5 is an element configured to store a plurality of related terms related to the presentation material stored by the presentation material storage unit 3. For example, the storage unit in the computer functions as the related term storage unit. An example of the plurality of related terms related to the presentation material includes terms possibly used for description based on the respective pages of PowerPoint. The storage unit stores the plurality of related terms related to the respective pages of the presentation material, such as PowerPoint. The storage unit stores the plurality of related terms related to the presentation material related to information (for example, a file ID and a page number) of the presentation material. Examples of the related term include “diabetes,” “new medicine,” “XYZ,” “ABC” (name of another therapeutic agent), “blood glucose level,” “side effect,” “blood sugar,” “glaucoma,” “retinopathy,” “insulin,” “DC pharmaceutical,” “side effect,” and “insert.”
The subsequent information storage unit 7 is an element configured to store information on a subsequent related term as one or a plurality of related terms preferred to be used next to each of the plurality of related terms stored by the related term storage unit 5. For example, the storage unit in the computer functions as the subsequent information storage unit. For example, regarding the related terms “diabetes” and “XYZ,” the storage unit stores the subsequent related terms “side effect” and “insert” as the information on the subsequent related terms.
The term analysis unit 9 is an element configured to analyze a word included in a conversation to obtain conversation information. It is an element configured to analyze the word included in the conversation to obtain first conversation information. A voice is input to the presentation support system via, for example, a microphone. Then, the presentation support system stores the conversation (voice) in the storage unit. The term analysis unit 9 analyzes the word included in the conversation and obtains the conversation information. An example of the first conversation information is conversion of the voice into sound information. Note that the presentation support system may include a database that stores candidates for a conversion word for conversion of a word or a phrase included in a conversational sentence and may convert the conversational sentence using the candidate for the conversion word.
The related term analysis unit 11 is an element configured to analyze whether the word analyzed by the term analysis unit 9 is any of the plurality of related terms. The related term storage unit 5 stores the plurality of related terms related to the presentation material. The computer reads the related terms related to the presentation material and performs a process to obtain whether the words included in the conversation match the related terms. When the words included in the conversation matches any of the related terms, the related term is stored (as analyzed related term) and a process described later is performed.
The display unit 13 is an element configured to display the presentation material and the related terms. Examples of the display unit 13 include a monitor and a display. The computer reads the information on the presentation material stored in the storage unit and displays the presentation material in the monitor and a screen. Thus, the presentation material can be displayed for the person in conversation and the audience.
The subsequent related term selection unit 15 is an element configured to select the subsequent related term related to the analyzed related term from the subsequent information storage unit 7 based on information on the analyzed related term as the related term analyzed by the related term analysis unit. The computer reads the related term stored as the analyzed related term from the storage unit. The computer uses the information on the read related term to read the information on the subsequent related term from the subsequent information storage unit 7.
With such a configuration, the system of this aspect allows preparation to appropriately and resourcefully adjust an order of the presentation materials and a related presentation material used according to the presentation.
A preferred aspect of the above-described presentation support system 1 further includes a related term display control unit 17 configured to cause the display unit 13 to display the subsequent related term related to the analyzed related term selected by the subsequent related term selection unit 15. The related term display control unit 17 reads the information on the subsequent related term from the storage unit and causes the display unit to display the read subsequent related term. Thus, the display unit displays the subsequent related term as a term preferably described next to a certain related term, and this contributes to the smooth presentation.
A preferred aspect of the above-described presentation support system 1 relates to the following. The presentation material storage unit 3 is configured to associate each related presentation material included in the presentation material with any of the plurality of related terms and store them. The system includes the related presentation material display control unit 19. The related presentation material display control unit is an element to cause the display unit 13 to display the related presentation material related to the subsequent related term using the information on the subsequent related term selected by the subsequent related term selection unit 15. The related presentation material display control unit receives the information on the subsequent related term and reads the presentation material (related presentation material) stored related to the subsequent related term from the storage unit. The related presentation material display control unit performs control such that the related presentation material read from the storage unit is displayed by the display unit.
That is, the presentation material related to the subsequent related term preferred to be continuous with the related term, not the related term based on the actual conversation, is read and displayed, thereby ensuring the smooth presentation. Since this related presentation material display control unit is provided, the system of this aspect allows appropriately and resourcefully adjusting the order of the presentation materials and the related presentation material used and displaying them according to the presentation.
A preferred aspect of the above-described presentation support system 1 further includes the used related term storage unit 21 configured to associate the related term analyzed by the related term analysis unit with the conversation information and store them. For example, the storage unit functions as the used related term storage unit. As an example of the conversation information, since which related term was spoken related to the conversation information, which is information that who gave the description to whom and when using which presentation material, can be stored, whether an explainer has responded accountability can be quickly checked. Additionally, based on a presentation of a prominent explainer (for example, a prominent MR), the order of appearance of the related terms can be stored, and this can be useful for patterning of an order of registration of the related terms.
In a preferred aspect of the above-described presentation support system 1, the plurality of related terms include a taboo word prohibited to be used related to the presentation material. The subsequent information storage unit includes a correction word as information on the subsequent related term related to the taboo word. The system further includes a correction guide unit 23. The correction guide unit 23 is configured such that when the word analyzed by the related term analysis unit is the taboo word, the correction guide unit 23 causes the display unit 13 to display the correction word. Since the correction word is a term preferred to be used after the use of the taboo word, the correction word is the subsequent related term related to the taboo word. The correction guide unit may further output any alert. For example, when the related term is the taboo word (no good word), the storage unit only needs to turn on a flag corresponding to it. When this flag is read, the presentation support system may perform control such that the alert is output. As an example of the alert, a display of a precautionary statement, “The no good word was used. Correct it.” may be displayed in a display unit for the presenter. When the subsequent related term is displayed in the display unit, a display, such as providing a red frame to the related term and a display of the related term in red, different from that in the case where the usual related term is displayed may be performed to ensure calling the presenter's attention. It is only necessary that alert information is transmitted to a mobile terminal (for example, a mobile phone, a smart phone, and a timepiece) of the presenter to output various kinds of alert (for example, the mobile terminal vibrates).
In a preferred aspect of the above-described presentation support system 1, the information on the subsequent related term stored in the subsequent information storage unit 7 is updated by analyzing an order of appearance of the plurality of related terms included in the plurality of conversations related to the presentation material. For example, conversations of a person in charge who had a good record can be analyzed and a recommendation (subsequent related term) can be updated. In this example, the storage unit stores an order that the related terms were used. The related term used next in many cases when a certain related term is used is analyzed by statistics. Thus, the order of and the candidate for the subsequent related term can be selected, and it is only necessary to update the information in the storage unit using the selected subsequent related term.
In a preferred aspect of the above-described presentation support system 1, the subsequent information storage unit 7 is configured to store a plurality of patterns of the information on the subsequent related terms. The subsequent related term selection unit 15 is configured such that when any of the plurality of patterns is selected, the subsequent related term selection unit 15 selects the subsequent related term related to the selected pattern.
In view of this, for example, as a plurality of patterns (modes), the plurality of patterns, such as a standard mode, a capable mode, a beginner-friendly mode, a mode for specialist, a cheerful mode, and a slow mode, are prepared in advance, and the presentation can be performed according to a physical condition and preference of the other person and the presenter.
Next, an example of a presentation support method using the above-described system will be described.
Material Selection Step (S101)
The presenter selects the presentation material installed on the computer. Then, the computer receives information that a certain presentation material is selected. The presentation material storage unit stores a plurality of presentation materials, and the specific presentation material is read based on the information that the certain presentation material is selected. Note that the computer may read the selected presentation material from the storage unit and display it in the display unit. The display unit may be a display unit of a computer for the presenter, may be a display unit of a computer seen by the other person, or may be both of the display units.
Term reading step (S102) The related term storage unit stores the plurality of related terms related to the respective presentation materials. The subsequent information storage unit stores the information on the subsequent related terms related to the respective related terms. Based on the information that the certain presentation material has been selected, the information on the respective related terms and subsequent related terms is read.
Voice Recognition Step (S103)
Using a sound pickup device, such as a microphone, the computer inputs the voice to the computer. The computer appropriately converts the voice into digital information and stores it in the storage unit. Using a voice analysis program, the term analysis unit analyzes the words included in the conversations to obtain the conversation information. Such a voice conversion system is publicly known.
Related Term Analysis Step (S104)
The related term analysis unit analyzes whether the word analyzed by the term analysis unit is any of the plurality of related terms. It is only necessary that this work reads the related terms (A1 to A4) and collates them with the word analyzed by the term analysis unit to determine whether the word analyzed by the term analysis unit is any of the related terms (A1 to A4), and continues the determination whether the analyzed term is the related terms (A1 to A4) until the related terms (A1 to A4) appear. For example, when the word analyzed by the term analysis unit matches the related term (A1), the related term (A1) may be stored in the storage unit as the analyzed related term.
Subsequent Related Term Selection Step (S105)
When the certain related term is used, the subsequent related term selection unit reads the analyzed related term (A1) from the storage unit and selects the subsequent related terms related to the analyzed related term from the subsequent information storage unit. For example, when the word analyzed by the term analysis unit (accordingly, the word spoken by the presenter) is the related term (A1), the subsequent related terms (B1 to B3) are read. The subsequent related terms are thus read, and therefore this method allows the user to provide various kinds of support.
Subsequent Related Term Display Step (S106)
The computer displays the read subsequent related terms (B1 to B3) at predetermined positions of the presentation displayed in the display unit. These subsequent related terms (B1 to B3) are preferably displayed in the display unit of the computer that can be visually perceived by the presenter and not displayed in a display unit of the other person. Reasonably, the presentation may be performed using one personal computer.
Subsequent Material Display Step (S107)
For example, the display unit of the computer is a touchscreen, and a user touches any of the subsequent related terms displayed in the display unit. Then, the information on the selection of the subsequent related term is input to the computer. This information may be input using a computer mouse or another means. Since the computer stores the presentation materials and the pages related to the subsequent related terms, the presentation material or its page related to the input subsequent related term is displayed in the display unit.
Since the present invention relates to a presentation support device, the present invention can be used for information-related industry.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2019-011665 | Jan 2019 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2020/000075 | 1/6/2020 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2020/153111 | 7/30/2020 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5459829 | Doi et al. | Oct 1995 | A |
| 5835722 | Bradshaw | Nov 1998 | A |
| 6049821 | Theriault | Apr 2000 | A |
| 6556970 | Sasaki | Apr 2003 | B1 |
| 6678822 | Morar | Jan 2004 | B1 |
| 7146349 | Benitez-Jimenez | Dec 2006 | B2 |
| 7149957 | Hull | Dec 2006 | B2 |
| 7495795 | Graham | Feb 2009 | B2 |
| 7941316 | Mahajan | May 2011 | B2 |
| 9336192 | Barba | May 2016 | B1 |
| 9910931 | Guerrero | Mar 2018 | B2 |
| 10956496 | Greenberg | Mar 2021 | B2 |
| 20020019731 | Masui | Feb 2002 | A1 |
| 20030078913 | McGreevy | Apr 2003 | A1 |
| 20040205041 | Erol et al. | Oct 2004 | A1 |
| 20060112131 | Harrold | May 2006 | A1 |
| 20060161520 | Brewer | Jul 2006 | A1 |
| 20060195461 | Lo | Aug 2006 | A1 |
| 20070214207 | Xie | Sep 2007 | A1 |
| 20070287477 | Tran | Dec 2007 | A1 |
| 20070294612 | Drucker | Dec 2007 | A1 |
| 20080091423 | Roy | Apr 2008 | A1 |
| 20080270138 | Knight | Oct 2008 | A1 |
| 20080270462 | Thomsen | Oct 2008 | A1 |
| 20080300853 | Xiaoning | Dec 2008 | A1 |
| 20090006543 | Smit | Jan 2009 | A1 |
| 20110107205 | Chow | May 2011 | A1 |
| 20110125503 | Dong | May 2011 | A1 |
| 20110201387 | Paek | Aug 2011 | A1 |
| 20120016671 | Jaggi | Jan 2012 | A1 |
| 20130006613 | Karov Zangvil | Jan 2013 | A1 |
| 20130080153 | Tanaka | Mar 2013 | A1 |
| 20130144605 | Brager | Jun 2013 | A1 |
| 20130179790 | Nadiadi | Jul 2013 | A1 |
| 20130275120 | DeGross | Oct 2013 | A1 |
| 20130304742 | Roman | Nov 2013 | A1 |
| 20140278633 | Daly | Sep 2014 | A1 |
| 20140310062 | Klein | Oct 2014 | A1 |
| 20150006563 | Carattini | Jan 2015 | A1 |
| 20150121248 | Levin | Apr 2015 | A1 |
| 20150154185 | Waibel | Jun 2015 | A1 |
| 20150309985 | Brav | Oct 2015 | A1 |
| 20150317069 | Clements | Nov 2015 | A1 |
| 20150379988 | Corfield | Dec 2015 | A1 |
| 20160071511 | Park | Mar 2016 | A1 |
| 20160299896 | Bawri | Oct 2016 | A1 |
| 20170103059 | Cai | Apr 2017 | A1 |
| 20170270092 | He | Sep 2017 | A1 |
| 20180025657 | Kim | Jan 2018 | A1 |
| 20180089335 | Huang | Mar 2018 | A1 |
| 20180109636 | Hardy | Apr 2018 | A1 |
| 20190012306 | Dvorak | Jan 2019 | A1 |
| 20190355346 | Bellegarda | Nov 2019 | A1 |
| 20190361962 | Laursen | Nov 2019 | A1 |
| 20200004828 | Kersting | Jan 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 104317781 | Jan 2015 | CN |
| 104796584 | Jul 2015 | CN |
| 2002-259635 | Sep 2002 | JP |
| 2013-025609 | Feb 2013 | JP |
| 2017-224052 | Dec 2017 | JP |
| WO2018221119 | Dec 2018 | JP |
| WO2018221120 | Dec 2018 | JP |
| Entry |
|---|
| Office Action of Canadian Patent Application No. 3,097,728 dated Dec. 21, 2020 (4 pages). |
| Office Action of Chinese Patent Application No. 202080002037.1 dated Jan. 22, 2021 (6 pages). |
| Office Action of Canadian Patent Application No. 3,097,728 dated Nov. 9, 2022 (4 pages). |
| International Search Report of International Patent Application No. PCT/JP2020/000075 completed Mar. 18, 2020 and dated Mar. 31, 2020 (4 pages). |
| Written Opinion of International Patent Application No. PCT/JP2020/000075 completed Mar. 18, 2020 and dated Mar. 31, 2020 (3 pages). |
| Number | Date | Country | |
|---|---|---|---|
| 20210020169 A1 | Jan 2021 | US |
