Method for enhancing memory and cognition in aging adults

Information

  • Patent Application
  • 20070065789
  • Publication Number
    20070065789
  • Date Filed
    February 02, 2006
    18 years ago
  • Date Published
    March 22, 2007
    17 years ago
Abstract
A method on a computing device is provided for enhancing the memory and cognitive ability of an older adult by requiring the adult to listen to two or more aurally processed syllables, presented serially, view the syllables graphically, and then designate the order in which the syllables were aurally presented. A number of trials are presented to the adult. As the adult correctly determines the syllable order in trials, the difficulty of the trials is increased by increasing the number of syllables presented, and by reducing the amount of processing that is applied to the syllables.
Description
FIELD OF THE INVENTION

This invention relates in general to the use of brain health programs utilizing brain plasticity to enhance human performance and correct neurological disorders.


BACKGROUND OF THE INVENTION

Almost every individual has a measurable deterioration of cognitive abilities as he or she ages. The experience of this decline may begin with occasional lapses in memory in one's thirties, such as increasing difficulty in remembering names and faces, and often progresses to more frequent lapses as one ages in which there is passing difficulty recalling the names of objects, or remembering a sequence of instructions to follow directions from one place to another. Typically, such decline accelerates in one's fifties and over subsequent decades, such that these lapses become noticeably more frequent. This is commonly dismissed as simply “a senior moment” or “getting older.” In reality, this decline is to be expected and is predictable. It is often clinically referred to as “age-related cognitive decline,” or “age-associated memory impairment.” While often viewed (especially against more serious illnesses) as benign, such predictable age-related cognitive decline can severely alter quality of life by making daily tasks (e.g., driving a car, remembering the names of old friends) difficult.


In many older adults, age-related cognitive decline leads to a more severe condition now known as Mild Cognitive Impairment (MCI), in which sufferers show specific sharp declines in cognitive function relative to their historical lifetime abilities while not meeting the formal clinical criteria for dementia. MCI is now recognized to be a likely prodromal condition to Alzheimer's Disease (AD) which represents the final collapse of cognitive abilities in an older adult. The development of novel therapies to prevent the onset of this devastating neurological disorder is a key goal for modem medical science.


The majority of the experimental efforts directed toward developing new strategies for ameliorating the cognitive and memory impacts of aging have focused on blocking and possibly reversing the pathological processes associated with the physical deterioration of the brain. However, the positive benefits provided by available therapeutic approaches (most notably, the cholinesterase inhibitors) have been modest to date in AD, and are not approved for earlier stages of memory and cognitive loss such as age-related cognitive decline and MCI.


Cognitive training is another potentially potent therapeutic approach to the problems of age-related cognitive decline, MCI, and AD. This approach typically employs computer- or clinician-guided training to teach subjects cognitive strategies to mitigate their memory loss. Although moderate gains in memory and cognitive abilities have been recorded with cognitive training, the general applicability of this approach has been significantly limited by two factors: 1) Lack of Generalization; and 2) Lack of enduring effect.


Lack of Generalization: Training benefits typically do not generalize beyond the trained skills to other types of cognitive tasks or to other “real-world” behavioral abilities. As a result, effecting significant changes in overall cognitive status would require exhaustive training of all relevant abilities, which is typically infeasible given time constraints on training.


Lack of Enduring Effect: Training benefits generally do not endure for significant periods of time following the end of training. As a result, cognitive training has appeared infeasible given the time available for training sessions, particularly from people who suffer only early cognitive impairments and may still be quite busy with daily activities.


As a result of overall moderate efficacy, lack of generalization, and lack of enduring effect, no cognitive training strategies are broadly applied to the problems of age-related cognitive decline, and to date they have had negligible commercial impacts. The applicants believe that a significantly innovative type of training can be developed that will surmount these challenges and lead to fundamental improvements in the treatment of age-related cognitive decline. This innovation is based on a deep understanding of the science of “brain plasticity” that has emerged from basic research in neuroscience over the past twenty years which only now through the application of computer technology can be brought out of the laboratory and into the everyday therapeutic treatment.


Therefore, what is needed is an overall training program that will significantly improve fundamental aspects of brain performance and function relevant to the remediation of the neurological origins and consequences of age-related cognitive decline.


SUMMARY

The training program described below is designed to: Significantly improve “noisy” sensory representations by improving representational fidelity and processing speed in the auditory and visual systems. The stimuli and tasks are designed to gradually and significantly shorten time constants and space constants governing temporal and spectral/spatial processing to create more efficient (accurate, at speed) and powerful (in terms of distributed response coherence) sensory reception. The overall effect of this improvement will be to significantly enhance the salience and accuracy of the auditory representation of speech stimuli under real-world conditions of rapid temporal modulation, limited stimulus discriminability, and significant background noise.


In addition, the training program is designed to significantly improve neuromodulatory function by heavily engaging attention and reward systems. The stimuli and tasks are designed to strongly, frequently, and repetitively activate attentional, novelty, and reward pathways in the brain and, in doing so, drive endogenous activity-based systems to sustain the health of such pathways. The goal of this rejuvenation is to re-engage and re-differentiate 1) nucleus basalis control to renormalize the circumstances and timing of ACh release, 2) ventral tegmental, putamen, and nigral DA control to renormalize DA function, and 3) locus coeruleus, nucleus accumbens, basolateral amygdale and mammillary body control to renormalize NE and integrated limbic system function. The result re-enables effective learning and memory by the brain, and to improve the trained subjects' focused and sustained attentional abilities, mood, certainty, self confidence, motivation, and attention.


The training modules accomplish these goals by intensively exercising relevant sensory, cognitive, and neuromodulatory structures in the brain by engaging subjects in game-like experiences. To progress through an exercise, the subject must perform increasingly difficult discrimination, recognition or sequencing tasks under conditions of close attentional control. The game-like tasks are designed to deliver tremendous numbers of instructive and interesting stimuli, to closely control behavioral context to maintain the trainee ‘on task’, and to reward the subject for successful performance in a rich, layered variety of ways. Negative feedback is not used beyond a simple sound to indicate when a trial has been performed incorrectly.


Various embodiments of a system and method are presented for enhancing memory and cognition in adults with impaired memory and cognition relative to a young healthy state, utilizing a computing device to present stimuli and to record responses.


A stimulus may be presented to a user, where the user is an adult with impaired memory and cognition relative to a young healthy state, and a response of the user to the stimulus may be recorded. The presenting and recording may be repeated a first specified number of times, i.e., in an iterative manner. If the user achieves a specified level of success, i.e., if the user's response is correct a specified percentage of the time, the difficulty of the stimulus may be increase. If, on the other hand, the user does not achieve the specified level of success, the difficulty of the stimulus may be increased. The presenting, recording, repeating, increasing, and/or decreasing may be repeated a second specified number times to improve the memory and cognition of the user.


In some embodiments, the stimulus may include an auditory stimulus, e.g., spoken sound, either recorded from a human or synthesized. Increasing the difficulty of the stimulus may include decreasing a level of processing of the auditory stimulus. Similarly, decreasing the difficulty of the stimulus may include increasing the level of processing of the auditory stimulus. The level of processing of the auditory stimulus may be based on one or more of: modifing a rate at which at least a portion of the auditory stimulus is played, while maintaining characteristic pitch-pulse-phase synchronous temporal structure of voiced speech sounds, and emphasizing portions of the auditory stimulus using band-modulation deepening to selectively enhance relatively fast-changing events in the voiced speech sounds.


In some embodiments, the stimulus may include an auditory frequency modulated (FM) sweep, where the FM sweep may include a base frequency, a duration, and a direction of up or down. The response may include a button press indicating the user's perception of the direction of the sweep. In this embodiment, increasing the difficulty of the stimulus may include decreasing the duration of the FM sweep, and decreasing the difficulty of the stimulus may include increasing the duration of the FM sweep. In some embodiments, the stimulus may include a sequence of auditory FM sweeps, where the sequence may include a specified inter-stimulus interval (ISI) between each FM sweep in the sequence, in which case, the response may include a corresponding sequence of button presses indicating the user's perception of the respective directions of each FM sweep in the sequence. Increasing the difficulty of the stimulus may include decreasing the duration of the FM sweep and/or decreasing the ISI, and decreasing the difficulty of the stimulus may include increasing the duration of the FM sweep and/or increasing the ISI. In one embodiment, the method may also include performing the repeating the presenting, the recording, the repeating, the increasing, and the decreasing, for each of a plurality of base frequencies for the FM sweeps.


In some embodiments, the stimulus may include an auditory phoneme, and the response may include a button press identifying the phoneme from a plurality of confusable phonemes. Increasing the difficulty of the stimulus may include decreasing emphasis of at least a portion of the auditory phoneme, and decreasing the difficulty of the stimulus may include increasing the emphasis of at least a portion of the auditory phoneme.


In some embodiments, the stimulus may include an array of buttons comprising a plurality of pairs of buttons, where each pair of buttons is associated with a respective phoneme, and where each button is pressable to invoke auditory presentation of the respective phoneme. The response may include a sequential press of two buttons asserting that the two buttons are one of the plurality of pairs of buttons associated with a respective phoneme. Increasing the difficulty of the stimulus may include decreasing emphasis of at least a portion of the auditory phoneme, and decreasing the difficulty of the stimulus may include increasing the emphasis of at least a portion of the auditory phoneme. The method may also include removing the two buttons from the array of buttons if the two buttons are one of the plurality of pairs of buttons associated with a respective phoneme. Thus, as the user correctly matches pairs of phonemes, the corresponding buttons may be removed from the array, until none are left. In one embodiment, each button may be associated with a randomly selected respective phoneme when first pressed by the user, where the randomly selected respective phoneme is precluded from matching the respective phoneme associated with an immediately previously pressed button. This may prevent the user from accidentally matching two phonemes.


In some embodiments, the stimulus may include an auditory syllable, and the response may include a button press identifying the syllable from a plurality of syllables textually displayed on respective buttons. Increasing the difficulty of the stimulus may include decreasing the level of processing of the auditory syllable, and decreasing the difficulty of the stimulus may include increasing the level of processing of the auditory syllable. In this case, the level of processing may correspond to the degree to which the syllable has been processed to enhance clarity of the auditory syllable. In one embodiment, the stimulus may include a sequence of auditory syllables, where the sequence may include an ISI between each auditory syllable in the sequence. The response may include a corresponding sequence of button presses identifying the syllables in the sequence. Increasing the difficulty of the stimulus may also include increasing the length of the sequence and/or decreasing the ISI, and decreasing the difficulty of the stimulus may also include decreasing the length of the sequence and/or increasing the ISI.


In some embodiments, the stimulus may include an auditory instruction indicating an action to be performed, where the action may include a manipulation of a graphical object. The response may include manipulating the graphical object. In these embodiments, increasing the difficulty of the stimulus may include decreasing the level of processing of the auditory instruction and/or increasing the complexity of the instruction, and decreasing the difficulty of the stimulus may include increasing the level of processing of the auditory instruction and/or decreasing the complexity of the instruction. The level of processing may correspond to the degree to which the auditory instruction has been processed to enhance clarity of the auditory instructions. In one embodiment, the stimulus may include a sequence of auditory instructions indicating a corresponding sequence of actions to be performed by the person, where the actions include respective manipulations of graphical objects. The response may include manipulating the graphical objects, i.e., following the sequence of instructions. Increasing the difficulty of the stimulus may also include increasing the length of the sequence, and decreasing the difficulty of the stimulus may also include decreasing the length of the sequence.


In some embodiments, the auditory instructions may include instructions of lower complexity directed to stimulus discrimination, instructions of higher complexity directed to stimulus discrimination, instructions of lower complexity directed to memory, and instructions of higher complexity directed to memory. Each of the instructions of lower complexity directed to stimulus discrimination may include an instruction to select a respective graphical object with a pointing device. Each of the instructions of higher complexity directed to stimulus discrimination may include an instruction to select a respective graphical object with a pointing device, where the respective graphical object is qualified by one or more adjectives and/or one or more prepositional phrases. Each of the instructions of lower complexity directed to memory may include an instruction to move a respective first graphical object with respect to a respective second graphical object. Finally, each of the instructions of higher complexity directed to memory may include an instruction to move a respective first graphical object with respect to a respective second graphical object, where one or both of the respective first graphical object and the respective second graphical object are qualified by one or more adjectives and/or one or more prepositional phrases.


In some embodiments, the stimulus may include an auditory story segment and one or more questions about the auditory story segment, and the response may include respective button presses indicating respective answers to the one or more questions. Increasing the difficulty of the stimulus may include increasing the complexity and/or decreasing the level of processing of the auditory story, and decreasing the difficulty of the stimulus may include decreasing the complexity and/or decreasing the level of processing of the auditory story. The level of processing may correspond to the degree to which the auditory story segment has been processed to enhance clarity of the auditory story segment.


In one embodiment, the stimulus may include a sequence of auditory story segments and respective questions about the auditory story segments. The response may include respective button presses indicating respective answers to the respective questions about the story segments. Increasing the difficulty of the stimulus may include increasing the length of the sequence, and decreasing the difficulty of the stimulus may include decreasing the length of the sequence.


The sequence of auditory story segments may form or compose one or more stories with respective complexities, where the complexity of each story is based on one or more of: the length of sentences in each story, the number of key elements in each story, the complexity of key elements in each story, the narrative relevance of key elements in each story, and the grammatical complexity of each story. The complexity of key elements in each story may be based on one or more of: use of adjectives, adjective phrases, adverbs, and/or adverb phrases qualifying the key elements of the story, and use of prepositional phrases qualifying the key elements of the story. The narrative relevance of key elements in each story may be based on one or more of: whether a key element is a main element of a plot of the story, and whether the key element is a background item of the story. The grammatical complexity of each story may be based on one or more of: simple noun verb sentence structure of sentences in the story, the number of clauses used in the sentences in the story, and nested clauses used in the sentences in the story.


Other features and advantages of the present invention will become apparent upon study of the remaining portions of the specification and drawings.




BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a block diagram of a computer system for executing a program according to the present invention.



FIG. 2 is a block diagram of a computer network for executing a program according to the present invention.



FIG. 3 is a chart illustrating frequency/energy characteristics of two phonemes within the English language.



FIG. 4 is a chart illustrating auditory reception of a phoneme by a subject having normal receptive characteristics, and by a subject whose receptive processing is impaired.



FIG. 5 is a chart illustrating stretching of a frequency envelope in time, according to the present invention.



FIG. 6 is a chart illustrating emphasis of selected frequency components, according to the present invention.



FIG. 7 is a chart illustrating up-down frequency sweeps of varying duration, separated by a selectable inter-stimulus-interval (ISI), according to the present invention.



FIG. 8 is a pictorial representation of a game selection screen according to the present invention.



FIG. 9 is a screen shot of an initial screen in the exercise High or Low.



FIG. 10 is a screen shot of a trial within the exercise High or Low.



FIG. 11 is a screen shot during a trial within the exercise High or Low showing progress within a graphical award portion of the screen.



FIG. 12 is a screen shot showing a completed picture within a graphical award portion of the screen during training of the exercise High or Low.



FIG. 13 is a screen shot showing alternative graphical progress during training within the exercise High or Low.



FIG. 14 is a screen shot showing a reward animation within the exercise High or Low.



FIG. 15 is a flow chart illustrating advancement through the processing levels within the exercise High or Low.



FIG. 16 is a selection screen illustrating selection of the next exercise in the training of HiFi, particularly the exercise Tell us Apart.



FIG. 17 is an initial screen shot within the exercise Tell us Apart.



FIG. 18 is a screen shot within the exercise Tell us Apart particularly illustrating progress in the graphical award portion of the screen.



FIG. 19 is a screen shot within the exercise Tell us Apart illustrating an alternative progress indicator within the graphical award portion of the screen.



FIG. 20 is a screen shot of a trial within the exercise Match It.



FIG. 21 is a screen shot of a trial within the exercise Match It particularly illustrating selection of one of the available icons.



FIG. 22 is a screen shot within the exercise Match It illustrating sequential selection of two of the available icons during an initial training portion of the exercise.



FIG. 23 is a screen shot within the exercise Match It illustrating sequential selection of two of the available icons.



FIG. 24 is a screen shot within the exercise Match It illustrating an advanced training level having 16 buttons.



FIG. 25 is a screen shot within the exercise Sound Replay illustrating two icons for order association with aurally presented phonemes.



FIG. 26 is a screen shot within the exercise Sound Replay illustrating six icons for order association with two or more aurally presented phonemes.



FIG. 27 is a screen shot within the exercise Listen and Do illustrating an initial training module of the exercise.



FIG. 28 is a screen shot within the exercise Listen and Do illustrating a moderately complex scene for testing.



FIG. 29 is a screen shot within the exercise Listen and Do illustrating a complex scene for testing.



FIG. 30 is a screen shot within the exercise Story Teller illustrating an initial training module of the exercise.



FIG. 31 is a screen shot within the exercise Story Teller illustrating textual response possibilities to a question.



FIG. 32 is a screen shot within the exercise Story Teller illustrating graphical response possibilities to a question.




DETAILED DESCRIPTION

Referring to FIG. 1, a computer system 100 is shown for executing a computer program to train, or retrain an individual according to the present invention to enhance their memory and improve their cognition. The computer system 100 contains a computer 102, having a CPU, memory, hard disk and CD ROM drive (not shown), attached to a monitor 104. The monitor 104 provides visual prompting and feedback to the subject during execution of the computer program. Attached to the computer 102 are a keyboard 105, speakers 106, a mouse 108, and headphones 110. The speakers 106 and the headphones 110 provide auditory prompting and feedback to the subject during execution of the computer program. The mouse 108 allows the subject to navigate through the computer program, and to select particular responses after visual or auditory prompting by the computer program. The keyboard 105 allows an instructor to enter alpha numeric information about the subject into the computer 102. Although a number of different computer platforms are applicable to the present invention, embodiments of the present invention execute on either IBM compatible computers or Macintosh computers, or similarly configured computing devices such as set top boxes, PDA's, gaming consoles, etc.


Now referring to FIG. 2, a computer network 200 is shown. The computer network 200 contains computers 202, 204, similar to that described above with reference to FIG. 1, connected to a server 206. The connection between the computers 202, 204 and the server 206 can be made via a local area network (LAN), a wide area network (WAN), or via modem connections, directly or through the Internet. A printer 208 is shown connected to the computer 202 to illustrate that a subject can print out reports associated with the computer program of the present invention. The computer network 200 allows information such as test scores, game statistics, and other subject information to flow from a subject's computer 202, 204 to a server 206. An administrator can then review the information and can then download configuration and control information pertaining to a particular subject, back to the subject's computer 202, 204.


Before providing a detailed description of the present invention, a brief overview of certain components of speech will be provided, along with an explanation of how these components are processed by subjects. Following the overview, general information on speech processing will be provided so that the reader will better appreciate the novel aspects of the present invention.


Referring to FIG. 3, a chart is shown that illustrates frequency components, over time, for two distinct phonemes within the English language. Although different phoneme combinations are applicable to illustrate features of the present invention, the phonemes Idal and Ibal are shown. For the phoneme /da/, a downward sweep frequency component 302 (called a formant), at approximately 2.5-2 khz is shown to occur over a 35 ms interval. In addition, a downward sweep frequency component (formant) 304, at approximately 1 khz is shown to occur during the same 35 ms interval. At the end of the 35 ms interval, a constant frequency component (formant) 306 is shown, whose duration is approximately 100 ms. Thus, in producing the phoneme /da/, the stop consonant portion of the element /d/ is generated, having high frequency sweeps of short duration, followed by a long vowel element /a/ of constant frequency.


Also shown are formants for a phoneme Iba/. This phoneme contains an upward sweep frequency component 308, at approximately 2 khz, having a duration of approximately 35 ms. The phoneme also contains an upward sweep frequency component 310, at approximately 1 khz, during the same 35 ms period. Following the stop consonant portion /b/ of the phoneme, is a constant frequency vowel portion 314 whose duration is approximately 110 ms.


Thus, both the /ba/ and /da/ phonemes begin with stop consonants having modulated frequency components of relatively short duration, followed by a constant frequency vowel component of longer duration. The distinction between the phonemes exists primarily in the 2 khz sweeps during the initial 35 ms interval. Similarity exists between other stop consonants such as /ta/, /pa/, /ka/ and /ga/.


Referring now to FIG. 4, the amplitude of a phoneme, for example /ba/, is viewed in the time domain. A short duration high amplitude peak waveform 402 is created upon release of either the lips or the tongue when speaking the consonant portion of the phoneme, that rapidly declines to a constant amplitude signal of longer duration. For an individual with normal temporal processing, the waveform 402 will be understood and processed essentially as it is. However, for an individual whose auditory processing is impaired, or who has abnormal temporal processing, the short duration, higher frequency consonant burst will be integrated over time with the lower frequency vowel, and depending on the degree of impairment, will be heard as the waveform 404. The result is that the information contained in the higher frequency sweeps associated with consonant differences, will be muddled, or indistinguishable.


With the above general background of speech elements, and how subjects process them, a general overview of speech processing will now be provided. As mentioned above, one problem that exists in subjects is the inability to distinguish between short duration acoustic events. If the duration of these acoustic events are stretched, in the time domain, it is possible to train subjects to distinguish between these acoustic events. An example of such time domain stretching is shown in FIG. 5, to which attention is now directed.


In FIG. 5, a frequency vs. time graph 500 is shown similar to that described above with respect to FIG. 3. Using existing computer technology, the analog waveforms 502, 504 can be sampled and converted into digital values (using a Fast Fourier Transform, for example). The values can then be manipulated so as to stretch the waveforms in the time domain to a predetermined length, while preserving the amplitude and frequency components of the modified waveforms. The modified waveform can then be converted back into an analog waveform (using an inverse FFT) for reproduction by a computer, or by some other audio device. The waveforms 502, 504 are shown stretched in the time domain to durations of 80 ms (waveforms 508, 510). By stretching the consonant portion of the waveforms 502, 504 without effecting their frequency components, aging subjects with deteriorated acoustic processing can begin to hear distinctions in common phonemes.


Another method that may be used to help subjects distinguish between phonemes is to emphasize selected frequency envelopes within a phoneme. Referring to FIG. 6, a graph 600 is shown illustrating a filtering function 602 that is used to filter the amplitude spectrum of a speech sound. In one embodiment, the filtering function effects an envelope that is 27 Hz wide. By emphasizing frequency modulated envelopes over a range similar to frequency variations in the consonant portion of phonemes, they are made to more strongly engage the brain. A 10 dB emphasis of the filtering function 602 is shown in waveform 600, and a 20 dB emphasis in the waveform 606.


A third method that may be used to train subjects to distinguish short duration acoustic events is to provide frequency sweeps of varying duration, separated by a predetermined interval, as shown in FIG. 7. More specifically, an upward frequency sweep 702, and a downward frequency sweep 704 are shown, having duration's varying between 25 and 80 milliseconds, and separated by an inter-stimulus interval (ISI) of between 500 and 0 milliseconds. The duration and frequency of the sweeps, and the inter-stimulus interval between the sweeps are varied depending on the processing level of the subject, as will be further described below.


Although a number of methodologies may be used to produce the stretching and emphasis of phonemes, of processing speech to stretch or emphasize certain portions of the speech, and to produce sweeps and bursts, according to the present invention, a complete description of the methodology used within HiFi is described in Appendix G, which should be read as being incorporated into the body of this specification.


Appendices H, I and J have further been included, and are hereby incorporated by reference to further describe the code which generates the sweeps, the methodology used for incrementing points in each of the exercises, and the stories used in the exercise Story Teller.


Each of the above described methods has been combined in a unique fashion by the present invention to provide an adaptive training method and apparatus for enhancing memory and cognition in aging adults. The present invention is embodied into a computer program entitled HiFi by Neuroscience Solutions, Inc. The computer program is provided to a participant via a CD-ROM which is input into a general purpose computer such as that described above with reference to FIG. 1. Specifics of the present invention will now be described with reference to FIGS. 8-32.


Referring to FIG. 8, an initial screen shot 800 is shown which provides buttons 802 for selection of one of the six exercises provided within the HiFi computer program. It is anticipated that more exercises may be added within the HiFi program, or alternate programs used to supplement or replace the exercises identified in the screen shot 800. In one embodiment, a participant begins training by selecting the first exercise (High or Low) and progressing sequentially through the exercises. That is, the participant moves a cursor over one of the exercise buttons, which causes a button to be highlighted, and then indicates a selection by pressing a computer mouse, for example. In an alternate embodiment, the exercises available for training are pre-selected, based on the participant's training history, and are available in a prescribed order. That is, based on the participant's success or failure in previous training sessions, or the time a participant has spent in particular exercises, an optimized schedule for a particular day is determined and provided to the participant via the selection screen. For example, to allow some adaptation of a training regimen to a participant's schedule, an hour per day is prescribed for N number of weeks (e.g., 8 weeks). This would allow 3-4 exercises to be presented each day. In another model, an hour and a half per day might be prescribed for a number of weeks, which would allow either more time for training in each exercise, each day, or more than 3-4 exercises to be presented each day. In either case, it should be appreciated that a training regimen for each exercise should be adaptable according to the participant's schedule, as well as to the participant's historical performance in each of the exercises. Once the participant has made a selection, in this example, the exercise HIGH or LOW is selected, training proceeds to that exercise.


High or Low


Referring now to FIG. 9, a screen shot is shown of the initial training screen for the exercise HIGH or LOW. Elements within the training screen 900 will be described in detail, as many are common for all of the exercises within the HiFi program. In the upper left of the screen 900 is a clock 902. The clock 902 does not provide an absolute reference of time. Rather, it provides a relative progress indicator according to the time prescribed for training in a particular game. For example, if the prescribed time for training was 12 minutes, each tick on the clock 902 would be 1 minute. But, if the prescribed time for training was 20 minutes, then each tick on the clock would be 20/12 minutes. In the following figures, the reader will note how time advances on the clock 902 in consecutive screens. Also shown is a score indicator 904. The score indicator 904 increments according to correct responses by the participant. In one embodiment, the score does not increment linearly. Rather, as described in co-pending application U.S. Ser. No. 10/894,388, filed Jul. 19, 2004 and entitled “REWARDS METHOD FOR IMPROVED NEUROLOGICAL TRAINING”, the score indicator 904 may increment non-linearly, with occasional surprise increments to create additional rewards for the participant. But, regardless of how the score is incremented, the score indicator provides the participant an indication of advancement in their exercise. The screen 900 further includes a start button 906 (occasionally referred to in the Appendices as the OR button). The purpose of the start button 906 is to allow the participant to select when they wish to begin a new trial. That is, when the participant places the cursor over the start button 906, the button is highlighted. Then, when the participant indicates a selection of the start button 906 (e.g., by click the mouse), a new trial is begun. The hscreen 900 further includes a trial screen portion 908 and a graphical reward portion 910. The trial screen portion 908 provides an area on the participant's computer where trials are graphically presented. The graphical reward portion 910 is provided, somewhat as a progress indicator, as well as a reward mechanism, to cause the participant to wish to advance in the exercise, as well as to entertain the participant. The format used within the graphical reward portion 910 is considered novel by the inventors, and will be better described as well as shown, in the descriptions of each of the exercises.


Referring now to FIG. 10, a screen shot 1000 is shown of an initial trial within the exercise HIGH or LOW. The screen shot 1000 is shown after the participant selects the start button 906. Elements of the screen 1000 described above with respect to FIG. 9 will not be referred to again, but it should be appreciated that unless otherwise indicated, their function performs as described above with respect to FIG. 9. Additionally, two blocks 1002 and 1004 are presented to the participant. The left block 1002 shows an up arrow. The right block 1004 shows a down arrow. The blocks 1002, 1004 are intended to represent auditory frequency sweeps that sweep up or down in frequency, respectively. Within the context of this application, the blocks 1002, 1004 are referred to as icons. In one embodiment, icons are pictorial representations that are selectable by the participant to indicate a selection. Icons may graphically illustrate an association with an aural presentation, such as an up arrow 1002, or may indicate a phoneme (e.g., BA), or even a word. Further, icons may be used to indicate correct selections to trials, or incorrect selections. Any use of a graphical item within the context of the present exercises, other than those described above with respect to FIG. 9 may be referred to as icons. In some instances, the term grapheme may also be used, although applicant's believe that icon is more representative of selectable graphical items.


In one embodiment, the participant is presented with two or more frequency sweeps, each separated by an inter-stimulus-interval (ISI). For example, the sequence of frequency sweeps might be (UP, DOWN, UP). The participant is required, after the frequency sweeps are auditorily presented, to indicate the order of the sweeps by selecting the blocks 1002, 1004, according to the sweeps. Thus, if the sequence presented was UP, DOWN, UP, the participant would be expected to indicate the sequence order by selecting the left block 1002, then right block 1004, then left block 1002. If the participant correctly indicates the sweep order, as just defmed, then they have correctly responded to the trial, the score indicator increments, and a “ding” is played to indicate a correct response. If the participant incorrectly indicates the sweep order, then they have incorrectly responded to the trial, and a “thunk” is played to indicate an incorrect response. With the above understanding of training with respect to the exercise HIGH or LOW, specifics of the game will now be described.


A goal of this exercise is to expose the auditory system to rapidly presented successive stimuli during a behavior in which the participant must extract meaningful stimulus data from a sequence of stimulus. This can be done efficiently using time order judgment tasks and sequence reconstruction tasks, in which participants must identify each successively present auditory stimulus. Several types of simple, speech-like stimuli are used in this exercise to improve the underlying ability of the brain to process rapid speech stimuli: frequency modulated (FM) sweeps, structured noise bursts, and phoneme pairs such as /ba/ and /da/. These stimuli are used because they resemble certain classes of speech. Sweeps resemble stop consonants like /b/ or /d/. Structured noise bursts are based on fricatives like /sh/ or /f/, and vowels like /a/ or /i/. In general, the FM sweep tasks are the most important for renormalizing the auditory responses of participants. The structured noise burst tasks are provided to allow high-performing participants who complete the FM sweep tasks quickly an additional level of useful stimuli to continue to engage them in time order judgment and sequence reconstruction tasks.


This exercise is divided into two main sections, FM sweeps and structured noise bursts. Both of these sections have: a Main Task, an initiation for the Main Task, a Bonus Task, and a short initiation for the Bonus Task. The Main Task in FM sweeps is Task 1 (Sweep Time Order Judgment), and the Bonus Task is Task 2 (Sweep Sequence Reconstruction). FM Sweeps is the first section presented to the participant. Task 1 of this section is closed out before the participant begins the second section of this exercise, structured noise bursts. The Main Task in structured noise bursts is Task 3 (Structured Noise Burst Time Order Judgment), and the Bonus Task is Task 4 (Structured Noise Burst Sequence construction). When Task 3 is closed out, the entire Task is reopened beginning with easiest durations in each frequency. The entire Task is replayed.


Task 1—Main Task: Sweep Time Order Judgment


This is a time order judgment task. Participants listen to a sequential pair of FM sweeps, each of which can sweep upwards or downwards. Participants are required to identify each sweep as upwards or downwards in the correct order. The task is made more difficult by hanging both the duration of the FM sweeps (shorter sweeps are more difficult) and decreasing the inter-stimulus interval (ISI) between the FM sweeps (shorter ISIs are more difficult).


Stimuli consist of upwards and downwards FM sweeps, characterized by their base frequency (the lowest frequency in the FM sweep) and their duration. The other characteristic defining an FM sweep, the sweep rate, is held constant at 16 octaves per second throughout the task. This rate was chosen to match the average FM sweep rate of formants in speech (e.g., ba/da). A pair of FM sweeps is presented during a trial. The ISI changes based on the participant's performance. There are three base frequencies:

Base Frequency IndexBase Frequency1 500 Hz21000 Hz32000 Hz


There are Five Durations:

Duration IndexDuration180 ms260 ms340 ms435 ms530 ms


Initially a “training” session is provided to illustrate to the participant how the exercice is to be played. More specifically, an upward sweep is presented to the participant, followed by an indication, as shown in FIG. 10 of block 1002 circled in red, to indicate to the participant that they are to select the upward arrow block 1002 when they hear an upward sweep. Then, a downward sweep is presented to the participant, followed by an indication (not shown) of block 1004 circled in red, to indicate to the participant that they are to select the downward arrow block 1004 when they hear a downward sweep. The initial training continues by presenting the participant with an upward sweep, followed by a downward sweep, with red circles appearing first on block 1002, and then on block 1004. The participant is presented with several trials to insure that they understand how trials are to be responded to. Once the initial training completes, it is not repeated. That is, the participant will no longer be presented with hints (i.e., red circles) to indicate the correct selection. Rather, after selecting the start button, an auditory sequence of frequency sweeps is presented, and the participant must indicate the order of the frequency sweeps by selecting the appropriate blocks, according to the sequence.


Referring now to FIG. 11, a screen shot 1100 is provided to illustrate a trial. In this instance, the right block 1104 is being selected by the participant to indicate a downward sweep. If the participant correctly indicates the sweep order, the score indicator is incremented, and a “ding” is played, as above. In addition, within the graphical reward portion 1106 of the screen 1100, part of an image is traced out for the subject. That is, upon completion of a trial, a portion of a reward image is traced. After another trial, an additional portion of a reward image is traced. Then, after several trials, the complete image is completed and shown to the participant. Thus, upon initiation of a first trial, the graphical reward portion 1106 is blank. But, as each trial is completed, a portion of a reward image is presented, and after a number of trials, the image is completed. One skilled in the art will appreciate that the number of trials required to completely trace an image may vary. What is important is that in addition to incrementing a counter to illustrate correct responses, the participant is presented with a picture that progressively advances as they complete trials, whether or not the participant correctly responds to a trial, until they are rewarded with a complete image. It is believed that this progressive revealing of reward images both entertains and holds the interest of the participant. And, it acts as an encouraging reward for completing a number of trials, even if the participant's score is not incrementing. Further, in one embodiment, the types of images presented to the participant are selected based on the demographics of the participant. For example, types of reward image libraries include children, nature, travel, etc., and can be modified according to the demographics, or other interests of the subject being trained. Applicant's are unaware of any “reward” methodology that is similar to what is shown and described with respect to the graphical reward portion.


Referring to FIG. 12, a screen shot 1200 is shown within the exercise HIGH or LOW. The screen shot 1200 includes a completed reward image 1202 in the graphical reward portion of the screen. In one embodiment, the reward image 1202 required the participant to complete six trials. But, one skilled in the art will appreciate that any number of trials might be selected before the reward image is completed. Once the reward image 1202 is completed, the next trial will begin with a blank graphical reward portion.


Referring to FIG. 13, a screen shot 1300 is shown within the exercise HIGH or LOW. In this screen 1300 the graphical reward portion 1302 is populated with a number of figures such as the dog 1304. In one embodiment, a different figure is added upon completion of each trial. Further, in one embodiment, each of the figures relate to a common theme, for a reward animation that will be forthcoming. More specifically at intervals during training, when the participant has completed a number of trials, a reward animation is played to entertain the participant, and provide a reward to training. The figures shown in the graphical reward portion 1302 correspond to a reward animation that has yet to be presented.


Referring now to FIG. 14, a reward animation 1400, such as that just described is shown. Typically, the reward animation is a moving cartoon, with music in the background, utilizing the figures added to the graphical reward portion at the end of each trial, as described above.


Referring now to FIG. 15, a flow chart is shown which illustrates progression thru the exercise HIGH or LOW. The first time in Task 1, a list of available durations (categories) with a current ISI is created within each frequency. At this time, there are categories in this list that have a duration index of 1 and a current ISI of 600 ms. Other categories (durations) are added (opened) as the participant progresses through the Task. Categories (durations) are removed from the list (closed) when specific criteria are met.


Choosing a frequency, duration (categor, and ISI: The first time in: the participant begins by opening duration index 1 (80 ms) in frequency index 1 (500 Hz). The starting ISI is 600 ms when opening a duration and the ISI step size index when entering a duration is 1.


Beginning subsequent sessions: The participant moves to a new frequency unless the participant has completed less than 20 trials in Task 1 of the previous session's frequency.


Returning from Task 2 (bonus task): The participant will be switching durations, but generally staying in the same frequency.


Switching frequencies: The frequency index is incremented, cycling the participant through the frequencies in order by frequency index (500 Hz, 1000 Hz, 200 Hz, 500 Hz, etc.). If there are no open durations in the new frequency, the frequency index is incremented again until a frequency is found that has an open duration. If all durations in all frequencies have been closed out, Task 1 is closed. The participant begins with the longest open duration (lowest duration index) in the new frequency.


Switching durations: Generally, the duration index is incremented until an open duration is found (the participant moves from longer, easier durations to shorter, harder durations). If there are no open durations, the frequency is closed and the participant switches frequencies. A participant switches into a duration with a lower index (longer, easier duration) when 10 incorrect trials are performed at an ISI of 1000 ms at a duration index greater than 1.


Progression within a duration changes in ISI: ISIs are changed using a 3-up/1-down adaptive tracking rule: Three consecutive correct trials equals advancement—ISI is shortened. One incorrect equals retreat—ISI is lengthened. The amount that the ISI changes is adaptively tracked. This allows participants to move in larger steps when they begin the duration and then smaller steps as they approach their threshold. The following steps sizes are used:

ISI Step Size IndexISI Step Size150 ms225 ms310 ms4 5 ms


When starting a duration, the ISI step index is 1 (50 ms). This means that 3 consecutive correct trials will shorten the ISI by 50 ms and 1 incorrect will lengthen the ISI by 50 ms—3up/1down. The step size index is increased after every second Sweeps reversal. A Sweeps reversal is a “change in direction”. For example, three correct consecutive trials shortens the ISI. A single incorrect lengthens the ISI. The drop to a longer ISI after the advancement to a shorter ISI is counted as one reversal. If the participant continues to decrease difficulty, these drops do not count as reversals. A “change in direction” due to 3 consecutive correct responses counts as a second reversal.


A total of 8 reversals are allowed within a duration; the 9th reversal results in the participant exiting the duration; the duration remains open unless criteria for stable performance have been met. ISI never decreases to lower than 0 ms, and never increases to more than 1000 ms. The tracking toggle pops the participant out of the Main Task and into Task Initiation if there are 5 sequential increases in ISI. The current ISI is stored. When the participant passes initiation, they are brought back into the Main Task. Duration re-entry rules apply. A complete description of progress through the exercise High or Low is found in Appendix A.


To allow the text of this specification to be presented clearly, the details relating to progression methodology, processing, stimuli, etc., for each of the exercises within HiFi have been placed in Appendices to this specification. However, applicants consider the appendices to be part of this specification. Therefore, they should be read as part of this specification, and as being incorporated within the body of this specification for all purposes.


Stretch and Emphasis Processing of Natural Speech in HiFi


In order to improve the representational fidelity of auditory sensory representations in the brain of trained individuals, natural speech signals are initially stretched and emphasized. The degree of stretch and emphasis is reduced as progress is made through the exercise. In the final stage, faster than normal speech is presented with no emphasis.


Both stretching and emphasis operations are performed using the Praat (v. 4.2) software package (http://www.fon.hum.uva.nl/praat/) produced by Paul Boersma and David Weenink at the Institute for Phonetic Sciences at the University of Amsterdam. The stretching algorithm is a Pitch-Synchronous OverLap-and-Add method (PSOLA). The purpose of this algorithm is lengthen or shorten the speech signal over time while maintaining the characteristics of the various frequency components, thus retaining the same speech information, only in a time-altered form. The major advantage of the PSOLA algorithm over the phase vocoder technique used in previous versions of the training software is that PSOLA maintains the characteristic pitch-pulse-phase synchronous temporal structure of voiced speech sounds. An artifact of vocoder techniques is that they do not maintain this synchrony, creating relative phase distortions in the various frequency components of the speech signal. This artifact is potentially detrimental to older observers whose auditory systems suffer from a loss of phase-locking activity. A minimum frequency of 75 Hz is used for the periodicity analysis. The maximum frequency used is 600 Hz. Stretch factors of 1.5, 1.25, 1 and 0.75 are used.


The emphasis operation used is referred to as band-modulation deepening. In this emphasis operation, relatively fast-changing events in the speech profile are selectively enhanced. The operation works by filtering the intensity modulations in each critical band of the speech signal. Intensity modulations that occur within the emphasis filter band are deepened, while modulations outside that band are not changed. The maximum enhancement in each band is 20 dB. The critical bands span from 300 to 8000 Hz. Bands are 1 Bark wide. Band smoothing (overlap of adjacent bands) is utilized to minimize ringing effects. Band overlaps of 100 Hz are used. The intensity modulations within each band are calculated from the pass-band filtered sound obtained from the inverse Fourier transform of the critical band signal. The time-varying intensity of this signal is computed and intensity modulations between 3 and 30 Hz are enhanced in each band. Finally, a full-spectrum speech signal is recomposed from the enhanced critical band signals. The major advantage of the method used here over methods used in previous versions of the software is that the filter functions used in the intensity modulation enhancement are derived from relatively flat Gaussian functions. These Gaussian filter functions have significant advantages over the FIR filters designed to approximate rectangular-wave functions used previously. Such FIR functions create significant ringing in the time domain due to their steepness on the frequency axis and create several maxima and minima in the impulse response. These artifacts are avoided in the current methodology.


The following levels of stretching and emphasis are used in HiFi:

    • Level 1=1.5 stretch, 20 dB emphasis
    • Level 2=1.25 stretch, 20 dB emphasis
    • Level 3=1.00 stretch, 10 dB emphasis
    • Level 4=0.75 stretch, 10 dB emphasis
    • Level 5=0.75 stretch, 0 dB emphasis


      Tell us Apart


Referring now to FIG. 16, a screen shot is shown of an exercise selection screen 1600. In this instance, the exercise Tell us Apart is being selected. Upon selection, the participant is taken to the exercise. In one embodiment, the participant is returned to the exercise selection screen 1600 when time expires in a current exercise. In an alternative embodiment, the participant is taken immediately to the next prescribed exercise, without returning to the selection screen 1600.


Applicant's believe that auditory systems in older adults suffer from a degraded ability to respond effectively to rapidly presented successive stimuli. This deficit manifests itself psychophysically in the participant's poor ability to perform auditory stimulus discriminations under backward and forward masking conditions. This manifests behaviorally in the participant's poor ability to discriminate both the identity of consonants followed by vowels, and vowels preceded by consonants. The goal of Tell us Apart is to force the participant to make consonant and vowel discriminations under conditions of forward and backward masking from adjacent vowels and consonants respectively. This is accomplished using sequential phoneme identification tasks and continuous performance phoneme identification tasks, in which participants identify successively presented phonemes. Applicants assume that older adults will find making these discriminations difficult, given their neurological deficits. These discriminations are made artificially easy (at first) by using synthetically generated phonemes in which both 1) the relative loudness of the consonants and vowels and/or 2) the gap between the consonants and vowels has been systematically manipulated to increase stimulus discriminability. As the participant improves, these discriminations are made progressively more difficult by making the stimuli more normal.


Referring now to FIG. 17, a screen shot 1700 is shown of an initial training screen within the exercise Tell us Apart. As in the exercise High or Low, the screen 1700 includes a timer, a score indicator, a trial portion, and a graphical reward portion. After the participant selects the Start button, two phonemes, or words, are graphically presented, (1702 and 1704 respectively). Then, one of the two words is presented in an acoustically processed form as described above. The participant is required to select one of the two graphically presented words 1702, 1704 to pair with the acoustically processed word. The selection is made when the participant places the cursor over one of the two graphical words, and indicates a selection (e.g., by clicking on a mouse button). If the participant makes a correct selection, the score indicator increments, and a “ding” is played. If the participant makes an incorrect selection, a “thunk” is played.


Referring to FIG. 18, a screen shot 1800 is shown, particularly illustrating a graphical reward portion 1802 that is traced, in part, upon completion of a trial. And, over a number of trials, the graphical reward portion is completed in trace form, finally resolving into a completed picture.


Referring to FIG. 19, a screen shot 1900 is shown, particularly illustrating a graphical reward portion 1902 that places a FIG. 1904 into the graphical reward portion 1902 upon completion of each trial. After a given number of trials, a reward animation is presented, as in the exercise High or Low, utilizing the FIGS. 1904 presented over the course of a number of trials. A complete description of advancement through the exercise Tell us Apart, including a description of the various processing levels used within the exercise is provided in Appendix B.


Match It


Goals of the exercise Match It! include: 1) exposing the auditory system to substantial numbers of consonant-vowel-consonant syllables that have been processed to emphasize and stretch rapid frequency transitions; and 2) driving improvements in working memory by requiring participants to store and use such syllable information in auditory working memory. This is done by using a spatial match task similar to the game “Concentration”, in which participants must remember the auditory information over short periods of time to identify matching syllables across a spatial grid of syllables.


Match It! has only one Task, but utilizes 5 speech processing levels. Processing level 1 is the most processed and processing level 5 is normal speech. Participants move through stages within a processing level before moving to a less processed speech level. Stages are characterized by the size of the spatial grid. At each stage, participants complete all the categories. The task is a spatial paired match task. Participants see an array of response buttons. Each response button is associated with a specific syllable (e.g., “big”, “tag”), and each syllable is associated with a pair of response buttons. Upon pressing a button, the participant hears the syllable associated with that response button. If the participant presses two response buttons associated with identical syllables consecutively, those response buttons are removed from the game. The participant completes a trial when they have removed all response buttons from the game. Generally, a participant completes the task by clicking on various response buttons to build a spatial map of which buttons are associated with which syllables, and concurrently begins to click consecutive pairs of responses that they believe, based on their evolving spatial map, are associated with identical syllables. The task is made more difficult by increasing the number of response buttons and manipulating the level of speech processing the syllables receive.


Stages: There are 4 task stages, each associated with a specific number of response buttons in the trial and a maximum number of response clicks allowed:

Number ofMaximum Number ofStageResponse ButtonsClicks (max clicks)1 8 (4 pairs)20216 (8 pairs)60324 (12 pairs)120430 (15 pairs)150


Categories: The stimuli consist of consonant-vowel-consonant syllables or single phonemes:

Category 1Category 2Category 3Category 4Category 5baafigbigbuckbackdoribbitbudbaggisitdigbutbatpukissdipcupcabtebillkickcutcapkadishkidduckcatlaanutkitduggaprochuckpickpugpacksarugpigpuppatstudustpittubtackzepunticktucktagshogumtiptugtapchibashbidbuggabvaacandidcudgagfogashpippuckbadmamatgibdudtabnulabtigguttadthenaggigguckpad


Category 1 consists of easily discriminable CV pairs. Leading consonants are chosen from those used in the exercise Tell us Apart and trailing vowels are chosen to make confusable leading consonants as easy to discriminate as possible. Category 2 consists of easily discriminable CVC syllables. Stop, fricative, and nasal consonants are used, and consonants and vowels are placed to minimize the number of confusable CVC pairs. Categories 3, 4, and 5 consist of difficult to discriminate CVC syllables. All consonants are stop consonants, and consonants and vowels are placed to maximize the number of confusable CVC syllables (e.g., cab/cap).


Referring now to FIG. 20, a screen shot 2000 is shown of a trial within the exercise Match It! That is, after the participant selects the start button to begin a trial, they are presented initially with four buttons 2002 for selection. As they move the cursor over a button 2002, it is highlighted. When they select a button 2002, a stimuli is presented. Consecutive selection of two buttons 2000 that have the same stimuli results in the two buttons being removed from the grid.


Referring now to FIG. 21, a screen shot 2100 is shown. This screen occurs during an initial training session after the participant has selected a button. During training, the word (or stimuli) associated with the selected button 2102 is presented both aurally and graphically to the participant. However, after training has ended, the stimuli is presented aurally only.


Referring now to FIG. 22, a screen shot 2200 is shown. This shot particularly illustrates that button selections are made in pairs. That is, a first selection is made to button 2202, associated with the stimuli “hello”. This selection is held until a selection is made to the second button 2204, associated with the stimuli “goodbye”. Since the consecutively selected buttons 2202 and 2204 were not associated with the same stimuli, the buttons will remain on the grid, and will be covered to hide the stimuli.


Referring now to FIG. 23, a screen shot 2300 is shown. This screen 2300 shows two consecutively selected buttons 2302 and 2304, as in FIG. 2200. However, this screen 2300 particularly illustrates that the stimuli associated with these buttons 2302 and 2304 are presented aurally only, but not graphically.


Referring now to FIG. 24, a screen shot 2400 is shown. This screen 2400 particularly illustrates a 16 button 2402 grid, presented to the participant during a more advanced stage of training than shown above with respect to FIGS. 20-23. Furthermore, what is shown is the beginning traces of a picture in the graphical reward portion 2404, as described above. One skilled in the art will appreciate that as the participant advances through the various levels in the exercise, the number of buttons provided to the participant also increases. For a complete description of flow through the processing levels, please see Appendix C.


It has been appreciated by the inventors that a participant might occasionally get credit for successfully matching two consecutive (or sequential) stimuli when they had not previously clicked on the response buttons. That is, if the computer associates stimuli with response buttons prior to the buttons being selected, it is possible that a participant could consecutively select two response buttons that have been previously paired. The result would be to inappropriately credit a pairing, even though the pairing resulted from a chance event. It is desired to only remove response buttons resulting from actual memorization of stimuli and response button pairings. Therefore, in one embodiment of the present invention, the association between the stimuli and the response buttons are assigned by a program after the participant has selected a response button. For example, the first time a participant selects a response button, the stimuli associated with the button is chosen at random from a pool of stimuli that is associated with the present trial. If the stimuli does not match the previous selection, then it is associated with the response button, and aurally presented to the participant. However, if the stimuli does match the previous selection, another stimuli is chosen for association, thereby preventing an association which results in a chance pairing. Alternatively, the pool of stimuli to be associated with a response button is selected so as not to include the stimuli that is associated with the immediately preceding selection. One skilled in the art will appreciate that a number of solutions may exist for preventing a chance pairing of stimuli. What has been described are embodiments which do not associate a stimuli with a response button until after selection. Another embodiment might associate stimuli with response buttons prior to selection, but alter an association (in real-time) should a chance pairing occur. What is important is that a method exist to prevent a chance pairing of stimuli, which would otherwise result in removal of paired response buttons.


Sound Replay


Applicants believe that degraded representational fidelity of the auditory system in older adults causes an additional difficulty in the ability of older adults to store and use information in auditory working memory. This deficit manifests itself psychophysically in the participant's poor ability to perform working memory tasks using stimuli presented in the auditory modality. The goals of this exercise therefore include: 1) To expose the participant's auditory system to substantial numbers of consonant-vowel-consonant syllables that have been processed to emphasize and stretch the rapid frequency transitions; and 2) To drive improvements in working memory by requiring participants to store and use such syllable information in auditory working memory. These goals are met using a temporal match task similar to the neuropsychological tasks digit span and digit span backwards, in which participants must remember the auditory information over short periods of time to identify matching syllables in a temporal stream of syllables.


Sound Replay has a Main Task and Bonus Task. The stimuli are identical across the two Tasks in Sound Replay. In one embodiment, the stimuli used in Sound Replay is identical to that used in Match It. There are 5 speech processing levels. Processing level 1 is the most processed and processing level 5 is normal speech. Participants move through stages within a processing level before moving to a less processed speech level. At each stage, participants complete all categories.


A task is a temporal paired match trial. Participants hear a sequence of processed syllables (e.g., “big”, “tag”, “pat”). Following the presentation of the sequence, the participant sees a number of response buttons, each labeled with a syllable. All syllables in the sequence are shown, and there may be buttons labeled with syllables not present in the sequence (distracters). The participant is required to press the response buttons to reconstruct the sequence. The Task is made more difficult by increasing the length of the sequence, decreasing the ISI, and manipulating the level of speech processing the syllables receive. A complete description of the flow through the various stimuli and processing levels is found in Appendix D.


Referring now to FIG. 25, a screen shot 2500 is shown which illustrates a trial within the exercise Sound Replay. More specifically, after the participant selects the start button, two or more processed stimuli are aurally presented, in a particular order. Subsequent to the aural presentation, two or more graphical representations 2502, 2504 of the stimuli are presented. In one embodiment, distracter icons may also be presented to make the task more difficult for the participant. The participant is required to select the icons 2502, 2504 in the order in which they were aurally presented. Thus, if the aural presentation were “gib”, “pip”, the participant should select icon 2502 followed by selection of icon 2504. If the participant correctly responds to the trial, a “ding” is played, and the score indicator increments. Then, the graphical award portion 2506 traces a portion of a picture, as above. If the participant does not indicate the correct sequence, a “thunk” is played, and the correct response is illustrated to the participant by highlighting the icons 2502, 2504 according to their order of aural presentation.


Referring now to FIG. 26, a screen shot is shown of a more advanced level of training within the exercise Sound Replay. In this instance, six buttons 2602 are presented to the participant after aural presentation of a sequence. The participant is required to select the buttons 2602 according to the order presented in the aural sequence. As mentioned above, if they are incorrect in their selection of the buttons 2602, Sound Replay provides an onscreen illustration to show the correct order of selection of the buttons by highlighting the buttons 2602 according to the order of aural presentation.


Listen and do


Applicants believe that a degraded representational fidelity of the auditory system in older adults causes an additional difficulty in the ability of older adults to store and use information in auditory working memory. This deficit manifests itself behaviorally in the subject's poor ability to understand and follow a sequence of verbal instructions to perform a complex behavioral task. Therefore, goals of the exercise Listen and Do include: 1) exposing the auditory system to a substantial amount of speech that has been processed to emphasize and stretch the rapid frequency transitions; and 2) driving improvements in speech comprehension and working memory by requiring participants to store and use such speech information. In this task, the participant is given auditory instructions of increasing length and complexity.


The task requires the subject to listen to, understand, and then follow an auditory instruction or sequence of instructions by manipulating various objects on the screen. Participants hear a sequence of instructions (e.g., “click on the bank” or “move the girl in the red dress to the toy store and then move the small dog to the tree”). Following the presentation of the instruction sequence, the participant performs the requested actions. The task is made more difficult by making the instruction sequence contain more steps (e.g., “click on the bus and then click on the bus stop”), by increasing the complexity of the object descriptors (i.e., specifying adjectives and prepositions), and manipulating the level of speech processing the instruction sequence receives. A complete description of the flow through the processing levels in the exercise Listen and Do is found in Appendix E.


Referring now to FIG. 27, a screen shot 2700 is shown during an initial training portion of the exercise Listen and Do. This screen occurs after the participant selects the start button. An auditory message prompts the participant to click on the cafe 2702. Then, the cafe 2702 is highlighted in red to show the participant what item on the screen they are to select. Correct selection causes a “ding” to be played, and increments the score indicator. Incorrect selection causes “thunk” to be played. The participant is provided several examples during the training portion so that they can understand the items that they are select. Once the training portion is successfully completed, they are taken to a normal training exercise, where trials of processed speech are presented.


Referring now to FIG. 28, a screen shot 2800 is shown during a trial within the Listen and Do exercise. In this trial, there are 4 characters 2802 and 4 locations 2804 that may be used to test the participant. Further, as in the other exercises, a graphical reward portion 2806 is provided to show progress within the exercise.


Referring now to FIG. 29, a screen shot 2900 is shown during a more advanced training level within the exercise Listen and Do. In this screen 2900 there are 7 characters 2902 and 4 locations 2904 to allow for more complex constructs of commands. A complete list of the syntax for building commands, and the list of available characters and locations for the commands are found in Appendix E.


Story Teller


Applicants believe that the degraded representational fidelity of the auditory system in older adults causes an additional difficulty in the ability of older adults to store and use information in auditory working memory. This deficit manifests itself behaviorally in the participant's poor ability to remember verbally presented information. Therefore applicants have at least the following goals for the exercise Story Teller: 1) to expose the participant's auditory system to a substantial amount of speech that has been processed to emphasize and stretch the rapid frequency transitions; and 2) to drive improvements in speech comprehension and working memory by requiring participants to store and recall verbally presented information. This is done using a story recall task, in which the participant must store relevant facts from a verbally presented story and then recall them later. In this task, the participant is presented with auditory stories of increasing length and complexity. Following the presentation, the participant must answer specific questions about the content of the story.


The task requires the participant to listen to an auditory story segment, and then recall specific details of the story. Following the presentation of a story segment, the participant is asked several questions about the factual content of the story. The participant responds by clicking on response buttons featuring either pictures or words. For example, if the story segment refers to a boy in a blue hat, a question might be: “What color is the boy's hat?” and each response button might feature a boy in a different color hat or words for different colors. The task is made more difficult by 1) increasing the number of story segments heard before responding to questions 2) making the stories more complex (e.g., longer, more key items, more complex descriptive elements, and increased grammatical complexity) and 3) manipulating the level of speech processing of the stories and questions. A description of the process for Story Teller, along with a copy of the stories and the stimuli is found in Appendix F.


Referring now to FIG. 30, a screen shot 3000 is shown of an initial training screen within the exercise Story Teller. After the participant selects a start button, a segment of a story is aurally presented to the participant using processed speech. Once the segment is presented, the start button appears again. The participant then selects the start button to be presented with questions relating to the story.


Referring now to FIG. 31, a screen shot 3100 is shown of icons 3102 that are possible answers to an aurally presented question. In one embodiment, the aurally presented questions are processed speech, using the same processing parameters used when the story was presented. In some instances, the icons are in text format, as in FIG. 31. In other instances, the icons are in picture format, as in FIG. 32. In either instance, the participant is required to select the icon that best answers the aurally presented question. If they indicate a correct response, a “ding” is played, the score indicator is incremented, and the graphical reward portion 3104 is updated, as above. If they indicate an incorrect response, a “thunk” is played.


Although the present invention and its objects, features, and advantages have been described in detail, other embodiments are encompassed by the invention. For example, particular advancement/promotion methodology has been thoroughly illustrated and described for each exercise. The methodology for advancement of each exercise is based on studies indicating the need for frequency, intensity, motivation and cross-training. However, the number of skill/complexity levels provided for in each game, the number of trials for each level, and the percentage of correct responses required within the methodology are not static. Rather, they change, based on heuristic information, as more participants utilize the HiFi training program. Therefore, modifications to advancement/progression methodology is anticipated. In addition, one skilled in the art will appreciate that the stimuli used for training, as detailed in the Appendices, are merely a subset of stimuli that can be used within a training environment similar to HiFi. Furthermore, although the characters, and settings of the exercises are entertaining, and therefore motivational to a participant, other storylines can be developed which would utilize the unique training methodologies described herein.


Finally, those skilled in the art should appreciate that they can readily use the disclosed conception and specific embodiments as a basis for designing or modifying other structures for carrying out the same purposes of the present invention without departing from the spirit and scope of the invention as defined by the appended claims.

Claims
  • 1. A computer-implemented method for enhancing memory and cognition in adults with impaired memory and cognition relative to a young healthy state, utilizing a computing device to present stimuli and to record responses, the method comprising: presenting a stimulus to a user, wherein the user is an adult with impaired memory and cognition relative to a young healthy state; recording a response of the user to the stimulus; repeating said presenting and said recording a first specified number of times; increasing difficulty of the stimulus if the user achieves a specified level of success; decreasing the difficulty of the stimulus if the user does not achieve the specified level of success; repeating said presenting, said recording, said repeating, said increasing, and said decreasing, a second specified number times to improve the memory and cognition of the adult.
  • 2. The method of claim 1, wherein the stimulus comprises an auditory stimulus; wherein said increasing the difficulty of the stimulus comprises decreasing a level of processing of the auditory stimulus; wherein said decreasing the difficulty of the stimulus comprises increasing the level of processing of the auditory stimulus.
  • 3. The method of claim 2, wherein the level of processing of the auditory stimulus is based on one or more of: modifying a rate at which at least a portion of the auditory stimulus is played, wherein said modifying maintains characteristic pitch-pulse-phase synchronous temporal structure of voiced speech sounds; and emphasizing portions of the auditory stimulus, wherein said emphasizing uses band-modulation deepening to selectively enhance relatively fast-changing events in the voiced speech sounds.
  • 4. The method of claim 1, wherein the stimulus comprises an auditory frequency modulated (FM) sweep, wherein the FM sweep comprises a base frequency, a duration, and a direction of up or down; wherein the response comprises a button press indicating the user's perception of the direction of the sweep; wherein said increasing the difficulty of the stimulus comprises decreasing the duration of the FM sweep; and wherein said decreasing the difficulty of the stimulus comprises increasing the duration of the FM sweep.
  • 5. The method of claim 4, wherein the stimulus comprises a sequence of auditory FM sweeps, and wherein the sequence comprises a specified inter-stimulus interval (ISI) between each FM sweep in the sequence; wherein the response comprises a corresponding sequence of button presses indicating the user's perception of the respective directions of each FM sweep in the sequence; wherein said increasing the difficulty of the stimulus comprises decreasing the duration of the FM sweep and/or decreasing the ISI; and wherein said decreasing the difficulty of the stimulus comprises increasing the duration of the FM sweep and/or increasing the ISI.
  • 6. The method of claim 4, further comprising: performing said repeating said presenting, said recording, said repeating, said increasing, and said decreasing, for each of a plurality of base frequencies for the FM sweeps.
  • 7. The method of claim 1, wherein the stimulus comprises an auditory phoneme; wherein the response comprises a button press identifying the phoneme from a plurality of confusable phonemes; wherein said increasing the difficulty of the stimulus comprises decreasing emphasis of at least a portion of the auditory phoneme; and wherein said decreasing the difficulty of the stimulus comprises increasing the emphasis of at least a portion of the auditory phoneme.
  • 8. The method of claim 1, wherein the stimulus comprises an array of buttons comprising a plurality of pairs of buttons, wherein each pair of buttons is associated with a respective phoneme, and wherein each button is pressable to invoke auditory presentation of the respective phoneme; wherein the response comprises a sequential press of two buttons asserting that the two buttons are one of the plurality of pairs of buttons associated with a respective phoneme; wherein said increasing the difficulty of the stimulus comprises decreasing emphasis of at least a portion of the auditory phoneme; and wherein said decreasing the difficulty of the stimulus comprises increasing the emphasis of at least a portion of the auditory phoneme; the method further comprising: if the two buttons are one of the plurality of pairs of buttons associated with a respective phoneme, removing the two buttons from the array of buttons.
  • 9. The method of claim 8, wherein each button is associated with a randomly selected respective phoneme when first pressed by the user, and wherein the randomly selected respective phoneme is precluded from matching the respective phoneme associated with an immediately previously pressed button.
  • 10. The method of claim 1, wherein the stimulus comprises an auditory syllable; wherein the response comprises a button press identifying the syllable from a plurality of syllables textually displayed on respective buttons; wherein said increasing the difficulty of the stimulus comprises decreasing the level of processing of the auditory syllable; wherein said decreasing the difficulty of the stimulus comprises increasing the level of processing of the auditory syllable; and wherein the level of processing corresponds to the degree to which the syllable has been processed to enhance clarity of the auditory syllable.
  • 11. The method of claim 10, wherein the stimulus comprises a sequence of auditory syllables, and wherein the sequence comprises a specified inter-stimulus interval (ISI) between each auditory syllable in the sequence; wherein the response comprises a corresponding sequence of button presses identifying the syllables in the sequence; wherein said increasing the difficulty of the stimulus further comprises increasing the length of the sequence and/or decreasing the ISI; and wherein said decreasing the difficulty of the stimulus further comprises decreasing the length of the sequence and/or increasing the ISI.
  • 12. The method of claim 1, wherein the stimulus comprises an auditory instruction indicating an action to be performed, wherein the action comprises a manipulation of a graphical object; wherein the response comprises manipulating the graphical object; wherein said increasing the difficulty of the stimulus comprises decreasing the level of processing of the auditory instruction and/or increasing the complexity of the instruction; wherein said decreasing the difficulty of the stimulus comprises increasing the level of processing of the auditory instruction and/or decreasing the complexity of the instruction; and wherein the level of processing corresponds to the degree to which the auditory instruction has been processed to enhance clarity of the auditory instructions.
  • 13. The method of claim 12, wherein the stimulus comprises a sequence of auditory instructions indicating a corresponding sequence of actions to be performed by the person, wherein the actions comprise respective manipulations of graphical objects; wherein the response comprises manipulating the graphical objects; wherein said increasing the difficulty of the stimulus further comprises increasing the length of the sequence; and wherein said decreasing the difficulty of the stimulus further comprises decreasing the length of the sequence.
  • 14. The method of claim 13, wherein the auditory instructions comprise: instructions of lower complexity directed to stimulus discrimination; instructions of higher complexity directed to stimulus discrimination; instructions of lower complexity directed to memory; and instructions of higher complexity directed to memory.
  • 15. The method of claim 14, wherein each of the instructions of lower complexity directed to stimulus discrimination comprises an instruction to: select a respective graphical object with a pointing device.
  • 16. The method of claim 14, wherein each of the instructions of higher complexity directed to stimulus discrimination comprises an instruction to: select a respective graphical object with a pointing device, wherein the respective graphical object is qualified by one or more adjectives and/or one or more prepositional phrases.
  • 17. The method of claim 14, wherein each of the instructions of lower complexity directed to memory comprises an instruction to: move a respective first graphical object with respect to a respective second graphical object.
  • 18. The method of claim 14, wherein each of the instructions of higher complexity directed to memory comprises an instruction to: move a respective first graphical object with respect to a respective second graphical object, wherein one or both of the respective first graphical object and the respective second graphical object are qualified by one or more adjectives and/or one or more prepositional phrases.
  • 19. The method of claim 1, wherein the stimulus comprises an auditory story segment and one or more questions about the auditory story segment; wherein the response comprises respective button presses indicating respective answers to the one or more questions; wherein said increasing the difficulty of the stimulus comprises increasing the complexity and/or decreasing the level of processing of the auditory story; wherein said decreasing the difficulty of the stimulus comprises decreasing the complexity and/or decreasing the level of processing of the auditory story; and wherein the level of processing corresponds to the degree to which the auditory story segment has been processed to enhance clarity of the auditory story segment.
  • 20. The method of claim 19, wherein the stimulus comprises a sequence of auditory story segments and respective questions about the auditory story segments; wherein the response comprises respective button presses indicating respective answers to the respective questions about the story segments; wherein said increasing the difficulty of the stimulus further comprises increasing the length of the sequence; and wherein said decreasing the difficulty of the stimulus further comprises decreasing the length of the sequence.
  • 21. The method of claim 20, the sequence of auditory story segments compose one or more stories with respective complexities, and wherein the complexity of each story is based on one or more of: length of sentences in each story; number of key elements in each story; complexity of key elements in each story; narrative relevance of key elements in each story; and grammatical complexity of each story.
  • 22. The method of claim 21, wherein the complexity of key elements in each story is based on one or more of: use of adjectives, adjective phrases, adverbs, and/or adverb phrases qualifying the key elements of the story; and use of prepositional phrases qualifying the key elements of the story.
  • 23. The method of claim 21, wherein the narrative relevance of key elements in each story is based on one or more of: whether a key element is a main element of a plot of the story; and whether the key element is a background item of the story.
  • 24. The method of claim 21, wherein grammatical complexity of each story is based on one or more of: simple noun verb sentence structure of sentences in the story; number of clauses used in the sentences in the story; and nested clauses used in the sentences in the story.
  • 25. A computer accessible memory medium comprising program instructions for enhancing memory and cognition in adults with impaired memory and cognition relative to a young healthy state, utilizing a computing device to present stimuli and to record responses, wherein the program instructions are executable to implement: presenting a stimulus to a user, wherein the user is an adult with impaired memory and cognition relative to a young healthy state; recording a response of the user to the stimulus; repeating said presenting and said recording a first specified number of times; increasing difficulty of the stimulus if the user achieves a specified level of success; decreasing the difficulty of the stimulus if the user does not achieve the specified level of success; repeating said presenting, said recording, said repeating, said increasing, and said decreasing, a second specified number times to improve the memory and cognition of the adult.
  • 26. The memory medium of claim 25, wherein the stimulus comprises an auditory stimulus; wherein said increasing the difficulty of the stimulus comprises decreasing a level of processing of the auditory stimulus; wherein said decreasing the difficulty of the stimulus comprises increasing the level of processing of the auditory stimulus.
  • 27. The memory medium of claim 26, wherein the level of processing of the auditory stimulus is based on one or more of: modifying a rate at which at least a portion of the auditory stimulus is played, wherein said modifying maintains characteristic pitch-pulse-phase synchronous temporal structure of voiced speech sounds; and emphasizing portions of the auditory stimulus, wherein said emphasizing uses band-modulation deepening to selectively enhance relatively fast-changing events in the voiced speech sounds.
  • 28. The memory medium of claim 25, wherein the stimulus comprises an auditory frequency modulated (FM) sweep, wherein the FM sweep comprises a base frequency, a duration, and a direction of up or down; wherein the response comprises a button press indicating the user's perception of the direction of the sweep; wherein said increasing the difficulty of the stimulus comprises decreasing the duration of the FM sweep; and wherein said decreasing the difficulty of the stimulus comprises increasing the duration of the FM sweep.
  • 29. The memory medium of claim 28, wherein the stimulus comprises a sequence of auditory FM sweeps, and wherein the sequence comprises a specified inter-stimulus interval (ISI) between each FM sweep in the sequence; wherein the response comprises a corresponding sequence of button presses indicating the user's perception of the respective directions of each FM sweep in the sequence; wherein said increasing the difficulty of the stimulus comprises decreasing the duration of the FM sweep and/or decreasing the ISI; and wherein said decreasing the difficulty of the stimulus comprises increasing the duration of the FM sweep and/or increasing the ISI.
  • 30. The memory medium of claim 28, wherein the program instructions are further executable to perform performing said repeating said presenting, said recording, said repeating, said increasing, and said decreasing, for each of a plurality of base frequencies for the FM sweeps.
  • 31. The memory medium of claim 25, wherein the stimulus comprises an auditory phoneme; wherein the response comprises a button press identifying the phoneme from a plurality of confusable phonemes; wherein said increasing the difficulty of the stimulus comprises decreasing emphasis of at least a portion of the auditory phoneme; and wherein said decreasing the difficulty of the stimulus comprises increasing the emphasis of at least a portion of the auditory phoneme.
  • 32. The memory medium of claim 25, wherein the stimulus comprises an array of buttons comprising a plurality of pairs of buttons, wherein each pair of buttons is associated with a respective phoneme, and wherein each button is pressable to invoke auditory presentation of the respective phoneme; wherein the response comprises a sequential press of two buttons asserting that the two buttons are one of the plurality of pairs of buttons associated with a respective phoneme; wherein said increasing the difficulty of the stimulus comprises decreasing emphasis of at least a portion of the auditory phoneme; wherein said decreasing the difficulty of the stimulus comprises increasing the emphasis of at least a portion of the auditory phoneme; and wherein the program instructions are further executable to perform if the two buttons are one of the plurality of pairs of buttons associated with a respective phoneme, removing the two buttons from the array of buttons.
  • 33. The memory medium of claim 32, wherein each button is associated with a randomly selected respective phoneme when first pressed by the user, and wherein the randomly selected respective phoneme is precluded from matching the respective phoneme associated with an immediately previously pressed button.
  • 34. The memory medium of claim 25, wherein the stimulus comprises an auditory syllable; wherein the response comprises a button press identifying the syllable from a plurality of syllables textually displayed on respective buttons; wherein said increasing the difficulty of the stimulus comprises decreasing the level of processing of the auditory syllable; wherein said decreasing the difficulty of the stimulus comprises increasing the level of processing of the auditory syllable; and wherein the level of processing corresponds to the degree to which the syllable has been processed to enhance clarity of the auditory syllable.
  • 35. The memory medium of claim 34, wherein the stimulus comprises a sequence of auditory syllables, and wherein the sequence comprises a specified inter-stimulus interval (ISI) between each auditory syllable in the sequence; wherein the response comprises a corresponding sequence of button presses identifying the syllables in the sequence; wherein said increasing the difficulty of the stimulus further comprises increasing the length of the sequence and/or decreasing the ISI; and wherein said decreasing the difficulty of the stimulus further comprises decreasing the length of the sequence and/or increasing the ISI.
  • 36. The memory medium of claim 25, wherein the stimulus comprises an auditory instruction indicating an action to be performed, wherein the action comprises a manipulation of a graphical object; wherein the response comprises manipulating the graphical object; wherein said increasing the difficulty of the stimulus comprises decreasing the level of processing of the auditory instruction and/or increasing the complexity of the instruction; wherein said decreasing the difficulty of the stimulus comprises increasing the level of processing of the auditory instruction and/or decreasing the complexity of the instruction; and wherein the level of processing corresponds to the degree to which the auditory instruction has been processed to enhance clarity of the auditory instructions.
  • 37. The memory medium of claim 36, wherein the stimulus comprises a sequence of auditory instructions indicating a corresponding sequence of actions to be performed by the person, wherein the actions comprise respective manipulations of graphical objects; wherein the response comprises manipulating the graphical objects; wherein said increasing the difficulty of the stimulus further comprises increasing the length of the sequence; and wherein said decreasing the difficulty of the stimulus further comprises decreasing the length of the sequence.
  • 38. The memory medium of claim 37, wherein the auditory instructions comprise: instructions of lower complexity directed to stimulus discrimination; instructions of higher complexity directed to stimulus discrimination; instructions of lower complexity directed to memory; and instructions of higher complexity directed to memory.
  • 39. The memory medium of claim 38, wherein each of the instructions of lower complexity directed to stimulus discrimination comprises an instruction to: select a respective graphical object with a pointing device.
  • 40. The memory medium of claim 38, wherein each of the instructions of higher complexity directed to stimulus discrimination comprises an instruction to: select a respective graphical object with a pointing device, wherein the respective graphical object is qualified by one or more adjectives and/or one or more prepositional phrases.
  • 41. The memory medium of claim 38, wherein each of the instructions of lower complexity directed to memory comprises an instruction to: move a respective first graphical object with respect to a respective second graphical object.
  • 42. The memory medium of claim 38, wherein each of the instructions of higher complexity directed to memory comprises an instruction to: move a respective first graphical object with respect to a respective second graphical object, wherein one or both of the respective first graphical object and the respective second graphical object are qualified by one or more adjectives and/or one or more prepositional phrases.
  • 43. The memory medium of claim 25, wherein the stimulus comprises an auditory story segment and one or more questions about the auditory story segment; wherein the response comprises respective button presses indicating respective answers to the one or more questions; wherein said increasing the difficulty of the stimulus comprises increasing the complexity and/or decreasing the level of processing of the auditory story; wherein said decreasing the difficulty of the stimulus comprises decreasing the complexity and/or decreasing the level of processing of the auditory story; and wherein the level of processing corresponds to the degree to which the auditory story segment has been processed to enhance clarity of the auditory story segment.
  • 44. The memory medium of claim 43, wherein the stimulus comprises a sequence of auditory story segments and respective questions about the auditory story segments; wherein the response comprises respective button presses indicating respective answers to the respective questions about the story segments; wherein said increasing the difficulty of the stimulus further comprises increasing the length of the sequence; and wherein said decreasing the difficulty of the stimulus further comprises decreasing the length of the sequence.
  • 45. The memory medium of claim 44, the sequence of auditory story segments compose one or more stories with respective complexities, and wherein the complexity of each story is based on one or more of: length of sentences in each story; number of key elements in each story; complexity of key elements in each story; narrative relevance of key elements in each story; and grammatical complexity of each story.
  • 46. The memory medium of claim 45, wherein the complexity of key elements in each story is based on one or more of: use of adjectives, adjective phrases, adverbs, and/or adverb phrases qualifying the key elements of the story; and use of prepositional phrases qualifying the key elements of the story.
  • 47. The memory medium of claim 45, wherein the narrative relevance of key elements in each story is based on one or more of: whether a key element is a main element of a plot of the story; and whether the key element is a background item of the story.
  • 48. The memory medium of claim 45, wherein grammatical complexity of each story is based on one or more of: simple noun verb sentence structure of sentences in the story; number of clauses used in the sentences in the story; and nested clauses used in the sentences in the story.
CROSS REFERENCE TO RELATED APPLICATION(S)

This application is a continuation-in-part of U.S. patent application Ser. No. 10/894,388, filed Jul. 19, 2004 entitled “REWARDS METHOD FOR IMPROVED NEUROLOGICAL TRAINING”. That application claimed the benefit of the following U.S. Provisional Patent Applications, which are hereby incorporated by reference herein in their entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.010160/536129Jan. 13, 2004NEUROPLASTICITY TOREVITALIZE THE BRAINNRSC.010260/536112Jan. 13, 2004LANGUAGE MODULEEXERCISENRSC.010360/536093Jan. 13, 2004PARKINSON'S DISEASE,AGING INFIRMITY,ALZHEIMER'S DISEASENRSC.010460/549390Mar. 2, 2004SENSORIMOTORAPPLIANCESNRSC.010560/558771Apr. 1, 2004SBIR'SNRSC.010660/565923Apr. 28, 2004ATP FINALNRSC.010860/575979Jun. 1, 2004HiFi V 0.5 SOURCE This application is also a continuation of U.S. patent application Ser. No. 11/032894 entitled “A METHOD FOR ENHANCING MEMORY AND COGNITION IN AGING ADULTS”, which is a continuation-in-part of U.S. patent application Ser. No. 10/894388, referenced above. U.S. application Ser. No. 11/032894 claimed the benefit of the following U.S. Provisional Patent Applications, which are hereby incorporated by reference herein in their entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.010160/536129Jan. 13, 2004NEUROPLASTICITYTO REVITALIZETHE BRAINNRSC.010260/536112Jan. 13, 2004LANGUAGEMODULE EXERCISENRSC.010360/536093Jan. 13, 2004PARKINSON'SDISEASE, AGINGINFIRMITY, ALZHEIMER'SDISEASENRSC.010460/549390Mar. 2, 2004SENSORIMOTORAPPLIANCESNRSC.010560/558771Apr. 1, 2004SBIR'SNRSC.010660/565923Apr. 28, 2004ATP FINALNRSC.010860/575979Jun. 1, 2004HiFi V 0.5 SOURCENRSC.010960/588829Jul. 16, 2004HiFi SOURCE CODENRSC.011060/598877Aug. 4, 2004HiFi SOURCE CODENRSC.011160/601666Aug. 13, 2004COMPANIONGUIDE TO HiFi This application is also a continuation of U.S. patent application Ser. No. 11/231132 entitled “A METHOD FOR ENHANCING MEMORY AND COGNITION IN AGING ADULTS” which is a continuation of U.S. application Ser. No. 11/032894, which is a continuation-in-part of U.S. application Ser. No. 10/894388, both of which are referenced above. U.S. application Ser. No. 11/231132 claimed the benefit of the following U.S. Provisional Patent Application, which is hereby incorporated by reference herein in its entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.011560/680127May 12, 2005HIFI EXERCISES ANDELEMENTS SCIENCEBASIS AND GOALS This application is also a continuation of U.S. patent application Ser. No. 11/245253 entitled “A METHOD FOR ENHANCING MEMORY AND COGNITION IN AGING ADULTS” which is a continuation-in-part of U.S. patent application Ser. No. 11/032894, referenced above, which is a continuation-in-part of U.S. patent application Ser. No. 10/894388, referenced above. U.S. application Ser. No. 11/245253 claimed the benefit of the following U.S. Provisional Patent Applications which are incorporated herein in their entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.011560/680127May 12, 2005HIFI EXERCISES ANDELEMENTS SCIENCEBASIS AND GOALSNRSC.020660/658308Mar. 2, 2005A METHOD OF ENSURINGTHAT INDIVIDUALSPERFORMING AMATCHING TASK DO NOTPERFORM THE TASKCORRECTLY BY CHANCE This application is also a continuation of U.S. patent application Ser. No. 11/294936 entitled “A METHOD FOR ENHANCING MEMORY AND COGNITION IN AGING ADULTS” which is a continuation of U.S. patent application Ser. No. 11/245253 entitled “A METHOD FOR ENHANCING MEMORY AND COGNITION IN AGING ADULTS” which is a continuation-in-part of U.S. patent application Ser. No. 11/032894, referenced above, which is a continuation-in-part of U.S. patent application Ser. No. 10/894388, referenced above. U.S. application Ser. No. 11/294936 claimed the benefit of the following U.S. Provisional Patent Applications which are incorporated herein in their entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.011360/670927Apr. 13, 2005HIFI HEALTHY AGINGFASTRACKNRSC.011560/680127May 12, 2005HIFI EXERCISES ANDELEMENTS SCIENCE BASIS ANDGOALSNRSC.020660/658308Mar. 2, 2005A METHOD OF ENSURING THATINDIVIDUALS PERFORMING AMATCHING TASK DO NOT PERFORM THE TASK CORRECTLY BYCHANCEPS.0116UNKNOWNOct. 31, 2005METHOD FOR MODULATINGLISTENER ATTENTION TOWARDSYNTHETIC FORMANTTRANSITION CUES IN SPEECHSTIMULI FOR TRAINING This application is also a continuation of U.S. patent application Ser. No. 11/322199 entitled “A METHOD FOR ENHANCING MEMORY AND COGNITION IN AGING ADULTS” which is a continuation-in-part of U.S. patent application Ser. No. 10/894388, and a continuation of U.S. patent application Ser. Nos. 11/032894; 11/231132; 11/245253; and 11/294936. U.S. patent application Ser. No. 11/322199 claimed the benefit of the following U.S. Provisional Patent Applications which are incorporated herein in their entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.011260/657863Mar. 2, 2005HAWKEYE VISIONSPECIFICATIONNRSC.011360/670927Apr. 13, 2005HIFI HEALTHY AGINGFASTRACKNRSC.011560/680127May 12, 2005HIFI EXERCISES ANDELEMENTS SCIENCE BASIS ANDGOALSNRSC.020660/658308Mar. 2, 2005A METHOD OF ENSURING THATINDIVIDUALS PERFORMING AMATCHING TASK DO NOT PERFORMTHE TASK CORRECTLY BYCHANCEPS.011660/731783Oct. 31, 2005METHOD FOR MODULATINGLISTENER ATTENTION TOWARDSYNTHETIC FORMANTTRANSITION CUES IN SPEECHSTIMULI FOR TRAININGPS.0117UNKNOWNDec. 13, 2005ZEST PROGRESSIONS IN HIFIASSESSMENTSPS.0118UNKNOWNDec. 13, 2005HIFI EXPANSION PACKPS.0119UNKNOWNDec. 15, 2005HAWKEYE ASSESSMENTSSPECIFICATION This application is also a continuation of U.S. patent application Ser. No. 11/322198 entitled “A METHOD FOR ENHANCING MEMORY AND COGNITION IN AGING ADULTS” which is a continuation in part of U.S. patent application Ser. No. 10/894388, and a continuation of U.S. patent application Ser. Nos. 11/032894; 11/231132; 11/245253; and 11/294936. U.S. patent application Ser. No. 11/322198 claimed the benefit of the following U.S. Provisional Patent Applications which are incorporated herein in their entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.011260/657863Mar. 2, 2005HAWKEYE VISIONSPECIFICATIONNRSC.011360/670927Apr. 13, 2005HIFI HEALTHY AGINGFASTRACKNRSC.011560/680127May 12, 2005HIFI EXERCISES ANDELEMENTS SCIENCE BASIS ANDGOALSNRSC.020660/658308Mar. 2, 2005A METHOD OF ENSURING THATINDIVIDUALS PERFORMING AMATCHING TASK DO NOT PERFORMTHE TASK CORRECTLY BYCHANCEPS.011660/731783Oct. 31, 2005METHOD FOR MODULATINGLISTENER ATTENTION TOWARDSYNTHETIC FORMANTTRANSITION CUES IN SPEECHSTIMULI FOR TRAININGPS.0117UNKNOWNDec. 13, 2005ZEST PROGRESSIONS IN HIFIASSESSMENTSPS.0118UNKNOWNDec. 13, 2005HIFI EXPANSION PACKPS.0119UNKNOWNDec. 15, 2005HAWKEYE ASSESSMENTSSPECIFICATION This application claims the benefit of the following U.S. Provisional Patent Applications which are hereby incorporated by reference herein in their entirety for all purposes: DocketSer. No.Filing DateTitleNRSC.011260/657863Mar. 2, 2005HAWKEYE VISIONSPECIFICATIONNRSC.011360/670927Apr. 13, 2005HIFI HEALTHY AGINGFASTRACKNRSC.011560/680127May 12, 2005HIFI EXERCISES ANDELEMENTS SCIENCE BASIS ANDGOALSPS.011660/731783Oct. 31, 2005METHOD FOR MODULATINGLISTENER ATTENTION TOWARDSYNTHETIC FORMANT TRANSITIONCUES IN SPEECHSTIMULI FOR TRAININGPS.011760/749979Dec. 13, 2005ZEST PROGRESSIONS IN HIFIASSESSMENTSPS.011860/749997Dec. 13, 2005HIFI EXPANSION PACKPS.011960/750509Dec. 15, 2005HAWKEYE ASSESSMENTSSPECIFICATIONPS.0120UNKNOWNJan. 26, 2006CONTINUOUS PERFORMANCEPS.0121UNKNOWNJan. 26, 2006COMPUTER BASED FACE-NAMEASSOCIATION TRAININGPROGRAMPS.0122UNKNOWNJan. 26, 2006COMPUTER BASED TRAININGPROGRAM TO REVERSE AGERELATED DECLINES IN VISUALSEARCHPS.0123UNKNOWNJan. 26, 2006COMPUTER BASED TRAININGPROGRAM TO REVERSE AGERELATED DECLINES IN SPATIALAND TEMPORAL PROCESSINGOF VISUAL STIMULI

Provisional Applications (51)
Number Date Country
60536129 Jan 2004 US
60536112 Jan 2004 US
60536093 Jan 2004 US
60549390 Mar 2004 US
60558771 Apr 2004 US
60565923 Apr 2004 US
60575979 Jun 2004 US
60536129 Jan 2004 US
60536112 Jan 2004 US
60536093 Jan 2004 US
60549390 Mar 2004 US
60558771 Apr 2004 US
60565923 Apr 2004 US
60575979 Jun 2004 US
60588829 Jul 2004 US
60598877 Aug 2004 US
60601666 Aug 2004 US
60680127 May 2005 US
60680127 May 2005 US
60658308 Mar 2005 US
60670927 Apr 2005 US
60680127 May 2005 US
60658308 Mar 2005 US
60731783 Oct 2005 US
60657863 Mar 2005 US
60670927 Apr 2005 US
60680127 May 2005 US
60658308 Mar 2005 US
60731783 Oct 2005 US
60749979 Dec 2005 US
60749997 Dec 2005 US
60750509 Dec 2005 US
60657863 Mar 2005 US
60670927 Apr 2005 US
60680127 May 2005 US
60658308 Mar 2005 US
60731783 Oct 2005 US
60750509 Dec 2005 US
60749997 Dec 2005 US
60749979 Dec 2005 US
60657863 Mar 2005 US
60670927 Apr 2005 US
60680127 May 2005 US
60731783 Oct 2005 US
60749979 Dec 2005 US
60749997 Dec 2005 US
60750509 Dec 2005 US
60762432 Jan 2006 US
60762433 Jan 2006 US
60762434 Jan 2006 US
60762446 Jan 2006 US
Continuations (16)
Number Date Country
Parent 11032894 Jan 2005 US
Child 11346627 Feb 2006 US
Parent 11231132 Sep 2005 US
Child 11346627 Feb 2006 US
Parent 11032894 Jan 2005 US
Child 11231132 Sep 2005 US
Parent 11245253 Oct 2005 US
Child 11346627 Feb 2006 US
Parent 11294936 Dec 2005 US
Child 11346627 Feb 2006 US
Parent 11245253 Oct 2005 US
Child 11294936 Dec 2005 US
Parent 11322199 Dec 2005 US
Child 11346627 Feb 2006 US
Parent 11032894 Jan 2005 US
Child 11322199 Dec 2005 US
Parent 11231132 Sep 2005 US
Child 11322199 Dec 2005 US
Parent 11245253 Oct 2005 US
Child 11322199 Dec 2005 US
Parent 11294936 Dec 2005 US
Child 11322199 Dec 2005 US
Parent 11322198 Dec 2005 US
Child 11346627 Feb 2006 US
Parent 11032894 Jan 2005 US
Child 11322198 Dec 2005 US
Parent 11231132 Sep 2005 US
Child 11322198 Dec 2005 US
Parent 11245253 Oct 2005 US
Child 11322198 Dec 2005 US
Parent 11294936 Dec 2005 US
Child 11322198 Dec 2005 US
Continuation in Parts (9)
Number Date Country
Parent 10894388 Jul 2004 US
Child 11346627 Feb 2006 US
Parent 10894388 Jul 2004 US
Child 11032894 Jan 2005 US
Parent 10894388 Jul 2004 US
Child 11032894 Jan 2005 US
Parent 11032894 Jan 2005 US
Child 11245253 Oct 2005 US
Parent 10894388 Jul 2004 US
Child 11032894 Jan 2005 US
Parent 11032894 Jan 2005 US
Child 11245253 Oct 2005 US
Parent 10894388 Jul 2004 US
Child 11032894 Jan 2005 US
Parent 10894388 Jul 2004 US
Child 11322199 Dec 2005 US
Parent 10894388 Jul 2004 US
Child 11322198 Dec 2005 US