CROSS-REFERENCE TO RELATED APPLICATIONS
The present application is in reference to and claims priority of a pending UK patent application number GB200883.6 filed on 10 Jun. 2020, entitled “Multi-Factor Verification and Timing Displaying System” by the present inventor Daniel Walklin.
STATEMENT REGARDING FENDERALLY SPONSORED RESEARCH OR DEVELOPMENT (IF APPLICABLE)
Not applicable
FIELD OF THE INVENTION
This invention relates to a device that can track and display the duration of time a user uses musical equipment/instrument or fitness equipment.
BACKGROUND OF THE INVENTION
Learning to play an instrument or developing a skill with a piece of equipment in a sport or other, is a difficult and a time-consuming process. Most people are unaware of how much time on average is needed to reach a certain level of competency, and instead have unrealistic expectations of what to expect early on in the learning process. This results in many people giving up.
Teachers can offer a level of motivation and give people realistic expectations for what to expect and how long things should take, but in many cases people do not have teachers and instead learn alone.
It is commonly accepted that 10,000 hours is required for mastery of a skill. If people were made more aware of how far away they are from this goal, this may encourage them to practice more frequently. Furthermore, the hours required to reach competency in a skill is significantly less, yet this value is still unknown to many. Being able to provide users with realistic expectations of what to expect after 10, 50, 100 hours or more of practice, will give a learner something more tangible to aim for.
Current means of tracking such information requires users to actively track the regularity and duration of their practicing with a timer or watch and record the values manually. This is hard to remember to do, and easily forgotten despite being extremely beneficial. It is also very hard for a user to make sense of data they have tracked and relate it to any goals or compare data to anyone who have already been through a similar learning journey and succeeded. Current solutions are too simplistic and cannot accurately track a user practising and therefore the data produced is not accurate or reflective of the work done. Many factors other than sound are required to ensure a false positive in detection has not been achieved. In addition, the devices themselves do not immediately display duration of practice, which is crucial for motivation to practice further.
BRIEF SUMMARY OF THE INVENTION
According to the present invention there is provided a multi-factor verification timing and displaying system comprising: a device attached to the equipment arranged to automatically track and display timing data comprising; a microcontroller with non-volatile memory; a display; at least one button; a vibration sensor in communication with said microcontroller; a accelerometer and gyroscope in communication with said microcontroller; a light sensor arranged to sense visible and non-visible spectrum light in communication with said microcontroller; an antenna in communication with said microcontroller; a power source; and an adjustable mount; wherein the microcontroller is designed to detect data on the usage time of the equipment the device is attached to and store such data to non-volatile memory, and display on the display; wherein the accelerometer and gyroscope is configured to detect motion of the device; wherein the light sensor is configured to detect if the equipment is being stored; wherein the light sensor is configured to detect the proximity of a warm body; wherein the vibration sensor is configured to detect vibrations pertaining to the equipment being in use; wherein said display visually communicates time and data for the device; wherein at least one button allows the user to change a time period in which to view the timing data; wherein the device comprises a detachable mount for the equipment; wherein the antenna provides a means of communicating timing data remotely; and wherein the microcontroller' detection of usage of the equipment, is in order of priority; (a) Activation of the device from low power sleep via sound stimulation from the piezo vibration sensor; (b) Piezo vibration sensor data analysis to ensure sound is indicative of use by comparing sound data to a database of reference values; (c) motion sensor data analysis to ensure motion data indicative of use by comparing to a database of reference values; (d) motion data compared to sound data to detect correlations expected when the equipment is in use; (e) Light sensor motion analysis to ensure environmental conditions are indicative of a normal use case for using the equipment (f) Confirmation from all sensors of expected use conditions in this order to begin the timer and periodic re-evaluation to ensure the device remains in use wherein once any data differs in a predefined margin the device will power down; wherein said microcontroller is enabled to have different data settings for different equipment, so as to vary sensors in use, the sensors' priority and sensitivity.
In this way the system and device of the present invention allows a user to automatically track the time invested into learning/practicing using a piece of equipment the device is attached to.
This relates to primarily to the tracking of a user using musical equipment or instruments, as well as sports equipment and is designed to be universal and adaptable to potentially other devices too. The device allows the user to see progress of invested time instantly via the inbuilt display, as well as how far away they are from any time related goals on the display at a glance.
The challenge the invention has overcome relates to accurate practice tracking of a piece of equipment in use. Depending on the equipment being tracked there are various different in use characteristics that can be used to accurately determine correct use has been detected.
To achieve this the present invention includes a vibration sensor, accelerometer/gyroscope, a light sensor (including IR spectrum), a microprocessor, a battery for power, non-volatile memory, a mounting system, an inbuilt display, an antenna with means of wireless communication and at least one button.
The device records and displays values pertaining to the duration of time practiced on the equipment the device is attached to. In addition, the invention consists of a multi-level verification process to ensure correct usage has been detected, and displays progress on the inbuilt display.
BRIEF DESCRIPTION OF DRAWINGS
The invention will now be described solely by way of example and with reference to the accompanying drawings in which:
FIG. 1 shows an exploded isometric top view of the invention.
FIG. 2 shows an exploded isometric bottom view of the invention.
FIG. 3 shows an isometric top view of the invention.
FIG. 4 shows an isometric bottom view of the invention.
FIG. 5 shows an isometric top view of the invention with the clip mount disconnected, parts 16,13,15.
FIG. 6 shows an isometric bottom view of the invention with the clip mount disconnected, parts 16,13,15.
FIG. 7 shows an isometric top view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 8 shows an isometric bottom view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 9 shows a top view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 10 shows a side view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 11 shows a front of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 12 shows bottom view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 13 shows an isometric top view of the invention.
FIG. 14 shows an isometric bottom view of the invention.
FIG. 15 shows a top view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 16 shows a side view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 17 shows a front view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 18 shows bottom view of the invention with the battery sliding housing 3 removed and the coin cell battery 2 removed from the battery sliding housing 3.
FIG. 19 shows an isometric top view of the invention with the battery sliding housing 3 removed with the coin cell battery 2 in place inside the battery sliding housing 3.
FIG. 20 shows an isometric bottom view of the invention with the battery sliding housing 3 removed with the coin cell battery 2 in place inside the battery sliding housing 3.
FIG. 21 shows a top view of the invention with the battery sliding housing 3 removed with the coin cell battery 2 in place inside the battery sliding housing 3.
FIG. 22 shows a front view of the invention with the battery sliding housing 3 removed with the coin cell battery 2 in place inside the battery sliding housing 3.
FIG. 23 shows a side view of the invention with the battery sliding housing 3 removed with the coin cell battery 2 in place inside the battery sliding housing 3.
FIG. 24 shows a bottom view of the invention with the battery sliding housing 3 removed with the coin cell battery 2 in place inside the battery sliding housing 3.
FIG. 25 shows an isometric top view of the invention with an alternative clip design 19 that relies on it elastically deforming to clip onto different pieces of equipment such as the head of a guitar, FIG. 51, or piano edge, FIG. 56.
FIG. 26 shows an isometric bottom view of the invention with an alternative clip design 19 that relies on it elastically deforming to clip onto different pieces of equipment such as the head of a guitar, FIG. 51, or piano edge, FIG. 56.
FIG. 27 shows a top view of the invention with alternative clip design 19.
FIG. 28 shows a left side view of the invention with alternative clip design 19.
FIG. 29 shows a front view of the invention with alternative clip design 19.
FIG. 30 shows a right side view of the invention with alternative clip design 19.
FIG. 31 shows a bottom side view of the invention with alternative clip design 19. Highlighting the keyhole system which attaches the mount 19.
FIG. 32 shows an isometric top view of the invention with an alternative clip design 20 that relies on it elastically deforming to clip onto different pieces of equipment such as the head of a guitar, FIG. 5327, or piano edge, FIG. 57.
FIG. 33 shows an isometric bottom view of the invention with an alternative clip design 20 that relies on it elastically deforming to clip onto different pieces of equipment such as the head of a guitar, FIG. 5327, or piano edge, FIG. 57.
FIG. 34 shows a top view of the invention with alternative clip design 19.
FIG. 35 shows a left side view of the invention with alternative clip design 19.
FIG. 36 shows a front view of the invention with alternative clip design 19.
FIG. 37 shows a right side view of the invention with alternative clip design 19.
FIG. 38 shows a bottom side view of the invention with alternative clip design 19. Highlighting the keyhole system which attaches the mount 19.
FIG. 39 shows an isometric top view of the invention with an alternative clip design 21,22 that relies an adhesive to mount the device on pieces of equipment such as positions 30,29 in FIG. 53, position 28 in FIG. 48, as described in FIG. 46, FIG. 55 in position 33,34, FIG. 62, FIG. 63 position 42 and FIG. 65 position 44.
FIG. 40 shows an isometric bottom view of the invention with an alternative clip design 21,22 that relies an adhesive to mount the device on pieces of equipment such as positions 30,29 in FIG. 53, position 28 in FIG. 48, as described in FIG. 46, FIG. 55 in position 33,34, FIG. 62, FIG. 63 position 42 and FIG. 65 position 44.
FIG. 41 shows a top view of the invention with alternative clip design 21,22.
FIG. 42 shows a left side view of the invention with alternative clip design 21,22.
FIG. 43 shows a front view of the invention with alternative clip design 21,22.
FIG. 44 shows a right side view of the invention with alternative clip design 21,22.
FIG. 45 shows a bottom side view of the invention with alternative clip design 21,22.
FIG. 46 shows an isometric top view of the invention mounted to a microphone.
FIG. 47 shows an isometric bottom view of the invention mounted to a microphone.
FIG. 48 shows an isometric top view of the invention mounted to a tennis racket.
FIG. 49 shows an detailed view of the invention mounted to a tennis racket.
FIG. 50 shows an isometric bottom view of the invention mounted to a tennis racket.
FIG. 51 shows a detailed view of the invention mounted to a guitar using mount 19.
FIG. 52 shows a detailed view of the invention mounted to a guitar using adhesive mount 21,22.
FIG. 53 shows an isometric top view of the invention mounted in numerous locations on a guitar.
FIG. 54 shows an isometric bottom view of the invention mounted in numerous locations on a guitar.
FIG. 55 shows an isometric top view of the invention mounted in numerous locations on a piano and stool, 31, 32, 33, 34.
FIG. 56 shows a detailed view of the invention mounted to a piano using mount 19.
FIG. 57 shows a detailed view of the invention mounted to a piano using mount 20.
FIG. 58 shows a detailed view of the invention mounted to a piano using mount 21,22.
FIG. 59 shows a detailed view of the invention mounted to a piano stool using mount 21,22.
FIG. 60 shows an isometric top view of the invention mounted to a drum set in numerous ways, 36, 35.
FIG. 61 shows a detailed view of the invention mounted to a drum set via the spring clip. 16,13,15.
FIG. 62 shows a detailed view of the invention mounted to a drum set via the adhesive mount 21,22.
FIG. 63 shows an isometric top view of the invention mounted to a cajon in numerous ways. 42 via an adhesive mount and 41 via a clip mount.
FIG. 64 shows an isometric top view of the invention mounted to a cajon in numerous ways. 42 via an adhesive mount and 41 via a clip mount.
FIG. 65 shows an isometric top view of the invention mounted to a speaker in numerous ways. 42 via an adhesive mount and 41 via a clip mount.
FIG. 66 shows an isometric top view of the invention mounted to a speaker in numerous ways. 42 via an adhesive mount and 41 via a clip mount.
FIG. 67 shows an electronics schematic showing the major components of the invention.
FIG. 68 shows the multiple different ways the device can detect if use of the piece of equipment has occurred. This figure should be viewed with FIG. 75 and FIG. 76 which shows examples of paths that would be appropriate for the detection of a guitar being in use. FIG. 68 shows the potential to configure different sensor priorities for accurate detection for different use cases.
FIG. 69 shows the process flow for accurate detection for the device where sound, movement and light play a significant role in device use characteristics. Sound stimulates piezo vibration sensor in the device to wake the microcontroller from low power mode followed by sequential confirmation of in use values from the piezo vibration sensor, gyroscope/accelerometer, and light sensor to detect use.
FIG. 70 shows the process flow for accurate detection for the device where sound, movement and light play a significant role in device use characteristics. Movement stimulates the device to wake the microcontroller from low power mode, followed by sequential confirmation of in use values from the gyroscope/accelerometer, piezo vibration sensor, and light sensor to detect use.
FIG. 71 shows the process flow for accurate detection for the device where vibration or sound do not vary significant or at all during device use characteristics. Light stimulates the device to the microcontroller from low power mode and is the only sensor present to keep the device activated detecting use until the sensor values moves outside the expected use range.
FIG. 72 shows the process flow for accurate detection for the device where sound and movement play a significant role in the device use characteristics. Sound stimulates the device to wake the microcontroller from low power mode followed by sequential confirmation of in use values from the gyroscope/accelerometer, piezo vibration sensor, and light sensor to detect use.
FIG. 73 shows the process flow for accurate detection for the device where only movement and sound play a significant role in the device use characteristics. Movement stimulates the device to wake the microcontroller from low power mode followed by sequential confirmation of in use values from the gyroscope/accelerometer, piezo vibration sensor to detect use.
FIG. 74 shows the process flow for accurate detection for the device where only sound plays a significant role in the device use characteristics. Sound stimulates the device to wake the microcontroller from low power mode via the piezo vibration sensor, followed by confirmation of in use values from the piezo vibration sensor to detect use.
FIG. 75 shows the process flow for accurate detection for the device where only movement plays a significant role in the device use characteristics. movement stimulates the device to wake the microcontroller from low power mode via the accelerometer/gyroscope sensor, followed by confirmation of in use values from the accelerometer/gyroscope sensor to detect use.
FIG. 76 shows the process flow for accurate detection for the device where sound, movement and light play a significant role in device use characteristics. Sound stimulates piezo vibration sensor in the device to wake the microcontroller from low power mode followed by sequential confirmation of in use values from the piezo vibration sensor, gyroscope/accelerometer, and light sensor to detect use.
FIG. 77 shows the process flow for accurate detection for the device where sound, movement and light play a significant role in device use characteristics. Movement stimulates the device to wake the microcontroller from low power mode, followed by sequential confirmation of in use values from the gyroscope/accelerometer, piezo vibration sensor, and light sensor to detect use.
FIG. 78 showing the landscape display graphics for tracking activity during use view.
FIG. 79 showing the portrait display graphics for tracking activity during use view.
FIG. 80 showing the portrait display graphics for the Today view.
FIG. 81 showing the landscape display graphics for the Today view.
FIG. 82 showing the portrait display graphics for the Week view.
FIG. 83 showing the landscape display graphics for the Week view.
FIG. 84 showing the portrait display graphics for the Month view.
FIG. 85 showing the landscape display graphics for the Month view.
FIG. 86 showing the portrait display graphics for the Year view.
FIG. 87 showing the landscape display graphics for the Year view.
FIG. 88 showing the portrait display graphics for the 10,000 hour view.
FIG. 89 showing the landscape display graphics for the 10,000 hour view.
FIG. 90 showing different methods of interacting with the device, from remote control via a smart device such as a smartphone, buttons on the device via a press, and via detecting tapping on the device using the accelerometer/gyroscope or piezo vibration sensor.
With number declarations as follows:
1. Clear plastic screen window
2. Coin cell battery
3. Coin cell battery sliding housing
4. Display, (MIP or E-ink or Other)
5. Upper plastic casing
6. Light sensor
7. Wireless communication module
8. PCB assembly comprising of components 6,7,10,9 and 17
9. Accelerometer/gyroscope
10. Microprocessor and non-volatile memory
11. Button cap
12. Lower plastic casing
13. Clip mount
14. Piezo vibration sensor—wired to PCB
15. Clip shaft
16. Clip arm
17. Button/s
18. Light sensor plastic cap
19. Clip mount variant 2
20. Clip mount variant 3
21. Clip mount variant 4 main body
22. Clip mount variant 4 adhesive
23. Microphone
24. Tennis racket
25. Clip mount variant 4 adhesive on tennis racket
26. Guitar body
27. Clip mount variant 3 on guitar head top
28. Clip mount variant 2 on guitar head side
29. Clip mount variant 4 adhesive on side of guitar body facing the player
30. Clip mount variant 4 adhesive on front of guitar body
31. Clip mount variant 2 on piano lid
32. Clip mount variant 3 on piano lid
33. Clip mount variant 4 adhesive on front of piano
34. Clip mount variant 4 adhesive on side of stool/chair
35. Clip mount variant 2 on drum rim
36. Clip mount variant 4 adhesive on drum
37. Stool/chair
38. Piano
39. Drum
40. Cajon
41. Clip mount variant 2 on cajon opening
42. Clip mount variant 4 adhesive on back of the cajon
43. Speaker
44. Clip mount variant 4 adhesive on top of a speaker
DETAILED DESCRIPTION OF THE INVENTION
Scenario 1:—Tracking a User Practicing Using a Piece of Musical Equipment/Instrument Such as a Saxophone, Violin or Guitar
Movement alone would not be sufficient to detect use of a piece of equipment but it can indicate potential use. An accelerometer/gyroscope could be used to detect motion relating to correct movement expected when playing has occurred. However, scenarios where a user may just be holding their instrument and not playing need to be accounted for. Different locations of monitoring movement can be used to increase accuracy of detection on the equipment by cross referencing motion with expected in use motion, however there may be insufficient data to fully validate use.
Similarly, solely detecting sound does not necessarily indicate the user is playing the instrument. They may be next to another user who has the same instrument and is playing, whilst they are holding their instrument about to play.
Additionally, the device maybe attached to equipment that is in a carry case or bag near places where sound and movement could trigger the device to begin. This could be on public transport, or in a case within an orchestra setting. Resonant frequencies in this case could make strings on a violin for example vibrate and produce sound themselves.
FIGS. 69 and 70 show how the device can utilise multiple sensors for this scenario to ensure correct use has been detected. By using different sensors, the device can authenticate correct use has occurred to a high degree of accuracy. FIGS. 69 and 70 use the same sensor set, and differ in sensor priority, however the result is essentially the same. FIG. 69 demonstrates a vibration sensor to wake the device from sleep whereas FIG. 70 demonstrates using the accelerometer/gyroscope to wake the device.
FIG. 69 shows how the first sensor, the piezo vibration sensor, is used to turn the device on from a low power sleep, when sound is detected. This is then followed by a more sophisticated analysis of the sound detected by the piezo vibration sensor. This consists of comparing the sound data received from the piezo vibration sensor to expected sound data values from datasets relating to the equipment the device is connected to. These would either be selected via the app to calibrate the device or via on the device itself.
This is then followed by analysing the movement characteristics of the equipment via the accelerometer/gyroscope sensor and comparing this outputted data to expected movement datasets for the piece of equipment the device is attached to. In addition, the sensor output data is compared to values from the piezo vibration sensor to identify if the production of sound relates to any notable movement. For example; this could be the movement that resulted from strumming a guitar, compared to a notable increase in sound at exactly the same point of time as the strum. This increases confidence that the user is actually playing the instrument or using the piece of equipment.
Finally, movement and the production of sound via external means can occur when transporting equipment. Equipment being knocked/moved also produces sound in such scenarios. In most occasions however, equipment such as this are normally placed in a cases or bags. This use case has one thing in common and that is, no light. Therefore, a light sensor is used to detect if the device is bagged/stored and helps prevent unwanted tracking from occurring when equipment is being transported. Furthermore, this sensor can validate use further by detecting the proximity of a warm body via emitted infrared radiation relating to that of a human nearby.
With these sensors uniquely configured together in this specific way accuracy of detection will be high and potential to trick or accidentally trick the system will be extremely low. At any stage if the values from each sensor are not what is expected the device will power down after a period of time.
The device can also record these sensor values to optimize accurate detection and learn to better track the user by correlating learnt values.
This device is intended to last for 1-2 years before replacing the battery or charging so efficient accuracy of detection is essential in the invention to ensure this. This is why there is a low power wake stage to prevent the microprocessor continually running.
Scenario 2: Custom Tracking
Some pieces of equipment required to be tracked may not have similar in use conditions such as the use case scenario described in scenario 1. A user may want to track a piano, drum set, microphone, chair etc. which all have different conditions of use that could be used for tracking.
In these instances, the device can allow for different detection settings with different priorities. FIG. 68 outlines the different options of stages of verification to detect use. Via the app or on the device the user can select different pre-sets that relate best to the object they are tracking use of. In addition, the user can create their own pre-sets by selecting which sensors are used, priorities of sensor order and sensor sensitivity. FIGS. 69, 70, 71, 72, 73, 74, 75 highlight some options a user could program.
For example, if a user wanted to track time spent in a music producing studio. Movement would most likely not be a variable worth tracking, and neither would light in the visible spectrum, however sound is. This would mean a user could select a pre-set solely dependent on sound and calibrate the sensitivity to only pick up the output of one of the main speakers in the room. FIG. 74 shows the configuration needed for such scenario.
Mounting:
The device is designed to be mounted to equipment in numerous ways. The device can connect to at least four different types of mount that allow for different mounting scenarios.
Adhesive mount, demonstrated in numbers 42, 44, 36, 33, 34, 29, 30, 25 and in FIG. 46. Shown in FIG. 39 and FIG. 40, with number 21 showing the mount and number 22 showing the adhesive layer. This clips onto the main assembly via a keyhole slot.
Horizontal clip mount, demonstrated in numbers 28, 32. Shown in FIG. 32 and FIG. 33, with number 19 showing the mount. This clips onto the main assembly via a keyhole slot. The device relies on the plastic clamp elastically deforming to clamp on to an object.
Vertical clip mount, demonstrated in 31. Shown in FIG. 25 and FIG. 26, with number 20 showing the mount. This clips onto the main assembly via a keyhole slot. The device relies on the plastic clamp elastically deforming to clamp on to an object.
Spring clip mount, demonstrated in 27.40,61. Shown in FIG. 13 and FIG. 14, with number 13,15,16 showing the mount. This clips onto the main assembly via a keyhole slot. With the spring arm 16 able to allow the clamp to adapt to a range of sizes.
The Display:
The display is crucial to motivate users to keep practising. This display also needs to be low power and either an e-ink or MIP display based technology or other low power equivalent. This low power aspect of the display is essential as the display needs to be visible at all times, meaning a passing glance can let a user know how much time left to complete their goals. FIGS. 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89.