Patent Application
20180050766
The present invention relates to tourist and sports equipment and may be used in building of light (small) floating craft, including swimming boards, SUP boards, surfboards, kayaks, inflatable boats, etc.
It is known that displays can be used in floor coverings (this is disclosed in the utility model CN202905052 (U), G09F9/33, 24.04.2013 wherein it comprises a housing whose upper part is formed by information screen, or in the patent KR100977589, G09F7/18, 23.08.2010 wherein it comprises a base, a support plate and a transparent plate located on the electric module).
A transparent deck of a floating craft is further disclosed. For example, the article on the website http://www.pro-israel/podvodnaya-observatoriya.html describes the ship “Coral 2000” which has a transparent deck at 1.5 m below water surface that provides convenient observation of the world of the Red Sea.
The disadvantages of the abovementioned embodiment are inability to combine underwater observing with information exchange and passive observation what significantly limits accuracy of information obtained by an observer.
In addition, when a user, a tourist or a sportsman is on a small flat bottomed floating craft, especially when he/she balances on a surfboard, board, canoe, reading of information from mobile devices (tablet, smartphone) becomes dangerous: the user's vestibular apparatus constantly readjusts, his/her vision switches from a screen to water surface and back, so the user can fall or drop the gadget.
The closest analogue to the invention claimed is disclosed in the patent US20050064774, B63B 1/00, 24 Mar. 2005 describing a small floating craft, namely a swimming board made transparent to observe undersea world. Said swimming board comprises a radar, and marks indicating a location of large undersea objects are displayed on its screen.
Also, the main disadvantage of the abovementioned apparatus is inability to overlap the processes of “balancing”, reading information and observing the undersea world. That is, when a user, a tourist or a sportsman is on a small flat bottomed floating craft, especially when he/she balances on a surfboard, board or canoe, reading of information from mobile devices (tablet, smartphone) becomes dangerous as the user's vestibular apparatus constantly readjusts, his/her vision switches from a screen to water surface and back. This happens when the user tries to combine at least two processes (balancing and reading), even without watching objects on the bottom, relief, dwellers of the undersea world, etc.
So the expected technical result of the present invention is primarily to improve safety and usability of the floating craft by secure reading of (navigation, environmental and any other) information and to increase completeness and correctness of information and decrease time of access thereto; as well as to provide assistance in control of water craft for the user by ensuring the following factors simultaneously:
The goal of the present invention is to supply the user with all necessary and available information without hampering the visual system of a sportsman to control the process of balancing on an unstable floating craft. It imposes various additional requirements to a displayed image and its location which must be available to the user's central and peripheral vision assisting him/her and not diverting from movement. For the user looking forward and down such a zone is located, for example, at the user's feet and a little ahead. At the same time, it is desirable to have customized topology adjustment of displayed information.
The abovementioned result is achieved by the fact that the small floating craft, predominantly a swimming board or a boat configured to observe underwater space and its objects using floating craft surface facing the user and being his support comprises a fixed information display configured to display complex information from video surveillance devices and processing units of underwater space image and/or from the receivers and external data processing devices and/or from the floating craft angular position processing and dynamic display units. Said display is located in a zone where the user has to look to keep balance.
Furthermore, the perimeter of the display and the perimeter of the floating craft may coincide, or the shape of the display may replicate the shape of the floating craft, but with decrease in size.
This means that the display can occupy entire surface of the floating craft, especially the area under and in front of a sportsman, what provides more outputting information and simplifies its reading by zooming. Furthermore, the recommended position of the user's feet and their movement for a better balance can be indicated on the surface of such display in a training mode.
Moreover, the possibility of observing can be provided by means of video surveillance devices wholly or partially located on or near the floating craft.
It means that either the floating craft has a mount for a video camera or it is placed on a float and flexibly connected with the floating craft which also has a mount that can fix at least a display (or a display with reception and/or data processing and/or observation units; in this case the appropriate niche for a video camera or locator directed to the bottom should be provided in the floating craft). The display (or a display with reception and/or data processing and/or observation units) located in a hull can be provided with a mount configured to be set on the floating craft, for example, in the form of a flexible resilient band.
Thus, a significant advantage of the claimed solution is that unlike prior water sports boards, surfboards and other individual flat bottomed floating craft, the user observes the objects around and under him not directly, but by an image transmitted from the surveillance devices to a display. As a particular case, said surveillance devices may be installed on the surface of the floating craft facing the water or on a float pulled in tow after the floating craft. In a general case, they may be located on the bottom, on the shore, on another floating craft, etc. Said display is mounted so that the user can read the image while moving and interact with it what will be shown below. This happens, for example, if the floating craft comprises the extra mounted camera pointed at the user, and the data processing units recognize and react to certain movements of the user's hands, for example, scrolling which allows moving from one menu item to another. Therefore, it is essential that the floating craft comprises the display and the video recorder pointed at the observed objects, as well as image transmitting and processing units situated between the video recorder and the display specially located to provide reading of information for the user.
Receivers and/or data processing units may also be wholly or partially located on the floating craft.
This means that some of receivers and/or data processing units may be located outside the floating craft and connect with the respective devices on the floating craft via Internet, radio channel, etc. Methods of spacing of the described scheme are widely known and have technical application.
Furthermore, video surveillance devices and data processing units may be configured to compensate image distortions on the display induced by water on the screen surface, by a deflection of vertical and change of distance to the user's pupils.
In other words, as the “correct” image as a video signal, codes in a bus, etc. exists on the corresponding display input, registration of the real image by appropriate devices at every instant allows determining the difference and compensate it also using standard tools, primarily algorithmic ones, since the proposed solution already contains data processing units in one form or another.
Further, video surveillance devices may include a tilt sensor of the floating craft, whereas the data processing unit may be configured to display shapes and/or letters changing their apparent angular position with a predetermined adjustable phase shift relative to change of the angular position of the floating craft.
Due to this, reading of the information from the display screen during roll is facilitated, the image can “track” roll of the floating craft and appear to be motionless to the user, whereas the user may customize this effect. The human organism, being in difficult conditions for the vestibular apparatus, simultaneously uses three stabilization systems: vestibular apparatus, system of visual binding to supporting points and muscular system. Specificity of balancing on a swimming board is that there are no good natural informative and effective reference points for equilibration for the second system (as the water is too homogeneous and fluid and the board is quite movable). At the same time, if the user is inexperienced, his/her third system is overloaded by continuous control of muscles. A fortunate solution in this situation would be to create such kinds of special supporting signals for the visual control system that could be easily used by the user's brain to create a new contour of management based on them with some prediction elements—in assistance to the vestibular apparatus. The present invention also solves this problem by creating easy-to-view marks or by placing and moving already existing elements of the image (including information texts, frames, windows, etc.) on the display appropriately.
Thus, the data processing unit may be configured to display elements that come in motion due to change of the angular position of the floating craft.
In addition, the motion of mentioned elements on the display may be accompanied with an image tail proportional to a rate of change of the floating craft angular position.
This allows a sportsman, especially the beginner, to balance better on the floating craft and simultaneously focus on reading the information from the display.
Furthermore, the data processing unit in the floating craft may be configured to recognize objects and output the information about them onto the display, wherein the information is stored in the data processing unit or received from external sources.
Moreover, the data processing unit may be configured to recognize dangerous objects and dangerous situations with priority displaying of these alerts.
Furthermore, the data processing unit may be configured to automatically exchange of data about dangers with a coast guard and/or similar information devices located in the region.
It should be noted directly that the hardware and corresponding algorithms for recognition, an interruption for display of priority messages and stand-alone data exchange are widely known. However, none of them have been used in the mentioned configuration, whereas precisely this application of resources provides the abovementioned effect.
In addition, the floating craft may also comprise devices for observing the surrounding space, and the data processing unit may be configured to display a conditionally fixed plane and the surrounding space at the display simultaneously.
A conditionally fixed plane is fixed relatively to the sportsman or the user what facilitates not only reading the information, but also keeping the balance. In this case observation devices provide an overview of the course and the space under the floating craft and monitoring of the position of the user's pupils in order to track changes and keep the said plane as a horizon level indicator.
Further, video surveillance devices may be located on the floating craft surface facing the water and provided with illumination.
This ensures the opportunity to travel and observe the space around and under the floating craft in the dark, as well as in colored or turbid water. Furthermore, observation devices of the floating craft may include a locator.
In addition, the locator may be configured as an acoustic sounder with ability of information exchange.
Moreover, the floating craft may be provided with one or more video cameras which face the user and/or are located on a support and/or pulled in tow after the floating craft and connected to receivers and/or data processing units, which are configured to analyze the user's health condition, to generate an alarm in case of worsening of his/her health condition and to transmit this alarm to a coast guard and other floating craft accessible for communication.
In addition, receivers and data processing units of the floating craft may be configured to duplicate the information from an external device at the whole display or its part at least in one of operation modes.
In other words, the floating craft can communicate with similar devices located nearby and with a coast guard, like any known mobile communication device. For example, if the data processing unit basing on the information from a video camera facing the user or from a tilt sensor of the floating craft, from a pulse meter and pressure gauge on the user's wrist that transmits information to receivers diagnoses the problem state of the user, it can go out to the information exchange with concerned recipients, even without the user's participation.
In addition, it is clear from the above that being installed at the floating craft the display with relevant information exchange devices and data processing units may be configured and used as a protected and the closest to the user substitute of an expensive and less protected gadget which has to be hidden in a sealed and inaccessible place or, for example, should be left on the beach. At the same time, receivers and data processing units are configured to duplicate (repeat) the information from an external device (gadget, personal computer, etc.) on the whole display or its part at least in one of operation modes.
It also follows from the above that the claimed apparatus may be substantially considered, performed and used as a gadget, a monitor, a display with some additional functions, the main one of which is ability to move on the water surface, while keeping all conditions of normal operation, including nonstop video monitoring and reading of the information from the display.
A surfboard 1 is used by a sportsman or a tourist, user's footprints are marked 2 on
As shown on
The group of primary converters 5 may include an external data receiver (GPS, internet connection, SMS messages, weather information, etc.), water and air temperature sensors, wind power sensors, accelerometers and tilt sensors registering rolls of the surfboard, a depth sounder, etc. At the same time, the external data receiver forms receiving units, and other sensing devices including a video recorder 6 form a video surveillance unit. If the further processing of information from receiving and/or video surveillance units is necessary, this is performed by a controller 7 forming the data processing unit of the apparatus (floating craft).
Thus, a minimum set of resources located at the floating craft is a video surveillance unit and an information display 3 which is configured to receive images, data, etc., for example, supplemented with a modem and a video controller, i.e. with standard units which ensure implementation of this function in any tablet, laptop and PC, wherein the display 3 faces the user. In addition to the display 3 there is a surveillance unit, namely a video recorder 6, on the floating craft surface which faces the water.
The fullest version of the floating craft also includes the group of primary converters 5 and the controller 7. Mark 8 denotes a display perimeter, when it is in the form of the floating craft.
On
A photo or video camera may be used as the video recorder 6, whereas the controller 7 may be configured for data processing: filtering, forming an “image”, arbitrating and therefore setting priority for outputting of the information on the display. Observing objects through the water layer is possible due to the fact that the digital image processing based on the known algorithms (see, for example, I. S. Gruzman et al., Digital Image Processing in Information Systems: Novosibirsk, NGTU Publishing House, 2002—352 p.) in combination with a mobile information device allows reaching two goals. Firstly, it gives the possibility to observe the bottom and objects underwater very clearly, tune out the noise, clean field of vision, and adjust the contrast, brightness and saturation of image. Secondly, it allows tuning out distortions induced by irregular composition of the aquatic environment and air gap, when the information device moves through the water or when it is removed out of the water (in the user's hands).
Moreover, application of well-known algorithms for smoothing sharp changes or irregularities on the display surface helps eliminating a short-term impact of drops or a thin water layer on the display, while use of a loopback from a tilt sensor to a data processing and storage unit allows applying known algorithms for stabilization of the image position or its details on the display.
In their turn, image recognition algorithms offer good opportunities to explore the underwater flora and fauna. For example, a tourist floating on a SUP (stand up paddle) board in a tropical shallow sea may receive not only information about names of fish sailing underneath, but also the information about their lifestyle, habits, uniqueness or, on the contrary, distribution in other regions; whereas a child floating on such a craft may get to know in which fairy tales they are mentioned. In addition, the function of remembering the processed image and the zoom function allow scrutinizing details of objects with the necessary magnification and even creating a collection of such images both for later viewing and for sharing via interface channels with similar devices located nearby in real time.
Finally, speaking about a possibility for fixing the display housing on the surface of the floating craft, we refer to different kinds of grips, fixtures, “velcro”, which would allow fixing the housing reliably on a surfboard or the bottom of the boat, so that the display would be always in front of the user's eyes, leaving his/her hands free.
Of course, all the blocks and elements, all electronics located on the floating craft are powered by a power source (battery) mounted thereon, they are made watertight and supplied with an appropriate interface for the described connection, data transmission and processing and described algorithms' implementation. Note also that all described algorithms are widely applied to mobile devices, and their implementation does not require development of new tools and approaches.
In comparison with a known solution, that is with a passive monitoring mode, it allows increasing the volume of data perceived by the user and effectiveness of perception, as well as filtering, selecting and providing the information which was previously simply lost not least due to turbidity of the water under the floating craft, short-term appearance of the objects, water excitement and periodic covering of the surface of the floating craft with a layer of water, rolls of the floating craft, etc. In this case, the controller 7 may be configured to apply the standard image filtering methods, eliminating vibrations, etc. which are widely applied in photo and video recorders.
Thus, the user looking on the display 3 (8) or perceiving a sound command outgoing therefrom (the display 3 may be equipped with speakers that are connected to the corresponding outputs of the controller 7) may also receive an alarm which is the result of complex processing of external information and data from various sensors and video signal, for example, in case of a shark, a reef or the nets nearby or a hurricane approaching, etc.
Practical tasks (like displaying water area maps with the user's position, the weather forecast, information from a coast guard, etc.) do not exclude aesthetic purposes and interactive exchange—the live image may contain ornament, paintings, photos of friends, etc.
The display 3 (
The controller 7 (
If the video camera 12 is complemented with a locator (a sonar, not shown on drawings), when analyzing dangerous situations, the information from the sonar about a distance and a closing speed to obstacles, swimmers, sea lions, etc. is also taken into account. In addition, the locator may be made acoustical, that is, including a sound or ultrasound emitter and receiver which can transmit and receive information, for example, by means of signal modulation, if they are connected to the data processing and storage controller 7. Such data exchange may be performed with similar information devices as well as other units, and even with representatives of marine fauna (e.g., the emitter can deter sharks).
It is clear that when particularly dangerous objects like poisonous fish or sharks are detected, the display 3 shows an alarm and a coast guard is alerted. This happens according to the algorithm described above which comprises recognition in the unit 18, data exchange with a coast guard and external information sources via the interface 13, prioritization and generation of messages (including audio messages, and output of data on the display 3 also implies sending a corresponding signal to speakers of the floating craft) and data transmission to the unit 19 and via said unit 19 to the display 3.
Actually, the same algorithms and block diagrams may be applied in the floating craft to compensate distortions arising from water drops or layer on the display surface, deflection of vertical and distance changes to the user's pupils. Let us consider them in succession.
If the housing 9 with the display 3 or just the display 3 is fixed on the surfboard 1 (swimming board), water drops or waves can cover the display 3 from time to time. Such local or short-time obstacles for light flux introduce some local or short-time image distortions which can be filtered by the unit 17 by means of comparing close in time or location images and deleting any local and short-time changes.
To compensate inclination, rolling, distance to the eyes we may use a tilt sensor mounted in the housing 9 and connected via the interface 13 to a compensation unit 18 (
Sound and ultrasonic emitters and receivers can provide not only for the active sonar system, but also for alarm and underwater communication with similar devices (units). In addition, some representatives of the underwater fauna react to ultrasounds of appropriate range and duration, and this fact may also be used.
Being on water involves a range of hazards for a person not only from outside, but also due to his/her own health condition and behavior. That is why in addition to standard methods of human interaction with the device (via menus, gestures, voice communication, etc.) it would be useful if the floating craft could analyze the dynamics of user's movements, facial gestures and oculomotor activity when they are in sight of the video camera facing the user (not shown on drawings). This analysis allows making conclusions about the user's health condition, adequacy, panic attack, etc. Surely, these methods do not exclude simultaneous use of information from a variety of physiological parameter sensors placed on the user's body (as a bracelet, glued patch, modules embedded in a swimming costume, etc.) and connected via interfaces with the information device and there via the interface 13 to the controller 7 configured with ability of analysis of user's condition. For this purpose the controller uses the algorithm of comparing data received from sensors with normal human reference data (or normal user's reference data). This solution allows performing higher quality monitoring of the user's health condition to ensure greater safety in critical situations.
Finally, as it has already been noted, the ability to fix the housing 9 on the surface of the floating craft may be realized using various types of clamps, spring-loaded grippers or holders.
As it is supposed that the floating craft may be also used in high waves and shallow waters where low-frequency radio waves can penetrate, it is reasonable to use a short-interface console for providing stable communication in difficult conditions. For example, it may be either made as an adapter for gadgets left on the beach or as a floating buoy converting signals into standard Wi-Fi and other frequencies.
It is also important to emphasize that the present invention contemplates not only use of independent embodiments mentioned above in the summary and examples, but also all possible combinations thereof.
Important possible application of the display 3 (8) is the embodiment when the transmitted image serves for training purposes and/or facilitates use of a surfboard. In the latter case not only various instructions and training videos for use of a surfboard are meant, but more practical aspects as well: use of dynamic image to facilitate balancing on a board such as, for example, visual information about navigation course, an image or indication of rolls, accelerations in rowing, etc., and also interactive communication between a beginner and the swimming board when various instructions are reproduced according to results of the user's failures—a kind of “trainer” on board. The video camera with a processor which is directed at the sportsman can be useful here, if recommendations about the correct way of training and technical aspects of exercises are provided according to results of image processing by the local device (or in the remote center). In addition, as it has already been mentioned, the display 8 can also show the optimal (correct) position of the user's feet, as well as recommended movement for a better balance on the surfboard.
As mentioned above, specificity of use of swimming boards in clear water allows the sportsman to see the image on the display clearly, even if the board is covered by a wave, etc. In all these cases the important fact is that it is not very comfortable to use conventional gadgets simultaneously for a sportsman holding a paddle or making some movements to balance on the board. Such devices as glasses projecting the image into the eyes, etc., are not always suitable for water recreation. That is why an image or a part thereof should be transmitted on the display 3 from other gadgets of the sportsman (such as a smartphone, a variety of fitness bracelets, watches, etc.). Furthermore, the controller 7 may be configured to manipulate an image by voice control, remote control or gestures (standard scrolling movement by hand, other movements, for example, of a head or body parts) recognized by the processor according to the information from video cameras or other sensors.
In addition, interactive communication between users of such devices is possible. Said communication can be performed between them and with the outside world. In particular, the image may be transmitted from another user of a swimming board (for example, an invitation with a photo or video clip from an inviting person with indication of mutual coordinates and distances on the water area).
And finally, the crucial difference of the claimed apparatus is, as noted above, the ability to process an image, including, for example, the ability to correct distortions induced by water on the surface using a camera or a set of built-in cameras or ultrasonic transducers or IR sensors or using information from ingress water sensors, water speed sensors or other data about finding of a part or entire image under an uneven water layer—and using the built-in device processor it is possible to adjust a live image so that its distortions induced by water cover (waves passed over) appear to be minimal to an observer. The other effective way is to analyze an image from an external camera (for example, attached to a paddle, a life jacket or other gear of the sportsman) and compare it with regard to the original projection angles and carry out the appropriate corrections based on the said comparison. Another way is to analyze changes in the image of the sportsman, the paddle, etc. in the field of sight of built-in cameras of the surfboard 1 and to make inverse calculations of optical distortions for a transmitted image for the following appropriate correction based on said analysis. The second method is less efficient in terms of drops and local pollution, but it does not require additional remote cameras.
In other words, the claimed solution makes it possible to adjust the live image during movement to compensate optical distortions induced by water on the surface of the surfboard 1.
Of interest is the embodiment when the image is as if it coincided with the horizontal surface of the water, and the screen (display) 3 of the surfboard 1 is as if it was a window, and possibly a moving window through which the image is seen. Then, in the case of getting some practical information the image can move according to the roll sensor information what solves the problem of drops and dirt which hinder, for example, reading—it is enough to sway a little to move the image and thereby improve perception of visual information by separating it from contamination. In this case the image appears to be moving and being under control of information from sensors of roll, rotation and other movement of the swimming board (surfboard).
In the other mode a real (from cameras) or information-synthesized image about depths and bottom surface can be transmitted on the display 3 (8) of the surfboard 1. Said image changes in time with movement of the surfboard 1 on the water area what is achieved by placing video cameras, light sources as well as sonars on hangers at the desirable depth. It creates the effect of “transparent surfboard”. Moreover, use of methods of filtering and enhancing the contrast of underwater images along with correction of geometric distortions provide the picture which is much more acceptable than the picture through a simple glass window with a light source in the swimming board. Of course, the ZOOM function is not excluded and should operate, for example, on request. Said image correction against water flooding or splashing onto the display 3 surface may be also applied simultaneously.
In addition, the synthesized image may be combined with the real one: for example, the bottom relief and deep-seated archaeological objects may be graphically synthesized and displayed according to the current GPS-coordinates, while flora, fauna and divers sailing under the surfboard may be displayed as an overlay of this processed real image from the video cameras. It is also reasonable that the image obtained from the depth for the sportsman being on the surface (surfer) is adjusted by distance what excludes the impact of the high coefficient of water refraction. In this case the user's vision does not have to adapt, and the distance to underwater objects can be perceived adequately (as well as above the surface). A picture from a quadcopter camera or camera of other aircraft representing the top view of the water area with associated data about location of other surfers, high sea wave motion, etc. may also be also transmitted on a separate additional display window.
Thus, the claimed floating craft with its large information capacity may be used not only for the exploring purposes like “a window” to the underwater world, but it can also work with security functions that appear to be potentially useful and convenient for both sportsmen and tourists.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2015108148 | Mar 2015 | RU | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/RU2016/000125 | 3/9/2016 | WO | 00 |
