Patent Application
20200151182
The present application relates to the field of device usability in multi-core or multi-chip embedded solutions.
A user interface, UI, enables a user to interact with a device, such as, for example, a car, a smartphone, an automated banking device or an aircraft control system. Different user interfaces are appropriate for different purposes. For example, when the user has arrived to a new location and wish to perform actions in that location, the quality and quantity of information presented to the user when interacting with the user interface must be sufficient to enable intuitive use of the device in its new surroundings without overloading the user with unnecessary information.
User interfaces may be based on presenting information to the user, and receiving inputs from the user. Information may be presented using an output device such as a display, for example an organic light-emitting diode, OLED, display. Inputs may be received from the user via various input devices, such as touchscreen displays, push buttons, microphones arranged to capture the user's speech and/or levers the user can pull.
A traditional user interface of a wristwatch comprises a long and a short arm, which rotate over a watch dial to indicate the time of day. Digital wrist watches may comprise, for example, a liquid crystal display, LCD, type display indicating the time of day numerically.
A smart watch may comprise a touchscreen, such that the display portion of the touchscreen acts as an output device of the user interface and the touch sensitive portion of the touchscreen acts as an input device of the user interface. Using a smart watch presents challenges, since useful applications tend to require larger screens to present a useful quantity of information using a font large enough, that users can read it without magnifying devices.
A personal device, such as a smart watch, may keep track of a route that the user traverses, for example while jogging or performing another kind of activity. The route may be compiled in the personal device based, at least in part, on keeping track of a geographical location of the personal device.
However, present solutions do not offer easy access to local activities for a person arriving at a location previously unknown to him or her. Also, also in previously visited locations, activity offerings and possibilities vary with time. So does the preference of the user. A user may thus not be aware of all available local activities, even is his or her home town. In addition, a user may simply seek inspiration and excitement in exploring what activities are available on a location where he or she is. Therefore, there is a need for devices and services that would provide a user a selection of suggested and up-to-date activities in his or her current location, wherever that may be.
The invention is defined by the features of the independent claims. Some specific embodiments are defined in the dependent claims.
According to a first aspect of the present invention, there is provided a device or an apparatus, hereinafter to be understood as synonyms to each other, which comprises at least one processing core, at least one display, at least one sensor, at least one memory including computer program code, the at least one memory and the computer program code being configured to, with the at least one processing core, cause the apparatus at least to:
According to a second aspect of the present invention, there is provided a method for presenting information to a user of an apparatus, such as a personal device, said device comprising at least one processing core, at least one display, at least one sensor and at least one memory including computer program code, said method comprising the steps of:
In some embodiments, a selected activity is initiated by a first processing core in said first display mode, said first power-save mode is entered by putting said first processing core in a hibernating mode and by switching to said second display mode using a second processing core, and said second power-save mode is entered by switching off said second display mode and putting said second processing core in a hibernating mode.
In some embodiments, when entering said second power-save mode, a third display mode is entered, where a Real Time Clock (RTC) unit updates said display with predefined time intervals at least with the time.
In some embodiments, the performed sequence in order a) to c) is reversed in order c) to a) based on at least one of the following criteria: user selection input or acceleration data input from an acceleration sensor in said apparatus indicating a display reading posture of said user.
Various embodiments of the first aspect may comprise at least one feature from the following bulleted list:
A pre-recorded user preference may include a planned activity for the present or an adjacent location that the user has planned in advance before making the trip to the present location.
A thematic map database, for example a heat map, may be compiled to cover a geographic area. Users may engage in activity sessions while in the geographic area. Activity types of such activity sessions may include jogging, swimming and cycling, for example. When a user wishes to engage in an activity session of his own, his device may determine a route for this activity session based at least in part on the thematic map database. Determining the route may comprise designing the route, optionally based partly on user settings, based on where other users have engaged in activity sessions of the same type in the past. For example, a jogging route may be determined based, at least partly, on indications where other users have jogged in the past. Route determination may be partly based on further considerations as well, as will be laid out below.
Device 110 may be communicatively coupled with a communications network. For example, in
Device 110 may be configured to receive, from satellite constellation 150, satellite positioning information via satellite link 151. The satellite constellation may comprise, for example the global positioning system, GPS, or the Galileo constellation. Satellite constellation 150 may comprise more than one satellite, although only one satellite is illustrated in
Alternatively or additionally to receiving data from a satellite constellation, device 110 may obtain positioning information by interacting with a network in which base station 120 is comprised. For example, cellular networks may employ various ways to position a device, such as trilateration, multilateration or positioning based on an identity of a base station with which attachment is possible or ongoing. Likewise a non-cellular base station, or access point, may know its own location and provide it to device 110, enabling device 110 to position itself within communication range of this access point.
Device 110 may be configured to obtain a current time from satellite constellation 150, base station 120 or by requesting it from a user, for example. Once device 110 has the current time and an estimate of its location, device 110 may consult a look-up table, for example, to determine a time remaining until sunset or sunrise, for example. Device 110 may likewise gain knowledge of the time of year.
Network 140 may be coupled to a database server 160 via a connection 161, or the further network connection 141. When device 110 apparatus has determined the present location of itself it may transmit a query to database server 160 acting as a thematic map database server. The query may comprise an indication of the current location of the apparatus obtained by, for example, a global positioning system as explained above.
Updated thematic map data related to the present location of the device 110 may then be downloaded from the server 160 over network connections 161 or 141 and stored in a memory of the device 110.
The device may be configured to present to the user a selection of updated thematic maps as heatmaps created for different sports activities in said location. The updated heatmaps thus stored in the memory of the device 110 may be used offline in activity sessions.
Device 110 may be configured to provide an activity session. An activity session may be associated with an activity type. Examples of activity types include rowing, paddling, cycling, jogging, walking, hunting and paragliding. In a simplest form, an activity session may comprise device 110 displaying a map of the surroundings, and a route on the map that relates to the activity session. Device 110 may be configured to display, on the route, an indication where along the route the user is currently located, enabling the user to see the place along the route where his jog, for example, is at the moment progressing.
According to some embodiments, the device 110 may be configured to present to the user a selection of updated thematic maps as heatmaps created for different sports activities in second locations outside but adjacent to said present location. Some activities preferred by the user, such as cycling for example, may involve moving long distances and/or for a lengthy time. In the planning of such activities it may be beneficial to have heatmaps also covering locations nearby the present one.
In some embodiments the apparatus may be configured to automatically update thematic maps from the server 160 when the apparatus is being charged with a charging device 170 and is connected to a wireless network 112.
According to some embodiments, the device 110 may first be able to determine the present location of the device, to transmit a query to a thematic map database server, the query comprising an indication of the current location of the device, and then to update itself with thematic maps related to its location by downloading thematic map data from the server and store the thematic map data in the memory of the device 110. Then, the device may present to the user on the display in a first display mode a selection of downloaded thematic maps as suggested activity types. The selection may be based on at least one of the criteria of a pre-recorded user preference, user activity history, intensity of activities in said location, special activities in said location, time of the day, time of the year, or a second location adjacent to said present location. In response to a user selection input, the device 110 may then initiate an activity session of one of the activity being selected, and display a thematic map of the activity in a second display mode.
Processing heatmaps, sensor information, displays and other hardware required for tracking the whereabouts and physical performance of a person is a power-consuming task. From a battery performance point of view, it is important to minimize the energy consumption of the device 110. Therefore, a first display mode has been envisaged, where all relevant data and features required for the user to perform searching, browsing and a selection of activities, as well as using any other features offered by the device. This requires much battery power, but once the activity selection is made and initiated, the device 110 may enter a low-power mode focusing only on processing data which is essential for the activity in question. Such a low-power mode may involve the use of a second display mode, where for example, resolution is reduced, colours are not displayed, map display is simplified and/or sensors are shut off and their corresponding information is suppressed on the display.
According to some embodiments, the apparatus comprises at least two processing cores, at least one display with at least two display modes. A first processing core causes the apparatus to determine the present location of the apparatus, transmit from the apparatus a query to a thematic map database server, and to update the apparatus with thematic maps related to said location from said server by downloading thematic map data and storing the thematic map data in at least one memory of the apparatus. It also presents to the user on the display in a first display mode a selection of downloaded thematic maps as suggested activity types, where the activity types are based on at least one of the following criteria: a pre-recorded user preference, user activity history, intensity of activities in said location, special activities in said location, time of the day, time of the year, or a second location adjacent to said present location. In response to a user selection input, an activity session is initiated and a thematic map of the selected activity is displayed in a second display mode by a second processing core.
In some embodiments, updated thematic heatmaps may be created for different sports activities also in second locations outside, but adjacent to the present location. This may be beneficial if the activity, such as cycling, takes place over considerable distances. The device 110 may be configured to automatically update thematic maps related to its location from a thematic map database server anytime when the apparatus is being charged and is connected to a wireless network with coverage of its present location.
In some embodiments, the updated thematic maps are stored in a memory of the device 110 for offline use. Thus a stored thematic map of an activity session that is to be initiated may be displayed directly in a second display mode.
An activity session in device 110 may enhance a utility a user can obtain from the activity, for example, where the activity involves movement outdoors, the activity session may provide a recording of the activity session. An activity session in device 110 may, in some embodiments, provide the user with contextual information during the activity session. Such contextual information may comprise, for example, locally relevant weather information, received via base station 120, for example. Such contextual information may comprise at least one of the following: a rain warning, a temperature warning, an indication of time remaining before sunset, an indication of a nearby service that is relevant to the activity, a security warning, an indication of nearby users and an indication of a nearby location where several other users have taken photographs. Where the contextual information comprises a security warning, the warning may comprise a security route, determined in a way that enables the user to avoid danger. For example, in case of a chemical leak, the security route may comprise a route that leads indoors or to public transport. The device 110 may determine a security route, or the device 110 may receive the security route, at least in part, from a network. The security route may be determined using existing roads, pathways and other transit routes that are known to the entity determining the security route. Transit routes may be known from a public mapping service, for example.
A recording may comprise information on at least one of the following: a route taken during the activity session, a metabolic rate or metabolic effect of the activity session, a time the activity session lasted, a quantity of energy consumed during the activity session, a sound recording obtained during the activity session and an elevation map along the length of the route taken during the activity session. A route may be determined based on positioning information, for example. Metabolic effect and consumed energy may be determined, at least partly, based on information concerning the user that device 110 has access to. A recording may be stored in device 110, an auxiliary device, or in a server or data cloud storage service. A recording stored in a server or cloud may be encrypted prior to transmission to the server or cloud, to protect privacy of the user.
An activity session may have access to a backhaul communications link to provide indications relating to the ongoing activity. For example, search and rescue services may be given access to information on joggers in a certain area of a forest, to enable their rescue if a chemical leak, for example, makes the forest unsafe for humans. In some embodiments, routes relating to activity sessions are provided to a cloud service for storage when the activity sessions start, to enable searching for missing persons along the route the persons were planning to take.
The user may initiate an activity session by interacting with a user interface of device 110, for example. Where device 110 has s small form factor, the user interface may be implemented over a limited user interaction capability, such as, for example, a small screen, small touchscreen, and/or limited number of push buttons. A limited user interaction capability may make it arduous for the user to perform complicated interactions with device 110, which makes it less likely the user will choose to interact with device 110. Therefore, it is of interest to simplify the interaction between device 110 and the user, to make it easier for the user to complete the interaction, and thus more likely the user will perform the interaction.
Device 110 may provide to the thematic map database 160 an indication relating to the activity session, to enhance the thematic map database further. Such indications may be anonymized prior to sending to the database, both to protect the user's privacy and/or to comply with local legislation. Such indications may comprise, for example, information on a determined route and a corresponding activity type.
In general, a thematic map database 160 may associate at least one form of data with a geographic location. For example, the thematic map database may associate past indications of activity sessions with geographic locations, for example to enable mapping areas where activity sessions of a given activity type have been performed. Areas may be mapped as to the intensity, or frequency, of past indications of activity session and type. Thus a first area of a lake may be associated with frequent rowing, and another area of the same lake with less frequent, but still non-zero, rowing. Such a frequency may be referred to as intensity, and the thematic map database may, in general, associate activity type intensities with locations. Alternatively to intensities, the thematic map database may simply associate, whether an activity session of a given activity type has in the past been performed in a geographic location. Alternatively to intensities, the thematic map database may indicate any specialities of activities in the location. Additionally or alternatively, a traffic density may be associated with the geographic locations. Traffic density may comprise pedestrian or vehicular traffic density, for example. Walking or jogging may be less pleasant, or less healthy, in areas with a high vehicular traffic density due to exhaust fumes, wherefore a route relating to an activity session with such type may be determined in a way that avoids such high-traffic density areas. Likewise, additionally or alternatively, crime density may be mapped, and employed in route determination to avoid high-crime areas. Avalanche risk density, obtained from meteorological services, may similarly be used to route ski activity sessions in safe areas. In some embodiments, places where many users have taken photographs may be used in routing, such that routes are determined to visit frequently photographed locations, since such locations are likely to be beautiful and inspiring.
In some embodiments, the user may have indicated in user settings that he wishes to engage in a certain type of activity session, wherein such indications may be taken into account when determining the route for the activity session. The settings may be taken into account, for example, by designing the route so that performing the activity session along the route causes an increase in energy consumption in the user that is approximately in line with what the user has requested in the settings. Alternatively or additionally, a cardiovascular effect of the activity session may be tuned to be in line with a user setting by designing the route in a suitable way. Likewise the user may specify a desired effect on oxygen consumption, EPOC effect and/or a recovery time length after the activity session. EPOC refers to excess post-exercise oxygen consumption, sometimes known colloquially as afterburn.
A route may be determined to be able to be interrupted. For example, where the activity comprises cycling, the route may come close to the starting and ending location close to a midpoint of the route, to enable the user to cut the route short. The user may specify in user settings he wishes to engage in an interruptable route, or interruptability may be a default setting that is attempted to comply with, where possible.
A level of physical exertion, in terms of energy consumption, oxygen consumption, cardiovascular effect, EPOC or recovery time length, the route causes in the user may be modified by determining elevation changes along the route. Where the user wishes a light activity session, the route may be determined as relatively flat, and where the user wishes for a strenuous activity session, the route may be determined in a way that it has more elevation changes. Using the thematic map database in connection with elevation data in this sense may comprise, for example, determining the route based on elevation changes to match the desired strenuousness, in an area which the thematic map database indicates that activity sessions of a corresponding type have been conducted in the past. In general, the user settings may be employed in determining the route after a suitable area for the route has been identifier using the thematic map database.
A time of year and/or a time of day may be employed in either the thematic map database or in the determining of the route. For example, the thematic map database 160 may comprise data collected at different times of year, for example a same location may be associated with frequent jogging in summertime and frequent skiing during the winter months. Thus, the database may return a jogging route in the location in case the query is made in the summer, and the database may return a skiing route in the location in case the query is made in the winter. Alternatively or in addition, device 110 may select activity types consistent with the time of year, or time of day, from the set of activity types returned from the database when determining the predicted user activity type. Device 110 may perform this task in embodiments where a thematic map database doesn't collect statistics separately according to time of year or day, for example. As a specific example, local residents may consider a certain location as safe during the day but unsafe after dark. In such a situation, a user requesting a jogging route could be routed to this location if the request is made in the daytime, but routed elsewhere if the request is made after dark.
In general, the thematic map database 160 may be comprised in a server or cloud device, or it may be downloaded, at least in part, to device 110 or an auxiliary device, for offline use. An auxiliary device is described below in connection with
Responsive to the user approving, implicitly or explicitly, a suggested route, an activity session based on the approved suggested route may be initiated.
More than one route may be determined, such that at least one of the determined routes is presented to the user as a suggested route. For example, two routes may be determined that match requirements defined by the user, and these two routes may then be presented as suggested routes, with information concerning each route presented to the user as well. For example, energy consumption, estimated time to completion and/or length of a route may be presented to assist the user in making a selection. Energy consumption, estimated time to completion and/or other suitable information may be determined, at least partly, on the elevation information.
Information may be presented also, or alternatively, concerning segments of any suggested route, to enable the user to construct his route from interconnected segments.
In some embodiments, the user needn't explicitly select a suggested route, rather, the device may deduce from the way positioning information changes, which route the user is following. As a response, any other suggested routes may be removed from the display to reduce clutter. In case the user deviates from the route, the device may notice this from the positioning information, and responsively determine an alternative route for the user, which may again be displayed. Thus movement of the user may cause, via the positioning information, an approval of a suggested route and/or a new determination of a new suggested route in case of deviation from a previously approved route. Such a new suggested route may be determined from the current location of the device to the same end point as the originally approved route. Such an end point may comprise the start point of the route, or, alternatively, another point input by the user. Remaining time, energy consumption and/or other information may be presented concerning the new suggested route.
Device 110 may be communicatively coupled, for example communicatively paired, with an auxiliary device 110x. The communicative coupling, or pairing, is illustrated in
In some embodiments, where an auxiliary device 100x is present, device 110 is configured to use connectivity capability of auxiliary device 110x. For example, device 110 may access a network via auxiliary device 110x. In these embodiments, device 110 need not be furnished with connectivity toward base station 120, for example, since device 110 may access network resources via interface 111 and a connection auxiliary device 110x has with base station 120. Such a connection is illustrated in
In some embodiments, device 110 may have some connectivity and be configured to use both that and connectivity provided by auxiliary device 110x. For example, device 110 may comprise a satellite receiver enabling device 110 to obtain satellite positioning information directly from satellite constellation 150. Device 110 may then obtain network connectivity to base station 120 via auxiliary device 110x. For example, device 110 may transmit a query to the thematic map database via auxiliary device 110x. In some embodiments, device 110 is configured to request, and responsively to receive, sensor information from auxiliary device 110x. Such sensor information may comprise acceleration sensor information, for example. In general, processing, such as route determination and/or communication processing, may be distributed in a suitable way between device 110, auxiliary device 110x and/or a cloud computing service.
Similarly as discussed in connection with
According to some embodiments, the user may be presented with a selection of updated heatmaps created for different sports activities in locations outside, but adjacent to said present location. Thus the display 200 may show a map 220 with a hill in a neighbouring town, county or borough, for example. The rule of what is within the present location of the device 110 and what is in adjacent location may be set by the boundaries between such areas, if the positioning system used contain such data, or simply by a radius form the present location, e.g. 10 km.
Some activities preferred by the user, such as cycling for example, may involve moving long distances and/or for a lengthy time. In the planning of such activities it may be beneficial to have heatmaps also covering locations nearby the present one.
A start point 230 is illustrated in the user interface, as is a route 240, which is indicated with a dashed line. In this example, the route may be traversed twice to obtain the physical exercise effect the user wants. The route proceeds along a relatively constant elevation around the hill, and when traversed twice provides an opportunity to interrupt the activity session halfway through, as the user passes start point 230. To interrupt the session, the user can simply stop at start point 230 instead of beginning a second lap along the route. In this example the area of map 220 may be indicated in the thematic map database as being associated with past activity sessions of a corresponding, or indeed same, activity type as the session the user selects. The route may be determined, in part, based on mapping information obtained from a mapping service, such as a proprietary service, HERE maps or Google maps, for example. Elevation information may be obtained from the same, or similar, service.
The user may be presented with information concerning route options, for example for the first option, an estimated energy consumption associated with an activity session along the route defined by the first option, and likewise for the second option. The user may, explicitly or implicitly, select one of the presented options, and along the route deviate therefrom to use a different set of route segments. For example, a user setting on along the first option, may decide to shorten the activity session by taking segments 250e and 250d back to the start point 230. Alternatively, the user may decide to lengthen the session by taking, in the first option, segment 250f instead of segment 250b.
In some embodiments, information is presented separately concerning route segments, to enable the user to design a route with greater precision. For example, an energy consumption associated with segment 250a, when used as a route segment in an activity session of a given type, may be presented. Likewise, other physiological effects, such as EPOC or oxygen consumption, may be presented in addition to, or alternatively to, the energy consumption.
In the example illustrated in
For the intersection at the end of route segment 2C2, device 110 presents three options to the user: 2C3, 2C4 and 2C5, corresponding to respective route segments which connect with route segment 2C2 at the intersection. Each of these options is labelled with information usable to the user in selecting from among the options. In detail, the labels indicate at least one of: a total route length obtainable via the respective sub-route, a total exercise session duration obtainable via the respective sub-route, a speed obtainable via the respective sub-route and a metabolic effect obtainable via the respective sub-route. A sub-route is, in general, a section of a complete actual route of an activity session that excludes the already traversed part of the actual route. Each of the options in the intersection corresponds to at least one sub-route.
In detail, associated with option 2C4, for example, are plural sub-routes since after choosing option 2C4 at the intersection, the user will be presented with a new choice at intersection 2C6, whether to turn left or right. Thus option 2C4 may be labelled with information relating to the sub-routes accessible via this option.
Device 110 may be configured to compile the labelled options based on the exercise history of a user. For example, where the user has often completed activity sessions of a certain length, device 110 may present as labelled options a subset of the possible sub-routes, such that the presented labelled options correspond to a range of total route lengths (or durations, or metabolic effects) which spans the typical activity session of the user, with also slightly shorter and slightly longer options included in the range. Thus labels corresponding to sub-routes which do not correspond at all to normal activity sessions of the user need not be presented in the view. In other words, the device may be configured to present to the user labelled options corresponding to the predicted route, and variations of the predicted route. Alternatively to predicting the route length or other target(s), the user may provide these targets, to guide the prediction of the route.
Once the user selects one of the options, the device 110 may once more determine based on positioning the device, which option the user has chosen. In other words, the user need not explicitly select any one of the options 2C3, 2C4 or 2C5 on the user interface. Once the user then arrives at a next intersection, for example 2C6, the device may once more present labelled options corresponding to activity sessions which may be completed via respective sub-routes from this intersection. Also, the predicted route is again updated to include the route segment between the intersection at the end of segment 2C2 and intersection 2C6 as an already traversed section of the overall route, for example.
Device 110 may be configured to determine the predicted route based at least partly on at least one of the following: a thematic map database, a season of the year, a time of day, user settings of the user, history information of the user, elevation information and a location of the apparatus. User settings of the user may comprise settings relating to at least one of the following: a desired energy consumption of a physical exercise session, a desired cardiovascular effect of the physical exercise session, a desired oxygen consumption effect of the physical exercise session, a desired EPOC effect of the physical exercise session, a desired recovery time length of the physical exercise session, and an indication the user wishes the route to be conveniently interruptible.
Device 300 may comprise memory 320. Memory 320 may comprise random-access memory and/or permanent memory. Memory 320 may comprise at least one RAM chip. Memory 320 may comprise solid-state, magnetic, optical and/or holographic memory, for example. Memory 320 may be at least in part accessible to processor 310. Memory 320 may be at least in part comprised in processor 310. Memory 320 may be means for storing information. Memory 320 may comprise computer instructions that processor 310 is configured to execute. When computer instructions configured to cause processor 310 to perform certain actions are stored in memory 320, and device 300 overall is configured to run under the direction of processor 310 using computer instructions from memory 320, processor 310 and/or its at least one processing core may be considered to be configured to perform said certain actions. Memory 320 may be at least in part comprised in processor 310. Memory 320 may be at least in part external to device 300 but accessible to device 300.
Device 300 may comprise a transmitter 330. Device 300 may comprise a receiver 340. Transmitter 330 and receiver 340 may be configured to transmit and receive, respectively, information in accordance with at least one cellular or non-cellular standard. Transmitter 330 may comprise more than one transmitter. Receiver 340 may comprise more than one receiver. Transmitter 330 and/or receiver 340 may be configured to operate in accordance with global system for mobile communication, GSM, wideband code division multiple access, WCDMA, long term evolution, LTE, IS-95, wireless local area network, WLAN, Ethernet and/or worldwide interoperability for microwave access, WiMAX, standards, for example.
Device 300 may comprise a near-field communication, NFC, transceiver 350. NFC transceiver 350 may support at least one NFC technology, such as NFC, Bluetooth, Wibree or similar technologies.
Device 300 may comprise user interface, UI, 360. UI 360 may comprise at least one of a display, a keyboard, a touchscreen, a vibrator arranged to signal to a user by causing device 300 to vibrate, a speaker and a microphone. A user may be able to operate device 300 via UI 360, for example to request for a route-based activity session and/or to place voice calls, where applicable, for example.
The display of the UI 360 may be operable in at least two display modes, where a first display mode may be used when the user makes a selection between downloaded thematic maps to initiate an activity session, and a second display mode used during the activity session and showing only the selected thematic map of the current activity session.
Device 300 may comprise or be arranged to accept a user identity module 370. User identity module 370 may comprise, for example, a subscriber identity module,
SIM, card installable in device 300. A user identity module 370 may comprise information identifying a subscription of a user of device 300. A user identity module 370 may comprise cryptographic information usable to verify the identity of a user of device 300 and/or to facilitate encryption of communicated information and billing of the user of device 300 for communication effected via device 300.
Processor 310 may be furnished with a transmitter arranged to output information from processor 310, via electrical leads internal to device 300, to other devices comprised in device 300. Such a transmitter may comprise a serial bus transmitter arranged to, for example, output information via at least one electrical lead to memory 320 for storage therein. Alternatively to a serial bus, the transmitter may comprise a parallel bus transmitter. Likewise processor 310 may comprise a receiver arranged to receive information in processor 310, via electrical leads internal to device 300, from other devices comprised in device 300. Such a receiver may comprise a serial bus receiver arranged to for example, receive information via at least one electrical lead from receiver 340 for processing in processor 310. Alternatively to a serial bus, the receiver may comprise a parallel bus receiver.
Device 300 may comprise further devices not illustrated in
Processor 310, memory 320, transmitter 330, receiver 340, NFC transceiver 350, UI 360 and/or user identity module 370 may be interconnected by electrical leads internal to device 300 in a multitude of different ways. For example, each of the aforementioned devices may be separately connected to a master bus internal to device 300, to allow for the devices to exchange information. However, as the skilled person will appreciate, this is only one example and depending on the embodiment various ways of interconnecting at least two of the aforementioned devices may be selected without departing from the scope of the present invention.
In a collective phase 410, which may take place over a period of time, the period of time preceding the other phases of the figure possibly by several months or more, further users 4BB provide to server 4AA indications of their locations and activity types that are selected, implicitly or explicitly, in those locations. For example, these indications may relate to activity types of activity sessions the further users are engaged in, as well as corresponding locations, enabling server 4AA to associate the activity types with the corresponding sessions by constructing a thematic map database.
In phase 420, server 4AA may construct or update a thematic map database based on the indications received in phase 410, and/or indications otherwise obtained in server 4AA. The thematic map database may comprise a heat map, for example. The thematic map database associates activity types with locations, enabling determination of statistical intensities for activity types as a function of location. In some embodiments, the thematic map database also comprises at least some route information, such as a set of outdoor activity routes that are available in a certain city.
In phase 430, device 110 queries the database by transmitting a query to the server, the query comprising an implicit or explicit indication of a location of the device 110. Responsively, in phase 440, server 4AA transmits back to device 110 a set of activity types that are associated with the location, area and/or surroundings of device 110.
Phase 450 comprises determining a route, based at least partially on the set of activity types received in phase 440, and presenting the route to the user as a suggested route. Determining the route has been described above.
Optional phase 460 comprises transmitting to server 4AA an indication of an activity type the user selects, which may be, but need not be, the suggested activity type. The message of phase 460 may also comprise an indication of the current location of device 110.
Alternatively to the phases described above, device 110 may request in phase 430 for server 4AA to determine the route, such that device 110 in phase 430 provides its current location and the activity type the route is to involve. Server 4AA may then responsively determine the route based at least partly on the thematic map and the information in the request of phase 430. In these embodiments, the route is informed to device 110 in phase 440.
As a yet further alternative, device 110 may in phase 430 query for areas that are associated in the thematic map database with an activity type, the query of phase 430 comprising an indication of the activity type. The areas, once informed to device 110 in phase 440, then enable device 110 to determine the route in a way that the route traverses an area that is associated with the correct activity type.
Phase 510 comprises determining a predicted user activity type based at least partly on a thematic map database and a current location of an apparatus. Phase 520 comprises presenting, by the apparatus, the predicted user activity type as a suggested activity type to a first user. Finally, phase 530 comprises, responsive to the first user approving the suggested activity type, initiating an activity session of the suggested activity type.
Phase 600 comprises determining the present location of the apparatus. Phase 610 comprises the action of transmitting from said apparatus a query to a thematic map database server. The query may comprise an indication of the current location of the apparatus. In phase 620 the device 110 is updated with thematic maps related to the location by downloading thematic map data and storing the thematic map data in a memory of the device. In phase 630 the user is presented in a first display mode with a selection of local thematic maps as suggested activity types. The thematic maps may be selected to be downloaded based on at least one of the following criteria: a pre-recorded user preference, user activity history, intensity of activities in said location, special activities in said location, time of the day, time of the year, or a second location adjacent to said present location. Finally, in phase 640 and in response to the user approving a suggested activity type, an activity session is initiated and displayed in a second display mode.
Microcontroller 710 is communicatively coupled, in the illustrated example, with a buzzer 770, a universal serial bus (USB) interface 780, a pressure sensor 790, an acceleration sensor 7100, a gyroscope 7110, a magnetometer 7120, satellite positioning circuitry 7130, a Bluetooth interface 7140, user interface buttons 7150 and a touch interface 7160. Pressure sensor 790 may comprise an atmospheric pressure sensor, for example.
Microprocessor 720 is communicatively coupled with an optional cellular interface 740, a non-cellular interface 750 and a USB interface 760. Microprocessor 720 is further communicatively coupled, via microprocessor display interface 722, with a display 730. Microcontroller 710 is likewise communicatively coupled, via microcontroller display interface 712, with the display 730. Microprocessor display interface 722 may comprise communication circuitry comprised in microprocessor 720. Microcontroller display interface 712 may comprise communication circuitry comprised in microcontroller 710.
Microcontroller 710 may be configured to determine whether triggering events occur, wherein responsive to the triggering events microcontroller 710 may be configured to cause microprocessor 720 to transition into and out of the hibernating state described above. When microprocessor 720 is in the hibernating state, microcontroller 710 may control display 730 via microcontroller display interface 712. Microcontroller 710 may thus provide, when microprocessor 720 is hibernated, for example, a reduced experience to a user via display 730.
Responsive to a triggering event, microcontroller 710 may cause microprocessor 720 to transition from the hibernated state to an active state. For example, where a user indicates, for example via buttons 7150, that he wishes to originate a cellular communication connection, microcontroller 710 may cause microprocessor 720 to transition to an active state since cellular interface 740 is controllable by microprocessor 720, but, in the example of
In some embodiments of the invention, where an inventive apparatus comprises at least two processing cores 710, 720, at least one display 730 with at least two display modes, and at least one memory 7170, 7180 including a computer program code, the apparatus may be configured to determine the present location of the apparatus and to transmit a query to a map database server comprising an indication of the current location of the apparatus. Then the apparatus may be updated with thematic maps related to its location from the server by downloading thematic map data and by storing the thematic map data in at least one memory of the apparatus.
The apparatus may then present to the user on the display 730 in a first display mode a selection of downloaded thematic maps as suggested activity types. The selection may be based on at least one of the following criteria: a pre-recorded user preference, user activity history, intensity of activities in said location, special activities in said location, time of the day, time of the year, or a second location adjacent to said present location, for example.
In response to user input over the user interface buttons 7150 or the touch interface 7160, when an activity session is initiated, the thematic map of the selected activity is shown by the microcontroller 710 and displayed over interface 712 in a second display mode.
The microprocessor 720 may be put in a hibernation state using a triggering event protocol, either directly or via a memory shared between the microcontroller 710 and the microprocessor 720.
In various embodiments, at least two elements illustrated in
In
In
During normal operation, when thematic maps, which may be downloaded from the server 870 through a communication interface 822 of the first processor 820, of suggested activities is presented to a user on the display 810, the device 800 assumes a first activity display mode controlled by the first processor 820. The communication interface 822 may correspond to any or several of the interfaces 240-260 of
The first processor 820 initiates the selected activity and displays to the user in the first activity display mode performance-related information relating to physical performance of the user, including sensor information relating to position, distance, speed, heart rate etc. This fist activity mode is active for a predetermined time, or ends when, for example, acceleration sensor information indicates that the user is in a steady performance mode, based on cadence, rhythmic movements, heart rate, etc.
The first processor 820 may then produce a reduced version of the thematic map of a selected activity, or the reduced maps may be downloaded from the server 870 on demand. The demand may be based on the type of the device, the preferences of the user and/or the location of the user, and the server provides the appropriate selection of activities for downloading.
The device 800 may enter a first power-save mode by determining the last known context of the user and/or the performance. Having determined from the context what to display in a second display mode, the first processor 820 may enter a hibernating mode and switch from a first display mode to a second display mode. In a two-processor embodiment, the second display mode may be controlled by the second processor 830. In the second display mode, time and other information relating to said activity may be shown, such as the location of the user provided by a GPS sensor. With a “reduced” map is here meant a reduced version of a thematic map. This may for example mean one or several of the following: less or no colours, lesser display resolution, slower display updates, reduced content, etc.
In some embodiments, where two processors are involved, first and second power-save modes may be used. The preferred sequence from a power-saving point of view would be to first hibernate the first processing core, which consumes more power.
This may be controlled by the low-power second processor, for example when there is nothing to left to execute for the first processor. In some alternative embodiments where on only one processor is used, only one power-save mode may be used. In both cases, the final power-save mode involves a complete or almost complete shutdown of any the processing cores in the device, while a clock unit, such as a Real Time Clock (RTC) unit 860 is used to keep track of the time. When a motion sensor or a press of button indicates the user is looking at the display, the RTC unit provides a time signal to show time-related context on the display, such as the time and a reduced thematic map.
Reduced thematic maps may be downloaded from the server 870, or they may be produced by the first processor 820 and stored in its memory 821. In a two-processing core embodiment, the image(s) of the reduced thematic map may be copied (arrow C in
As the performance of the user continues on a steady path and there is no indication of the user looking at the display, the device 800 may enter a second power-save mode by switching off the second display mode and putting the second processing core 830 in a hibernating mode.
In a second power-save mode, the only process running in the device may be the real time clock in the RTC unit 860. The RTC unit is preferably a separate unit connected to a battery of the device, for example. The processing cores may then be completely shut off. RTC units may also be integrated in either one of the processors 820 or 830, or in both, but would then require at least some hardware around the processor in question to be powered up, with a power consumption of a few microamperes. Which alternative RTC units to use is a matter of design choice.
In a one-processor embodiment, the transfer of maps internally in the device is of course not needed, otherwise a second display mode may be used in the same fashion as with two processors, and the reduced thematic map is then shown from the memory 821 on the display 810. The single processor may thus have three levels of operation and power consumption: full operation, reduced operation and hibernation (with or without an internal RTC clock). During the performance, an acceleration sensor 840 may continuously sense the movement of the device 800. In some embodiments, the processor may be left in a reduced operation mode, if the activity and/or context are deemed to require a fast wakeup of the core. Wakeup from a state of hibernation will take longer. Various power-saving modes may also be entered when the device 800 deems the user is sleeping, for example. Indeed, various sensor inputs and their combinations may be used for determining the context of the user and select an appropriate time to enter a particular power-save mode. Such input may include the time (e.g. night-time), acceleration sensor input, ambient light, position signals from a GPS sensor, etc.
Reversing the power-saving sequence may be initiated simply by a user pressing a button, or it may be automatic. In some embodiments, for example, when a vertical move is sensed by a smart acceleration sensor 840, the corresponding sensor signal may have pre-recorded threshold values that when exceeded are interpreted as a raise of the arm in an attempted reading of the display 810. A power controller 850 then powers up the high-power processor 820 or the low-power processor 830, depending on the embodiment (one or two processors) and the previous context or display mode of the device 800). In order to speed up the wakeup of hibernating processing cores, their power supplies (switched-mode power supply SMPS, for example) may be left on. Another alternative embodiment is to switch the SMPS off and connect a low-dropout (LDO) regulator as a fast power source for the hibernating processing core in parallel over the SMPS.
In some embodiments, the RTC unit may also start a processor core. For example, if a relatively long time has passed since the user last made an attempt to look at the display, the context is difficult to predict and may have changed. The user would then no longer be interested in looking at a reduced thematic map that probably does not show the correct location and/or activity of the user anymore. Instead of just fetching for display a stored thematic map relating to a wrong context, the time delay since the last display action may be used as an indicator that the context has probably changed. As the RTC unit reveals this time delay, the information may be used for example to activate a GPS sensor in order to check the location and start at least a low power processor to update the context of the user, including fetching a thematic map which matches the current location of the user.
The context-dependent images may be fetched from a memory by using a LDO regulator as the power source for a hibernating processor, which provides a fast wakeup. After wakeup, transfer of stored images may take place directly from an internal memory of the processor or from an external memory unit to the display.
Reference is now made to
In step 910, the present location of the apparatus is determined and a query is transmitted from the apparatus to a thematic map database server for available activity or thematic maps at the current location of the apparatus.
In step 920, the apparatus is update with thematic maps related to the current location from the thematic map database server, by downloading thematic map data and storing the thematic map data in said at least one memory of the apparatus.
At least one downloaded thematic map is presented to a user of the apparatus as a selection of local heatmaps as a suggested activity in step 930, using a first activity display mode, as presented by a high-power first processing core. The activity session may be selected based on at least one of the following criteria: user selection input, a pre-recorded user preference, user activity history, intensity of activities in said location, special activities in said location, time of the day, time of the year, or a second location adjacent to said present location.
In step 940, a selected activity is initiated and displayed to the user in the display mode, containing performance-related information relating to physical performance of the user in the activity.
Now, in step 950, a first power-save mode is entered, by putting the first processing core in a hibernating mode, and by switching from the first display mode to a second display mode. The second display mode may display to the user, using a second low power processing core, the time and static information relating to said activity. In some embodiments, in predefined time intervals a pre-calculated static thematic map relating to the activity and the current time is shown. As explained in connection with
Finally, in step 960 a second power-save mode is entered by switching off the second display mode and putting also the low-power second processing core in a hibernating mode. A third display mode is entered, where a Real Time Clock (RTC) unit is used to keep the time. Pre-stored thematic maps may be shown when requested by a user input or a sensor request, showing the predicted location of the user on the map at that time.
The apparatus may now go stepwise back to the second and/or first display modes by activating the second and/or first processing cores from hibernation. This may be triggered on at least one of the following criteria: user selection input, acceleration data input from an acceleration sensor in said apparatus indicating a display reading posture of said user.
It is to be understood that the embodiments of the invention disclosed are not limited to the particular structures, process steps, or materials disclosed herein, but are extended to equivalents thereof as would be recognized by those ordinarily skilled in the relevant arts. It should also be understood that terminology employed herein is used for the purpose of describing particular embodiments only and is not intended to be limiting.
Reference throughout this specification to one embodiment or an embodiment means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment” or “in an embodiment” in various places throughout this specification are not necessarily all referring to the same embodiment. Where reference is made to a numerical value using a term such as, for example, about or substantially, the exact numerical value is also disclosed.
As used herein, a plurality of items, structural elements, compositional elements, and/or materials may be presented in a common list for convenience. However, these lists should be construed as though each member of the list is individually identified as a separate and unique member. Thus, no individual member of such list should be construed as a de facto equivalent of any other member of the same list solely based on their presentation in a common group without indications to the contrary. In addition, various embodiments and example of the present invention may be referred to herein along with alternatives for the various components thereof. It is understood that such embodiments, examples, and alternatives are not to be construed as de facto equivalents of one another, but are to be considered as separate and autonomous representations of the present invention.
Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided, such as examples of lengths, widths, shapes, etc., to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the invention.
While the forgoing examples are illustrative of the principles of the present invention in one or more particular applications, it will be apparent to those of ordinary skill in the art that numerous modifications in form, usage and details of implementation can be made without the exercise of inventive faculty, and without departing from the principles and concepts of the invention. Accordingly, it is not intended that the invention be limited, except as by the claims set forth below.
The verbs “to comprise” and “to include” are used in this document as open limitations that neither exclude nor require the existence of also un-recited features. The features recited in depending claims are mutually freely combinable unless otherwise explicitly stated. Furthermore, it is to be understood that the use of “a” or “an”, that is, a singular form, throughout this document does not exclude a plurality.
At least some embodiments of the present invention find industrial application in enhancing device usability and/or personal safety.
| Number | Date | Country | Kind |
|---|---|---|---|
| 20155906 | Dec 2015 | FI | national |
| 1521192.3 | Dec 2015 | GB | national |
| 20165790 | Oct 2016 | FI | national |
| 1617575.4 | Oct 2016 | GB | national |
This application is a continuation-in-part of U.S. patent application Ser. No. 16/377,267 filed on Apr. 8, 2019, which is a continuation-in-part of U.S. patent application Ser. No. 15/365,972 filed on Dec. 1, 2016, which claims priority from both the Finnish patent application No. 20155906 filed on Dec. 1, 2015 and the British patent application No. 1521192.3 filed on Dec. 1, 2015, and U.S. patent application Ser. No. 15/784,234 filed on Oct. 16, 2017, which claims priority from both the Finnish patent application No. 20165790 filed on Oct. 17, 2016 and the British patent application No. 1617575.4 filed on Oct. 17, 2016. The subject matter of these is incorporated by reference in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16377267 | Apr 2019 | US |
| Child | 16731120 | US | |
| Parent | 15365972 | Dec 2016 | US |
| Child | 16377267 | US | |
| Parent | 15784234 | Oct 2017 | US |
| Child | 15365972 | US |
