This application is based on and claims the benefit of priority from United Kingdom (GB) Patent Application 1219816.4, filed on Nov. 5, 2012, and herein incorporated by reference in its entirety.
This invention relates to a method and apparatus for improving local context search results. In particular, this invention relates to a method and apparatus for improving search results from remote and locally connected searchable devices.
A common Internet search request is a query for a technical specification of a product. This type of search request sometimes does not yield the desired results, perhaps returning links from automated price comparison website or poorly written technical reviews. There are a number of problems with this type of search request. First there is time, effort and bandwidth costs as the user does not immediately receive the answer they need and must spend additional effort to get the desired response. Secondly, the information returned from such results is likely to be unreliable or simply does not answer the question the user posed.
In a known client device, a natural language search statement is translated into a machine search instruction by the client device destined for one of a number of search engines. For example, the machine search instruction can comprise a command for a connected search engine to report back with the weather for that week or a query for a different search engine to return a firmware version. Such a translation works when the client device has been pre-configured for a precise search instruction type for a precise search engine but does not work if the statement is not of a configured type.
A method, system, and/or computer program product handles a query generated by a user of one of multiple local network devices that are coupled to a network. Multiple system queries are autonomously issued, by a computer that is coupled to the network, requesting states of the local network devices. Query statements, responsive to the system queries and being sent to a wide area network search engine, are intercepted. A natural language query, which is a logical query that is answered by one of the multiple query statements, is generated from one of the multiple query statements. An unstructured query, from a user, about a state of a particular device is received. The unstructured query from the user is compared with the natural language query in order to determine if a match between the query from the user with the natural language query exceeds a predetermined threshold value.
Preferred embodiments of the present invention will now be described, by way of example only, with reference to the following drawings in which:
Referring to
Referring to
Computer processing system 10 may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer processor. Generally, program modules may include routines, programs, objects, components, logic, and data structures that perform particular tasks or implement particular abstract data types.
Computer processing system 10 may be embodied in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
Computer processing system 10 comprises: general-purpose computer client 12 and one or more input devices 14 and output devices 16 directly attached to computer client 12. Computer processing system 10 is connected to a network 20. Computer processing system communicates with a user 18 using input devices 14 and output devices 16. Input devices 14 include one or more of: a keyboard, a scanner, a mouse, trackball or another pointing device. Output devices 16 include one or more of a display or a printer. Computer processing system communicates with network devices (not shown) over network 20. Network 20 can be a local area network (LAN). Further networks such as the Internet or wide area network (WAN) connect directly or indirectly through the LAN.
Computer client 12 comprises the following components: central processing unit (CPU) 22; network adapter 24; device adapter 26; bus 28 and memory 30.
CPU 22 loads machine instructions from memory 30 and performs machine operations in response to the instructions. Such machine operations include: increment or decrement a value in register (not shown); transfer a value from memory 30 to a register or vice versa; take instructions from a different location in memory if a condition is true or false (also known as a conditional branch instruction); and add or subtract the values in two different registers and put the result in another register. A typical CPU can perform many different machine operations. A set of machine instructions is called a machine code program, the machine instructions are written in a machine code language which is referred to a low level language.
A computer program written in a high level language needs to be compiled to a machine code program before it can be run. Alternatively a machine code program such as a virtual machine or an interpreter can interpret a high level language in terms of machine operations.
Network adapter 24 is connected to bus 28 and network 20 for enabling communication between the computer client 12 and network devices.
Device adapter 26 is connected to bus 28 and input devices 14 and output devices 16 for enabling communication between computer client 12 and input devices 14 and output devices 16.
Bus 28 couples together CPU 22, network adapter 24, device adapter 26 and memory 30. Bus 28 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnects (PCI) bus.
Memory 30 includes computer system readable media in the form of volatile memory 32 and non-volatile or persistent memory 34. Examples of volatile memory 32 are random access memory (RAM) 36 and cache memory 38. Generally volatile memory is used because it is faster and generally persistent memory is used because it will hold data without power.
Computer processing system 10 may further include other removable and/or non-removable, volatile and/or non-volatile computer system storage media. By way of example only, persistent memory 34 can be provided for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically a magnetic hard disk or solid-state drive). Although not shown, further storage media may be provided including: an external port for removable, non-volatile solid-state memory; and an optical disk drive for reading from or writing to a removable, non-volatile optical disk such as a compact disk (CD), digital video disk (DVD) or Blu-ray. In such instances, each can be connected to bus 28 by one or more data media interfaces. As will be further depicted and described below, memory 30 may include at least one program product having a set (for example, at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
In the preferred embodiment, the set of program modules configured to carry out the functions of the embodiments comprise query interception engine 300. Further program modules that support the preferred embodiment but are not shown include firmware, boot strap program, operating system, and support applications. Each of the operating system, support applications, other program modules, and program data or some combination thereof, may include an implementation of a networking environment.
Computer processing system 10 communicates with other device over at least one network 20 (such as a local area network (LAN) via network adapter 24. Network adapter 24 communicates with the other components of computer processing system 10 via bus 18. It should be understood that although not shown, other hardware and/or software components could be used in conjunction with computer processing system 10. Examples, include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, redundant array of independent disks (RAID), tape drives, and data archival storage systems.
Referring to
Repository 400 is for storing data used and acquired by and from device discovery method 500; result discovery method 600; and statement interception method 700. Repository 400 is described in more detail below.
Device discovery method 500 is for discovering devices connected in a local context to the client computer 12 and populates repository 500 with such discovered devices. Local context is used to describe external devices that are associated with the computer client 12. The preferred embodiment discovers devices that are associated in a local network via Ethernet connections, wireless connections and device adapter 26 connections. However, other embodiments are envisaged where devices on an enterprise network or on the Internet are associated with the client device and ready for discovery. Device discovery method 500 is described in more detail below with respect to
Result discovery method 600 is for discovering possible results from discovered devices and populates repository 400 with such possible results. Result discovery method 600 is described in more detail below.
Statement interception method 700 is for receiving an intercepted search performed on the client computer 12 and for matching the statement with the discovered possible results in the repository 400. Statement interception method 700 is described in more detail below.
Query Listener 800 is for intercepting the search on the computer client 12 and sending to statement interception method 700.
Referring to
Network device model 402 comprises data records for each device discovered by device discovery method 500. Each record comprises: device name; device network; and network address. In
Result model cache 404 holds records describing possible results. Each possible result record comprising: a natural language query that may be used to acquire a possible result; a device that the result may come from; a natural language result and a possible result as raw data.
Query register 406 is a register for holding the query statement entered by a user.
Confidence threshold register 408 is a register for holding the threshold value used as a reference for accepting results as close results or not.
Query confidence cache 410 is a memory space for holding confidence value calculations as to whether a natural language query is close to the query entered by the user.
Referring to
Step 502 is for querying a dynamic host configuration protocol (DHCP) server for devices and addresses.
Step 504 is for adding discovered DHCP devices, addresses and network type to network device model 402.
Step 506 is for querying a Bluetooth stack for devices and address. In the preferred embodiment a Bluetooth network is used for wireless personal area devices but other embodiments using a proprietary wireless network are envisaged.
Step 508 is for adding discovered Bluetooth devices, addresses and network type to network device model 402.
Step 510 is for querying a device adapter stack for devices that are connected to the client via device adapter 26.
Step 512 is for adding discovered devices, address and network type to network device model 402.
Step 514 is the end of method 500.
Referring to
Step 602 defines a loop N for each device in network device model 402.
Step 604 is for identifying a device profile for device N that contains the network protocol needed to query the device.
Step 606 is for identifying possible results for device N using the network protocol and for updating the result model cache 404.
Step 608 is for converting possible results into natural language results and for updating the result model cache 404.
Step 610 is for converting natural language results into natural language queries and for updating the result model cache 404.
Step 612 loops back to step 604 to process a next device if there is one.
Step 614 is the end of method 600.
Referring to
Step 702 is for providing a user interface for a search query.
Step 704 is for initiating and waiting for query listener 800 to intercept a search query destined for an Internet search engine. When an intercept occurs and a search query is determined then the process continues at step 706.
Step 706 is for determining if the search query contains specific device information. If yes then processing moves to step 708 else, processing moves to step 722.
Step 708 is for determining if the specific device is known to the system. A check of network device model 402 is made and the most likely devices selected based on the similarity of the device in the query and the search terms in the query. If a match is made then processing continues at step 710 else processing continues at step 722.
Step 710 is for querying the device with the search query using a specific device protocol. This step may query the device directly or indirectly using the result model cache 404.
Step 712 is for receiving the results from the device or result model cache 404.
Step 714 is for determining a confidence value of the results based on the closeness of the user query to a determined query for the possible device results.
Step 716 is for checking timeouts and confidence values. If the confidence value is equal to or more than the threshold value (or there is an Internet query timeout) then processing continues at step 718 else step 720. Step 720 is arrived at: if the device query times out; or if the confidence value is less than threshold value.
Step 718 is for returning the query result from the local device and bypassing the Internet search. This is an end of method 700.
Step 720 is for returning amalgamated Internet search results and device specific results (if any). This is an end of method 700.
Step 722 is for determining if useful results might be obtained by broadcasting the query to all known local devices. This might be a default determination regardless of the search query or might occur if the search query has more than a threshold similarity to device references. If the query is broadcast then step 724 else step 726.
Step 724 is for collecting the results from devices that have received the broadcast and determining which results are the most likely matches to the search query. The most likely results are passed on to step 712.
Step 726 is for continuing with a regular Internet search without a device query. This is an end of method 700.
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Controls 902 comprise: browser control 906 and address bar 908.
Browser control 906 provides buttons for minimizing (−); maximizing (□) and closing (X) network browser 900.
Address bar 908 provides: a network address input box; a back button and a forward button. The network address input box allows for a user to enter a server address so that the browser can request content from the server at the address. In this case the server will be the network interception engine. The back and forward buttons allow for navigation backwards and forwards through a series of network addresses.
Browser frame 904 is a frame space for rendering content sent from the server at the network address in the address bar 908.
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
As described herein, in one embodiment of the invention there is provided a method in a system of local network devices for handling a query statement generated by one of the local network devices and destined for a wide area network search engine comprising: determining possible results provided after querying local network devices in the system; intercepting a query statement destined for the wide area network search engine; determining respective relevance values for the possible results provided for the query statement; and returning relevant results from the local network devices in response to the query statement.
In one embodiment the query statement is a search query but other embodiments are envisaged where the query statement is an instruction statement.
The embodiments can direct a query or statement to a device that has been determined as the most likely to provide a relevant result. The embodiments intercept a query and analyze it to determine whether nearby connected devices can provide a more relevant result. If a nearby device is more likely to provide a relevant result to a user's statement then a result from the nearby device is returned.
The embodiments reduce network gateway and external network bandwidth usage as more communication occurs between a client device and local network devices. Reduced wide area network traffic (for example Internet traffic) is particularly important for mobile devices such as mobile phones that incur Internet costs.
The results of the embodiments are more relevant when a locally connected device is able to respond to the user's statement because the locally connected device is aware of the context of the statement.
The various embodiments address local context in a way that a traditional web based search model cannot address.
Questions about products owned by a user could be more reliably answered. For example, a query such as “what video codec does my Blu-ray player support?” would be advantageously answered by the device in question. Similarly “what is the recommended setting for my washing machine for items x, y, z?” would best be answered by the washing machine.
Questions about products not owned by a user could also be answered. For example, “what is the refresh rate on a model ABC TV?” and “what is latest firmware for a model XYZ MP3 Player?” A generic ABC TV might exist for the purpose of answering questions about that particular ABC TV.
Location specific questions could be more reliably answered by devices at that location. For example, what is the temperature in my vicinity? And is the downstairs porch light on?
The above questions illustrate the type of queries that the embodiments perform more relevantly than the traditional web search model. For the first two sets of product related statements, by querying the device first, the device would ideally be aware of its technical specifications and can therefore provide relevant information unlike the Internet which often is unaware of model or location specific differences in the user's hardware. Potentially devices not owned by the user can be located and respond to statements directed at them.
The location specific questions illustrate how the embodiments could be used not only for technical information but for location specific information, such as being able to provide sensor data from sources in the user's surrounding environment effectively an Internet of things.
The embodiments have a physical effect on processes carried on outside the client since the embodiments will reduce the query and statement workload sent externally of the client device.
The embodiments can be implemented at the machine level of a computer and would not affect a computer program executing at the application level.
The embodiments have an effect that results in the computer being made to operate in a new way such that a device for querying can be connected to the local system and become part of the query device network as soon as it is discovered.
The embodiments have an effect leading to an increase in the speed of the overall search since often the local result will be the most relevant and fastest obtained.
The embodiments have an effect leading to an increase in the performance of the client computer since the local result will be the most context relevant result.
Relevance and confidence are used interchangeably throughout the embodiments.
In one embodiment, the method further comprises querying relevant local network devices in response to the intercepted query statement, acquiring an up-to-date result from the network devices; and returning the most up-to-date result from the networked device.
In one embodiment the returned results are cached results from the networked device obtained prior to the intercepted query statement.
In one embodiment, the method further comprises querying the search engine and amalgamating search engine results with the results from the networked device query.
In one embodiment the method further comprises returning only results from the networked devices if a respective relevance value is above a threshold confidence value.
In one embodiment only the results from the networked devices are returned if the search engine query times out.
In one embodiment only the results from the search engine are returned if the networked device query times out.
Suitably a proxy search engine is created and consolidates the search results from the network device and the search engine.
More suitably a new page of search results from the network device is created and kept separate from the search engine results.
Most suitably the search engine is within or outside of the network and the network is a local or enterprise or virtual network.
In one embodiment of the invention there is provided a computer program product for handling a query statement generated by one device of a network of devices and destined for an external system, the computer program product comprising a computer-readable storage medium having computer-readable program code embodied therewith and the computer-readable program code configured to perform the method of any one of appended claims.
Viewed from a further aspect, the present invention provides a method and system substantially as described with reference to the figures.
Further embodiments of the invention are described herein. It will be clear to one of ordinary skill in the art that all or part of the logical process steps of the preferred embodiment may be alternatively embodied in a logic apparatus, or a plurality of logic apparatus, comprising logic elements arranged to perform the logical process steps of the method and that such logic elements may comprise hardware components, firmware components or a combination thereof.
It will be equally clear to one of skill in the art that all or part of the logic components of the preferred embodiment may be alternatively embodied in logic apparatus comprising logic elements to perform the steps of the method, and that such logic elements may comprise components such as logic gates in, for example a programmable logic array or application-specific integrated circuit. Such a logic arrangement may further be embodied in enabling elements for temporarily or permanently establishing logic structures in such an array or circuit using, for example, a virtual hardware descriptor language, which may be stored and transmitted using fixed or transmittable carrier media.
In a further alternative embodiment, the present invention may be realized in the form of a computer implemented method of deploying a service comprising steps of deploying computer program code operable to, when deployed into a computer infrastructure and executed thereon, cause the computer system to perform all the steps of the method.
It will be appreciated that the method and components of one or more of the disclosed embodiments may alternatively be embodied fully or partially in a parallel computing system comprising two or more processors for executing parallel software.
It will be clear to one skilled in the art that many improvements and modifications can be made to the foregoing exemplary embodiment without departing from the scope of the present invention.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including, but not limited to, wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Aspects of the present invention are described below with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
For the avoidance of doubt, the term “comprising”, as used herein throughout the description and claims is not to be construed as meaning “consisting only of”, but rather to mean “including but not limited to”.
Number | Date | Country | Kind |
---|---|---|---|
1219816.4 | Nov 2012 | GB | national |
Number | Name | Date | Kind |
---|---|---|---|
6615172 | Bennett et al. | Sep 2003 | B1 |
7698344 | Sareen et al. | Apr 2010 | B2 |
7873654 | Bernard | Jan 2011 | B2 |
8516308 | Gill | Aug 2013 | B1 |
8788944 | Gill | Jul 2014 | B1 |
9111248 | Makhija | Aug 2015 | B2 |
20050131892 | Knott | Jun 2005 | A1 |
20070192085 | Roulland et al. | Aug 2007 | A1 |
20080133504 | Messer et al. | Jun 2008 | A1 |
20080250010 | Rathod et al. | Oct 2008 | A1 |
20090132969 | Mayer | May 2009 | A1 |
20090248529 | Dhanapal et al. | Oct 2009 | A1 |
20100293178 | Govani et al. | Nov 2010 | A1 |
20110004462 | Houghton | Jan 2011 | A1 |
20120005198 | Pontier et al. | Jan 2012 | A1 |
20120233640 | Odryna | Sep 2012 | A1 |
20130278811 | Kristensson | Oct 2013 | A1 |
20140358882 | Diab | Dec 2014 | A1 |
Entry |
---|
GB Patent Application No. 1219816.4—Search Report Mailed Mar. 28, 2013. |
Anonymous, “Is Apple ‘Siri’-Ous About Search?” Barclays Capital, Google, Inc., March 9, 2012, pp. 1-13. |
P. Cimiano et al, “Orakel: A Portable Natural Language Interface to Knowledge Bases”, Mar. 1, 2007, pp. 1-. |
Anonymous, “Siri. Your Wish Is Its Command.” apple.com, Retrieved October 9, 2013, pp. 1-3. |
Number | Date | Country | |
---|---|---|---|
20140129584 A1 | May 2014 | US |