The present invention relates to an audio-video distribution system with the facility to control devices which respond to IR remote control commands.
For many years, infra-red remote controls have been used to control home entertainment appliances such as televisions, DVD players, satellite/cable receivers, audio systems, and so on.
More recently, the ubiquitous use of smartphones has meant that there is considerable demand for controlling these entertainment appliances using a mobile app, rather than a special-purpose remote control. Apart from reducing the number of remote control devices required, control by a mobile app allows devices to be controlled from anywhere where the smartphone is in range of a WiFi® network, whereas infra-red remote controls generally require line-of-sight communication. Control of an appliance in a different room is particularly useful in the context of video distribution systems, where the signal from (for example) a single central DVD player or satellite decoder may be selectably sent to any one of multiple connected display screens. A user watching satellite television in one room may therefore wish to control a central satellite receiver which is in another part of the building.
Some entertainment appliances are now designed to be connected to a home TCP/IP network for control with a smartphone app. However, the provision of IR receivers on this type of appliance is still ubiquitous, and there is a need for a means of controlling an IR-controlled device connected to a video distribution system, via a smartphone app.
Some systems have been made available which use a TCP/IP connected device to transmit IR commands, in response to user controls in the form of a smartphone or tablet app. However, such systems often suffer from high latency, i.e. a time delay between the user selecting a function on the smartphone and the infra-red being transmitted to the entertainment appliance. This results in a poor user experience and considerable frustration. Also, existing systems are not highly integrated into video distribution systems. It is currently possible to control a video distribution system with a smartphone app to select which sources route to which display screens, and separately to control the sources and display screens with a smartphone app which sends IR commands to the sources and display screens, but these two functions use different devices and separate communication channels.
It is an object of the invention to provide low-latency app control of an appliance having an infra-red receiver.
According to the present invention, there is provided an audio-video distribution system for sending an audio and video signal from at least one audio-video source to any of a plurality of connected display screens, the system comprising:
The architecture of the system according to the invention allows very low-latency control, in other words a very short time delay between the user selecting a function on the mobile computer, and an infra-red remote control signal being transmitted by the IR transmitter. This is because the amount of processing required in response to user input is minimised. It is simply a matter of choosing the correct machine code program according to user input, and causing execution of that machine code program by the second computer, which has the effect of transmitting the required IR command. Where multiple IR transmitters are connected to different output interfaces of the second computer, the machine code program selected will specify not only the IR command to be transmitted, but also which one of the plurality of IR transmitters should transmit the command.
In one embodiment, the storage containing the machine code programs may be storage of the mobile computer. In this case, the machine code program to be executed will be selected according to user input, and transmitted from the mobile computer to the first computer, over the packet switched network. The first computer will then load the program into the second computer and cause the second computer to execute the loaded program. As an alternative, the storage containing the machine code programs may be storage of the first computer. In this case, only a reference or pointer to the particular selected program needs to be transmitted from the mobile computer to the first computer. The first computer then retrieves the selected program from its storage and causes execution of the selected program on the second computer. Preferably, the storage is high-speed random access memory (primary storage) of the first computer. Preferably, on initialization/power-up of the first computer, all of the machine code programs are retrieved from secondary storage and held in RAM for high-speed selection and transfer to the second computer for execution, when selected by a user.
For each discrete control function selectable by the user in the application software on the mobile computer, there is a stored machine code program which is executed unaltered on the second processor. This results in very low-latency control from a smartphone app, practically indistinguishable from direct use of the original infra-red remote control within line-of-sight of the device being controlled.
In a simplest embodiment, the video distribution system has just one audio-video input, which is distributed to all display screens. However, most embodiments will include a plurality of audio-video sources, and will allow each of the display screens to be independently switched to a chosen source, that is, any source can be viewed on any screen. The routing of audio-visual signals from sources to display screens is in this case controlled by a series of switches, which in turn are connected to output interfaces of the second computer. User selection of which source is to be displayed on a particular screen may then be effected by sending a stored machine code program (or a pointer or reference to a stored machine code program) from the mobile computer to the first computer, for execution on the second computer, in exactly the same way as the IR transmitters connected to output interfaces of the second computer are controlled. Preferably, machine code programs may be stored which, when executed on the second computer, cause a combination of a switching operation and transmission of an IR command. For example, a function in the application software on the mobile device could allow a user to press a button to switch a particular display to a satellite receiver source and select channel 1. When this function is selected, a machine code program is retrieved from storage which, when executed on the second computer, causes the audio-video signal from a particular audio-video source port to be routed to a particular display screen, and also causes an IR transmitter associated with a satellite receiver connected to the selected source port to transmit a command causing the satellite receiver to show channel 1.
The first computer and second computer are typically integrated into a single hardware base station, which also includes the input ports and output ports, and where provided switches to control routing of audio-video signals from input ports to output ports. Typically, infra-red transmitters will be provided as external devices, connectable by plug and socket to the base station, since the infra-red transmitters need to be positioned for line-of-sight communication with controlled devices, whether they are audio-video source devices or display screens.
The output ports may be in the form of HDBaseT outputs, for connection of display screens at remote locations via relatively long lengths of CAT6 twisted-pair cable. The HDBaseT standard allows for Ethernet to be carried over the same cable as HD video and audio, and so a wireless network access point may be provided adjacent the display screen, allowing the packet-switched network to be accessed wirelessly from the area around the display screen, without having to provide separate wireless network infrastructure in a large building. The HDBaseT standard also allows control signals for an infra-red transmitter to be carried over the same cable, and so an IR transmitter, in particular one associated with a display screen, may be connected to an output port of the second computer via the same CAT6 twisted-pair cable as carries the HD video from an audio-video output port of the system to the associated display screen.
Preferably, a HDBaseT input, HDMI® output, infra-red output connection, and wireless network access point, or any combination of those, are integrated into a single hardware receiver device. Typically, one receiver device would be provided for each HDBaseT audio-video output port provided on the base station.
A hardware receiver device may integrate a wireless network access point, or alternatively the hardware receiver device may integrate an Ethernet port for connection of an external wireless network access point.
The first computer in most embodiments will be in most respects similar to a general purpose computer, running a common operating system suitable for embedded systems and adapted to run application software written in high-level languages. The second computer may be in the form of a single-chip microcontroller, and generally is not provided with an operating system as such. Rather, the second computer is designed to run discrete machine code programs which are loaded into it by the first computer, and each of which has a particular hardware effect such as causing the transmission of an infra-red command or causing a particular audio-video output port to be switched to carry the signal from a particular audio-video input port, or a combination of those things. The second computer may well have a fundamentally different architecture from the first computer, for example in some embodiments the second computer may have separate program and data memory, whereas the first computer will almost always use the same memory for storage of data and program instructions, albeit this is not essential to the invention. The mobile computer is typically a smartphone or tablet device, running a mobile operating system for example Android® or iOS®.
It is evident that the machine code programs stored on the mobile computer or the first computer will need to be selected depending on the particular devices which are connected to the particular audio-video input and output ports. To allow a wide variety of devices to be used with the system without taking up a large amount of storage space on the mobile computer or first computer, it is envisaged that the mobile computer and/or the first computer will be preconfigured by storing only programs which are needed to control the currently-connected set of audio-video devices. The configuration process may be handled by the first computer. In particular, application software running on the first computer may accept user input as to which devices are connected to which ports, or alternatively may be able to automatically detect devices in some cases. The first computer will then obtain infra-red commands relating to connected devices from a library, which will typically be a remote library accessible via the internet. The first computer will then automatically generate a machine code program for each infra red command of each connected device, and then either store the generated machine code in storage associated with the first computer, and transmit references to the mobile computer for storage on the mobile computer, or directly send the generated machine code programs to the mobile computer for storage.
Typically, multiple mobile computers may be connected to a single system, for example one smartphone belonging to each member of a family. Each mobile computer can be provided with the same set of machine code programs or references for storage, and transmission to the base station in response to a user command.
At the same time, other configuration information for the application software running on the mobile computer can be distributed. For example, the layout of buttons on the screen which when pressed cause transmission of associated infra-red commands (by sending a machine code program for execution on the second computer).
Preferably, the transmission of either machine code programs or references to machine code programs from the mobile computer to the first computer is via an HTTP API. In many embodiments, machine code programs may be transmitted over HTTP or another protocol in the form of hexadecimal strings.
For a better understanding of the invention, and to show more clearly how it may be carried into effect, a specific embodiment will now be described with reference to the accompanying drawings, in which:
Referring firstly to
The base station 12 includes a first computer and a second computer. The first computer includes a network interface and is connected to the packet-switched network 18. The first computer runs a conventional operating system for embedded systems, and runs a web server for managing and configuring the base station, among other things. The second computer is a single-chip microcontroller. The purpose of the second computer is to directly control hardware, including the infra-red transmitters 14a,b,c,d. The first computer is in communication with the first computer such that the first computer can load machine code programs into the second computer, and can cause the second computer to execute those programs.
The mobile computer 16 is a conventional mobile “smartphone”, for example an iPhone® or Android® device.
The packet-switched network is typically an internal home TCP/IP network, which includes wired and wireless physical parts. In most embodiments, the mobile device 16 will connect wirelessly to the network 18, but the base station 12 may be provided with a wired network connection. In practical terms, it may be convenient to co-locate the base station 12 with home networking equipment, for example a modem-router.
For clarity,
In
In this embodiment, the mobile device 16 has been configured with application software for controlling, among other devices, the blu-ray player 20. Specifically, the application software is configured to store machine code programs corresponding to remote control functions of the Blu-ray® player 20. For example, a machine code program would be provided for the play function, another program for the fast forward function, another for rewind and so on. The application software on the mobile device 16 presents the user with simple buttons to activate each function, similar to the infra-red remote control originally supplied with the Blu-ray® player 20. Each button on the user interface is associated with one of the stored machine code programs, in the sense that when the button is pressed the associated machine code program is received from storage and sent to the first computer of the base station 12 via the packet-switched network 18. The first computer then loads the machine code program into the second computer, and causes the second computer to execute that program. This has the effect of causing the infra-red transmitter 14b which is associated with the Blu-ray® player 20 to transmit the infra-red control command to the Blu-ray® player 20.
Referring now to
The method firstly involves establishing which devices are connected to which audio-video input ports and audio-video output ports. More precisely, it involves establishing which device is associated with each infra-red transmitter, although in this embodiment and in most embodiments each infra-red transmitter has a fixed association with an audio-video input port or an audio-video output port. Establishing which devices are connected may be a simple case of asking the user via a user interface, or it may be possible in some embodiments to automatically detect which devices are plugged into which audio-video input/output ports (and therefore which devices are associated with which infra-red transmitters). Typically, the manufacturer and model of each device is the required information, since this is what determines the infra-red commands which will control the device.
The first computer of the base station 12 will then contact a remote control command library 22. The remote control command library 22 is typically on a remote server on the internet. In
Machine code programs suitable for execution on the second computer are then generated on the first computer. A machine code program needs to be generated for each function of each device which is to be controlled. The machine code program needs to be generated to take account of not only the specific function of the specific device (and therefore the specific infra-red command which needs to be sent) but also the port which that device is plugged in to, and therefore the infra-red transmitter associated with the device. The generated machine code program, when executed on the second computer, will cause a specific infra-red command to be output by a specific infra-red transmitter.
In this embodiment, the machine code programs are sent to individual mobile devices 16a,b,c,d for storage on the mobile devices. Once the base station has been configured with details of the devices plugged in to each port and has retrieved the necessary details from the remote control command library 22, any number of mobile devices 16 can connect to the base station and synchronize their configuration with that stored on the base station. The authentication step with the remote control command library 22 does not need to be repeated, unless new devices are plugged in which require the retrieval of new remote control commands.
The video distribution system according to the invention allows very low latency control of both the video distribution system itself (i.e. control of the switching matrix—which source is displayed on which screen) and also the connected source devices and display screens, via the infra-red transmitters. Storing machine code programs for retrieval and execution on the second computer in response to user input ensures that the response speed of connected devices to the smartphone app control is comparable to the response speed when using a conventional infra-red remote control.
The invention according to the claims is not limited to the description given above, but changes and modifications will be apparent to the skilled person, including different combinations of the described features.
Number | Name | Date | Kind |
---|---|---|---|
20090051765 | Moberly | Feb 2009 | A1 |
20110047465 | Thiyagarajan et al. | Feb 2011 | A1 |
20120324515 | Dashevskiy et al. | Dec 2012 | A1 |
20140064735 | Thompson et al. | Mar 2014 | A1 |
Entry |
---|
Combined Search and Examination Report issued by the UK IPO dated Jun. 23, 2017. |
Number | Date | Country | |
---|---|---|---|
20180176480 A1 | Jun 2018 | US |