Patent Grant
10585814
The present invention relates to electronic tools for meetings including methods or devices for providing connection to a communications network, to networks or methods of operating the network, methods or devices for use in displaying media content as well as software for performing any of these methods.
Tools for Collaboration
Allowing ad hoc groups of persons to communicate with each other is one of the fundamental aspects of collaboration, problem solving, negotiation, teaching and education, etc. To assist in communication, there has been an explosion of electronic communication tools such as electronic conferencing tools, e.g. synchronous and asynchronous conferencing, online chat, Instant Messaging, audio conferencing, videoconferencing, data conferencing, application sharing, remote desktop sharing, electronic meeting systems, collaborative management (coordination) tools, project management systems, knowledge management systems, and social software systems.
One classic approach is the lecture or seminar often involving a presentation using presentation software. To a large extent the traditional single person presentation or lecture has been maintained with the audience being in a rather passive mode as far as determining, constructing, augmenting or modifying the information to be presented is concerned.
As with other business processes, meetings are going digital. Increasingly, people are using computer technology alone and in conjunction with broadband networks to support their meeting objectives prior to and during an actual meeting. For example, e-mail is used to pass around files for people to read prior to a meeting.
Collaborative workspaces in corporate networks and on the Internet offer geographically distributed collaborators a virtual repository for documents related to a project or a meeting. Electronic meeting support systems, such as interactive network-connect white boards and videoconferencing appliances, are available for the benefit of those who share the same room as well as those who are in remote locations.
The AMIDA Final Public Report describes the overall methodology behind the development of meeting support technologies. It reports that numerous studies confirm that meetings dominate the way people work. Namely, according to a study conducted by MCI Worldcom in 2003 a business person participates in 60 meetings per month. People meet in groups for a multitude of reasons. They interact in numerous predictable and unpredictable ways and the results of their interactions are as varied as the people who participate and the projects on which they are collaborating or communicating. Studies of business processes also reveal that approximately 80% of the “workload” associated with a project or process happens in preparation for a meeting. In other words, many people view the “live” meeting as a milestone or deadline by which they can pace and measure their productivity and that of their colleagues. Unfortunately, for many information managers, being in perpetual meetings has reduced their ability to prepare adequately for the next meeting, perpetuating a vicious and negative cycle.
However, Marc Al-Hames et al. report in “Audio-Visual Processing in Meetings: Seven Questions and Current AMI Answers”, that although large parts of working days are consumed by meetings and conferences, unfortunately a lot of them are neither efficient, nor especially successful. They report a study in which people were asked to select emotion terms that they thought would be frequently experienced in a meeting. The top answer—mentioned from more than two third of the participants—was “boring”; furthermore nearly one third mentioned “annoyed” as a frequently perceived emotion.
The conclusion is that despite the plethora of electronic aids to meetings, fundamental problems in handling meetings have not been solved. In fact organising and conducting meetings in a business context involves a large number of factors.
Participation
A lack of efficiency of meetings is addressed in the article “Mood indicators on electronic meeting tools” IBM, IP.com number: IPCOM000011711D, Publication Date: Mar. 12, 2003. This article addresses the issue that the lack of direct feedback makes meetings clumsy, inefficient and often unproductive. It proposes a “mood indicator” as well as an “I want to ask a question” indicator which allow the presenter to choose an appropriate moment to pause, change track or field a question. It is argued that interrupting a presenter in full flow can be awkward; however, sometimes it is difficult to get an opportunity to ask a question or make a comment when many different people are trying to make their voices heard. In a similar vein, U.S. Pat. No. 6,966,035 suggests displaying a “murmur frame” for a participant to express a view. To increase user participation, US 2010/0087139 discloses a system for sending a selection to another computer, and US 2006/0095376 discloses a system for secure voting. Commenting, voting or selecting requires that a central authority provides the information that is to be selected or commented or voted on. Hence, these proposals still leave a central figure such as the presenter in a dominating position and the other members of the meeting are largely an audience with limited selection or voting or participation rights.
A further problem with meetings is that someone is usually late or has to leave early. With the person arriving late one has to decide if the meeting is interrupted and a summary of the proceedings so far is given. For the person leaving early (often a senior person), subsequent discussions can go missing. If there is a notes taker, this provides a personal summary of the meeting—but not an objective one.
Presents systems do not provide an optimal solution.
Legal and Security Issues
A legal requirement of a meeting is that presentations, comments and submissions need to be completely reproducible—in some circumstances, e.g. in a share holders' meeting, the events in the meeting should be subject to total recall. Computer-supported collaborative work technologies, particularly those which capture human verbal and non-verbal communications (audio and video interaction) in addition to text and graphics generated during a meeting, promise to have a long term impact on how people will prepare for and behave during and following meetings. In addition, connecting to a network brings the danger of virus, malware or spyware transfer in either direction, and there is danger of copying of confidential information.
Practical Difficulties
Scalability and Ease of Use
There are even more fundamental problems with using electronic tools in meetings. If two persons want to make two presentations then usually either both presentations must be placed on one machine or there is a need to swap between the presenters' machines. To bring the display content of a computer to a projector, the most common ways are to use a cable that connects the display adapter of the graphics card to the video input of the projector [method 1] or to use a software that captures the display contents and sends it over a wired or wireless network to a remote base unit connected to the projector [method 2]. This is often called “remote desktop” and is mostly used for remote administration or remote IT assistance purposes.
Less common but also practiced methods are to use a special device connected to the display adapter of the graphics card that captures, encodes and streams the display content over a wired or wireless network [method 3].
Method 1 has several practical problems and disadvantages. In meetings where people want to contribute content from their own computers, e.g. to project images on a display, typically a video cable such as a VGA cable is used to connect each PC one at a time to the projector. This is not only not scalable but also can be and often is quite a cumbersome process that typically wastes valuable meeting time and takes the dynamism out of the meeting. Connection can be made more difficult and time consuming for example if the computer has to be rebooted for it to detect the projector or when the format of the PC differs from the format of the projector. In addition changing format can leave the computer with a new format that is not compatible with its own screen so that on reboot of the PC alone, nothing is displayed on the computer screen. Without a visible screen image the necessary re-configuration can be difficult. These issues are aggravated by a number of elements:
Method 2 also has many drawbacks. If the connection is made to a corporate LAN there is a danger of virus, malware or spyware transfer in either direction, there is danger of copying of confidential information, and there is the difficulty of making the connection, e.g. entry of a user code and password, as well the administration of such passwords and user codes.
The advantage of method 3 is that the computer does not need to use its own processing power to bring the display content in a form that is easily transported over a network. This advantage becomes less relevant as computers grow in processing power. A drawback of method 3 is that the same problems often encountered with method 1 of connecting to the display adapter remain. Another drawback is that the special device referred to requires significant processing power, which means that this device will consume much power, be relatively big and certainly be relatively expensive.
An alternative method in the making today is to use the well known USB interface of the computer for extracting the display content of the computer. US 2009/0198839 discloses such a pluggable cable arrangement. US 2011/0115689 discloses a similar USB solution for wireless connection to a projector. Accordingly connecting a projector to a computer using the standard USB port might become commonplace with time. However, this usually requires special drivers and even special hardware. Connecting a projector to a computer using the standard USB port hence might become commonplace—but even when that happens there will be a mix of new and legacy machines for several years.
Firewalls
Additional problems can occur with firewalls. Typically a visitor to a meeting will bring a computer such as a laptop that is set up for a different corporate networking environment and hence has different or incompatible networking settings. The setting up of a firewall can be complicated and if this is not done correctly, telecommunication software that has to pass through a firewall may be blocked. In order to solve problems associated with firewalls it may be necessary to open ports or identify or even add programs in an exception list. If, besides a network (hardware) firewall and an operating system firewall, there is any software based third-party firewall like Zonealarm, Norton Systemworks, CA Internet Security Suite or McAfee Firewall, then it is necessary to follow that software developer's documentation to place programs on a safe list or adding exceptions to the firewall rules. Such activity is beyond the usual user. Fussing with computer settings, or having to call for IT support wastes valuable meeting time and takes the dynamism out of the meeting.
The following problems remain for holding a face-to-face meeting using advanced electronic tools at the present time:
Although some tools solve some of these problems effectively, no electronic meeting tool solves all of them.
An object of the present invention is to provide network solutions including electronic tools for meetings including devices for providing connection to a communications network, to methods of operating the network, methods of displaying media content as well as software for performing any of these methods or for implementing such systems.
In an aspect the present invention provides an electronic meeting tool for communicating arbitrary media content from users at a meeting comprising: a node configuration means adapted to operate a display node of a communications network, the display node being coupled to a first display, the node configuration means being adapted to receive user selected arbitrary media content and to control display of the user selected arbitrary media content on the first display; and at least one peripheral device adapted to communicate the user selected arbitrary media content via the communications network, wherein the peripheral device is a connection unit comprising:
a program adapted to be loaded onto the processing device and to run on the operating system of the processing device, said program being adapted to obtain user selected arbitrary media content, said program leaving a zero footprint on termination, and an input device to allow the user to carry out a user action that triggers transfer of said user selected arbitrary media content to said transmitter through said port.
The program can be stored on the peripheral device. The transmitter can be a wireless transmitter or transceiver. The peripheral device can be a plug-and-play device. The program cane adapted to screen scrape content of the second display.
The input device can be physical actuator coupled to the peripheral device. The physical actuator preferably has a surface area of between 100 and 14,400 square mm. Alternatively, the input device can be a key displayed on the second display. The key displayed on the second display can be one not screen scraped by the program.
In another aspect the present invention provides a method for connecting a processing device to a communications network, the processing device having a memory, a display and an operating system with at least one pre-installed generic driver providing a generic communications protocol for communication between processing device and a standard class of peripheral devices, the method comprising the steps of:
a) coupling a peripheral device to the processing device, the peripheral device having a transceiver;
b) setting up, by means of the pre-installed generic driver of the operating system, a means for communication between the peripheral device and the processing device;
c) coupling the processing device to a communications network via the peripheral device;
d) routing screen scraped data between the processing device and the communication network via the means for communication, wherein the generic communication protocol is used for transferring the screen scraped data between the processing device and the peripheral device.
Step b) can comprise presenting the peripheral device to the processing device as a human interface device and wherein the pre-installed generic driver is a human interface device driver.
Alternatively step b) can comprise presenting the peripheral device to the processing device as a mass storage device and wherein the pre-installed generic driver is a mass storage device driver.
Alternatively, step b) comprises presenting the peripheral device to the processing device as a composite device and wherein pre-installed generic drivers drive different device interfaces independently.
A client application can be stored on the peripheral device which when run on the processing device obtains the screen scraped data. Such a client application can be a portable application.
In another aspect the present invention provides a peripheral device for providing communication connectivity to a processing device which is provided with memory, a display and an operating system with at least one pre-installed generic driver providing a generic communication protocol for communication between the processing device and a standard class of peripheral devices, the peripheral device comprising a memory in which executable software code is stored for execution on the processing device, said executable software code comprising:
a first software code portion for setting up, by means of the pre-installed generic driver of the operating system, a means for communication between the peripheral device and the processing device;
a second software code portion for connecting the processing device to a communications network via the peripheral device, the peripheral device having a transceiver;
a third software code portion for screen scraping data from the processing device; and
a fourth software code for routing screen scraped data between the processing device and the communications network over the means for communication; wherein the first software code portion is adapted to use the generic communication protocol for transferring the screen scraped data between the processing device and the peripheral device.
The first software code portion can be adapted to present the peripheral device to the processing device as a human interface device and wherein the pre-installed generic driver is a human interface device driver. The first software code portion can be adapted to present the peripheral device to the processing device as a mass storage device and wherein the pre-installed generic driver is a mass storage device driver. The first software code portion can be adapted to present the peripheral device to the processing device as a composite device and wherein pre-installed generic drivers drive different device interfaces independently.
The executable software code can comprise fifth code for providing a means for connecting to the communications network including a base node. The executable software code can comprise sixth code for providing means for capturing video frame buffers of the processing device.
The executable software code can comprise seventh code for providing a means for encoding, compressing and optionally encrypting the screen scraped data and sending the screen scraped data the communication network. The executable software code can comprise eighth code for providing a means for handling the peripheral device. The executable software code can comprise ninth code for providing means for initiating connection to the base node. The executable software code can comprise tenth code for receiving inputs from an input device on the peripheral device. The executable software code can comprise eleventh code for providing a means for sending state changes to the visual indicator on the peripheral device. The executable software code can comprise twelfth code for providing a means for presenting to the user a GUI. The executable software code can comprise thirteenth code for presenting a GUI for administration of the said executable software code when executed as a portable application. The executable software code can comprise fourteenth code for providing a means for displaying and activating a key on the display of the client processing device for allowing a user to input the start the transfer of data from the processing device to the base node.
In another aspect the present invention provides a peripheral device for providing communication connectivity to a processing device which is provided with memory, a display and an operating system with at least one pre-installed generic driver providing a generic communication protocol for communication between the processing device and a standard class of peripheral devices, the peripheral device comprising a memory in which executable software code is stored for execution on the processing device,
said executable software code comprising:
a first software code portion for setting up, by means of the pre-installed generic driver of the operating system, a means for communication between the peripheral device and the processing device;
a second software code portion for connecting the processing device to a communications network via the peripheral device, the peripheral device having a transceiver; and
a third processing software code for routing data between the processing device and the communications network over the means for communication; wherein the first software code portion is adapted to use the generic communication protocol for transferring the data between the processing device and the peripheral device, and an input device coupled to the peripheral device, the input device being adapted to react to a user action to trigger the transfer of the data from the processing device to the peripheral device.
The first software code portion can be adapted to present the peripheral device to the processing device as a human interface device and wherein the pre-installed generic driver is a human interface device driver. The first software code portion can be adapted to present the peripheral device to the processing device as a mass storage device and wherein the pre-installed generic driver is a mass storage device driver. The first software code portion can be adapted to present the peripheral device to the processing device as a composite device and wherein pre-installed generic drivers drive different device interfaces independently.
The input device is preferably a physical actuator coupled to the peripheral device. The physical actuator preferably has a surface area of between 100 and 14,400 square mm. The input device can be for example a key for display on the display. The executable software code can comprise fourth code for providing a means for connecting to the communications network including a base node. The executable software code can comprise fifth code for providing a means for capturing video frame buffers of the processing device. The executable software code can comprise sixth code for providing a means for encoding, compressing and optionally encrypting the video frames and sending them over a secure link to the base node. The executable software code can comprise seventh code for providing a means for handling the peripheral device. The executable software code can comprise eighth code for providing a means for initiating connection to the base node. The executable software code can comprises ninth code for receive inputs from an input device on the peripheral device. The executable software code can comprise tenth code for providing a means for sending state changes to the visual indicator on the peripheral device. The executable software code can comprise eleventh code for providing a means for presenting the user a GUI. The executable software code can comprise twelfth code for presenting GUI for administration of the executable software code when executed as a portable application. The executable software code can comprise thirteenth code for providing a means for displaying and activating a key on the display of the processing device for allowing a user input to start the transfer of data from the processing device to the base node.
In another aspect of the invention a peripheral device is provided for providing communication connectivity to a processing device which is provided with memory, a display and an operating system with at least one pre-installed generic driver providing a generic communication protocol for communication between the processing device and a standard class of peripheral devices, the peripheral device comprising a memory in which executable software code is stored for execution on the processing device, said executable software code comprising:
a first software code portion for setting up, by means of the pre-installed generic driver of the operating system, a means for communication between the peripheral device and the processing device;
a second software code portion for connecting the processing device to a communications network via the peripheral device, the peripheral device having a transceiver;
a third software code portion for receiving media content from the network and for displaying the media content on the display in accordance with a set of rules; wherein the first software code portion is adapted to use the generic communication protocol for transferring the media content between the peripheral device and the processing device.
The executable software code can comprise fourth code for providing a means for correctly configuring a receiver as an access point. The executable software code can comprise fifth code for providing a means for listening for output of connection units trying to connect on a specific port. The executable software code can comprise sixth code for providing a means for a GUI for administration purposes. The executable software code can comprise seventh code for providing a means for publishing its presence over the network using the Zeroconf protocol. The executable software code can comprise eighth code for providing a means for accepting and installing software updates. The executable software code can comprise ninth code for providing a means for providing facilities for pairing of connection units to the processing device. The executable software code can comprise tenth code for providing a means for auto-composing of different incoming arbitrary media streams and rendering of composited image on display. The executable software code can comprise eleventh code for providing a means for receiving, decrypting and decoding incoming arbitrary media content. The executable software code can comprise twelfth code for scaling of incoming arbitrary media streams. The executable software code can comprise thirteenth code for providing a means for displaying incoming arbitrary media content in accordance with a set of rules.
The present invention also provides a method for communicating arbitrary media content from users at a meeting comprising:
operating a display node of a communications network, the display node being coupled to a first display, to receive user selected arbitrary media content and to control display of the user selected arbitrary media content on the first display; and connecting a peripheral device to a port of a processing device and communicating the user selected arbitrary media content via the communications network, loading a program onto the processing device and running the program on the operating system of the processing device to obtain user selected arbitrary media content, said program leaving a zero footprint on termination, and triggering transfer of said user selected arbitrary media content to said transmitter through said port after a user action on an input device.
The present invention also provides a peripheral device comprising: a base
a connector for connection to a plug and play port of a host processing device,
a flexible connection between the base and the connector for transferring data signals and power,
an actuator on the base for actuating a signal and for transferring the signal to the connector for transfer to the port, wherein the base has electronics comprising permanent storage for storing a portable application, a processing engine, a transceiver and a visual indicator.
The present invention also provides a method for providing communication connectivity from a processing device,
setting up a communications network between a base node of the communications network and a peripheral device coupled to the processing device;
transferring media content between the processing device and the peripheral device, transmitting the media content from the peripheral device to the communications network,
receiving media content from the communications network at the base node and displaying the media content on a display in accordance with a set of rules.
With any of the above embodiments using pairing of the peripheral device, the only user actions required to connect the processing device to the communications network and hence to the first or central display are plug in the peripheral device into the processing device, optionally press the button on the peripheral device. This method allows for an automatic connection of the peripheral device to the display node without any user interaction or configuration
Embodiments of the present invention also include any of the above software code being stored on a non-transitory storage medium.
Definitions
“Plug and play” is a term used to describe the characteristic of a computer bus, or device specification, which facilitates the discovery of a hardware component in a system, without the need for physical device configuration, or user intervention in resolving resource conflicts. Plug and play devices can be added to a bus of a computing system (while running or when shut down), and the newly added device and possibly the rest of the computing system is automatically configured to make the newly added device work, both from hardware and from software perspective.
Plug and play interfaces include for example (not an exhaustive list): Firewire (IEEE-1394), PCI, Mini PCI, PCI Express, Mini PCI Express, PCMCIA, PC Card, Universal Serial Bus (USB), SDIO cards.
“Auto-configuration” is the automatic configuration of devices without manual intervention, without setting any switches or jumpers, and without any need for software configuration. An example of auto-configuring devices: USB devices. Examples of auto-configuring protocols: DHCP, Zeroconf, Bonjour.
A plug and play device has auto-configuration software by default to make it plug and play. Example: USB devices are made to be plug and play by including the correct auto-configuration software (e.g. host driver, host stack, application software). Autoconfiguration can also refer to a software alone and is not restricted to a physical device.
“Hot swapping and hot plugging” are terms used to describe the functions of replacing computer system components without shutting down the system. More specifically, hot swapping describes replacing components without significant interruption to the system, while hot plugging describes the addition of components that would expand the system without significant interruption to the operation of the system. A well-known example of this functionality is the Universal Serial Bus (USB) that allows users to add or remove peripheral components such as a mouse, keyboard, or printer. Other examples are eSATA, PCIe, FireWire, for example.
A “portable application” (portable app), sometimes also called standalone, is a computer software program designed to run without installation on the target machine. This type of application is stored on a removable storage device such as a CD, USB flash drive, flash card, or floppy disk—storing its program files, configuration information and data on the storage medium alone. It is a program that can be stored on an electronic device such as a USB flash drive, iPod, memory card, portable hard drive or other portable electronic device and runs on a computer or other processing device coupled to the electronic device without making permanent configuration changes to the host computer. All such programs have a zero-footprint, meaning all temporary files, registry entries, and any other changes to the machine exist only while the program is running.
To be considered a portable application, for purpose of this invention, a software program must:
Not require any kind of formal installation onto a computer's permanent storage device to be executed, and can be stored on a removable storage device such as USB flash drive, iPod, memory card, portable hard drive or other portable electronic storage device thus enabling it to be used on multiple computers.
Settings are stored with, and can be preferably carried around with, the software (i.e., they are written to the electronic device such as a USB drive). Settings are not stored to the registry or any other central system database of the computer.
Leaves a zero (or near-zero) “footprint” on any PC it is run on after being used. i.e., all temporary files/registry settings should be either avoided or at least removed once the program has exited, and files created by the user can be saved directly to the same removable media as the application is stored on.
A portable application does not leave its files or settings on the host computer on which it runs. For example, the application does not write to the Windows registry or store its configuration files (such as an INI file) in the user's profile; instead, it stores its configuration files in the program's directory. Another requirement, since file paths will often differ on changing computers due to variation in Windows drive letter assignments, is the need for applications to store them in a relative format. Preferably, such a program does not require a launcher program to copy necessary settings and files to the host computer when the application starts and move them back to the application's directory when it closes as this may leave a residue on the hard drive in case of power failure.
“Electronic meeting systems” (EMS) need to be distinguished on the one hand from classic groupware, on the other from web conferencing systems. In reality, there is some overlap between minor features of products of the named categories. The main difference from groupware is the intensity of collaboration. EMS should be distinguished from systems with which it is possible to show the contents of an individual computer screen on a remote display with multiple users at the same time.
“Groupware” supports collaboration within groups where the individual contributions remain identifiable. In contrast, EMS enables the group to cooperatively produce a result for which the group is responsible as a whole. In a business process, groupware and electronic meeting systems complement each other: Groupware supports teams when researching and creating documents in the run up to an EMS session or when implementing the results of such a session.
“Web conferencing systems” and “electronic meeting systems” complement each other in the online meeting or workshop: EMS extends the web conferencing system by providing interactive tools for producing and documenting group results. On the other hand, “web conferencing systems” complement EMS with the screen sharing and voice conferencing functionality required in synchronous online meetings and not present in EMS.
“Data conferencing” refers to a communication session among two or more participants sharing computer data in real time. Interaction and presentation devices such as a screen, keyboard, mouse, camera, etc. can be shared. It is a term used to distinguish from video conferencing and audio conferencing. The data can include screen, documents, graphics, drawings and applications that can be seen by the participants of the meeting.
“Application sharing” is an element of remote access, falling under the collaborative software umbrella, that enables two or more users to access a shared application or document from their respective computers simultaneously in real time. Generally, the shared application or document will be running on a host computer, and remote access to the shared content will be provided to other users by the host user. Application sharing should be distinguished from systems in which collaboration on the applications between different users is not possible but the contents of individual computer screens can be projected onto a remote display with multiple users at the same time.
The term “arbitrary media content” refers to the fact that a user may generate, create or select any media content that is appropriate to display. This differs from client voting on, or selecting of media content that is displayed by another in a meeting or presentation. This term refers to client oriented, distributed rights and privileges for the display of content rather than a central presenter providing content which is presented to the members of the meeting.
“Screen scraping” in our sense refers to reading the video frame buffers and processing them, rather than just rendering them on a display. Screen scraping for presentations is described in US2002/0196378 to Slobodin et al which is included herein by reference.
“Auto composition” or “auto layout” refers to the automatic nature in which multiple graphics/video sources are rendered on a central display, without user intervention and in a way that a user would intuitively expect it to happen.
“Wireless” and “wireless communication network” can be any network that does not use cable links between nodes, e.g. uses RF, optical or InfraRed for communication purposes, such as IrDA, diffuse infra-red, WLAN, WiMax, WiFi, WiFi Direct, Bluetooth or any other wireless communication network known to the person skilled in the art.
“Computer” generally refers to a processing device, i.e. having a processing engine capable of various types of digital processing, such as rendering graphics images for display. A computer can be in the form of a work station, a personal computer, a lap-top, a palm top, a PDA, a smartphone, a tablet etc. Generally a computer has memory such as volatile RAM. Non-volatile memory such as a hard disc, optical disk or solid state memory can be included in the computer or can be a peripheral device. Currently most computers are electronic but the term “computer” also includes optics based computing devices.
The term “pre-installed generic driver” is intended to mean a driver which is installed on a processing device such as a computer as a standard driver, e.g. is installed with the installation of the operating system. Such a driver is standard for the operating system and can drive a standard class of peripheral devices coupled to or connected to the processing device. The installation of a specific driver for such a peripheral device is not required. Such a generic driver can be a human interface driver (HID) or a mass storage device driver, which has predetermined software components configured for driving mass storage, a CD-ROM, a keyboard etc. or combinations of these. Such devices can be readable and writable computer peripheral memory devices such as USB memory sticks, flash memories, external hard drives, or more.
The present invention will be described with respect to particular embodiments and with reference to certain drawings but the invention is not limited thereto but only by the claims. The drawings described are only schematic and are non-limiting.
Furthermore, the terms first, second, third and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a sequential or chronological order. The terms are interchangeable under appropriate circumstances and the embodiments of the invention can operate in other sequences than described or illustrated herein.
Moreover, the terms top, bottom, over, under and the like in the description and the claims are used for descriptive purposes and not necessarily for describing relative positions. The terms so used are interchangeable under appropriate circumstances and the embodiments of the invention described herein can operate in other orientations than described or illustrated herein.
The term “comprising”, used in the claims, should not be interpreted as being restricted to the means listed thereafter; it does not exclude other elements or steps. It needs to be interpreted as specifying the presence of the stated features, integers, steps or components as referred to, but does not preclude the presence or addition of one or more other features, integers, steps or components, or groups thereof. Thus, the scope of the expression “a device comprising means A and B” should not be limited to devices consisting only of components A and B. It means that with respect to the present invention, the only relevant components of the device are A and B.
Similarly, it is to be noticed that the term “coupled”, also used in the description or claims, should not be interpreted as being restricted to direct connections only. Thus, the scope of the expression “a device A coupled to a device B” should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means.
Elements or parts of the described devices may comprise logic encoded in media for performing any kind of information processing. Logic may comprise software encoded in a disk or other computer-readable medium and/or instructions encoded in an application specific integrated circuit (ASIC), field programmable gate array (FPGA), or other processor or hardware.
References to software can encompass any type of programs in any language executable directly or indirectly by a processor.
References to logic, hardware, processor or circuitry can encompass any kind of logic or analog circuitry, integrated to any degree, and not limited to general purpose processors, digital signal processors, ASICs, FPGAs, discrete components or transistor logic gates and so on.
Embodiments of the present invention provide solutions to three major problems with meetings:
a) the time taken to prepare for a meeting. This is mainly achieved by allowing “on-the-fly” presentation of any displayable information. This information does not have to be linked into any particular presentation software, nor to be compatible with any such presentation software,
b) the time taken to conduct the meeting using electronic meeting tools. This is achieved by reducing the time to connect computers to the display or projection system.
c) the time taken to reflect and review and document the meeting afterwards. This is achieved by providing the possibility of recording the course of the meeting in the same time sequence that it was carried out as well as be able to store all data presented and who presented it.
Preferably the network 50 is a local area network, i.e. preferably local to the meeting room for security reasons but the network 50 may have access to other local or wide area networks such as 51 or to a larger corporate network or the internet 43, for example via a router 42. Another node of the network 50 is the base or display node 36. This node 36 may optionally be a wireless access point. The base node 36 may also be a processing device or host computer and may be coupled to a second connection unit 49 that provides access to the network 50 thus linking all of the processing devices 31, 36 together. The connection unit may have an input device as described above. Alternatively, network connections installed on the base node 36 can be used. Audio equipment 46 may be provided, e.g. a telephone that allows other members of the meeting to call in from remote destinations.
The display node 36 is coupled to and adapted to allow display of media on some kind of display 44. The display node is in embodiments of the present invention a base node of the communications network 50. The display 44 may be a projector and screen, the projector being coupled to the base node 36. A whiteboard 45 can optionally be provided that can be optionally coupled to the display 44 and/or the base node 36, e.g. when the whiteboard can record electronically what is written on it. Optionally, a camera 35 may be provided to record the entries on the whiteboard 45. The camera 35 may have a third connection unit 52 for connecting the camera 52 to the network 50 so that the data from the whiteboard can be recorded and stored or transmitted to other networks via router 42. The connection unit 52 may have an input device as described above.
Optional equipment can be cameras 39, 40, 41 for recording the progress of the meeting. These cameras can be linked by a network 51, e.g. a cable network to the router 42 and/or the base node 36. Another optional item is a microphone or microphones 38 that can be used to transfer audio, e.g. to the processing devices 31 and to loud speakers (not shown) attached to the base node 36 or part of the display 44.
Any or all of the outputs of the processing devices 31, the cameras, the whiteboard, etc. can be recorded and stored digitally, e.g. in node 36 or elsewhere to provide a complete record with correct time sequence.
Summarizing the above, the present invention provides an electronic meeting tool for communicating arbitrary media content between different users 37 (with their own processing devices 31, e.g. PC, mobile phone, or tablet) and one display or projector or multiple displays or projectors 44 in the meeting room 50.
Referring to
An independent aspect of the present invention is at least one connection unit 47, (optionally 49 for receiving) adapted to communicate the user selected arbitrary media content to said base node 36. Preferably the connection units 47 and/or optionally 49 are physical plug-and-play devices. An example of a connection unit is shown schematically in
The connection unit 47 may integrated into a user processing device 31, e.g. as an internal peripheral device or may preferably be an external peripheral device comprising a connector adapted to couple to a port of a user processing device 31. The processing device 31 may have a client display, a processing engine such as a microprocessor, a memory and an operating system. The optional connection unit 49 may integrated into the base node 36, e.g. as an internal peripheral device or may be an external peripheral device comprising a connector adapted to couple to a port of the base node 36. The connection unit 49 may be fully integrated into the base node 36, e.g. is an internal network interface of the base node 36. The base node 36 may have a processing engine such as a microprocessor, a memory and an operating system.
The user processing devices 31, the connection units 47, (optionally 49) and the base node 36 co-operate to form a communication network 50 for linking between at least one of the plurality of processing devices 31, 36 and the central display device 44. The communication network 50 is adapted to receive arbitrary media content from at least one of the plurality of processing devices 31 and to transmit the arbitrary media content of at least one of the plurality of processing devices to the central display device 44.
An independent aspect of the present invention is a portable application 60 adapted to be loaded onto a client processing device 31 and to be run on the operating system of the client processing device 31. The portable application 60 runs as a process on the client processing device 31 that is adapted to deliver an arbitrary media content from the client processing device 31 to the communication network 50 in response to a user action applied to an input device 48, the process leaving a zero footprint on termination. Optionally the portable application 60 is stored on each connection unit 47 and optionally 49. Preferably the portable application 60 is adapted to “screen scrape” content of the client display of the client processing device 31. Optionally the portable application 60 when run on a processing device 31 is adapted to “screen scrape” content of the client display of this client processing device 31 and to transmit it via a connection unit 47. Optionally the portable application 60 when run on the processing device is adapted to “screen scrape” content of the client display of the client processing device 31 and to transmit it via a network interface of the processing device 31, for example if the connection unit 47 has no transmitter.
The connection unit 47 for communicating with said base node 36 has a network interface e.g. comprising a transmitter 62. The transmitter 62 is preferably a transceiver. Optionally the transmitter/receiver can be a wireless transmitter/receiver.
The base node 36 for communicating with the connection unit 47 has a receiver 63 which can be included in the connection unit 49 or integrated into the base node 36.
The receiver is preferably a transceiver. Optionally the transmitter/receiver can be a wireless transmitter/receiver.
The input device 48 allows a user interaction with the connection unit 47. Preferably the input device 48 is physical actuator coupled to the connection unit 47. The user action applied to the input device 48 generates a signal that can trigger transfer of data from the processing device 31 (to which the connection unit 47 is coupled) to the network 50. Preferably the input device 48 has an activating surface that is between 100 and 14,400 square mm. Optionally, the input device 48 can be a key displayed on the client display 1 of a client processing device 31. This key can be activated, e.g. by use of a pointing device such as a mouse trigger transfer of data from the processing device 31 to the network 50.
The connection unit 47 is preferably provided with a visual indicator 61, e.g. for allowing user feedback from the connection unit 47 of the status of any activity.
The system also can include a server program 64 adapted to be loaded onto the base node 36, said program 64 being adapted to receive arbitrary media content from one or a plurality of client processing devices 31 through said connection units 47, (optionally 49), and to show this plurality of arbitrary media content streams on one or a plurality of displays 44. The server program 64 may be adapted to allow display in accordance with one or more rules, e.g. FIFO, automatically, on request, forced, in accordance with a priority etc. To execute the rules, the server program 64 may have a decision module.
Preferably, the server program 64 is adapted to treat media content passed to it from any or all of the connection units 47 in an equal manner. The server program 64 may be adapted to auto compose the media content on the central display 44.
The server program 64 may be a portable application adapted to be loaded onto the base node 36 and to be run on the operating system of the base node 36. The portable application 64 runs a process on the base node 36 that is adapted to display an arbitrary media content received from the client processing device 31 via the communication network 50, the process leaving a zero footprint on termination. Optionally the portable application 64 is stored on each connection unit 49 and optionally 7 and can be installed therefrom.
The system may also include a central display device 44 and optionally a whiteboard 45 or other display means such as a printer. The display 44 being adapted to receive user selected arbitrary media content, and may be adapted to allow display of the received user selected arbitrary media content in accordance with one or more rules, e.g. FIFO, automatic, forced, on request or approval, in accordance with a priority etc.
Optionally, one of the connection units 47 can be adapted to be a master connection unit. Such a master connection unit may be adapted to instruct the base node when media content from a client processing device 31 may be displayed or which of the processing devices may be allowed to send content for display.
In embodiments of the present invention, at least one portable application is used, e.g. for the client software on a client procesing device 31 or optionzlly on the base node 36. In these embodiments, one of the pre-installed generic drivers of the operating system on the relevant computer device 31, 36 is exploited for setting up communication from the computer device 31, 36 to the network 50 via the connection unit 47, (optionally 49). The generic driver is used in connection with the connection unit 47, (optionally 49) operating as a peripheral device but the use can go beyond that of the standard class of peripheral devices for which the generic driver is intended. In some embodiments the connection unit 47, (optionally 49) operated as a peripheral device communicates with the relevant processing device 31, 36 by using a generic communication protocol provided by the pre-installed generic driver. Pre-installed USB drivers are examples. Preferably the setting up of the communication of network 50 using connection unit 47, (optionally 49) does not alter or affect the networking capability of the relevant processing device 31, 36. For example, if a browser is started on the client processing device 31, this browser can use the standard network interfaces on the processing device 31. This means that transfer of data via the connection unit 47 (optionally 49) is independent of transfer of data over the network interfaces of processing device 31 or 36. This has the advantage that each user can carry out processing such as searching on the internet to gather data independently of the transfer of data to be diplayed during a meeting, or receive emails etc.
The use of a portable application has the advantage that any modification to settings in the register or generally in the operating system can be avoided, so that upon any form of termination, e.g. disconnecting the electronic device, system crash, no trace is left. This is generally termed “zero footprint”.
The present invention has the advantage of scalability. It can provide a display system for use by a plurality of users in meetings. Every user in the meeting thus can have a client processing device 31 for coupling to a connection unit 47. A first user action connects the client processing device 31 to the base node 36, e.g. by inserting a connection unit 47 into the relevant interface connector on the processing device 31, e.g. a USB interface. A second user action comprising activating a button or key on the input device (e.g. by depressing it) then starts the process of transmitting arbitrary media content from the client processing device 31 to the base node 36. This process preferably includes screen scraping data from the processing device. Using screen scraping avoids special programs being installed on the base node 36 to carry out graphical commands sent from the processing device 31. When the base node 36 receives the plurality of arbitrary media content, it can allow auto composition of this media content on the central display connected to it.
The present invention will now be described further with reference to certain more specific embodiments.
With reference to
A client processing device 31 that wants to have its arbitrary media content displayed on the central display connected to the base node 36 is connected to a connection unit 47. The portable application 60 will be executed on the client processing device 31 as a host device. A first user interaction creates a connection between the portable application 60 and the base node 36 using the transmitter in the connection unit 47 and the receiver in the base node 36. A second user interaction, this time on the input device 48, activates screen scraping by the portable application of the arbitrary media content from the client processing device display, which is then sent over the connector unit 47 to the base node.
The base node 36 receives the plurality of arbitrary media content coming from one or more connection units 47, and auto composes this media content for rendering on the central display.
The visual indicator 61 on the connection unit 47 indicates to the user and to other participants in the meeting that media content is being sent by that connection unit 47 to the base node 36 for display.
Repeating the second user interaction on the input device 48 of a connection unit 47 decouples the media content from that connection unit 47 from the base node 36. The base node 36 removes that media content from the composed image on the central display and recomposes the remaining content on the central display.
The content on the central display/projector is auto arranged as shown in
Base Node Software
The base node software has one or more of the following features:
Any of the above code may be stored on a non-transitory machine readable storage medium such as an optical disk, a magnetic disk, magnetic tape, solid state memory etc.
Portable application for the client processing device
The portable application comprises an algorithm for screen scraping. Screen scraping algorithms include VNC and RDP or similar. The algorithm may include a combination of algorithms such as VNC and RDP that are optimized for different content, e.g. static text or video. The portable application has one or more of the following features:
Any of the above code may be stored on a non-transitory machine readable storage medium such as an optical disk, a magnetic disk, magnetic tape, solid state memory etc.
In this embodiment the portable application stored on the connection unit, and is executed in an execution context on the client processing device. The portable application does not need to be copied to or installed on the computer. It can be executed directly from the connection unit. It will only be copied temporarily into an execution context on the client processing device. There are also no changes in configuration or settings in the client processing device. This means that nothing will remain on the client processing device when the connection unit is removed. It also implies that the portable application will run on client processing devices where the user does not have the necessary access rights to install software.
The portable application is designed in such a way that
Advantages
The present application has one or more of the following advantages:
The portable application may be stored on a non-transitory machine readable storage medium such as an optical disk, a magnetic disk, magnetic tape, solid state memory etc.
In the second embodiment, referring to
The connection unit is a physical device in the form of an external peripheral device (shown in the drawings as a “dongle” D) comprising permanent storage storing the portable application (7) and configuration parameters (12), memory, a processing engine (e.g. CPU, FPGA), a wireless transmitter such as WiFi (3), a plug and play interface such as a USB interface (2), a button as input device (9), an LED ring as visual indicator (10). The portable application is stored on the peripheral device (7).
The client processing device is host device, for example a computer or laptop comprising a display, a plug and play interface such as a USB port (2), memory, and a processing engine such as a microprocessor.
The system thus comprises
The external peripheral device (D) also preferably has any one or any combination of:
An advantage of embodiments of the present invention is to provide data transfer to the peripheral device via a peripheral interface such as a USB interface on any processing device such as a computer in a manner that is largely operating system independent and without leaving a footprint (Zero-Footprint). Installation of drivers and/or applications onto such a processing device as a computer is not necessary wherever pre-installed generic drivers are present. Administrator rights on the processing device such as a computer are preferably not necessary. To avoid the need for administrator rights, embodiments of the present invention use other peripheral device pre-installed drivers such as USB class drivers supported without any extra installation. Embodiments of the present invention route at least screen scraped data presented by client software running on the processing device for transfer to a communications network via a peripheral device such as a USB device. This bypasses any network interface of the processing device (and hence many firewalls) but only for the specific client software. Other applications are not affected and can make use of the standard network interfaces, i.e. packets from/to the TCP/IP stack are transferred to a network device as normal. The client software is launched from the peripheral device such as a USB composite device or storage device as a portable application, which can avoid that any traces are left on the host OS.
Basic usage scenario of the second embodiment
The base node software (6) displays on the projector a splash screen—(21) in
To avoid user interaction for the configuration of the connection between peripheral device and base unit, a pairing process is used. This pairing process provides the peripheral device, i.e. the connection unit with networks parameters needed to set up the local network. As an example, the peripheral device can be briefly plugged into the USB port (11) of the base unit (B). The base unit then optionally does a software validity check, optionally does a software update of the portable application stored on the peripheral device, and writes the connection parameters on the peripheral device (D) required for the peripheral device and base unit to find each other to the permanent storage (8). For example, when using WiFi, this would be the SSID, WEP/WPA2 and IP address of the base unit's receiver, as well as the port number used by the base node software.
A client processing device that wants to have its arbitrary media content displayed on the central display connected to the base node (5) connects a peripheral device (D) to its USB port via (2). The peripheral device presents itself to the computer over interface (2) as a composite device comprising a mass storage device and a keypad. This has the major advantage that no specific driver is required, since all these devices are natively supported in every personal computer system that has a USB port. If autorun is enabled, then the computer will automatically execute the client software (7) stored in mass storage (8) on the peripheral device. The first user interaction mentioned in the general case is then just the connection of the peripheral device to the USB port. If security measures disabled auto-run, the user needs to explore the mass storage on the mass storage of the peripheral device and start the portable application manually.
The portable application will use the wireless, e.g. wifi interface of the peripheral device (3) to connect to the correct base node. To know the right base unit to connect to, the configuration parameters needed to make this connection are stored in the database (12) on the mass storage device (8) during the pairing process described earlier.
Once the connection is made, the peripheral device goes into connected mode. This means that there is now at least one channel from the peripheral device to the base unit. The content is not shown yet. The LED (10) on the peripheral device now turns white to give a visual indication of this new state.
When the user at the computer (C) wants to show her content, she presses the button (9). When the button was previously in state “connected” (see
The button (9) acts as a toggle. When the user presses the button again, that computer displays content will be removed from the projector. The LED (10) goes back to white.
Use of the auto-run feature is optional if possible and enabled on the computer (C) to start the client software (7) as soon as the peripheral device is plugged in. On Windows for example, this means mounting the peripheral device as a mass storage device and using the autorun.inf file stored on the peripheral device.
In many cases however, this auto-run feature will be disabled for security reasons. In that case, we will, if possible and enabled on the computer (C), use the auto-play feature to show the logo of the connected peripheral device on the desktop of the computer. The user then needs to double click on that logo to start the client software. If the auto-play feature as described above is also not possible or enabled, the user must browse to the file system of the connected peripheral device and start the application manually. This means double clicking the client.exe file on Windows, client.app on Mac OS/X or tapping the appropriate application icon on a tablet or any mobile device with touch screen.
In the third embodiment, the portable application is stored on a solid state memory such as a regular USB memory stick (
With a solid state memory such as a regular USB memory stick, there is no input device, visual indicator or transmitter of the kinds described above for the connection unit. This means that the system needs to:
The client processing device then looks like
This embodiment provides a peripheral interface such as the USB interface on any processing device acting as a host device such as a computer in a manner that is largely operating system independent. Installation of drivers and/or applications onto such a processing device as a computer is not necessary wherever pre-installed generic drivers are present. Administrator rights on the processing device such as a computer are preferably not necessary. To avoid the need for administrator rights, this embodiment uses other peripheral device pre-installed drivers such as USB class drivers supported without any extra installation. This embodiment of the present invention routes at least screen scraped data presented by client software running on the processing device for transfer to a communications network via a network connection of the processing device. The client software is launched from the peripheral device such as the USB device as a portable application.
The first user operation then comprises:
Presenting visual feedback on user actions is in this embodiment also done using elements in the GUI of the display of the client operating device.
In this embodiment, the advantage of zero footprint is partly realized by the portable application in the sense that no software is installed on or copied to the client operating device, but there is a configuration change needed to connect the transmitter of the client operating device with the base node, which needs to be undone afterwards.
Optionally, the portable application can make the configuration changes to the transmitter for the user.
Advantages lost in this embodiment
Optionally, the last point can be avoided by using the base unit as a gateway to the network that the client operating device wanted to connect to through its own interface.
Advantages are:
Disadvantage is a higher vulnerability of the system because the display connection is now possible a doorway into the corporate network.
What remains as advantages are
This embodiment is similar to the third embodiment, with as only difference that the software is copied on the client operating device (
This embodiment will typically be used for tablet PC's and mobile devices. In that case
In this embodiment, the base node is not realized as a separate physical box, but integrated into the processing unit inside a display or projector. All other details are as previously described.
In this embodiment, the base node is not realized as a separate physical box, but integrated into the codec of a video conferencing equipment. All other details are as previously described.
In this embodiment, one or multiple client operating devices are not in the direct vicinity of the base node but on a remote location.
To accommodate this case, the following adaptations are needed:
All other details are as previously described.
In this embodiment, multiple base nodes are used. This can be done for different purposes:
Thi provides the advantage that one can present on multiple base units from a single peripheral device. This is usefull for a number of cases:
personal peripheral device: user can have a personal peripheral device that is paired with multiple meeting rooms that he regularly uses
use in meeting room with multiple base units each controlling a different display in the same meeting room
The proposal uses a special variant of the peripheral device called a multi base peripheral device. The multi base peripheral device is equiped with a rotating wheel around the circular central “show me” button. This could be a mechanical rotating multi-position switch or something like the touch wheel on the iPod classic.
The pairing of this multi-base variant of the peripheral device:
the rotation wheel is put in the position of the corresponding base unit.
the peripheral device is paired to the base node in the regular way
the configuration parameters are stored in a permanent storage location; every position of the rotating wheel has a corresponding set of connection parameters (e.g. different rows in a table) each corresponding with a particular base
The connection of the peripheral device is as follows:
multi-base peripheral device X is plugged into a PC
rotation wheel on peripheral device X is put in position A
peripheral device X reads configuration parameters in position A of its internal memory
peripheral device X connects to base node A
base node A indicates connection of multi-base peripheral device X on central display screen
rotation wheel on peripheral device X is put in position B
peripheral device X reads configuration parameters in position B of its internal memory
peripheral device X connects to base node B
base node B indicates connection of multi-base peripheral device X on screen
continue until correct base is selected with rotation wheel
click the peripheral device input device e.g. button to show content on central display of base node
rotating the wheel always first clicks away content from the base of the last position
The peripheral device is configured as a connection unit and is a physical device in the form of a connector for a plug and play interface of a user processing device as a host computer such as a USB connection, a flexible data and power connection connected to the connector and a base, the base having an actuator, e.g. a button configured to be an input device with the functions as described above.
The base and/or the actuator is preferably large in size, e.g. having a surface area between 100 and 14,400 square mm. The base can be square, rectangular, round, hexagonal, oval, polygonal in shape or any other ergonomically suitable shape. The actuator is preferably round but can be square, rectangular, hexagonal, oval, polygonal in shape etc. there can be more than one actuator on one base.
The length of the flexible data and power connection, e.g. cable is preferably adapted to place the peripheral device (when in its connected in its operating position), especially the base and the actuator, in the region between the boundary of the connected user processing device and the ergonomic boundary as defined above. In addition the flexible data and power connection should be adapted so that the base lies flat on the meeting table independent of the orientation of the connector needed to insert the connector into the plug and play interface. The flexible data and power connection can be a cable that is firmly fixed to and integrated into the base. Alternatively the flexible data and power connection can be a separate cable that connectors to a suitable connector in the base, e.g. a USB connector.
The base preferably includes electronics such as having permanent storage for storing the portable application and the network configuration parameters, memory, a processing engine (e.g. CPU, FPGA), a wireless transmitter/receiver such as for WiFi, a plug and play interface such as a USB interface, a LED ring as visual indicator. The portable application can be stored on the peripheral device, i.e. in the base. The visual indicator is for allowing user feedback from the connection unit of the status of any activity.
In the above embodiments, once the connection is made between the connection device and a host computer, the peripheral device goes into connected mode. This means that there is at least one channel from the peripheral device to the base node. In accordance with any of the embodiments of the present invention a plurality of channels can be set up between the connection device and the base node. These channels may be logical channels.
Some examples for such a multichannel arrangement may include the first and one or more of the additional channels:
In the above embodiments, a particular method of pairing the peripheral device with the base node has been described. Any of the embodiments of the present invention may include other pairing mechanisms of which some examples are given below.
This application is a continuation application claiming benefit to U.S. patent application Ser. No. 14/278,442 filed May 15, 2014, which is a continuation application claiming the benefit of U.S. patent application Ser. No. 13/270,659, filed Oct. 11, 2011, which claims the benefit of U.S. provisional application No. 61/534,592 filed Sep. 14, 2011 the entirety of said applications being incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6966035 | Suess et al. | Nov 2005 | B1 |
| 8316138 | Chang | Nov 2012 | B2 |
| 8346753 | Hayes | Jan 2013 | B2 |
| 20020174254 | Kita et al. | Nov 2002 | A1 |
| 20020196378 | Slobodin et al. | Dec 2002 | A1 |
| 20040125777 | Doyle et al. | Jul 2004 | A1 |
| 20040128354 | Horikiri et al. | Jul 2004 | A1 |
| 20040263636 | Cutler et al. | Dec 2004 | A1 |
| 20050015719 | Marchon et al. | Jan 2005 | A1 |
| 20050036509 | Acharya et al. | Feb 2005 | A1 |
| 20050122392 | Johansen | Jun 2005 | A1 |
| 20060031779 | Theurer et al. | Feb 2006 | A1 |
| 20060095376 | Mitchell et al. | May 2006 | A1 |
| 20070005809 | Kobayashi et al. | Jan 2007 | A1 |
| 20070033289 | Nuyttens et al. | Feb 2007 | A1 |
| 20070065078 | Jiang | Mar 2007 | A1 |
| 20070109410 | Siew | May 2007 | A1 |
| 20070244970 | Watanabe et al. | Oct 2007 | A1 |
| 20090046139 | Cutler et al. | Feb 2009 | A1 |
| 20090064302 | Colella | Mar 2009 | A1 |
| 20090092198 | Motoyoshi et al. | Apr 2009 | A1 |
| 20090189981 | Sian | Jul 2009 | A1 |
| 20090198839 | Banerjee et al. | Aug 2009 | A1 |
| 20090235170 | Golden et al. | Sep 2009 | A1 |
| 20090247006 | Thompson | Oct 2009 | A1 |
| 20090300520 | Ashutosh | Dec 2009 | A1 |
| 20100064063 | Deforche et al. | Mar 2010 | A1 |
| 20100066806 | Lyu | Mar 2010 | A1 |
| 20100087139 | Glass | Apr 2010 | A1 |
| 20100302130 | Kikuchi et al. | Dec 2010 | A1 |
| 20100302454 | Epstein et al. | Dec 2010 | A1 |
| 20100332663 | Chang | Dec 2010 | A1 |
| 20110023096 | Xiao et al. | Jan 2011 | A1 |
| 20110078716 | MacWan | Mar 2011 | A1 |
| 20110092198 | Miyata | Apr 2011 | A1 |
| 20110115689 | Sugiyama et al. | May 2011 | A1 |
| 20110150433 | Alexandrov et al. | Jun 2011 | A1 |
| 20110179182 | Vadla Ravnas | Jul 2011 | A1 |
| 20110180380 | Lee | Jul 2011 | A1 |
| 20110188391 | Sella | Aug 2011 | A1 |
| 20120054372 | Chen et al. | Mar 2012 | A1 |
| 20120331509 | Laksono | Dec 2012 | A1 |
| 20130050254 | Tran et al. | Feb 2013 | A1 |
| 20130054348 | Holsman et al. | Feb 2013 | A1 |
| 20130060662 | Carlson et al. | Mar 2013 | A1 |
| 20130067121 | Beel et al. | May 2013 | A1 |
| 20140082227 | Beel et al. | Mar 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 1476242 | Feb 2004 | CN |
| 1499841 | May 2004 | CN |
| 1550996 | Dec 2004 | CN |
| 1689275 | Oct 2005 | CN |
| 1788494 | Jun 2006 | CN |
| 101022529 | Aug 2007 | CN |
| 101106469 | Jan 2008 | CN |
| 101106681 | Jan 2008 | CN |
| 101442500 | May 2009 | CN |
| 101828392 | Sep 2010 | CN |
| 101965609 | Feb 2011 | CN |
| 101631223 | Apr 2011 | CN |
| 102023852 | Apr 2011 | CN |
| 102045864 | May 2011 | CN |
| 101454762 | Jun 2013 | CN |
| 1187480 | Mar 2002 | EP |
| 1246395 | Oct 2002 | EP |
| 1329055 | Jul 2003 | EP |
| 1385336 | Jan 2004 | EP |
| 2107463 | Oct 2009 | EP |
| 2756668 | Jul 2014 | EP |
| 2000242257 | Sep 2000 | JP |
| 2008-090561 | Apr 2008 | JP |
| 2008165007 | Jul 2008 | JP |
| 2008271265 | Nov 2008 | JP |
| 0052887 | Sep 2000 | WO |
| 2001089156 | Nov 2001 | WO |
| 2007137415 | Dec 2007 | WO |
| 2010105335 | Sep 2010 | WO |
| 2013037979 | Mar 2013 | WO |
| Entry |
|---|
| U.S. Office Action dated Oct. 20, 2017, for U.S. Appl. No. 14//344,836. |
| European Notice of Opposition dated Sep. 27, 2017 for EP 2756668. |
| StarTech.com: USB to DVI External Dual Monitor Video Adapter/USS to VGA External Dual Monitor Video Adapter, User Manual dated May 19, 2011. |
| Microsoft Community, conversation on Aug. 30, 2011 about USB2VGA Adapter, retrieved on Sep. 7, 2017. |
| Webopedia Definition of Peripheral Device, retrieved on Sep. 7, 2017. |
| Trulink Wireless USB2VGA Adapter, Quick Start Guide, retrieved from www.c2g.com. |
| HWebPage on Availability of Trulink, retrieved on Sep. 7, 2017. |
| Chinese Office Action dated Oct. 31, 2017, for CN 201280001542.X, and English translation thereof. |
| International Search Report in PCT/EP2012/068166, dated Mar. 6, 2013. |
| International Search Report in PCT/EP2012/068167, dated Mar. 19, 2013. |
| International Search Report in PCT/EP2012/068168, dated Mar. 4, 2013, |
| International Search Report in PCT/EP2012/068169, dated Jan. 28, 2013. |
| Search Report in GB1206841.7, dated Aug. 28, 2012. |
| Proc. 3rd International Conference on Ubiquitious Intelligence and Computing, Sep. 2006, pp. 688-697, Wenbing Jiang, et al.; “Free Speech: a novel wireless approach for conference projecting and cooperating”. |
| Examination Report of German Patent and Trademark Office regarding related German Patent Application 10 2011 055 443.2, May 30, 2012. |
| Martin Trautschold, iPhone 4 Made Simple, 2010, Apress, pp. 1-819. |
| European Office Communication dated Jun. 15, 2015, for EP 12762258.7. |
| European Office Communication dated Dec. 21, 2015, for EP 12762258.7. |
| U.S. Office Action dated Mar. 29, 2016, for U.S. Appl. No. 14/395,364. |
| Marc Al-Hames et al., Audio-Visual Processing in Meetings: Seven Questions and Current AMI Answers, 2006. |
| Mood indicators on electronic meeting tools IBM, IP.com No. IPCOMOOOO1171D, Publication Date: Mar. 12, 2003. |
| European Office Action dated Aug. 1, 2016, for EP 12762258.7. |
| European Extended Search Report dated Nov. 3, 2016, for EP 16170760.9. |
| Chinese Office Action dated Oct. 14, 2016, for CN 201280055744.2. |
| Chinese Office Action dated Oct. 10, 2016, for CN 201280055667.0. |
| Dffice Action in corresponding U.S. Appl. No. 14/344,830 dated Oct. 6, 2016. |
| Final Office Action in corresponding U.S. Appl. No. 14/395,364 dated Nov. 2, 2016. |
| Chinese Office Action dated Nov. 4, 2016, for CN 201280001542.X, and English translation thereof. |
| Chinese Office Action dated Dec. 27, 2016, for CN 201280074077.2, and English translation thereof. |
| Final Office Action in corresponding U.S. Appl. No. 14/725,401 dated Jan. 26, 2017. |
| European Office Communication (Intention to Grant) dated Nov. 23, 2016, for EP 12762258.7. |
| Chinese Office Action dated Apr. 5, 2017, for CN 201280055744.2, and English translation thereof. |
| Chinese Office Action dated Sep. 26, 2017, for CN 201280055744.2, and English translation thereof. |
| U.S. Office Action dated May 3, 2017, for U.S. Appl. No. 14/344,836. |
| U.S. Office Action dated Sep. 28, 2017, for U.S. Appl. No. 14/344,830. |
| U.S. Office Action dated Sep. 28, 2017, for U.S. Appl. No. 14/278,442. |
| “Quick Connect Wireless with Epson Projectors”, retrieved from https://www.youtube.com/watch?v=9POz4-HyDXY, Nov. 3, 2009. |
| “Remote Framebuffer Protocol (RFB)”, Internet standard IETF RFC 6143 , Mar. 2011. |
| Richardson & Wood, “The RFB Protocol”, Cambridge: ORL, 1998. |
| “Manual of the Epson projectors”, retrieved from http://esupport.epsoneurope.com/ViewArticle.aspx?Ing=sv-SE&kbid=328038&data=bOU002FRIffu7YFtMOBp2mpSKntPq1A26Wyw&cl=1, Feb. 14, 2011. |
| Chinese Office Action dated Jun. 28, 2017, for CN 201280074077.2, and English translation thereof. |
| Chinese Office Action dated Jul. 4, 2017, for CN 201280055667.0, and English translation thereof. |
| Chinese Office Action dated Jul. 21, 2017, for CN 20128001542.X, and English translation thereof. |
| European Search Report dated Aug. 1, 2017, for EP 16207123. |
| SIPO Office Action in corresponding app. CN 201280001542.X dated Jul. 30, 2018. |
| EPO Office Action in corresponding app. EP 12759440.6-1204 dated Aug. 9, 2018. |
| EPO Office Action in corresponding app. EP 12775162.6-1204 dated Aug. 9, 2018. |
| Office Action in corresponding U.S. Appl. No. 14/725,401 dated Sep. 10, 2018. |
| Office Action in corresponding U.S. Appl. No. 90/014,087 dated Sep. 4, 2018. |
| Chinese Office Action in related Chinese Application No. 201280055744.2, dated Mar. 30, 2018. |
| U.S. Office Action in related U.S. Appl. No. 14/344,836, dated Feb. 28, 2018. |
| Chinese Office Action in Chinese Application No. 201280074077.2, dated Jan. 4, 2018. |
| Intervention according to Art 105 EPC in corresponding European Patent 2756668, dated May 3, 2018. |
| Request for Reexamination of U.S. Pat. No. 8,756,348, dated Feb. 9, 2018. |
| Request for Reexamination of U.S. Pat. No. 9,083,769, dated Feb. 9, 2018. |
| Final Office Action in related U.S. Appl. No. 14/278,442, dated Jun. 8, 2018. |
| SIPO Office Action in corresponding app. CN 201280074077.2 dated Aug. 23, 2018. |
| http://esupport.epson-europe.com/ViewArticle.aspx?Ing=sv-SE&kbid=328038&data=bOU002FRIftu7YFtMOBp2mpSKntPq1A26Wyw&c1=1, accessed Jul. 8, 2017. |
| https://www.infocus.com/resources/documents/User-Guides/Liteshow-3-UserGuide.pdf, accessed Oct. 3, 2018. |
| Non-Final Office Action in corresponding U.S. Reexamination No. 90/014,088, dated Sep. 25, 2018. |
| Final Office Action in corresponding U.S. Reexamination No. 90/014,087, dated Jan. 22, 2019. |
| Chinese Office Action in related Chinese Application No. 201280001542.X, dated Jan. 2, 2019. |
| U.S. Office Action in corresponding U.S. Appl. No. 16/034,846, dated Oct. 7, 2019. |
| Chinese Office Action in corresponding Chinese Application No. 201280074077.2, dated Sep. 30, 2019. |
| European Office Action in corresponding European Application No. 16170760.9-1216, dated Apr. 2, 2019. |
| Chinese Office Action in corresponding Chinese Application No. 201280074077.2, dated Mar. 5, 2019. |
| U.S. Office Action in corresponding U.S. Appl. No. 14/278,442, dated Sep. 18, 2019. |
| European Office Action in corresponding European Application No. 12775162.6-1204, dated May 21, 2019. |
| European Office Action in corresponding European Application No. 12759440.6-1204, dated May 28, 2019. |
| Notice on Reexamination in corresponding Chinese Application No. 201280001542.X, dated Jun. 11, 2019. |
| Office Action in related U.S. Appl. No. 14/725,401 dated Dec. 31, 2019. |
| Summons to attend oral proceedings in corresponding EP 12762258.7 dated Dec. 12, 2019. |
| Number | Date | Country | |
|---|---|---|---|
| 20170177511 A1 | Jun 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| 61534592 | Sep 2011 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14278442 | May 2014 | US |
| Child | 15449048 | US | |
| Parent | 13270659 | Oct 2011 | US |
| Child | 14278442 | US |
