This application relates generally to electronic devices, including but not limited to methods and systems for guiding sound from a speaker that is at least partially obscured by a display screen.
Electronic devices integrated with microphones have been widely used to collect voice inputs from users and implement different voice-activated functions according to the voice inputs. These electronic devices, when made at a low cost and with relatively simple structures, are disposed at different locations in a smart home environment, so that they can be used as user interface devices to listen to the ambient environment and follow a user constantly without disturbing regular activities of the user. The electronic devices disposed at different locations in a smart home environment could be subject to restricted footprints, especially in areas such as a cluttered kitchen countertop or bedroom nightstand. As such, it would be beneficial to pack a number of mechanical and electronic parts into a small package in order to accommodate a smaller footprint. This, however, can potentially cause unintended consequences such as muffled sound due to the speaker being obscured underneath other components, such as a display screen. Further, it would be beneficial in designing a smaller footprint for the overall design to be substantially vertical. However, the more vertical the design, the greater the potential for falling over during physical user interactions due to a higher center of mass. It would be beneficial to incorporate one or more space saving designs that do not negatively affect sound quality, and further allow for a vertically oriented device to maintain a lower center of mass.
An electronic device is applied in a smart home environment to provide an eyes-free and hands-free voice interface that can activate voice-activated functions for media devices or smart home devices in the smart home environment. The electronic device is configured to sit at a fixed location in the smart home environment, and at least includes a display screen in addition to a microphone and a speaker. The electronic device does not include a complicated operating system, but provides a low cost user interface solution dedicated to constantly listening to its surroundings, collecting audio inputs, and presenting both audio and video information in response to the audio inputs. Further, in some implementations, the audio inputs are collected from the surroundings to initiate voice-activated functions on other media play devices or smart home devices coupled within the smart home environment.
In one aspect, a display assistant device includes a speaker mounted in a waveguide structure which is at least partially disposed beneath a display screen. The waveguide structure is mounted in an exterior housing which includes speaker grills distributed on a plurality of surfaces of the exterior housing, permitting sound waves from the speaker to be projected outside the exterior housing. A cover structure is disposed on top of the waveguide structure to conceal the waveguide structure and speaker within the exterior housing. The cover structure has a tilted bottom surface configured to be suspended above the waveguide structure and to be separated by a first space. Sound waves projected from an upper portion of the speaker are reflected by the tilted bottom surface and are guided through the first space to exit the device from a speaker grill portion located on a rear side of the exterior housing.
In accordance with various embodiments of this application, the display assistant device has a substantially small footprint that allows the display assistant device to be conveniently disposed at many different locations (e.g., a kitchen, living room and bedroom) in the smart home environment. Despite the substantially small footprint, the speaker has a relatively heavy weight and is configured to pull a center of mass of the display assistant device close to the surface on which the display assistant device sits. A low center of mass allows the display assistant device to maintain stability at time of being touched or hit. In addition, the display assistant device further includes many mechanical features configured to protect the screen of the display assistant from falling apart from the base and being damaged when the display assistant device hits a floor. By these means, this application provides a low-cost, mechanically robust, and voice-activated user interface solution that has visual display capabilities and supports various voice-activated functions.
For a better understanding of the various described implementations, reference should be made to the Description of Implementations below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.
Like reference numerals refer to corresponding parts throughout the several views of the drawings.
While digital revolution has provided many benefits ranging from openly sharing information to a sense of global community, emerging new technology often induces confusion, skepticism and fear among consumers, preventing consumers from benefitting from the technology. Electronic devices are conveniently used as voice interfaces to receive voice inputs from users and initiate voice-activated functions, and thereby offer eyes-free and hands-free solutions to approach both existing and emerging technology. Specifically, the voice inputs received at an electronic device can carry instructions and information even if a user's line of sight is obscured and his hands are full. To enable hands-free and eyes-free experience, the voice-activated electronic device listens to the ambient (i.e., processes audio signals collected from the ambient) constantly or only when triggered. On the other hand, user identities are linked with a user's voice and a language used by the user. To protect the user identities, voice-activated electronic devices are normally used in non-public places that are protected, controlled and intimate spaces (e.g., home and car).
In accordance with some implementations of the invention, a voice-activated electronic device includes a screen configured to provide additional visual information in addition to audio information that can be broadcast via a speaker of the voice-activated electronic device. The voice-activated electronic device, when integrated with its own display screen, constitutes a display assistant device. The display assistant device thereby includes a base and a speaker in addition to the screen. The base is configured for sitting on a surface. The screen has a rear surface and is supported by the base at the rear surface. A bottom edge of the screen is configured to be held above the surface by a predefined height, and the base is substantially hidden behind the screen from a front view of the display assistant device (i.e., the base appears to float in air from the front view). The speaker is concealed inside the base and configured to project sound substantially towards the front view of the display assistant device. The display assistant device has a substantially small footprint, and however, a center of mass of the display assistant device is configured to be close to a surface on which the display assistant device sits, thereby allowing the display assistant device to maintain stability at time of being touched or hit. The display assistant device further includes a plurality of mechanical features configured to protect the screen from falling apart from the base and being damaged when the display assistant device hits a floor. That said, the display assistant device provides a low-cost, mechanically robust, and voice-activated user interface solution that has visual display capabilities and supports various voice-activated functions.
Reference will now be made in detail to implementations, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various described implementations. However, it will be apparent to one of ordinary skill in the art that the various described implementations may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the implementations.
One or more media devices are disposed in the smart home environment 100 to provide media content that is stored at a local content source or streamed from a remote content source (e.g., content host(s) 114). The media devices can be classified to two categories: media output devices 106 that directly output the media content to audience, and cast devices 108 that are networked to stream media content to the media output devices 106. Examples of the media output devices 106 include, but are not limited to television (TV) display devices and music players. Examples of the cast devices 108 include, but are not limited to, set-top boxes (STBs), DVD players and TV boxes. In the example smart home environment 100, the media output devices 106 are disposed in more than one location, and each media output device 106 is coupled to a respective cast device 108 or includes an embedded casting unit. The media output device 106-1 includes a TV display that is hard wired to a DVD player or a set top box 108-1. The media output device 106-2 includes a smart TV device that integrates an embedded casting unit to stream media content for display to its audience. The media output device 106-3 includes a regular TV display that is coupled to a TV box 108-3 (e.g., Google TV or Apple TV products), and such a TV box 108-3 streams media content received from a media content host server 114 and provides an access to the Internet for displaying Internet-based content on the media output device 106-3.
In addition to the media devices 106 and 108, one or more electronic devices 190 are disposed in the smart home environment 100 to collect audio inputs for initiating various media play functions of the media devices. In some implementations, these voice-activated electronic devices 190 (e.g., devices 1901-1, 190-2 and 190-3) are disposed in proximity to a media device, for example, in the same room with the cast devices 108 and the media output devices 106.
Alternatively, in some implementations, a voice-activated electronic device 190-4 is disposed in a room having one or more smart home devices but not any media device. Alternatively, in some implementations, a voice-activated electronic device 190 is disposed in a location having no networked electronic device.
The electronic device 190 includes at least one or more microphones, a speaker, a processor and memory storing at least one program for execution by the processor. The speaker is configured to allow the electronic device 190 to deliver voice messages to a location where the electronic device 190 is located in the smart home environment 100, thereby broadcasting music, reporting a state of audio input processing, having a conversation with or giving instructions to a user of the electronic device 190. As an alternative to the voice messages, visual signals could also be used to provide feedback to the user of the electronic device 190 concerning the state of audio input processing. When the electronic device 190 is a conventional mobile device (e.g., a mobile phone or a tablet computer) or has its own display screen, its display screen is configured to display a notification concerning the state of audio input processing.
In accordance with some implementations, the electronic device 190 is a voice interface device that is network-connected to provide voice recognition functions with the aid of a cloud cast service server 116 and/or a voice/display assistance server 112. For example, the electronic device 190 includes a smart speaker that provides music to a user and allows eyes-free and hands-free access to voice assistant service (e.g., Google Assistant). Optionally, the electronic device 190 is one of a desktop or laptop computer, a tablet and a mobile phone that includes a microphone. Optionally, the electronic device 190 is a simple and low cost voice interface device, e.g., a speaker device and a display assistant device (including a display screen having no touch detection capability).
In some implementations, the voice-activated electronic devices 190 includes a display assistant device (e.g., 190-2 and 190-4) that incorporates a display screen in addition to the microphones, speaker, processor and memory. The display screen is configured to provide visual information in addition to audio information that can be broadcast via the speaker of the voice-activated electronic device 190. When a user is nearby and his or her line of sight is not obscured, the user may review the visual information directly on the display screen of the display assistant device. Optionally, the visual information provides feedback to the user of the electronic device 190 concerning the state of audio input processing. Optionally, the visual information is provided in response to the user's previous voice inputs, and may be related to the audio information broadcast by the speaker. In some implementations, the display screen of the voice-activated electronic devices 190 includes a touch display screen configured to detect touch inputs on its surface. Alternatively, in some implementations, the display screen of the voice-activated electronic devices 190 is not a touch display screen, which is relatively expensive and can compromise the goal of offering the display assistant device 190 as a low cost user interface solution.
When voice inputs from the electronic device 190 are used to control the media output devices 106 via the cast devices 108, the electronic device 190 effectively enables a new level of control of cast-enabled media devices independently of whether the electronic device 190 has its own display. In a specific example, the electronic device 190 includes a casual enjoyment speaker with far-field voice access and functions as a voice interface device for Google Assistant. The electronic device 190 could be disposed in any room in the smart home environment 100. When multiple electronic devices 190 are distributed in multiple rooms, they become audio receivers that are synchronized to provide voice inputs from all these rooms.
Specifically, in some implementations, the electronic device 190 includes a WiFi speaker with a microphone that is connected to a voice-activated personal assistant service (e.g., Google Assistant). A user could issue a media play request via the microphone of electronic device 190, and ask the personal assistant service to play media content on the electronic device 190 itself or on another connected media output device 106. For example, the user could issue a media play request by saying to the WiFi speaker “OK Google, Play cat videos on my Living room TV.” The personal assistant service then fulfils the media play request by playing the requested media content on the requested device using a default or designated media application.
A user could also make a voice request via the microphone of the electronic device 190 concerning the media content that has already been played on a display device. In some implementations, closed captions of the currently displayed media content are initiated or deactivated on the display device by voice when there is no remote control or a second screen device is available to the user. Thus, the user can turn on the closed captions on a display device via an eyes-free and hands-free voice-activated electronic device 190 without involving any other device having a physical user interface, and such a voice-activated electronic device 190 satisfies federal accessibility requirements for users having hearing disability. In some implementations, a user may want to take a current media session with them as they move through the house. This requires the personal assistant service to transfer the current media session from a first cast device to a second cast device that is not directly connected to the first cast device or has no knowledge of the existence of the first cast device. Subsequent to the media content transfer, a second output device 106 coupled to the second cast device 108 continues to play the media content previously a first output device 106 coupled to the first cast device 108 from the exact point within a music track or a video clip where play of the media content was forgone on the first output device 106.
In some implementations, in addition to the media devices (e.g., the output devices 106 and the cast devices 108) and the voice-activated electronic devices 190, smart home devices could also be mounted on, integrated with and/or supported by a wall 154, floor 156 or ceiling 158 of the smart home environment 100 (which is also broadly called as a smart home environment in view of the existence of the smart home devices). The integrated smart home devices include intelligent, multi-sensing, network-connected devices that integrate seamlessly with each other in a smart home network and/or with a central server or a cloud-computing system to provide a variety of useful smart home functions. In some implementations, a smart home device is disposed at the same location of the smart home environment 100 as a cast device 108 and/or an output device 106, and therefore, is located in proximity to or with a known distance with respect to the cast device 108 and the output device 106.
The smart home devices in the smart home environment 100 may include, but are not limited to, one or more intelligent, multi-sensing, network-connected thermostats 122, one or more intelligent, network-connected, multi-sensing hazard detectors 124, one or more intelligent, multi-sensing, network-connected entryway interface devices 126 and 128 (hereinafter referred to as “smart doorbells 126” and “smart door locks 128”), one or more intelligent, multi-sensing, network-connected alarm systems 130, one or more intelligent, multi-sensing, network-connected camera systems 132, and one or more intelligent, multi-sensing, network-connected wall switches 136. In some implementations, the smart home devices in the smart home environment 100 of
The smart home devices in the smart home environment 100 may additionally or alternatively include one or more other occupancy sensors (e.g., touch screens, IR sensors, ambient light sensors and motion detectors). In some implementations, the smart home devices in the smart home environment 100 include radio-frequency identification (RFID) readers (e.g., in each room 152 or a portion thereof) that determine occupancy based on RFID tags located on or embedded in occupants. For example, RFID readers may be integrated into the smart hazard detectors 104.
In some implementations, in addition to containing sensing capabilities, devices 122, 124, 126, 128, 130, 132, 136 and 138 (which are collectively referred to as “the smart home devices” or “the smart home devices 120”) are capable of data communications and information sharing with other smart home devices, a central server or cloud-computing system, and/or other devices (e.g., the client device 104, the cast devices 108 and the voice-activated electronic devices 190) that are network-connected. Similarly, each of the cast devices 108 and the voice-activated electronic devices 190 is also capable of data communications and information sharing with other cast devices 108, voice-activated electronic devices 190, smart home devices, a central server or cloud-computing system 140, and/or other devices (e.g., the client device 104) that are network-connected. Data communications may be carried out using any of a variety of custom or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a, WirelessHART, MiWi, etc.) and/or any of a variety of custom or standard wired protocols (e.g., Ethernet, HomePlug, etc.), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
In some implementations, the cast devices 108, the electronic devices 190 and the smart home devices 120 serve as wireless or wired repeaters. In some implementations, a first one of and the cast devices 108 communicates with a second one of the cast devices 108 and the smart home devices 120 via a wireless router. The cast devices 108, the electronic devices 190 and the smart home devices 120 may further communicate with each other via a connection (e.g., network interface 160) to a network, such as the Internet 110. Through the Internet 110, the cast devices 108, the electronic devices 190 and the smart home devices 120 may communicate with a smart server system 140 (also called a central server system and/or a cloud-computing system herein). Optionally, the smart server system 140 may be associated with a manufacturer, support entity, or service provider associated with the cast devices 108 and the media content displayed to the user.
Accordingly, the smart server system 140 may include a voice/display assistance server 112 that processes audio inputs collected by voice-activated electronic devices 190, one or more content hosts 104 that provide the displayed media content, a cloud cast service server 116 creating a virtual user domain based on distributed device terminals, and a device registry 118 that keeps a record of the distributed device terminals in the virtual user environment. Examples of the distributed device terminals include, but are not limited to the voice-activated electronic devices 190, cast devices 108, media output devices 106 and smart home devices 122-138. In some implementations, these distributed device terminals are linked to a user account (e.g., a Google user account) in the virtual user domain.
In some implementations, the network interface 160 includes a conventional network device (e.g., a router). The smart home environment 100 of
When the voice-activated electronic devices 190 are used as user interface devices applied in a user's daily life, they are placed at different locations in the smart home environment 100, and merge into the smart home environment 100. The locations where the voice-activated electronic devices 190 are placed could be drastically different, so the electronic devices 190 are configured to have small footprints that can fit into different locations. An electronic device 190, when placed at different locations, faces different situations of blunt forces that may hit the electronic device 190 and push it off to the ground. Therefore, the center of mass, an orientation of the screen, an orientation and the base of the voice-activated electronic devices 190 are configured so that the voice-activated electronic devices 190 (particularly, a display assistant device) can sustain a blunt force up to a threshold level without being tipped over. Retention elements are also integrated to prevent edges of a display panel from falling apart from edges of a back cover in the voice-activated electronic device 190.
Referring to
The base 202 acts as a speaker box. A speaker is concealed inside the base and configured to project sound substantially towards the front view of the display assistant device, i.e., through a space of the predefined height h separating the bottom edge 208 of the screen 204 and the surface on which the display assistant device 200 is configured to sit.
The display assistant device 200 has a substantially narrow bezel area surrounding an active display area of the screen 204. In some implementations, the bezel area includes one or more microphone holes 212. One or more microphones are placed behind the microphone holes 212 and configured to collect sound from the environment of the display assistant device 200. In some implements, the display assistant device 200 further includes a sensor opening 220 configured to access an ambient light sensor and/or an RGB color sensor. The ambient light sensor or RGB color sensor is configured to detect a light condition in the smart home environment 100 where the display assistant device 200 sits. In some implementations, the display assistant device 200 is configure to adjust a brightness level of its screen 204 according to the light condition. The ambient light sensor and the RGB color sensor are disposed behind the bezel area and exposed to light via transparent part of the bezel area, e.g., the sensor opening 220.
A bottom surface of the base 202 constitutes a footprint of the display assistant device 202. A length of the bottom surface of the base 202 is smaller than (e.g., 75% or less of) a length of the screen 204, and a width of the bottom surface of the base 202 is significant smaller than (e.g., <40% or less of) a width w of the screen 204. As a result, the footprint of the display assistant device 202 is substantially small, and the display assistant device 202 can therefore fit into different physical settings (e.g., a kitchen, living room, and bedroom) in the smart home environment 100.
In some implementations, the entire speaker 304, or substantially the entire speaker 204, is disposed behind the screen 204. In these implementations, portion 304A describes the area of the speaker 304 that produces sound waves that are directed toward openings in the front surface of the base 202, while portion 304B describes the area of the front of the speaker 304 that produces sound waves that are mostly directed toward the screen 204 and reflected back into the deice 200 as a result.
The display panel 404 is configured to display graphics content. Optionally, the display panel 404 is substantially flat. Optionally, the display pane 404 is curved, and covered by a curved cover glass layer 402. In some implementations, a display panel assembly does not have a cover glass 402 covering the curved display panel 404; rather, the display panel 404 includes a protective layer on its top surface.
Edge areas of a rear surface of the cover glass 402 are covered with paint to define a bezel area surrounding an active display area of the screen 204. In some implementations, the bezel area includes one or more microphone holes 212. One or more microphones are placed behind the microphone holes 212 and configured to collect sound from the ambient of the display assistant device 200. Optionally, the cover glass 402 is coupled to the display panel 404 using an adhesive. The display panel 404 has a rear surface made of thermally and/or electrically conductive material (e.g., a metal plate). When a thermal spreader is attached to a portion of the rear surface of the display panel 404, the thermal spreader redistributes heat evenly across itself and the portion of the rear surface of the display panel 404, thereby avoiding formation of hot spots on the display panel 404.
The middle frame 406 is disposed between the display front (i.e., a combination of the cover glass 402 and the display panel 404) and the back cover 408. The middle frame 406 is mechanically coupled to the display front using an adhesive that is applied adjacent to edges of the display front and middle frame 406. Further, the middle frame 406 is mechanically coupled to the back cover 408 using an adhesive or mechanical structures.
In some implementations, the display assistant device 200 further includes a main logic board 512 mounted on a rear surface of the middle frame 406 (see
During an example assembly process, the display front, the middle frame 406 and the base 202 are provided separately. A speaker assembly 502 is disposed in the housing 430, which is further covered by a base mount plate to form the base 202. The back cover 408 is assembled to the base 202, optionally by fastening top and bottom edges of the first opening of the back cover 408 to an interior rear surface and a front surface of the housing 430, respectively. After the back cover 408 is assembled to the base 202, the middle frame 406 is coupled to the back cover 408 via a plurality of first retention elements on the rear surface of the middle frame 406 and a plurality of second retention elements on a front surface of the back cover 408. The display front is coupled to the middle frame 406 via an adhesive either before or after the middle frame 406 is coupled to the back cover 408 and the base 202.
In some implementations, the base 202 of the display assistant device 200 includes an external housing 430, a waveguide/speaker mount structure 420, and a speaker 304. These components, as well as their physical relationships with the various components of the display 204 described above, are described in more detail with reference to
The speaker 304 is concealed inside the base 202 and has a speaker opening disposed at a front portion of the speaker. The speaker opening has a dimension substantially greater than a predefined height h of the space separating a bottom edge of the screen 204 and a surface on which the display assistant device 200 is configured to sit. The speaker opening faces forward (in
The speaker 304 is configured to project sound waves 520 substantially towards a front view of the display assistant device 200, i.e., project a substantial portion (e.g., in some implementations, 80% or more) of sound generated by the speaker 304 towards the space between the bottom edge of the screen 204 and the surface on which the base 202 sits. A housing 430 of the base 202 includes a plurality of speaker grill portions disposed on one or more of (i) a front surface 202A (see
The speaker assembly 502 is disposed in a lower portion of a base 202 to lower down a center of mass of the entire display assistant device 200. In some implementations, for the purpose of lowering down the center of mass, a speaker assembly having a larger weight is selected over a speaker assembly having a smaller weight when their costs or speaker box volumes are comparable. For example, a speaker has a volume of 120cc, and a Neodymium based speaker is selected over a Ferrite based speaker because of its weight advantage. Given its center of mass, weight and angles (a and (3), the display assistant device 200 does not tip over (forward or backward) easily when a blunt force F hits a top edge of the display assistant device 200 or a user touch occurs to the screen 204 of the display assistant device 200. For example, the center of weight is configured so that the display assistant device 200 can sustain an impact force of 50 Newton without tipping over. In some implementations, airflow associated with sound generated by the speaker 304 (e.g., sound that is guided along the sound propagation paths C and D shown in
As explained above, the upper extent of the front surface 202A of the housing 430 is lower than the upper extent of the rear surface 202B of the housing 430, such that the housing 430 has a tilted opening configured to receive the screen 204. That said, the screen 204 and the base 202 are interconnected to form an interior space. In this interior space, a main logic board 512 is arranged in parallel with a display panel of the screen, and a heat sink 514 comes into contact with the main logic board 512 to absorb heat generated by the main logic board 512. The heat sink 514 is thereby disposed in the upper portion of the base 202. Optionally, the heat sink 514 at least partially sits on the speaker waveguide 420. Optionally, the heat sink 514 is mechanically attached to the main board 512 that is further included in the screen 204. The heat sink 514 is suspended above the speaker waveguide 420 and separated therefrom by a gap, and sound generated by the speaker 304 is partially guided towards the rear surface of the base 202 via the gap in accordance with a sound propagation path C.
Referring to
Referring to
Referring to
In some implementations, two shoulders 505 of the speaker waveguide 730 have different shapes, e.g., have a hyperbolic shape and a parabolic shape, respectively. In some implementations, spaces are created to eliminate air disturbance associated with the sound that exits the base 202 via a front side of the housing 430 and thereby reduce noise in the sound broadcasted from the speaker 304.
Also, upon assembly of the cover structure 408′ to the housing 430 and waveguide 420 assembly, two spaces separate the frame and the heat sink from the waveguide structure 420. These spaces are depicted as paths C and D in
In some implementations, the housing 430 includes a plurality of crush ribs 660 (
The frame 406, or alternatively the display panel 404 or any other mechanical component of the screen 204, includes a logic board 512 (described in more detail above). In some implementations, the heat sink 514 comes in contact, or is disposed in close proximity to, the logic board 512, thereby absorbing heat generated from the logic board. In some implementations, the heat sink is hollow. Alternatively, the heat sink is filled with a plastic insert. For example, the heat sink is metal and is filled with an insert. Optionally, the insert is made of plastic or silicone. The heat sink creates an acoustic effect in which acoustic harmonics (e.g., standing waves) are suppressed. Additionally, when sound waves are generated by the front portion of the speaker, the sound waves are guided through the space(s) surrounding the heat sink 514 (
The terminology used in the description of the various described implementations herein is for the purpose of describing particular implementations only and is not intended to be limiting. As used in the description of the various described implementations and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, the term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting” or “in accordance with a determination that,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event]” or “in accordance with a determination that [a stated condition or event] is detected,” depending on the context.
It is to be appreciated that “smart home environments” may refer to smart environments for homes such as a single-family house, but the scope of the present teachings is not so limited. The present teachings are also applicable, without limitation, to duplexes, townhomes, multi-unit apartment buildings, hotels, retail stores, office buildings, industrial buildings, and more generally any living space or work space.
Although various drawings illustrate a number of logical stages in a particular order, stages that are not order dependent may be reordered and other stages may be combined or broken out. While some reordering or other groupings are specifically mentioned, others will be obvious to those of ordinary skill in the art, so the ordering and groupings presented herein are not an exhaustive list of alternatives. Moreover, it should be recognized that the stages can be implemented in hardware, firmware, software or any combination thereof.
The above description, for purpose of explanation, has been described with reference to specific implementations. However, the illustrative discussions above are not intended to be exhaustive or to limit the scope of the claims to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The implementations were chosen in order to best explain the principles underlying the claims and their practical applications, to thereby enable others skilled in the art to best use the implementations with various modifications as are suited to the particular uses contemplated.
This this application is a continuation of U.S. patent application Ser. No. 17/196,060, filed Mar. 9, 2021, issued as U.S. Pat. No. 11,481,005, titled “Speaker Assembly in a Display Assistant Device”, which is a continuation of U.S. patent application Ser. No. 16/597,745, filed Oct. 9, 2019, issued as U.S. Pat. No. 10,996,717, titled “Speaker Assembly in a Display Assistant Device”, which is a continuation-in-part of U.S. patent application Ser. No. 16/596,711, filed Oct. 8, 2019, issued as U.S. Pat. No. 11,209,873, titled “Drop Protection for Display Assistant Device”, and is a continuation-in-part of U.S. patent application Ser. No. 16/596,709, filed Oct. 8, 2019, issued as U.S. Pat. No. 11,604,493,titled “Display Assistant Device”, and is a continuation of International Application No. PCT/US2018/064536, filed Dec. 7, 2018, titled “Speaker Assembly in a Display Assistant Device,” which claims priority to U.S. Provisional Patent Application No. 62/743,464, filed Oct. 9, 2018, titled “Speaker Assembly in a Display Assistant Device”, U.S. Provisional Patent Application No. 62/742,892, filed Oct. 8, 2018, titled “Display Assistant Device”, and U.S. Provisional Patent Application No. 62/742,888, filed Oct. 8, 2018, titled “Drop Protection for Display Assistant Device”, U.S. patent application Ser. No. 16/596,711, is a continuation of International Application No. PCT/US2018/064452, filed Dec. 7, 2018, titled “Drop Protection for Display Assistant Device”, which claims priority to U.S. Provisional Patent Application No. 62/742,892, U.S. Provisional Patent Application No. 62/742,888, and U.S. Provisional Patent Application No. 62/743,464. U.S. patent application Ser. No. 16/596,709, is a continuation of International Application No. PCT/US2018/064449, filed Dec. 7, 2018, titled “Display Assistant Device”, which claims priority to U.S. Provisional Patent Application No. 62/742,892, U.S. Provisional Patent Application No. 62/742,888, and U.S. Provisional Patent Application No. 62/743,464 and is a continuation-in-part of U.S. Design Patent Application No. 29/663,725, filed Sep. 18, 2018, issued as U.S. Pat. No. D935,456, titled “Display Device”, and is a continuation-in-part of U.S. Design Patent Application No. 29/663,723, filed Sep. 18, 2018, issued as U.S. Pat. No. D934,244, titled “Display Device”. The entire disclosures of all of the aforementioned applications are hereby incorporated by reference, for all purposes, as if fully set forth herein. This application is related to the following applications, each of which is incorporated by reference in its entirety: International Application No. PCT/US2018/064449, filed Dec. 7, 2018, titled “Display Assistant Device”; which claims priority from U.S. Design Application No. 29/663,725, filed Sep. 18, 2018, and U.S. Design Application No. 29/663,723, filed Sep. 18, 2018;International Application No. PCT/US2018/064452, filed Dec. 7, 2018, titled “Drop Protection for Display Assistant Device”;U.S. patent application Ser. No. 16/525,360, filed Jul. 29, 2019, titled “Display Assistant Device,” which claims priority to and is a continuation application of International Application No. PCT/US2019/28601, filed Apr. 23, 2019, titled “Display Assistant Device”; andInternational Application No. PCT/US2019/28959, filed Apr. 24, 2019, titled “Multipurpose Speaker Enclosure in a Display Assistant Device,” which is herein incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5729430 | Johnson | Mar 1998 | A |
5822443 | Kim | Oct 1998 | A |
6032918 | Cho | Mar 2000 | A |
6411271 | Bang-Soon | Jun 2002 | B1 |
6437238 | Annerino et al. | Aug 2002 | B1 |
7296653 | Smith, Jr. | Nov 2007 | B1 |
7388744 | Chu | Feb 2008 | B2 |
D563405 | Taniho et al. | Mar 2008 | S |
7576983 | Yamaguchi et al. | Aug 2009 | B2 |
7953242 | Soga | May 2011 | B2 |
8528690 | Wu | Sep 2013 | B1 |
9064386 | Won et al. | Jun 2015 | B2 |
9641920 | Jones | May 2017 | B1 |
D789362 | Elijas | Jun 2017 | S |
D811383 | Diasabeygunawardena | Feb 2018 | S |
9930286 | Hamadate | Mar 2018 | B2 |
10306356 | Katz et al. | May 2019 | B2 |
10484770 | Rao et al. | Nov 2019 | B1 |
D873815 | McWilliam et al. | Jan 2020 | S |
10996717 | Castro et al. | May 2021 | B2 |
11209873 | Castro et al. | Dec 2021 | B2 |
11310577 | Je et al. | Apr 2022 | B2 |
11481005 | Castro et al. | Oct 2022 | B2 |
20030202162 | Arai | Oct 2003 | A1 |
20050129263 | Tamura et al. | Jun 2005 | A1 |
20050233781 | Erixon et al. | Oct 2005 | A1 |
20060008103 | Takahashi et al. | Jan 2006 | A1 |
20060039571 | Harris | Feb 2006 | A1 |
20060070280 | Yamamura et al. | Apr 2006 | A1 |
20070097608 | Matsutani | May 2007 | A1 |
20070206123 | Hsieh | Sep 2007 | A1 |
20080165485 | Zadesky et al. | Jul 2008 | A1 |
20100146766 | Dabov et al. | Jun 2010 | A1 |
20100205667 | Anderson et al. | Aug 2010 | A1 |
20100212996 | Takashima | Aug 2010 | A1 |
20100272307 | Okumura | Oct 2010 | A1 |
20130058023 | Supran et al. | Mar 2013 | A1 |
20130070172 | Ooe | Mar 2013 | A1 |
20130077812 | Kishinami et al. | Mar 2013 | A1 |
20130082984 | Drzaic et al. | Apr 2013 | A1 |
20130098854 | Lee et al. | Apr 2013 | A1 |
20130235420 | Nihashi et al. | Sep 2013 | A1 |
20130279730 | Tanaka | Oct 2013 | A1 |
20130282499 | Kato | Oct 2013 | A1 |
20140112512 | Su et al. | Apr 2014 | A1 |
20140247959 | Yamanaka | Sep 2014 | A1 |
20140268578 | Dolci et al. | Sep 2014 | A1 |
20140376758 | Barcel et al. | Dec 2014 | A1 |
20150049894 | Ditullo et al. | Feb 2015 | A1 |
20150053497 | Horiuchi | Feb 2015 | A1 |
20150185768 | Voege et al. | Jul 2015 | A1 |
20150195635 | Garfio et al. | Jul 2015 | A1 |
20150278499 | Levitov | Oct 2015 | A1 |
20150326816 | Hamadate | Nov 2015 | A1 |
20150373440 | Fontana | Dec 2015 | A1 |
20160037665 | Zhang et al. | Feb 2016 | A1 |
20160139702 | Franklin et al. | May 2016 | A1 |
20170006715 | Choi et al. | Jan 2017 | A1 |
20170208364 | Glazier et al. | Jul 2017 | A1 |
20170258191 | Poon et al. | Sep 2017 | A1 |
20170278361 | Fujimoto | Sep 2017 | A1 |
20170300893 | Sasaki et al. | Oct 2017 | A1 |
20180174584 | Chih et al. | Jun 2018 | A1 |
20180190285 | Heckman et al. | Jul 2018 | A1 |
20180199123 | Rao et al. | Jul 2018 | A1 |
20190029103 | MacDonald et al. | Jan 2019 | A1 |
20190114880 | Hanes | Apr 2019 | A1 |
20190181533 | Gummalla et al. | Jun 2019 | A1 |
20190212274 | Patterson et al. | Jul 2019 | A1 |
20200090662 | Castro et al. | Mar 2020 | A1 |
20200110441 | Castro et al. | Apr 2020 | A1 |
20200112786 | Castro et al. | Apr 2020 | A1 |
20210011518 | Zin et al. | Jan 2021 | A1 |
20210191456 | Castro et al. | Jun 2021 | A1 |
Number | Date | Country |
---|---|---|
107454513 | Dec 2017 | CN |
0303912 | Feb 1989 | EP |
3122022 | Jan 2017 | EP |
2001169378 | Jun 2001 | JP |
2007259262 | Apr 2007 | JP |
2008211381 | Sep 2008 | JP |
2009038446 | Feb 2009 | JP |
2009267577 | Nov 2009 | JP |
4808168 | Nov 2011 | JP |
2014131243 | Jul 2014 | JP |
2014131243 | Jul 2014 | JP |
2015053540 | Mar 2015 | JP |
2018121168 | Aug 2018 | JP |
201131335 | Sep 2011 | TW |
2006104101 | Oct 2006 | WO |
WO-2006104101 | Oct 2006 | WO |
2016198559 | Dec 2016 | WO |
2018139462 | Aug 2018 | WO |
Entry |
---|
Emmanuelle Bureau Du Colombier: “Archos Hello, Activates AI, Displays and Manages Anything, Anywhere at home, just by Asking”, Aug. 28, 2018, pp. 1-6, XP055585517, http://www.archos.com/corporate/press/press_releases/EN_20180828_ARCHOS_IFA_Next_2018_ARCHOS_Hello.pdf, Aug. 28, 2018, 6 pages. |
I-Home Technology Co, Ltd.: “Lynky: Touchscreen Smart hub with Google Assistant,” Feb. 24, 2018, pp. 1-13, XP055585514, Retrieved from the Internet: URL: https://www.indiegogo.com/projects/lynky-touchscreen-smart-hub-with-google-assistant [retrieved on May 3, 2019]. |
“We took apart the Google Home Hub and the Amazon Echo Show 2 | Cracking Open,” https://www.youtube.com/watch?v=9vo7PtXIzCk, Jan. 27, 2019, 1 page. |
Awad, “Exclusive Google Home Hub to be Launched on October 9”, Retrieved at: https://web.archive.org/web/20181009015232/https://www.mysmartprice.com/gear/googl-home-hub/, Sep. 18, 2018, 6 pages. |
Burns, “Google Home Hub leaked: The new do-all screen”, Sep. 18, 2018, 7 pages. |
International Search Report and Written Opinion for PCT/US2018/064449 dated Aug. 28, 2019, all pages. |
International Search Report and Written Opinion for PCT/US2018/064452 dated Jun. 24, 2019, all pages. |
International Search Report and Written Opinion for PCT/US2018/064536 dated Jun. 28, 2019, all pages. |
International Search Report and Written Opinion for PCT/US2019/028959 dated Jul. 24, 2019, all pages. |
Number | Date | Country | |
---|---|---|---|
20230122155 A1 | Apr 2023 | US |
Number | Date | Country | |
---|---|---|---|
62743464 | Oct 2018 | US | |
62742892 | Oct 2018 | US | |
62742888 | Oct 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 17196060 | Mar 2021 | US |
Child | 17948995 | US | |
Parent | 16597745 | Oct 2019 | US |
Child | 17196060 | US | |
Parent | PCT/US2018/064536 | Dec 2018 | US |
Child | 16596709 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16596711 | Oct 2019 | US |
Child | 16597745 | US | |
Parent | 16596709 | Oct 2019 | US |
Child | 16596711 | US |