In various embodiments, the present invention relates to systems, methods, and apparatus for drawing chemical structures. More specifically, described herein are exemplary systems, methods, and apparatus for creating and editing representations of chemical structures using a touch and gesture based drawing tool.
Chemical structure rendering software is widely used by research and educational institutions to depict chemical structures and chemical reactions of interest. Unlike chemical formulas or chemical names, structural formulas provide a graphical representation of the molecular structure. A graphical chemical structure representation is capable of indicating the arrangements of atoms in a way that a chemical formula cannot.
Current methods for drawing and editing chemical structures on a computer utilize mouse-driven or touch pad commands that include pointing and clicking on displayed menu items in a graphical user interface. Existing chemical structure rendering ‘apps’ for tablet computers and other portable computing devices (e.g., portable phones) utilize the same menu-driven paradigm. In general, these approaches are manually intensive and non-intuitive.
There is a need for more efficient and intuitive user interfaces for drawing and editing chemical structures on a touch screen or touch pad of an electronic device. A particular need exists for electronic systems and devices that receive intuitive gesture input from a user's fingers on a touch screen or touch pad and utilize the input to create and edit chemical structure representations.
Described herein are various embodiments of systems, methods, and apparatus that allow a user to more intuitively draw and edit a chemical structure using one or more fingers on an input interface, such as a touch pad or touch screen. In various embodiments, the systems, methods, and apparatus utilize or include a tablet computer, a mobile phone device, or any other computer device or system capable of receiving input from a user's fingers. The systems, methods, and apparatus have applications in a wide variety of industries that create and edit structural formulas, such as the reagent industry, the publishing industry, and/or the web search industry. By incorporating intuitive, easy to perform gestures, the systems, methods, and apparatus described herein provide an efficient and accurate tool for drawing and editing chemical structures.
In general, in one aspect, embodiments of the invention feature an apparatus for creating a graphical representation of a chemical structure. A user may utilize the apparatus to assign an atom label to the chemical structure representation by performing a press and tap gesture. The apparatus includes: a touch pad or touch screen configured to receive input from a user; (b) a memory for storing a code defining a set of instructions; and (c) a processor for executing the set of instructions. The code includes a chemical structure drawing module configured to: (i) provide a representation of a chemical structure on a graphical display; (ii) receive a first signal corresponding to a user press gesture delivered upon the touch pad or touch screen at a location corresponding to a selected atom position in the chemical structure representation; (iii) receive a second signal corresponding to a user tap gesture delivered upon the touch pad or touch screen; (iv) upon receiving the second signal, provide a contextual menu that includes a plurality of atom labels on the graphical display; (v) receive a third signal corresponding to a user selection of one of the atom labels; and (vi) in the graphical display, update the chemical structure representation to include the selected atom label at the selected atom position in the chemical structure representation.
In certain embodiments, the apparatus includes a touch screen and the touch screen includes the graphical display. In preferred embodiments, the contextual menu actively excludes atom labels that would result in a chemically impossible structure if included at the selected atom position in the chemical structure representation. A location of the user tap gesture delivered upon the touch pad or touch screen is preferably near the location on the touch pad or touch screen corresponding to the selected atom position in the chemical structure representation.
In another aspect, embodiments of the invention feature an article of manufacture having computer-readable program portions embodied thereon for creating a graphical representation of a chemical structure. A user may use the article to assign an atom label to the chemical structure representation by performing a press and tap gesture. The article includes computer-readable instructions for: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a first signal corresponding to a user press gesture delivered upon a touch pad or touch screen at a location corresponding to a selected atom position in the chemical structure representation; (iii) receiving a second signal corresponding to a user tap gesture delivered upon the touch pad or touch screen; (iv) upon receiving the second signal, providing a contextual menu that includes a plurality of atom labels on the graphical display; (v) receiving a third signal corresponding to a user selection of one of the atom labels; and (vi) in the graphical display, updating the chemical structure representation to include the selected atom label at the selected atom position in the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, embodiments of the invention feature a computer-implemented method of creating a graphical representation of a chemical structure. A user may use the method to assign an atom label to the chemical structure representation by performing a press and tap gesture. The computer-implemented method includes the steps of: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a first signal corresponding to a user press gesture delivered upon a touch pad or touch screen at a location corresponding to a selected atom position in the chemical structure representation; (iii) receiving a second signal corresponding to a user tap gesture delivered upon the touch pad or touch screen; (iv) upon receiving the second signal, providing a contextual menu that includes a plurality of atom labels on the graphical display; (v) receiving a third signal corresponding to a user selection of one of the atom labels; and (vi) in the graphical display, updating the chemical structure representation to include the selected atom label at the selected atom position in the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, the invention relates to an apparatus for creating a graphical representation of a chemical structure. A user may utilize the apparatus to change a chemical bond characteristic within the chemical structure representation by performing a tap gesture. The apparatus includes: (a) a touch pad or touch screen configured to receive input from a user; (b) a memory for storing a code defining a set of instructions; and (c) a processor for executing the set of instructions. The code includes a chemical structure drawing module configured to: (i) provide a representation of a chemical structure on a graphical display; (ii) receive a first signal corresponding to a first user tap gesture delivered upon the touch pad or touch screen at a location corresponding to a selected chemical bond position in the chemical structure representation; and (iii) upon receiving the first signal, updating a representation of a chemical bond at the selected chemical bond position of the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In certain embodiments, the chemical structure drawing module is configured to toggle through a contextual selection of bond order representations at the selected chemical bond position upon receiving signals corresponding to repeated user tap gestures. In one embodiment, the contextual selection of bond order representations actively excludes bond orders that would result in a chemically impossible structure if included at the selected chemical bond position in the chemical structure representation. The chemical structure drawing module is preferably further configured to, upon receiving a second signal corresponding to a second user tap gesture delivered upon the touch pad or touch screen at a location corresponding to a selected chemical bond position in the chemical structure representation, update a representation of stereochemistry at the selected chemical bond position. In some embodiments, the chemical structure drawing module is configured to toggle through a contextual selection of stereochemistry representations at the selected chemical bond position upon receiving signals corresponding to repeated user tap gestures. The chemical structure drawing module is preferably configured to distinguish between the first user tap gesture and the second user tap gesture, wherein one gesture is provided by one finger, and the other is provided by two or more fingers.
In another aspect, embodiments of the invention feature an article of manufacture having computer-readable program portions embodied thereon for creating a graphical representation of a chemical structure. A user may utilize the article to change a chemical bond characteristic within the chemical structure representation by performing a tap gesture. The article includes computer-readable instructions for: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a first signal corresponding to a first user tap gesture delivered upon a touch pad or touch screen at a location corresponding to a selected chemical bond position in the chemical structure representation; and (iii) upon receiving the first signal, updating a representation of a chemical bond at the selected chemical bond position of the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, the invention relates to a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to change a chemical bond characteristic within the chemical structure representation by performing a tap gesture. The computer-implemented method includes the steps of: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a first signal corresponding to a first user tap gesture delivered upon a touch pad or touch screen at a location corresponding to a selected chemical bond position in the chemical structure representation; and (iii) upon receiving the first signal, updating a representation of a chemical bond at the selected chemical bond position of the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, embodiments of the invention feature an apparatus for creating a graphical representation of a chemical structure. A user may utilize the apparatus to lengthen a molecular chain of the chemical structure representation by performing a drag gesture. The apparatus includes (a) a touch pad or touch screen configured to receive input from a user; (b) a memory for storing a code defining a set of instructions; and (c) a processor for executing the set of instructions. The code includes a chemical structure drawing module configured to: (i) provide a representation of a chemical structure on a graphical display; (ii) receive a signal corresponding to a user drag gesture delivered upon the touch pad or touch screen at a location corresponding to a selected atom position in the chemical structure representation, wherein the user drag gesture includes a drag length; and (iii) upon receiving the signal, update the chemical structure representation by extending a molecular chain from the selected atom position, wherein length of the extended molecular chain corresponds to the drag length. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, embodiments of the invention feature an article of manufacture having computer-readable program portions embodied thereon for creating a graphical representation of a chemical structure. A user may utilize the article to lengthen a molecular chain of the chemical structure representation by performing a drag gesture. The article includes computer-readable instructions for: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a signal corresponding to a user drag gesture delivered upon a touch pad or touch screen at a location corresponding to a selected atom position in the chemical structure representation, wherein the user drag gesture includes a drag length; and (iii) upon receiving the signal, updating the chemical structure representation by extending a molecular chain from the selected atom position, wherein length of the extended molecular chain corresponds to the drag length. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, the invention relates to a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to lengthen a molecular chain of the chemical structure representation by performing a drag gesture. The computer-implemented method includes the steps of: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a signal corresponding to a user drag gesture delivered upon a touch pad or touch screen at a location corresponding to a selected atom position in the chemical structure representation, wherein the user drag gesture includes a drag length; and (iii) upon receiving the signal, updating the chemical structure representation by extending a molecular chain from the selected atom position, wherein length of the extended molecular chain corresponds to the drag length. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, embodiments of the invention feature an apparatus for creating a graphical representation of a chemical structure. A user may utilize the apparatus to rotate the chemical structure representation by performing a rotation gesture. The apparatus includes: (a) a touch pad or touch screen configured to receive input from a user; (b) a memory for storing a code defining a set of instructions; and (c) a processor for executing the set of instructions. The code includes a chemical structure drawing module configured to (i) provide a representation of a chemical structure on a graphical display, and (ii) receive a signal corresponding to at least one of a first, second, and third user rotation gesture delivered upon the touch pad or touch screen at or near a location corresponding to the chemical structure representation. The first user rotation gesture includes a two-handed spin when the user contacts the touch pad or touch screen with a first finger of a first hand and a second finger of a second hand and translates the first finger and the second finger in a common rotational direction around a point between the first and second fingers on the touch pad or touch screen. The second user rotation gesture includes an anchored spin when the user contacts the touch pad or touch screen with a first finger at a location corresponding to an atom position in the chemical structure representation, contacts the touch pad or touch screen with a second finger, and translates the second finger on the touch pad or touch screen in an arc around the location corresponding to a selected atom position in the chemical structure representation. The third user rotation gesture includes a two-fingered rotation when the user contacts the touch pad or touch screen with two figures at a location corresponding to the chemical structure and drags the two fingers along the touch pad or touch screen in an arc. The chemical structure drawing module is also configured to, (iii) upon receiving the signal, update a rotational position of the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In certain embodiments, the chemical structure drawing module is configured to update the rotational position of the chemical structure representation in response to the first user rotation gesture by rotating the chemical structure about a point corresponding to the point between the first and second fingers on the touch pad or touch screen. In one embodiment, the chemical structure drawing module is configured to update the rotational position of the chemical structure representation in response to the second user rotation gesture by rotating the chemical structure about the selected atom position. In some embodiments, the chemical structure drawing module is configured to update the rotational position of the chemical structure representation in response to the third user rotation gesture by rotating the chemical structure about a substantially central point of the chemical structure.
In another aspect, embodiments of the invention relate to an article of manufacture having computer-readable program portions embodied thereon for creating a graphical representation of a chemical structure. A user may utilize the article to rotate the chemical structure representation by performing a rotation gesture. The article includes computer-readable instructions for (i) providing a representation of a chemical structure on a graphical display, and (ii) receiving a signal corresponding to at least one of a first, second, and third user rotation gesture delivered upon a touch pad or touch screen at or near a location corresponding to the chemical structure representation. The first user rotation gesture includes a two-handed spin when the user contacts the touch pad or touch screen with a first finger of a first hand and a second finger of a second hand and translates the first finger and the second finger in a common rotational direction around a point between the first and second fingers on the touch pad or touch screen. The second user rotation gesture includes an anchored spin when the user contacts the touch pad or touch screen with a first finger at a location corresponding to an atom position in the chemical structure representation, contacts the touch pad or touch screen with a second finger, and translates the second finger on the touch pad or touch screen in an arc around the location corresponding to a selected atom position in the chemical structure representation. The third user rotation gesture includes a two-fingered rotation when the user contacts the touch pad or touch screen with two figures at a location corresponding to the chemical structure and drags the two fingers along the touch pad or touch screen in an arc. The article also includes computer-readable instructions for, (iii) upon receiving the signal, updating a rotational position of the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, the invention relates to a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to rotate the chemical structure representation by performing a rotation gesture. The computer-implemented method includes the steps of (i) providing a representation of a chemical structure on a graphical display, and (ii) receiving a signal corresponding to at least one of a first, second, and third user rotation gesture delivered upon a touch pad or touch screen at or near a location corresponding to the chemical structure representation. The first user rotation gesture includes a two-handed spin when the user contacts the touch pad or touch screen with a first finger of a first hand and a second finger of a second hand and translates the first finger and the second finger in a common rotational direction around a point between the first and second fingers on the touch pad or touch screen. The second user rotation gesture includes an anchored spin when the user contacts the touch pad or touch screen with a first finger at a location corresponding to an atom position in the chemical structure representation, contacts the touch pad or touch screen with a second finger, and translates the second finger on the touch pad or touch screen in an arc around the location corresponding to a selected atom position in the chemical structure representation. The third user rotation gesture includes a two-fingered rotation when the user contacts the touch pad or touch screen with two figures at a location corresponding to the chemical structure and drags the two fingers along the touch pad or touch screen in an arc. The method also includes the step of, (iii) upon receiving the signal, updating a rotational position of the chemical structure representation. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In another aspect, embodiments of the invention relate to a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to edit a chemical structure representation by performing a pinch-zoom gesture. The computer-implemented method includes the steps of: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a first signal corresponding to a user multi-finger gesture delivered upon a touch pad or touch screen at a location corresponding to the chemical structure representation; and, (iii) upon receiving the first signal, (A) providing a working view of the chemical structure representation on the graphical display, wherein the working view is scaled such that individual atoms and/or bonds within the chemical structure representation are independently accessible to fingertips of the user, and (B) providing a full view of the chemical structure representation in a corner of the graphical display. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In certain embodiments, the method includes the steps of: (iv) receiving a second signal corresponding to a user tap gesture delivered upon the touch pad or touch screen at a location in the working view corresponding to an atom or bond in the chemical structure representation; and (v) after receiving the second signal, updating the chemical structure representation at the location according to a selection from a menu on the graphical display, wherein the menu includes representations of chemical structure elements. In some embodiments, the chemical structure representation in the working view is at least partially transparent. The multi-finger gesture may include a pinch-to-zoom gesture. In one embodiment, the working view is active and the full view is inactive. A map may be superimposed on the full view indicating boundaries of the chemical structure representation currently viewable in the working view.
In another aspect, embodiments of the invention feature a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to join two chemical structure representations together by performing a pinch gesture. The computer-implemented method includes the steps of: (i) providing a representation of a first chemical structure and a representation of a second chemical structure on a graphical display; (ii) receiving a signal corresponding to a user pinch gesture delivered upon a touch pad or touch screen; and (iii) upon receiving the signal, joining the representation of the first chemical structure and the representation of the second chemical structure at or in the vicinity of the first and second structure elements to produce a representation of a third chemical structure. The pinch gesture originates at a first location and a second location. The first location corresponds to a first structure element on the representation of the first chemical structure, and the second location corresponds to a second structure element on the representation of the second chemical structure. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In certain embodiments, the first and second structure elements include an atom and/or a bond. In one embodiment, the method includes joining the representation of the first chemical structure and the representation of the second chemical structure according to a set of chemical structure rules.
In another aspect, embodiments of the invention feature a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to join two chemical structure representations together by performing a fling gesture. The computer-implemented method includes the steps of: (i) providing a representation of a chemical structure on a graphical display; (ii) providing a menu on the graphical display, wherein the menu includes representations of chemical structure elements; (iii) receiving a first signal corresponding to a user tap gesture delivered upon a touch pad or touch screen at a first location corresponding to a target on the chemical structure representation; (iv) receiving a second signal corresponding to a user fling gesture delivered upon the touch pad or touch screen, wherein the fling gesture originates at a second location corresponding to a representation of a chemical structure element in the menu and proceeds in a direction towards the first location; and (v) upon receiving the first and second signals, joining the representation of the chemical structure element with the chemical structure representation at the target to create a representation of a new chemical structure. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In certain embodiments, the method includes joining the representation of the chemical structure element with the chemical structure representation according to a set of chemical structure rules. In various embodiments, the joining step includes animating the representation of the chemical structure element from the second location to the first location on the graphical display, in response to the fling gesture. The tap gesture may include a tap and hold gesture.
In another aspect, the invention relates to a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to rotate the chemical structure representation by performing a flick gesture. The computer-implemented method includes the steps of: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a first signal corresponding to a user tap gesture delivered upon a touch pad or touch screen at a first location corresponding to the chemical structure representation; (iii) receiving a second signal corresponding to a user flick gesture delivered upon the touch pad or touch screen, wherein the flick gesture originates at a second location and proceeds in a flick direction, wherein the flick direction is substantially orthogonal to a line between the first location and the second location; and (iv) upon receiving the first and second signals, rotating the chemical structure representation in the flick direction about an axis of rotation, wherein the axis rotation is perpendicular to the graphical display and passes through the first location. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
In certain embodiments, a velocity of rotation of the chemical structure representation corresponds to a velocity of the flick gesture. In one embodiment, the rotating step includes reducing a velocity of rotation of the chemical structure representation following the flick gesture.
In another aspect, embodiments of the invention feature a computer-implemented method of creating a graphical representation of a chemical structure. A user may utilize the method to create an electronic document for a chemical structure representation by performing a drag gesture. The computer-implemented method includes the steps of: (i) providing a representation of a chemical structure on a graphical display; (ii) receiving a first signal corresponding to a user drag gesture delivered upon a touch pad or touch screen at a location corresponding to empty space around the chemical structure representation; (iii) upon receiving the first signal, (A) translating the representation of the chemical structure in a direction corresponding to the drag gesture, and (B) providing an indication on the graphical display that release of the drag gesture will create a new electronic document for a chemical structure representation; (iv) receiving a second signal corresponding to release of the drag gesture delivered upon the touch pad or the touch screen; and (v) upon receiving the second signal, creating the new electronic document. In certain embodiments, the new electronic document includes the representation of the chemical structure. The description of elements of the embodiments above can be applied to this aspect of the invention as well.
Elements of embodiments described with respect to a given aspect of the invention may be used in various embodiments of another aspect of the invention. For example, it is contemplated that features of dependent claims depending from one independent claim can be used in apparatus, articles, systems, and/or methods of any of the other independent claims.
The foregoing and other objects, aspects, features, and advantages of the invention will become more apparent and may be better understood by referring to the following description taken in conjunction with the accompanying drawings, in which:
It is contemplated that apparatus, systems, and methods of the claimed invention encompass variations and adaptations developed using information from the embodiments described herein. Adaptation and/or modification of the apparatus, systems, and methods described herein may be performed by those of ordinary skill in the relevant art.
Throughout the description, where apparatus and systems are described as having, including, or comprising specific components, or where processes and methods are described as having, including, or comprising specific steps, it is contemplated that, additionally, there are apparatus and systems of the present invention that consist essentially of, or consist of, the recited components, and that there are processes and methods according to the present invention that consist essentially of, or consist of, the recited processing steps.
It should be understood that the order of steps or order for performing certain actions is immaterial so long as the invention remains operable. Moreover, two or more steps or actions may be conducted simultaneously.
In general, in various embodiments, the present invention pertains to apparatus, systems, and methods for drawing chemical structures (e.g., a skeletal formula) on a computer having an input interface that interacts with the human hand. The computer may be, for example, a personal computer, a workstation, a tablet computer (e.g., an IPAD®), or a mobile phone device. In certain embodiments, the input interface is a touch screen or a touch pad (e.g., a mouse pad). For example, the user may interact directly with a touch screen to edit or create chemical structure representations that are displayed on the touch screen. Alternatively, the user may interact with a touch pad to edit or create chemical structure representations that are displayed on a separate graphical display (e.g., a computer monitor).
In certain embodiments, the user edits or creates chemical structure representations by performing a multi-touch gesture on the input interface. The multi-touch gesture may be as simple as contacting the input interface with one or two fingers to trace out a particular molecular structure or bond pattern, or as intricate as contacting the input interface with all the fingers of both hands in a complex sequence of movements, reminiscent of American Sign Language. In one embodiment, each motion of hands and fingers, whether complex or not, conveys a specific molecular editing sequence or action that is acted upon by the computer apparatus or system at the behest of the scientist.
In various embodiments, a user of the apparatus or system performs a gesture (e.g., a multi-touch gesture) by contacting the input interface with one or more fingertips. Alternatively, the user may perform the gesture by contacting the input interface with one or more other body parts (e.g., a knuckle or a hand), or with a device or object that is grasped or otherwise held by the user. For example, the user may perform the gesture using a hand-held stylus. Throughout this description, where a gesture is described as being performed with a user's fingers, it is contemplated that the gesture may be performed with the user's fingertips, knuckles, or other body part(s), and/or with a separate device or object manipulated by the user.
In certain embodiments, a user performs a tap gesture by contacting the input interface with a fingertip and bouncing or quickly removing the fingertip from the input interface. By contrast, in certain embodiments, a user performs a tap and hold gesture by contacting the input interface at a location with a fingertip and maintaining contact between the fingertip and the location for a desired period of time.
In various embodiments, the apparatus, systems, and methods utilize a set of rules for determining whether structural formulas requested by the user are chemically valid. In one embodiment, the rules are used to prevent the user from creating invalid structural formulas. For example, if the user attempts to add a triple bond to a chemical structure representation and the triple bond is not feasible, the user may be prevented from adding the triple bond. Likewise, if the user attempts to introduce a stereo chemical bond assignment that is not chemically valid, the user may be prevented from introducing the stereo chemical bond assignment. Similar rules may be used to prevent the user from adding structural elements, such as bonds or atoms, to a chemical structure representation that would result in a chemically invalid structure. In one embodiment, the rules are used to determine one or more “snap-to” positions at locations of feasible attachment of a group or structural element the user is attempting to add to the chemical structure representation.
Referring to
Referring to
In the working view 200, the user may edit the chemical structure representation 106 by selecting an atom or bond location in the chemical structure representation. The atom or bond location may be selected by, for example, delivering a tap gesture upon the input interface at a location corresponding to the atom or bond in the working view. The user may then modify the chemical structure representation 106 at the atom or bond location by selecting a representation of a chemical structure element 206 from a menu 208 on the graphical display. For example, the user may select the chemical structure element 206 by tapping the input interface 100 at a location corresponding to the chemical structure element 206. In one embodiment, selecting the chemical structure element 206 adds the chemical structure element 206 to the chemical structure representation 106 at the atom or bond location.
Referring to
Referring to
In certain embodiments, the user rotates the chemical structure representation within the graphical display (e.g., the working view) by performing one or more rotation gestures on the input interface 100. For example, in the embodiment depicted in
Referring to
Referring to
In the embodiment depicted in
Referring to
Referring to
Referring to
Referring to
In the embodiment depicted in
Referring to
In certain embodiments, the apparatus, systems, and methods described herein include a set of chemical cleaning rules for creating and displaying chemical structure representations. In various embodiments, the chemical cleaning rules perform a structure cleanup that includes, for example, normalizing bond lengths, performing global orientation, standardizing ring exterior angles, iteratively normalizing a ring system, performing ring perception (e.g., to distinguish between ring systems and chain systems), generating chain systems and angles, and/or generating ring systems. Ring system generation may include: (i) identifying an arbitrary seed atom; (ii) calculating angular demand of atoms generally using, for example, 180−(360/R), where R is a radius; and (iii) using angular demand to place neighboring atoms in the ring system. In one embodiment, special cases angles for bridged and fusion systems are applied. These structure cleanup methods may be useful to generate diagrams from SMILES, InChi, chemical names, etc. In various embodiments, an interactive method for performing structure cleanup starts with a user-drawn structure. The user may then apply the interactive method multiple times for progressive refinement.
In various embodiments, the user has complete control over a font selection, a font size, and/or a font styling to be used the chemical structure representations. Fonts may utilize or include templates from industry standard journals and organizations. These templates may include specific font styles, font sizes, bond lengths, and/or bond widths. In one embodiment, an important aspect of font handling is bond-truncation. For example, bonds that join text may be treated specially, glyphs may be converted to bitmaps and analyzed, and bonds may be truncated according to a standard distance from a glyph using a radial search of a bitmap.
In certain embodiments, bonds are drawn as 6-membered polygons. Wedges may be mitered according to a glyph using a bond truncation algorithm.
The network 1908 may be, for example, a local-area network (LAN), such as a company or laboratory Intranet, a metropolitan area network (MAN), or a wide area network (WAN), such as the Internet. Each of the client node 1902, server node 1904, and the database 1906 may be connected to the network 1908 through a variety of connections including, but not limited to, standard telephone lines, LAN or WAN links (e.g., T1, T3, 56 kb, X.25), broadband connections (e.g., ISDN, Frame Relay, ATM), or wireless connections. The connections, moreover, may be established using a variety of communication protocols (e.g., HTTP, TCP/IP, IPX, SPX, NetBIOS, NetBEUI, SMB, Ethernet, ARCNET, Fiber Distributed Data Interface (FDDI), RS232, IEEE 802.11, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, and direct asynchronous connections).
The client node 1902 may be any type of personal computer, Windows-based terminal, network computer, wireless device, information appliance, RISC Power PC, X-device, workstation, mini computer, main frame computer, tablet computer, personal digital assistant, set top box, cellular phone, handheld device, or other computing device that is capable of both presenting information/data to, and receiving commands from, a user of the client node 1902 (e.g., an analytical chemist). The client node 1902 may include, for example, a graphical display device (e.g., a touch screen or a computer monitor), a data entry device (e.g., a keyboard, a touch screen, or a mouse pad), persistent and/or volatile storage (e.g., computer memory), a processor, and a mouse. In one embodiment, the client node 1902 includes a web browser, such as, for example, the INTERNET EXPLORER program developed by Microsoft Corporation of Redmond, Wash., to connect to the World Wide Web.
For its part, the server node 1904 may be any computing device that is capable of receiving information/data from and delivering information/data to the client node 1902, for example over the network 1908, and that is capable of querying, receiving information/data from, and delivering information/data to the server node 1904. For example, as further explained below, the server node 1904 may receive input (e.g., a multi-touch gesture) from a user of the client node 1902, create or edit a chemical structure representation according to the input, and present or display the chemical structure representation to the user at the client node 1902. The server node 1904 may include a processor and persistent and/or volatile storage, such as computer memory.
The server node 1904 may be any computing device that is capable of storing and managing collections of data, such as data relating to chemical structure representations. The chemical structure representations may be, for example, of the type described in co-pending U.S. patent application Ser. No. 13/100,217, filed May 3, 2011, titled “Systems, Methods, and Apparatus for Processing Documents to Identify Structures,” and co-pending U.S. application Ser. No. 13/239,069, filed, Sep. 21, 2011, titled “Systems, Methods, and Apparatus for Facilitating Chemical Analyses,” the disclosures of which are hereby incorporated by reference herein in their entireties.
As used herein, the term “server node” is broadly used to refer to any repository of information. The data stored within the server node 1904 may be harvested from the server node 1904 in any manner. In one embodiment, the harvesting is performed utilizing indexing and structure recognition algorithms, and the harvested data is connected together by examining and correlating the disjointed information that is found.
The drawing module 1910 of the server node 1904 may be implemented as any software program and/or hardware device, for example an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA), that is capable of providing the functionality described herein. It will be understood by one having ordinary skill in the art, however, that the illustrated module 1910, and the organization of the server node 1904, are conceptual, rather than explicit, requirements. For example, it should be understood that the drawing module 1910 may in fact be implemented as multiple modules, such that the functions performed by the single module, as described herein, are in fact performed by the multiple modules.
Although not shown in
It will also be understood by those skilled in the art that
In certain embodiments, the system 1900 allows a user to draw and edit a chemical structure representation using one or more fingers on an input interface, such as a touch pad or touch screen, at the client node 1902. In general, the drawing module 1910 in the server node 1904 is configured to draw or revise the chemical structure representation according to the input from the user, as explained above with respect to
It should also be noted that embodiments of the present invention may be provided as one or more computer-readable programs embodied on or in one or more articles of manufacture. The article of manufacture may be any suitable hardware apparatus, such as, for example, a floppy disk, a hard disk, a CD ROM, a CD-RW, a CD-R, a DVD ROM, a DVD-RW, a DVD-R, a flash memory card, a PROM, a RAM, a ROM, or a magnetic tape. In general, the computer-readable programs may be implemented in any programming language. Some examples of languages that may be used include C, C++, or JAVA. The software programs may be further translated into machine language or virtual machine instructions and stored in a program file in that form. The program file may then be stored on or in one or more of the articles of manufacture.
Certain embodiments of the present invention were described above. It is, however, expressly noted that the present invention is not limited to those embodiments, but rather the intention is that additions and modifications to what was expressly described herein are also included within the scope of the invention. Moreover, it is to be understood that the features of the various embodiments described herein were not mutually exclusive and can exist in various combinations and permutations, even if such combinations or permutations were not made express herein, without departing from the spirit and scope of the invention. In fact, variations, modifications, and other implementations of what was described herein will occur to those of ordinary skill in the art without departing from the spirit and the scope of the invention. As such, the invention is not to be defined only by the preceding illustrative description.
The present application is a continuation of U.S. Ser. No. 15/944,642 filed on Apr. 3, 2018 and entitled “Systems, Methods, and Apparatus for Drawing and Editing Chemical Structures on a User Interface via User Gestures,” which is a divisional of U.S. Ser. No. 13/404,671 filed on Feb. 24, 2012 and entitled “Systems, Methods, and Apparatus for Drawing Chemical Structures Using Touch and Gestures,” which is hereby incorporated by reference as to its entirety.
Number | Name | Date | Kind |
---|---|---|---|
4967372 | Feldman | Oct 1990 | A |
5008831 | Feldman | Apr 1991 | A |
5249137 | Wilson et al. | Sep 1993 | A |
5386507 | Teig et al. | Jan 1995 | A |
5461580 | Facci et al. | Oct 1995 | A |
6017390 | Charych et al. | Jan 2000 | A |
6304869 | Moore et al. | Oct 2001 | B1 |
6434490 | Agrafiotis et al. | Aug 2002 | B1 |
6582233 | Clark | Jun 2003 | B1 |
7043415 | Dunlavey et al. | May 2006 | B1 |
7138997 | Balakrishnan et al. | Nov 2006 | B2 |
7613574 | Verseput | Nov 2009 | B2 |
7663607 | Hotelling et al. | Feb 2010 | B2 |
7705830 | Westerman et al. | Apr 2010 | B2 |
7912689 | Helson | Mar 2011 | B1 |
8296670 | Matthews et al. | Oct 2012 | B2 |
8407578 | Boyer et al. | Mar 2013 | B2 |
8479122 | Hotelling et al. | Jul 2013 | B2 |
20020049548 | Bunin | Apr 2002 | A1 |
20020051999 | Sepetov et al. | May 2002 | A1 |
20020107359 | Hogarth et al. | Aug 2002 | A1 |
20030194687 | Clark | Oct 2003 | A1 |
20030220776 | Phillips | Nov 2003 | A1 |
20040003000 | Smith et al. | Jan 2004 | A1 |
20040024493 | Fagrell et al. | Feb 2004 | A1 |
20040088118 | Jensen et al. | May 2004 | A1 |
20040122641 | Miller et al. | Jun 2004 | A1 |
20040171062 | Hirth et al. | Sep 2004 | A1 |
20050094205 | Lo et al. | May 2005 | A1 |
20050123993 | Brunner et al. | Jun 2005 | A1 |
20050131894 | Vuong | Jun 2005 | A1 |
20050177280 | Almstetter et al. | Aug 2005 | A1 |
20060026521 | Hotelling et al. | Feb 2006 | A1 |
20060040322 | Archetti et al. | Feb 2006 | A1 |
20060061595 | Goede et al. | Mar 2006 | A1 |
20060277201 | Dorsett | Dec 2006 | A1 |
20070177803 | Elias et al. | Aug 2007 | A1 |
20070192747 | Phelan et al. | Aug 2007 | A1 |
20070276636 | Wythoff | Nov 2007 | A1 |
20080036743 | Westerman et al. | Feb 2008 | A1 |
20080136785 | Baudisch et al. | Jun 2008 | A1 |
20080165140 | Christie et al. | Jul 2008 | A1 |
20080213663 | Hu et al. | Sep 2008 | A1 |
20080309632 | Westerman et al. | Dec 2008 | A1 |
20090063427 | Zuta et al. | Mar 2009 | A1 |
20090079700 | Abernathy | Mar 2009 | A1 |
20090273571 | Bowens | Nov 2009 | A1 |
20090278806 | Duarte et al. | Nov 2009 | A1 |
20090288044 | Matthews et al. | Nov 2009 | A1 |
20100060588 | Fong | Mar 2010 | A1 |
20100079369 | Hartmann et al. | Apr 2010 | A1 |
20100103118 | Townsend et al. | Apr 2010 | A1 |
20110041098 | Kajiya et al. | Feb 2011 | A1 |
20110055696 | Dollar et al. | Mar 2011 | A1 |
20110072339 | Boyer et al. | Mar 2011 | A1 |
20110276589 | Smith et al. | Nov 2011 | A1 |
20120078853 | Huang et al. | Mar 2012 | A1 |
20120141032 | Ouyang | Jun 2012 | A1 |
20120154440 | Nicholls et al. | Jun 2012 | A1 |
20120185513 | Samukawa | Jul 2012 | A1 |
20130061163 | Clark | Mar 2013 | A1 |
20140089329 | Kozloski et al. | Mar 2014 | A1 |
20140267240 | Smith | Sep 2014 | A1 |
20140282106 | Smith et al. | Sep 2014 | A1 |
20140337725 | Smith et al. | Nov 2014 | A1 |
20150112604 | Smith | Apr 2015 | A1 |
20150199797 | Palo | Jul 2015 | A1 |
Number | Date | Country |
---|---|---|
2012370485 | Sep 2014 | AU |
2018204023 | Jun 2018 | AU |
2019204427 | Jul 2019 | AU |
2865004 | Nov 2020 | CA |
102165394 | Aug 2011 | CN |
1526471 | Apr 2005 | EP |
2567338 | Mar 2013 | EP |
2817750 | Oct 2020 | EP |
2493830 | Feb 2013 | GB |
2007092842 | Aug 2007 | WO |
2011140148 | Nov 2011 | WO |
2013126077 | Aug 2013 | WO |
Entry |
---|
Bruce Michael Allen University of Denver “New Open Source Software for Building Molecular Dynamics Systems” <https://digitalcommons.du.edu/cgi/viewcontent.cgi?article=1746&context=etd> (Year: 2012). |
IPad Guy “7 Awesome Apps for Molecular Modeling in ChemistryiPad App Finders” <“http://ipad.appfinders.com/awesome-apps-for-chemistry-and-molecular-modeling/”> (Year: 2012). |
Feb. 9, 2021—(CA) Office Action—App. No. 3092122. |
Feb. 1, 2021—(AU) Notice of Acceptance—App. No. 2019204427. |
Villamar, Craig et al: “Touch Gesture Reference Guide”, Apr. 15, 2010, retrieved from the Internet: URL:http://web.archive.org/web/20100601214053/http:l/ www.lukew.com/touch/TouchGestureGuide.pdf [retrieved on Apr. 10, 2012]. |
Hancock, Mark S. et al: “Rotation and Translation Mechanisms for Tabletop Interaction”, Horizontal Interactive Human-Computer Systems, 2006. Tabletop 2006. Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (Tabletop '06), Jan. 5, 2006, Piscataway, NJ, 8 pages. |
Cohe, Aurelie et al: “tBox: A 3D Transformation Widget Designed for Touch-Screens”, Human Factors in Computing Systems, ACM, 2 Penn Plaza, Suite 701 New York NY 10121-0701 USA, May 7, 2011, pp. 3005-3008. |
Oct. 25, 2018—(EP) Examination Report—App 12716771.6. |
Nov. 6, 2018—(AU) Office Action—App 2018204023. |
Dec. 20, 2018—(AU) Office Action—App 2018204023. |
Jun. 6, 2019—(CA) Office Action—App 2,865,004. |
Jun. 19, 2019—(AU) Office Action—AU 2018204023. |
Oct. 8, 2019—(EP) Office Action—App. 12716771.6. |
May 13, 2020—(EP) Notice of Allowance—App No. 12716771.6. |
Jul. 1, 2020—(US) Notice of Allowance—U.S. Appl. No. 15/944,642. |
May 8, 2020—(CA) Notice of Allowance—App No. 2,865,004. |
Jul. 2, 2020—(AU) Eamination Report—App No. 2019204427. |
Carmigniani, J. et al., “Augmented Reality Technologies, Systems and Applications, Multimedia Tools and Applications” 51: pp. 341-377 (2011). |
Clark A. M., Basic Primitives for Molecular Diagram Sketching, Journal of Cheminformatics 2:8 (2010). |
Apr. 9, 2014—(EP) European Search Report—App 13275308.8. |
Aug. 13, 2014—(EP) European Search Report—App 13275308.8. |
Furlon, Rod “Build Your Own Google Glass, Resources Hands On” IEEE Spectrum, IEEE Inc., vol. 50, No. 1, pp. 20-21, Jan. 1, 2013. |
Guidice N.A. et al., “Learning Non-Visual Graphical Information Using a Touch-Based Vibro-Audio Interface” Proceedings of the 14th International ACM Sigaccess Conference on Computers and Accessibility, Assets '12, 103-110, Jan. 1, 2012. |
Aug. 13, 2014—(WO) International Search Report and Written Opinion—App PCT/US2014/016249. |
Aug. 4, 2014—(WO) International Search Report and Written Opinion—App PCT/US2014/035685. |
Li et al., “Personal Experience with Four Kinds of Chemical Structure Drawing Software” Review on ChemDraw, ChemWindow, ISIS/Draw, and ChemSketch, J. Chem. Inf. Comput. Sc. 44:1886-1890 (2004). |
Shine et al., “ChemPad3 a tutorial” May 21, 2008, 10 pages. |
Toennies J.L. et al., “Toward Haptic/Aural Touchscreen Display of Graphical Mathtematics for the Education of Blind Students” WHC, IEEE, 373:378 (2011). |
Australian Patent Application No. 2011248243, APO Examination Report No. 1, dated Nov. 5, 2013, 3 pages. |
Bennett Samsun's AllShare Play pushes pictures from phone to cloud and TV, <http://news.cnet.com/8301-1035_3-57391735-94/samsungs-allshare-play-pushes-pictures-from-phone-to-cloud-and-tv/> [retrieved Oct. 24, 2013], Mar. 6, 2012, 9 pages. |
May 29, 2013—(CN) Office Action—App 201190000597.X. |
Gonzalez-Villanueva et al. “WallShare: A Collaborative Multi-Pointer System for Portable Devices” Nov. 9, 2012 7 pages. |
Oct. 6, 2011—(WO) International Search Report and Written Opinion—App PCT/US2011/035070. |
Jurach, T. “Microsoft Outlook Quick Start Email Guide!” pp. 1-3 (2006). |
Layar “What is Layar” <http://www.layar.com/features/> [retrieved Nov. 14, 2012] 7 pages. |
Lorensen et al., Marching Cubes: A high resolution 3D surface construction algorithm. In: Computer Graphics, vol. 21, Nr 4, Jul. 1987. |
Lucero et al. “Pass-Them-Around: Collaborative User of Mobile Phones for Photo Sharing” CHI 2011—Session: Photo Sharing, May 7-11, 2011, Vancouver, BC, Canada, 10 pages. |
Park et al. Tunable Machine Vision-Based Strategy for Automated Annotation of Chemical Databases, Journal of Chemical Information and Modeling, vol. 49, No. 8, 2009, pp. 1993-2001. |
Pering et al. “Enabling Pervasive Collaboration with Platform Composition” Intel Research Santa Clara, 2009, 18 pages. |
Scheible et al., “MobiToss: A Novel gesture based interface for creating and sharing mobile multimedia art on large public displays” MM'08, Oct. 26-31, 2008 Vancouver British Columbia, Canada, pp. 957-960, 4 pages. |
Tsotsis “Word Lens Translates Words Inside of Images. Yes Really.,” <http://techcrunch.com/2010/12/16/world-lens-translates-words-inside-of-images-yes-really/> [retrieved Nov. 14, 2012] Dec. 16, 2010, 3 pages. |
Weinberg et al., “ZooZBeat: as Gesture-based Mobile Music Studio” NIME 2009, pp. 312-315, 4 pages. |
Algorri et al., “Reconstruction of Chemical Molecules from Images” 2007 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 07) Lyon, France, Aug. 22-26, 2007, in Conjunction with the Biennial Conference of the Societe Francaise de Genie Biologique et Medical (SFGB) Aug. 22, 2007, pp. 4609-4612. |
Casey et al. “Optical Recognition of Chemical Graphics” Document Analysis and Recognition, 1993, Proceedings of the Second International Conference on, Tsukuba Science City, Japan, Oct. 20-22, 1993, Los Alamitos, CA, US IEEE Comput. Soc., Oct. 20, 1993, pp. 627-631. |
Filippov et al. “Optical Structure Recognition Software To Recover Chemical Information: OSRA, An Open Source Solution” Journal of Chemical Information and Modeling, vol. 49, No. 3, Mar. 23, 2009, pp. 740-743. |
Park et al., “Automated extraction of chemical structure information from digital raster images” Chemistry Central Journal, Biomed Central Ltd., vol. 3, No. 1, Feb. 5, 2009, pp. 1-16. |
Valko et al., “CLiDE Pro: The Latest Generation of CLiDE, a Tool for Optical Chemical Structure Recognition” Journal of Chemical Information and Modeling, vol. 49, No. 4, Mar. 19, 2009, pp. 780-787. |
Website: https://itunes.apple.com/nl/app/flick./id644265534?mt=8 (2013). |
Website: http://getflick.io/(2013). |
Mar. 20, 2013—(WO) International Search Report and Written Opinion—App PCT/US2012/026574. |
Kim, et al. “Development of a Gesture-Based Molecular Visualization Tool Based on Virtual Reality for Moleculara Docking” Bull. Korean Chem. Soc. 2004 vol. 25, No. 10, pp. 1571-1574. |
Williams et al., “Mobile apps for chemistry in the wordl of drug discovery” Drug Discovery Today, vol. 16 Nos. 21/22, Nov. 2011, pp. 928-939. |
Williams et al., “Smart Phones, a Powerful Tool in the Chemistry Classroom” Journal of Chemical Education, 2011, pp. 683-686. |
Wobbrock, et al., “User-Defined Gestures for Surface Computing” CHI-Tabletop Gestures, Apr. 7, 2009, pp. 1083-1092. |
“Chem & Bio Draw”, Version 12.0, CambridgeSoft, Inc., 2009. |
“ChemDraw User's Guide”, Version 9.0.1, CambridgeSoft, Inc., Dec. 2004. |
“IDBS Makes Chemical Structure Drawing Mobile”, press release, ID Business Solutions, Ltd., Dec. 9, 2009. |
Logtenberg, “Multi-user interaction with molecular visualizations on a multi-touch table” MSc thesis, Human Media Interaction Group, University of Twente, Aug. 11, 2009. |
Mills, “ChemDraw Ultra 10.0” Journal of American Chemical Society, v. 128, n. 41, pp. 13649-13650, 2006. |
“ChemJuice Grande—Basic Structure Drawing”, printout page of YouTube video posting from IDBS at http://www.youtube com/watch?v=mK0cC5bLzd0, uploaded Oct. 3, 2011, printed May 18, 2015. |
“MolPrime+”, http://molmatinf.com/molprimeplus.html, Molecular Materials Informatics, Inc., Jan. 23, 2011. |
“Mobile Molecular Datasheet”, http://molmatinf.com/mmdsios.html, Molecular Materials Informatics, Inc., Sep. 23, 2011, retrieved by Archive.org as https://web.archive.org/web/20120403140454/http://molmatinf.com/mmdsios.html on Apr. 3, 2012. |
“Introduction to Drawing (iPhone)”, http://molmatinf.com/introdrawios.html, Molecular Materials Informatics, Inc., Dec. 9, 2010, retrieved by Archive.org as https://web.archive.org/web/20120413131358/http://molmatinf.com/introdrawios.html on Apr. 13, 2012. |
“Overview of Drawing Gestures (iPhone)”, http://molmatinf.com/gesturesios.html, Molecular Materials Informatics, Inc., Nov. 3, 2010, retrieved by Archive.org as https://web.archive.org/web/20101118005114/http://molmatinf.com/gesturesios.html on Nov. 18, 2010. |
“Van Der Waals Radius of the elements” retrieved from http://periodictable.com/Properties/A/VanDerWaalsRadius.v.html. May 22, 2008. |
Williams et al. “Mobile apps for chemistry in the world of drug discovery” Drug Discovery Today, lov. 16, No. 21, Nov. 1, 2011, pp. 928-939, XP-28334614, ISSN: 1359-6446, DOI: 10.1016/J.DRUDIS.2011.09.002. |
Jun. 12, 2018—(CA) Office Action—App 2,865,004. |
Number | Date | Country | |
---|---|---|---|
20200402620 A1 | Dec 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13404671 | Feb 2012 | US |
Child | 15944642 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15944642 | Apr 2018 | US |
Child | 17004652 | US |