Invented by Cameron James Pickett, Patrick Andrew Larson, Russell William Andrews, Meta Platforms Inc

The market for adding augmented messages to electronic communication threads is rapidly growing as technology continues to advance. Augmented messages refer to the integration of additional information or features into electronic communication platforms, enhancing the user experience and adding value to conversations. Electronic communication has become an integral part of our daily lives, with platforms such as email, messaging apps, and social media connecting people from all corners of the world. However, traditional text-based communication can sometimes lack the personal touch and context that face-to-face conversations provide. This is where augmented messages come in, bridging the gap between virtual and real-life interactions. One of the key benefits of augmented messages is the ability to convey emotions and tone more effectively. In text-based communication, it can be challenging to accurately interpret the intended meaning behind a message. Augmented messages allow users to add emojis, gifs, or even voice recordings to better express their emotions, ensuring that the recipient understands the intended sentiment. Furthermore, augmented messages can provide additional context to conversations. For example, users can attach location tags, images, or videos to their messages, allowing others to better understand the context of the discussion. This can be particularly useful in professional settings, where visual aids or location information can enhance collaboration and decision-making. The market for adding augmented messages is not limited to personal communication. Many businesses are recognizing the potential of augmented messages to improve customer engagement and support. For instance, customer service representatives can utilize augmented messages to provide step-by-step instructions, visual demonstrations, or even personalized videos to assist customers with their queries. This not only enhances the customer experience but also saves time and resources for businesses. Moreover, augmented messages can also be utilized for marketing purposes. Companies can incorporate interactive elements, such as clickable links, surveys, or product showcases, into their messages to engage customers and drive conversions. This innovative approach to marketing allows businesses to stand out from the competition and create more meaningful connections with their target audience. As the demand for augmented messages continues to grow, technology companies are investing in research and development to create more advanced and user-friendly platforms. Artificial intelligence and machine learning algorithms are being employed to improve the accuracy of emotion recognition and provide personalized suggestions for augmented messages. Additionally, advancements in virtual and augmented reality technologies are expected to further enhance the capabilities of augmented messages, allowing users to create immersive and interactive communication experiences. In conclusion, the market for adding augmented messages to electronic communication threads is expanding rapidly, driven by the need for more expressive and contextual conversations. Augmented messages provide users with the ability to convey emotions, add context, and enhance collaboration in both personal and professional settings. Businesses are also leveraging augmented messages to improve customer engagement and support, as well as for innovative marketing strategies. With ongoing technological advancements, the future of augmented messages looks promising, promising a more immersive and interactive communication experience for users worldwide.

The Meta Platforms Inc invention works as follows

The present disclosure relates to systems and methods that provide message elements in electronic communication threads. “Systems and methods described in this document identify message elements within electronic communication threads, and add interactions between those message elements to electronic communication threads.

Background for Adding augmented messages to electronic communication threads

1. “1.

One or more embodiments relate to electronic communications in general. One or more embodiments relate to the intelligent enhancement of message elements in electronic communication.

2. “2.

Computing devices (computers, tablets and smart phones, for example) offer a variety of ways to communicate and connect with each other. A computing device, for example, can run an electronic communication app that offers various ways to send and receive messages electronically. In most electronic communication applications, a user can communicate with another user via instant messaging, text messages, social networks posts, or other electronic communication methods. A communication can also include different types of content such as images, videos, text and/or data. Electronic communication is a popular method of connecting and communicating with others.

Due to the many ways people can communicate with electronic communication, and the convenience and mobility offered by electronic devices, users often receive and send a large volume of electronic messages every day. Many electronic communication programs allow users to add emoticons, stickers and images in order to increase efficiency when sending or receiving electronic messages. As a form of communication, you can include emoticons and stickers in an electronic message. Emoticons, stickers, images, etc. Emoticons, stickers, images, etc. can be a quick way to communicate because they require less input from the user (e.g. less typing), compared to a conventional message that conveys the same thought as the emoticon. Include emoticons, stickers and images in your electronic communication. In an electronic message, a user can reduce the number of words or sentences they need to type.

Emoticons have become popular because they enable users to express feelings and emotions which are difficult to do with text. Users can have a better electronic conversation by using emoticons, stickers and other similar tools. “Emoticons, stickers and other similar tools can allow users to communicate in a way that is easier in a face-to-face conversation but more difficult with text alone.

The use or stickers and emoticons can improve the efficiency of electronic messaging. There are a few disadvantages to using emoticons, stickers and other similar items. The use of stickers, emoticons and other similar tools does not allow the interaction and interplay that are commonplace in face-toface conversations. A first user cannot tell if and how an emoticon has been received by a second person after sending it. The first user does not always know if the second person received the emoticon or if they saw it.

Furthermore the message elements that are typically used in electronic communication are not robust. A typical emoticon, for example, is a static picture that an electronic communication app merely adds to the communication thread between users. In some cases, an emoticon can be animated in a rudimentary manner. Even an animated emoticon generally consists of a few frames that are repetitive and do not interact. In general, the existing methods for using symbols in electronic communication do not add any additional layer of expression or interactivity to electronic communications.

There are several disadvantages of the current methods used to use symbols in electronic communication.

One or more embodiments of the present invention provide benefits or solve one or several of the above or other problems with systems and method for providing augmented messages elements in electronic communication. In one or more embodiments, systems and methods are described for detecting message elements that match in a communication. The systems and methods, upon detecting corresponding messages, can display an interaction between them, replace the corresponding elements with an alternate message element, provide an enhanced message element within the communication thread, etc. In one embodiment, for example, the systems described herein are able to identify a message submitted by a user within a communication thread as well as the corresponding message submitted by another user. The systems and methods can then display an interaction between both message elements in the communication thread. The systems and methods described provide an interactive and robust communication feature, which adds a new layer of expression to electronic communications.

Additional advantages and features of the present disclosure are described in the following description. In part, these will be apparent from the description or can be acquired by practicing such exemplary embodiments. These features and benefits can be obtained and realized by using the instruments and combinations specifically mentioned in the appended claim. The following description and the appended claims will make these and other features more apparent. Or, they can be learned through the practice of the exemplary embodiments that are described hereafter.

One or more embodiments of the invention described herein includes an electronic communication system which utilizes message components. In one or more embodiments, the electronic communication system identifies a pair or more of corresponding messages sent by participants within a communications thread. The electronic communication system replaces or modifies corresponding message elements by an enhanced message element.

In one or more embodiments the electronic communication system may search a thread of communication for one or multiple message elements. When the electronic communications system identifies the first message sent by a communication participant, it can search for the second message sent by a different participant. The electronic communication system may replace corresponding messages in a thread of communication with an enhanced message element. The augmented message element, in at least one embodiment can display an interactivity between the identified corresponding messages elements that the electronic communications system has replaced.

The electronic communications system can associate pairs of message elements or a multitude to create corresponding messages elements. The electronic communication system is able to associate message elements that are related. The electronic communication system, for example, can associate two thumbs up stickers. The electronic communication system may then associate additional or alternative messages with each set of message elements. Referring to the previous example again, the electronic messaging can be associated with a bump animation for the two thumbs up stickers. When a second user responds to a thumbs up sticker sent by the first user with a thumbs up sticker, the electronic messaging system can replace the thumbs up stickers with the bump animation. The electronic communication system allows users to add a new layer of communication and expression to electronic communications.

The electronic communication system may replace corresponding messages elements in a thread of communication in response to a trigger or several triggers. In one embodiment, the electronic communications system may replace the corresponding messages with an enhanced message element when it determines the message elements have been sent within a certain time period. The electronic communication system can also replace the corresponding messages elements with an enhanced message element if it determines that the message elements have been sent consecutively, or within a predetermined time period. In yet other embodiments, the user can input information that triggers replacement of corresponding messages elements.

As used in this document, a message element is an electronic element. Refers to any element of an electronic communication which expresses the user’s message, mood, tone, temperament or thought. In some embodiments, the message element does not contain conventional text. A message element, for example, can include one or more stickers or symbols, icons or emoticons, illustrations or images, animations or sounds, video clips or audio clips, or other content which can be sent electronically. A message element can include a symbol, for example. A single message element can include an animation or sound in another instance. A message element can also be written in conventional language, even if it is not conventional text. For example, an instant messaging may include the message “Have a great day!” ? ). A communication electronic can also consist of only a single message (e.g. an instant message could contain the following message: ?). In a single electronic message, different message elements can be used. In one or more embodiments a message element may consist of conventional text.

Message elements” can include both user-generated and system-generated message elements. As an example, users can download messages element files (e.g. “sticker packs”) periodically. A client-computing system (e.g. a mobile, tablet, laptop etc.) can be used to download message element files containing different messages elements. In one embodiment, for example, a file containing a number of messages elements (e.g. images, animations, or illustrations) can be used. A user can also create a message component such as an image or audio file, an illustration, a text, etc.

Each message or type of element can include an identification. The electronic communication system may associate groups or pairs of identifiers to an identifier for one or more alternative or augmented message elements. This association allows the electronic communication system replace the corresponding message element with the augmented message element or alternative message element.

In response, a system of electronic communication can use metadata associated with both the first and second message elements within a communication thread to identify a new message element. The electronic communication system then replaces the first and second message elements associated with the communication thread by the third message element identified. “In one or more embodiments, the third element of the message is an animated interaction between the illustrations of the first message elements and the second.

In one or several embodiments, from the perspective of the user, the electronic communications system displays a seemingly-invisible display that shows both the message elements from the first and second users interacting. The interaction between message elements is a powerful and elegant way to express what was previously just images being sent back and forth. “The electronic communication system facilitates the creation and distribution of one message element file to users for electronic communications.

As used in this document, “an ‘electronic communications'” refers to an electronic message sent from a user to one or more co-users. Refers to an electronic communication sent by a user to a co-user or users. A “social networking system post” A’social networking system post’ is an electronic communication that is sent by one user to one co-user or more via a social network. In one embodiment, the post of a social network system is an electronic message from a user, which the system posts on a newsfeed. A social networking system post can be an electronic communication from a user that the social networking system adds to a newsfeed (i.e.,?wall?) associated with each friend of the users. A social networking post is an electronic communication that a user sends and the social network system adds to newsfeeds associated with certain groups or communities of social networking users.

Click here to view the patent on Google Patents.