Researchers study brain waves associated with digital icons
Jodi Heckel, Illinois News Bureau
September 5, 2018

 

 

The brain processes ironic emojis in the same way as ironic language, indicating emojis convey meaning in a sentence, according to research by Benjamin Weissman, a U of I graduate student in linguistics (left), and Darren Tanner, until recently a U of I linguistics professor (right).
(Images courtesy of Benjamin Weissman and Darren Tanner.)
The brain processes ironic emojis in the same way as ironic language, indicating emojis convey meaning in a sentence, according to research by Benjamin Weissman, a U of I graduate student in linguistics (left), and Darren Tanner, until recently a U of I linguistics professor (right). (Images courtesy of Benjamin Weissman and Darren Tanner.)

That winky-face emoji that you use at the end of a text isn’t just a fun picture added to your sentence. It can convey linguistic meaning that changes the interpretation of the sentence, a new study finds.

University of Illinois researchers studied the brain wave patterns of people reading sentences paired with emojis. Sometimes the emojis matched the literal meaning of the sentence, but in other cases they were construed as indicating irony. Researchers found the participants’ brains processed the ironic emojis in the same way they process ironic language.

The results of the research by Benjamin Weissman, a U of I doctoral student in linguistics, and Darren Tanner, until recently a U of I linguistics professor, appear in the journal PLOS ONE.

“Emojis are ubiquitous. They are seemingly everywhere, and people use them a lot in text messages and online along with language,” Weissman said. “But nobody in linguistics or psychology had looked at them using the experimental methods we have at our disposal, like looking at the electrical activity generated by the brain in real time. Looking at brain activity to understand how we process language is pretty common. But people hadn’t studied emojis paired with language like this.”

The researchers looked at brain-wave patterns associated with language processing, including a pattern called the P600, a kind of “error signal” that occurs when a person encounters something linguistically unexpected. The signal indicates the brain is reprocessing or reanalyzing the content of the sentence.

This signal was traditionally associated with grammatical errors, Tanner said, but previous studies have shown verbal irony also triggers this type of brain wave. Weissman and Tanner hypothesized, if emojis can convey linguistic meaning in the same way as words, they would see similar brain-wave patterns with people reading sentences that include an ironic emoji.

“Irony or sarcasm is a really conventionalized use of emojis,” Tanner said. “People have trouble understanding what some emojis mean, even in context. The exception is with sarcasm or irony. The winky-face emoji conveys a certain meaning that people understand.”

In three experiments, a total of 106 participants in the study read sentences followed by an emoji – either a smile, frown or wink – while their brain waves were recorded. The participants then answered comprehension questions about how they ultimately interpreted the meaning of the sentences. The questions probed whether the participants had interpreted the sentence literally, based on only the words, or whether the wink emoji had changed their interpretation to a nonliteral (ironic) reading of the sentence.

 

Researchers asked participants in an experiment to read sentences followed by an emoji (either a smile, frown or wink) and answer questions about how they interpreted the meaning of the sentences. (Image courtesy Benjamin Weissman and Darren Tanner.)
Researchers asked participants in an experiment to read sentences followed by an emoji (either a smile, frown or wink) and answer questions about how they interpreted the meaning of the sentences. (Image courtesy Benjamin Weissman and Darren Tanner.)

When comparing the brain responses elicited by the ironic (wink) emojis with the nonironic emojis (smile or frown), Weissman and Tanner found the brain-wave patterns elicited by the ironic emojis looked just like those seen in previous studies with ironic verbal language. More interestingly, they said, the size of each participant’s brain response to the ironic emojis reflected how willing that participant was to let the wink emoji override the literal meaning of the sentence. This indicates that this brain response pattern is a reflection of the “work” that the readers’ brains are doing to reinterpret the sentence in light of the wink emoji, just like when a person reinterprets the meaning of a sentence when someone is being sarcastic.

Weissman and Tanner said their research shows words combined with emojis can be considered another form a multimodal communication, similar to words plus gestures or words plus facial expressions.

“Spoken and signed languages evolved long before humans developed written representations of language, and spoken and signed languages have ways of enhancing or changing meaning through mechanisms like intonation or gesture,” Weissman said. “Written language largely strips those extra modes for conveying meaning away, but emojis seem to be an important recent development that adds some of these mechanisms back into written forms of language. Emojis can convey irony or sarcasm in a written format in the same way we might use intonation to convey the same thing when speaking.

“I wouldn’t go so far as saying emojis are words, but they can be used linguistically,” he said. “And what this study shows is that for things like sarcasm, our brains can use information from emojis almost immediately, and in the same way as language.”

“This helps broaden our view of communication. It can be words, or words plus pictures, or words plus gesture, and it can be words plus emojis,” Tanner said. “You can’t just use a string of emojis, but when you pair emojis with words, they can enhance each other. The combined effect of written words plus emojis is bigger than words or emojis alone.”

Read article: Illini Success report: 90% of LAS alums find a first destination soon after graduation
Illini Success report: 90% of LAS alums find a first destination soon after graduation
An annual survey of recent graduates reports that 90% of LAS alumni who graduated during the 2023-2024 period secured their first destination within six months of graduating.  That figure includes 41% who found employment and 48% who sought further education. About 1% went into volunteer or...
Read article: LAS announces teaching and advising award winners
LAS announces teaching and advising award winners
The College of LAS has selected 16 professors, graduate students, lecturers, and advisors as the recipients of the 2025 teaching and advising rewards. "We are honored and fortunate to have so many amazing teachers and advisors in the College of LAS,” said Venetria K. Patton, the Harry E. Preble...
Read article: New professors arrive at the U of I
New professors arrive at the U of I
More than 50 new tenure-track faculty members arrived in the College of LAS this fall, in departments from history to political science, statistics, Asian American studies, biochemistry, sociology, and many more. Some come with faculty experience from other universities and institutions, and others...