Findings

Summary & Analysis

Summary

Across two observations involving a student's interactions with ChatGPT, the student and the AI system functioned as both sender and receiver. The student initiated requests, evaluated the generated responses, and provided feedback, while ChatGPT generated content and responded to the student's corrections and additional instructions. The observation demonstrated how communication developed through repeated exchanges, with the student returning to ChatGPT for assistance throughout both tasks.

The messages exchanged during the interactions primarily involved requests for assistance, generated outputs, corrections, and revisions. In the first observation, the student consulted ChatGPT to create a Biology reviewer for an exam, while the second interaction involved drafting an email. In both cases, the student communicated specific expectations, identified shortcomings in the generated responses, and requested further modifications to achieve the desired output.

The primary communication channel was text-based interactions through ChatGPT's interface. The student conveyed instructions, concerns, and approval through written messages, while ChatGPT responded with generated text. The tone and wording of these messages also served as indicators of the student's emotional responses to the quality and appropriateness of the generated outputs.

The student actively evaluated ChatGPT'S responses and provided corrections whenever the generated content did not meet the intended requirements. For instance, the student expressed frustration when the Biology reviewer omitted previously requested information and when the email draft did not maintain the desired level of formality. ChatGPT's revisions influenced the student’s reactions, which shifted from dissatisfaction to greater acceptance when the output became more appropriate.

The interactions demonstrated changes in the student's emotional responses and approach to using ChatGPT. Following corrections and revisions, the student generally expressed greater approval and gratitude toward the generated outputs. Furthermore, the repeated requests for assistance and modifications suggest that ChatGPT became an integrated part of the student's workflow. However, the student continued to exercise judgment by evaluating the responses rather than passively accepting the generated output.

Potential communication noise was observed in the form of both semantic and psychological barriers, resulting in mismatched expectations and shortcomings in ChatGPT's responses. Semantic noise emerged from language and structural disconnects, such as missing information in the Biology reviewer and insufficient formality in the email draft, which created misunderstandings between the student's intended message and the output generated by ChatGPT. Furthermore, psychological noise manifested as student frustration, cognitive impatience, and over-reliance on the tool, influencing how the user perceived these errors and triggering reactive or hasty re-prompting. These combined barriers required additional clarification and revisions before the interaction could reach a satisfactory outcome.

Both observations occurred within an academic context in which the student used ChatGPT to assist with school-related tasks. The purpose of each interaction influenced the student's expectations and emotional responses. The Biology reviewer required accurate and complete information, while the email draft required an appropriate level of formality. These differences in task requirements shaped how the student evaluated ChatGPT's responses and communicated dissatisfaction or approval.

Analysis

The two observations demonstrated how communication between the student and ChatGPT developed through continuous exchanges. Rather than ending after the initial request, both interactions involved multiple rounds of generation, evaluation, and revision. The student's repeated consultations with ChatGPT illustrate how feedback and responses shaped the progression of each interaction.

Observation 01

Biology reviewer

In the first observation, which involved creating a Biology reviewer, sentiment analysis scores varied considerably for the student's initial message. The message received a score of -100 using Soper, 0 using VADER, and 0.09333445877 using CardiffNLP. These differing results suggest that the tools did not interpret the message in the same way, which may be attributed to its nature as a request rather than an explicit expression of emotion. However, the student's emotional response became clearer when ChatGPT failed to meet the stated requirements. For example, the message, "omg i already told u to include the full names...", received a CardiffNLP sentiment score of -0.8577050148, indicating a negative emotional response to the incomplete output. This instance demonstrates how the context of an interaction can provide a clearer basis for interpreting emotional semantics.

Following ChatGPT's correction of the Biology reviewer, the student's tone became more accepting. The response, "hmm alright i guess this is fine, thanks", received a Soper score of 100, a VADER score of 0.6908, and a CardiffNLP score of 0.7142516831. All three tools indicated a positive sentiment, showing general agreement in interpreting the message as an expression of approval and gratitude. However, the phrase "I guess" suggests some hesitation, indicating that the student may have accepted the output without being entirely satisfied. This shift from frustration to approval was associated with the improved quality of ChatGPT's response, while the student's wording retained some indication of reservation.

Initial request — Soper −100 / VADER 0 / CardiffNLP 0.093
"omg i already told u to include the full names..." — CardiffNLP −0.858
"hmm alright i guess this is fine, thanks" — Soper 100 / VADER 0.691 / CardiffNLP 0.714
Observation 02

Drafting an email

The second observation, which involved drafting an email, demonstrated a similar pattern. Throughout the interaction, ChatGPT's messages consistently received positive sentiment scores across the three sentiment analysis tools, reflecting a generally positive tone in its responses. After receiving the initial draft, the student responded, "this is good thank u", which received positive sentiment scores of 0.6597 using VADER and 0.9753 using CardiffNLP. However, upon realizing that the draft did not meet the desired level of formality, the student stated, "wait why is it not that formal anymore." This message received a CardiffNLP score of -0.4388 and a Soper score of -100. Although the scores indicated negative sentiment, the message can be interpreted in context as an expression of dissatisfaction with the output rather than hostility toward ChatGPT. After receiving a revised response, the student expressed approval, with all three sentiment analysis tools indicating positive sentiment. Similar to the first observation, the student's emotional language shifted alongside the quality and appropriateness of ChatGPT's responses, while ChatGPT's consistently positive sentiment scores contrasted with the student's more variable emotional responses.

"this is good thank u" — VADER 0.660 / CardiffNLP 0.975
"wait why is it not that formal anymore" — CardiffNLP −0.439 / Soper −100
Revised response & final approval — positive across all three tools

Multiple verbal cues were noticed during the observations.

Through semantics,

we were able to analyze how the different contexts and emotions were transmitted to the AI via the text. For example, “omg i already told u to include the full names...” expressed frustration, while “this is good thank u” conveyed approval and gratitude. The meaning of these expressions varied depending on the student's reaction to ChatGPT's responses.

Through syntactics:

The student's use of sentence structure, punctuation, capitalization, and informal expressions reflected the conversational nature of the interaction. Examples such as “omg,” “u,” and “thank u” show how the student used shortened and informal forms to communicate quickly and naturally with ChatGPT. The use of repeated punctuation and lowercase writing also contributed to the tone of certain messages.

Lastly, pragmatics

The context of the interaction influenced how the student's statements were understood. For example, “wait why is it not that formal anymore” functioned not only as a question but also as an expression of dissatisfaction with the email's level of formality. This shows that the intended meaning of an utterance cannot always be understood from its literal words alone, but also depends on the situation and the student's purpose in communicating.

The observations also indicated a developing reliance on ChatGPT for academic assistance. In both tasks, the student continued using the system beyond the initial request by asking for revisions, corrections, and additional content. This repeated consultation suggests that ChatGPT had become an integrated part of the student's workflow, serving not only as a tool for generating initial content but also as a resource for refining and improving academic outputs.

Despite this reliance, the student did not passively accept the information generated by ChatGPT. In the biology reviewer task, the student noticed missing information and requested its inclusion. Similarly, in the email task, the student identified the lack of formality and asked for appropriate revisions. These instances demonstrate that the student continued to exercise judgment over ChatGPT's responses. Although the student relied on the system for assistance and modifications, they remained actively involved in evaluating the generated content and directing the interaction toward the intended outcome.

Overall, the two observations demonstrate the relationship between emotional semantics, feedback, and reliance on ChatGPT during academic tasks. The student's emotional responses varied according to the quality and appropriateness of the generated outputs, with dissatisfaction prompting corrections and improved responses generally resulting in greater approval. At the same time, repeated consultations suggest that ChatGPT became an increasingly integrated part of the student's workflow. However, this reliance did not eliminate the student's active role in communication, as the student continued to evaluate, correct, and direct the system. The observations highlight how communication with AI is shaped not only by the messages exchanged but also by task expectations, feedback, and the user's interpretation of the generated responses.

Data SHEET Sentiment score data (Google Sheets)
Scores across Soper, VADER, and CardiffNLP did not always agree; see the Analysis above for cases where the tools diverged. Scores are provided for reference alongside the surrounding context, not as a standalone measure of sentiment.