AI Journaling Nudges Less Effective for Social Behaviors, Study Finds
An analysis published on arXiv (2608.12582) examined 369 journal entries from an eight-week passive sensing project to assess how behaviors react to AI journaling prompts. Researchers employed a large language model (LLM) to categorize each entry based on the intention to modify behavior and evaluated the follow-through using 26 sensor features with a three-day pre- and post-comparison. Results revealed that responsiveness was largely influenced by social interactions: behaviors reliant on others showed improvement in only 15 to 22% of instances, whereas individual actions saw enhancements ranging from 50 to 63%, albeit inconsistently. Notably, the style of writing was less significant; no specific text characteristic distinguished improved from unimproved entries. The limited sample size leads authors to consider these findings as exploratory, indicating potential areas where AI journaling could effectively encourage behavior change, particularly emphasizing the importance of social context.
Key facts
- Study analyzed 369 journal entries from an eight-week passive sensing study.
- An LLM labeled each entry as expressing an intention to change a behavior or not.
- Follow-through was measured against 26 sensor features with a 3-day before/after comparison.
- Behaviors depending on others improved in only 15 to 22% of cases.
- Behaviors a person can act on alone improved more often, up to 50 to 63%.
- No single text feature separated improved from unimproved entries.
- Writing carried signal only within specific behaviors, most clearly for text messaging and longer, more personal intention entries.
- The sample is small, so findings are considered exploratory.
Entities
Institutions
- arXiv