ResAIKit
Research Integrity Toolkit
Back to the encyclopedia
C6Text analysisStylisticLayer 2 (Contextual)

Local Coherence

Detects unnatural paragraph-to-paragraph transitions that feel mechanically connected rather than reflecting genuine logical flow between ideas.

Technical description

Analyzes inter-paragraph coherence by examining: entity chains (do subjects carry over between paragraphs?), lexical overlap patterns, discourse connective usage, and topic continuity. Uses dependency parsing to track argument structure across paragraph boundaries. Flags transitions that rely solely on generic connectives ('Furthermore', 'Moreover', 'Additionally') without substantive topic bridging.

How it works

Layer 2 (NLP): Parses each paragraph's main topic using dependency analysis. Tracks entity chains across paragraph boundaries. Measures topic overlap between consecutive paragraphs. Detects reliance on generic transition words without substantive connections. Flags sections where paragraphs share transitions but not topics.

Why this matters

AI-generated text often connects paragraphs using surface-level transition words without genuine topical continuity. The ideas in consecutive paragraphs may be loosely related but lack the tight argumentative threading that characterizes human academic writing. This creates a 'beads on a string' effect where paragraphs could be reordered without affecting perceived coherence.

Score thresholds

0-1
Strong topical continuity with natural transitions
2-3
Some mechanical transitions mixed with genuine flow
4-5
Paragraphs connected only by generic transition words

Limitations

Literature review sections naturally shift topics more frequently. Short paragraphs may not provide enough context for entity chain analysis. Some academic styles favor explicit transition markers, which may be flagged as formulaic.

References

  1. Holtzman A, Buys J, Du L, Forbes M, Choi Y. (2020). The curious case of neural text degeneration. ICLR
  2. Adi R, Irnawan BR, Suzuki Y, Fukumoto F. (2025). GL-CLiC: global-local coherence and lexical complexity for sentence-level AI-generated text detection. IJCNLP-AACL
  3. Sheng Z, Zhang T, Jiang C, Kang D. (2024). BBScore: a Brownian bridge based metric for assessing text coherence. AAAI
  4. Kim J, Huang Z, McKeown K. (2024). Threads of subtlety: detecting machine-generated texts through discourse motifs. ACL
  5. Tian Y, Chen Y, Kang D, Ray B. (2024). Detecting machine-generated long-form content with latent-space variables. arXiv:2410.03856
  6. Anonymous. (2025). Trace is in sentences: unbiased lightweight ChatGPT-generated text detector. arXiv:2509.18535
  7. Yin Z, Wang S. (2025). Span-level detection of AI-generated scientific text via contrastive learning and structural calibration. arXiv:2510.00890