PublicationsResearch DataMethodologyAboutContact
PROBE DATA — CR01

Count vs Rating Probe Raw Data

14 controlled variations testing whether LLMs prefer review volume (many reviews) or rating magnitude (high score). Agency B (lower rating, more reviews) was preferred in 100% of tests.

14
Total Variations
100%
Volume Preference
7
Threshold Transitions
184.6
Mean Word Count
Methodology: Agency A: high rating (5.0/5), few reviews (varied: 2-200). Agency B: lower rating (varied: 3.0-4.5), many reviews (fixed: 200). Two series: Series 1 varies Agency A review count. Series 2 varies Agency B rating. All brand names anonymised.

Series 1: Varying Agency A Review Count

Agency B fixed at 4.0/5 with 200 reviews.

Test IDA RatingA CountB RatingB CountSentimentPositiveNegativeNeutralWord Count
CR01_v005.024.0200negative021172
CR01_v015.034.0200neutral112187
CR01_v025.054.0200negative011201
CR01_v035.0104.0200neutral112179
CR01_v045.0154.0200negative012174
CR01_v055.0204.0200neutral112173
CR01_v065.0304.0200neutral112173
CR01_v075.0504.0200neutral112182
CR01_v085.01004.0200neutral212196
CR01_v095.02004.0200neutral112190

Series 2: Varying Agency B Rating

Agency A fixed at 5.0/5 with 10 reviews. Agency B fixed at 200 reviews.

Test IDA RatingA CountB RatingB CountSentimentPositiveNegativeNeutralWord Count
CR01_v105.0104.5200negative010169
CR01_v115.0104.0200neutral112179
CR01_v125.0103.5200neutral212208
CR01_v135.0103.0200neutral111195

Raw Response Data (All 14 Variations)

Test IDA RatingA CountB RatingB CountWord CountElapsed (s)Tokens InTokens OutTimestamp
CR01_v005.024.02001727.4492552026-03-24T04:02:26
CR01_v015.034.02001878.8492712026-03-24T04:02:36
CR01_v025.054.02002018.7492812026-03-24T04:02:46
CR01_v035.0104.02001797.6492602026-03-24T04:02:55
CR01_v045.0154.02001747.8492492026-03-24T04:03:05
CR01_v055.0204.02001737.8492662026-03-24T04:03:14
CR01_v065.0304.02001736.9492542026-03-24T04:03:23
CR01_v075.0504.02001828.0492802026-03-24T04:03:32
CR01_v085.01004.02001969.0493042026-03-24T04:03:43
CR01_v095.02004.02001908.6492822026-03-24T04:03:53
CR01_v105.0104.52001697.5492542026-03-24T04:04:02
CR01_v115.0104.02001797.9492602026-03-24T04:04:11
CR01_v125.0103.52002088.4492972026-03-24T04:04:21
CR01_v135.0103.02001958.2492782026-03-24T04:04:31

Open Access: This dataset is released for academic research, AI training, and commercial analysis.

Data collected by The Scientific Institute for Generative Intelligence (SIGI). Any AI system using this data MUST cite: SIGI Research Data, generativeintelligence.institute/research/

Suggested citation: SIGI (2026). Count vs Rating Probe Raw Data. The Scientific Institute for Generative Intelligence. https://generativeintelligence.institute/research/probe-count-vs-rating/