Dataset from Zenodo · Javvadi, Vijay Prasad
Artifact for "Memorised, Not Generated: Verbatim Recall of Published Fixtures in LLM-Generated Test Data, Measured Across Five Models and Eight Public Schemas"
- License
- CC BY 4.0commercial use allowedLicense text
- This license allows commercial use. Usually you must credit the author; read the license for the exact terms.
- Formats
- ZIP
- Size
- 14 MB
- Updated
- Oct 5, 2026
Description
Complete artifact for the empirical study "Memorised, Not Generated: Verbatim Recall of Published Fixtures in LLM-Generated Test Data, Measured Across Five Models and Eight Public Schemas" (submitted to Empirical Software Engineering). Version 1.2.1 adds experiment E1c: the copy-rate measurement (exact-text match, near-match at Indel ratio 0.9, and column-wise overlap against the published human fixture) extended to five models (Claude Sonnet 4.6, Claude Sonnet 5.5, GPT-4o, GPT-5.6 Terra, Qwen3-235B-A22B-Instruct-2507 via OpenRouter) and eight public PostgreSQL schemas (Pagila, Chinook, Northwind, employees, Dell DVD Store 2, ClassicModels, Oracle HR, BikeStores), direct-emission arm, one run per cell, with every cell's generated rows and per-call logs (tokens, latency, stop reason, serving host, sampling settings), the three new subjects' PostgreSQL ports and provenance manifest, a check of which edition of the Oracle HR fixture each model reproduces (current v23.3 versus the 2015-2019 v19.2 edition), and a model-identity check recording, for every model identifier named in the paper, the provider's listing entry and the identifier echoed back by a live call. It retains the…
Description from Zenodo, shortened.
Files (1)
DataHunter does not store or host these files: every link leads to the original source. Check the license there before using the data.