Artifact for "Memorised, Not Generated: Verbatim Recall of Published Fixtures in LLM-Generated Test Data, Measured Across Five Models and Eight Public Schemas"

Descripción

Complete artifact for the empirical study "Memorised, Not Generated: Verbatim Recall of Published Fixtures in LLM-Generated Test Data, Measured Across Five Models and Eight Public Schemas" (submitted to Empirical Software Engineering). Version 1.2.1 adds experiment E1c: the copy-rate measurement (exact-text match, near-match at Indel ratio 0.9, and column-wise overlap against the published human fixture) extended to five models (Claude Sonnet 4.6, Claude Sonnet 5.5, GPT-4o, GPT-5.6 Terra, Qwen3-235B-A22B-Instruct-2507 via OpenRouter) and eight public PostgreSQL schemas (Pagila, Chinook, Northwind, employees, Dell DVD Store 2, ClassicModels, Oracle HR, BikeStores), direct-emission arm, one run per cell, with every cell's generated rows and per-call logs (tokens, latency, stop reason, serving host, sampling settings), the three new subjects' PostgreSQL ports and provenance manifest, a check of which edition of the Oracle HR fixture each model reproduces (current v23.3 versus the 2015-2019 v19.2 edition), and a model-identity check recording, for every model identifier named in the paper, the provider's listing entry and the identifier echoed back by a live call. It retains the…

Descripción de Zenodo, abreviada.

Archivos (1)

• ZIPpaperH-artifact-v1.2.1.zip14 MB

DataHunter no guarda ni aloja estos archivos: cada enlace lleva a la fuente original. Revisa allí la licencia antes de usar los datos.