Manuals, References, and Academic Citations¶
This document provides direct links to dataset documentation, product hierarchy references, and academic literature that form the foundation of our matching methodology.
Dataset Manuals and Nielsen Documentation¶
All official documentation files provided by the Kilts Center for Marketing (Chicago Booth) are organized locally in the repository:
1. Primary Dataset User Guides¶
-
Nielsen Retail Scanner Dataset Manual (2006–2020): Comprehensive documentation detailing the 1-to-1 product module hierarchy, movement files, store universe, and UPC check-digit handling (see Pages 37–40 for external UPC matching algorithms).
-
Nielsen Retail Scanner Dataset Manual (2024 Edition): Updated guide covering the many-to-many category hierarchy introduced in 2021+.
-
Retail Scanner Data Guide Overview: The Kilts Center README guide describing file structures, supercategories, and download formats.
2. Hierarchy and Mapping Reference Files¶
-
Product Hierarchy (2006–2020 Data): Master taxonomy mapping department codes, product group codes (e.g.,
1001for Baking Mixes), and product modules. -
Product Hierarchy (2021 Onward): Taxonomy for the revised post-2021 category hierarchy.
-
Private Label Unmasking Table: Crosswalk bridging 2020 unmasked UPCs to 2021 masked identifiers.
-
Geographic DMA and County Crosswalk: FIPS county to Nielsen Designated Market Area (DMA) conversion table.
Academic Literature and Citations¶
The matching methodology implemented in this repository adheres to established procedures in leading finance, economics, and marketing publications.
1. Fracassi, Previtero, and Sheen (2022)¶
Fracassi, C., Previtero, A., & Sheen, A. (2022). Barbarians at the Store? Private Equity, Products, and Consumers. The Journal of Finance, 77(3), 1439-1488. https://doi.org/10.1111/jofi.13134
- Local PDF: fracassi_2022_barbarians_at_the_store.pdf
- Methodology Summary: Matches 12-digit Nielsen UPCs to parent firms via GS1 company prefixes, achieving an 82% direct match rate, while identifying and filtering private-label products.
@article{fracassi2022barbarians,
author = {Fracassi, Cesare and Previtero, Alessandro and Sheen, Albert},
title = {Barbarians at the Store? Private Equity, Products, and Consumers},
journal = {The Journal of Finance},
volume = {77},
number = {3},
pages = {1439--1488},
year = {2022},
publisher = {Wiley Online Library},
doi = {10.1111/jofi.13134}
}
2. Servaes and Tamayo¶
Servaes, H., & Tamayo, A. (Working Paper). ESG and Product Sales.
- Local PDF: servaes_esg_and_product_sales.pdf
- Methodology Summary: Details the mapping from Global Company Prefixes (GCP) to corporate parents, combining GS1 registry data with CRSP/Compustat firm identifiers and historical NETS parent-subsidiary trees.
@unpublished{servaes2023esg,
author = {Servaes, Henri and Tamayo, Ane},
title = {ESG and Product Sales},
year = {2023},
note = {Working Paper}
}
3. Kilts Center for Marketing¶
Kilts Center for Marketing. (2022). NielsenIQ Retail Scanner Dataset Manual. The University of Chicago Booth School of Business.
@manual{kiltsscanner2022,
title = {NielsenIQ Retail Scanner Dataset Manual},
author = {{Kilts Center for Marketing}},
organization = {The University of Chicago Booth School of Business},
year = {2022},
url = {https://www.chicagobooth.edu/research/kilts/datasets/nielsenIQ-nielsen}
}
Data Outputs and Interactive Exploration¶
- Interactive Product Crosswalk: Open crosswalk.html for instant searchable filtering and export across all 7,921 products.
- CSV Crosswalk Table: upc_firm_lookup.csv
- Parquet Columnar Table: upc_firm_lookup.parquet