Skip to content

WRDS Integration Guide

This guide details procedures for connecting the NielsenIQ-GS1 product crosswalk with financial and economic databases available through Wharton Research Data Services (WRDS).


1. Corporate Financial Data Linkage

While the GS1 US Company Prefix Registry provides operating legal names (for example, Continental Mills, Inc. or General Mills, Inc.), it does not include financial or market accounting identifiers. WRDS hosts standard identifiers enabling researchers to link product sales to corporate financial statements.

Compustat Capital and Operating Metrics

Researchers can merge matched GS1 operating entities with Compustat North America (comp.company and comp.funda) to analyze corporate fundamentals:

  • Primary Identifiers: Compustat identifies publicly traded firms using the Global Company Key (GVKEY) and Committee on Uniform Securities Identification Procedures (CUSIP) number.
  • Key Financial Variables: Linking product sales to Compustat allows researchers to observe firm leverage, operating margin, research and development (XRD), advertising expense (XAD), capital expenditures (CAPX), and total assets (AT).
  • Analytical Application: Evaluating how firm-level capital constraints or ESG ratings affect product-level pricing, promotional frequency, and sales volume in retail stores.

CRSP Stock Performance and Asset Pricing

Researchers investigating market reactions to product recalls, brand acquisitions, or retail expansion can link matched firms to the Center for Research in Security Prices (CRSP):

  • Primary Identifiers: CRSP identifies equity issues using the permanent security identifier (PERMNO) and permanent company identifier (PERMCO).
  • Event Study Analysis: Examining abnormal stock returns around retail product introductions, private-label market share shifts, or public health announcements.
  • Valuation Multiples: Measuring market-to-book ratios and equity valuations alongside granular retail market share metrics.

2. Centralized NielsenIQ Infrastructure on WRDS

Researchers with direct Kilts Center access through WRDS can query standardized relational tables in the wrds_nielsen schema without manually processing multi-gigabyte flat text files.

Product Attribute Enrichment via Master Product Tables

The centralized table nielsen.products contains standardized longitudinal records for all products scanned in participating retail chains:

  • Descriptive Variables: Contains standardized brand descriptions (brand_descr), product group descriptions, package size metrics (size1_amount, size1_units), and multi-pack indicators (multi).
  • Brand Verification: Merging our upc_firm_lookup table with nielsen.products enables immediate programmatic validation: verifying that the GS1 company_name corresponds to authentic consumer brands recorded in brand_descr (such as confirming that General Mills, Inc. maps to Betty Crocker and Bisquick).
  • Attribute Imputation: Fills missing physical attributes for items listed in unclassified product modules (such as Module 9999).

Longitudinal Version Tracking via RMS Versions

The relational table nielsen.rms_versions tracks version revisions across consecutive panel years:

  • Reversion Tracking: Tracks when physical formulations or package dimensions change while retaining the same base barcode.
  • Panel Harmonization: Resolves ambiguities where manufacturers reuse UPCs across multi-year studies by conditioning on both upc and upc_ver_uc.

3. Implementation Workflow and Matching Protocols

Bridging the string-based company_name field from the GS1 registry to Compustat and CRSP requires systematic name normalization and validation protocols.

Name Normalization and Standard String Cleansing

Prior to conducting fuzzy or exact joins against Compustat CONM (Company Name) or CRSP COMNAM:

  • Suffix Standardization: Strip legal entity suffixes including LLC, L.L.C., INC, INCORPORATED, CORP, CORPORATION, LTD, CO, and COMPANY.
  • Punctuation Removal: Remove hyphens, commas, periods, ampersands, and apostrophes.
  • Case Normalization: Convert all entity names to uppercase strings and compress repeated whitespace.

Quality Assurance and Matching Safeguards

Because automated string matching can introduce false-positive links between unrelated firms sharing similar name components:

  • Manual Audit Threshold: Researchers should manually audit all matches accounting for the top 80% of aggregate category sales volume.
  • Industry SIC/NAICS Filtering: Restrict candidate matches to firms operating within consumer packaged goods and manufacturing classifications (such as SIC 2000-2099 for Food and Kindred Products) to eliminate spurious links to financial or technology entities.
  • Time-Series Consistency: Verify that the matched Compustat entity was an active operating entity during the scanner panel year.