Research & Evidence

Search for a method

Search titles, questions, territories and MSC identifiers.

41 results
  1. MSC-P-001How do you turn a marketing claim into a testable question?Decision Science↗
  2. MSC-P-002Correlation or causality: what can an analysis actually support?Marketing Measurement↗
  3. MSC-P-003How should uncertainty in a marketing result be expressed?Decision Science↗
  4. MSC-P-004Statistical significance or effect size: which result should be interpreted?Decision Science↗
  5. MSC-P-005How do you measure a marketing construct that is not directly observable?Market Research↗
  6. MSC-P-006How do you design and validate a measurement scale?Market Research↗
  7. MSC-P-007Alpha or omega: how should scale reliability be assessed?Market Research↗
  8. MSC-P-009PCA, EFA or CFA: which method should you choose?Market Research↗
  9. MSC-P-010When should you run a marketing experiment?Marketing Measurement↗
  10. MSC-P-011How do you design an A/B test that actually estimates an effect?Marketing Measurement↗
  11. MSC-P-012How many observations does an experiment need?Decision Science↗
  12. MSC-P-013How do you measure campaign incrementality with a control group?Marketing Measurement↗
  13. MSC-P-017How do you detect selection, contamination and attrition in an experiment?Marketing Measurement↗
  14. MSC-P-018Predictive or causal regression: what are you trying to estimate?Marketing Models↗
  15. MSC-P-019How do you diagnose a marketing regression before interpreting it?Marketing Models↗
  16. MSC-P-022How do you estimate price elasticity and its uncertainty?Pricing Science↗
  17. MSC-P-026Logit vs Probit: how do you choose for purchase probability?Customer Science↗
  18. MSC-P-029Which customers have the highest probability of churn?Customer Science↗
  19. MSC-P-027TAM, UTAUT or UTAUT2: which framework should be used to study technology acceptance?Market Research↗
  20. MSC-H-001Measurement and causality: how can a marketing effect be established?Marketing Measurement↗
  21. MSC-H-002Marketing response models: shape, delay and saturationMarketing Models↗
  22. MSC-H-003Pricing science: connecting price, demand and contributionPricing Science↗
  23. MSC-H-004Customer and choice science: behavior, value and heterogeneityCustomer Science↗
  24. MSC-H-005Measurement science: building valid indicatorsMarket Research↗
  25. MSC-H-006Statistical decision methods: choose, quantify, validateDecision Science↗
  26. MSC-P-008How do you validate a marketing measurement scale?Market Research↗
  27. MSC-P-014How do you design a marketing geo experiment?Marketing Measurement↗
  28. MSC-P-015How do you estimate an effect with difference-in-differences?Marketing Measurement↗
  29. MSC-P-020How do you address price endogeneity?Pricing Science↗
  30. MSC-P-021Fixed or random effects: which panel model should you choose?Marketing Models↗
  31. MSC-P-023How do you estimate a demand function?Pricing Science↗
  32. MSC-P-024How do you simulate a price-volume-margin scenario?Pricing Science↗
  33. MSC-P-028How do you estimate CLV with BG/NBD and Gamma-Gamma?Customer Science↗
  34. MSC-P-030How do you analyze retention with a survival model?Customer Science↗
  35. MSC-P-043What is a subscriber worth with only six months of retention data?Customer Science↗
  36. MSC-P-031How do you build a useful customer segmentation?Customer Science↗
  37. MSC-P-032How do you test segmentation stability?Customer Science↗
  38. MSC-P-033How do you validate a marketing forecast?Decision Science↗
  39. MSC-P-034How do you build a Monte Carlo simulation for a marketing decision?Decision Science↗
  40. MSC-P-035How do you model saturation and adstock?Marketing Models↗
  41. MSC-P-039Which statistical test should you choose?Decision Science↗
← All methods
METHOD DOSSIERMSC-P-008Measurement scienceVerified scientific dossier

How do you validate a marketing measurement scale?

Validation combines content, factor structure, reliability, convergent validity, discriminant validity and, when needed, invariance across groups. No single indicator is sufficient.

Scientific editorial team: Marketing Science Center

Direct answer

Decide whether a composite score is interpretable for a defined use and population.

Validation combines content, factor structure, reliability, convergent validity, discriminant validity and, when needed, invariance across groups. No single indicator is sufficient.

Trizano-Hermosilla & Alvarado, 2016Edwards, Joyner & Schatschneider, 2021

01

Operational summary

Scientific question and scope

How do you validate a marketing measurement scale?

Supported

Decide whether a composite score is interpretable for a defined use and population.

Forbidden

Declare a scale universally valid because alpha exceeds 0.70.

02

Three reading levels

  1. 01

    Decision-maker — Connect the result to a declared decision, useful threshold and error cost.

  2. 02

    Practitioner — Fix population, unit, horizon, available variables and analysis rule before calculation.

  3. 03

    Analyst — Reproduce the calculation, quantify uncertainty and document diagnostics, failures and sensitivities.

03

Concrete marketing situation

Validation combines content, factor structure, reliability, convergent validity, discriminant validity and, when needed, invariance across groups. No single indicator is sufficient.

04

Scientific question and scope

How do you validate a marketing measurement scale?

Reliability and construct validity for a declared use

Required data

respondent × item × occasion

Population, unit of analysis, origin date and horizon must be declared in the deliverable. Without them, the estimand silently changes.

05

Why a simple analysis can fail

  • Declare a scale universally valid because alpha exceeds 0.70.
  • Are observations independent and paired on the two scores?
  • Was the screening threshold declared before seeing the correlation?
  • Are construct definitions, factor structure and measurement errors examined separately?

06

Method intuition

The method does not automatically turn an association into evidence. It links a declared question to an estimand, specification, compatible data and a bounded interpretation rule.

Reliability and construct validity for a declared use

07

Required data

Scientific symbol dictionary

r
Observed correlation used only as a prespecified screening statistic between two construct scores. Unit: dimensionless · Type: number in (-1, 1) · Role: input
n
Number of independent paired observations supporting the correlation. Unit: observation · Type: integer greater than 3 · Role: input
z_r
Fisher transformation of the observed correlation. Unit: dimensionless · Type: number · Role: derived
CI_r
Approximate confidence interval for the population correlation after inverse Fisher transformation. Unit: dimensionless · Type: ordered pair · Role: output

Exact sealed engine inputs

trust_satisfaction_correlation
Value: 0.94 · Unit: dimensionless · Type: number · Data status: synthetic
separation_threshold
Value: 0.85 · Unit: dimensionless · Type: number · Data status: parameter
sample_size
Value: 30 · Unit: respondent · Type: integer · Data status: synthetic

08

Formal model

Formal model

z_r = atanh(r); CI_r = tanh(z_r ± 1.959964 / sqrt(n − 3))

Evidence claims: MSC-P008-C01 · MSC-P008-C02 · MSC-P008-C03 · MSC-P008-C04 · MSC-P008-C05 · MSC-P008-C06

Scientific question and scope

Reliability and construct validity for a declared use

09

Declared calculation

  1. 01

    Validate an independent paired sample, a finite correlation strictly between −1 and 1, n > 3, and a prespecified screening threshold.

  2. 02

    Transform r with Fisher z, compute the normal interval, and transform both bounds back to the correlation scale.

  3. 03

    Report threshold excess as a screen only and require HTMT, CFA and substantive evidence for discriminant validity.

10

Numerical example or application case

Worked example — synthetic data or declared parameters; no real observations

Sealed inputs

  • trust_satisfaction_correlation=0.94 [dimensionless]
  • separation_threshold=0.85 [dimensionless]
  • sample_size=30 [respondent]

Reproducible results

  • Fisher_CI95=[0.876591; 0.971327]
  • threshold_excess=0.09
  • screening_signal=true

Verified dossier: claims are linked to passage-level sources, the Python/R calculation is reproduced, limits are explicit, and independent scientific review is complete.

11

Validity assumptions

  • Are observations independent and paired on the two scores?
  • Was the screening threshold declared before seeing the correlation?
  • Are construct definitions, factor structure and measurement errors examined separately?

12

Diagnostics and uncertainty

Diagnostics and uncertainty

Are observations independent and paired on the two scores? · Was the screening threshold declared before seeing the correlation? · Are construct definitions, factor structure and measurement errors examined separately?

Bounded diagnostic

Correlation screen only; it is not HTMT, CFA or proof of discriminant-validity failure.

Explicit uncertainty contract · quantified

Method: Deterministic reference-engine calculation on the sealed input slice.

Target: Sampling uncertainty of the observed correlation screen.

Engine evidence: metric.correlation_ci_lower= · metric.correlation_ci_upper=

Interpretation: The Fisher interval quantifies correlation uncertainty only; it is not an HTMT or CFA validity test.

Stop when

Declare a scale universally valid because alpha exceeds 0.70.

13

Result interpretation

  • Decide whether a composite score is interpretable for a defined use and population.
  • The result is conditional on the declared population, horizon, specification and diagnostics. It must not be extended to another decision without new justification.

14

Supported and forbidden conclusions

Supported

Decide whether a composite score is interpretable for a defined use and population.

Forbidden

Declare a scale universally valid because alpha exceeds 0.70.

15

Possible marketing decision

  1. 01

    Decide whether a composite score is interpretable for a defined use and population.

  2. 02

    The result is conditional on the declared population, horizon, specification and diagnostics. It must not be extended to another decision without new justification.

16

When to use — when to stop

Use when

Decide whether a composite score is interpretable for a defined use and population.

respondent × item × occasion

Stop when

Declare a scale universally valid because alpha exceeds 0.70.

Methodological alternatives

  • Estimate HTMT with an uncertainty interval in the declared measurement model.
  • Compare constrained and unconstrained CFA specifications.
  • Revise construct definitions and item content when overlap is theoretical rather than merely statistical.

17

Reproducibility contract

Python and R are the executable references. SPSS and SAS remain secondary syntaxes until checked on the same data, specification and diagnostics.

The engine selects only this page’s explicit slice and branch. Its hash, outputs, and diagnostics remain sealed in the atomic dossier; no generic fallback branch is allowed.

Slice fingerprint: 6c4226a9ac9e8b9a7864d300b0ae6ac50507c3be5d2f56f712a48803584bdb32

Available asset · MSC-007

Synthetic validity responses

Formal model

z_r = atanh(r); CI_r = tanh(z_r ± 1.959964 / sqrt(n − 3))

Verified dossier: claims are linked to passage-level sources, the Python/R calculation is reproduced, limits are explicit, and independent scientific review is complete.

18

Expected final deliverable

  1. 01

    How do you validate a marketing measurement scale? — respondent × item × occasion

  2. 02

    r · n · z_r · CI_r

  3. 03

    z_r = atanh(r); CI_r = tanh(z_r ± 1.959964 / sqrt(n − 3))

  4. 04

    Are observations independent and paired on the two scores? · Was the screening threshold declared before seeing the correlation? · Are construct definitions, factor structure and measurement errors examined separately?

  5. 05

    Decide whether a composite score is interpretable for a defined use and population. / Declare a scale universally valid because alpha exceeds 0.70.

19

Scientific sources and evidence status

Verified dossier: claims are linked to passage-level sources, the Python/R calculation is reproduced, limits are explicit, and independent scientific review is complete.

  1. MSC-P008-C01 — Tau-equivalence can be expressed as equal factor loadings in the declared one-factor setting.
  2. MSC-P008-C02 — The displayed omega formula uses factor loadings and item error variances.
  3. MSC-P008-C03 — Reading alpha as reliability depends on explicit model assumptions.
  4. MSC-P008-C04 — HTMT is an explicit discriminant-validity diagnostic.
  5. MSC-P008-C05 — The proposed criterion is evaluated through simulation.
  6. MSC-P008-C06 — HTMT is compared with established discriminant-validity checks.
  1. Trizano-Hermosilla & Alvarado, 2016
  2. Edwards, Joyner & Schatschneider, 2021
  3. Henseler, Ringle & Sarstedt, 2015

Dataset · Tool

Dataset · MSC-007Synthetic validity responses→

Method connections

Parent territoryMeasurement science: building valid indicatorsRequiresHow do you design and validate a measurement scale?ValidatesAlpha or omega: how should scale reliability be assessed?

Read next

MSC-H-005Measurement science: building valid indicators→MSC-P-005How do you measure a marketing construct that is not directly observable?→MSC-P-006How do you design and validate a measurement scale?→MSC-P-007Alpha or omega: how should scale reliability be assessed?→