Scenario
In quantitative trading and quantitative research, candidates are frequently evaluated on statistics modeling, specifically regarding Decision Theory / Shrinkage.
Your Task
Let X∼Np(θ,Ip) be a single observation of a p-dimensional multivariate normal vector. Under the squared error loss L(θ^,θ)=∥θ^−θ∥22, the maximum likelihood estimator is θ^MLE=X, with constant risk R(θ^MLE,θ)=p.
(1) State Stein's Paradox for p≥3.
(2) State the James-Stein estimator θ^JS=(1−∥X∥22p−2)X.
(3) Prove using Stein's Unbiased Risk Estimate (SURE) / integration by parts that R(θ^JS,θ)<p for all θ∈Rp.
Constraints
- All variables are defined on a standard probability space (Ω,F,P).
- Analytical expressions must be in closed form, and empirical simulations should converge within standard statistical tolerances.