pdf of XXX f(x)=12πσ2e−(x−μ)22σ2 (−∞<x<∞,−∞<μ<∞,σ2>0)f(x)=\frac{1}{\sqrt{2 \pi \sigma^2}}e^{-\frac{(x- \mu)^2}{2 \sigma^2}} \space (-\infty<x<\infty,-\infty<\mu<\infty,\sigma^2>0)f(x)=2πσ21e−2σ2(x−μ)2 (−∞<x<∞,−∞<μ<∞,σ2>0) ∫−∞∞f(x)dx=1?\int_{-\infty}^{\infty}f(x)dx=1?∫−∞∞f(x)dx=1? 기댓값 E(X)=μE(X)=\muE(X)=μ pf) 분산 Var(X)=σ2Var(X)=\sigma^2Var(X)=σ2 pf) mgf MX(t)=eμt+(σt)22 (−∞<t<∞)M_X(t)=e^{\mu t+\frac{(\sigma t)^2}{2}} \space (-\infty<t<\infty)MX(t)=eμt+2(σt)2 (−∞<t<∞) pf)
Theorem) Z∼N(0,1)Z \sim N(0,1)Z∼N(0,1)일 때, Z2∼χ2(1)Z^2 \sim \chi^2(1)Z2∼χ2(1) pf)
✔︎ 주의사항 N(0,1)N(0,1)N(0,1) 을 따르는 ZZZ의 cdf는 닫힌 형태를 갇고 있지 않기 때문에, 표시할 때 편의를 위해 Φ(x)\Phi(x)Φ(x)로 표시한다.
Φ(x)=∫−∞x12πe−t22dt\Phi(x)=\int_{-\infty}^{x}\frac{1}{\sqrt{2 \pi}}e^{-\frac{t^2}{2}}dtΦ(x)=∫−∞x2π1e−2t2dt
Joint pdf of X‾\underline{X}X
Let X‾=(X1,X2,...,Xn)T,μ‾=(E(X1),E(X2),...,E(Xn))T,∣∑∣=det(∑)\underline{X}=(X_1,X_2,...,X_n)^T, \underline{\mu}=(E(X_1),E(X_2),...,E(X_n))^T, |\sum| = det(\sum)X=(X1,X2,...,Xn)T,μ=(E(X1),E(X2),...,E(Xn))T,∣∑∣=det(∑) f(X‾)=(2π)−n2∣∑∣−12exp(−12(x‾−μ‾)T∑−1(x‾−μ‾))X‾∼Nn(μ‾,∑)f(\underline{X}) = (2 \pi)^{-\frac{n}{2}} |\sum|^{-\frac{1}{2}} exp(-\frac{1}{2} (\underline{x} - \underline{\mu})^T \sum^{-1} (\underline{x} - \underline{\mu}) ) \\ \underline{X} \sim N_n(\underline{\mu}, \sum)f(X)=(2π)−2n∣∑∣−21exp(−21(x−μ)T∑−1(x−μ))X∼Nn(μ,∑)
bivariate case
(X1X2)∼N2((μ1μ2),(σ12ρσ1σ2ρσ1σ2σ22))\begin{pmatrix} X_1\\ X_2 \end{pmatrix} \sim N_2(\begin{pmatrix} \mu_1\\ \mu_2 \end{pmatrix}, \begin{pmatrix} \sigma_1^2 & \rho \sigma_1 \sigma_2\\ \rho \sigma_1 \sigma_2 & \sigma_2^2 \end{pmatrix})(X1X2)∼N2((μ1μ2),(σ12ρσ1σ2ρσ1σ2σ22)) ∣∑∣=∣σ12ρσ1σ2ρσ1σ2σ22∣=(1−ρ)2σ12σ22|\sum| = \begin{vmatrix} \sigma_1^2 & \rho \sigma_1 \sigma_2 \\ \rho \sigma_1 \sigma_2 & \sigma_2^2 \\ \end{vmatrix}=(1- \rho)^2 \sigma_1^2 \sigma_2^2∣∑∣=∣∣∣∣∣σ12ρσ1σ2ρσ1σ2σ22∣∣∣∣∣=(1−ρ)2σ12σ22 ∑−1=1(1−ρ)2σ12σ22(σ22−ρσ1σ2−ρσ1σ2σ12)\sum^{-1} = \frac{1}{(1- \rho)^2 \sigma_1^2 \sigma_2^2}\begin{pmatrix} \sigma_2^2 & -\rho \sigma_1 \sigma_2 \\ -\rho \sigma_1 \sigma_2 & \sigma_1^2 \\ \end{pmatrix}∑−1=(1−ρ)2σ12σ221(σ22−ρσ1σ2−ρσ1σ2σ12) (x‾−μ‾)T∑−1(x‾−μ‾)=1(1−ρ)2[(x1−μ1)2σ12−2ρ(x1−μ1)(x2−μ2)σ1σ2+(x2−μ2)2σ22](\underline{x} - \underline{\mu})^T \sum^{-1} (\underline{x} - \underline{\mu}) = \frac{1}{(1- \rho)^2}[\frac{(x_1 - \mu_1)^2}{\sigma_1^2} -2 \rho \frac{(x_1 - \mu_1)(x_2 - \mu_2)}{\sigma_1 \sigma_2} + \frac{(x_2 - \mu_2)^2}{\sigma_2^2}](x−μ)T∑−1(x−μ)=(1−ρ)21[σ12(x1−μ1)2−2ρσ1σ2(x1−μ1)(x2−μ2)+σ22(x2−μ2)2] f(x1,x2)=(2π)−1((1−ρ)2σ12σ22)−1/2exp(−12(x‾−μ‾)T∑−1(x‾−μ‾))=12π(1−ρ)2σ12σ22exp[−12(1−ρ)2((x1−μ1)2σ12−2ρ(x1−μ1)(x2−μ2)σ1σ2+(x2−μ2)2σ22)]f(x_1,x_2) = (2 \pi)^{-1} ((1- \rho)^2 \sigma_1^2 \sigma_2^2)^{-1/2} exp(-\frac{1}{2} (\underline{x} - \underline{\mu})^T \sum^{-1} (\underline{x} - \underline{\mu})) = \\ \frac{1}{2 \pi \sqrt{(1- \rho)^2 \sigma_1^2 \sigma_2^2}} exp[-\frac{1}{2(1 - \rho)^2}(\frac{(x_1 - \mu_1)^2}{\sigma_1^2} -2 \rho \frac{(x_1 - \mu_1)(x_2 - \mu_2)}{\sigma_1 \sigma_2} + \frac{(x_2 - \mu_2)^2}{\sigma_2^2})]f(x1,x2)=(2π)−1((1−ρ)2σ12σ22)−1/2exp(−21(x−μ)T∑−1(x−μ))=2π(1−ρ)2σ12σ221exp[−2(1−ρ)21(σ12(x1−μ1)2−2ρσ1σ2(x1−μ1)(x2−μ2)+σ22(x2−μ2)2)] If ρ=0\rho=0ρ=0, f(x1,x2)=12πσ12σ22exp[−12((x1−μ1)2σ12−(x2−μ2)2σ22)]=12πσ12exp(−(x1−μ1)22σ12)12πσ22exp(−(x2−μ2)22σ22)f(x_1,x_2) = \frac{1}{2 \pi \sqrt{\sigma_1^2 \sigma_2^2}} exp[-\frac{1}{2} (\frac{(x_1 - \mu_1)^2}{\sigma_1^2}- \frac{(x_2 - \mu_2)^2}{\sigma_2^2})]=\frac{1}{\sqrt{2 \pi \sigma_1^2}} exp(-\frac{(x_1 - \mu_1)^2}{2 \sigma_1^2}) \frac{1}{\sqrt{2 \pi \sigma_2^2}} exp(-\frac{(x_2 - \mu_2)^2}{2 \sigma_2^2})f(x1,x2)=2πσ12σ221exp[−21(σ12(x1−μ1)2−σ22(x2−μ2)2)]=2πσ121exp(−2σ12(x1−μ1)2)2πσ221exp(−2σ22(x2−μ2)2) => X1,X2X_1,X_2X1,X2 are indep. => If XiX_iXi's follows normal dist., Cov(X‾)=0<=>Cov(\underline{X})=0 <=>Cov(X)=0<=> Xi′sX_i'sXi′s are indep.