Let’s assume that we have samples of two independent Bernoulli random variables, Ber(θ1) and Ber(θ2).
How do we prove that (ˉX1−ˉX2)−(θ1−θ2)√θ1(1−θ1)n1+θ2(1−θ2)n2d→N(0,1)?
Assume that n1≠n2.
Answer
Put
a=√θ1(1−θ1)√n1, b=√θ2(1−θ2)√n2,
A=(ˉX1−θ1)/a,
B=(ˉX2−θ2)/b. We have
A→dN(0,1), B→dN(0,1).
In terms of characteristic functions it means
ϕA(t)≡EeitA→e−t2/2, ϕB(t)→e−t2/2.
We want to prove that
D:=a√a2+b2A−b√a2+b2B→dN(0,1)
Since A and B are independent,
ϕD(t)=ϕA(a√a2+b2t)ϕB(−b√a2+b2t)→e−t2/2,
as we wish it to be.
This proof is incomplete. Here we need some estimates for uniform convergence of characteristic functions. However in the case under consideration we can do explicit calculations. Put p=θ1, m=n1.
ϕX1,1(t)=1+p(eit−1),ϕˉX1(t)=(1+p(eit/m−1))m,ϕˉX1−θ1(t)=(1+p(eit/m−1))me−ipt,ϕA(t)=(1+p(eit/√mp(1−p)−1))me−ipt√m/√p(1−p)=((1+p(eit/√mp(1−p)−1))e−ipt/√mp(1−p))m=(1−t22m+O(t3m−3/2))m
as t3m−3/2→0. Thus, for a fixed t,
ϕD(t)=(1−a2t22(a2+b2)n1+O(n−3/21))n1(1−b2t22(a2+b2)n2+O(n−3/22))n2→e−t2/2
(even if a→0 or b→0), since |e−y−(1−y/m)m|≤y2/2m when y/m<1/2 (see https://math.stackexchange.com/questions/2566469/uniform-bounds-for-1-y-nn-exp-y/ ).
Note that similar calculations may be done for arbitrary (not necessarily Bernoulli) distributions with finite second moments, using the expansion of characteristic function in terms of the first two moments.
Attribution
Source : Link , Question Author : An old man in the sea. , Answer Author : Viktor