Seyed Masoud Hosseini · Overview · Study log · Ideas · Transcript · RSS feed
Probability · Lecture 47 of 76 · 10:10
Using the Conditional Expectation and Variance
Study guide
What this lecture covers
This is a worked recitation problem applying the law of total variance to a joint density. X and Y are uniformly distributed over a parallelogram, and the problem finds the variance of X + Y. It demonstrates a choice that matters in practice: which variable to condition on, and why picking the one that keeps conditional slices a constant width makes the calculation far easier.
After watching, you should be able to read a joint density defined on a region, choose a sensible conditioning variable based on the region's geometry, derive conditional distributions from geometric slices, and combine the resulting pieces using the law of total variance.
Key ideas
- Why condition on X and not Y: slicing the parallelogram at a fixed x always gives an interval of the same width, so the conditional distribution of Y given X is uniform with a constant-width shift; slicing at a fixed y gives varying widths, which would be harder to work with.
- Conditional distribution from geometry: for x in
[0, 1], Y given X = x is uniform betweenxandx + 1, since conditioning on a uniform joint density preserves uniformity within the conditional region. - Conditional expectation as a linear shift:
E[X + Y | X] = x + E[Y|X] = x + (midpoint of the interval) = 2x + 1/2. - Conditional variance ignores the constant shift:
Var(X + Y | X) = Var(Y|X) = 1/12, using the uniform-variance formula(b - a)^2 / 12. - Law of total variance combines both pieces:
Var(X + Y) = Var(2X + 1/2) + E[1/12] = 4*Var(X) + 1/12. - Marginalizing the joint density: integrating the joint density over y at each x shows the marginal density of X is uniform on
[0, 1], givingVar(X) = 1/12and a final answer of5/12.
Before you watch
- Watch the main lecture on iterated expectations for the law of total variance.
- Be comfortable computing marginal densities from a joint density, and know the variance formula for a uniform random variable.
Check your understanding
- Why does conditioning on X, rather than Y, simplify this problem given the shape of the parallelogram?
- Why does the constant term inside a conditional expectation not affect the conditional variance?
- Derive the marginal density of X by marginalizing the joint density over y.
- Walk through both terms of the law of total variance calculation for
Var(X + Y).
Chapters
- 0:00 <Untitled Chapter 1>
- 3:15 draw the conditional pdf of y conditioned on x
- 5:50 computing the variance of a random variable
- 7:40 compute the variance of x
From the YouTube description
MIT 6.041SC Probabilistic Systems Analysis and Applied Probability, Fall 2013
View the complete course: http://ocw.mit.edu/6-041SCF13
Instructor: Katie Szeto
License: Creative Commons BY-NC-SA
More information at http://ocw.mit.edu/terms
More courses at http://ocw.mit.edu
