Conditional expectation

Click on a title to access the corresponding entry of the Glossary

1

Click on a number to access the detailed Table of Contents of the Tutorial

 

 

 

 

PROBABILITIES and RANDOM VARIABLES

 

 

 

 

 

 

Expectation

 

Tutorial

1

            The Law of the Unconscious Statistician
   Discrete case, continuous case.
   Expectation of a linear tranform.
   Expectation of a function of two r.v..
   Expectation of a linear combination.

 

 

 

Conditional expectation

 

Tutorial

1

Examples (discrete explicit, binomial and continuous).
   Expectation of the product of two random variables :
       * General case.
       * Independent variables.
   Necessary and sufficient condition for two r.v.
   to be independent.

 

 

 

 

Iterated expectation

 

Tutorials

1

Demonstrations of the Theorem of Iterated Expectation.

2

More examples of applications :
       * Mean of the geometric distribution
       * Covariance of two modalities of a multinomial
          distribution

3

Expectations of the sum and of the product of a random    number of iid random variable.

Tutorials

 4

Calculating probabilities by iterated expectation :
      * P{Y < X} and P{X + Y < a}

5

Moment generating function of the sum of a random  number    of iid random variables.
   Mean and variance of this sum.

6

The "Miner's problem".
   M.g.f. of the geometric distribution revisited.

 

 

 

 

Variance

 

Tutorial

1

Alternative expression of the variance
   Variance of a linear transform of a r.v.
   Variance of a linear combination of r.v.s.
   Estimating a variance by the empirical variance.
   The law of conditional variance :
         * Demonstration.
         * Example : the "broken stick" problem.

 

 

 

 

 

Covariance

 

Tutorial

1

Basic properties of covariance : its two fundamental    expression, linearity, relation with independence.

2

Example :Covariance of two modalities of a multinomial    distribution.

Animation

Covariance and correlation coefficient of a bidimensional and     adjustable sample.

 

  

 

 

Sampling without replacement

 

Tutorial

1

Population mean :
       * The sample mean is an unbiased estimator of the population mean.
       * Variance of the distribution of the sample mean.
   Unbiased estimator of the population variance.
   Unbiased estimation of a proportion. Variance of the estimator.

 

 

 

 

Moment generating function

 

Tutorial

1

Basic properties of the Moment Generating Function

 

 

 

 

Central Limit Theorem

 

Tutorial

1

Demonstration assumes that the distribution has a moment generating function

 

 

 

 

Transformations and functions of random variables

 

Tutorials

1

Simple examples of transformations :
       * Linear, square, square root, inverse.

2

Univariate transformations (monotone and general).
   Examples.
   The Probability Integral Transformation.

3

Multivariate transformations. Jacobian determinant.
    Multiple integration by change of variable.

Tutorials

 4

Distribution of the sum of random variables :
      * Theory.
      * Examples : exponential, uniform, Cauchy.

5

Ratio of two random variables :
      * Theory.
      * Examples : Student's T, Fisher's F, Cauchy.

 

 

 

Cauchy-Schwarz inequality

 

Tutorial

1

Cauchy-Schwarz inequality for random variables.
   Cauchy-Schwarz inequality for integrable functions.

 

 

  

Jacobian determinant

 

Tutorial

1

Bivariate transformations form first principles

 

 

  

Jensen's inequality

 

Tutorial

1

Demonstration of Jensen's inequality (finite and continuous)

 

 

 

Kullback-Leibler distance

 

Tutorial

1

Justification of the definition.
   Nonnegativeness. Asymmetry.
   Kullback-Leibler distance and Maximum Likelihood.

2

Special case : normal distributions

Animation

Two operating modes :
       * Two normal distributions.
       * Two samples.

 

 

 

Quantiles

 

Tutorial

1

QQ-plots :
    * Samples against a reference distribution.
    * Comparing two samples.

2

The mid-distribution function.
   The continuous quantile function.
   The Quantile Inter-Quartile (QIQ) transformation

Case study

3

The problem
   The data
   The solution
       * Identification of the distributions with QQ-plots
       * Estimate the parameters of the distributions
       * Simulating the distributions

 

 

 

Weak Law of Large Numbers

 

Tutorial

1

Markov inequality.
   Chebyshev inequality.
   Weak Law of Large Numbers.
   Generalized Weak Law of Large Numbers.
   Fundamental Theorem of Statistics.
   Estimation of the moments of a distribution.

 

 _____________________________________________________________________

 

Accessing the Tutorials

Other Tutorials