Probability and Random Variables
Probability and Random Variables
2
A random variable which can take both discrete and continuous values is called a
mixed random variable.
What is probability distribution function?
If X is a real random variable, then the function defined by
where is called distribution function of
the random variable X. we also call it as cumulative distribution function.
Give the properties of probability distribution function.
1.
2.
3.
4.
5.
(iii)
2.
3.
4.
5.
Random variables
Probability Mass Function (pmf):
(i)
(ii)
(i)
(ii)
3
For discrete X : for
(i)
For continuous X:
(ii)
Mathematical Expectation:
For discrete X :
(i)
For continuous X :
(ii)
Mean =
Variance =
For discrete X:
(i)
For continuous X:
(ii)
Characteristic Function:
For discrete X:
(i)
For continuous X:
(ii)
Problems:
1. A one-dimensional random variable X has the following probability distribution.
0 1 2
2. A shipment of 6 television sets contains two defective sets. A hotel makes a random purchase of 3 of the sets. If X is the number of defective sets purchased by the hotel find
(i)
Probability distribution of X
(ii)
Also determine its distribution function and hence, find the probability of purchasing at the most 1 defective set and probability of purchasing at least 1 defective
set.
3. A continuous random variable X that can assume any value between and has
a density function given by . Find .
4. If
(i)
4
(ii)
distribution function of X.
7.
-1
P(X)
0.15
0.1
0.3
0.3
0.15
8. Find the MGF and rth moment for the distribution whose pdf is
. Find also standard deviation.
9. The first four moments of a distribution about X=4 are 1,4,10 and 45 respectively. Show
that the mean is 5, variance is 3.
10. Let the random variable X have the pdf
ing function, mean and variance of X.
11. A continuous random variable X has the pdf . Find the value of
C and CDF of X.
12. For the triangular distribution, find the mean, variance and the
13. If a random variable has the MGF , obtain the standard deviation of X.
14. The probability function of an infinite discrete distribution is given by
. Verify that the total probability is 1 and find the mean and variance
15. If X is a random variable for which E(X)=10 and Var(X)=25. For what positive value of a
and b, does have expectation 0 and variance 1?
1) If a random variable X takes the value 1,2,3,4 such that 2P(X=1) = 3P(X=2) = P(X=3) = 5P(X=4). Find the
5
distribution of x
2) A random variable X has the following distribution,
X
P(X)
2k
2k
3k
k2
2 k2
7 k2 +k
Find (i) the value of k (ii) P (1.5 < X < 4.5 | x > 2) (iii) the smallest value of P for which P(X <P) > (iv) find cdf
3) A random variable X has the following distribution,
X
P(X)
3a
5a
7a
9a
11a
13a
15a
17a
(iii) cdf
-2
-1
P(X)
0.1
0.2
2k
0.3
3k
Find (I) the value of k (ii) P(X<2) & P (-2 <X <2)
(iii) cdf MU
5) A continuous R.V x has a PDF given by f(x) = 3x ) < x < 1 Find ksuch that P (X> k ) = 0.05
if g
otherwise
0exe2
kx
2k
2exe4
elsewhere
0
0 e x e1
2 e x e 4 find its cdf
xu2
9) Find the distribution function of a R.V x is given by F(x) = 1 ( 1+x) e-x; x >0 Find the density function, P( x >2)
x2
0 e x 1/ 2
1/ 2 e x
xu3
11) Find the value of k if the PDF of x is f(x) = kx (1-x); 0 < x< 1.
12) Find the moment of the following
X
other ise
0
x
0 x 1
14) Find the MGF of the a R.V. X with PDF f(x) = 2 x 1 x 2 also find Q , Q
0
other ise
1
1
1
2
15) Let X be a R.V with value -1, 0, 1 such that P(X= -1)=2P(X=0) = P(X=1). Find the mean of 2x 5
16) A continuous R.V X has the PDF f(x) = kx2 e-x x > 0 Find the rth moment of X about the origin. Hence find the mean
and variance of X
17) A continuous R.V X has the PDF f(x) = k e-x x > 0 Find the rth moment of X about the origin. Hence find the S.D
18) For a R.V x with M x (t ) !
(e t 2) 4
, Find P (x < 2)
81
19) Determine the binomial distribution for which mean is 4 and variance 3
20) 6 dice thrown 729 times, how many times do you expect at least 3 dice to show 5 or 6?
21) 6 bombs are dropped from a flight to hit a target. The probability of hitting is 1/5 . Two bombs are required to destroy
the building. Find the probability that the building is destroyed.
22) In a long run, 3 vessels out of every 10 do not return. If 10 vessels are out , find the probability that at least 8 will arrive safely
23) If X, Y are independent Poisson variable, then conditional distribution of X + Y given X is Binomial distribution.
24) Poisson distribution is an approximation of binomial distribution.
25) If X is a Poisson variable such that P(X = 2) = 9 P(X = 4) + 90 P(X= 6) find the variance.
26) The MGF of a RV of X is given by
M x (t ) ! e 3( e
1)
Find P (x = 1)
27) It is known that 5% of the books of a certain bindings have defective bindings. Find the probability that 2 of 100 books
bound of this binding will have defective
28) A certain rare blood type can be found in only 0.05% of people. If the population of a randomly selected group is
3000. What is the probability that at least two people in the group have this rare blood type?
29) A radioactive source emits on the average 2.5 particles per second. Find the probability that 3 or more particles will be
emitted in the interval of 4 seconds.
30) A radioactive source emits on the average 10 particles per min. in according to the Poisson law. Each particle emitted
has a probability of 2/5 being recorded. Find the probability that 4 particles recorded in a min period
31) From an arbitrary deck of 52 cards, we draw cards at random with replacement and successively until an ace is drawn.
What is the probability that at least10 draw are needed
32) A father asks his sons to cut their background lawn. Since he does not specify of three sons is to do so the job, each
boy tosses a coin to determine odd person, what must cut lawn. In the case that all these get heads or tail, they continue
tossing until they reach a decision. (i) find the probability that they reach a decision in less than n tosses (ii) what is minimum number of tosses required to reach a decision with probability 0.95
Dr. D. Saravanan, Professor of Mathematics
7
33) A woman and her husband want to have 95% chance for atleast one boy and atleast one girl. What is the minimum
number of children they should plan to have? assume that equal probability for gender of child
34) life time of IC chips manufactured by a semiconductor manufacturer are approximately normally distributed with
mean 5x106 hours and variance 5x105 hours A mainframe manufacturer requires at least 95% of a batch should have a life
time greater than 4x106 will the deal be made?
35) The time required to repair a machine is exponentially distributed with parameter P=1/3. What is the probability that
the repair time exceeds 3 hours.
36) The daily consumption of milk in excesses of 20000 gallon is approximately exponentially distributed with U = 3000.
The city has a daily stock of 35000 gallons. What is the probability that of two days selected at random the stock is in sufficient for both days.
37) the mileage which a car owner get with a certain kind of radial tyre is a R.V having exponential distribution with mean
40000 km. Find the probability that one of these tyres will last
1) at least 20000km
2) at most 30000km
38) If the time T is required to repair of a component is exponentially distributed with P= . What is the 1) probability
that repair time will exceed 2 hours
2) conditional probability that repair time takes atmost 10 hours given that its dura-
Pe Px
xu0
otherwise
forsome P " 0
x2
e
45) Let the p.d.f. of x be f(x) = f ( x) !
0
other ise
x
46) If X is a normal R.V with mean zero and variance W2 Find p.d.f of Y = ex
4x3
0 other ise
1
t < 1 be the m.g.f of the R.V. Find the m.g.f. of Y = 2X + 1
1 t
and Z = e x
T T
, ) Find the p.d.f of y = tan x
2 2
UNIT II
--------------------------------------------------------------------------------------------------------------------------PART A
1.
2.
3.
4.
5.
Given joint pdf, f(x,y) = cx(x-y), 0 <x <2 , -x < y <x. Evaluate c.
6.
8 xy , 0 x 1; 0 y
0, elsewhere
function of x.
7.
k (6 x y ); 0 x 2, 2
0,
elsewhere
f(x,y) =
3 2
( x y 2 ); 0 x 1, 0 y 1
, find f(x/y).
8. If f(x,y) = 2
0
,
elsewhere
9.
Find the value of k if f(x,y) = k(1-x)(1-y) for 0 < x, y < 1 is to be a joint density function.
PART B
10. The input to a binary communication system, denoted by random variable X, takes on one of two values 0 or 1 with
probabilities and respectively. Because of errors caused by noise in the system, the output Y differs from the input
occasionally. The behaviour of the communication system is modeled by the conditional probability P( Y =1 / X =1) =
and P ( Y =0 / x =0) = 7/8. Find (i) P (Y=1) (ii) P(Y=0) and (iii) P( X =1/ Y =1).
9
11. 3 balls are drawn at random without replacement from a box containing 2 White , 3 Red & 4 Black balls. If X denots
the number of white balls drawn and Y denotes the number of red balls drawn, form the joint probability distribution of
(X,Y).
12. The
joint
probability
mass
function
of
and
is
given
X Y
0.1
0.04
.02
0.08
0. 2
0.06
0.06 0.14
0.3
as
Compute the marginal probability mass functions X and Y. Also, find P( X e 1, y e 1) and check whether the variables are
independent.
X /Y
1
2
1 / 16 1 / 16 1 / 16
1
1/ 8
1 / 16
1/ 8 .
1/ 8
1 / 16
1/ 8
1 / 16 1 / 16
1/ 8
13. Consider the discrete random variables X and Y with the joint pmf as shown below:
2 xy
x ; 0 x 1, 0 y 2
14. If the joint pdf of a 2D rv (x,y) is given by f(x,y) =
.
3
0
,
elsewhere
8 xy , 0 x 1; 0 y
0, elsewhere
(i) Find the conditional density functions . (ii) Find P ( Y < 1/8 / X < ) (iii) Check the independency.
6
( x y 2 ); 0 e x e 1, 0 e y e 1
16. If f(x,y) = 5
0, elsewhere
P ( e y e ).
2
( x 2 y ); 0 x 1, 0
y 1
0, elsewhere
given by Y =y and P ( X e / Y = ).
e ( x y ) , x u 0, y u 0
18. If f(x,y) =
0, elsewhere
10
y 2
. Find the mar
0, else here
8
xy , 1 x
ginal density functions of X and Y. Find also the conditional density function of Y given X=x and the conditional density
function
of
X given Y =y.
9(1 x y )
; 0 e x g, 0 e y g
0,
elsewhere
1 x
y e ; x " 0, 0 y 2
22. Let the joint density function of random variables X and Y be given by f(x,y) = 2
. Find
0, elsewhere
6e 2 x 3 x ; 0 x1 , x 2 " 0
. Find the probability that the first random variable will take on a value between 1
f(x,y) =
elsewhere
0,
1
and 2 and the second random variable will take on a value between 2 and 3. Also find the probability that the first random
variable will take on a value less than 2 and the second random variable will take on a value greater than 2.
24. If the joint pdf of a two dimensional random variables x,y is given by
k (6 x y ); 0 x 2, 2
0,
elsewhere
f(x,y) =
x y x
e ; 0 x g, 0 y g
elsewhere
0,
-1e V e 1.
29. Prove that if the variables are independent , then they are uncorrelated.
30. If the variables are uncorrelated, are they independent? Justify your answer.
Dr. D. Saravanan, Professor of Mathematics
11
PART B
31. Calculate the correlation coefficient for the following height (in inches) of father (X) and their sons(Y)
X : 65
66
67
67
68
69
70
72
Y : 67
68
65
68
72
72
69
71.
/Y
0
1
1
1
8
2
8
1
3
8
2
8
33. If the joint density function of ( X,Y) is given by f(x,y)=2-x-y, o< x,y <1. Find correlation coefficient
34. Let X be a RV with mean value is 3 &Variance is 2. Find the second moment of X about the origin. Another RV Yis
defind by Y=-6x+22. Find the mean value of Y and the correlation of X &Y.
35. If the joint p.d.f of (X,Y) is given by f ( x, y ) ! 3 xy ( x y ),0 e x, y e 1.
Verify that E ( E ( Y
)) ! E (Y ) ! 1124
x y
,
3
0,
0 x 1
other ise
independent
4 ax,
f ( x) !
0 ,
random
variables
elsewhere
0 y 1
. Prove that U = X+Y and V = X-Y are uncorother ise
4by ,
f ( y) !
0,
x 1, 0
and
are
defined
such
that
related.
38. (X,Y) is a 2-D random variable uniformly distributed over the triangular region R bounded by y=0, x=3 and y = 4x/3,
find the Vxy.
39. Let the joint pdf of (X,Y) be given by
6 x y,
f ( x, y ) !
x " 0, y " 0, x y
0,
else here
x y, 0 x 1, 0 y 1
f ( x, y ) !
.
else here
0,
coefficient.
41. A statistical investigator obtains the following regression lines 2x+3y = 5; 4y+3x = 7. Find (i) Vxy
(iii) Wy if Wx = 2.5
(ii) x, y
12
42. Find V if f ( x, y ) ! 24 y (1 x), 0 e y e x e 1 . Find Vxy.
43. If x,y&z are uncorrelated with zero means , standard deviations 5,12,9 respectively and if u = 2x -3y, v= y + z + 2, find
Vuv.
x e ( x y ) ,
x " 0, y " 0
f ( x, y ) !
. Find the
here
0
,
else
44. Given two random variables X and Y that have joint pdf
regression equation Y on X.
45. If the two dimensional random variable (X,Y) is uniformly distributed over R , where
R ! _( x, y ) / x 2 y 2 e 1, y u 0
x y, 0 x, y 1
f ( x, y ) !
. Find the pdf of (i) U =
else here
0,
XY (ii) U = X+Y
53. If X and Y each follow exponential distribution with parameter 1 and are independent find the pdf of U = X Y.
x
y
54. If X and Y are independent random variables having densities f X ( x) ! e U ( x), f Y ( y ) ! e U ( y ) . Find pdf
of
Z = X / Y.
55. If X and Y are independent random variables with identical uniform distributions in ( 0, a), find the density function of
Z = X Y.
CENTRAL LIMIT THEOREM
PART A
56. State the two different forms of Central limit theorem .
13
57. If Xi , i = 1 to 20 are independent ,uniformly distributed &identical variables , how are the random variables
20
X and
are distributed?
i !1
PART B
58. Prove Central limit theorem.
59. A random sample of size 100 is taken from population whose mean is 60 and variance 400. Using CLT what probability can we assert that the mean of the sample will not differ from Q = 60 by more than 4 ?
60. If Vi, I = 1,2,,20 are independent noise voltages received in an adder and V is the sum of the voltages received,
find the probability that total incoming voltage V exceeds 105 using CLT. Assume that each of the random variables Vi is
uniformly distributed over ( 0, 10 ).
61. A distribution with unknown mean Q, has the variance equal to 1.5 . Use CLT to find how large a sample should be
taken from the distribution in order that the probability will be atleast 0.95 that the sample mean will be within 0.5 of the
population mean.
62. If X1,. X2,.,Xn are Poisson variables with parameter P = 2. Use CLT, to estimate P(120 < Sn < 160 ) where Sn = X1 +
X2++Xn and n = 75.
UNIT III
Definition and examples - first order, second order, strictly stationary, wide sense stationary and Ergodic processes - Markov process - Binomial, Poisson and Normal processes Sine wave process Random Telegraphic Process.
--------------------------------------------------------------------------------------------------------------------------------------------------------Part A
1.
2.
3.
4.
5.
6.
7.
8.
Part B
9.
When is a stationary time series X (t) said to be ergodic? S. T it is ergodic for Q if E[X (t)] = Q and cova-
14
11. State the properties of ergodic process.
12. Define a random process. Explain the classification of Random Processes Give example
13. Derive the Poisson Law
14. Explain any two application of binomial process
15. Write a detailed note on sine-wave process
16. Two random process X(t) = A Cos Wt + B sin Wt & Y(t)= B cos Wt A sin Wt where A & B are uncorrelated
random variables with zero mean and equal variance and W is a constant, Check Whether the processes are
jointly WSS
17. State and prove the properties of Poisson process
18. The
process
X(t)
whose
(at ) n 1
(1 at ) n1
P{ X (t ) ! n} !
(at )
(1 at )
probability
under
certain
conditions
is
given
by
n ! 1,2,3,
S.T it is not a stationary
n!0
19. Suppose that a customer arrive at a bank according to Poisson process wit a mean rate 3 per min. Find the
probability that during a time interval of 2 min:
a) Exactly 4 customers arrive
b) More than 4 customers arrive.
20. Let {X (t) = a cos (Wt+Y)} be a random process where Y and W are independent random variable. Further
the characteristic function N of Y satisfies N(1) = N(2) = 0. While the density function f(w) of w satisfies f(w) = f(w). S.T X (t) is a WSS
21. Given that WSS random process X (t) = 10 cos (100t+U) where U is uniformly distributed over (-T,T). Prove
that the process X (t) is correlation-ergodic.
22. Find the mean and autocorrelation of Poisson process.
23. If {X(t) = A cos Pt + B sin Pt; t u 0 } is a random process where A & B are independent N(0,W2) random variables, examine the stationary of X(t).
24. Let {X(t); t u 0 }be a random process where X(t) = total number of points in the interval (0,t) = K,
!
1
if
iseven
if
isodd
15
26. Consider a random process X (t) = B cos (50t+U) where B and U are independent random variables. B is a
random variable with mean zero and variance 1 U is uniformly distributed in the interval (-T,T). Find mean and
autocorrelation of the process.
27. Distinguish SSS & WSS and establish any two results for weekly stationary time service involving auto correlation function.
28. Verify the sine wave process X(t) = Y coswt where Y is uniformly distributed in (0,1) is SSS process.
29. S.T if a random process X(t) is WSS, then it must be covariance stationary.
30. Consider a R.P Y(t) = X(t) cos (wt+U) where X(t) is WSS, U is random variable independent of X(t)and it is
uniformly distributed (-T,T)and w is a constant. P.T Y(t) is WSS.
31. P.T the random process X(t) = A cos (wt+U) where A,W are constant and U is uniformly distributed in (0,2T)
is correlation ergodic.
UNIT IV
Auto correlation - Cross correlation - Properties Power spectral density Cross spectral
density - Properties Wiener-Khintchine relation Relationship between cross power spectrum and cross correlation function
--------------------------------------------------------------------------------------------------------------------------Part A
1.
2.
Define auto correlation function. State all of its properties when the process is WSS
3.
4.
5.
6.
7.
8.
9.
16
15. Distinguish SSS & WSS and establish any two results for weekly stationary time service involving auto correlation function.
16. Write a note on correlation integrals.
17. Explain the ACF of X(t) in term of ACF of X(t)
18. The ACF for a stationary process X(t) is given by Rxx(X) = 9 + 2 e
-|X |.
X (t )dt
19. If X(t) is a WSS with ACF Rxx(X) and if Y(t) = X( t+a) X( t-a), S.T
Ryy(X)= 2Rxx(X)- Rxx(X+2a)-Rxx(X-2a).
20. Consider the two random process X(t) = 3 cos (wt + U) and Y(t) = 2 cos (wt + U -T/2) where U is a random
variable uniformly distributed in (0,2T) P.T
Rxx(0)Ryy(0) u Rxy(X )
21. Given R(X) = ce-E|X| Obtain the spectral density Also state its application to linear system with random inputs
22. Let {X (t) = a cos (Wt+Y)} be a random process where Y and W are independent random variable. Further
the characteristic function N of Y satisfies N(1) = N(2) = 0. While the density function f(w) of w satisfies f(w) = f(w). S.T X (t) is a WSS and calculate the spectral density.
23. State and establish the spectral representation theorem for WSS process. Also, obtain the covariance function and spectral devising function average process.
24. Describe a linear system. With usual notation S.T Syy(w) = Sxx(w) | H (w) |2 where Syy(w) & Sxx(w) are the
spectral density function of Y(t) and X(t) and H(w) is the system transfer function.
25. Write a note on correlation integrals.
26. Write a note on linear system with random inputs.
27. Given the ACF of X(t) = A e-a|X|cos wX where A > 0 , a > 0 and w are real constant . Find S(w)
28. A system has an impulse response h(t) = e at U(t) find the power spectral density of the output Y(t) corresponding to the input X(t).
a ibZ ,
Z 1
29. Given that S XY (Z ) !
find its cross-correlation function.
else where
0
UNIT V
Linear time invariant system - System transfer function Linear systems with random inputs
Auto correlation and cross correlation functions of input and output
---------------------------------------------------------------------------------------------------------------------------