Here are my notes when reading about σ-algebras (sigma-algebra).
Motivation
Example: Toss a coin, have it come up heads, and if it comes up
tails, pick a random number in the range [0,1]. How do you come up
with a PDF/CDF?
Further reading: Look at the excerpt from A User's Guide to Measure Theoretic Probability.
Related video: Why use measure theory for probability?
So, measure-theoretic probability unified the discrete and continuous cases.
tails, pick a random number in the range [0,1]. How do you come up
with a PDF/CDF?
Further reading: Look at the excerpt from A User's Guide to Measure Theoretic Probability.
Related video: Why use measure theory for probability?
So, measure-theoretic probability unified the discrete and continuous cases.
First approach
Pick a set of all possible outcomes Ω (capital omega). When
flipping coins, this set is {H,T}, and when rolling dice this set
is {1,2,3,4,5,6}.
Give a function P that assigns a probability to arbitrary
subsets of Ω. You can write this as: P:2Ω→[0,1].
The 2X notation denotes the power set of X.
We'd like this function to behave nicely and obey some intuitive laws:
P(roll even number)=P({2,4,6}). If P assigned
a number to all subsets, then we'd be happy.
However, for the continuous case, something like 2[0,1] leads us to paradoxes, so the question is: P:?→[0,1].
flipping coins, this set is {H,T}, and when rolling dice this set
is {1,2,3,4,5,6}.
Give a function P that assigns a probability to arbitrary
subsets of Ω. You can write this as: P:2Ω→[0,1].
The 2X notation denotes the power set of X.
We'd like this function to behave nicely and obey some intuitive laws:
- P(Ω)=1
- For every event A∈Ω, P(A)≥0
- For any two disjoint events A,B, P(A∪B)=P(A)+P(B)
P(roll even number)=P({2,4,6}). If P assigned
a number to all subsets, then we'd be happy.
However, for the continuous case, something like 2[0,1] leads us to paradoxes, so the question is: P:?→[0,1].
Sigma-algebras
Choose some subset of the power set and define the domain of P using it:
P:Σ→[0,1] ∅≤Σ≤Ω
What we'd like Σ to contain:
Σ={∅,Ω}
There are certain rules a σ-algebra has to obey:
Note: To resolve the paradox mentioned above, see the Borel σ-algebra.
In the usual parsimonious fashion, the above three rules along with
the definition of P in the previous section, are used to derive
the rest.
P:Σ→[0,1] ∅≤Σ≤Ω
What we'd like Σ to contain:
- The empty set ∅, so that we can talk about the
probability of something not happening. - The set of all possible outcomes Ω, so we can talk about the
possibility of anything happening.
Σ={∅,Ω}
There are certain rules a σ-algebra has to obey:
- Ω∈Σ: As above
- A∈Σ implies that the complement AC∈Σ: if I can talk
about some event A happening, then I'd like to talk about some
event A not happening - A,B∈Σ implies that A∪B∈Σ
Note: To resolve the paradox mentioned above, see the Borel σ-algebra.
In the usual parsimonious fashion, the above three rules along with
the definition of P in the previous section, are used to derive
the rest.
0 comments:
Post a Comment