Tip:
Highlight text to annotate it
X
[Thrun] The initial probability for rain is 0
because we are just encountering 1 initial day and it's sunny.
The maximum likelihood estimate is therefore 0.
We transition 8 times out of a sunny state--1, 2, 3, 4, 5, 6, 7, 8--
twice into a rainy state, and therefore 6 times we remain in a sunny state,
so the probability of sun to sun is ¾,
whereas sun to rain is ¼.
From a rainy state we have 2 outbound transitioning,
1 to a sunny state and 1 to a rainy state.
The last R over here has no outbound transition,
so it doesn't really count in our statistic.
The maximum likelihood therefore is 0.5 or ½ for each of those.