A little personal update Got tested positive for CoViD-19 this week No definitive source of infection that I know of Writing this journal to document my symptoms and experiences Will be WIP till I fully recover Since the course of infection to different people is different: Do not expect to have the same experiences as me ... Read more 08 Oct 2020 - 4 minute read
The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 4 of the corresponding chapter of the book. Introduction and definitions Information theory is needed to characterize probability distributions and compare them. Quantifying similarity between probability distributions ... Read more 26 Sep 2020 - 3 minute read
The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 3 of the corresponding chapter of the book. Background ML algorithms involve large number of random variables. Joint Probability distribution of these many variables is complex. Often, very few variables interact wi... Read more 25 Sep 2020 - 2 minute read
The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 2 of the corresponding chapter of the book. Bernoulli Distribution Single Binary Random variable: possible two sates are: 0,1. Controlled by single parameter: $\phi \in [0,1]$ which gives the probability of random variable taking ... Read more 24 Sep 2020 - 5 minute read
The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 1 of the corresponding chapter of the book. Why Probability? Not all physical phenomena are deterministic. Stochastic quantities and uncertain quantities are naturally present in many sources of data. Sources of uncertainty: ... Read more 23 Sep 2020 - 7 minute read