Bipin's Bubble

My experiences with covid

A little personal update Got tested positive for CoViD-19 this week No definitive source of infection that I know of Writing this journal to document my symptoms and experiences Will be WIP till I fully recover Since the course of infection to different people is different: Do not expect to have the same experiences as me ... Read more

Information Theory 1

The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 4 of the corresponding chapter of the book. Introduction and definitions Information theory is needed to characterize probability distributions and compare them. Quantifying similarity between probability distributions ... Read more

Probability 3: Structured Probabilistic Models

The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 3 of the corresponding chapter of the book. Background ML algorithms involve large number of random variables. Joint Probability distribution of these many variables is complex. Often, very few variables interact wi... Read more

Probability 2: Common Probability Distributions

The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 2 of the corresponding chapter of the book. Bernoulli Distribution Single Binary Random variable: possible two sates are: 0,1. Controlled by single parameter: $\phi \in [0,1]$ which gives the probability of random variable taking ... Read more

Probability 1

The chapter 2 of Deep Learning Book is focussed on Probability and Information Theory. This post is TLDR part 1 of the corresponding chapter of the book. Why Probability? Not all physical phenomena are deterministic. Stochastic quantities and uncertain quantities are naturally present in many sources of data. Sources of uncertainty: ... Read more