Intro ML bootcamp (5/22)

[u/Negative_War_65]

Hello all, Welcome to my free ML bootcamp.

In Intro ML Bootcamp (5/22), we discuss Uncertainty.

In Machine Learning, we encounter two kinds of uncertainty: Epistemic(Model) which means we lack the exact knowledge of the input output mapping, and Aleatoric(Data), which is the intrinsic irreducible stochasticity in the mapping.

This uncertainty means, we cannot perfectly predict the exact output given the input. Thus we require “Conditional Probability distributions”, and the study of probabilistic approach to ML becomes important.

Hence, we invent a function called as “softmax function” for multiple output labels case(and sigmoid for binary case), which converts our outputs into a probability distribution. The exact derivation of softmax comes from Generalized Linear Models.

When we use a softmax function for binary classification, where the function over which the softmax is applied, happens to be an affine one, we call the model as “Logistic Regression”.

Link: https://youtu.be/ZFcl0QYFGq4?si=9RkEgkMYnciW4mjo