Gumbel Softmax

Gumbel-Softmax: A Continuous Distribution for Categorical Outputs If you're interested in machine learning, you may have heard the term "Gumbel-Softmax" thrown around. But what exactly is it? In simple terms, Gumbel-Softmax is a type of probability distribution that can be used in neural networks to generate categorical outputs. Understanding Probability Distributions Before diving into Gumbel-Softmax specifically, let's take a step back and talk about probability distributions in general. A