codesandcoffee

A Concise Introduction to the Logistic Sigmoid Function

Nov 9, 20213 min read

Introduction The logistic sigmoid is one of the most popular activation functions used when working with the probability distributions associated with...

A Concise Introduction to the Logistic Sigmoid Function

A Concise Introduction to the ReLU Function

Sep 17, 20215 min read

Introduction The rectified linear unit function, ReLU, is one of the three most commonly used activation functions used in deep learning, including...

A Concise Introduction to the ReLU Function

A Subtle Introduction to The Softmax Function

Sep 12, 20213 min read

Introduction The softmax function is a generalization of the logistic function to multiple dimensions. It is often used as the last activation...

A Subtle Introduction to The Softmax Function