# Summary of Blog Posts

Blog posts are organized under various topics here

## Full Paper Review

- GradCAM, Model Interpretability - VGG16 & Xception Networks

Posted July 4, 2020 ‐ 11 min read - With 20 Watts, We Built Cultures and Civilizations - Story of a Spiking Neuron

Posted May 9, 2021 ‐ 13 min read - Understanding Post-Synaptic Depression through Tsodyks-Markram Model by Solving Ordinary Differential Equation

Posted March 12, 2021 ‐ 9 min read - Cocktail Party Problem - Eigentheory and Blind Source Separation Using ICA - Part 1

Posted July 18, 2021 ‐ 13 min read - Blind Source Separation using ICA - A Practical Guide to Separate Audio Signals - Part 2

Posted July 24, 2021 ‐ 7 min read - Atoms and Bonds 2 - ML for Predicting Quantum Mechanical Properties of Organic Molecules

Posted October 8, 2021 ‐ 10 min read - Quotient-Remainder Embedding, Dealing With Categorical Data In A DLRM - A Paper Review

Posted December 3, 2021 ‐ 7 min read

## Neuroscience

- Higher Cognition through Inductive Bias, Out-of-Distribution and Biological Inspiration

Posted April 24, 2021 ‐ 12 min read - With 20 Watts, We Built Cultures and Civilizations - Story of a Spiking Neuron

Posted May 9, 2021 ‐ 13 min read - Understanding Post-Synaptic Depression through Tsodyks-Markram Model by Solving Ordinary Differential Equation

Posted March 12, 2021 ‐ 9 min read - Need For Understanding Brain Functions, Introducing Medical Images - Brain, Heart and Hippocampus

Posted June 26, 2021 ‐ 11 min read - Gossips and Epicenter of Emotions for our Existence - Study on Anatomy of Limbic System

Posted September 5, 2021 ‐ 9 min read

## ML/AI

### Fundamentals

- Metrics That We Measure - Measuring Efficacy of Your Machine Learning Models

Posted October 30, 2021 ‐ 7 min read - Tensorflow 2: Introduction, Feature Engineering and Metrics

Posted April 4, 2020 ‐ 27 min read - Quotient-Remainder Embedding, Dealing With Categorical Data In A DLRM - A Paper Review

Posted December 3, 2021 ‐ 7 min read - 3rd Wave in India, Covid Debacle Continues - Let us Use Covid Data to Learn Piecewise LR and Exponential Curve Fitting

Posted January 7, 2020 - 8 min read - Introduction to Contrastive Loss - Similarity Metric as an Objective Function

Posted January 30, 2022 ‐ 6 min read

### Recommenders

- Quotient-Remainder Embedding, Dealing With Categorical Data In A DLRM - A Paper Review

Posted December 3, 2021 ‐ 7 min read - TFRS for DLRMs At Enterprise Scale - A Practical Guide to Understand Deep and Cross Networks

Posted December 10, 2021 ‐ 10 min read

### Object Detection

- ResNet50 vs InceptionV3 vs Xception vs NASNet - Introduction to Transfer Learning

Posted June 28, 2019 ‐ 23 min read - GradCAM, Model Interpretability - VGG16 & Xception Networks

Posted July 4, 2020 ‐ 11 min read - Causal Reasoning, Trustworthy Models and Model Explainability using Saliency Maps

Posted May 2, 2021 ‐ 9 min read

### Transformers

- Higher Cognition through Inductive Bias, Out-of-Distribution and Biological Inspiration

Posted April 24, 2021 ‐ 12 min read - La Memoire, C’est Poser Son Attention Sur Le Temps

Posted June 5, 2021 ‐ 10 min read - Relooking Attention Models, SHA-RNN Overview, gMLP Briefing and Measuring Efficacy of Language Models through Perplexity

Posted September 11, 2021 ‐ 10 min read - Understanding Self Attention and Positional Encoding Of The Transformer Architecture

Posted December 17, 2021 ‐ 9 min read - Transformers Everywhere - Patch Encoding Technique for Vision Transformers(ViT) Explained

Posted December 24, 2021 ‐ 8 min read

### Model Explainability

- GradCAM, Model Interpretability - VGG16 & Xception Networks

Posted July 4, 2020 ‐ 11 min read - Causal Reasoning, Trustworthy Models and Model Explainability using Saliency Maps

Posted May 2, 2021 ‐ 9 min read - Information Gain, Gini Index - Measuring and Reducing Uncertainty for Decision Trees

Posted April 17, 2021 ‐ 9 min read - Attribution and Counterfactuals - SHAP, LIME and DiCE

Posted June 19, 2021 - 10 min read - Courage and Data Literacy Required to Deploy an AI Model and Exploring Design Patterns for AI

Posted July 10, 2021 ‐ 18 min read

### Causality

- Causal Reasoning, Trustworthy Models and Model Explainability using Saliency Maps

Posted May 2, 2021 ‐ 9 min read - Is Covid Crisis Lead to Prosperity - Causal Inference from a Counterfactual World Using Facebook Prophet

Posted June 12, 2021 ‐ 12 min read - Attribution and Counterfactuals - SHAP, LIME and DiCE

Posted June 19, 2021 - 10 min read

### GNN

- Introduction to Graph Neural Networks

Posted September 19, 2021 ‐ 9 min read - Graph Convolution Network - A Practical Implementation of Vertex Classifier and it’s Mathematical Basis

Posted September 25, 2021 ‐ 10 min read - Atoms and Bonds - Graph Representation of Molecular Data For Drug Detection Posted October 2, 2021 ‐ 15 min read
- Atoms and Bonds 2 - ML for Predicting Quantum Mechanical Properties of Organic Molecules

Posted October 8, 2021 ‐ 10 min read

### MLOps

- Istio Service Mesh, Canary Release Routing Strategies for ML Deployments in a Kubernetes Cluster

Posted October 16, 2021 ‐ 13 min read

### Data Engineering

- Airflow Trigger Rules for Building Complex Data Pipelines Explained, and My Initial Days of Airflow Selection and Experience

Posted May 1, 2022 ‐ 9 min read

## Probabilistic ML/DNN

### Information Theory

- The Best Way to Minimize Uncertainty is NOT Being Informed, Surprised? Let us Measure Surprise

Posted January 14, 2022 ‐ 6 min read

### Uncertainty

- Gaussian Process and Related Ideas To Kick Start Bayesian Inference

Posted October 24, 2021 ‐ 8 min read - Relooking Attention Models, SHA-RNN Overview, gMLP Briefing and Measuring Efficacy of Language Models through Perplexity

Posted September 11, 2021 ‐ 10 min read - Bayesian and Frequentist Approach to Machine Learning Models

Posted March 27, 2021 ‐ 5 min read - Understaning Uncertainty, Deterministic to Probabilistic Neural Networks

Posted March 19, 2021 ‐ 8 min read - Shannon’s Entropy, Measure of Uncertainty When Elections are Around

Posted April 3, 2021 ‐ 6 min read - KL-Divergence, Relative Entropy in Deep Learning

Posted April 10, 2021 ‐ 5 min read - Information Gain, Gini Index - Measuring and Reducing Uncertainty for Decision Trees

Posted April 17, 2021 ‐ 9 min read

### Density Estimation

- Normalizing Flows - A Practical Guide Using Tensorflow Probability

Posted May 29, 2021 ‐ 9 min read - Cocktail Party Problem - Eigentheory and Blind Source Separation Using ICA

Posted July 18, 2021 ‐ 13 min read - Bijectors of Tensorflow Probability - A Guide to Understand the Motivation and Mathematical Intuition Behind Them

Posted November 7, 2021 ‐ 11 min read - Dequantization for Categorical Data, Categorical NFs via Continuous Transformations - A Paper Review

Posted November 13, 2021 ‐ 9 min read - Ever Wondered that Voice is from a Human Being or Created by a Computer? Revisiting Normalizing Flows

Posted December 31, 2021 ‐ 8 min read

### Time Series

- A Practical Guide to Univariate Time Series Models with Seasonality and Exogenous Inputs using Finance Data of FMCG Manufacturers

Posted August 21, 2021 ‐ 10 min read - Trend, Features of Structural Time Series, Mathematical Intuition Behind Trend Analysis for STS

Posted August 14, 2021 ‐ 6 min read - Fourier Series as a Function of Approximation for Seasonality Modeling - Exploring Facebook Prophet’s Architecture

Posted August 8, 2021 ‐ 8 min read - Structural Time Series Models, Why We Call It Structural? A Bayesian Scheme For Time Series Forecasting

Posted August 1, 2021 ‐ 7 min read - Is Covid Crisis Lead to Prosperity - Causal Inference from a Counterfactual World Using Facebook Prophet

Posted June 12, 2021 ‐ 12 min read

### Energy Based Models

- Temperature is Nothing but Measure of Speed of the Particles at Molecular Scale - Intro 2 Maxwell Boltzmann Distribution

Posted January 23, 2022 ‐ 8 min read - Introduction to Contrastive Loss - Similarity Metric as an Objective Function

Posted January 30, 2022 ‐ 6 min read

## Math for AI/ML

### Convergence

- That Straight Line Looks a Bit Silly - Let Us Approximate A Sine Wave Using UAT

Posted November 29, 2021 ‐ 4 min read - Why Covariance Matrix Should Be Positive Semi-Definite, Tests Using Breast Cancer Dataset

Posted May 23, 2021 ‐ 8 min read - La Memoire, C’est Poser Son Attention Sur Le Temps

Posted June 5, 2021 ‐ 10 min read - Do You Know We Can Approximate Any Continuous Function With A Single Hidden Layer Neural Network - A Visual Guide

Posted November 27, 2021 ‐ 10 min read - 3rd Wave in India, Covid Debacle Continues - Let us Use Covid Data to Learn Piecewise LR and Exponential Curve Fitting

Posted January 7, 2020 - 8 min read

### Eigen Theory

- Eigenvalue, Eigenvector, Eigenspace and Implementation of Google’s PageRank Algorithm

Posted July 3, 2021 ‐ 8 min read - Cocktail Party Problem - Eigentheory and Blind Source Separation Using ICA - Part 1

Posted July 18, 2021 ‐ 13 min read - Blind Source Separation using ICA - A Practical Guide to Separate Audio Signals - Part 2

Posted July 24, 2021 ‐ 7 min read

### Statistics

- Survival Analysis using Lymphoma, Breast Cancer Dataset and A Practical Guide to Kaplan Meier Estimator

Posted November 20, 2021 ‐ 9 min read

### Numerical Methods, Calculus

- Methodus Fluxionum et Serierum Infinitarum - Numerical Methods for Solving ODEs Using Our Favorite Tools

Posted August 28, 2021 ‐ 8 min read - Roll your sleeves! Let us do some partial derivatives.

Posted August 14, 2020 ‐ 3 min read - Automatic Differentiation Using Gradient Tapes

Posted December 14, 2020 ‐ 9 min read - Calculus - Gradient Descent Optimization through Jacobian Matrix for a Gaussian Distribution

Posted May 15, 2021 ‐ 12 min read

### Compute Complexity

- Time and Space Complexity - 5 Governing Rules

Posted February 28, 2020 ‐ 9 min read

### Misc

- Deep Learning is Not As Impressive As you Think, It’s Mere Interpolation

Posted November 24, 2021 ‐ 14 min read