Summary of Blog Posts

Blog posts are organized under various topics here

Full Paper Review#

• GradCAM, Model Interpretability - VGG16 & Xception Networks Posted July 4, 2020 ‐ 11 min read
• With 20 Watts, We Built Cultures and Civilizations - Story of a Spiking Neuron Posted May 9, 2021 ‐ 13 min read
• Understanding Post-Synaptic Depression through Tsodyks-Markram Model by Solving Ordinary Differential Equation Posted March 12, 2021 ‐ 9 min read
• Cocktail Party Problem - Eigentheory and Blind Source Separation Using ICA - Part 1 Posted July 18, 2021 ‐ 13 min read
• Blind Source Separation using ICA - A Practical Guide to Separate Audio Signals - Part 2 Posted July 24, 2021 ‐ 7 min read
• Atoms and Bonds 2 - ML for Predicting Quantum Mechanical Properties of Organic Molecules Posted October 8, 2021 ‐ 10 min read
• Quotient-Remainder Embedding, Dealing With Categorical Data In A DLRM - A Paper Review Posted December 3, 2021 ‐ 7 min read

Neuroscience#

• Higher Cognition through Inductive Bias, Out-of-Distribution and Biological Inspiration Posted April 24, 2021 ‐ 12 min read
• With 20 Watts, We Built Cultures and Civilizations - Story of a Spiking Neuron Posted May 9, 2021 ‐ 13 min read
• Understanding Post-Synaptic Depression through Tsodyks-Markram Model by Solving Ordinary Differential Equation Posted March 12, 2021 ‐ 9 min read
• Need For Understanding Brain Functions, Introducing Medical Images - Brain, Heart and Hippocampus Posted June 26, 2021 ‐ 11 min read
• Gossips and Epicenter of Emotions for our Existence - Study on Anatomy of Limbic System Posted September 5, 2021 ‐ 9 min read

ML/AI#

Fundamentals#

• Metrics That We Measure - Measuring Efficacy of Your Machine Learning Models Posted October 30, 2021 ‐ 7 min read
• Tensorflow 2: Introduction, Feature Engineering and Metrics Posted April 4, 2020 ‐ 27 min read
• Quotient-Remainder Embedding, Dealing With Categorical Data In A DLRM - A Paper Review Posted December 3, 2021 ‐ 7 min read
• 3rd Wave in India, Covid Debacle Continues - Let us Use Covid Data to Learn Piecewise LR and Exponential Curve Fitting Posted January 7, 2020 - 8 min read
• Introduction to Contrastive Loss - Similarity Metric as an Objective Function Posted January 30, 2022 ‐ 6 min read

Recommenders#

• Quotient-Remainder Embedding, Dealing With Categorical Data In A DLRM - A Paper Review Posted December 3, 2021 ‐ 7 min read
• TFRS for DLRMs At Enterprise Scale - A Practical Guide to Understand Deep and Cross Networks Posted December 10, 2021 ‐ 10 min read

Object Detection#

• ResNet50 vs InceptionV3 vs Xception vs NASNet - Introduction to Transfer Learning Posted June 28, 2019 ‐ 23 min read
• GradCAM, Model Interpretability - VGG16 & Xception Networks Posted July 4, 2020 ‐ 11 min read
• Causal Reasoning, Trustworthy Models and Model Explainability using Saliency Maps Posted May 2, 2021 ‐ 9 min read

Transformers#

• Higher Cognition through Inductive Bias, Out-of-Distribution and Biological Inspiration Posted April 24, 2021 ‐ 12 min read
• La Memoire, C’est Poser Son Attention Sur Le Temps Posted June 5, 2021 ‐ 10 min read
• Relooking Attention Models, SHA-RNN Overview, gMLP Briefing and Measuring Efficacy of Language Models through Perplexity Posted September 11, 2021 ‐ 10 min read
• Understanding Self Attention and Positional Encoding Of The Transformer Architecture Posted December 17, 2021 ‐ 9 min read
• Transformers Everywhere - Patch Encoding Technique for Vision Transformers(ViT) Explained Posted December 24, 2021 ‐ 8 min read

Model Explainability#

• GradCAM, Model Interpretability - VGG16 & Xception Networks Posted July 4, 2020 ‐ 11 min read
• Causal Reasoning, Trustworthy Models and Model Explainability using Saliency Maps Posted May 2, 2021 ‐ 9 min read
• Information Gain, Gini Index - Measuring and Reducing Uncertainty for Decision Trees Posted April 17, 2021 ‐ 9 min read
• Attribution and Counterfactuals - SHAP, LIME and DiCE Posted June 19, 2021 - 10 min read
• Courage and Data Literacy Required to Deploy an AI Model and Exploring Design Patterns for AI Posted July 10, 2021 ‐ 18 min read

Causality#

• Causal Reasoning, Trustworthy Models and Model Explainability using Saliency Maps Posted May 2, 2021 ‐ 9 min read
• Is Covid Crisis Lead to Prosperity - Causal Inference from a Counterfactual World Using Facebook Prophet Posted June 12, 2021 ‐ 12 min read
• Attribution and Counterfactuals - SHAP, LIME and DiCE Posted June 19, 2021 - 10 min read

GNN#

• Introduction to Graph Neural Networks Posted September 19, 2021 ‐ 9 min read
• Graph Convolution Network - A Practical Implementation of Vertex Classifier and it’s Mathematical Basis Posted September 25, 2021 ‐ 10 min read
• Atoms and Bonds - Graph Representation of Molecular Data For Drug Detection Posted October 2, 2021 ‐ 15 min read
• Atoms and Bonds 2 - ML for Predicting Quantum Mechanical Properties of Organic Molecules Posted October 8, 2021 ‐ 10 min read

MLOps#

• Istio Service Mesh, Canary Release Routing Strategies for ML Deployments in a Kubernetes Cluster Posted October 16, 2021 ‐ 13 min read
• Evaluating Large Language Models Generated Contents with TruEra’s TruLens Posted Mar 17, 2024 ‐ 12 min read

Data Engineering#

• Airflow Trigger Rules for Building Complex Data Pipelines Explained, and My Initial Days of Airflow Selection and Experience Posted May 1, 2022 ‐ 9 min read

Probabilistic ML/DNN#

Information Theory#

• The Best Way to Minimize Uncertainty is NOT Being Informed, Surprised? Let us Measure Surprise Posted January 14, 2022 ‐ 6 min read

Uncertainty#

• Gaussian Process and Related Ideas To Kick Start Bayesian Inference Posted October 24, 2021 ‐ 8 min read
• Relooking Attention Models, SHA-RNN Overview, gMLP Briefing and Measuring Efficacy of Language Models through Perplexity Posted September 11, 2021 ‐ 10 min read
• Bayesian and Frequentist Approach to Machine Learning Models Posted March 27, 2021 ‐ 5 min read
• Understaning Uncertainty, Deterministic to Probabilistic Neural Networks Posted March 19, 2021 ‐ 8 min read
• Shannon’s Entropy, Measure of Uncertainty When Elections are Around Posted April 3, 2021 ‐ 6 min read
• KL-Divergence, Relative Entropy in Deep Learning Posted April 10, 2021 ‐ 5 min read
• Information Gain, Gini Index - Measuring and Reducing Uncertainty for Decision Trees Posted April 17, 2021 ‐ 9 min read

Density Estimation#

• Normalizing Flows - A Practical Guide Using Tensorflow Probability Posted May 29, 2021 ‐ 9 min read
• Cocktail Party Problem - Eigentheory and Blind Source Separation Using ICA Posted July 18, 2021 ‐ 13 min read
• Bijectors of Tensorflow Probability - A Guide to Understand the Motivation and Mathematical Intuition Behind Them Posted November 7, 2021 ‐ 11 min read
• Dequantization for Categorical Data, Categorical NFs via Continuous Transformations - A Paper Review Posted November 13, 2021 ‐ 9 min read
• Ever Wondered that Voice is from a Human Being or Created by a Computer? Revisiting Normalizing Flows Posted December 31, 2021 ‐ 8 min read

Time Series#

• A Practical Guide to Univariate Time Series Models with Seasonality and Exogenous Inputs using Finance Data of FMCG Manufacturers Posted August 21, 2021 ‐ 10 min read
• Trend, Features of Structural Time Series, Mathematical Intuition Behind Trend Analysis for STS Posted August 14, 2021 ‐ 6 min read
• Fourier Series as a Function of Approximation for Seasonality Modeling - Exploring Facebook Prophet’s Architecture Posted August 8, 2021 ‐ 8 min read
• Structural Time Series Models, Why We Call It Structural? A Bayesian Scheme For Time Series Forecasting Posted August 1, 2021 ‐ 7 min read
• Is Covid Crisis Lead to Prosperity - Causal Inference from a Counterfactual World Using Facebook Prophet Posted June 12, 2021 ‐ 12 min read

Energy Based Models#

• Temperature is Nothing but Measure of Speed of the Particles at Molecular Scale - Intro 2 Maxwell Boltzmann Distribution Posted January 23, 2022 ‐ 8 min read
• Introduction to Contrastive Loss - Similarity Metric as an Objective Function Posted January 30, 2022 ‐ 6 min read

Math for AI/ML#

Convergence#

• That Straight Line Looks a Bit Silly - Let Us Approximate A Sine Wave Using UAT Posted November 29, 2021 ‐ 4 min read
• Why Covariance Matrix Should Be Positive Semi-Definite, Tests Using Breast Cancer Dataset Posted May 23, 2021 ‐ 8 min read
• La Memoire, C’est Poser Son Attention Sur Le Temps Posted June 5, 2021 ‐ 10 min read
• Do You Know We Can Approximate Any Continuous Function With A Single Hidden Layer Neural Network - A Visual Guide Posted November 27, 2021 ‐ 10 min read
• 3rd Wave in India, Covid Debacle Continues - Let us Use Covid Data to Learn Piecewise LR and Exponential Curve Fitting Posted January 7, 2020 - 8 min read

Eigen Theory#

• Eigenvalue, Eigenvector, Eigenspace and Implementation of Google’s PageRank Algorithm Posted July 3, 2021 ‐ 8 min read
• Cocktail Party Problem - Eigentheory and Blind Source Separation Using ICA - Part 1 Posted July 18, 2021 ‐ 13 min read
• Blind Source Separation using ICA - A Practical Guide to Separate Audio Signals - Part 2 Posted July 24, 2021 ‐ 7 min read

Statistics#

• Survival Analysis using Lymphoma, Breast Cancer Dataset and A Practical Guide to Kaplan Meier Estimator Posted November 20, 2021 ‐ 9 min read

Numerical Methods, Calculus#

• Methodus Fluxionum et Serierum Infinitarum - Numerical Methods for Solving ODEs Using Our Favorite Tools Posted August 28, 2021 ‐ 8 min read
• Roll your sleeves! Let us do some partial derivatives. Posted August 14, 2020 ‐ 3 min read
• Automatic Differentiation Using Gradient Tapes Posted December 14, 2020 ‐ 9 min read
• Calculus - Gradient Descent Optimization through Jacobian Matrix for a Gaussian Distribution Posted May 15, 2021 ‐ 12 min read

Compute Complexity#

• Time and Space Complexity - 5 Governing Rules Posted February 28, 2020 ‐ 9 min read

Misc#

• Deep Learning is Not As Impressive As you Think, It’s Mere Interpolation Posted November 24, 2021 ‐ 14 min read

• The 40 rules of love Posted December 23, 2023 ‐ 41 min read