Hi! I'm a Postdoctoral Associate in the Department of Electrical and Computer Engineering at Duke University, working under the supervision of Prof. Lawrence Carin. My research focuses on generative modeling and computer vision, particularly understanding the role of transformers in implementing functional gradient descent for categorical outcomes. Additionally, I am exploring how to adapt pretrained diffusion models, such as Stable Diffusion, for conditional generation of unseen classes or concepts using multimodal prompts. Previously, I was a PhD student in the Department of Computer Science and Engineering at IIT Kanpur, advised by Prof. Piyush Rai and Prof. Vinay P. Namboodiri (University of Bath). Before that, I completed my Master's in Computer Science from Banaras Hindu University and my Bachelor's from Ramakrishna Mission Vidyamandira.
Education
Indian Institute of Technology Kanpur
Integrated M.Tech. - Ph.D. in Computer Science and Engineering
Advisor: Prof. Piyush Rai & Prof. Vinay P. Namboodiri (University of Bath)
Thesis: Adaptable and Efficient AI Systems via Lifelong Learning and Unlearning
Banaras Hindu University
M.Sc. in Computer Science
Ramakrishna Mission Vidyamandira
B.Sc. in Computer Science (H)
Experience
Postdoc Associate — EECE @ Duke University
Advisor: Prof. Lawrence Carin
Working on Transformers, Generative Modelling and Computer Vision
Senior Student Research Associate — Indian Institute of Technology Kanpur
Advisor: Prof. Sachida Nand Tripathi & Prof. Piyush Rai
Developed novel algorithms for prediction of PM 2.5 concentration in the environment.
AI / ML Intern — Verisk Analytics
Worked on developing active learning methods.
Publications
British Machine Vision Conference (BMVC) 2024
RISSOLE: Parameter-efficient Diffusion Models via Block-wise Generation and Retrieval-Guidance
Mukherjee, A; Banerjee, S; Rai, P; Namboodiri, VP
International Conference on Robotics and Automation (ICRA) 2024
Verse: Virtual-gradient Aware Streaming Lifelong Learning with Anytime Inference
Banerjee, S; Verma, VK; Mukherjee, A; Gupta, D; Namboodiri, VP; Rai, P
International Conference on Robotics and Automation (ICRA) 2023
Streaming LifeLong Learning With Any-Time Inference
Banerjee, S; Verma, VK; Namboodiri, VP
Atmospheric Environment 2024
A Hybrid Approach for Integrating Micro-Satellite Images and Sensors Network-Based Ground Measurements Using Deep Learning for High-Resolution Prediction of Fine Particulate Matter (PM2.5) over an Indian City, Lucknow
Jain, Vaishali; Mukherjee, Avideep; Banerjee, Soumya; Madhwal, Sandeep; Bergin, Michael H.; Bhave, Prakash; Carlson, David; Jiang, Ziyang; Rai, Piyush; Tripathi, Sachchida
European Geosciences Union - General Assembly 2023
Predicting PM2.5 based on micro-satellite imagery and low-cost sensor network using CNN-RT-RF Joint Model
Tripathi, S; Jain, V; Mukherjee, A; Banerjee, S; Rai, P; Madhwal, S