ECEN 755: Stochastic Systems
Guest Lecturer, Texas A&M University
Lectures on dynamic programming: deterministic and stochastic DP, the Hamilton–Jacobi–Bellman equation, and infinite-horizon discounted problems.
Postdoctoral Researcher, Electrical and Computer Engineering
Texas A&M University
I work on building AI agents that understand and act reliably in the physical world. Drawing on the long-standing theory of adaptive control, I address fundamental questions in world models, such as exploration and adaptation.
I am a postdoctoral researcher at Texas A&M University, working with Prof. P. R. Kumar, with whom I also completed my PhD in 2026. Before that, I completed a dual degree (B.Tech. + M.Tech.) in Electrical Engineering at IIT Bombay.
I am on the academic job market for 2026–27.
Optimistic World Models change how a world model is trained: an optimistic dynamics loss, derived from reward-biased maximum likelihood estimation in adaptive control, biases imagined transitions toward higher-reward outcomes. The loss is fully gradient-based, needs no uncertainty estimates, and plugs into existing world-model architectures; we instantiate it in DreamerV3 and STORM.
Key paper: arXiv 2026
Reward-Biased Maximum Likelihood Estimation (RBMLE) fits a model of the environment by maximum likelihood, biased toward models that promise higher reward, so that the model the agent learns is shaped by what it needs to control. I have developed RBMLE for Markov decision processes and linear systems, with applications to safe, multi-objective, and RLHF settings.
Key papers: L4DC 2021 · Allerton 2023
For linear systems, I study how well an agent can learn its model while controlling with it, measured by regret. PIECE is a self-tuning regulator for auto-regressive systems with the first O(log T) regret bound for self-tuning regulation, and augmented RBMLE-UCB brings reward-biased model learning to adaptive linear–quadratic control.
Key papers: ICML 2024 · NeurIPS 2022
International Conference on Machine Learning PDF
Allerton Conference on Communication, Control, and Computing Invited PDF
Conference on Information Sciences and Systems Invited PDF
IEEE Applied Power Electronics Conference and Exposition Paper
ACM Transactions on Modeling and Performance Evaluation of Computing Systems PDF
International Conference on Communication Systems & Networks Paper
Technologies for the Wireless Edge Workshop, MobiCom Paper
Guest Lecturer, Texas A&M University
Lectures on dynamic programming: deterministic and stochastic DP, the Hamilton–Jacobi–Bellman equation, and infinite-horizon discounted problems.
Long tutorial, Indian Control Conference (ICC 2023)
ICML · NeurIPS · AISTATS · AAAI · L4DC · CDC · ACC · ICC
Texas A&M University, College Station, TX
Host: P. R. Kumar
Texas A&M University, College Station, TX
Dissertation: The Exploration–Exploitation Trade-Off in Reinforcement Learning
Advisor: P. R. Kumar
Network Analytics and Automation Group, Bedminster, NJ
Reinforcement learning for network slicing. Mentor: H. Wang
Indian Institute of Technology Bombay, Mumbai
Communication and Signal Processing
Advisors: D. Manjunath, J. Nair, S. Moharir