Research
Research overview
Intelligent control systems must operate reliably and efficiently in uncertain environments shared with humans. Biological systems face the same challenge: they produce robust behavior despite noisy, delayed, and limited information. My research centers on a question that is essential in both science and technology: how can we design intelligent control systems with lifelong assurance of safety, robustness, efficiency, and adaptability? To answer it, my group develops control and learning techniques and applies them to autonomous vehicles and robots, human–machine interaction, human sensorimotor control, and safety-critical decision policies.
Robust and safe control
Many systems contain latent variables that make their dynamics partially unidentifiable. More fundamentally, data-driven techniques can confuse correlation with causation, producing spurious distribution shifts in observed statistics that corrupt learned models and safety certificates. We develop safety certificates that remain valid under exactly these conditions.
The foundation is a probabilistic invariance framework that states invariance conditions in probability space. It lets risk measures learned from limited data or observation be converted into safety certificates with long-term assurance despite latent risks. Building on it, we used causal reinforcement learning to construct consistently feasible safety conditions from data even under spurious distribution shifts, the first integration of causal RL into stochastic safe control.
The same framework yields certificates that work with incomplete information, such as occlusions in navigation and the absence of centralized communication in multi-agent systems. It produces myopic, affine control constraints with assured long-term safety and exploits low-dimensional risk representations, analogous to biological reflexes, to operate under limited computation. Because the certificates accept modular risk models, controllers adapt to changing environments and can draw on external risk-quantification tools.
Representative publications
- Safety Certificate Against Latent Variables with Partially Unidentifiable DynamicsInternational Conference on Machine Learning (ICML), 2025
- Myopically Verifiable Probabilistic Certificates for Safe Control and LearningIEEE Transactions on Automatic Control (accepted)
- Myopically Verifiable Probabilistic Certificate for Long-Term SafetyAmerican Control Conference (ACC), 2022
- Probabilistic Safety Certificate for Multi-Agent Safe Control and LearningIEEE Transactions on Control of Network Systems (accepted)
- Probabilistic Safety Certificate for Multi-Agent SystemsIEEE Conference on Decision and Control (CDC), 2022
- An Occlusion- and Interaction-Aware Safe Control Strategy for Autonomous VehiclesIFAC World Congress, 2023
- Scalable Long-Term Safety Certificate for Large-Scale SystemsIEEE Control Systems Letters, 2023
- Adaptive Safe Control for Driving in Uncertain EnvironmentsIEEE Intelligent Vehicles Symposium (IV), 2022
- Safe Control in the Presence of Stochastic UncertaintiesIEEE Conference on Decision and Control (CDC), 2021
Risk quantification and probabilistic reachability
Quantifying long-term risk is difficult for three reasons: risk events are rare in data, computation must scale to high-dimensional and multi-agent systems, and risks differ across heterogeneous systems. Our work addresses each of these.
To learn from limited data, we developed physics-informed learning techniques that combine empirical data with physics information. We showed that four distinct classes of long-term risk probabilities are characterized by partial differential equations, and designed B-spline neural architectures that enforce PDE boundary conditions by construction. Analysis and experiments show that this framework infers long-term risk from short-horizon samples with few risk events, generalizes beyond the sampled states and horizons, and computes stable probability gradients.
For computational efficiency, low-dimensional risk representations scale the approach to problems with thousands of dimensions, and a decomposition framework quantifies risk in sparsely connected multi-agent systems through low-dimensional subproblems. Physics-informed reinforcement learning solves probabilistic reachability problems with fewer visits to risky states and with sparse rewards, for example estimating vehicle drift probability from binary safety labels. For heterogeneous systems, a B-spline neural operator architecture provides provable approximation and generalization guarantees.
Representative publications
- A Generalizable Physics-Informed Learning Framework for Risk Probability EstimationLearning for Dynamics and Control Conference (L4DC), 2023
- Generalizable Physics-Informed Learning for Stochastic Safety-Critical SystemsIEEE Transactions on Automatic Control (accepted)
- Physics-Informed Deep B-Spline Networks for Dynamical SystemsJournal of Machine Learning Research (JMLR), 2025
- Neural Spline Operators for Risk Quantification in Stochastic SystemsIEEE Conference on Decision and Control (CDC), 2025
- Physics-Informed Representation and Learning: Control and Risk QuantificationAAAI Conference on Artificial Intelligence, 2024
- Orthogonal Modal Representation in Long-Term Risk Quantification for Dynamic Multi-Agent SystemsIEEE Control Systems Letters, 2024
- Physics-Informed RL for Maximal Safety Probability EstimationAmerican Control Conference (ACC), 2024
- Autonomous Drifting Based on Maximal Safety Probability LearningIEEE International Conference on Intelligent Transportation Systems (ITSC), 2024
Neural networks for uncertain and non-stationary systems
Uncertainty quantification is essential for the robust deployment of deep learning in physical systems, yet it usually relies on costly sampling or coarse approximations. We developed a sample-free method that characterizes the input–output distributions of neural networks by propagating mean vectors and covariance matrices through the network. The key enabler is an analytic solution for the covariance of random variables passed through nonlinear activations such as Heaviside, ReLU, and GELU.
This result underpins training techniques for Bayesian neural networks based on deterministic variational inference and, more recently, a dual Bayesian inference scheme that reformulates fine-tuning as two coupled Bayesian updates: one incorporates new data as it arrives, the other performs layer-wise inference through closed-form moment propagation. Propagating analytic moments in a single pass gives ultra-low-latency adaptation from a small number of samples, which is what sequential fine-tuning under shifting distributions requires.
Representative publications
- An Analytic Solution to Covariance Propagation in Neural NetworksInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2024
- Kalman Bayesian TransformerIEEE Conference on Decision and Control (CDC), 2025
Intelligent control and human–machine interaction
To enhance robustness and adaptability, we developed techniques for attack-resilient estimation and control, stabilization of unknown systems with fundamental sample-complexity limits, predictive control with regret guarantees for non-stationary environments, and fast bandit-based meta-learning across diverse environments.
Safety in the long run also depends on how people respond to machines. Through modeling and human experiments, we showed that a worst-case safe control strategy can trigger adverse human adaptation that increases risk for everyone, and demonstrated how to facilitate more desirable adaptation over many interactions. We also built frameworks that predict and influence human behavior for proactive, safe human–robot collaboration.
These methods have been applied to autonomous driving, robots, smart grids and electric vehicle charging, cloud computing, building HVAC systems, and poverty-alleviation policy design, where our work was the first to bring a control-theoretic perspective to microfinance.
Representative publications
- Rethinking Safe Control in the Presence of Self-Seeking HumansAAAI Conference on Artificial Intelligence, 2023
- Towards Proactive Safe Human-Robot Collaborations via Data-Efficient Conditional Behavior PredictionIEEE International Conference on Robotics and Automation (ICRA), 2024
- Stabilizing Linear Systems under Partial Observability: Sample Complexity and Fundamental LimitsConference on Neural Information Processing Systems (NeurIPS), 2025
- Sample Complexity of Stabilizing LTI Systems on a Single Trajectory under Stochastic NoiseConference on Uncertainty in Artificial Intelligence (UAI), 2025
- Predictive Control and Regret Analysis of Non-Stationary MDP with Look-Ahead InformationUnder review, Transactions on Machine Learning Research, 2025
- Fast Bandit-Based Policy Adaptation in Diverse EnvironmentsAmerican Control Conference (ACC), 2025
- Attack-Resilient H2, H∞, and ℓ1 State EstimatorIEEE Transactions on Automatic Control, 2017
- Dynamic State Estimation in the Presence of Compromised Sensory DataIEEE Conference on Decision and Control (CDC), 2015
- A Learning and Control Perspective for MicrofinanceLearning for Dynamics and Control Conference (L4DC), 2023
- Generalized Exact Scheduling: A Minimal-Variance Distributed Deadline SchedulerOperations Research, 2023
- Smoothed Least-Laxity-First Algorithm for Electric Vehicle Charging: Online Decision and Performance Analysis with Resource AugmentationIEEE Transactions on Smart Grid, 2021
- Optimizing HVAC Systems for Energy Efficiency and Control: A Scalable and Robust Multi-Zone Control Approach with Uncertainty ConsiderationsASCE International Conference on Computing in Civil Engineering (i3CE), 2023
Language-guided and context-aware control
Natural language carries context that sensors and models cannot: instructions, preferences, and warnings about latent risks. We are developing frameworks in which large language models supply this context to safe controllers. Our work translates human instructions into constraints and actions while accounting for context and latent risks, adapts probabilistic safety certificates online from natural-language guidance together with Bayesian estimators, and extends language guidance to distributed control of multi-agent systems.
In the other direction, control-theoretic tools inform the development of language models themselves. As a Project Researcher at the Research and Development Center for Large Language Models at Japan's National Institute of Informatics, I apply control-theoretic techniques to support the development of large language models and language-action models.
Representative publications
- Context-Aware LLM-Based Safe Control Against Latent RisksAmerican Control Conference (ACC), 2026
- Online Adaptive Probabilistic Safety Certificate with Language GuidanceLearning for Dynamics and Control Conference (L4DC), 2026
- UAVGENT: A Language-Guided Distributed Control FrameworkarXiv preprint, 2026
- OpInf-LLM: Parametric PDE Solving with LLMs via Operator InferencearXiv preprint, 2026
Physical AI and humanoid robots
We are currently developing next-generation Vision-Language-Action (VLA) models and deploying them onto advanced humanoid robots. On the algorithmic front, we develop ultra-efficient fine-tuning techniques that empower these VLA models to master highly complex, real-world tasks. This deployment phase is conducted in close collaboration with Fujitsu Research as part of their pioneering Physical AI initiative, which includes the Fujitsu–Carnegie Mellon Physical AI Research Center launched in April 2026.
Representative publications
- Online Adaptive Probabilistic Safety Certificate with Language GuidanceLearning for Dynamics and Control Conference (L4DC), 2026
- Context-Aware LLM-Based Safe Control Against Latent RisksAmerican Control Conference (ACC), 2026
- UAVGENT: A Language-Guided Distributed Control FrameworkarXiv preprint, 2026
- Kalman Bayesian TransformerIEEE Conference on Decision and Control (CDC), 2025
Insights from biological systems
Nervous systems achieve remarkably fast, accurate, and robust control despite severe component limitations in speed and accuracy. Understanding this paradox offers design principles for intelligent control systems. We modeled how neurophysiological constraints in latency and information rate impose fundamental limits on sensorimotor performance in layered control architectures, and built an open-source experimental platform to test the predictions.
The study revealed a core principle: diversity among neurons creates diversity-enabled sweet spots (DeSSs) that deconstrain the limitations of individual components. DeSSs explain both how biological systems achieve fast and accurate control using slow or inaccurate components and why heterogeneity is ubiquitous in nature. Extending the model, we showed how microscopic motor constraints give rise to macroscopic behavioral laws such as Fitts' law, providing a mechanistic explanation for the logarithmic speed–accuracy tradeoffs observed across reaching tasks.
Beyond neuroscience, the same techniques reveal fundamental tradeoffs in biomolecular control and inform the design of networked control systems operating over delayed, quantized, and rate-limited communication channels.
Representative publications
- Diversity-Enabled Sweet Spots in Layered Architectures and Speed–Accuracy Trade-Offs in Sensorimotor ControlProceedings of the National Academy of Sciences, 2021
- Diversity Deconstrains Component Limitations in Sensorimotor ControlNeural Computation, 2025
- Theoretical Foundations for Layered Architectures and Speed–Accuracy Tradeoffs in Sensorimotor ControlAmerican Control Conference (ACC), 2019
- Experimental and Educational Platforms for Studying Architecture and Tradeoffs in Human Sensorimotor ControlAmerican Control Conference (ACC), 2019
- Hard Limits on Robust Control over Delayed and Quantized Communication Channels with Applications to Sensorimotor ControlIEEE Conference on Decision and Control (CDC), 2015
- Fundamental Limits and Achievable Performance in Biomolecular ControlAmerican Control Conference (ACC), 2018
- Rate-Cost Tradeoffs in Continuous-Time Control with a Biomolecular ApplicationIEEE Transactions on Automatic Control (accepted)
- An Integrative Perspective to LQ and L∞ Control for Delayed and Quantized SystemsIEEE Transactions on Automatic Control, 2020
- LQ vs. ℓ∞ in Controller Design for Systems with Delay and QuantizationIEEE Conference on Decision and Control (CDC), 2016
- Algorithms for Optimal Control with Fixed-Rate FeedbackIEEE Conference on Decision and Control (CDC), 2017
- A Linear Programming Framework for Networked Control System DesignIFAC Workshop on Distributed Estimation and Control in Networked Systems (NecSys), 2015
AI for physical AI research
Robots operate with limited data, memory, and computing power in environments that never stop changing, so training them once and expecting safe performance forever is unrealistic. We therefore study sequential fine-tuning, in which a system keeps learning as new information arrives, together with uncertainty awareness, so that a system knows what it does not know and acts cautiously in unfamiliar situations. The long-term vision is a unified framework that integrates language understanding, learning, uncertainty estimation, and control, so that anyone, not just engineers, could configure a robot to perform tasks safely and customize its behavior to personal preferences or workplace norms.
Representative publications
- Kalman Bayesian TransformerIEEE Conference on Decision and Control (CDC), 2025
- An Analytic Solution to Covariance Propagation in Neural NetworksInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2024
- Safety Certificate Against Latent Variables with Partially Unidentifiable DynamicsInternational Conference on Machine Learning (ICML), 2025
- Online Adaptive Probabilistic Safety Certificate with Language GuidanceLearning for Dynamics and Control Conference (L4DC), 2026
Application domains
- Autonomous vehicles
- Robots and human–robot collaboration
- Human sensorimotor control
- Smart grids and EV charging
- Cloud computing
- Building HVAC systems
- Microfinance and poverty alleviation
- Large language models
Support
Research in the group has been supported by the National Science Foundation (CAREER Award), the Japan Science and Technology Agency (PRESTO and BOOST programs), the Office of Naval Research, the U.S. Department of Transportation University Transportation Centers (Safety21 and Mobility21), the Pennsylvania Infrastructure Technology Alliance with Fujitsu Research of America, CMU CyLab, the Manufacturing Futures Institute, the Software Engineering Institute, MathWorks, and Oracle.