Kshitij Bhatta
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Kshitij Bhatta has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Qing Chang
Department of Mechanical and Aerospace Engineering, University of Virginia, Charlottesville, VA, USA
3 shared publications - Amirhossein Nazerian
Department of Mechanical Engineering, University of New Mexico, Albuquerque, USA
2 shared publications - Francesco Sorrentino
Department of Mechanical Engineering, University of New Mexico, Albuquerque, USA
2 shared publications
Latest Publications
- 26 May 2025
- Published by Elsevier in Journal of Manufacturing Systems
- Vol. 81, 155-168
Train small, deploy large: Scaling multi-agent reinforcement learning for multi-stage manufacturing lines
- 26 May 2025
- Published by Elsevier in Journal of Manufacturing Systems
- Vol. 81, 155-168
Train small, deploy large: Scaling multi-agent reinforcement learning for multi-stage manufacturing lines
- 12 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (9) , 5338-5344
Integrating Robot Assignment and Maintenance Management: A Multi-Agent Reinforcement Learning Approach for Holistic Control
Modern manufacturing requires effective integration of production control and maintenance scheduling to improve productivity and quality. However, there have been few studies on this integrated control due to a lack of a comprehensive manufacturing system model. In response to this challenge, this paper presents a mathematical model framework for a mobile multi-skilled robot-operated manufacturing system that integrates three essential control aspects: robot assignment, maintenance scheduling, and product quality. Furthermore, an integrated control scheme is formulated in the Decentralized Partially Observable Markov Decision Process (Dec-POMDP) framework to showcase the proposed method's efficacy in control. Results show that the proposed integrated model outperforms models that consider only system-level parameters, as well as those that only address maintenance scheduling and quality-related parameters.
- 12 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (9) , 5338-5344
Integrating Robot Assignment and Maintenance Management: A Multi-Agent Reinforcement Learning Approach for Holistic Control
Modern manufacturing requires effective integration of production control and maintenance scheduling to improve productivity and quality. However, there have been few studies on this integrated control due to a lack of a comprehensive manufacturing system model. In response to this challenge, this paper presents a mathematical model framework for a mobile multi-skilled robot-operated manufacturing system that integrates three essential control aspects: robot assignment, maintenance scheduling, and product quality. Furthermore, an integrated control scheme is formulated in the Decentralized Partially Observable Markov Decision Process (Dec-POMDP) framework to showcase the proposed method's efficacy in control. Results show that the proposed integrated model outperforms models that consider only system-level parameters, as well as those that only address maintenance scheduling and quality-related parameters.
- Open Access
- 22 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Control Systems
- Vol. 2, 24-35
Exact Decomposition of Optimal Control Problems via Simultaneous Block Diagonalization of Matrices
In this paper, we consider optimal control problems (OCPs) applied to large-scale linear dynamical systems with a large number of states and inputs. We attempt to reduce such problems into a set of independent OCPs of lower dimensions. Our decomposition is ‘exact’ in the sense that it preserves all the information about the original system and the objective function. Previous work in this area has focused on strategies that exploit symmetries of the underlying system and of the objective function. Here, instead, we implement the algebraic method of simultaneous block diagonalization of matrices (SBD), which we show provides advantages both in terms of the dimension of the subproblems that are obtained and of the computation time. We provide practical examples with networked systems that demonstrate the benefits of applying the SBD decomposition over the decomposition method based on group symmetries.
- 22 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Control Systems
- Vol. 2, 24-35
Open AccessExact Decomposition of Optimal Control Problems via Simultaneous Block Diagonalization of Matrices
In this paper, we consider optimal control problems (OCPs) applied to large-scale linear dynamical systems with a large number of states and inputs. We attempt to reduce such problems into a set of independent OCPs of lower dimensions. Our decomposition is ‘exact’ in the sense that it preserves all the information about the original system and the objective function. Previous work in this area has focused on strategies that exploit symmetries of the underlying system and of the objective function. Here, instead, we implement the algebraic method of simultaneous block diagonalization of matrices (SBD), which we show provides advantages both in terms of the dimension of the subproblems that are obtained and of the computation time. We provide practical examples with networked systems that demonstrate the benefits of applying the SBD decomposition over the decomposition method based on group symmetries.
- Open Access
- 4 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 72658-72670
Supermodal Decomposition of the Linear Swing Equation for Multilayer Networks
We study the swing equation in the case of a multilayer network in which generators and motors are modeled differently; namely, the model for each generator is given by second order dynamics and the model for each motor is given by first order dynamics. We also remove the commonly used assumption of equal damping coefficients in the second order dynamics. Under these general conditions, we are able to obtain a decomposition of the linear swing equation into independent modes describing the propagation of small perturbations. In the process, we identify symmetries affecting the structure and dynamics of the multilayer network and derive an essential model based on a ‘quotient network.’ We then compare the dynamics of the full network and that of the quotient network and obtain a modal decomposition of the error dynamics. We also provide a method to quantify the steady-state error and the maximum overshoot error. Two case studies are presented to illustrate application of our method.
- 4 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 72658-72670
Open AccessSupermodal Decomposition of the Linear Swing Equation for Multilayer Networks
We study the swing equation in the case of a multilayer network in which generators and motors are modeled differently; namely, the model for each generator is given by second order dynamics and the model for each motor is given by first order dynamics. We also remove the commonly used assumption of equal damping coefficients in the second order dynamics. Under these general conditions, we are able to obtain a decomposition of the linear swing equation into independent modes describing the propagation of small perturbations. In the process, we identify symmetries affecting the structure and dynamics of the multilayer network and derive an essential model based on a ‘quotient network.’ We then compare the dynamics of the full network and that of the quotient network and obtain a modal decomposition of the error dynamics. We also provide a method to quantify the steady-state error and the maximum overshoot error. Two case studies are presented to illustrate application of our method.