Distributed reinforcement learning control for batch sequencing and sizing in just-in-time manufacturing systems

Joonki Hong, Vittaldas V. Prabhu

Research output: Contribution to journalArticle

27 Scopus citations

Abstract

This paper presents an approach that is suitable for Just-In-Time (JIT) production for multi-objective scheduling problem in dynamically changing shop floor environment. The proposed distributed learning and control (DLC) approach integrates part-driven distributed arrival time control (DATC) and machine-driven distributed reinforcement learning based control. With DATC, part controllers adjust their associated parts' arrival time to minimize due-date deviation. Within the restricted pattern of arrivals, machine controllers are concurrently searching for optimal dispatching policies. The machine control problem is modeled as Semi Markov Decision Process (SMDP) and solved using Q-learning. The DLC algorithms are evaluated using simulation for two types of manufacturing systems: family scheduling and dynamic batch sizing. Results show that DLC algorithms achieve significant performance improvement over usual dispatching rules in complex real-time shop floor control problems for JIT production.

Original languageEnglish (US)
Pages (from-to)71-87
Number of pages17
JournalApplied Intelligence
Volume20
Issue number1
DOIs
StatePublished - Jan 1 2004

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Distributed reinforcement learning control for batch sequencing and sizing in just-in-time manufacturing systems'. Together they form a unique fingerprint.

  • Cite this