Reinforcement Learning for Active Noise Control in a Hydraulic System

Thumbnail Image
Supplemental Files
Date
2021-06-01
Authors
Anderson, Eric
Steward, Brian
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Authors
Person
Steward, Brian
Professor
Research Projects
Organizational Units
Organizational Unit
Mechanical Engineering
The Department of Mechanical Engineering at Iowa State University is where innovation thrives and the impossible is made possible. This is where your passion for problem-solving and hands-on learning can make a real difference in our world. Whether you’re helping improve the environment, creating safer automobiles, or advancing medical technologies, and athletic performance, the Department of Mechanical Engineering gives you the tools and talent to blaze your own trail to an amazing career.
Organizational Unit
Journal Issue
Is Version Of
Versions
Series
Department
Mechanical EngineeringAgricultural and Biosystems EngineeringHuman Computer Interaction
Abstract

Hydraulic pressure ripple in a pump, as a result of converting rotational power to fluid power, continues to be a problem faced when developing hydraulic systems due to the resulting noise generated. In this paper, we present simulation results from leveraging an actor-critic reinforcement learning method as the control method for active noise control in a hydraulic system. The results demonstrate greater than 96%, 81%, and 61% pressure ripple reduction for the first, second, and third harmonics, respectively, in a single operating point test, along with the advantage of feed forward like control for high bandwidth response during dynamic changes in the operating point. It also demonstrates the disadvantage of long convergence times while the controller is effectively learning the optimal control policy. Additionally, this work demonstrates the ancillary benefit of the elimination of the injection of white noise for the purpose of system identification in the current state of the art.

Comments

This is a manuscript of an article published as Anderson, Eric R., and Brian L. Steward. "Reinforcement Learning for Active Noise Control in a Hydraulic System." Journal of Dynamic Systems, Measurement, and Control 143, no. 6 (2021): 061006. DOI: 10.1115/1.4049556. Posted with permission.

Description
Keywords
Citation
DOI
Copyright
Fri Jan 01 00:00:00 UTC 2021
Collections