UKERC EDC: ETI

Citation	Anderlini, E., Forehand, D.I.M., Bannon, E. and Abusara, M. Constraints Implementation in the Application of Reinforcement Learning to the Reactive Control of a Point Absorber, ASME 2017 36th International Conference on Ocean, Offshore and Arctic Engineering, 2017. https://dx.doi.org/10.1115/OMAE2017-61294. Cite this using DataCite
Author(s)	Anderlini, E., Forehand, D.I.M., Bannon, E. and Abusara, M.
Project partner(s)	University of Edinburgh, Wave Energy Scotland, University of Exeter
Publisher	ASME 2017 36th International Conference on Ocean, Offshore and Arctic Engineering
DOI	https://dx.doi.org/10.1115/OMAE2017-61294
Download	282082
Abstract	Least-squares policy iteration, a reinforcement learning algorithm, is applied to the reactive control of a wave energy converter for the first time. Simulations of a linear point absorber are used for this analysis. The focus of this study is on the implementation of displacement constraints. The use of a penalty term is effective in teaching the controller to avoid the selection of combinations of the damping and stiffness coefficients that would result in excessive displacements in particular sea states. However, the controller can learn that the actions are bad only after trying them, as shown by the simulations. For this reason, a lower-level control scheme is proposed, which changes the sign of the controller force based on the magnitude of the float displacement and sign of its velocity. Its effectiveness is proven in both regular and irregular waves, although greater care is required for the determination of soft constraints
Associated Project(s)	ETI-MA2003: Industrial Doctorate Centre for Offshore Renewable Energy (IDCORE)
Associated Dataset(s)	No associated datasets
Associated Publication(s)	A model to map levelised cost of energy for wave energy projects An Integrated Data Management Approach for Offshore Wind Turbine Failure Root Cause Analysis An investigation of the effects of wind-induced inclination on floating wind turbine dynamics: heave plate excursion Application of an offshore wind farm layout optimization methodology at Middelgrunden wind farm Characterisation of current and turbulence in the FloWave Ocean Energy Research Facility Characterization of the tidal resource in Rathlin Sound Comparison of Offshore Wind Farm Layout Optimization Using a Genetic Algorithm and a Particle Swarm Optimizer Component reliability test approaches for marine renewable energy Control of a Realistic Wave Energy Converter Model Using Least-Squares Policy Iteration Cost Reduction to Encourage Commercialisation of Marine in the UK Cumulative impact assessment of tidal stream energy extraction in the Irish Sea Design diagrams for wavelength discrepancy in tank testing with inconsistently scaled intermediate water depth Development of a Condition Monitoring System for an Articulated Wave Energy Converter Dynamic mooring simulation with Code(-)Aster with application to a floating wind turbine ETI Insights Report - Wave Energy Environmental interactions of tidal lagoons: A comparison of industry perspectives Exploring Marine Energy Potential in the UK Using a Whole Systems Modelling Approach Hybrid, Multi-Megawatt HVDC Transformer Topology Comparison for Future Offshore Wind Farms Hydrodynamic analysis of a ducted, open centre tidal stream turbine using blade element momentum theory Offshore wind farm electrical cable layout optimization Offshore wind installation vessels - A comparative assessment for UK offshore rounds 1 and 2 Optimisation of Offshore Wind Farms Using a Genetic Algorithm Quantifying uncertainty in acoustic measurements of tidal flows using a “Virtual” Doppler Current Profiler Re-creation of site-specific multi-directional waves with non-collinear current Reactive control of a two-body point absorber using reinforcement learning Reactive control of a wave energy converter using artificial neural networks Reliability and O & M sensitivity analysis as a consequence of site specific characteristics for wave energy converters Reliability prediction for offshore renewable energy: Data driven insights Resource characterization of sites in the vicinity of an island near a landmass Review and application of Rainflow residue processing techniques for accurate fatigue damage estimation Sensitivity analysis of offshore wind farm operation and maintenance cost and availability Simulating Extreme Directional Wave Conditions Testing Marine Renewable Energy Devices in an Advanced Multi-Directional Combined Wave-Current Environment Testing the robustness of optimal access vessel fleet selection for operation and maintenance of offshore wind farms The Industrial Doctorate Centre for Offshore Renewable Energy(IDCORE) - Case Studies The SPAIR method: Isolating incident and reflected directional wave spectra in multidirectional wave basins The effects of wind-induced inclination on the dynamics ofsemi-submersible floating wind turbines in the time domain The power-capture of a nearshore, modular, flap-type wave energy converter in regular waves UK offshore wind cost optimisation: top head mass (Presentation to All Energy, 10th May 2017)

Constraints Implementation in the Application of Reinforcement Learning to the Reactive Control of a Point Absorber