{"id":202257,"date":"2025-03-21T11:29:12","date_gmt":"2025-03-21T10:29:12","guid":{"rendered":"https:\/\/www.rse-web.it\/pubblicazioni\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/"},"modified":"2025-03-21T11:30:03","modified_gmt":"2025-03-21T10:30:03","slug":"a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids","status":"publish","type":"pubblicazioni","link":"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/","title":{"rendered":"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids"},"content":{"rendered":"","protected":false},"excerpt":{"rendered":"<p>Smart grids enable bidirectional flows of electricity and information between customers, which can produce and consume energy. A Reinforcement Learning controller optimizes energy flow, balancing the costs of exchanges with the grid and battery degradation.<\/p>\n","protected":false},"author":93,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"tags":[1302,1324,1300,1482,1315],"targets":[1304,1314,1317],"pubblicazioni_tipologie":[773],"class_list":["post-202257","pubblicazioni","type-pubblicazioni","status-publish","hentry","tag-batteries","tag-electricity-network-en","tag-industrial-sector","tag-smart-energy-grid","tag-smart-grids-en","targets-industrial-world","targets-press-media-en","targets-research","pubblicazioni_tipologie-isi-article-en"],"acf":{"dont_show_hompage":true,"projects":{"ID":188409,"post_author":"93","post_date":"2024-06-13 15:10:21","post_date_gmt":"2024-06-13 13:10:21","post_content":"","post_title":"Electrochemical and thermal storage technologies","post_excerpt":"The goal of this project is to develop electrochemical and thermal storage technologies with improved performance and greater environmental and economic sustainability by optimizing the use of resources, material formulations and synthesis methods, diagnostic and control processes, and prototype design.","post_status":"publish","comment_status":"open","ping_status":"closed","post_password":"","post_name":"electrochemical-and-thermal-storage-technologies","to_ping":"","pinged":"","post_modified":"2024-07-06 15:23:41","post_modified_gmt":"2024-07-06 13:23:41","post_content_filtered":"","post_parent":0,"guid":"https:\/\/www.rse-web.it\/progetti\/electrochemical-and-thermal-storage-technologies\/","menu_order":0,"post_type":"progetti","post_mime_type":"","comment_count":"0","filter":"raw"},"order_posts":"","dont_show_search":false,"related_posts":false,"show_on_slider":false,"single_post_data":{"titolo_spot":"","post_content":"<p>Smart Grids are the evolution of traditional electric grids and allow two-way flows of electricity and information between different actors. At the edge of this network, customers can both produce and consume energy. Due to the intermittent nature of renewable energy sources, customers are characterized by moments of energy surplus and deficit.<\/p>\n<p>&nbsp;<\/p>\n<p>To solve this problem, customers are connected to the power grid, and, usually, they are also provided with Lithium-Ion battery packs positioned near the energy source used to store energy in excess for later use, reducing expensive energy exchanges with the grid. On the one hand, using the battery at its full capabilities produces significant economic savings.<\/p>\n<p>&nbsp;<\/p>\n<p>On the other hand, massive use of the battery leads to degradation and consequently to a more frequent substitution of the battery. Therefore, depending on the cost of energy and batteries, one should carefully choose when it is favourable to use it. To avoid inefficiencies, it is common to design controllers that regulate the energy flow within the battery packs, deciding whether to exchange energy with the network or store it in the battery.<\/p>\n<p>&nbsp;<\/p>\n<p>In this work, a Reinforcement Learning controller optimizing energy flow is developed. The controller\u2019s goal is to balance the costs of exchanges with the power grid and those derived from the degradation due to battery usage. A synthetic experimental campaign conducted using real-world data demonstrates that the policy learned shows an improvement in the worst-case of 3% w.r.t. state-of-the-art baselines.<\/p>\n","scarica_file":false,"link_estreno":[{"link_text":"Download Publication","link":"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S2352152X24001567"}],"button":{"text":"","link":""},"referente_group":false,"data_emissione":"2024-01-17","autori":"M. Mussi, O. F. Pindaro, M. Restelli, F. Trov\u00f2 (Politecnico di Milano), L. Pellegrino (RSE S.p.A.)","destinazione":"24000731","rif_rse":""},"satellite_post_url":""},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids - RSE<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids - RSE\" \/>\n<meta property=\"og:description\" content=\"Smart grids enable bidirectional flows of electricity and information between customers, which can produce and consume energy. A Reinforcement Learning controller optimizes energy flow, balancing the costs of exchanges with the grid and battery degradation.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/\" \/>\n<meta property=\"og:site_name\" content=\"RSE\" \/>\n<meta property=\"article:modified_time\" content=\"2025-03-21T10:30:03+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/\",\"url\":\"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/\",\"name\":\"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids - RSE\",\"isPartOf\":{\"@id\":\"https:\/\/www.rse-web.it\/#website\"},\"datePublished\":\"2025-03-21T10:29:12+00:00\",\"dateModified\":\"2025-03-21T10:30:03+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.rse-web.it\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.rse-web.it\/#website\",\"url\":\"https:\/\/www.rse-web.it\/\",\"name\":\"RSE\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.rse-web.it\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.rse-web.it\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.rse-web.it\/#organization\",\"name\":\"RSE\",\"url\":\"https:\/\/www.rse-web.it\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.rse-web.it\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.rse-web.it\/wp-content\/uploads\/2024\/01\/cropped-logo_rse_2022.png\",\"contentUrl\":\"https:\/\/www.rse-web.it\/wp-content\/uploads\/2024\/01\/cropped-logo_rse_2022.png\",\"width\":734,\"height\":164,\"caption\":\"RSE\"},\"image\":{\"@id\":\"https:\/\/www.rse-web.it\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids - RSE","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/","og_locale":"en_US","og_type":"article","og_title":"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids - RSE","og_description":"Smart grids enable bidirectional flows of electricity and information between customers, which can produce and consume energy. A Reinforcement Learning controller optimizes energy flow, balancing the costs of exchanges with the grid and battery degradation.","og_url":"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/","og_site_name":"RSE","article_modified_time":"2025-03-21T10:30:03+00:00","twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/","url":"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/","name":"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids - RSE","isPartOf":{"@id":"https:\/\/www.rse-web.it\/#website"},"datePublished":"2025-03-21T10:29:12+00:00","dateModified":"2025-03-21T10:30:03+00:00","breadcrumb":{"@id":"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.rse-web.it\/en\/publications\/a-reinforcement-learning-controller-optimizing-costs-and-battery-state-ofhealth-in-smart-grids\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.rse-web.it\/en\/"},{"@type":"ListItem","position":2,"name":"A Reinforcement Learning controller optimizing costs and battery State ofHealth in smart grids"}]},{"@type":"WebSite","@id":"https:\/\/www.rse-web.it\/#website","url":"https:\/\/www.rse-web.it\/","name":"RSE","description":"","publisher":{"@id":"https:\/\/www.rse-web.it\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.rse-web.it\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.rse-web.it\/#organization","name":"RSE","url":"https:\/\/www.rse-web.it\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.rse-web.it\/#\/schema\/logo\/image\/","url":"https:\/\/www.rse-web.it\/wp-content\/uploads\/2024\/01\/cropped-logo_rse_2022.png","contentUrl":"https:\/\/www.rse-web.it\/wp-content\/uploads\/2024\/01\/cropped-logo_rse_2022.png","width":734,"height":164,"caption":"RSE"},"image":{"@id":"https:\/\/www.rse-web.it\/#\/schema\/logo\/image\/"}}]}},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/pubblicazioni\/202257","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/pubblicazioni"}],"about":[{"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/types\/pubblicazioni"}],"author":[{"embeddable":true,"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/users\/93"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/comments?post=202257"}],"version-history":[{"count":1,"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/pubblicazioni\/202257\/revisions"}],"predecessor-version":[{"id":202258,"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/pubblicazioni\/202257\/revisions\/202258"}],"wp:attachment":[{"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/media?parent=202257"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/tags?post=202257"},{"taxonomy":"targets","embeddable":true,"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/targets?post=202257"},{"taxonomy":"pubblicazioni_tipologie","embeddable":true,"href":"https:\/\/www.rse-web.it\/en\/wp-json\/wp\/v2\/pubblicazioni_tipologie?post=202257"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}