Embedding Temporal Awareness in Reinforcement Learning Models for Energy System Control Article Swipe
Amirhossein Heydarian Ardakani
,
Johann L. Hurink
,
Ian Gibson
,
Elham Shirazi
·
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.1145/3679240.3734686
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.1145/3679240.3734686
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1145/3679240.3734686
- https://dl.acm.org/doi/pdf/10.1145/3679240.3734686
- OA Status
- gold
- References
- 5
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4411346309
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4411346309Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1145/3679240.3734686Digital Object Identifier
- Title
-
Embedding Temporal Awareness in Reinforcement Learning Models for Energy System ControlWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-06-16Full publication date if available
- Authors
-
Amirhossein Heydarian Ardakani, Johann L. Hurink, Ian Gibson, Elham ShiraziList of authors in order
- Landing page
-
https://doi.org/10.1145/3679240.3734686Publisher landing page
- PDF URL
-
https://dl.acm.org/doi/pdf/10.1145/3679240.3734686Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
goldOpen access status per OpenAlex
- OA URL
-
https://dl.acm.org/doi/pdf/10.1145/3679240.3734686Direct OA link when available
- Concepts
-
Reinforcement learning, Embedding, Computer science, Control (management), Reinforcement, Energy (signal processing), Artificial intelligence, Engineering, Mathematics, Statistics, Structural engineeringTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- References (count)
-
5Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4411346309 |
|---|---|
| doi | https://doi.org/10.1145/3679240.3734686 |
| ids.doi | https://doi.org/10.1145/3679240.3734686 |
| ids.openalex | https://openalex.org/W4411346309 |
| fwci | 0.0 |
| type | article |
| title | Embedding Temporal Awareness in Reinforcement Learning Models for Energy System Control |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | 1004 |
| biblio.first_page | 1002 |
| topics[0].id | https://openalex.org/T10603 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.9984999895095825 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2208 |
| topics[0].subfield.display_name | Electrical and Electronic Engineering |
| topics[0].display_name | Smart Grid Energy Management |
| topics[1].id | https://openalex.org/T11052 |
| topics[1].field.id | https://openalex.org/fields/22 |
| topics[1].field.display_name | Engineering |
| topics[1].score | 0.9894000291824341 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/2208 |
| topics[1].subfield.display_name | Electrical and Electronic Engineering |
| topics[1].display_name | Energy Load and Power Forecasting |
| topics[2].id | https://openalex.org/T10917 |
| topics[2].field.id | https://openalex.org/fields/22 |
| topics[2].field.display_name | Engineering |
| topics[2].score | 0.9854000210762024 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/2207 |
| topics[2].subfield.display_name | Control and Systems Engineering |
| topics[2].display_name | Smart Grid Security and Resilience |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C97541855 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8390048742294312 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q830687 |
| concepts[0].display_name | Reinforcement learning |
| concepts[1].id | https://openalex.org/C41608201 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6958019137382507 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q980509 |
| concepts[1].display_name | Embedding |
| concepts[2].id | https://openalex.org/C41008148 |
| concepts[2].level | 0 |
| concepts[2].score | 0.6773170828819275 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[2].display_name | Computer science |
| concepts[3].id | https://openalex.org/C2775924081 |
| concepts[3].level | 2 |
| concepts[3].score | 0.5039648413658142 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q55608371 |
| concepts[3].display_name | Control (management) |
| concepts[4].id | https://openalex.org/C67203356 |
| concepts[4].level | 2 |
| concepts[4].score | 0.4626975655555725 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q1321905 |
| concepts[4].display_name | Reinforcement |
| concepts[5].id | https://openalex.org/C186370098 |
| concepts[5].level | 2 |
| concepts[5].score | 0.42620849609375 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q442787 |
| concepts[5].display_name | Energy (signal processing) |
| concepts[6].id | https://openalex.org/C154945302 |
| concepts[6].level | 1 |
| concepts[6].score | 0.4048663377761841 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[6].display_name | Artificial intelligence |
| concepts[7].id | https://openalex.org/C127413603 |
| concepts[7].level | 0 |
| concepts[7].score | 0.13861575722694397 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[7].display_name | Engineering |
| concepts[8].id | https://openalex.org/C33923547 |
| concepts[8].level | 0 |
| concepts[8].score | 0.12757915258407593 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[8].display_name | Mathematics |
| concepts[9].id | https://openalex.org/C105795698 |
| concepts[9].level | 1 |
| concepts[9].score | 0.06804150342941284 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q12483 |
| concepts[9].display_name | Statistics |
| concepts[10].id | https://openalex.org/C66938386 |
| concepts[10].level | 1 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q633538 |
| concepts[10].display_name | Structural engineering |
| keywords[0].id | https://openalex.org/keywords/reinforcement-learning |
| keywords[0].score | 0.8390048742294312 |
| keywords[0].display_name | Reinforcement learning |
| keywords[1].id | https://openalex.org/keywords/embedding |
| keywords[1].score | 0.6958019137382507 |
| keywords[1].display_name | Embedding |
| keywords[2].id | https://openalex.org/keywords/computer-science |
| keywords[2].score | 0.6773170828819275 |
| keywords[2].display_name | Computer science |
| keywords[3].id | https://openalex.org/keywords/control |
| keywords[3].score | 0.5039648413658142 |
| keywords[3].display_name | Control (management) |
| keywords[4].id | https://openalex.org/keywords/reinforcement |
| keywords[4].score | 0.4626975655555725 |
| keywords[4].display_name | Reinforcement |
| keywords[5].id | https://openalex.org/keywords/energy |
| keywords[5].score | 0.42620849609375 |
| keywords[5].display_name | Energy (signal processing) |
| keywords[6].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[6].score | 0.4048663377761841 |
| keywords[6].display_name | Artificial intelligence |
| keywords[7].id | https://openalex.org/keywords/engineering |
| keywords[7].score | 0.13861575722694397 |
| keywords[7].display_name | Engineering |
| keywords[8].id | https://openalex.org/keywords/mathematics |
| keywords[8].score | 0.12757915258407593 |
| keywords[8].display_name | Mathematics |
| keywords[9].id | https://openalex.org/keywords/statistics |
| keywords[9].score | 0.06804150342941284 |
| keywords[9].display_name | Statistics |
| language | en |
| locations[0].id | doi:10.1145/3679240.3734686 |
| locations[0].is_oa | True |
| locations[0].source | |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://dl.acm.org/doi/pdf/10.1145/3679240.3734686 |
| locations[0].version | publishedVersion |
| locations[0].raw_type | proceedings-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Proceedings of the 16th ACM International Conference on Future and Sustainable Energy Systems |
| locations[0].landing_page_url | https://doi.org/10.1145/3679240.3734686 |
| indexed_in | crossref |
| authorships[0].author.id | https://openalex.org/A5070770854 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-3989-5481 |
| authorships[0].author.display_name | Amirhossein Heydarian Ardakani |
| authorships[0].countries | NL |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I94624287 |
| authorships[0].affiliations[0].raw_affiliation_string | University of Twente, Enschede, Netherlands |
| authorships[0].institutions[0].id | https://openalex.org/I94624287 |
| authorships[0].institutions[0].ror | https://ror.org/006hf6230 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I94624287 |
| authorships[0].institutions[0].country_code | NL |
| authorships[0].institutions[0].display_name | University of Twente |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Amirhossein Heydarian Ardakani |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | University of Twente, Enschede, Netherlands |
| authorships[1].author.id | https://openalex.org/A5001577619 |
| authorships[1].author.orcid | https://orcid.org/0000-0001-6986-5633 |
| authorships[1].author.display_name | Johann L. Hurink |
| authorships[1].countries | NL |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I94624287 |
| authorships[1].affiliations[0].raw_affiliation_string | University of Twente, Enschede, Netherlands |
| authorships[1].institutions[0].id | https://openalex.org/I94624287 |
| authorships[1].institutions[0].ror | https://ror.org/006hf6230 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I94624287 |
| authorships[1].institutions[0].country_code | NL |
| authorships[1].institutions[0].display_name | University of Twente |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Johann Hurink |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | University of Twente, Enschede, Netherlands |
| authorships[2].author.id | https://openalex.org/A5012467454 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-4149-9122 |
| authorships[2].author.display_name | Ian Gibson |
| authorships[2].countries | NL |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I94624287 |
| authorships[2].affiliations[0].raw_affiliation_string | University of Twente, Enschede, Netherlands |
| authorships[2].institutions[0].id | https://openalex.org/I94624287 |
| authorships[2].institutions[0].ror | https://ror.org/006hf6230 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I94624287 |
| authorships[2].institutions[0].country_code | NL |
| authorships[2].institutions[0].display_name | University of Twente |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Ian Gibson |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | University of Twente, Enschede, Netherlands |
| authorships[3].author.id | https://openalex.org/A5079394484 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-1274-1506 |
| authorships[3].author.display_name | Elham Shirazi |
| authorships[3].countries | NL |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I94624287 |
| authorships[3].affiliations[0].raw_affiliation_string | University of Twente, Enschede, Netherlands |
| authorships[3].institutions[0].id | https://openalex.org/I94624287 |
| authorships[3].institutions[0].ror | https://ror.org/006hf6230 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I94624287 |
| authorships[3].institutions[0].country_code | NL |
| authorships[3].institutions[0].display_name | University of Twente |
| authorships[3].author_position | last |
| authorships[3].raw_author_name | Elham Shirazi |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | University of Twente, Enschede, Netherlands |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://dl.acm.org/doi/pdf/10.1145/3679240.3734686 |
| open_access.oa_status | gold |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Embedding Temporal Awareness in Reinforcement Learning Models for Energy System Control |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10603 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.9984999895095825 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2208 |
| primary_topic.subfield.display_name | Electrical and Electronic Engineering |
| primary_topic.display_name | Smart Grid Energy Management |
| related_works | https://openalex.org/W4310083477, https://openalex.org/W2328553770, https://openalex.org/W2920061524, https://openalex.org/W1977959518, https://openalex.org/W2038908348, https://openalex.org/W2107890255, https://openalex.org/W2106552856, https://openalex.org/W2145821588, https://openalex.org/W2086122291, https://openalex.org/W1987513656 |
| cited_by_count | 0 |
| locations_count | 1 |
| best_oa_location.id | doi:10.1145/3679240.3734686 |
| best_oa_location.is_oa | True |
| best_oa_location.source | |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://dl.acm.org/doi/pdf/10.1145/3679240.3734686 |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | proceedings-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Proceedings of the 16th ACM International Conference on Future and Sustainable Energy Systems |
| best_oa_location.landing_page_url | https://doi.org/10.1145/3679240.3734686 |
| primary_location.id | doi:10.1145/3679240.3734686 |
| primary_location.is_oa | True |
| primary_location.source | |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://dl.acm.org/doi/pdf/10.1145/3679240.3734686 |
| primary_location.version | publishedVersion |
| primary_location.raw_type | proceedings-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Proceedings of the 16th ACM International Conference on Future and Sustainable Energy Systems |
| primary_location.landing_page_url | https://doi.org/10.1145/3679240.3734686 |
| publication_date | 2025-06-16 |
| publication_year | 2025 |
| referenced_works | https://openalex.org/W3209275630, https://openalex.org/W4395110468, https://openalex.org/W4389383604, https://openalex.org/W4313443452, https://openalex.org/W4286512640 |
| referenced_works_count | 5 |
| abstract_inverted_index | |
| cited_by_percentile_year | |
| countries_distinct_count | 1 |
| institutions_distinct_count | 4 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/7 |
| sustainable_development_goals[0].score | 0.6499999761581421 |
| sustainable_development_goals[0].display_name | Affordable and clean energy |
| citation_normalized_percentile.value | 0.23506825 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |