End-to-End Analysis Automation over Distributed Resources with Luigi Analysis Workflows Article Swipe
In particle physics, workflow management systems are primarily used as tailored solutions in dedicated areas such as Monte Carlo production. However, physicists performing data analyses are usually required to steer their individual, complex workflows manually, frequently involving job submission in several stages and interaction with distributed storage systems by hand. This process is not only time-consuming and error-prone, but also leads to undocumented relations between particular workloads, rendering the steering of an analysis a serious challenge. This article presents the Luigi Analysis Workflow (Law) Python package which is based on the open-source pipelining tool Luigi, originally developed by Spotify. It establishes a generic design pattern for analyses of arbitrary scale and complexity, and shifts the focus from executing to defining the analysis logic. Law provides the building blocks to seamlessly integrate with interchangeable remote resources without, however, limiting itself to a specific choice of infrastructure. In particular, it introduces the concept of complete separation between analysis algorithms on the one hand, and run locations, storage locations, and software environments on the other hand. To cope with the sophisticated demands of end-to-end HEP analyses, Law supports job execution on WLCG infrastructure (ARC, gLite, CMS-CRAB) as well as on local computing clusters (HTCondor, Slurm, LSF), remote file access via various protocols using the Grid File Access Library (GFAL2), and an environment sandboxing mechanism with support for sub-shells and virtual environments, as well as Docker and Singularity containers. Moreover, the novel approach ultimately aims for analysis preservation out-of-the-box. Law is developed opensource and independent of any experiment or the language of executed code, and its user-base increased steadily over the past years.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1051/epjconf/202429505012
- https://www.epj-conferences.org/articles/epjconf/pdf/2024/05/epjconf_chep2024_05012.pdf
- OA Status
- diamond
- Cited By
- 2
- References
- 6
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4396661999
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4396661999Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1051/epjconf/202429505012Digital Object Identifier
- Title
-
End-to-End Analysis Automation over Distributed Resources with Luigi Analysis WorkflowsWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-01-01Full publication date if available
- Authors
-
M. RiegerList of authors in order
- Landing page
-
https://doi.org/10.1051/epjconf/202429505012Publisher landing page
- PDF URL
-
https://www.epj-conferences.org/articles/epjconf/pdf/2024/05/epjconf_chep2024_05012.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
diamondOpen access status per OpenAlex
- OA URL
-
https://www.epj-conferences.org/articles/epjconf/pdf/2024/05/epjconf_chep2024_05012.pdfDirect OA link when available
- Concepts
-
Workflow, Automation, Computer science, Software engineering, Engineering, Data science, Systems engineering, Database, Mechanical engineeringTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
2Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 2Per-year citation counts (last 5 years)
- References (count)
-
6Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4396661999 |
|---|---|
| doi | https://doi.org/10.1051/epjconf/202429505012 |
| ids.doi | https://doi.org/10.1051/epjconf/202429505012 |
| ids.openalex | https://openalex.org/W4396661999 |
| fwci | 1.6737322 |
| type | article |
| title | End-to-End Analysis Automation over Distributed Resources with Luigi Analysis Workflows |
| biblio.issue | |
| biblio.volume | 295 |
| biblio.last_page | 05012 |
| biblio.first_page | 05012 |
| topics[0].id | https://openalex.org/T10715 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9998000264167786 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1705 |
| topics[0].subfield.display_name | Computer Networks and Communications |
| topics[0].display_name | Distributed and Parallel Computing Systems |
| topics[1].id | https://openalex.org/T11986 |
| topics[1].field.id | https://openalex.org/fields/18 |
| topics[1].field.display_name | Decision Sciences |
| topics[1].score | 0.9988999962806702 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1802 |
| topics[1].subfield.display_name | Information Systems and Management |
| topics[1].display_name | Scientific Computing and Data Management |
| topics[2].id | https://openalex.org/T10772 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9980999827384949 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1705 |
| topics[2].subfield.display_name | Computer Networks and Communications |
| topics[2].display_name | Distributed systems and fault tolerance |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C177212765 |
| concepts[0].level | 2 |
| concepts[0].score | 0.8066698908805847 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q627335 |
| concepts[0].display_name | Workflow |
| concepts[1].id | https://openalex.org/C115901376 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6646563410758972 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q184199 |
| concepts[1].display_name | Automation |
| concepts[2].id | https://openalex.org/C41008148 |
| concepts[2].level | 0 |
| concepts[2].score | 0.43626904487609863 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[2].display_name | Computer science |
| concepts[3].id | https://openalex.org/C115903868 |
| concepts[3].level | 1 |
| concepts[3].score | 0.41583192348480225 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q80993 |
| concepts[3].display_name | Software engineering |
| concepts[4].id | https://openalex.org/C127413603 |
| concepts[4].level | 0 |
| concepts[4].score | 0.40476545691490173 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q11023 |
| concepts[4].display_name | Engineering |
| concepts[5].id | https://openalex.org/C2522767166 |
| concepts[5].level | 1 |
| concepts[5].score | 0.4047560393810272 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[5].display_name | Data science |
| concepts[6].id | https://openalex.org/C201995342 |
| concepts[6].level | 1 |
| concepts[6].score | 0.37009644508361816 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q682496 |
| concepts[6].display_name | Systems engineering |
| concepts[7].id | https://openalex.org/C77088390 |
| concepts[7].level | 1 |
| concepts[7].score | 0.21844282746315002 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q8513 |
| concepts[7].display_name | Database |
| concepts[8].id | https://openalex.org/C78519656 |
| concepts[8].level | 1 |
| concepts[8].score | 0.12168452143669128 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q101333 |
| concepts[8].display_name | Mechanical engineering |
| keywords[0].id | https://openalex.org/keywords/workflow |
| keywords[0].score | 0.8066698908805847 |
| keywords[0].display_name | Workflow |
| keywords[1].id | https://openalex.org/keywords/automation |
| keywords[1].score | 0.6646563410758972 |
| keywords[1].display_name | Automation |
| keywords[2].id | https://openalex.org/keywords/computer-science |
| keywords[2].score | 0.43626904487609863 |
| keywords[2].display_name | Computer science |
| keywords[3].id | https://openalex.org/keywords/software-engineering |
| keywords[3].score | 0.41583192348480225 |
| keywords[3].display_name | Software engineering |
| keywords[4].id | https://openalex.org/keywords/engineering |
| keywords[4].score | 0.40476545691490173 |
| keywords[4].display_name | Engineering |
| keywords[5].id | https://openalex.org/keywords/data-science |
| keywords[5].score | 0.4047560393810272 |
| keywords[5].display_name | Data science |
| keywords[6].id | https://openalex.org/keywords/systems-engineering |
| keywords[6].score | 0.37009644508361816 |
| keywords[6].display_name | Systems engineering |
| keywords[7].id | https://openalex.org/keywords/database |
| keywords[7].score | 0.21844282746315002 |
| keywords[7].display_name | Database |
| keywords[8].id | https://openalex.org/keywords/mechanical-engineering |
| keywords[8].score | 0.12168452143669128 |
| keywords[8].display_name | Mechanical engineering |
| language | en |
| locations[0].id | doi:10.1051/epjconf/202429505012 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S19068271 |
| locations[0].source.issn | 2100-014X, 2101-6275 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 2100-014X |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | EPJ Web of Conferences |
| locations[0].source.host_organization | https://openalex.org/P4310319748 |
| locations[0].source.host_organization_name | EDP Sciences |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319748 |
| locations[0].source.host_organization_lineage_names | EDP Sciences |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://www.epj-conferences.org/articles/epjconf/pdf/2024/05/epjconf_chep2024_05012.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | EPJ Web of Conferences |
| locations[0].landing_page_url | https://doi.org/10.1051/epjconf/202429505012 |
| locations[1].id | pmh:oai:arXiv.org:2402.17949 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | https://arxiv.org/pdf/2402.17949 |
| locations[1].version | submittedVersion |
| locations[1].raw_type | text |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | http://arxiv.org/abs/2402.17949 |
| locations[2].id | pmh:oai:doaj.org/article:2e3817e69d0f465cb9e2e9f338ca84c6 |
| locations[2].is_oa | False |
| locations[2].source.id | https://openalex.org/S4306401280 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[2].source.host_organization | |
| locations[2].source.host_organization_name | |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | article |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | EPJ Web of Conferences, Vol 295, p 05012 (2024) |
| locations[2].landing_page_url | https://doaj.org/article/2e3817e69d0f465cb9e2e9f338ca84c6 |
| locations[3].id | pmh:oai:edpsciences.org:dkey/10.1051/epjconf/202429505012 |
| locations[3].is_oa | False |
| locations[3].source.id | https://openalex.org/S4306400744 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | Springer Link (Chiba Institute of Technology) |
| locations[3].source.host_organization | https://openalex.org/I8488066 |
| locations[3].source.host_organization_name | Chiba Institute of Technology |
| locations[3].source.host_organization_lineage | https://openalex.org/I8488066 |
| locations[3].license | |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | Text |
| locations[3].license_id | |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | https://doi.org/10.1051/epjconf/202429505012 |
| locations[3].landing_page_url | |
| indexed_in | arxiv, crossref, doaj |
| authorships[0].author.id | https://openalex.org/A5057847592 |
| authorships[0].author.orcid | https://orcid.org/0000-0003-0797-2606 |
| authorships[0].author.display_name | M. Rieger |
| authorships[0].countries | DE, SK |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I159176309, https://openalex.org/I4210091658 |
| authorships[0].affiliations[0].raw_affiliation_string | Institute of Experimental Physics, Hamburg University, Luruper Chaussee 149, 22761 Hamburg |
| authorships[0].institutions[0].id | https://openalex.org/I159176309 |
| authorships[0].institutions[0].ror | https://ror.org/00g30e956 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I159176309 |
| authorships[0].institutions[0].country_code | DE |
| authorships[0].institutions[0].display_name | Universität Hamburg |
| authorships[0].institutions[1].id | https://openalex.org/I4210091658 |
| authorships[0].institutions[1].ror | https://ror.org/0046rz373 |
| authorships[0].institutions[1].type | facility |
| authorships[0].institutions[1].lineage | https://openalex.org/I207624831, https://openalex.org/I4210091658 |
| authorships[0].institutions[1].country_code | SK |
| authorships[0].institutions[1].display_name | Institute of Experimental Physics of the Slovak Academy of Sciences |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Marcel Rieger |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Institute of Experimental Physics, Hamburg University, Luruper Chaussee 149, 22761 Hamburg |
| has_content.pdf | True |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://www.epj-conferences.org/articles/epjconf/pdf/2024/05/epjconf_chep2024_05012.pdf |
| open_access.oa_status | diamond |
| open_access.any_repository_has_fulltext | False |
| created_date | 2024-05-07T00:00:00 |
| display_name | End-to-End Analysis Automation over Distributed Resources with Luigi Analysis Workflows |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10715 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9998000264167786 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1705 |
| primary_topic.subfield.display_name | Computer Networks and Communications |
| primary_topic.display_name | Distributed and Parallel Computing Systems |
| related_works | https://openalex.org/W1981780420, https://openalex.org/W2182707996, https://openalex.org/W45233828, https://openalex.org/W2964988449, https://openalex.org/W2397952901, https://openalex.org/W2029380707, https://openalex.org/W4255934811, https://openalex.org/W2465382974, https://openalex.org/W2010229520, https://openalex.org/W2547528905 |
| cited_by_count | 2 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 2 |
| locations_count | 4 |
| best_oa_location.id | doi:10.1051/epjconf/202429505012 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S19068271 |
| best_oa_location.source.issn | 2100-014X, 2101-6275 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 2100-014X |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | EPJ Web of Conferences |
| best_oa_location.source.host_organization | https://openalex.org/P4310319748 |
| best_oa_location.source.host_organization_name | EDP Sciences |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319748 |
| best_oa_location.source.host_organization_lineage_names | EDP Sciences |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://www.epj-conferences.org/articles/epjconf/pdf/2024/05/epjconf_chep2024_05012.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | EPJ Web of Conferences |
| best_oa_location.landing_page_url | https://doi.org/10.1051/epjconf/202429505012 |
| primary_location.id | doi:10.1051/epjconf/202429505012 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S19068271 |
| primary_location.source.issn | 2100-014X, 2101-6275 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 2100-014X |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | EPJ Web of Conferences |
| primary_location.source.host_organization | https://openalex.org/P4310319748 |
| primary_location.source.host_organization_name | EDP Sciences |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319748 |
| primary_location.source.host_organization_lineage_names | EDP Sciences |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://www.epj-conferences.org/articles/epjconf/pdf/2024/05/epjconf_chep2024_05012.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | EPJ Web of Conferences |
| primary_location.landing_page_url | https://doi.org/10.1051/epjconf/202429505012 |
| publication_date | 2024-01-01 |
| publication_year | 2024 |
| referenced_works | https://openalex.org/W2148317584, https://openalex.org/W4252854332, https://openalex.org/W1596936080, https://openalex.org/W2489053600, https://openalex.org/W1574680346, https://openalex.org/W2613409207 |
| referenced_works_count | 6 |
| abstract_inverted_index.a | 73, 101, 140 |
| abstract_inverted_index.In | 0, 145 |
| abstract_inverted_index.It | 99 |
| abstract_inverted_index.To | 173 |
| abstract_inverted_index.an | 71, 217 |
| abstract_inverted_index.as | 9, 16, 193, 195, 228, 230 |
| abstract_inverted_index.by | 48, 97 |
| abstract_inverted_index.in | 12, 39 |
| abstract_inverted_index.is | 52, 87, 246 |
| abstract_inverted_index.it | 147 |
| abstract_inverted_index.of | 70, 107, 143, 151, 179, 251, 257 |
| abstract_inverted_index.on | 89, 157, 169, 187, 196 |
| abstract_inverted_index.or | 254 |
| abstract_inverted_index.to | 28, 61, 118, 128, 139 |
| abstract_inverted_index.HEP | 181 |
| abstract_inverted_index.Law | 123, 183, 245 |
| abstract_inverted_index.and | 42, 56, 110, 112, 161, 166, 216, 225, 232, 249, 260 |
| abstract_inverted_index.any | 252 |
| abstract_inverted_index.are | 6, 25 |
| abstract_inverted_index.but | 58 |
| abstract_inverted_index.for | 105, 223, 241 |
| abstract_inverted_index.its | 261 |
| abstract_inverted_index.job | 37, 185 |
| abstract_inverted_index.not | 53 |
| abstract_inverted_index.one | 159 |
| abstract_inverted_index.run | 162 |
| abstract_inverted_index.the | 68, 79, 90, 114, 120, 125, 149, 158, 170, 176, 210, 236, 255, 266 |
| abstract_inverted_index.via | 206 |
| abstract_inverted_index.File | 212 |
| abstract_inverted_index.Grid | 211 |
| abstract_inverted_index.This | 50, 76 |
| abstract_inverted_index.WLCG | 188 |
| abstract_inverted_index.aims | 240 |
| abstract_inverted_index.also | 59 |
| abstract_inverted_index.cope | 174 |
| abstract_inverted_index.data | 23 |
| abstract_inverted_index.file | 204 |
| abstract_inverted_index.from | 116 |
| abstract_inverted_index.only | 54 |
| abstract_inverted_index.over | 265 |
| abstract_inverted_index.past | 267 |
| abstract_inverted_index.such | 15 |
| abstract_inverted_index.tool | 93 |
| abstract_inverted_index.used | 8 |
| abstract_inverted_index.well | 194, 229 |
| abstract_inverted_index.with | 44, 131, 175, 221 |
| abstract_inverted_index.(ARC, | 190 |
| abstract_inverted_index.(Law) | 83 |
| abstract_inverted_index.Carlo | 18 |
| abstract_inverted_index.LSF), | 202 |
| abstract_inverted_index.Luigi | 80 |
| abstract_inverted_index.Monte | 17 |
| abstract_inverted_index.areas | 14 |
| abstract_inverted_index.based | 88 |
| abstract_inverted_index.code, | 259 |
| abstract_inverted_index.focus | 115 |
| abstract_inverted_index.hand, | 160 |
| abstract_inverted_index.hand. | 49, 172 |
| abstract_inverted_index.leads | 60 |
| abstract_inverted_index.local | 197 |
| abstract_inverted_index.novel | 237 |
| abstract_inverted_index.other | 171 |
| abstract_inverted_index.scale | 109 |
| abstract_inverted_index.steer | 29 |
| abstract_inverted_index.their | 30 |
| abstract_inverted_index.using | 209 |
| abstract_inverted_index.which | 86 |
| abstract_inverted_index.Access | 213 |
| abstract_inverted_index.Docker | 231 |
| abstract_inverted_index.Luigi, | 94 |
| abstract_inverted_index.Python | 84 |
| abstract_inverted_index.Slurm, | 201 |
| abstract_inverted_index.access | 205 |
| abstract_inverted_index.blocks | 127 |
| abstract_inverted_index.choice | 142 |
| abstract_inverted_index.design | 103 |
| abstract_inverted_index.gLite, | 191 |
| abstract_inverted_index.itself | 138 |
| abstract_inverted_index.logic. | 122 |
| abstract_inverted_index.remote | 133, 203 |
| abstract_inverted_index.shifts | 113 |
| abstract_inverted_index.stages | 41 |
| abstract_inverted_index.years. | 268 |
| abstract_inverted_index.Library | 214 |
| abstract_inverted_index.article | 77 |
| abstract_inverted_index.between | 64, 154 |
| abstract_inverted_index.complex | 32 |
| abstract_inverted_index.concept | 150 |
| abstract_inverted_index.demands | 178 |
| abstract_inverted_index.generic | 102 |
| abstract_inverted_index.package | 85 |
| abstract_inverted_index.pattern | 104 |
| abstract_inverted_index.process | 51 |
| abstract_inverted_index.serious | 74 |
| abstract_inverted_index.several | 40 |
| abstract_inverted_index.storage | 46, 164 |
| abstract_inverted_index.support | 222 |
| abstract_inverted_index.systems | 5, 47 |
| abstract_inverted_index.usually | 26 |
| abstract_inverted_index.various | 207 |
| abstract_inverted_index.virtual | 226 |
| abstract_inverted_index.(GFAL2), | 215 |
| abstract_inverted_index.Analysis | 81 |
| abstract_inverted_index.However, | 20 |
| abstract_inverted_index.Spotify. | 98 |
| abstract_inverted_index.Workflow | 82 |
| abstract_inverted_index.analyses | 24, 106 |
| abstract_inverted_index.analysis | 72, 121, 155, 242 |
| abstract_inverted_index.approach | 238 |
| abstract_inverted_index.building | 126 |
| abstract_inverted_index.clusters | 199 |
| abstract_inverted_index.complete | 152 |
| abstract_inverted_index.defining | 119 |
| abstract_inverted_index.executed | 258 |
| abstract_inverted_index.however, | 136 |
| abstract_inverted_index.language | 256 |
| abstract_inverted_index.limiting | 137 |
| abstract_inverted_index.particle | 1 |
| abstract_inverted_index.physics, | 2 |
| abstract_inverted_index.presents | 78 |
| abstract_inverted_index.provides | 124 |
| abstract_inverted_index.required | 27 |
| abstract_inverted_index.software | 167 |
| abstract_inverted_index.specific | 141 |
| abstract_inverted_index.steadily | 264 |
| abstract_inverted_index.steering | 69 |
| abstract_inverted_index.supports | 184 |
| abstract_inverted_index.tailored | 10 |
| abstract_inverted_index.without, | 135 |
| abstract_inverted_index.workflow | 3 |
| abstract_inverted_index.CMS-CRAB) | 192 |
| abstract_inverted_index.Moreover, | 235 |
| abstract_inverted_index.analyses, | 182 |
| abstract_inverted_index.arbitrary | 108 |
| abstract_inverted_index.computing | 198 |
| abstract_inverted_index.dedicated | 13 |
| abstract_inverted_index.developed | 96, 247 |
| abstract_inverted_index.executing | 117 |
| abstract_inverted_index.execution | 186 |
| abstract_inverted_index.increased | 263 |
| abstract_inverted_index.integrate | 130 |
| abstract_inverted_index.involving | 36 |
| abstract_inverted_index.manually, | 34 |
| abstract_inverted_index.mechanism | 220 |
| abstract_inverted_index.primarily | 7 |
| abstract_inverted_index.protocols | 208 |
| abstract_inverted_index.relations | 63 |
| abstract_inverted_index.rendering | 67 |
| abstract_inverted_index.resources | 134 |
| abstract_inverted_index.solutions | 11 |
| abstract_inverted_index.user-base | 262 |
| abstract_inverted_index.workflows | 33 |
| abstract_inverted_index.(HTCondor, | 200 |
| abstract_inverted_index.algorithms | 156 |
| abstract_inverted_index.challenge. | 75 |
| abstract_inverted_index.end-to-end | 180 |
| abstract_inverted_index.experiment | 253 |
| abstract_inverted_index.frequently | 35 |
| abstract_inverted_index.introduces | 148 |
| abstract_inverted_index.locations, | 163, 165 |
| abstract_inverted_index.management | 4 |
| abstract_inverted_index.opensource | 248 |
| abstract_inverted_index.originally | 95 |
| abstract_inverted_index.particular | 65 |
| abstract_inverted_index.performing | 22 |
| abstract_inverted_index.physicists | 21 |
| abstract_inverted_index.pipelining | 92 |
| abstract_inverted_index.sandboxing | 219 |
| abstract_inverted_index.seamlessly | 129 |
| abstract_inverted_index.separation | 153 |
| abstract_inverted_index.sub-shells | 224 |
| abstract_inverted_index.submission | 38 |
| abstract_inverted_index.ultimately | 239 |
| abstract_inverted_index.workloads, | 66 |
| abstract_inverted_index.Singularity | 233 |
| abstract_inverted_index.complexity, | 111 |
| abstract_inverted_index.containers. | 234 |
| abstract_inverted_index.distributed | 45 |
| abstract_inverted_index.environment | 218 |
| abstract_inverted_index.establishes | 100 |
| abstract_inverted_index.independent | 250 |
| abstract_inverted_index.individual, | 31 |
| abstract_inverted_index.interaction | 43 |
| abstract_inverted_index.open-source | 91 |
| abstract_inverted_index.particular, | 146 |
| abstract_inverted_index.production. | 19 |
| abstract_inverted_index.environments | 168 |
| abstract_inverted_index.error-prone, | 57 |
| abstract_inverted_index.preservation | 243 |
| abstract_inverted_index.undocumented | 62 |
| abstract_inverted_index.environments, | 227 |
| abstract_inverted_index.sophisticated | 177 |
| abstract_inverted_index.infrastructure | 189 |
| abstract_inverted_index.time-consuming | 55 |
| abstract_inverted_index.infrastructure. | 144 |
| abstract_inverted_index.interchangeable | 132 |
| abstract_inverted_index.out-of-the-box. | 244 |
| cited_by_percentile_year.max | 97 |
| cited_by_percentile_year.min | 95 |
| corresponding_author_ids | https://openalex.org/A5057847592 |
| countries_distinct_count | 2 |
| institutions_distinct_count | 1 |
| corresponding_institution_ids | https://openalex.org/I159176309, https://openalex.org/I4210091658 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/9 |
| sustainable_development_goals[0].score | 0.6200000047683716 |
| sustainable_development_goals[0].display_name | Industry, innovation and infrastructure |
| citation_normalized_percentile.value | 0.7448804 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |