Using Big Data Technologies for HEP Analysis Article Swipe
M. Cremonesi
,
Cláudio Bellini
,
Bianny Bian
,
Luca Canali
,
Vasileios Dimakopoulos
,
P. Elmer
,
I. Fisk
,
Maria Girone
,
O. Gutsche
,
Siew-Yan Hoh
,
B. Jayatilaka
,
V. Khristenko
,
Andrea Luiselli
,
A. Melo
,
Evangelos Evangelos
,
D. Olivito
,
J. Pazzini
,
J. Pivarski
,
Alexey Svyatkovskiy
,
Marco Zanetti
·
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.1901.07143
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.1901.07143
The HEP community is approaching an era were the excellent performances of the particle accelerators in delivering collision at high rate will force the experiments to record a large amount of information. The growing size of the datasets could potentially become a limiting factor in the capability to produce scientific results timely and efficiently. Recently, new technologies and new approaches have been developed in industry to answer to the necessity to retrieve information as quickly as possible to analyze PB and EB datasets. Providing the scientists with these modern computing tools will lead to rethinking the principles of data analysis in HEP, making the overall scientific process faster and smoother. In this paper, we are presenting the latest developments and the most recent results on the usage of Apache Spark for HEP analysis. The study aims at evaluating the efficiency of the application of the new tools both quantitatively, by measuring the performances, and qualitatively, focusing on the user experience. The first goal is achieved by developing a data reduction facility: working together with CERN Openlab and Intel, CMS replicates a real physics search using Spark-based technologies, with the ambition of reducing 1 PB of public data in 5 hours, collected by the CMS experiment, to 1 TB of data in a format suitable for physics analysis. The second goal is achieved by implementing multiple physics use-cases in Apache Spark using as input preprocessed datasets derived from official CMS data and simulation. By performing different end-analyses up to the publication plots on different hardware, feasibility, usability and portability are compared to the ones of a traditional ROOT-based workflow.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- http://cds.cern.ch/record/2650364
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4288627414
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4288627414Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.1901.07143Digital Object Identifier
- Title
-
Using Big Data Technologies for HEP AnalysisWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2019Year of publication
- Publication date
-
2019-01-22Full publication date if available
- Authors
-
M. Cremonesi, Cláudio Bellini, Bianny Bian, Luca Canali, Vasileios Dimakopoulos, P. Elmer, I. Fisk, Maria Girone, O. Gutsche, Siew-Yan Hoh, B. Jayatilaka, V. Khristenko, Andrea Luiselli, A. Melo, Evangelos Evangelos, D. Olivito, J. Pazzini, J. Pivarski, Alexey Svyatkovskiy, Marco ZanettiList of authors in order
- Landing page
-
https://cds.cern.ch/record/2650364Publisher landing page
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://www.osti.gov/biblio/1529354Direct OA link when available
- Concepts
-
Big data, Computer science, Data science, Data miningTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4288627414 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.1901.07143 |
| ids.doi | https://doi.org/10.48550/arxiv.1901.07143 |
| ids.openalex | https://openalex.org/W4288627414 |
| fwci | 0.0 |
| type | article |
| title | Using Big Data Technologies for HEP Analysis |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T11052 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.0625 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2208 |
| topics[0].subfield.display_name | Electrical and Electronic Engineering |
| topics[0].display_name | Energy Load and Power Forecasting |
| topics[1].id | https://openalex.org/T13812 |
| topics[1].field.id | https://openalex.org/fields/14 |
| topics[1].field.display_name | Business, Management and Accounting |
| topics[1].score | 0.043699998408555984 |
| topics[1].domain.id | https://openalex.org/domains/2 |
| topics[1].domain.display_name | Social Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1407 |
| topics[1].subfield.display_name | Organizational Behavior and Human Resource Management |
| topics[1].display_name | AI and HR Technologies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C75684735 |
| concepts[0].level | 2 |
| concepts[0].score | 0.6588943600654602 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q858810 |
| concepts[0].display_name | Big data |
| concepts[1].id | https://openalex.org/C41008148 |
| concepts[1].level | 0 |
| concepts[1].score | 0.44685038924217224 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[1].display_name | Computer science |
| concepts[2].id | https://openalex.org/C2522767166 |
| concepts[2].level | 1 |
| concepts[2].score | 0.4199933707714081 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q2374463 |
| concepts[2].display_name | Data science |
| concepts[3].id | https://openalex.org/C124101348 |
| concepts[3].level | 1 |
| concepts[3].score | 0.1936560571193695 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q172491 |
| concepts[3].display_name | Data mining |
| keywords[0].id | https://openalex.org/keywords/big-data |
| keywords[0].score | 0.6588943600654602 |
| keywords[0].display_name | Big data |
| keywords[1].id | https://openalex.org/keywords/computer-science |
| keywords[1].score | 0.44685038924217224 |
| keywords[1].display_name | Computer science |
| keywords[2].id | https://openalex.org/keywords/data-science |
| keywords[2].score | 0.4199933707714081 |
| keywords[2].display_name | Data science |
| keywords[3].id | https://openalex.org/keywords/data-mining |
| keywords[3].score | 0.1936560571193695 |
| keywords[3].display_name | Data mining |
| language | en |
| locations[0].id | pmh:oai:cds.cern.ch:2650364 |
| locations[0].is_oa | False |
| locations[0].source.id | https://openalex.org/S4306402194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | CERN Document Server (European Organization for Nuclear Research) |
| locations[0].source.host_organization | https://openalex.org/I67311998 |
| locations[0].source.host_organization_name | European Organization for Nuclear Research |
| locations[0].source.host_organization_lineage | https://openalex.org/I67311998 |
| locations[0].license | |
| locations[0].pdf_url | |
| locations[0].version | submittedVersion |
| locations[0].raw_type | |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://cds.cern.ch/record/2650364 |
| locations[1].id | pmh:oai:edpsciences.org:dkey/10.1051/epjconf/201921406030 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306400744 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | Springer Link (Chiba Institute of Technology) |
| locations[1].source.host_organization | https://openalex.org/I8488066 |
| locations[1].source.host_organization_name | Chiba Institute of Technology |
| locations[1].source.host_organization_lineage | https://openalex.org/I8488066 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | submittedVersion |
| locations[1].raw_type | Text |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | https://doi.org/10.1051/epjconf/201921406030 |
| locations[1].landing_page_url | |
| locations[2].id | pmh:oai:osti.gov:1529354 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306402487 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) |
| locations[2].source.host_organization | https://openalex.org/I139351228 |
| locations[2].source.host_organization_name | Office of Scientific and Technical Information |
| locations[2].source.host_organization_lineage | https://openalex.org/I139351228 |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | https://www.osti.gov/biblio/1529354 |
| locations[3].id | doi:10.48550/arxiv.1901.07143 |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S4306400194 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | True |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | arXiv (Cornell University) |
| locations[3].source.host_organization | https://openalex.org/I205783295 |
| locations[3].source.host_organization_name | Cornell University |
| locations[3].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[3].license | |
| locations[3].pdf_url | |
| locations[3].version | |
| locations[3].raw_type | article-journal |
| locations[3].license_id | |
| locations[3].is_accepted | False |
| locations[3].is_published | |
| locations[3].raw_source_name | |
| locations[3].landing_page_url | https://doi.org/10.48550/arxiv.1901.07143 |
| indexed_in | datacite |
| authorships[0].author.id | https://openalex.org/A5060199873 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-7605-3243 |
| authorships[0].author.display_name | M. Cremonesi |
| authorships[0].countries | US |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I1314696892 |
| authorships[0].affiliations[0].raw_affiliation_string | Fermilab |
| authorships[0].institutions[0].id | https://openalex.org/I1314696892 |
| authorships[0].institutions[0].ror | https://ror.org/020hgte69 |
| authorships[0].institutions[0].type | facility |
| authorships[0].institutions[0].lineage | https://openalex.org/I1314696892, https://openalex.org/I1330989302, https://openalex.org/I39565521, https://openalex.org/I4210114836 |
| authorships[0].institutions[0].country_code | US |
| authorships[0].institutions[0].display_name | Fermi National Accelerator Laboratory |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Cremonesi, Matteo |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Fermilab |
| authorships[1].author.id | https://openalex.org/A5054023487 |
| authorships[1].author.orcid | |
| authorships[1].author.display_name | Cláudio Bellini |
| authorships[1].countries | US |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I1343180700 |
| authorships[1].affiliations[0].raw_affiliation_string | Intel, Santa Clara |
| authorships[1].institutions[0].id | https://openalex.org/I1343180700 |
| authorships[1].institutions[0].ror | https://ror.org/01ek73717 |
| authorships[1].institutions[0].type | company |
| authorships[1].institutions[0].lineage | https://openalex.org/I1343180700 |
| authorships[1].institutions[0].country_code | US |
| authorships[1].institutions[0].display_name | Intel (United States) |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Bellini, Claudio |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Intel, Santa Clara |
| authorships[2].author.id | https://openalex.org/A5044556367 |
| authorships[2].author.orcid | |
| authorships[2].author.display_name | Bianny Bian |
| authorships[2].countries | US |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I1343180700 |
| authorships[2].affiliations[0].raw_affiliation_string | Intel, Santa Clara |
| authorships[2].institutions[0].id | https://openalex.org/I1343180700 |
| authorships[2].institutions[0].ror | https://ror.org/01ek73717 |
| authorships[2].institutions[0].type | company |
| authorships[2].institutions[0].lineage | https://openalex.org/I1343180700 |
| authorships[2].institutions[0].country_code | US |
| authorships[2].institutions[0].display_name | Intel (United States) |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Bian, Bianny |
| authorships[2].is_corresponding | False |
| authorships[2].raw_affiliation_strings | Intel, Santa Clara |
| authorships[3].author.id | https://openalex.org/A5013269493 |
| authorships[3].author.orcid | https://orcid.org/0000-0002-9957-149X |
| authorships[3].author.display_name | Luca Canali |
| authorships[3].countries | CH |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I67311998 |
| authorships[3].affiliations[0].raw_affiliation_string | CERN |
| authorships[3].institutions[0].id | https://openalex.org/I67311998 |
| authorships[3].institutions[0].ror | https://ror.org/01ggx4157 |
| authorships[3].institutions[0].type | facility |
| authorships[3].institutions[0].lineage | https://openalex.org/I67311998 |
| authorships[3].institutions[0].country_code | CH |
| authorships[3].institutions[0].display_name | European Organization for Nuclear Research |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Canali, Luca |
| authorships[3].is_corresponding | False |
| authorships[3].raw_affiliation_strings | CERN |
| authorships[4].author.id | https://openalex.org/A5008539362 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-9490-565X |
| authorships[4].author.display_name | Vasileios Dimakopoulos |
| authorships[4].countries | CH |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I67311998 |
| authorships[4].affiliations[0].raw_affiliation_string | CERN |
| authorships[4].institutions[0].id | https://openalex.org/I67311998 |
| authorships[4].institutions[0].ror | https://ror.org/01ggx4157 |
| authorships[4].institutions[0].type | facility |
| authorships[4].institutions[0].lineage | https://openalex.org/I67311998 |
| authorships[4].institutions[0].country_code | CH |
| authorships[4].institutions[0].display_name | European Organization for Nuclear Research |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Dimakopoulos, Vasileios |
| authorships[4].is_corresponding | False |
| authorships[4].raw_affiliation_strings | CERN |
| authorships[5].author.id | https://openalex.org/A5031846245 |
| authorships[5].author.orcid | https://orcid.org/0000-0001-6830-3356 |
| authorships[5].author.display_name | P. Elmer |
| authorships[5].affiliations[0].raw_affiliation_string | Princeton U. |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Elmer, Peter |
| authorships[5].is_corresponding | False |
| authorships[5].raw_affiliation_strings | Princeton U. |
| authorships[6].author.id | https://openalex.org/A5109230827 |
| authorships[6].author.orcid | |
| authorships[6].author.display_name | I. Fisk |
| authorships[6].countries | US |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I4210153546, https://openalex.org/I4387153999 |
| authorships[6].affiliations[0].raw_affiliation_string | Flatiron Inst., New York |
| authorships[6].institutions[0].id | https://openalex.org/I4387153999 |
| authorships[6].institutions[0].ror | https://ror.org/00sekdz59 |
| authorships[6].institutions[0].type | nonprofit |
| authorships[6].institutions[0].lineage | https://openalex.org/I4210107338, https://openalex.org/I4387153999 |
| authorships[6].institutions[0].country_code | |
| authorships[6].institutions[0].display_name | Flatiron Institute |
| authorships[6].institutions[1].id | https://openalex.org/I4210153546 |
| authorships[6].institutions[1].ror | https://ror.org/0508h6p74 |
| authorships[6].institutions[1].type | company |
| authorships[6].institutions[1].lineage | https://openalex.org/I4210153546 |
| authorships[6].institutions[1].country_code | US |
| authorships[6].institutions[1].display_name | Flatiron Health (United States) |
| authorships[6].author_position | middle |
| authorships[6].raw_author_name | Fisk, Ian |
| authorships[6].is_corresponding | False |
| authorships[6].raw_affiliation_strings | Flatiron Inst., New York |
| authorships[7].author.id | https://openalex.org/A5104105662 |
| authorships[7].author.orcid | |
| authorships[7].author.display_name | Maria Girone |
| authorships[7].countries | CH |
| authorships[7].affiliations[0].institution_ids | https://openalex.org/I67311998 |
| authorships[7].affiliations[0].raw_affiliation_string | CERN |
| authorships[7].institutions[0].id | https://openalex.org/I67311998 |
| authorships[7].institutions[0].ror | https://ror.org/01ggx4157 |
| authorships[7].institutions[0].type | facility |
| authorships[7].institutions[0].lineage | https://openalex.org/I67311998 |
| authorships[7].institutions[0].country_code | CH |
| authorships[7].institutions[0].display_name | European Organization for Nuclear Research |
| authorships[7].author_position | middle |
| authorships[7].raw_author_name | Girone, Maria |
| authorships[7].is_corresponding | False |
| authorships[7].raw_affiliation_strings | CERN |
| authorships[8].author.id | https://openalex.org/A5101728612 |
| authorships[8].author.orcid | https://orcid.org/0000-0002-8015-9622 |
| authorships[8].author.display_name | O. Gutsche |
| authorships[8].countries | US |
| authorships[8].affiliations[0].institution_ids | https://openalex.org/I1314696892 |
| authorships[8].affiliations[0].raw_affiliation_string | Fermilab |
| authorships[8].institutions[0].id | https://openalex.org/I1314696892 |
| authorships[8].institutions[0].ror | https://ror.org/020hgte69 |
| authorships[8].institutions[0].type | facility |
| authorships[8].institutions[0].lineage | https://openalex.org/I1314696892, https://openalex.org/I1330989302, https://openalex.org/I39565521, https://openalex.org/I4210114836 |
| authorships[8].institutions[0].country_code | US |
| authorships[8].institutions[0].display_name | Fermi National Accelerator Laboratory |
| authorships[8].author_position | middle |
| authorships[8].raw_author_name | Gutsche, Oliver |
| authorships[8].is_corresponding | False |
| authorships[8].raw_affiliation_strings | Fermilab |
| authorships[9].author.id | https://openalex.org/A5011558187 |
| authorships[9].author.orcid | |
| authorships[9].author.display_name | Siew-Yan Hoh |
| authorships[9].countries | IT |
| authorships[9].affiliations[0].institution_ids | https://openalex.org/I83816512 |
| authorships[9].affiliations[0].raw_affiliation_string | Genoa U. |
| authorships[9].institutions[0].id | https://openalex.org/I83816512 |
| authorships[9].institutions[0].ror | https://ror.org/0107c5v14 |
| authorships[9].institutions[0].type | education |
| authorships[9].institutions[0].lineage | https://openalex.org/I83816512 |
| authorships[9].institutions[0].country_code | IT |
| authorships[9].institutions[0].display_name | University of Genoa |
| authorships[9].author_position | middle |
| authorships[9].raw_author_name | Hoh, Siew-Yan |
| authorships[9].is_corresponding | False |
| authorships[9].raw_affiliation_strings | Genoa U. |
| authorships[10].author.id | https://openalex.org/A5044094870 |
| authorships[10].author.orcid | https://orcid.org/0000-0001-7912-5612 |
| authorships[10].author.display_name | B. Jayatilaka |
| authorships[10].countries | US |
| authorships[10].affiliations[0].institution_ids | https://openalex.org/I1314696892 |
| authorships[10].affiliations[0].raw_affiliation_string | Fermilab |
| authorships[10].institutions[0].id | https://openalex.org/I1314696892 |
| authorships[10].institutions[0].ror | https://ror.org/020hgte69 |
| authorships[10].institutions[0].type | facility |
| authorships[10].institutions[0].lineage | https://openalex.org/I1314696892, https://openalex.org/I1330989302, https://openalex.org/I39565521, https://openalex.org/I4210114836 |
| authorships[10].institutions[0].country_code | US |
| authorships[10].institutions[0].display_name | Fermi National Accelerator Laboratory |
| authorships[10].author_position | middle |
| authorships[10].raw_author_name | Jayatilaka, Bo |
| authorships[10].is_corresponding | False |
| authorships[10].raw_affiliation_strings | Fermilab |
| authorships[11].author.id | https://openalex.org/A5107447102 |
| authorships[11].author.orcid | |
| authorships[11].author.display_name | V. Khristenko |
| authorships[11].countries | CH |
| authorships[11].affiliations[0].institution_ids | https://openalex.org/I67311998 |
| authorships[11].affiliations[0].raw_affiliation_string | CERN |
| authorships[11].institutions[0].id | https://openalex.org/I67311998 |
| authorships[11].institutions[0].ror | https://ror.org/01ggx4157 |
| authorships[11].institutions[0].type | facility |
| authorships[11].institutions[0].lineage | https://openalex.org/I67311998 |
| authorships[11].institutions[0].country_code | CH |
| authorships[11].institutions[0].display_name | European Organization for Nuclear Research |
| authorships[11].author_position | middle |
| authorships[11].raw_author_name | Khristenko, Viktor |
| authorships[11].is_corresponding | False |
| authorships[11].raw_affiliation_strings | CERN |
| authorships[12].author.id | https://openalex.org/A5086180424 |
| authorships[12].author.orcid | |
| authorships[12].author.display_name | Andrea Luiselli |
| authorships[12].countries | US |
| authorships[12].affiliations[0].institution_ids | https://openalex.org/I1343180700 |
| authorships[12].affiliations[0].raw_affiliation_string | Intel, Santa Clara |
| authorships[12].institutions[0].id | https://openalex.org/I1343180700 |
| authorships[12].institutions[0].ror | https://ror.org/01ek73717 |
| authorships[12].institutions[0].type | company |
| authorships[12].institutions[0].lineage | https://openalex.org/I1343180700 |
| authorships[12].institutions[0].country_code | US |
| authorships[12].institutions[0].display_name | Intel (United States) |
| authorships[12].author_position | middle |
| authorships[12].raw_author_name | Luiselli, Andrea |
| authorships[12].is_corresponding | False |
| authorships[12].raw_affiliation_strings | Intel, Santa Clara |
| authorships[13].author.id | https://openalex.org/A5107937033 |
| authorships[13].author.orcid | https://orcid.org/0000-0003-3473-8858 |
| authorships[13].author.display_name | A. Melo |
| authorships[13].countries | US |
| authorships[13].affiliations[0].institution_ids | https://openalex.org/I4210162197 |
| authorships[13].affiliations[0].raw_affiliation_string | Vanderbilt U. |
| authorships[13].institutions[0].id | https://openalex.org/I4210162197 |
| authorships[13].institutions[0].ror | https://ror.org/05grhsk96 |
| authorships[13].institutions[0].type | company |
| authorships[13].institutions[0].lineage | https://openalex.org/I4210162197 |
| authorships[13].institutions[0].country_code | US |
| authorships[13].institutions[0].display_name | Vanderbilt Health |
| authorships[13].author_position | middle |
| authorships[13].raw_author_name | Melo, Andrew |
| authorships[13].is_corresponding | False |
| authorships[13].raw_affiliation_strings | Vanderbilt U. |
| authorships[14].author.id | https://openalex.org/A5002896749 |
| authorships[14].author.orcid | |
| authorships[14].author.display_name | Evangelos Evangelos |
| authorships[14].countries | CH |
| authorships[14].affiliations[0].institution_ids | https://openalex.org/I67311998 |
| authorships[14].affiliations[0].raw_affiliation_string | CERN |
| authorships[14].institutions[0].id | https://openalex.org/I67311998 |
| authorships[14].institutions[0].ror | https://ror.org/01ggx4157 |
| authorships[14].institutions[0].type | facility |
| authorships[14].institutions[0].lineage | https://openalex.org/I67311998 |
| authorships[14].institutions[0].country_code | CH |
| authorships[14].institutions[0].display_name | European Organization for Nuclear Research |
| authorships[14].author_position | middle |
| authorships[14].raw_author_name | Evangelos, Evangelos |
| authorships[14].is_corresponding | False |
| authorships[14].raw_affiliation_strings | CERN |
| authorships[15].author.id | https://openalex.org/A5107394143 |
| authorships[15].author.orcid | https://orcid.org/0000-0002-1021-2774 |
| authorships[15].author.display_name | D. Olivito |
| authorships[15].countries | US |
| authorships[15].affiliations[0].institution_ids | https://openalex.org/I36258959 |
| authorships[15].affiliations[0].raw_affiliation_string | UC, San Diego |
| authorships[15].institutions[0].id | https://openalex.org/I36258959 |
| authorships[15].institutions[0].ror | https://ror.org/0168r3w48 |
| authorships[15].institutions[0].type | education |
| authorships[15].institutions[0].lineage | https://openalex.org/I36258959 |
| authorships[15].institutions[0].country_code | US |
| authorships[15].institutions[0].display_name | University of California, San Diego |
| authorships[15].author_position | middle |
| authorships[15].raw_author_name | Olivito, Dominick |
| authorships[15].is_corresponding | False |
| authorships[15].raw_affiliation_strings | UC, San Diego |
| authorships[16].author.id | https://openalex.org/A5039937730 |
| authorships[16].author.orcid | https://orcid.org/0000-0002-1118-6205 |
| authorships[16].author.display_name | J. Pazzini |
| authorships[16].countries | IT |
| authorships[16].affiliations[0].institution_ids | https://openalex.org/I83816512 |
| authorships[16].affiliations[0].raw_affiliation_string | Genoa U. |
| authorships[16].institutions[0].id | https://openalex.org/I83816512 |
| authorships[16].institutions[0].ror | https://ror.org/0107c5v14 |
| authorships[16].institutions[0].type | education |
| authorships[16].institutions[0].lineage | https://openalex.org/I83816512 |
| authorships[16].institutions[0].country_code | IT |
| authorships[16].institutions[0].display_name | University of Genoa |
| authorships[16].author_position | middle |
| authorships[16].raw_author_name | Pazzini, Jacopo |
| authorships[16].is_corresponding | False |
| authorships[16].raw_affiliation_strings | Genoa U. |
| authorships[17].author.id | https://openalex.org/A5024608882 |
| authorships[17].author.orcid | https://orcid.org/0000-0002-6649-343X |
| authorships[17].author.display_name | J. Pivarski |
| authorships[17].affiliations[0].raw_affiliation_string | Princeton U. |
| authorships[17].author_position | middle |
| authorships[17].raw_author_name | Pivarski, Jim |
| authorships[17].is_corresponding | False |
| authorships[17].raw_affiliation_strings | Princeton U. |
| authorships[18].author.id | https://openalex.org/A5107906350 |
| authorships[18].author.orcid | |
| authorships[18].author.display_name | Alexey Svyatkovskiy |
| authorships[18].affiliations[0].raw_affiliation_string | Princeton U. |
| authorships[18].author_position | middle |
| authorships[18].raw_author_name | Svyatkovskiy, Alexey |
| authorships[18].is_corresponding | False |
| authorships[18].raw_affiliation_strings | Princeton U. |
| authorships[19].author.id | https://openalex.org/A5107233188 |
| authorships[19].author.orcid | |
| authorships[19].author.display_name | Marco Zanetti |
| authorships[19].countries | IT |
| authorships[19].affiliations[0].institution_ids | https://openalex.org/I83816512 |
| authorships[19].affiliations[0].raw_affiliation_string | Genoa U. |
| authorships[19].institutions[0].id | https://openalex.org/I83816512 |
| authorships[19].institutions[0].ror | https://ror.org/0107c5v14 |
| authorships[19].institutions[0].type | education |
| authorships[19].institutions[0].lineage | https://openalex.org/I83816512 |
| authorships[19].institutions[0].country_code | IT |
| authorships[19].institutions[0].display_name | University of Genoa |
| authorships[19].author_position | last |
| authorships[19].raw_author_name | Zanetti, Marco |
| authorships[19].is_corresponding | False |
| authorships[19].raw_affiliation_strings | Genoa U. |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://www.osti.gov/biblio/1529354 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | Using Big Data Technologies for HEP Analysis |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T11052 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.0625 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2208 |
| primary_topic.subfield.display_name | Electrical and Electronic Engineering |
| primary_topic.display_name | Energy Load and Power Forecasting |
| related_works | https://openalex.org/W4322629366, https://openalex.org/W2808989540, https://openalex.org/W2397053934, https://openalex.org/W1039292361, https://openalex.org/W2551093110, https://openalex.org/W4237919137, https://openalex.org/W3184179822, https://openalex.org/W3095362084, https://openalex.org/W2148016376, https://openalex.org/W3003361536 |
| cited_by_count | 0 |
| locations_count | 4 |
| best_oa_location.id | pmh:oai:osti.gov:1529354 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306402487 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) |
| best_oa_location.source.host_organization | https://openalex.org/I139351228 |
| best_oa_location.source.host_organization_name | Office of Scientific and Technical Information |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I139351228 |
| best_oa_location.license | |
| best_oa_location.pdf_url | |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | https://www.osti.gov/biblio/1529354 |
| primary_location.id | pmh:oai:cds.cern.ch:2650364 |
| primary_location.is_oa | False |
| primary_location.source.id | https://openalex.org/S4306402194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | CERN Document Server (European Organization for Nuclear Research) |
| primary_location.source.host_organization | https://openalex.org/I67311998 |
| primary_location.source.host_organization_name | European Organization for Nuclear Research |
| primary_location.source.host_organization_lineage | https://openalex.org/I67311998 |
| primary_location.license | |
| primary_location.pdf_url | |
| primary_location.version | submittedVersion |
| primary_location.raw_type | |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://cds.cern.ch/record/2650364 |
| publication_date | 2019-01-22 |
| publication_year | 2019 |
| referenced_works_count | 0 |
| abstract_inverted_index.1 | 192, 206 |
| abstract_inverted_index.5 | 198 |
| abstract_inverted_index.a | 27, 41, 167, 180, 211, 264 |
| abstract_inverted_index.By | 242 |
| abstract_inverted_index.EB | 81 |
| abstract_inverted_index.In | 110 |
| abstract_inverted_index.PB | 79, 193 |
| abstract_inverted_index.TB | 207 |
| abstract_inverted_index.an | 5 |
| abstract_inverted_index.as | 73, 75, 231 |
| abstract_inverted_index.at | 18, 136 |
| abstract_inverted_index.by | 149, 165, 201, 222 |
| abstract_inverted_index.in | 15, 44, 63, 100, 197, 210, 227 |
| abstract_inverted_index.is | 3, 163, 220 |
| abstract_inverted_index.of | 11, 30, 35, 97, 127, 140, 143, 190, 194, 208, 263 |
| abstract_inverted_index.on | 124, 156, 251 |
| abstract_inverted_index.to | 25, 47, 65, 67, 70, 77, 93, 205, 247, 260 |
| abstract_inverted_index.up | 246 |
| abstract_inverted_index.we | 113 |
| abstract_inverted_index.CMS | 178, 203, 238 |
| abstract_inverted_index.HEP | 1, 131 |
| abstract_inverted_index.The | 0, 32, 133, 160, 217 |
| abstract_inverted_index.and | 52, 57, 80, 108, 119, 153, 176, 240, 256 |
| abstract_inverted_index.are | 114, 258 |
| abstract_inverted_index.era | 6 |
| abstract_inverted_index.for | 130, 214 |
| abstract_inverted_index.new | 55, 58, 145 |
| abstract_inverted_index.the | 8, 12, 23, 36, 45, 68, 84, 95, 103, 116, 120, 125, 138, 141, 144, 151, 157, 188, 202, 248, 261 |
| abstract_inverted_index.CERN | 174 |
| abstract_inverted_index.HEP, | 101 |
| abstract_inverted_index.aims | 135 |
| abstract_inverted_index.been | 61 |
| abstract_inverted_index.both | 147 |
| abstract_inverted_index.data | 98, 168, 196, 209, 239 |
| abstract_inverted_index.from | 236 |
| abstract_inverted_index.goal | 162, 219 |
| abstract_inverted_index.have | 60 |
| abstract_inverted_index.high | 19 |
| abstract_inverted_index.lead | 92 |
| abstract_inverted_index.most | 121 |
| abstract_inverted_index.ones | 262 |
| abstract_inverted_index.rate | 20 |
| abstract_inverted_index.real | 181 |
| abstract_inverted_index.size | 34 |
| abstract_inverted_index.this | 111 |
| abstract_inverted_index.user | 158 |
| abstract_inverted_index.were | 7 |
| abstract_inverted_index.will | 21, 91 |
| abstract_inverted_index.with | 86, 173, 187 |
| abstract_inverted_index.Spark | 129, 229 |
| abstract_inverted_index.could | 38 |
| abstract_inverted_index.first | 161 |
| abstract_inverted_index.force | 22 |
| abstract_inverted_index.input | 232 |
| abstract_inverted_index.large | 28 |
| abstract_inverted_index.plots | 250 |
| abstract_inverted_index.study | 134 |
| abstract_inverted_index.these | 87 |
| abstract_inverted_index.tools | 90, 146 |
| abstract_inverted_index.usage | 126 |
| abstract_inverted_index.using | 184, 230 |
| abstract_inverted_index.Apache | 128, 228 |
| abstract_inverted_index.Intel, | 177 |
| abstract_inverted_index.amount | 29 |
| abstract_inverted_index.answer | 66 |
| abstract_inverted_index.become | 40 |
| abstract_inverted_index.factor | 43 |
| abstract_inverted_index.faster | 107 |
| abstract_inverted_index.format | 212 |
| abstract_inverted_index.hours, | 199 |
| abstract_inverted_index.latest | 117 |
| abstract_inverted_index.making | 102 |
| abstract_inverted_index.modern | 88 |
| abstract_inverted_index.paper, | 112 |
| abstract_inverted_index.public | 195 |
| abstract_inverted_index.recent | 122 |
| abstract_inverted_index.record | 26 |
| abstract_inverted_index.search | 183 |
| abstract_inverted_index.second | 218 |
| abstract_inverted_index.timely | 51 |
| abstract_inverted_index.Openlab | 175 |
| abstract_inverted_index.analyze | 78 |
| abstract_inverted_index.derived | 235 |
| abstract_inverted_index.growing | 33 |
| abstract_inverted_index.overall | 104 |
| abstract_inverted_index.physics | 182, 215, 225 |
| abstract_inverted_index.process | 106 |
| abstract_inverted_index.produce | 48 |
| abstract_inverted_index.quickly | 74 |
| abstract_inverted_index.results | 50, 123 |
| abstract_inverted_index.working | 171 |
| abstract_inverted_index.achieved | 164, 221 |
| abstract_inverted_index.ambition | 189 |
| abstract_inverted_index.analysis | 99 |
| abstract_inverted_index.compared | 259 |
| abstract_inverted_index.datasets | 37, 234 |
| abstract_inverted_index.focusing | 155 |
| abstract_inverted_index.industry | 64 |
| abstract_inverted_index.limiting | 42 |
| abstract_inverted_index.multiple | 224 |
| abstract_inverted_index.official | 237 |
| abstract_inverted_index.particle | 13 |
| abstract_inverted_index.possible | 76 |
| abstract_inverted_index.reducing | 191 |
| abstract_inverted_index.retrieve | 71 |
| abstract_inverted_index.suitable | 213 |
| abstract_inverted_index.together | 172 |
| abstract_inverted_index.Providing | 83 |
| abstract_inverted_index.Recently, | 54 |
| abstract_inverted_index.analysis. | 132, 216 |
| abstract_inverted_index.collected | 200 |
| abstract_inverted_index.collision | 17 |
| abstract_inverted_index.community | 2 |
| abstract_inverted_index.computing | 89 |
| abstract_inverted_index.datasets. | 82 |
| abstract_inverted_index.developed | 62 |
| abstract_inverted_index.different | 244, 252 |
| abstract_inverted_index.excellent | 9 |
| abstract_inverted_index.facility: | 170 |
| abstract_inverted_index.hardware, | 253 |
| abstract_inverted_index.measuring | 150 |
| abstract_inverted_index.necessity | 69 |
| abstract_inverted_index.reduction | 169 |
| abstract_inverted_index.smoother. | 109 |
| abstract_inverted_index.usability | 255 |
| abstract_inverted_index.use-cases | 226 |
| abstract_inverted_index.workflow. | 267 |
| abstract_inverted_index.ROOT-based | 266 |
| abstract_inverted_index.approaches | 59 |
| abstract_inverted_index.capability | 46 |
| abstract_inverted_index.delivering | 16 |
| abstract_inverted_index.developing | 166 |
| abstract_inverted_index.efficiency | 139 |
| abstract_inverted_index.evaluating | 137 |
| abstract_inverted_index.performing | 243 |
| abstract_inverted_index.presenting | 115 |
| abstract_inverted_index.principles | 96 |
| abstract_inverted_index.replicates | 179 |
| abstract_inverted_index.rethinking | 94 |
| abstract_inverted_index.scientific | 49, 105 |
| abstract_inverted_index.scientists | 85 |
| abstract_inverted_index.Spark-based | 185 |
| abstract_inverted_index.application | 142 |
| abstract_inverted_index.approaching | 4 |
| abstract_inverted_index.experience. | 159 |
| abstract_inverted_index.experiment, | 204 |
| abstract_inverted_index.experiments | 24 |
| abstract_inverted_index.information | 72 |
| abstract_inverted_index.portability | 257 |
| abstract_inverted_index.potentially | 39 |
| abstract_inverted_index.publication | 249 |
| abstract_inverted_index.simulation. | 241 |
| abstract_inverted_index.traditional | 265 |
| abstract_inverted_index.accelerators | 14 |
| abstract_inverted_index.developments | 118 |
| abstract_inverted_index.efficiently. | 53 |
| abstract_inverted_index.end-analyses | 245 |
| abstract_inverted_index.feasibility, | 254 |
| abstract_inverted_index.implementing | 223 |
| abstract_inverted_index.information. | 31 |
| abstract_inverted_index.performances | 10 |
| abstract_inverted_index.preprocessed | 233 |
| abstract_inverted_index.technologies | 56 |
| abstract_inverted_index.performances, | 152 |
| abstract_inverted_index.technologies, | 186 |
| abstract_inverted_index.qualitatively, | 154 |
| abstract_inverted_index.quantitatively, | 148 |
| cited_by_percentile_year | |
| countries_distinct_count | 3 |
| institutions_distinct_count | 20 |
| citation_normalized_percentile.value | 0.26959461 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |