Keep-up Production in JUNO’s Offline Data Processing Article Swipe
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.1051/epjconf/202533701176
The Jiangmen Underground Neutrino Observatory (JUNO) is a cutting-edge scientific experiment designed to address fundamental questions in neutrino physics, including the determination of the neutrino mass ordering and precision measurements of neutrino oscillation parameters. To support the massive data processing requirements of JUNO, we have developed the Keep Up Production (KUP) pipeline, a robust and scalable system for managing the offline data processing workflow. This paper presents the architecture, design, and implementation of the KUP pipeline, highlighting its key components, including job management, data visualization, and the use of modern web technologies. We also discuss the challenges posed by the complexity and volume of data, and how the KUP pipeline addresses these challenges through automation, modularity, and real-time monitoring.
Related Topics
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1051/epjconf/202533701176
- https://www.epj-conferences.org/articles/epjconf/pdf/2025/22/epjconf_chep2025_01176.pdf
- OA Status
- diamond
- References
- 6
- OpenAlex ID
- https://openalex.org/W4414882354
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4414882354Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1051/epjconf/202533701176Digital Object Identifier
- Title
-
Keep-up Production in JUNO’s Offline Data ProcessingWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-01-01Full publication date if available
- Authors
-
Weiqing Yin, T. Lin, Yizhou ZhangList of authors in order
- Landing page
-
https://doi.org/10.1051/epjconf/202533701176Publisher landing page
- PDF URL
-
https://www.epj-conferences.org/articles/epjconf/pdf/2025/22/epjconf_chep2025_01176.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
diamondOpen access status per OpenAlex
- OA URL
-
https://www.epj-conferences.org/articles/epjconf/pdf/2025/22/epjconf_chep2025_01176.pdfDirect OA link when available
- Cited by
-
0Total citation count in OpenAlex
- References (count)
-
6Number of works referenced by this work
Full payload
| id | https://openalex.org/W4414882354 |
|---|---|
| doi | https://doi.org/10.1051/epjconf/202533701176 |
| ids.doi | https://doi.org/10.1051/epjconf/202533701176 |
| ids.openalex | https://openalex.org/W4414882354 |
| fwci | 0.0 |
| type | article |
| title | Keep-up Production in JUNO’s Offline Data Processing |
| biblio.issue | |
| biblio.volume | 337 |
| biblio.last_page | 01176 |
| biblio.first_page | 01176 |
| topics[0].id | https://openalex.org/T10715 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9993000030517578 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1705 |
| topics[0].subfield.display_name | Computer Networks and Communications |
| topics[0].display_name | Distributed and Parallel Computing Systems |
| topics[1].id | https://openalex.org/T10054 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9987999796867371 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1708 |
| topics[1].subfield.display_name | Hardware and Architecture |
| topics[1].display_name | Parallel Computing and Optimization Techniques |
| topics[2].id | https://openalex.org/T11181 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9987000226974487 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1705 |
| topics[2].subfield.display_name | Computer Networks and Communications |
| topics[2].display_name | Advanced Data Storage Technologies |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| language | en |
| locations[0].id | doi:10.1051/epjconf/202533701176 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S19068271 |
| locations[0].source.issn | 2100-014X, 2101-6275 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | 2100-014X |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | True |
| locations[0].source.display_name | EPJ Web of Conferences |
| locations[0].source.host_organization | https://openalex.org/P4310319748 |
| locations[0].source.host_organization_name | EDP Sciences |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319748 |
| locations[0].source.host_organization_lineage_names | EDP Sciences |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://www.epj-conferences.org/articles/epjconf/pdf/2025/22/epjconf_chep2025_01176.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | EPJ Web of Conferences |
| locations[0].landing_page_url | https://doi.org/10.1051/epjconf/202533701176 |
| locations[1].id | pmh:oai:doaj.org/article:3ab500cb6b744610a88cb3c887161695 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306401280 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | DOAJ (DOAJ: Directory of Open Access Journals) |
| locations[1].source.host_organization | |
| locations[1].source.host_organization_name | |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | submittedVersion |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | EPJ Web of Conferences, Vol 337, p 01176 (2025) |
| locations[1].landing_page_url | https://doaj.org/article/3ab500cb6b744610a88cb3c887161695 |
| indexed_in | crossref, doaj |
| authorships[0].author.id | https://openalex.org/A5108976170 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Weiqing Yin |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Weiqing Yin |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5101961197 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-6450-9629 |
| authorships[1].author.display_name | T. Lin |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Tao Lin |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5100643391 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-8206-4694 |
| authorships[2].author.display_name | Yizhou Zhang |
| authorships[2].author_position | last |
| authorships[2].raw_author_name | Yizhou Zhang |
| authorships[2].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://www.epj-conferences.org/articles/epjconf/pdf/2025/22/epjconf_chep2025_01176.pdf |
| open_access.oa_status | diamond |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-07T00:00:00 |
| display_name | Keep-up Production in JUNO’s Offline Data Processing |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T10715 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9993000030517578 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1705 |
| primary_topic.subfield.display_name | Computer Networks and Communications |
| primary_topic.display_name | Distributed and Parallel Computing Systems |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | doi:10.1051/epjconf/202533701176 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S19068271 |
| best_oa_location.source.issn | 2100-014X, 2101-6275 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | 2100-014X |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | True |
| best_oa_location.source.display_name | EPJ Web of Conferences |
| best_oa_location.source.host_organization | https://openalex.org/P4310319748 |
| best_oa_location.source.host_organization_name | EDP Sciences |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319748 |
| best_oa_location.source.host_organization_lineage_names | EDP Sciences |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://www.epj-conferences.org/articles/epjconf/pdf/2025/22/epjconf_chep2025_01176.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | EPJ Web of Conferences |
| best_oa_location.landing_page_url | https://doi.org/10.1051/epjconf/202533701176 |
| primary_location.id | doi:10.1051/epjconf/202533701176 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S19068271 |
| primary_location.source.issn | 2100-014X, 2101-6275 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | 2100-014X |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | True |
| primary_location.source.display_name | EPJ Web of Conferences |
| primary_location.source.host_organization | https://openalex.org/P4310319748 |
| primary_location.source.host_organization_name | EDP Sciences |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319748 |
| primary_location.source.host_organization_lineage_names | EDP Sciences |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://www.epj-conferences.org/articles/epjconf/pdf/2025/22/epjconf_chep2025_01176.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | EPJ Web of Conferences |
| primary_location.landing_page_url | https://doi.org/10.1051/epjconf/202533701176 |
| publication_date | 2025-01-01 |
| publication_year | 2025 |
| referenced_works | https://openalex.org/W1583045029, https://openalex.org/W1974070499, https://openalex.org/W3104138323, https://openalex.org/W4396662210, https://openalex.org/W2150511069, https://openalex.org/W2990714382 |
| referenced_works_count | 6 |
| abstract_inverted_index.a | 7, 52 |
| abstract_inverted_index.To | 34 |
| abstract_inverted_index.Up | 48 |
| abstract_inverted_index.We | 92 |
| abstract_inverted_index.by | 98 |
| abstract_inverted_index.in | 16 |
| abstract_inverted_index.is | 6 |
| abstract_inverted_index.of | 22, 30, 41, 72, 88, 103 |
| abstract_inverted_index.to | 12 |
| abstract_inverted_index.we | 43 |
| abstract_inverted_index.KUP | 74, 108 |
| abstract_inverted_index.The | 0 |
| abstract_inverted_index.and | 27, 54, 70, 85, 101, 105, 116 |
| abstract_inverted_index.for | 57 |
| abstract_inverted_index.how | 106 |
| abstract_inverted_index.its | 77 |
| abstract_inverted_index.job | 81 |
| abstract_inverted_index.key | 78 |
| abstract_inverted_index.the | 20, 23, 36, 46, 59, 67, 73, 86, 95, 99, 107 |
| abstract_inverted_index.use | 87 |
| abstract_inverted_index.web | 90 |
| abstract_inverted_index.Keep | 47 |
| abstract_inverted_index.This | 64 |
| abstract_inverted_index.also | 93 |
| abstract_inverted_index.data | 38, 61, 83 |
| abstract_inverted_index.have | 44 |
| abstract_inverted_index.mass | 25 |
| abstract_inverted_index.(KUP) | 50 |
| abstract_inverted_index.JUNO, | 42 |
| abstract_inverted_index.data, | 104 |
| abstract_inverted_index.paper | 65 |
| abstract_inverted_index.posed | 97 |
| abstract_inverted_index.these | 111 |
| abstract_inverted_index.(JUNO) | 5 |
| abstract_inverted_index.modern | 89 |
| abstract_inverted_index.robust | 53 |
| abstract_inverted_index.system | 56 |
| abstract_inverted_index.volume | 102 |
| abstract_inverted_index.address | 13 |
| abstract_inverted_index.design, | 69 |
| abstract_inverted_index.discuss | 94 |
| abstract_inverted_index.massive | 37 |
| abstract_inverted_index.offline | 60 |
| abstract_inverted_index.support | 35 |
| abstract_inverted_index.through | 113 |
| abstract_inverted_index.Jiangmen | 1 |
| abstract_inverted_index.Neutrino | 3 |
| abstract_inverted_index.designed | 11 |
| abstract_inverted_index.managing | 58 |
| abstract_inverted_index.neutrino | 17, 24, 31 |
| abstract_inverted_index.ordering | 26 |
| abstract_inverted_index.physics, | 18 |
| abstract_inverted_index.pipeline | 109 |
| abstract_inverted_index.presents | 66 |
| abstract_inverted_index.scalable | 55 |
| abstract_inverted_index.addresses | 110 |
| abstract_inverted_index.developed | 45 |
| abstract_inverted_index.including | 19, 80 |
| abstract_inverted_index.pipeline, | 51, 75 |
| abstract_inverted_index.precision | 28 |
| abstract_inverted_index.questions | 15 |
| abstract_inverted_index.real-time | 117 |
| abstract_inverted_index.workflow. | 63 |
| abstract_inverted_index.Production | 49 |
| abstract_inverted_index.challenges | 96, 112 |
| abstract_inverted_index.complexity | 100 |
| abstract_inverted_index.experiment | 10 |
| abstract_inverted_index.processing | 39, 62 |
| abstract_inverted_index.scientific | 9 |
| abstract_inverted_index.Observatory | 4 |
| abstract_inverted_index.Underground | 2 |
| abstract_inverted_index.automation, | 114 |
| abstract_inverted_index.components, | 79 |
| abstract_inverted_index.fundamental | 14 |
| abstract_inverted_index.management, | 82 |
| abstract_inverted_index.modularity, | 115 |
| abstract_inverted_index.monitoring. | 118 |
| abstract_inverted_index.oscillation | 32 |
| abstract_inverted_index.parameters. | 33 |
| abstract_inverted_index.cutting-edge | 8 |
| abstract_inverted_index.highlighting | 76 |
| abstract_inverted_index.measurements | 29 |
| abstract_inverted_index.requirements | 40 |
| abstract_inverted_index.architecture, | 68 |
| abstract_inverted_index.determination | 21 |
| abstract_inverted_index.technologies. | 91 |
| abstract_inverted_index.implementation | 71 |
| abstract_inverted_index.visualization, | 84 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 3 |
| citation_normalized_percentile.value | 0.55848394 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | True |