TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining Article Swipe

PDF

Jeffrey Li , Mohammadreza Armandpour , Seyed Iman Mirzadeh , Sachin Mehta , Vaishaal Shankar , Raviteja Vemulapalli , Samy Bengio , Oncel Tuzel , Mehrdad Farajtabar , Hadi Pouransari , Fartash Faghri ·

YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.18653/v1/2025.acl-long.1551

Related Topics

Benchmark (Surveying)

Computer Science

Artificial Intelligence

Geography

Geodesy

Cartography

Concepts

Benchmark (surveying) Computer science Scale (ratio) Artificial intelligence Geography Geodesy Cartography

Metadata

Type: article
Language: en
Landing Page: https://doi.org/10.18653/v1/2025.acl-long.1551
PDF: https://aclanthology.org/2025.acl-long.1551.pdf
OA Status: gold
Related Works: 10
OpenAlex ID: https://openalex.org/W4412889661

All OpenAlex metadata

Raw OpenAlex JSON

OpenAlex ID: https://openalex.org/W4412889661

Canonical identifier for this work in OpenAlex
DOI: https://doi.org/10.18653/v1/2025.acl-long.1551

Digital Object Identifier
Title: TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining

Work title
Type: article

OpenAlex work type
Language: en

Primary language
Publication year: 2025

Year of publication
Publication date: 2025-01-01

Full publication date if available
Authors: Jeffrey Li, Mohammadreza Armandpour, Seyed Iman Mirzadeh, Sachin Mehta, Vaishaal Shankar, Raviteja Vemulapalli, Samy Bengio, Oncel Tuzel, Mehrdad Farajtabar, Hadi Pouransari, Fartash Faghri

List of authors in order
Landing page: https://doi.org/10.18653/v1/2025.acl-long.1551

Publisher landing page
PDF URL: https://aclanthology.org/2025.acl-long.1551.pdf

Direct link to full text PDF
Open access: Yes

Whether a free full text is available
OA status: gold

Open access status per OpenAlex
OA URL: https://aclanthology.org/2025.acl-long.1551.pdf

Direct OA link when available
Concepts: Benchmark (surveying), Computer science, Scale (ratio), Artificial intelligence, Geography, Geodesy, Cartography

Top concepts (fields/topics) attached by OpenAlex
Cited by: 0

Total citation count in OpenAlex
Related works (count): 10

Other works algorithmically related by OpenAlex

Full payload

id	https://openalex.org/W4412889661
doi	https://doi.org/10.18653/v1/2025.acl-long.1551
ids.doi	https://doi.org/10.18653/v1/2025.acl-long.1551
ids.openalex	https://openalex.org/W4412889661
fwci	0.0
type	article
title	TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining
biblio.issue
biblio.volume
biblio.last_page	32273
biblio.first_page	32231
topics[0].id	https://openalex.org/T11201
topics[0].field.id	https://openalex.org/fields/22
topics[0].field.display_name	Engineering
topics[0].score	0.9240999817848206
topics[0].domain.id	https://openalex.org/domains/3
topics[0].domain.display_name	Physical Sciences
topics[0].subfield.id	https://openalex.org/subfields/2211
topics[0].subfield.display_name	Mechanics of Materials
topics[0].display_name	Metallurgy and Material Forming
is_xpac	False
apc_list
apc_paid
concepts[0].id	https://openalex.org/C185798385
concepts[0].level	2
concepts[0].score	0.7638698220252991
concepts[0].wikidata	https://www.wikidata.org/wiki/Q1161707
concepts[0].display_name	Benchmark (surveying)
concepts[1].id	https://openalex.org/C41008148
concepts[1].level	0
concepts[1].score	0.6912028789520264
concepts[1].wikidata	https://www.wikidata.org/wiki/Q21198
concepts[1].display_name	Computer science
concepts[2].id	https://openalex.org/C2778755073
concepts[2].level	2
concepts[2].score	0.6509776711463928
concepts[2].wikidata	https://www.wikidata.org/wiki/Q10858537
concepts[2].display_name	Scale (ratio)
concepts[3].id	https://openalex.org/C154945302
concepts[3].level	1
concepts[3].score	0.33425700664520264
concepts[3].wikidata	https://www.wikidata.org/wiki/Q11660
concepts[3].display_name	Artificial intelligence
concepts[4].id	https://openalex.org/C205649164
concepts[4].level	0
concepts[4].score	0.07024046778678894
concepts[4].wikidata	https://www.wikidata.org/wiki/Q1071
concepts[4].display_name	Geography
concepts[5].id	https://openalex.org/C13280743
concepts[5].level	1
concepts[5].score	0.0
concepts[5].wikidata	https://www.wikidata.org/wiki/Q131089
concepts[5].display_name	Geodesy
concepts[6].id	https://openalex.org/C58640448
concepts[6].level	1
concepts[6].score	0.0
concepts[6].wikidata	https://www.wikidata.org/wiki/Q42515
concepts[6].display_name	Cartography
keywords[0].id	https://openalex.org/keywords/benchmark
keywords[0].score	0.7638698220252991
keywords[0].display_name	Benchmark (surveying)
keywords[1].id	https://openalex.org/keywords/computer-science
keywords[1].score	0.6912028789520264
keywords[1].display_name	Computer science
keywords[2].id	https://openalex.org/keywords/scale
keywords[2].score	0.6509776711463928
keywords[2].display_name	Scale (ratio)
keywords[3].id	https://openalex.org/keywords/artificial-intelligence
keywords[3].score	0.33425700664520264
keywords[3].display_name	Artificial intelligence
keywords[4].id	https://openalex.org/keywords/geography
keywords[4].score	0.07024046778678894
keywords[4].display_name	Geography
language	en
locations[0].id	doi:10.18653/v1/2025.acl-long.1551
locations[0].is_oa	True
locations[0].source
locations[0].license	cc-by
locations[0].pdf_url	https://aclanthology.org/2025.acl-long.1551.pdf
locations[0].version	publishedVersion
locations[0].raw_type	proceedings-article
locations[0].license_id	https://openalex.org/licenses/cc-by
locations[0].is_accepted	True
locations[0].is_published	True
locations[0].raw_source_name	Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
locations[0].landing_page_url	https://doi.org/10.18653/v1/2025.acl-long.1551
indexed_in	crossref
authorships[0].author.id	https://openalex.org/A5111296494
authorships[0].author.orcid	https://orcid.org/0009-0002-4393-5773
authorships[0].author.display_name	Jeffrey Li
authorships[0].author_position	first
authorships[0].raw_author_name	Jeffrey Li
authorships[0].is_corresponding	False
authorships[1].author.id	https://openalex.org/A5053849494
authorships[1].author.orcid
authorships[1].author.display_name	Mohammadreza Armandpour
authorships[1].author_position	middle
authorships[1].raw_author_name	Mohammadreza Armandpour
authorships[1].is_corresponding	False
authorships[2].author.id	https://openalex.org/A5010129552
authorships[2].author.orcid	https://orcid.org/0000-0003-1586-0700
authorships[2].author.display_name	Seyed Iman Mirzadeh
authorships[2].author_position	middle
authorships[2].raw_author_name	Seyed Iman Mirzadeh
authorships[2].is_corresponding	False
authorships[3].author.id	https://openalex.org/A5074132108
authorships[3].author.orcid	https://orcid.org/0000-0002-5420-4725
authorships[3].author.display_name	Sachin Mehta
authorships[3].author_position	middle
authorships[3].raw_author_name	Sachin Mehta
authorships[3].is_corresponding	False
authorships[4].author.id	https://openalex.org/A5112327867
authorships[4].author.orcid
authorships[4].author.display_name	Vaishaal Shankar
authorships[4].author_position	middle
authorships[4].raw_author_name	Vaishaal Shankar
authorships[4].is_corresponding	False
authorships[5].author.id	https://openalex.org/A5071825172
authorships[5].author.orcid	https://orcid.org/0000-0003-0425-7797
authorships[5].author.display_name	Raviteja Vemulapalli
authorships[5].author_position	middle
authorships[5].raw_author_name	Raviteja Vemulapalli
authorships[5].is_corresponding	False
authorships[6].author.id	https://openalex.org/A5017529415
authorships[6].author.orcid
authorships[6].author.display_name	Samy Bengio
authorships[6].author_position	middle
authorships[6].raw_author_name	Samy Bengio
authorships[6].is_corresponding	False
authorships[7].author.id	https://openalex.org/A5028613002
authorships[7].author.orcid
authorships[7].author.display_name	Oncel Tuzel
authorships[7].author_position	middle
authorships[7].raw_author_name	Oncel Tuzel
authorships[7].is_corresponding	False
authorships[8].author.id	https://openalex.org/A5050499655
authorships[8].author.orcid	https://orcid.org/0000-0002-5510-518X
authorships[8].author.display_name	Mehrdad Farajtabar
authorships[8].author_position	middle
authorships[8].raw_author_name	Mehrdad Farajtabar
authorships[8].is_corresponding	False
authorships[9].author.id	https://openalex.org/A5059295598
authorships[9].author.orcid
authorships[9].author.display_name	Hadi Pouransari
authorships[9].author_position	middle
authorships[9].raw_author_name	Hadi Pouransari
authorships[9].is_corresponding	False
authorships[10].author.id	https://openalex.org/A5036601505
authorships[10].author.orcid	https://orcid.org/0000-0001-5975-5158
authorships[10].author.display_name	Fartash Faghri
authorships[10].author_position	last
authorships[10].raw_author_name	Fartash Faghri
authorships[10].is_corresponding	False
has_content.pdf	True
has_content.grobid_xml	True
is_paratext	False
open_access.is_oa	True
open_access.oa_url	https://aclanthology.org/2025.acl-long.1551.pdf
open_access.oa_status	gold
open_access.any_repository_has_fulltext	False
created_date	2025-10-10T00:00:00
display_name	TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining
has_fulltext	False
is_retracted	False
updated_date	2025-11-06T03:46:38.306776
primary_topic.id	https://openalex.org/T11201
primary_topic.field.id	https://openalex.org/fields/22
primary_topic.field.display_name	Engineering
primary_topic.score	0.9240999817848206
primary_topic.domain.id	https://openalex.org/domains/3
primary_topic.domain.display_name	Physical Sciences
primary_topic.subfield.id	https://openalex.org/subfields/2211
primary_topic.subfield.display_name	Mechanics of Materials
primary_topic.display_name	Metallurgy and Material Forming
related_works	https://openalex.org/W4391375266, https://openalex.org/W2899084033, https://openalex.org/W2748952813, https://openalex.org/W2378211422, https://openalex.org/W4321353415, https://openalex.org/W2745001401, https://openalex.org/W2130974462, https://openalex.org/W2028665553, https://openalex.org/W2086519370, https://openalex.org/W4246352526
cited_by_count	0
locations_count	1
best_oa_location.id	doi:10.18653/v1/2025.acl-long.1551
best_oa_location.is_oa	True
best_oa_location.source
best_oa_location.license	cc-by
best_oa_location.pdf_url	https://aclanthology.org/2025.acl-long.1551.pdf
best_oa_location.version	publishedVersion
best_oa_location.raw_type	proceedings-article
best_oa_location.license_id	https://openalex.org/licenses/cc-by
best_oa_location.is_accepted	True
best_oa_location.is_published	True
best_oa_location.raw_source_name	Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
best_oa_location.landing_page_url	https://doi.org/10.18653/v1/2025.acl-long.1551
primary_location.id	doi:10.18653/v1/2025.acl-long.1551
primary_location.is_oa	True
primary_location.source
primary_location.license	cc-by
primary_location.pdf_url	https://aclanthology.org/2025.acl-long.1551.pdf
primary_location.version	publishedVersion
primary_location.raw_type	proceedings-article
primary_location.license_id	https://openalex.org/licenses/cc-by
primary_location.is_accepted	True
primary_location.is_published	True
primary_location.raw_source_name	Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
primary_location.landing_page_url	https://doi.org/10.18653/v1/2025.acl-long.1551
publication_date	2025-01-01
publication_year	2025
referenced_works_count	0
abstract_inverted_index
cited_by_percentile_year
countries_distinct_count	0
institutions_distinct_count	11
citation_normalized_percentile.value	0.37946669
citation_normalized_percentile.is_in_top_1_percent	False
citation_normalized_percentile.is_in_top_10_percent	False