Should we Reload Time Series Classification Performance Evaluation ? (a position paper) Article Swipe
Dominique Gay
,
Vincent Lemaire
·
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.1903.03300
YOU?
·
· 2019
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.1903.03300
Since the introduction and the public availability of the \textsc{ucr} time series benchmark data sets, numerous Time Series Classification (TSC) methods has been designed, evaluated and compared to each others. We suggest a critical view of TSC performance evaluation protocols put in place in recent TSC literature. The main goal of this `position' paper is to stimulate discussion and reflexion about performance evaluation in TSC literature.
Related Topics
Concepts
Metadata
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/1903.03300
- https://arxiv.org/pdf/1903.03300
- OA Status
- green
- Cited By
- 2
- References
- 22
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W2950552270
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W2950552270Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.1903.03300Digital Object Identifier
- Title
-
Should we Reload Time Series Classification Performance Evaluation ? (a position paper)Work title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2019Year of publication
- Publication date
-
2019-03-08Full publication date if available
- Authors
-
Dominique Gay, Vincent LemaireList of authors in order
- Landing page
-
https://arxiv.org/abs/1903.03300Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/1903.03300Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/1903.03300Direct OA link when available
- Concepts
-
Computer science, Series (stratigraphy), Position (finance), Time series, Position paper, Artificial intelligence, Machine learning, World Wide Web, Geology, Paleontology, Economics, FinanceTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
2Total citation count in OpenAlex
- Citations by year (recent)
-
2021: 2Per-year citation counts (last 5 years)
- References (count)
-
22Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W2950552270 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.1903.03300 |
| ids.doi | https://doi.org/10.48550/arxiv.1903.03300 |
| ids.mag | 2950552270 |
| ids.openalex | https://openalex.org/W2950552270 |
| fwci | 0.32836018 |
| type | preprint |
| title | Should we Reload Time Series Classification Performance Evaluation ? (a position paper) |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T12205 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9998999834060669 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1711 |
| topics[0].subfield.display_name | Signal Processing |
| topics[0].display_name | Time Series Analysis and Forecasting |
| topics[1].id | https://openalex.org/T13083 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9674999713897705 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Advanced Text Analysis Techniques |
| topics[2].id | https://openalex.org/T11512 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9670000076293945 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1702 |
| topics[2].subfield.display_name | Artificial Intelligence |
| topics[2].display_name | Anomaly Detection Techniques and Applications |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.684141993522644 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C143724316 |
| concepts[1].level | 2 |
| concepts[1].score | 0.6799209117889404 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q312468 |
| concepts[1].display_name | Series (stratigraphy) |
| concepts[2].id | https://openalex.org/C198082294 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5260583758354187 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q3399648 |
| concepts[2].display_name | Position (finance) |
| concepts[3].id | https://openalex.org/C151406439 |
| concepts[3].level | 2 |
| concepts[3].score | 0.4858657717704773 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q186588 |
| concepts[3].display_name | Time series |
| concepts[4].id | https://openalex.org/C78780964 |
| concepts[4].level | 2 |
| concepts[4].score | 0.4456355571746826 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q7233193 |
| concepts[4].display_name | Position paper |
| concepts[5].id | https://openalex.org/C154945302 |
| concepts[5].level | 1 |
| concepts[5].score | 0.38535118103027344 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q11660 |
| concepts[5].display_name | Artificial intelligence |
| concepts[6].id | https://openalex.org/C119857082 |
| concepts[6].level | 1 |
| concepts[6].score | 0.2883394956588745 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q2539 |
| concepts[6].display_name | Machine learning |
| concepts[7].id | https://openalex.org/C136764020 |
| concepts[7].level | 1 |
| concepts[7].score | 0.06715318560600281 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q466 |
| concepts[7].display_name | World Wide Web |
| concepts[8].id | https://openalex.org/C127313418 |
| concepts[8].level | 0 |
| concepts[8].score | 0.04410552978515625 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q1069 |
| concepts[8].display_name | Geology |
| concepts[9].id | https://openalex.org/C151730666 |
| concepts[9].level | 1 |
| concepts[9].score | 0.0 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q7205 |
| concepts[9].display_name | Paleontology |
| concepts[10].id | https://openalex.org/C162324750 |
| concepts[10].level | 0 |
| concepts[10].score | 0.0 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q8134 |
| concepts[10].display_name | Economics |
| concepts[11].id | https://openalex.org/C10138342 |
| concepts[11].level | 1 |
| concepts[11].score | 0.0 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q43015 |
| concepts[11].display_name | Finance |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.684141993522644 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/series |
| keywords[1].score | 0.6799209117889404 |
| keywords[1].display_name | Series (stratigraphy) |
| keywords[2].id | https://openalex.org/keywords/position |
| keywords[2].score | 0.5260583758354187 |
| keywords[2].display_name | Position (finance) |
| keywords[3].id | https://openalex.org/keywords/time-series |
| keywords[3].score | 0.4858657717704773 |
| keywords[3].display_name | Time series |
| keywords[4].id | https://openalex.org/keywords/position-paper |
| keywords[4].score | 0.4456355571746826 |
| keywords[4].display_name | Position paper |
| keywords[5].id | https://openalex.org/keywords/artificial-intelligence |
| keywords[5].score | 0.38535118103027344 |
| keywords[5].display_name | Artificial intelligence |
| keywords[6].id | https://openalex.org/keywords/machine-learning |
| keywords[6].score | 0.2883394956588745 |
| keywords[6].display_name | Machine learning |
| keywords[7].id | https://openalex.org/keywords/world-wide-web |
| keywords[7].score | 0.06715318560600281 |
| keywords[7].display_name | World Wide Web |
| keywords[8].id | https://openalex.org/keywords/geology |
| keywords[8].score | 0.04410552978515625 |
| keywords[8].display_name | Geology |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:1903.03300 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/1903.03300 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/1903.03300 |
| locations[1].id | pmh:oai:HAL:hal-01911980v1 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306402512 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | HAL (Le Centre pour la Communication Scientifique Directe) |
| locations[1].source.host_organization | https://openalex.org/I1294671590 |
| locations[1].source.host_organization_name | Centre National de la Recherche Scientifique |
| locations[1].source.host_organization_lineage | https://openalex.org/I1294671590 |
| locations[1].license | other-oa |
| locations[1].pdf_url | |
| locations[1].version | submittedVersion |
| locations[1].raw_type | info:eu-repo/semantics/conferenceObject |
| locations[1].license_id | https://openalex.org/licenses/other-oa |
| locations[1].is_accepted | False |
| locations[1].is_published | False |
| locations[1].raw_source_name | Proceedings of 3rd ECML/PKDD Workshop on Advanced Analytics and Learning on Temporal Data |
| locations[1].landing_page_url | https://hal.univ-reunion.fr/hal-01911980 |
| locations[2].id | doi:10.48550/arxiv.1903.03300 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306400194 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | True |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | arXiv (Cornell University) |
| locations[2].source.host_organization | https://openalex.org/I205783295 |
| locations[2].source.host_organization_name | Cornell University |
| locations[2].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[2].license | |
| locations[2].pdf_url | |
| locations[2].version | |
| locations[2].raw_type | article-journal |
| locations[2].license_id | |
| locations[2].is_accepted | False |
| locations[2].is_published | |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | https://doi.org/10.48550/arxiv.1903.03300 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5022119069 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-0671-4616 |
| authorships[0].author.display_name | Dominique Gay |
| authorships[0].countries | FR |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I4210102957 |
| authorships[0].affiliations[0].raw_affiliation_string | Laboratoire d'Informatique et de Mathématiques |
| authorships[0].institutions[0].id | https://openalex.org/I4210102957 |
| authorships[0].institutions[0].ror | https://ror.org/011emb038 |
| authorships[0].institutions[0].type | government |
| authorships[0].institutions[0].lineage | https://openalex.org/I4210088668, https://openalex.org/I4210102957 |
| authorships[0].institutions[0].country_code | FR |
| authorships[0].institutions[0].display_name | Département Mathématiques et Informatique Appliquées |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Dominique Gay |
| authorships[0].is_corresponding | False |
| authorships[0].raw_affiliation_strings | Laboratoire d'Informatique et de Mathématiques |
| authorships[1].author.id | https://openalex.org/A5103118554 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-6030-2356 |
| authorships[1].author.display_name | Vincent Lemaire |
| authorships[1].countries | FR |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I19370010 |
| authorships[1].affiliations[0].raw_affiliation_string | Orange Labs [Lannion] |
| authorships[1].institutions[0].id | https://openalex.org/I19370010 |
| authorships[1].institutions[0].ror | https://ror.org/035j0tq82 |
| authorships[1].institutions[0].type | company |
| authorships[1].institutions[0].lineage | https://openalex.org/I19370010 |
| authorships[1].institutions[0].country_code | FR |
| authorships[1].institutions[0].display_name | Orange (France) |
| authorships[1].author_position | last |
| authorships[1].raw_author_name | Vincent Lemaire |
| authorships[1].is_corresponding | False |
| authorships[1].raw_affiliation_strings | Orange Labs [Lannion] |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/1903.03300 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2019-06-27T00:00:00 |
| display_name | Should we Reload Time Series Classification Performance Evaluation ? (a position paper) |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T12205 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9998999834060669 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1711 |
| primary_topic.subfield.display_name | Signal Processing |
| primary_topic.display_name | Time Series Analysis and Forecasting |
| related_works | https://openalex.org/W2911039683, https://openalex.org/W2622688551, https://openalex.org/W2119012848, https://openalex.org/W1990205660, https://openalex.org/W1550175370, https://openalex.org/W2382416307, https://openalex.org/W4387331850, https://openalex.org/W1966415008, https://openalex.org/W2169127058, https://openalex.org/W3112644326 |
| cited_by_count | 2 |
| counts_by_year[0].year | 2021 |
| counts_by_year[0].cited_by_count | 2 |
| locations_count | 3 |
| best_oa_location.id | pmh:oai:arXiv.org:1903.03300 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/1903.03300 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/1903.03300 |
| primary_location.id | pmh:oai:arXiv.org:1903.03300 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/1903.03300 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/1903.03300 |
| publication_date | 2019-03-08 |
| publication_year | 2019 |
| referenced_works | https://openalex.org/W2035104901, https://openalex.org/W2029767187, https://openalex.org/W2112865076, https://openalex.org/W2050493487, https://openalex.org/W2124533898, https://openalex.org/W2507487910, https://openalex.org/W2028138594, https://openalex.org/W3098918569, https://openalex.org/W3125903163, https://openalex.org/W2209840346, https://openalex.org/W1680392829, https://openalex.org/W2524083015, https://openalex.org/W206576811, https://openalex.org/W1778796894, https://openalex.org/W2963313239, https://openalex.org/W1984674851, https://openalex.org/W2524126247, https://openalex.org/W1565746575, https://openalex.org/W2106525823, https://openalex.org/W2555077524, https://openalex.org/W1853995153, https://openalex.org/W1900747440 |
| referenced_works_count | 22 |
| abstract_inverted_index.a | 32 |
| abstract_inverted_index.We | 30 |
| abstract_inverted_index.in | 41, 43, 63 |
| abstract_inverted_index.is | 54 |
| abstract_inverted_index.of | 7, 35, 50 |
| abstract_inverted_index.to | 27, 55 |
| abstract_inverted_index.TSC | 36, 45, 64 |
| abstract_inverted_index.The | 47 |
| abstract_inverted_index.and | 3, 25, 58 |
| abstract_inverted_index.has | 21 |
| abstract_inverted_index.put | 40 |
| abstract_inverted_index.the | 1, 4, 8 |
| abstract_inverted_index.Time | 16 |
| abstract_inverted_index.been | 22 |
| abstract_inverted_index.data | 13 |
| abstract_inverted_index.each | 28 |
| abstract_inverted_index.goal | 49 |
| abstract_inverted_index.main | 48 |
| abstract_inverted_index.this | 51 |
| abstract_inverted_index.time | 10 |
| abstract_inverted_index.view | 34 |
| abstract_inverted_index.(TSC) | 19 |
| abstract_inverted_index.Since | 0 |
| abstract_inverted_index.about | 60 |
| abstract_inverted_index.paper | 53 |
| abstract_inverted_index.place | 42 |
| abstract_inverted_index.sets, | 14 |
| abstract_inverted_index.Series | 17 |
| abstract_inverted_index.public | 5 |
| abstract_inverted_index.recent | 44 |
| abstract_inverted_index.series | 11 |
| abstract_inverted_index.methods | 20 |
| abstract_inverted_index.others. | 29 |
| abstract_inverted_index.suggest | 31 |
| abstract_inverted_index.compared | 26 |
| abstract_inverted_index.critical | 33 |
| abstract_inverted_index.numerous | 15 |
| abstract_inverted_index.benchmark | 12 |
| abstract_inverted_index.designed, | 23 |
| abstract_inverted_index.evaluated | 24 |
| abstract_inverted_index.protocols | 39 |
| abstract_inverted_index.reflexion | 59 |
| abstract_inverted_index.stimulate | 56 |
| abstract_inverted_index.`position' | 52 |
| abstract_inverted_index.discussion | 57 |
| abstract_inverted_index.evaluation | 38, 62 |
| abstract_inverted_index.literature. | 46, 65 |
| abstract_inverted_index.performance | 37, 61 |
| abstract_inverted_index.\textsc{ucr} | 9 |
| abstract_inverted_index.availability | 6 |
| abstract_inverted_index.introduction | 2 |
| abstract_inverted_index.Classification | 18 |
| cited_by_percentile_year.max | 95 |
| cited_by_percentile_year.min | 93 |
| countries_distinct_count | 1 |
| institutions_distinct_count | 2 |
| citation_normalized_percentile.value | 0.54980572 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |