A family of experiments about how developers perceive delayed system response time Article Swipe
Oscar Cornejo
,
Daniela Briola
,
Daniela Micucci
,
Davide Ginelli
,
Leonardo Mariani
,
Adrián Santos Parrilla
,
Natália Juristo
·
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1007/s11219-024-09660-w
YOU?
·
· 2024
· Open Access
·
· DOI: https://doi.org/10.1007/s11219-024-09660-w
Collecting and analyzing data about developers working on their development tasks can help improve development practices, finally increasing the productivity of teams. Indeed, monitoring and analysis tools have already been used to collect data from productivity tools. Monitoring inevitably consumes resources and, depending on their extensiveness, may significantly slow down software systems, interfering with developers’ activity. There is thus a challenging trade-off between monitoring and validating applications in their operational environment and preventing the degradation of the user experience. The lack of studies about when developers perceive an overhead introduced in an application makes it extremely difficult to fine-tune techniques working in the field. In this paper, we address this challenge by presenting an empirical study that quantifies how developers perceive overhead. The study consists of three replications of an experiment that involved 99 computer science students in total, followed by a small-scale experimental assessment of the key findings with 12 professional developers. Results show that non-negligible overhead can be introduced for a short period into applications without developers perceiving it and that the sequence in which complex operations are executed influences the perception of the system response time. This information can be exploited to design better monitoring techniques.
Related Topics
Concepts
Metadata
- Type
- article
- Language
- en
- Landing Page
- https://doi.org/10.1007/s11219-024-09660-w
- https://link.springer.com/content/pdf/10.1007/s11219-024-09660-w.pdf
- OA Status
- hybrid
- Cited By
- 1
- References
- 63
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4392371923
All OpenAlex metadata
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4392371923Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.1007/s11219-024-09660-wDigital Object Identifier
- Title
-
A family of experiments about how developers perceive delayed system response timeWork title
- Type
-
articleOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2024Year of publication
- Publication date
-
2024-03-04Full publication date if available
- Authors
-
Oscar Cornejo, Daniela Briola, Daniela Micucci, Davide Ginelli, Leonardo Mariani, Adrián Santos Parrilla, Natália JuristoList of authors in order
- Landing page
-
https://doi.org/10.1007/s11219-024-09660-wPublisher landing page
- PDF URL
-
https://link.springer.com/content/pdf/10.1007/s11219-024-09660-w.pdfDirect link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
hybridOpen access status per OpenAlex
- OA URL
-
https://link.springer.com/content/pdf/10.1007/s11219-024-09660-w.pdfDirect OA link when available
- Concepts
-
Computer scienceTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
1Total citation count in OpenAlex
- Citations by year (recent)
-
2025: 1Per-year citation counts (last 5 years)
- References (count)
-
63Number of works referenced by this work
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4392371923 |
|---|---|
| doi | https://doi.org/10.1007/s11219-024-09660-w |
| ids.doi | https://doi.org/10.1007/s11219-024-09660-w |
| ids.pmid | https://pubmed.ncbi.nlm.nih.gov/38912430 |
| ids.openalex | https://openalex.org/W4392371923 |
| fwci | 0.63620868 |
| type | article |
| title | A family of experiments about how developers perceive delayed system response time |
| awards[0].id | https://openalex.org/G802235667 |
| awards[0].funder_id | https://openalex.org/F4320334678 |
| awards[0].funder_award_id | 646867 |
| awards[0].funder_display_name | European Research Council |
| biblio.issue | 2 |
| biblio.volume | 32 |
| biblio.last_page | 605 |
| biblio.first_page | 567 |
| grants[0].funder | https://openalex.org/F4320321610 |
| grants[0].award_id | |
| grants[0].funder_display_name | Università degli Studi di Milano-Bicocca |
| grants[1].funder | https://openalex.org/F4320334678 |
| grants[1].award_id | 646867 |
| grants[1].funder_display_name | European Research Council |
| topics[0].id | https://openalex.org/T12000 |
| topics[0].field.id | https://openalex.org/fields/22 |
| topics[0].field.display_name | Engineering |
| topics[0].score | 0.984000027179718 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/2207 |
| topics[0].subfield.display_name | Control and Systems Engineering |
| topics[0].display_name | Systems Engineering Methodologies and Applications |
| topics[1].id | https://openalex.org/T10639 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9835000038146973 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1702 |
| topics[1].subfield.display_name | Artificial Intelligence |
| topics[1].display_name | Advanced Software Engineering Methodologies |
| topics[2].id | https://openalex.org/T10260 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9570000171661377 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1710 |
| topics[2].subfield.display_name | Information Systems |
| topics[2].display_name | Software Engineering Research |
| funders[0].id | https://openalex.org/F4320321610 |
| funders[0].ror | https://ror.org/01ynf4891 |
| funders[0].display_name | Università degli Studi di Milano-Bicocca |
| funders[1].id | https://openalex.org/F4320334678 |
| funders[1].ror | https://ror.org/0472cxd90 |
| funders[1].display_name | European Research Council |
| is_xpac | False |
| apc_list.value | 2390 |
| apc_list.currency | EUR |
| apc_list.value_usd | 2990 |
| apc_paid.value | 2390 |
| apc_paid.currency | EUR |
| apc_paid.value_usd | 2990 |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.48622003197669983 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.48622003197669983 |
| keywords[0].display_name | Computer science |
| language | en |
| locations[0].id | doi:10.1007/s11219-024-09660-w |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S7504070 |
| locations[0].source.issn | 0963-9314, 1573-1367 |
| locations[0].source.type | journal |
| locations[0].source.is_oa | False |
| locations[0].source.issn_l | 0963-9314 |
| locations[0].source.is_core | True |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | Software Quality Journal |
| locations[0].source.host_organization | https://openalex.org/P4310319900 |
| locations[0].source.host_organization_name | Springer Science+Business Media |
| locations[0].source.host_organization_lineage | https://openalex.org/P4310319900 |
| locations[0].license | cc-by |
| locations[0].pdf_url | https://link.springer.com/content/pdf/10.1007/s11219-024-09660-w.pdf |
| locations[0].version | publishedVersion |
| locations[0].raw_type | journal-article |
| locations[0].license_id | https://openalex.org/licenses/cc-by |
| locations[0].is_accepted | True |
| locations[0].is_published | True |
| locations[0].raw_source_name | Software Quality Journal |
| locations[0].landing_page_url | https://doi.org/10.1007/s11219-024-09660-w |
| locations[1].id | pmid:38912430 |
| locations[1].is_oa | False |
| locations[1].source.id | https://openalex.org/S4306525036 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | False |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | PubMed |
| locations[1].source.host_organization | https://openalex.org/I1299303238 |
| locations[1].source.host_organization_name | National Institutes of Health |
| locations[1].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | publishedVersion |
| locations[1].raw_type | |
| locations[1].license_id | |
| locations[1].is_accepted | True |
| locations[1].is_published | True |
| locations[1].raw_source_name | Software quality journal |
| locations[1].landing_page_url | https://pubmed.ncbi.nlm.nih.gov/38912430 |
| locations[2].id | pmh:oai:boa.unimib.it:10281/462999 |
| locations[2].is_oa | True |
| locations[2].source.id | https://openalex.org/S4306401259 |
| locations[2].source.issn | |
| locations[2].source.type | repository |
| locations[2].source.is_oa | False |
| locations[2].source.issn_l | |
| locations[2].source.is_core | False |
| locations[2].source.is_in_doaj | False |
| locations[2].source.display_name | BOA (University of Milano-Bicocca) |
| locations[2].source.host_organization | https://openalex.org/I66752286 |
| locations[2].source.host_organization_name | University of Milano-Bicocca |
| locations[2].source.host_organization_lineage | https://openalex.org/I66752286 |
| locations[2].license | cc-by |
| locations[2].pdf_url | |
| locations[2].version | submittedVersion |
| locations[2].raw_type | info:eu-repo/semantics/article |
| locations[2].license_id | https://openalex.org/licenses/cc-by |
| locations[2].is_accepted | False |
| locations[2].is_published | False |
| locations[2].raw_source_name | |
| locations[2].landing_page_url | https://hdl.handle.net/10281/462999 |
| locations[3].id | pmh:oai:pubmedcentral.nih.gov:11189977 |
| locations[3].is_oa | True |
| locations[3].source.id | https://openalex.org/S2764455111 |
| locations[3].source.issn | |
| locations[3].source.type | repository |
| locations[3].source.is_oa | False |
| locations[3].source.issn_l | |
| locations[3].source.is_core | False |
| locations[3].source.is_in_doaj | False |
| locations[3].source.display_name | PubMed Central |
| locations[3].source.host_organization | https://openalex.org/I1299303238 |
| locations[3].source.host_organization_name | National Institutes of Health |
| locations[3].source.host_organization_lineage | https://openalex.org/I1299303238 |
| locations[3].license | other-oa |
| locations[3].pdf_url | |
| locations[3].version | submittedVersion |
| locations[3].raw_type | Text |
| locations[3].license_id | https://openalex.org/licenses/other-oa |
| locations[3].is_accepted | False |
| locations[3].is_published | False |
| locations[3].raw_source_name | Softw Qual J |
| locations[3].landing_page_url | https://www.ncbi.nlm.nih.gov/pmc/articles/11189977 |
| indexed_in | crossref, pubmed |
| authorships[0].author.id | https://openalex.org/A5017676130 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-9243-8071 |
| authorships[0].author.display_name | Oscar Cornejo |
| authorships[0].countries | LU |
| authorships[0].affiliations[0].institution_ids | https://openalex.org/I186903577 |
| authorships[0].affiliations[0].raw_affiliation_string | Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg, Esch-sur-Alzette, Luxembourg |
| authorships[0].institutions[0].id | https://openalex.org/I186903577 |
| authorships[0].institutions[0].ror | https://ror.org/036x5ad56 |
| authorships[0].institutions[0].type | education |
| authorships[0].institutions[0].lineage | https://openalex.org/I186903577 |
| authorships[0].institutions[0].country_code | LU |
| authorships[0].institutions[0].display_name | University of Luxembourg |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Oscar Cornejo |
| authorships[0].is_corresponding | True |
| authorships[0].raw_affiliation_strings | Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg, Esch-sur-Alzette, Luxembourg |
| authorships[1].author.id | https://openalex.org/A5076033814 |
| authorships[1].author.orcid | https://orcid.org/0000-0003-1994-8929 |
| authorships[1].author.display_name | Daniela Briola |
| authorships[1].countries | IT |
| authorships[1].affiliations[0].institution_ids | https://openalex.org/I66752286 |
| authorships[1].affiliations[0].raw_affiliation_string | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[1].institutions[0].id | https://openalex.org/I66752286 |
| authorships[1].institutions[0].ror | https://ror.org/01ynf4891 |
| authorships[1].institutions[0].type | education |
| authorships[1].institutions[0].lineage | https://openalex.org/I66752286 |
| authorships[1].institutions[0].country_code | IT |
| authorships[1].institutions[0].display_name | University of Milano-Bicocca |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Daniela Briola |
| authorships[1].is_corresponding | True |
| authorships[1].raw_affiliation_strings | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[2].author.id | https://openalex.org/A5015645148 |
| authorships[2].author.orcid | https://orcid.org/0000-0003-1261-2234 |
| authorships[2].author.display_name | Daniela Micucci |
| authorships[2].countries | IT |
| authorships[2].affiliations[0].institution_ids | https://openalex.org/I66752286 |
| authorships[2].affiliations[0].raw_affiliation_string | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[2].institutions[0].id | https://openalex.org/I66752286 |
| authorships[2].institutions[0].ror | https://ror.org/01ynf4891 |
| authorships[2].institutions[0].type | education |
| authorships[2].institutions[0].lineage | https://openalex.org/I66752286 |
| authorships[2].institutions[0].country_code | IT |
| authorships[2].institutions[0].display_name | University of Milano-Bicocca |
| authorships[2].author_position | middle |
| authorships[2].raw_author_name | Daniela Micucci |
| authorships[2].is_corresponding | True |
| authorships[2].raw_affiliation_strings | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[3].author.id | https://openalex.org/A5031106961 |
| authorships[3].author.orcid | https://orcid.org/0000-0003-1489-321X |
| authorships[3].author.display_name | Davide Ginelli |
| authorships[3].countries | IT |
| authorships[3].affiliations[0].institution_ids | https://openalex.org/I66752286 |
| authorships[3].affiliations[0].raw_affiliation_string | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[3].institutions[0].id | https://openalex.org/I66752286 |
| authorships[3].institutions[0].ror | https://ror.org/01ynf4891 |
| authorships[3].institutions[0].type | education |
| authorships[3].institutions[0].lineage | https://openalex.org/I66752286 |
| authorships[3].institutions[0].country_code | IT |
| authorships[3].institutions[0].display_name | University of Milano-Bicocca |
| authorships[3].author_position | middle |
| authorships[3].raw_author_name | Davide Ginelli |
| authorships[3].is_corresponding | True |
| authorships[3].raw_affiliation_strings | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[4].author.id | https://openalex.org/A5036120394 |
| authorships[4].author.orcid | https://orcid.org/0000-0001-9527-7042 |
| authorships[4].author.display_name | Leonardo Mariani |
| authorships[4].countries | IT |
| authorships[4].affiliations[0].institution_ids | https://openalex.org/I66752286 |
| authorships[4].affiliations[0].raw_affiliation_string | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[4].institutions[0].id | https://openalex.org/I66752286 |
| authorships[4].institutions[0].ror | https://ror.org/01ynf4891 |
| authorships[4].institutions[0].type | education |
| authorships[4].institutions[0].lineage | https://openalex.org/I66752286 |
| authorships[4].institutions[0].country_code | IT |
| authorships[4].institutions[0].display_name | University of Milano-Bicocca |
| authorships[4].author_position | middle |
| authorships[4].raw_author_name | Leonardo Mariani |
| authorships[4].is_corresponding | True |
| authorships[4].raw_affiliation_strings | DISCO, University of Milano - Bicocca, Milan, Italy |
| authorships[5].author.id | https://openalex.org/A5090346556 |
| authorships[5].author.orcid | |
| authorships[5].author.display_name | Adrián Santos Parrilla |
| authorships[5].countries | FI |
| authorships[5].affiliations[0].institution_ids | https://openalex.org/I98381234 |
| authorships[5].affiliations[0].raw_affiliation_string | ITEE, University of Oulu, Oulu, Finland |
| authorships[5].institutions[0].id | https://openalex.org/I98381234 |
| authorships[5].institutions[0].ror | https://ror.org/03yj89h83 |
| authorships[5].institutions[0].type | education |
| authorships[5].institutions[0].lineage | https://openalex.org/I98381234 |
| authorships[5].institutions[0].country_code | FI |
| authorships[5].institutions[0].display_name | University of Oulu |
| authorships[5].author_position | middle |
| authorships[5].raw_author_name | Adrián Santos Parrilla |
| authorships[5].is_corresponding | True |
| authorships[5].raw_affiliation_strings | ITEE, University of Oulu, Oulu, Finland |
| authorships[6].author.id | https://openalex.org/A5056117323 |
| authorships[6].author.orcid | https://orcid.org/0000-0002-2465-7141 |
| authorships[6].author.display_name | Natália Juristo |
| authorships[6].countries | ES |
| authorships[6].affiliations[0].institution_ids | https://openalex.org/I88060688 |
| authorships[6].affiliations[0].raw_affiliation_string | Universidad Politécnica de Madrid, Madrid, Spain |
| authorships[6].institutions[0].id | https://openalex.org/I88060688 |
| authorships[6].institutions[0].ror | https://ror.org/03n6nwv02 |
| authorships[6].institutions[0].type | education |
| authorships[6].institutions[0].lineage | https://openalex.org/I88060688 |
| authorships[6].institutions[0].country_code | ES |
| authorships[6].institutions[0].display_name | Universidad Politécnica de Madrid |
| authorships[6].author_position | last |
| authorships[6].raw_author_name | Natalia Juristo |
| authorships[6].is_corresponding | True |
| authorships[6].raw_affiliation_strings | Universidad Politécnica de Madrid, Madrid, Spain |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://link.springer.com/content/pdf/10.1007/s11219-024-09660-w.pdf |
| open_access.oa_status | hybrid |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | A family of experiments about how developers perceive delayed system response time |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T03:46:38.306776 |
| primary_topic.id | https://openalex.org/T12000 |
| primary_topic.field.id | https://openalex.org/fields/22 |
| primary_topic.field.display_name | Engineering |
| primary_topic.score | 0.984000027179718 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/2207 |
| primary_topic.subfield.display_name | Control and Systems Engineering |
| primary_topic.display_name | Systems Engineering Methodologies and Applications |
| related_works | https://openalex.org/W4391375266, https://openalex.org/W2748952813, https://openalex.org/W2390279801, https://openalex.org/W2358668433, https://openalex.org/W4396701345, https://openalex.org/W2376932109, https://openalex.org/W2001405890, https://openalex.org/W4396696052, https://openalex.org/W2382290278, https://openalex.org/W4395014643 |
| cited_by_count | 1 |
| counts_by_year[0].year | 2025 |
| counts_by_year[0].cited_by_count | 1 |
| locations_count | 4 |
| best_oa_location.id | doi:10.1007/s11219-024-09660-w |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S7504070 |
| best_oa_location.source.issn | 0963-9314, 1573-1367 |
| best_oa_location.source.type | journal |
| best_oa_location.source.is_oa | False |
| best_oa_location.source.issn_l | 0963-9314 |
| best_oa_location.source.is_core | True |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | Software Quality Journal |
| best_oa_location.source.host_organization | https://openalex.org/P4310319900 |
| best_oa_location.source.host_organization_name | Springer Science+Business Media |
| best_oa_location.source.host_organization_lineage | https://openalex.org/P4310319900 |
| best_oa_location.license | cc-by |
| best_oa_location.pdf_url | https://link.springer.com/content/pdf/10.1007/s11219-024-09660-w.pdf |
| best_oa_location.version | publishedVersion |
| best_oa_location.raw_type | journal-article |
| best_oa_location.license_id | https://openalex.org/licenses/cc-by |
| best_oa_location.is_accepted | True |
| best_oa_location.is_published | True |
| best_oa_location.raw_source_name | Software Quality Journal |
| best_oa_location.landing_page_url | https://doi.org/10.1007/s11219-024-09660-w |
| primary_location.id | doi:10.1007/s11219-024-09660-w |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S7504070 |
| primary_location.source.issn | 0963-9314, 1573-1367 |
| primary_location.source.type | journal |
| primary_location.source.is_oa | False |
| primary_location.source.issn_l | 0963-9314 |
| primary_location.source.is_core | True |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | Software Quality Journal |
| primary_location.source.host_organization | https://openalex.org/P4310319900 |
| primary_location.source.host_organization_name | Springer Science+Business Media |
| primary_location.source.host_organization_lineage | https://openalex.org/P4310319900 |
| primary_location.license | cc-by |
| primary_location.pdf_url | https://link.springer.com/content/pdf/10.1007/s11219-024-09660-w.pdf |
| primary_location.version | publishedVersion |
| primary_location.raw_type | journal-article |
| primary_location.license_id | https://openalex.org/licenses/cc-by |
| primary_location.is_accepted | True |
| primary_location.is_published | True |
| primary_location.raw_source_name | Software Quality Journal |
| primary_location.landing_page_url | https://doi.org/10.1007/s11219-024-09660-w |
| publication_date | 2024-03-04 |
| publication_year | 2024 |
| referenced_works | https://openalex.org/W4309618976, https://openalex.org/W3124893884, https://openalex.org/W2060201762, https://openalex.org/W3165293486, https://openalex.org/W944938320, https://openalex.org/W2169955577, https://openalex.org/W2092207592, https://openalex.org/W3028909709, https://openalex.org/W2165811181, https://openalex.org/W2602060687, https://openalex.org/W2616064966, https://openalex.org/W3037277068, https://openalex.org/W2999571074, https://openalex.org/W3016902877, https://openalex.org/W2957089131, https://openalex.org/W3006500354, https://openalex.org/W4235011715, https://openalex.org/W616399477, https://openalex.org/W2093587206, https://openalex.org/W2249595199, https://openalex.org/W3086160984, https://openalex.org/W4223575856, https://openalex.org/W2964112113, https://openalex.org/W2128949174, https://openalex.org/W178302743, https://openalex.org/W1984554975, https://openalex.org/W156034388, https://openalex.org/W2049381173, https://openalex.org/W3140804348, https://openalex.org/W6630481227, https://openalex.org/W2045615866, https://openalex.org/W4384302864, https://openalex.org/W2155479707, https://openalex.org/W2593715911, https://openalex.org/W2346809710, https://openalex.org/W2580855102, https://openalex.org/W2774782036, https://openalex.org/W2089666999, https://openalex.org/W2113000322, https://openalex.org/W2169786955, https://openalex.org/W2061141931, https://openalex.org/W2507618760, https://openalex.org/W2171594219, https://openalex.org/W4234943353, https://openalex.org/W2155891645, https://openalex.org/W2006862253, https://openalex.org/W112066486, https://openalex.org/W3001796748, https://openalex.org/W2887658528, https://openalex.org/W2124941516, https://openalex.org/W2093810318, https://openalex.org/W2159904898, https://openalex.org/W2510550031, https://openalex.org/W2152127906, https://openalex.org/W4245935093, https://openalex.org/W1980911127, https://openalex.org/W2018097747, https://openalex.org/W2611381500, https://openalex.org/W3021094736, https://openalex.org/W3104427003, https://openalex.org/W1511267087, https://openalex.org/W262436420, https://openalex.org/W2150615820 |
| referenced_works_count | 63 |
| abstract_inverted_index.a | 60, 142, 163 |
| abstract_inverted_index.12 | 151 |
| abstract_inverted_index.99 | 134 |
| abstract_inverted_index.In | 105 |
| abstract_inverted_index.an | 88, 92, 114, 130 |
| abstract_inverted_index.be | 160, 193 |
| abstract_inverted_index.by | 112, 141 |
| abstract_inverted_index.in | 68, 91, 102, 138, 176 |
| abstract_inverted_index.is | 58 |
| abstract_inverted_index.it | 95, 171 |
| abstract_inverted_index.of | 21, 76, 82, 126, 129, 146, 185 |
| abstract_inverted_index.on | 8, 44 |
| abstract_inverted_index.to | 32, 98, 195 |
| abstract_inverted_index.we | 108 |
| abstract_inverted_index.The | 80, 123 |
| abstract_inverted_index.and | 2, 25, 65, 72, 172 |
| abstract_inverted_index.are | 180 |
| abstract_inverted_index.can | 12, 159, 192 |
| abstract_inverted_index.for | 162 |
| abstract_inverted_index.how | 119 |
| abstract_inverted_index.key | 148 |
| abstract_inverted_index.may | 47 |
| abstract_inverted_index.the | 19, 74, 77, 103, 147, 174, 183, 186 |
| abstract_inverted_index.This | 190 |
| abstract_inverted_index.and, | 42 |
| abstract_inverted_index.been | 30 |
| abstract_inverted_index.data | 4, 34 |
| abstract_inverted_index.down | 50 |
| abstract_inverted_index.from | 35 |
| abstract_inverted_index.have | 28 |
| abstract_inverted_index.help | 13 |
| abstract_inverted_index.into | 166 |
| abstract_inverted_index.lack | 81 |
| abstract_inverted_index.show | 155 |
| abstract_inverted_index.slow | 49 |
| abstract_inverted_index.that | 117, 132, 156, 173 |
| abstract_inverted_index.this | 106, 110 |
| abstract_inverted_index.thus | 59 |
| abstract_inverted_index.used | 31 |
| abstract_inverted_index.user | 78 |
| abstract_inverted_index.when | 85 |
| abstract_inverted_index.with | 54, 150 |
| abstract_inverted_index.There | 57 |
| abstract_inverted_index.about | 5, 84 |
| abstract_inverted_index.makes | 94 |
| abstract_inverted_index.short | 164 |
| abstract_inverted_index.study | 116, 124 |
| abstract_inverted_index.tasks | 11 |
| abstract_inverted_index.their | 9, 45, 69 |
| abstract_inverted_index.three | 127 |
| abstract_inverted_index.time. | 189 |
| abstract_inverted_index.tools | 27 |
| abstract_inverted_index.which | 177 |
| abstract_inverted_index.better | 197 |
| abstract_inverted_index.design | 196 |
| abstract_inverted_index.field. | 104 |
| abstract_inverted_index.paper, | 107 |
| abstract_inverted_index.period | 165 |
| abstract_inverted_index.system | 187 |
| abstract_inverted_index.teams. | 22 |
| abstract_inverted_index.tools. | 37 |
| abstract_inverted_index.total, | 139 |
| abstract_inverted_index.Indeed, | 23 |
| abstract_inverted_index.Results | 154 |
| abstract_inverted_index.address | 109 |
| abstract_inverted_index.already | 29 |
| abstract_inverted_index.between | 63 |
| abstract_inverted_index.collect | 33 |
| abstract_inverted_index.complex | 178 |
| abstract_inverted_index.finally | 17 |
| abstract_inverted_index.improve | 14 |
| abstract_inverted_index.science | 136 |
| abstract_inverted_index.studies | 83 |
| abstract_inverted_index.without | 168 |
| abstract_inverted_index.working | 7, 101 |
| abstract_inverted_index.Abstract | 0 |
| abstract_inverted_index.analysis | 26 |
| abstract_inverted_index.computer | 135 |
| abstract_inverted_index.consists | 125 |
| abstract_inverted_index.consumes | 40 |
| abstract_inverted_index.executed | 181 |
| abstract_inverted_index.findings | 149 |
| abstract_inverted_index.followed | 140 |
| abstract_inverted_index.involved | 133 |
| abstract_inverted_index.overhead | 89, 158 |
| abstract_inverted_index.perceive | 87, 121 |
| abstract_inverted_index.response | 188 |
| abstract_inverted_index.sequence | 175 |
| abstract_inverted_index.software | 51 |
| abstract_inverted_index.students | 137 |
| abstract_inverted_index.systems, | 52 |
| abstract_inverted_index.activity. | 56 |
| abstract_inverted_index.analyzing | 3 |
| abstract_inverted_index.challenge | 111 |
| abstract_inverted_index.depending | 43 |
| abstract_inverted_index.difficult | 97 |
| abstract_inverted_index.empirical | 115 |
| abstract_inverted_index.exploited | 194 |
| abstract_inverted_index.extremely | 96 |
| abstract_inverted_index.fine-tune | 99 |
| abstract_inverted_index.overhead. | 122 |
| abstract_inverted_index.resources | 41 |
| abstract_inverted_index.trade-off | 62 |
| abstract_inverted_index.Collecting | 1 |
| abstract_inverted_index.Monitoring | 38 |
| abstract_inverted_index.assessment | 145 |
| abstract_inverted_index.developers | 6, 86, 120, 169 |
| abstract_inverted_index.experiment | 131 |
| abstract_inverted_index.increasing | 18 |
| abstract_inverted_index.inevitably | 39 |
| abstract_inverted_index.influences | 182 |
| abstract_inverted_index.introduced | 90, 161 |
| abstract_inverted_index.monitoring | 24, 64, 198 |
| abstract_inverted_index.operations | 179 |
| abstract_inverted_index.perceiving | 170 |
| abstract_inverted_index.perception | 184 |
| abstract_inverted_index.practices, | 16 |
| abstract_inverted_index.presenting | 113 |
| abstract_inverted_index.preventing | 73 |
| abstract_inverted_index.quantifies | 118 |
| abstract_inverted_index.techniques | 100 |
| abstract_inverted_index.validating | 66 |
| abstract_inverted_index.application | 93 |
| abstract_inverted_index.challenging | 61 |
| abstract_inverted_index.degradation | 75 |
| abstract_inverted_index.developers. | 153 |
| abstract_inverted_index.development | 10, 15 |
| abstract_inverted_index.environment | 71 |
| abstract_inverted_index.experience. | 79 |
| abstract_inverted_index.information | 191 |
| abstract_inverted_index.interfering | 53 |
| abstract_inverted_index.operational | 70 |
| abstract_inverted_index.small-scale | 143 |
| abstract_inverted_index.techniques. | 199 |
| abstract_inverted_index.applications | 67, 167 |
| abstract_inverted_index.experimental | 144 |
| abstract_inverted_index.productivity | 20, 36 |
| abstract_inverted_index.professional | 152 |
| abstract_inverted_index.replications | 128 |
| abstract_inverted_index.developers’ | 55 |
| abstract_inverted_index.significantly | 48 |
| abstract_inverted_index.extensiveness, | 46 |
| abstract_inverted_index.non-negligible | 157 |
| cited_by_percentile_year.max | 95 |
| cited_by_percentile_year.min | 91 |
| corresponding_author_ids | https://openalex.org/A5015645148, https://openalex.org/A5076033814, https://openalex.org/A5017676130, https://openalex.org/A5056117323, https://openalex.org/A5090346556, https://openalex.org/A5031106961, https://openalex.org/A5036120394 |
| countries_distinct_count | 4 |
| institutions_distinct_count | 7 |
| corresponding_institution_ids | https://openalex.org/I186903577, https://openalex.org/I66752286, https://openalex.org/I88060688, https://openalex.org/I98381234 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/8 |
| sustainable_development_goals[0].score | 0.5899999737739563 |
| sustainable_development_goals[0].display_name | Decent work and economic growth |
| citation_normalized_percentile.value | 0.57610013 |
| citation_normalized_percentile.is_in_top_1_percent | False |
| citation_normalized_percentile.is_in_top_10_percent | False |