The Conundrum of Diffuse Basis Sets: A Blessing for Accuracy yet a Curse for Sparsity Article Swipe
YOU?
·
· 2025
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2502.04631
Diffuse atomic orbital basis sets have proven to be essential to obtain accurate interaction energies, especially in regard to non-covalent interactions. However, they also have a detrimental impact on the sparsity of the one-particle density matrix (1-PDM), to a degree stronger than the spatial extent of the basis functions alone could explain. This is despite the fact that the matrix elements of the 1-PDM of insulators (systems with significant HOMO-LUMO gaps) are expected to decay exponentially with increasing real-space distance from the diagonal and the asymptotic decay rate is expected to have a well-defined basis set limit. The observed low sparsity of the 1-PDM appears to be independent of representation and even persists after projecting the 1-PDM onto a real-space grid, leading to the conclusion that this "curse of sparsity" is solely a basis set artifact, which, counterintuitively, becomes worse for larger basis sets, seemingly contradicting the notion of a well-defined basis set limit. We show that this is a consequence of the low locality of the contra-variant basis functions as quantified by the inverse overlap matrix $\mathbf{S}^{-1}$ being significantly less sparse than its covariant dual. Introducing the model system of an infinite non-interacting chain of helium atoms, we are able to quantify the exponential decay rate to be proportional to the diffuseness as well as local incompleteness of the basis set, meaning small and diffuse basis sets are affected the most. Finally, we propose one solution to the conundrum in the form of the complementary auxiliary basis set (CABS) singles correction in combination with compact, low l-quantum-number basis sets, showing promising results for non-covalent interactions.
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2502.04631
- https://arxiv.org/pdf/2502.04631
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4407309048
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4407309048Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2502.04631Digital Object Identifier
- Title
-
The Conundrum of Diffuse Basis Sets: A Blessing for Accuracy yet a Curse for SparsityWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2025Year of publication
- Publication date
-
2025-02-07Full publication date if available
- Authors
-
Henryk Laqua, Linus Bjarne Dittmer, Martin Head‐GordonList of authors in order
- Landing page
-
https://arxiv.org/abs/2502.04631Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2502.04631Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2502.04631Direct OA link when available
- Concepts
-
Blessing, Curse, Basis (linear algebra), Computer science, Mathematics, Philosophy, Theology, GeometryTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4407309048 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2502.04631 |
| ids.doi | https://doi.org/10.48550/arxiv.2502.04631 |
| ids.openalex | https://openalex.org/W4407309048 |
| fwci | |
| type | preprint |
| title | The Conundrum of Diffuse Basis Sets: A Blessing for Accuracy yet a Curse for Sparsity |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10928 |
| topics[0].field.id | https://openalex.org/fields/18 |
| topics[0].field.display_name | Decision Sciences |
| topics[0].score | 0.6148999929428101 |
| topics[0].domain.id | https://openalex.org/domains/2 |
| topics[0].domain.display_name | Social Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1804 |
| topics[0].subfield.display_name | Statistics, Probability and Uncertainty |
| topics[0].display_name | Probabilistic and Robust Engineering Design |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C2776195157 |
| concepts[0].level | 2 |
| concepts[0].score | 0.9864643216133118 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q626510 |
| concepts[0].display_name | Blessing |
| concepts[1].id | https://openalex.org/C2780273121 |
| concepts[1].level | 2 |
| concepts[1].score | 0.9375999569892883 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q109411 |
| concepts[1].display_name | Curse |
| concepts[2].id | https://openalex.org/C12426560 |
| concepts[2].level | 2 |
| concepts[2].score | 0.5897735953330994 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q189569 |
| concepts[2].display_name | Basis (linear algebra) |
| concepts[3].id | https://openalex.org/C41008148 |
| concepts[3].level | 0 |
| concepts[3].score | 0.3530750274658203 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[3].display_name | Computer science |
| concepts[4].id | https://openalex.org/C33923547 |
| concepts[4].level | 0 |
| concepts[4].score | 0.25828617811203003 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q395 |
| concepts[4].display_name | Mathematics |
| concepts[5].id | https://openalex.org/C138885662 |
| concepts[5].level | 0 |
| concepts[5].score | 0.18592584133148193 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q5891 |
| concepts[5].display_name | Philosophy |
| concepts[6].id | https://openalex.org/C27206212 |
| concepts[6].level | 1 |
| concepts[6].score | 0.08925506472587585 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q34178 |
| concepts[6].display_name | Theology |
| concepts[7].id | https://openalex.org/C2524010 |
| concepts[7].level | 1 |
| concepts[7].score | 0.057356029748916626 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q8087 |
| concepts[7].display_name | Geometry |
| keywords[0].id | https://openalex.org/keywords/blessing |
| keywords[0].score | 0.9864643216133118 |
| keywords[0].display_name | Blessing |
| keywords[1].id | https://openalex.org/keywords/curse |
| keywords[1].score | 0.9375999569892883 |
| keywords[1].display_name | Curse |
| keywords[2].id | https://openalex.org/keywords/basis |
| keywords[2].score | 0.5897735953330994 |
| keywords[2].display_name | Basis (linear algebra) |
| keywords[3].id | https://openalex.org/keywords/computer-science |
| keywords[3].score | 0.3530750274658203 |
| keywords[3].display_name | Computer science |
| keywords[4].id | https://openalex.org/keywords/mathematics |
| keywords[4].score | 0.25828617811203003 |
| keywords[4].display_name | Mathematics |
| keywords[5].id | https://openalex.org/keywords/philosophy |
| keywords[5].score | 0.18592584133148193 |
| keywords[5].display_name | Philosophy |
| keywords[6].id | https://openalex.org/keywords/theology |
| keywords[6].score | 0.08925506472587585 |
| keywords[6].display_name | Theology |
| keywords[7].id | https://openalex.org/keywords/geometry |
| keywords[7].score | 0.057356029748916626 |
| keywords[7].display_name | Geometry |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2502.04631 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2502.04631 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2502.04631 |
| locations[1].id | doi:10.48550/arxiv.2502.04631 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | cc-by |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | https://openalex.org/licenses/cc-by |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2502.04631 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5026783879 |
| authorships[0].author.orcid | https://orcid.org/0000-0002-5401-696X |
| authorships[0].author.display_name | Henryk Laqua |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Laqua, Henryk |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5092991736 |
| authorships[1].author.orcid | https://orcid.org/0009-0008-9480-1250 |
| authorships[1].author.display_name | Linus Bjarne Dittmer |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Dittmer, Linus Bjarne |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5015311244 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-4309-6669 |
| authorships[2].author.display_name | Martin Head‐Gordon |
| authorships[2].author_position | last |
| authorships[2].raw_author_name | Head-Gordon, Martin |
| authorships[2].is_corresponding | False |
| has_content.pdf | False |
| has_content.grobid_xml | False |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2502.04631 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | The Conundrum of Diffuse Basis Sets: A Blessing for Accuracy yet a Curse for Sparsity |
| has_fulltext | False |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10928 |
| primary_topic.field.id | https://openalex.org/fields/18 |
| primary_topic.field.display_name | Decision Sciences |
| primary_topic.score | 0.6148999929428101 |
| primary_topic.domain.id | https://openalex.org/domains/2 |
| primary_topic.domain.display_name | Social Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1804 |
| primary_topic.subfield.display_name | Statistics, Probability and Uncertainty |
| primary_topic.display_name | Probabilistic and Robust Engineering Design |
| related_works | https://openalex.org/W2005044196, https://openalex.org/W2313412377, https://openalex.org/W1485007142, https://openalex.org/W3133282625, https://openalex.org/W2314038984, https://openalex.org/W1911503363, https://openalex.org/W3165692504, https://openalex.org/W3180421702, https://openalex.org/W2313993255, https://openalex.org/W2413520594 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2502.04631 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2502.04631 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2502.04631 |
| primary_location.id | pmh:oai:arXiv.org:2502.04631 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2502.04631 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2502.04631 |
| publication_date | 2025-02-07 |
| publication_year | 2025 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 25, 38, 92, 118, 132, 149, 159 |
| abstract_inverted_index.We | 154 |
| abstract_inverted_index.an | 191 |
| abstract_inverted_index.as | 170, 213, 215 |
| abstract_inverted_index.be | 8, 106, 208 |
| abstract_inverted_index.by | 172 |
| abstract_inverted_index.in | 16, 240, 252 |
| abstract_inverted_index.is | 53, 88, 130, 158 |
| abstract_inverted_index.of | 31, 45, 61, 64, 101, 108, 128, 148, 161, 165, 190, 195, 218, 243 |
| abstract_inverted_index.on | 28 |
| abstract_inverted_index.to | 7, 10, 18, 37, 73, 90, 105, 122, 201, 207, 210, 237 |
| abstract_inverted_index.we | 198, 233 |
| abstract_inverted_index.The | 97 |
| abstract_inverted_index.and | 83, 110, 224 |
| abstract_inverted_index.are | 71, 199, 228 |
| abstract_inverted_index.for | 140, 263 |
| abstract_inverted_index.its | 183 |
| abstract_inverted_index.low | 99, 163, 256 |
| abstract_inverted_index.one | 235 |
| abstract_inverted_index.set | 95, 134, 152, 248 |
| abstract_inverted_index.the | 29, 32, 42, 46, 55, 58, 62, 81, 84, 102, 115, 123, 146, 162, 166, 173, 187, 203, 211, 219, 230, 238, 241, 244 |
| abstract_inverted_index.This | 52 |
| abstract_inverted_index.able | 200 |
| abstract_inverted_index.also | 23 |
| abstract_inverted_index.even | 111 |
| abstract_inverted_index.fact | 56 |
| abstract_inverted_index.form | 242 |
| abstract_inverted_index.from | 80 |
| abstract_inverted_index.have | 5, 24, 91 |
| abstract_inverted_index.less | 180 |
| abstract_inverted_index.onto | 117 |
| abstract_inverted_index.rate | 87, 206 |
| abstract_inverted_index.set, | 221 |
| abstract_inverted_index.sets | 4, 227 |
| abstract_inverted_index.show | 155 |
| abstract_inverted_index.than | 41, 182 |
| abstract_inverted_index.that | 57, 125, 156 |
| abstract_inverted_index.they | 22 |
| abstract_inverted_index.this | 126, 157 |
| abstract_inverted_index.well | 214 |
| abstract_inverted_index.with | 67, 76, 254 |
| abstract_inverted_index.1-PDM | 63, 103, 116 |
| abstract_inverted_index.after | 113 |
| abstract_inverted_index.alone | 49 |
| abstract_inverted_index.basis | 3, 47, 94, 133, 142, 151, 168, 220, 226, 247, 258 |
| abstract_inverted_index.being | 178 |
| abstract_inverted_index.chain | 194 |
| abstract_inverted_index.could | 50 |
| abstract_inverted_index.decay | 74, 86, 205 |
| abstract_inverted_index.dual. | 185 |
| abstract_inverted_index.gaps) | 70 |
| abstract_inverted_index.grid, | 120 |
| abstract_inverted_index.local | 216 |
| abstract_inverted_index.model | 188 |
| abstract_inverted_index.most. | 231 |
| abstract_inverted_index.sets, | 143, 259 |
| abstract_inverted_index.small | 223 |
| abstract_inverted_index.worse | 139 |
| abstract_inverted_index."curse | 127 |
| abstract_inverted_index.(CABS) | 249 |
| abstract_inverted_index.atomic | 1 |
| abstract_inverted_index.atoms, | 197 |
| abstract_inverted_index.degree | 39 |
| abstract_inverted_index.extent | 44 |
| abstract_inverted_index.helium | 196 |
| abstract_inverted_index.impact | 27 |
| abstract_inverted_index.larger | 141 |
| abstract_inverted_index.limit. | 96, 153 |
| abstract_inverted_index.matrix | 35, 59, 176 |
| abstract_inverted_index.notion | 147 |
| abstract_inverted_index.obtain | 11 |
| abstract_inverted_index.proven | 6 |
| abstract_inverted_index.regard | 17 |
| abstract_inverted_index.solely | 131 |
| abstract_inverted_index.sparse | 181 |
| abstract_inverted_index.system | 189 |
| abstract_inverted_index.which, | 136 |
| abstract_inverted_index.Diffuse | 0 |
| abstract_inverted_index.appears | 104 |
| abstract_inverted_index.becomes | 138 |
| abstract_inverted_index.density | 34 |
| abstract_inverted_index.despite | 54 |
| abstract_inverted_index.diffuse | 225 |
| abstract_inverted_index.inverse | 174 |
| abstract_inverted_index.leading | 121 |
| abstract_inverted_index.meaning | 222 |
| abstract_inverted_index.orbital | 2 |
| abstract_inverted_index.overlap | 175 |
| abstract_inverted_index.propose | 234 |
| abstract_inverted_index.results | 262 |
| abstract_inverted_index.showing | 260 |
| abstract_inverted_index.singles | 250 |
| abstract_inverted_index.spatial | 43 |
| abstract_inverted_index.(1-PDM), | 36 |
| abstract_inverted_index.(systems | 66 |
| abstract_inverted_index.Finally, | 232 |
| abstract_inverted_index.However, | 21 |
| abstract_inverted_index.accurate | 12 |
| abstract_inverted_index.affected | 229 |
| abstract_inverted_index.compact, | 255 |
| abstract_inverted_index.diagonal | 82 |
| abstract_inverted_index.distance | 79 |
| abstract_inverted_index.elements | 60 |
| abstract_inverted_index.expected | 72, 89 |
| abstract_inverted_index.explain. | 51 |
| abstract_inverted_index.infinite | 192 |
| abstract_inverted_index.locality | 164 |
| abstract_inverted_index.observed | 98 |
| abstract_inverted_index.persists | 112 |
| abstract_inverted_index.quantify | 202 |
| abstract_inverted_index.solution | 236 |
| abstract_inverted_index.sparsity | 30, 100 |
| abstract_inverted_index.stronger | 40 |
| abstract_inverted_index.HOMO-LUMO | 69 |
| abstract_inverted_index.artifact, | 135 |
| abstract_inverted_index.auxiliary | 246 |
| abstract_inverted_index.conundrum | 239 |
| abstract_inverted_index.covariant | 184 |
| abstract_inverted_index.energies, | 14 |
| abstract_inverted_index.essential | 9 |
| abstract_inverted_index.functions | 48, 169 |
| abstract_inverted_index.promising | 261 |
| abstract_inverted_index.seemingly | 144 |
| abstract_inverted_index.sparsity" | 129 |
| abstract_inverted_index.asymptotic | 85 |
| abstract_inverted_index.conclusion | 124 |
| abstract_inverted_index.correction | 251 |
| abstract_inverted_index.especially | 15 |
| abstract_inverted_index.increasing | 77 |
| abstract_inverted_index.insulators | 65 |
| abstract_inverted_index.projecting | 114 |
| abstract_inverted_index.quantified | 171 |
| abstract_inverted_index.real-space | 78, 119 |
| abstract_inverted_index.Introducing | 186 |
| abstract_inverted_index.combination | 253 |
| abstract_inverted_index.consequence | 160 |
| abstract_inverted_index.detrimental | 26 |
| abstract_inverted_index.diffuseness | 212 |
| abstract_inverted_index.exponential | 204 |
| abstract_inverted_index.independent | 107 |
| abstract_inverted_index.interaction | 13 |
| abstract_inverted_index.significant | 68 |
| abstract_inverted_index.non-covalent | 19, 264 |
| abstract_inverted_index.one-particle | 33 |
| abstract_inverted_index.proportional | 209 |
| abstract_inverted_index.well-defined | 93, 150 |
| abstract_inverted_index.complementary | 245 |
| abstract_inverted_index.contradicting | 145 |
| abstract_inverted_index.exponentially | 75 |
| abstract_inverted_index.interactions. | 20, 265 |
| abstract_inverted_index.significantly | 179 |
| abstract_inverted_index.contra-variant | 167 |
| abstract_inverted_index.incompleteness | 217 |
| abstract_inverted_index.representation | 109 |
| abstract_inverted_index.non-interacting | 193 |
| abstract_inverted_index.l-quantum-number | 257 |
| abstract_inverted_index.$\mathbf{S}^{-1}$ | 177 |
| abstract_inverted_index.counterintuitively, | 137 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 3 |
| citation_normalized_percentile |