vWitness: Certifying Web Page Interactions with Computer Vision Article Swipe
YOU?
·
· 2020
· Open Access
·
· DOI: https://doi.org/10.48550/arxiv.2007.15805
Web servers service client requests, some of which might cause the web server to perform security-sensitive operations (e.g. money transfer, voting). An attacker may thus forge or maliciously manipulate such requests by compromising a web client. Unfortunately, a web server has no way of knowing whether the client from which it receives a request has been compromised or not -- current "best practice" defenses such as user authentication or network encryption cannot aid a server as they all assume web client integrity. To address this shortcoming, we propose vWitness, which "witnesses" the interactions of a user with a web page and certifies whether they match a specification provided by the web server, enabling the web server to know that the web request is user-intended. The main challenge that vWitness overcomes is that even benign clients introduce unpredictable variations in the way they render web pages. vWitness differentiates between these benign variations and malicious manipulation using computer vision, allowing it to certify to the web server that 1) the web page user interface is properly displayed 2) observed user interactions are used to construct the web request. Our vWitness prototype achieves compatibility with modern web pages, is resilient to adversarial example attacks and is accurate and performant -- vWitness achieves 99.97% accuracy and adds 197ms of overhead to the entire interaction session in the average case.
Related Topics
- Type
- preprint
- Language
- en
- Landing Page
- http://arxiv.org/abs/2007.15805
- https://arxiv.org/pdf/2007.15805
- OA Status
- green
- Related Works
- 10
- OpenAlex ID
- https://openalex.org/W4383466499
Raw OpenAlex JSON
- OpenAlex ID
-
https://openalex.org/W4383466499Canonical identifier for this work in OpenAlex
- DOI
-
https://doi.org/10.48550/arxiv.2007.15805Digital Object Identifier
- Title
-
vWitness: Certifying Web Page Interactions with Computer VisionWork title
- Type
-
preprintOpenAlex work type
- Language
-
enPrimary language
- Publication year
-
2020Year of publication
- Publication date
-
2020-07-31Full publication date if available
- Authors
-
Shuang He, Lianying Zhao, David LieList of authors in order
- Landing page
-
https://arxiv.org/abs/2007.15805Publisher landing page
- PDF URL
-
https://arxiv.org/pdf/2007.15805Direct link to full text PDF
- Open access
-
YesWhether a free full text is available
- OA status
-
greenOpen access status per OpenAlex
- OA URL
-
https://arxiv.org/pdf/2007.15805Direct OA link when available
- Concepts
-
Computer science, Web page, Web server, Static web page, World Wide Web, Web service, Web navigation, Web API, Web development, Web application security, Web modeling, Application server, The InternetTop concepts (fields/topics) attached by OpenAlex
- Cited by
-
0Total citation count in OpenAlex
- Related works (count)
-
10Other works algorithmically related by OpenAlex
Full payload
| id | https://openalex.org/W4383466499 |
|---|---|
| doi | https://doi.org/10.48550/arxiv.2007.15805 |
| ids.doi | https://doi.org/10.48550/arxiv.2007.15805 |
| ids.openalex | https://openalex.org/W4383466499 |
| fwci | |
| type | preprint |
| title | vWitness: Certifying Web Page Interactions with Computer Vision |
| biblio.issue | |
| biblio.volume | |
| biblio.last_page | |
| biblio.first_page | |
| topics[0].id | https://openalex.org/T10400 |
| topics[0].field.id | https://openalex.org/fields/17 |
| topics[0].field.display_name | Computer Science |
| topics[0].score | 0.9988999962806702 |
| topics[0].domain.id | https://openalex.org/domains/3 |
| topics[0].domain.display_name | Physical Sciences |
| topics[0].subfield.id | https://openalex.org/subfields/1705 |
| topics[0].subfield.display_name | Computer Networks and Communications |
| topics[0].display_name | Network Security and Intrusion Detection |
| topics[1].id | https://openalex.org/T11241 |
| topics[1].field.id | https://openalex.org/fields/17 |
| topics[1].field.display_name | Computer Science |
| topics[1].score | 0.9976999759674072 |
| topics[1].domain.id | https://openalex.org/domains/3 |
| topics[1].domain.display_name | Physical Sciences |
| topics[1].subfield.id | https://openalex.org/subfields/1711 |
| topics[1].subfield.display_name | Signal Processing |
| topics[1].display_name | Advanced Malware Detection Techniques |
| topics[2].id | https://openalex.org/T11598 |
| topics[2].field.id | https://openalex.org/fields/17 |
| topics[2].field.display_name | Computer Science |
| topics[2].score | 0.9968000054359436 |
| topics[2].domain.id | https://openalex.org/domains/3 |
| topics[2].domain.display_name | Physical Sciences |
| topics[2].subfield.id | https://openalex.org/subfields/1702 |
| topics[2].subfield.display_name | Artificial Intelligence |
| topics[2].display_name | Internet Traffic Analysis and Secure E-voting |
| is_xpac | False |
| apc_list | |
| apc_paid | |
| concepts[0].id | https://openalex.org/C41008148 |
| concepts[0].level | 0 |
| concepts[0].score | 0.8337410688400269 |
| concepts[0].wikidata | https://www.wikidata.org/wiki/Q21198 |
| concepts[0].display_name | Computer science |
| concepts[1].id | https://openalex.org/C21959979 |
| concepts[1].level | 2 |
| concepts[1].score | 0.7598411440849304 |
| concepts[1].wikidata | https://www.wikidata.org/wiki/Q36774 |
| concepts[1].display_name | Web page |
| concepts[2].id | https://openalex.org/C11392498 |
| concepts[2].level | 3 |
| concepts[2].score | 0.7015746831893921 |
| concepts[2].wikidata | https://www.wikidata.org/wiki/Q11288 |
| concepts[2].display_name | Web server |
| concepts[3].id | https://openalex.org/C173576120 |
| concepts[3].level | 4 |
| concepts[3].score | 0.682941198348999 |
| concepts[3].wikidata | https://www.wikidata.org/wiki/Q2641220 |
| concepts[3].display_name | Static web page |
| concepts[4].id | https://openalex.org/C136764020 |
| concepts[4].level | 1 |
| concepts[4].score | 0.650740385055542 |
| concepts[4].wikidata | https://www.wikidata.org/wiki/Q466 |
| concepts[4].display_name | World Wide Web |
| concepts[5].id | https://openalex.org/C35578498 |
| concepts[5].level | 2 |
| concepts[5].score | 0.6402857899665833 |
| concepts[5].wikidata | https://www.wikidata.org/wiki/Q193424 |
| concepts[5].display_name | Web service |
| concepts[6].id | https://openalex.org/C61096286 |
| concepts[6].level | 3 |
| concepts[6].score | 0.5835887789726257 |
| concepts[6].wikidata | https://www.wikidata.org/wiki/Q7978592 |
| concepts[6].display_name | Web navigation |
| concepts[7].id | https://openalex.org/C127613066 |
| concepts[7].level | 4 |
| concepts[7].score | 0.5747624039649963 |
| concepts[7].wikidata | https://www.wikidata.org/wiki/Q557770 |
| concepts[7].display_name | Web API |
| concepts[8].id | https://openalex.org/C79373723 |
| concepts[8].level | 3 |
| concepts[8].score | 0.543430745601654 |
| concepts[8].wikidata | https://www.wikidata.org/wiki/Q386275 |
| concepts[8].display_name | Web development |
| concepts[9].id | https://openalex.org/C59241245 |
| concepts[9].level | 4 |
| concepts[9].score | 0.4941845238208771 |
| concepts[9].wikidata | https://www.wikidata.org/wiki/Q4781497 |
| concepts[9].display_name | Web application security |
| concepts[10].id | https://openalex.org/C130436687 |
| concepts[10].level | 3 |
| concepts[10].score | 0.4863046109676361 |
| concepts[10].wikidata | https://www.wikidata.org/wiki/Q7978591 |
| concepts[10].display_name | Web modeling |
| concepts[11].id | https://openalex.org/C164554305 |
| concepts[11].level | 2 |
| concepts[11].score | 0.42161810398101807 |
| concepts[11].wikidata | https://www.wikidata.org/wiki/Q71550 |
| concepts[11].display_name | Application server |
| concepts[12].id | https://openalex.org/C110875604 |
| concepts[12].level | 2 |
| concepts[12].score | 0.18790769577026367 |
| concepts[12].wikidata | https://www.wikidata.org/wiki/Q75 |
| concepts[12].display_name | The Internet |
| keywords[0].id | https://openalex.org/keywords/computer-science |
| keywords[0].score | 0.8337410688400269 |
| keywords[0].display_name | Computer science |
| keywords[1].id | https://openalex.org/keywords/web-page |
| keywords[1].score | 0.7598411440849304 |
| keywords[1].display_name | Web page |
| keywords[2].id | https://openalex.org/keywords/web-server |
| keywords[2].score | 0.7015746831893921 |
| keywords[2].display_name | Web server |
| keywords[3].id | https://openalex.org/keywords/static-web-page |
| keywords[3].score | 0.682941198348999 |
| keywords[3].display_name | Static web page |
| keywords[4].id | https://openalex.org/keywords/world-wide-web |
| keywords[4].score | 0.650740385055542 |
| keywords[4].display_name | World Wide Web |
| keywords[5].id | https://openalex.org/keywords/web-service |
| keywords[5].score | 0.6402857899665833 |
| keywords[5].display_name | Web service |
| keywords[6].id | https://openalex.org/keywords/web-navigation |
| keywords[6].score | 0.5835887789726257 |
| keywords[6].display_name | Web navigation |
| keywords[7].id | https://openalex.org/keywords/web-api |
| keywords[7].score | 0.5747624039649963 |
| keywords[7].display_name | Web API |
| keywords[8].id | https://openalex.org/keywords/web-development |
| keywords[8].score | 0.543430745601654 |
| keywords[8].display_name | Web development |
| keywords[9].id | https://openalex.org/keywords/web-application-security |
| keywords[9].score | 0.4941845238208771 |
| keywords[9].display_name | Web application security |
| keywords[10].id | https://openalex.org/keywords/web-modeling |
| keywords[10].score | 0.4863046109676361 |
| keywords[10].display_name | Web modeling |
| keywords[11].id | https://openalex.org/keywords/application-server |
| keywords[11].score | 0.42161810398101807 |
| keywords[11].display_name | Application server |
| keywords[12].id | https://openalex.org/keywords/the-internet |
| keywords[12].score | 0.18790769577026367 |
| keywords[12].display_name | The Internet |
| language | en |
| locations[0].id | pmh:oai:arXiv.org:2007.15805 |
| locations[0].is_oa | True |
| locations[0].source.id | https://openalex.org/S4306400194 |
| locations[0].source.issn | |
| locations[0].source.type | repository |
| locations[0].source.is_oa | True |
| locations[0].source.issn_l | |
| locations[0].source.is_core | False |
| locations[0].source.is_in_doaj | False |
| locations[0].source.display_name | arXiv (Cornell University) |
| locations[0].source.host_organization | https://openalex.org/I205783295 |
| locations[0].source.host_organization_name | Cornell University |
| locations[0].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[0].license | |
| locations[0].pdf_url | https://arxiv.org/pdf/2007.15805 |
| locations[0].version | submittedVersion |
| locations[0].raw_type | text |
| locations[0].license_id | |
| locations[0].is_accepted | False |
| locations[0].is_published | False |
| locations[0].raw_source_name | |
| locations[0].landing_page_url | http://arxiv.org/abs/2007.15805 |
| locations[1].id | doi:10.48550/arxiv.2007.15805 |
| locations[1].is_oa | True |
| locations[1].source.id | https://openalex.org/S4306400194 |
| locations[1].source.issn | |
| locations[1].source.type | repository |
| locations[1].source.is_oa | True |
| locations[1].source.issn_l | |
| locations[1].source.is_core | False |
| locations[1].source.is_in_doaj | False |
| locations[1].source.display_name | arXiv (Cornell University) |
| locations[1].source.host_organization | https://openalex.org/I205783295 |
| locations[1].source.host_organization_name | Cornell University |
| locations[1].source.host_organization_lineage | https://openalex.org/I205783295 |
| locations[1].license | |
| locations[1].pdf_url | |
| locations[1].version | |
| locations[1].raw_type | article |
| locations[1].license_id | |
| locations[1].is_accepted | False |
| locations[1].is_published | |
| locations[1].raw_source_name | |
| locations[1].landing_page_url | https://doi.org/10.48550/arxiv.2007.15805 |
| indexed_in | arxiv, datacite |
| authorships[0].author.id | https://openalex.org/A5100520043 |
| authorships[0].author.orcid | |
| authorships[0].author.display_name | Shuang He |
| authorships[0].author_position | first |
| authorships[0].raw_author_name | Shuang, He |
| authorships[0].is_corresponding | False |
| authorships[1].author.id | https://openalex.org/A5075517496 |
| authorships[1].author.orcid | https://orcid.org/0000-0002-6376-4062 |
| authorships[1].author.display_name | Lianying Zhao |
| authorships[1].author_position | middle |
| authorships[1].raw_author_name | Zhao, Lianying |
| authorships[1].is_corresponding | False |
| authorships[2].author.id | https://openalex.org/A5049933072 |
| authorships[2].author.orcid | https://orcid.org/0000-0002-2000-6827 |
| authorships[2].author.display_name | David Lie |
| authorships[2].author_position | last |
| authorships[2].raw_author_name | Lie, David |
| authorships[2].is_corresponding | False |
| has_content.pdf | True |
| has_content.grobid_xml | True |
| is_paratext | False |
| open_access.is_oa | True |
| open_access.oa_url | https://arxiv.org/pdf/2007.15805 |
| open_access.oa_status | green |
| open_access.any_repository_has_fulltext | False |
| created_date | 2025-10-10T00:00:00 |
| display_name | vWitness: Certifying Web Page Interactions with Computer Vision |
| has_fulltext | True |
| is_retracted | False |
| updated_date | 2025-11-06T06:51:31.235846 |
| primary_topic.id | https://openalex.org/T10400 |
| primary_topic.field.id | https://openalex.org/fields/17 |
| primary_topic.field.display_name | Computer Science |
| primary_topic.score | 0.9988999962806702 |
| primary_topic.domain.id | https://openalex.org/domains/3 |
| primary_topic.domain.display_name | Physical Sciences |
| primary_topic.subfield.id | https://openalex.org/subfields/1705 |
| primary_topic.subfield.display_name | Computer Networks and Communications |
| primary_topic.display_name | Network Security and Intrusion Detection |
| related_works | https://openalex.org/W1566985031, https://openalex.org/W2074126298, https://openalex.org/W2106737497, https://openalex.org/W1558090658, https://openalex.org/W2386381307, https://openalex.org/W2079759057, https://openalex.org/W1878945750, https://openalex.org/W2354120989, https://openalex.org/W2616587278, https://openalex.org/W1991431151 |
| cited_by_count | 0 |
| locations_count | 2 |
| best_oa_location.id | pmh:oai:arXiv.org:2007.15805 |
| best_oa_location.is_oa | True |
| best_oa_location.source.id | https://openalex.org/S4306400194 |
| best_oa_location.source.issn | |
| best_oa_location.source.type | repository |
| best_oa_location.source.is_oa | True |
| best_oa_location.source.issn_l | |
| best_oa_location.source.is_core | False |
| best_oa_location.source.is_in_doaj | False |
| best_oa_location.source.display_name | arXiv (Cornell University) |
| best_oa_location.source.host_organization | https://openalex.org/I205783295 |
| best_oa_location.source.host_organization_name | Cornell University |
| best_oa_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| best_oa_location.license | |
| best_oa_location.pdf_url | https://arxiv.org/pdf/2007.15805 |
| best_oa_location.version | submittedVersion |
| best_oa_location.raw_type | text |
| best_oa_location.license_id | |
| best_oa_location.is_accepted | False |
| best_oa_location.is_published | False |
| best_oa_location.raw_source_name | |
| best_oa_location.landing_page_url | http://arxiv.org/abs/2007.15805 |
| primary_location.id | pmh:oai:arXiv.org:2007.15805 |
| primary_location.is_oa | True |
| primary_location.source.id | https://openalex.org/S4306400194 |
| primary_location.source.issn | |
| primary_location.source.type | repository |
| primary_location.source.is_oa | True |
| primary_location.source.issn_l | |
| primary_location.source.is_core | False |
| primary_location.source.is_in_doaj | False |
| primary_location.source.display_name | arXiv (Cornell University) |
| primary_location.source.host_organization | https://openalex.org/I205783295 |
| primary_location.source.host_organization_name | Cornell University |
| primary_location.source.host_organization_lineage | https://openalex.org/I205783295 |
| primary_location.license | |
| primary_location.pdf_url | https://arxiv.org/pdf/2007.15805 |
| primary_location.version | submittedVersion |
| primary_location.raw_type | text |
| primary_location.license_id | |
| primary_location.is_accepted | False |
| primary_location.is_published | False |
| primary_location.raw_source_name | |
| primary_location.landing_page_url | http://arxiv.org/abs/2007.15805 |
| publication_date | 2020-07-31 |
| publication_year | 2020 |
| referenced_works_count | 0 |
| abstract_inverted_index.a | 33, 37, 52, 73, 94, 97, 105 |
| abstract_inverted_index.-- | 59, 206 |
| abstract_inverted_index.1) | 166 |
| abstract_inverted_index.2) | 175 |
| abstract_inverted_index.An | 21 |
| abstract_inverted_index.To | 82 |
| abstract_inverted_index.as | 65, 75 |
| abstract_inverted_index.by | 31, 108 |
| abstract_inverted_index.in | 138, 221 |
| abstract_inverted_index.is | 122, 130, 172, 195, 202 |
| abstract_inverted_index.it | 50, 158 |
| abstract_inverted_index.no | 41 |
| abstract_inverted_index.of | 6, 43, 93, 214 |
| abstract_inverted_index.or | 26, 57, 68 |
| abstract_inverted_index.to | 13, 116, 159, 161, 181, 197, 216 |
| abstract_inverted_index.we | 86 |
| abstract_inverted_index.Our | 186 |
| abstract_inverted_index.The | 124 |
| abstract_inverted_index.Web | 0 |
| abstract_inverted_index.aid | 72 |
| abstract_inverted_index.all | 77 |
| abstract_inverted_index.and | 100, 151, 201, 204, 211 |
| abstract_inverted_index.are | 179 |
| abstract_inverted_index.has | 40, 54 |
| abstract_inverted_index.may | 23 |
| abstract_inverted_index.not | 58 |
| abstract_inverted_index.the | 10, 46, 91, 109, 113, 119, 139, 162, 167, 183, 217, 222 |
| abstract_inverted_index.way | 42, 140 |
| abstract_inverted_index.web | 11, 34, 38, 79, 98, 110, 114, 120, 143, 163, 168, 184, 193 |
| abstract_inverted_index.adds | 212 |
| abstract_inverted_index.been | 55 |
| abstract_inverted_index.even | 132 |
| abstract_inverted_index.from | 48 |
| abstract_inverted_index.know | 117 |
| abstract_inverted_index.main | 125 |
| abstract_inverted_index.page | 99, 169 |
| abstract_inverted_index.some | 5 |
| abstract_inverted_index.such | 29, 64 |
| abstract_inverted_index.that | 118, 127, 131, 165 |
| abstract_inverted_index.they | 76, 103, 141 |
| abstract_inverted_index.this | 84 |
| abstract_inverted_index.thus | 24 |
| abstract_inverted_index.used | 180 |
| abstract_inverted_index.user | 66, 95, 170, 177 |
| abstract_inverted_index.with | 96, 191 |
| abstract_inverted_index."best | 61 |
| abstract_inverted_index.(e.g. | 17 |
| abstract_inverted_index.197ms | 213 |
| abstract_inverted_index.case. | 224 |
| abstract_inverted_index.cause | 9 |
| abstract_inverted_index.forge | 25 |
| abstract_inverted_index.match | 104 |
| abstract_inverted_index.might | 8 |
| abstract_inverted_index.money | 18 |
| abstract_inverted_index.these | 148 |
| abstract_inverted_index.using | 154 |
| abstract_inverted_index.which | 7, 49, 89 |
| abstract_inverted_index.99.97% | 209 |
| abstract_inverted_index.assume | 78 |
| abstract_inverted_index.benign | 133, 149 |
| abstract_inverted_index.cannot | 71 |
| abstract_inverted_index.client | 3, 47, 80 |
| abstract_inverted_index.entire | 218 |
| abstract_inverted_index.modern | 192 |
| abstract_inverted_index.pages, | 194 |
| abstract_inverted_index.pages. | 144 |
| abstract_inverted_index.render | 142 |
| abstract_inverted_index.server | 12, 39, 74, 115, 164 |
| abstract_inverted_index.address | 83 |
| abstract_inverted_index.attacks | 200 |
| abstract_inverted_index.average | 223 |
| abstract_inverted_index.between | 147 |
| abstract_inverted_index.certify | 160 |
| abstract_inverted_index.client. | 35 |
| abstract_inverted_index.clients | 134 |
| abstract_inverted_index.current | 60 |
| abstract_inverted_index.example | 199 |
| abstract_inverted_index.knowing | 44 |
| abstract_inverted_index.network | 69 |
| abstract_inverted_index.perform | 14 |
| abstract_inverted_index.propose | 87 |
| abstract_inverted_index.request | 53, 121 |
| abstract_inverted_index.server, | 111 |
| abstract_inverted_index.servers | 1 |
| abstract_inverted_index.service | 2 |
| abstract_inverted_index.session | 220 |
| abstract_inverted_index.vision, | 156 |
| abstract_inverted_index.whether | 45, 102 |
| abstract_inverted_index.accuracy | 210 |
| abstract_inverted_index.accurate | 203 |
| abstract_inverted_index.achieves | 189, 208 |
| abstract_inverted_index.allowing | 157 |
| abstract_inverted_index.attacker | 22 |
| abstract_inverted_index.computer | 155 |
| abstract_inverted_index.defenses | 63 |
| abstract_inverted_index.enabling | 112 |
| abstract_inverted_index.observed | 176 |
| abstract_inverted_index.overhead | 215 |
| abstract_inverted_index.properly | 173 |
| abstract_inverted_index.provided | 107 |
| abstract_inverted_index.receives | 51 |
| abstract_inverted_index.request. | 185 |
| abstract_inverted_index.requests | 30 |
| abstract_inverted_index.vWitness | 128, 145, 187, 207 |
| abstract_inverted_index.voting). | 20 |
| abstract_inverted_index.certifies | 101 |
| abstract_inverted_index.challenge | 126 |
| abstract_inverted_index.construct | 182 |
| abstract_inverted_index.displayed | 174 |
| abstract_inverted_index.interface | 171 |
| abstract_inverted_index.introduce | 135 |
| abstract_inverted_index.malicious | 152 |
| abstract_inverted_index.overcomes | 129 |
| abstract_inverted_index.practice" | 62 |
| abstract_inverted_index.prototype | 188 |
| abstract_inverted_index.requests, | 4 |
| abstract_inverted_index.resilient | 196 |
| abstract_inverted_index.transfer, | 19 |
| abstract_inverted_index.vWitness, | 88 |
| abstract_inverted_index.encryption | 70 |
| abstract_inverted_index.integrity. | 81 |
| abstract_inverted_index.manipulate | 28 |
| abstract_inverted_index.operations | 16 |
| abstract_inverted_index.performant | 205 |
| abstract_inverted_index.variations | 137, 150 |
| abstract_inverted_index."witnesses" | 90 |
| abstract_inverted_index.adversarial | 198 |
| abstract_inverted_index.compromised | 56 |
| abstract_inverted_index.interaction | 219 |
| abstract_inverted_index.maliciously | 27 |
| abstract_inverted_index.compromising | 32 |
| abstract_inverted_index.interactions | 92, 178 |
| abstract_inverted_index.manipulation | 153 |
| abstract_inverted_index.shortcoming, | 85 |
| abstract_inverted_index.compatibility | 190 |
| abstract_inverted_index.specification | 106 |
| abstract_inverted_index.unpredictable | 136 |
| abstract_inverted_index.Unfortunately, | 36 |
| abstract_inverted_index.authentication | 67 |
| abstract_inverted_index.differentiates | 146 |
| abstract_inverted_index.user-intended. | 123 |
| abstract_inverted_index.security-sensitive | 15 |
| cited_by_percentile_year | |
| countries_distinct_count | 0 |
| institutions_distinct_count | 3 |
| sustainable_development_goals[0].id | https://metadata.un.org/sdg/16 |
| sustainable_development_goals[0].score | 0.7900000214576721 |
| sustainable_development_goals[0].display_name | Peace, Justice and strong institutions |
| citation_normalized_percentile |