main webpage
W Topic
Engineering
arXiv (Cornell University)
Language Modeling Is Compression
2023
It has long been established that predictive models can be transformed into lossless compressors and vice versa. Incidentally, in recent years, the machine learning community has focused on training increasingly large and powerful self-supervised (language) m…
Article

Engineering

Applied science

Engineering is the use of scientific principles to design and build machines, structures, and other items, including bridges, tunnels, roads, vehicles, and buildings. The discipline of engineering encompasses a broad range of more specialized fields of engineering, each with a more specific emphasis on particular areas of applied mathematics, applied science, and types of application. See glossary of engineering.

The term engineering is derived from the Latin ingenium , meaning "cleverness" and ingeniare , meaning "to contrive, devise".

Exploring foci of:
arXiv (Cornell University)
Language Modeling Is Compression
2023
It has long been established that predictive models can be transformed into lossless compressors and vice versa. Incidentally, in recent years, the machine learning community has focused on training increasingly large and powerful self-supervised (language) models. Since these large language models exhibit impressive predictive capabilities, they are well-positioned to be strong compressors. In this work, we advocate for viewing the prediction problem through the lens of compression and evaluate the compression ca…
Click Engineering Vs:
Computer Science
Lossy Compression
Compressor
Artificial Intelligence
Machine Learning
Mechanical Engineering
Materials Science
Composite Material
Paleontology
Click Engineering Vs:
Biology