TreasureX Researchcs.LGAI Embeddings Struggle With Basic Physical Measurements
Juri Opitz, Andrianos Michail · September 17, 2026
The problem with how AI understands numbers
Embedding models are the workhorses behind search engines, recommendation systems, and chatbots. They turn words and phrases into vectors — lists of numbers — so a computer can judge how similar two things are. A new paper by Juri Opitz and Andrianos Michail asks a simple but revealing question: do these vectors actually capture physical measurements like mass, distance, time, and volume?
The answer is largely no. The researchers found that physical quantities are only weakly represented in embedding space. Worse, the models seem to rely on superficial string similarity — words that look alike get treated as similar, even when their physical meaning is very different. Recalibrating the similarity scores did not fix the problem.
Why it matters
Embeddings quietly shape what AI systems retrieve, rank, and recommend. If a model cannot reliably tell that 1 kilometre and 1,000 metres mean the same thing, or that 5 kilograms is heavier than 500 grams, then any downstream application involving units — logistics, engineering, scientific search, e-commerce specifications — inherits that blind spot.
Investing angle
For companies building AI products, this is a reminder that bigger models do not automatically mean better reasoning. Firms selling AI for industrial, scientific, or supply-chain use cases may need specialised numeric or unit-aware layers rather than relying on general-purpose embeddings. That is both a risk for incumbents and an opening for niche vendors.
Source: arXiv paper by Juri Opitz and Andrianos Michail — https://arxiv.org/abs/2609.20821
Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.