Think Miniml / Research

Neurosymbolic Reasoning Shortcuts under the Independence Assumption

The ubiquitous independence assumption among symbolic concepts in neurosymbolic (NeSy) predictors is a convenient simplification that speeds up probab...

Full paper · available on arxiv.org

Read paper

The ubiquitous independence assumption among symbolic concepts in neurosymbolic (NeSy) predictors is a convenient simplification that speeds up probabilistic reasoning. Recent works argued that this assumption can hinder learning and prevent the correct modelling of uncertainty.

We formally show that assuming independence among symbolic concepts entails that a model can never represent uncertainty over certain concept combinations. Thus, the model fails to be aware of reasoning shortcuts, the pathological behaviour of NeSy predictors that predict correct downstream tasks but for the wrong reasons. This work settles the question of when the independence assumption actually limits NeSy systems.

Start the conversation

Talk to a senior consultant.

30 minutes. Bring a problem you’re stuck on — we’ll tell you what we’d do next.

Book a consultation