Neurosymbolic Diffusion Models

Read Paper

Neurosymbolic (NeSy) predictors combine neural perception with symbolic reasoning to solve tasks like visual reasoning. However, standard NeSy predictors assume conditional independence between symbols, limiting their ability to model interactions and uncertainty. We introduce neurosymbolic diffusion models (NeSyDMs), a new class of NeSy predictors that use discrete diffusion to model dependencies between symbols.

Our approach reuses the independence assumption from NeSy predictors at each step of the diffusion process, enabling scalable learning while capturing symbol dependencies and uncertainty quantification. Across both synthetic and real-world benchmarks, NeSyDMs achieve state-of-the-art accuracy among NeSy predictors and demonstrate strong calibration.

Share :