Some researchers have argued that mass perception, causal ascriptions, and predictions in simple billiard ball in-teractions can be modeled as inductive Bayesian inference over a (noisy) Newtonian representation of the world. However,there are phenomena, such as the asymmetrical ascription of forces to colliding objects, that are conceptually incompatible withthe symmetry of Newtonian physics. We propose that human inference in physical scenarios operates over a pre-Newtonianphysical representation that is based on impetus intuitions. Impetus theories assume that object movements are caused by aninternal force, impetus, that is transferred and reflected when objects collide with each other. Moreover, impetus interactionsare inherently asymmetric. We present a mathematical model that implements impetus theory and show that the theory is wellsuited to model perceived causal asymmetry. Moreover, the theory can also explain phenomena that so far have been presentedas unique evidence for (noisy) Newtonian representations.