This paper describes a belief updating technique based on relevance reasoning that is applicable in practical systems in which observations are interleaved with belief updating. Our technique invalidates the posterior beliefs of those nodes that depend probabilistically on the new evidence or the revised part of the model and focuses the subsequent belief updating on the invalidated beliefs rather than on all beliefs. Very often observations and model updating invalidate only a small fraction of the beliefs and our scheme can then lead to substantial savings in computation. We report results of empirical tests for incremental belief updating when the evidence gathering is interleaved with reasoning. These tests demonstrate the practical significance of our approach.