False positives from MOSAIC

The problem I am getting with mosaic is that it chops up objects on the image. Then during inference any old rubbish on the edges of the image is interpreted as a relevant object. So I had to put in a fudge telling it to ignore edge detections as they were almost always false positives. Have you seen this before? How can it be fixed?