If the pump is supplying water to a toilet, the toilet stop valve may be leaking. Turn off the pump water supply to the toilet. Did this fix the problem?