One rule of thumb to consider when refinancing is whether you can reduce your current mortgage rate by at least one percentage point.