Fannie and Freddie fee could push homeowners off the fence