Ministers vow Boris Johnson will not seek delay as he sticks to Brexit plan