I have done the VehicleExitEvent and pet.removerider but is there a way so it does not send the player a message saying that he has stopped riding his pet?

EchoPet listens to VehicleExitEvent to send that message. You would have to override this to stop the message being sent.

Alternatively, you could listen to EchoPetSendMessageEvent