When you disconnect, a quit message is shown to other users. You can customize this message.
Setting a Quit Message
Use /quit Your message here
to disconnect with a custom message, or configure a default quit message in the Options dialog.
Default
If no custom message is set, the default message is "Leaving".