This will involve adding a command-specific keymap to the minibuffer call that reads the buffer name.

C-k is the natural binding for this action, following the emacs convention. We lose the default kill-line
binding in this case, but when was the last time you wanted to use kill-line while switching buffers?