Delete Immediately. (You can assign a keyboard shortcut to it from System Preferences / Keyboard / Keyboard Shortcuts.

Alternately, use the Delete key, then Cmd-Shift-Option-Delete to empty the trash.

Me, I just use "rm" in the terminal.