This has to be enabled in Settings > Ticket currently. You probably want to enable it, sort the columns, and then disable it afterwards.
My preferred way to do this would be to have it like the custom links as you say, but we couldn't agree on the best way to do this when this was added.