The fee isn't negligible, and I don't think we can arbitrarily lower it and also make all tx's use it without doing a really thorough security review. Also, remember the fee is per input. If you try to use InstantSend from a PrivateSend balance with dozens or hundreds of inputs, RIP.