Please read this thread:
It really comes down to where your money is. If you put money into TSP, you expect a return on it.
If you take money out of TSP, it is no longer working for you in that capacity.
If you repay your loan at the rate of the "G Fund" then you are returning that money at under inflation rates. Also, it's your money you are repaying the interest which most people don't like.