You might consider experimenting with a removable brace, instead of just cutting it out. The job it performs is to make certain the left and right fork legs compress at the same rate. If you are going downhill, and you hit a hard bump at an angle, it may be possible for there to be much more force applied to one side, compared to the other.
The leverage involved between the bottom of the wheel and the axles could bend the wheel assembly to the side hard enough that the axle may bend a small amount, or the fork-ends might crack/bend. At best you would have a wobbly ride after that point, at worst a complete wheel/fork failure leading to a crash.
I'm not saying you shouldn't try this. I'm suggesting that you first try it on a frame you can afford to damage the front wheel and fork, and perhaps to start with a removable brace first.