Before I grill I always turn it up on high for about 10 minutes
to burn off the old grease. Every once in a while though, the
grill flares up inside and keep going even when I cut off the gas.
Needless to say I put the grill further away from the house.

Is this just common to Webers? My old cheapy grill never did this.