I love this thing. Check your values carefully.
The first stage is not just be a buffer, especially with the interaction of the load control. You must have something wrong, I dare say.
I found the fuzz knob very useful, and that particular tone control (I left that out of mine when I breadboarded it) is designed to be fairly wide ranged in both directions, neutral in the middle. The values are not the same as a BMP, as it is designed to be 'flat' in the center with no mid scoop with the 'body' control at full. The typical BMP is very bass shy on one side and very dark on the other, with a fair mid dip.
I don't find the circuit buzzy, especially if using the toggle switch tastefully, even with clean fender amps (though I think all fender bright switches should be neutered). It's one of the most jaw dropping fuzzes I've ever tried...if only I could get around to finalizing it...someday.
Keep the Bias and Gain trims at 1/2. Give it another look over. And another.
Use your breadboard and compare. Strip it down to the basic circuit, even -- load, fuzz, volume and you can plug in/out caps at the end to taste...sub a 1K for the 'bias' and 470R for the gain trimpots. Elminate everything between C8 and R11. Then you can know the range of tones it should start with, and if's your build, or just the other gear you are using it with that may be the issue...just one more reason why I think it's always best to breadboard everything first...