I'm not sure if it's the speaker
or a bad power tube causing the buzz I am
hearing. Open low E is the worst and the
Buzz starts right away and gets gradually
better. If I hold the one el34 with
a cloth it mostly will go away.
Power tube, voice coil rub?
What do you think?

first what kind of amp u useing, is it single coil pickups on your guitar?
what kind of lighting you in is this sound loud
like when you touch the end of the guitar jack when its pluged in and amp. turned on?
could be a ground loop could be alot of things need more info. you useing pedals?

you said if you hold one power tube it mostly goes away you could have a cracked restor on the back of the tube socket, hey hey take it in to see a tech. at the music store

Thanks Michael, what is the restor and what
does it look like. I put in a new set of
power tubes and the noise is mostly gone.
The problem is my house vibrates when I
turn it up, so it's hard to decipher if there
is still something there. When I turn it
up it seems like the whole amp vibrates
at certain pitches.

Try swapping the 1st (V1) preamp 12AX7 for another. If it's a custom amp, ask your manufacturer for a tube spring retainer to put on the EL34s. I had this same problem once and this fixed it. I think this is why I moved on to heads vs combos.
If you have an extra cab around -run the speaker cable to it and see if the buzzing stops.