I have a USD account in Canada and one in the States, but when I withdraw cash from one to put in the other, QBO always converts it to C$, throwing off the amounts, help?

Are you setup with multi-currency?  If so, you should be able to record it as a transfer in USD.  Do note though that there is a difference in value based on exchange rate if your company books are in CDN since the exchange rate changed between days.  This should be represented as a different CDN balance on your books (though it will be registered as $50 USD) as well as a gain/loss on exchange, particularly after you perform a revaluation on your books.