Yes and no. There are countries that use USD as well as their own currencies. Often the banks offer much better rates than any US bank. Part of that is the risk of the bank collapsing, or the government confiscating deposits, introducing windfall taxes, etc, but part of it simply reflects supply and demand - sometimes those banks find it hard to borrow internationally themselves, and are desperate for deposits.