You're saying that drugs cannot easily be bought with government-issued cash? It's totally the other way around: drugs are easily and frequently bought using cash, and vanishingly rarely bought with bitcoins.
I would consider the Silk Road to be fairly large. Obviously, it's tiny relative to the entire USD drug market, but bitcoin is also tiny relative to USD. But the point is, you simply cannot deny that there is actual demand for bitcoins caused by the fact that the Silk Road only uses bitcoin.