So even though GPU time is more expensive and GPUs need specialized programming, for this particular problem they can’t be beat with raw CPU power, either in absolute or in $/ops measures.

Just putting a problem on a ton of cores is an absolutely valid strategy for problems that are a bad fit for GPUs.