The actual payment networks like visa and mastercard charge very small amounts in most cases, something around %0.15 + $0.02. Most of the credit card fee is going to the issuing banks.