WhatsApp publicly stated[1] in testimony before the Brazilian Congressional Committee on Cyber Crimes in December 2015 that they do not, and have not ever, retained the content of communications—regardless of E2E or not. Apparently, WhatsApp only retains messages until they are delivered.

[1] http://www2.camara.leg.br/atividade-legislativa/comissoes/co...