I would argue that how you define the inputs, outputs, and architecture of a model is quite precisely providing a spec. That doesn't necessarily mean that any intermediary within the model is explainable, as you allude to, just as a spec doesn't specify how a feature gets implemented.