Article doesn’t mention this, but I’d consider neural networks a form of branchl...

david-gpu · 2025-09-28T19:43:51 1759088631

> It’s all a bunch of multiply and threshold operations.

Real-world high-performance matrix multiplication functions do contain branches internally, even on GPUs. If you are ever curious about what that looks like, NVidia maintains an open-source library called CUTLASS.

abyesilyurt · 2025-09-28T18:09:38 1759082978

Thresholding requires branching no?

WJW · 2025-09-28T18:32:45 1759084365

No, you can do that without branching. See https://en.algorithmica.org/hpc/pipelining/branchless/#predi... for example.

bqmjjx0kac · 2025-09-28T20:05:15 1759089915

As demonstrated in the article, you can compute clamp(x, min, max) with straight-line code.

Legend2440 · 2025-09-28T18:33:33 1759084413

No, it’s just a math operation and can be applied to any amount of data in parallel.