• hendrik@palaver.p3x.de
    link
    fedilink
    English
    arrow-up
    4
    ·
    7 hours ago

    What kind of AI workloads are these NPUs good at? I mean it can’t be most of generative AI like LLMs, since that’s mainly limited by the memory bandwith and at this point it doesn’t really matter if you have a NPU, GPU or CPU… You first need lots of fast RAM and a wide interface to it.