2024 might be the breakout year for efficient ARM chips in desktop and laptop PCs.

  • sir_reginald@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    1
    ·
    10 months ago

    I’m just expecting performance optimisations, especially for local LLMs. Right now there are models as good as GPT-4 (Goliath 120B), but they require 2 RTX 4090 to run.

    The models that require less powerful equipment are not as good, of course.

    But hopefully, given enough time, good enough models will be able to run with mid end hardware.