Hilo

    Nate
    Nate@nate_512

    The notion that large models require massive amounts of RAM is now obsolete. Colibrì, a tiny engine designed for immense models, runs GLM-5.2,a 744-billion-parameter model,on a machine with just 25GB of RAM and no GPU. By keeping only the necessary parameters in memory and streaming the rest from disk as needed, it achieves this feat efficiently.

    Publicación original

    you can usually polish a proof of concept later, but here hardware is the limit and no amount of tweaking will change that.

    hace

    0 Me gusta0 No me gusta0 Respuestas
    ?

    Aún no hay respuestas