Small models, big effects: AI that runs on your own machine
A model with a few billion parameters fits in the memory of an ordinary laptop once quantised. What it does well, what it does badly, and how to try it without installing anything exotic.
etiquette
A model with a few billion parameters fits in the memory of an ordinary laptop once quantised. What it does well, what it does badly, and how to try it without installing anything exotic.
Un modèle de quelques milliards de paramètres tient dans la mémoire d’un portable ordinaire, une fois quantifié. Ce qu’il fait bien, ce qu’il fait mal, et comment l’essayer sans rien installer d’exotique.