Meta Opens Local AI

Menlo ParkMeta gave away a 30-billion-parameter AI model.

It runs entirely on a personal computer, so prompts never reach Meta’s servers.

Small enough for one consumer GPU, it was distilled from a larger teacher model under Meta’s Apache license.

Integrations with llama.cpp, MLX and ExecuTorch are due in the coming days.

Sources: Hacker News