ModelsMedium importance
Edge0 open-sources Edge0-145B, a 145-billion-parameter model built to run on a laptop with 29 GB of memory
Edge0 released Edge0-145B and Edge0-120B as open source, together with the inference framework and deployment tools. According to the company, Edge0-145B runs on a compatible laptop, such as a MacBook Pro, with peak memory of 29 GB, generates more than 80 tokens per second, processes more than 1,100 tokens per second when reading the prompt, draws about 120 W and accepts 128,000 to 256,000 tokens of context. It works on macOS, Windows and Linux, on Apple M-series chips and NVIDIA RTX cards. Edge0 says the model plans, writes and runs code and checks the result, and that in coding, reasoning and instruction following it comes close to some frontier cloud models; the numbers are the company's own.
Published in edition no. 27 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese
Original source
https://edge0.ai/blog/introducing-edge0-145b-frontier-ai-capabilities-on-your-own-computer