| Thread Tools |
5th March 2024, 13:40 | #1 |
[M] Reviewer Join Date: May 2010 Location: Romania
Posts: 148,652
| IBM Announces Availability of Open-Source Mistral AI Model on watsonx IBM announced the availability of the popular open-source Mixtral-8x7B large language model (LLM), developed by Mistral AI, on its watsonx AI and data platform, as it continues to expand capabilities to help clients innovate with IBM's own foundation models and those from a range of open-source providers. IBM offers an optimized version of Mixtral-8x7B that, in internal testing, was able to increase throughput—or the amount of data that can be processed in a given time period—by 50 percent when compared to the regular model. This could potentially cut latency by 35-75 percent, depending on batch size—speeding time to insights. This is achieved through a process called quantization, which reduces model size and memory requirements for LLMs and, in turn, can speed up processing to help lower costs and energy consumption. https://www.techpowerup.com/319935/i...del-on-watsonx |
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
MIPS goes open source | Stefan Mileschin | WebNews | 0 | 20th December 2018 07:58 |
PhysX Goes Open Source | Stefan Mileschin | WebNews | 0 | 5th December 2018 15:08 |
Olimex Announces Their Open Source Laptop | Stefan Mileschin | WebNews | 0 | 6th February 2017 05:43 |
Minoca OS goes open source | Stefan Mileschin | WebNews | 0 | 3rd November 2016 10:26 |
Bulgaria goes Open Source | Stefan Mileschin | WebNews | 0 | 6th July 2016 13:43 |
TRENDnet Announces Open Source DD-WRT Compatibility for Wireless AC Routers | Stefan Mileschin | WebNews | 0 | 15th May 2014 08:49 |
BackupPC (Open Source) | Sidney | WebNews | 0 | 4th January 2008 14:04 |
How To Choose An Open Source CMS | jmke | WebNews | 1 | 25th January 2006 18:21 |
Open source, open wallet | Sidney | WebNews | 2 | 7th November 2005 15:53 |
Open Source Myths | jmke | WebNews | 0 | 26th July 2004 12:00 |
Thread Tools | |
| |