It appears you have not yet registered with our community. To register please click here...

 
Go Back [M] > Madshrimps > WebNews
Intel Optimizes PyTorch for Llama 2 for Arc A770 GPU, Uses Higher Precision FP16 Intel Optimizes PyTorch for Llama 2 for Arc A770 GPU, Uses Higher Precision FP16
FAQ Members List Calendar Search Today's Posts Mark Forums Read


Intel Optimizes PyTorch for Llama 2 for Arc A770 GPU, Uses Higher Precision FP16
Reply
 
Thread Tools
Old 26th February 2024, 07:57   #1
[M] Reviewer
 
Stefan Mileschin's Avatar
 
Join Date: May 2010
Location: Romania
Posts: 148,738
Stefan Mileschin Freshly Registered
Default Intel Optimizes PyTorch for Llama 2 for Arc A770 GPU, Uses Higher Precision FP16

Intel just announced optimizations for PyTorch (IPEX) to take advantage of the AI acceleration features of its Arc "Alchemist" GPUs.PyTorch is a popular machine learning library that is often associated with NVIDIA GPUs, but it is actually platform-agnostic. It can be run on a variety of hardware, including CPUs and GPUs. However, performance may not be optimal without specific optimizations. Intel offers such optimizations through the Intel Extension for PyTorch (IPEX), which extends PyTorch with optimizations specifically designed for Intel's compute hardware.

https://www.techpowerup.com/319576/i...precision-fp16
Stefan Mileschin is offline   Reply With Quote
Reply


Similar Threads
Thread Thread Starter Forum Replies Last Post
Intel releases new GPU graphics driver for the Arc A770 and Arc A750 Stefan Mileschin WebNews 0 21st November 2022 06:29
Intel's Arc A750 and A770 GPUs glitches are annoying Stefan Mileschin WebNews 0 21st October 2022 08:16
Intel Arc A770 and A750 available worldwide as of today Stefan Mileschin WebNews 0 14th October 2022 09:50
Intel Arc A770 Tested with PCIe 3.0 and Resizable BAR Off @ TechPowerUp Stefan Mileschin WebNews 0 6th October 2022 07:11
Intel Arc A770 @ TechPowerUp Stefan Mileschin WebNews 0 6th October 2022 07:10
Intel Arc A750 & A770 Unboxing & Preview @ TechPowerUp Stefan Mileschin WebNews 0 3rd October 2022 07:46
Intel officially launches the Arc A770, coming October 12 Stefan Mileschin WebNews 0 29th September 2022 09:27
Intel's mid-range Arc A770 GPU arrives October 12th for $329 Stefan Mileschin WebNews 0 29th September 2022 08:43
Intel Arc A770 matches or beats RTX 3060 at ray tracing Stefan Mileschin WebNews 0 2nd September 2022 07:41
Possible Intel Arc A770 spotted in Geekbench Stefan Mileschin WebNews 0 19th April 2022 04:23

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


All times are GMT +1. The time now is 10:26.


Powered by vBulletin® - Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO