Nvidia Tensor RT 3 speeds up inferencing by 100X
 

4.8 FPS on CPU to 550 FPS on Volta

Nvidia has come up with a new optimized complier called Tensor RT 3 and demonstrated how Volta obliterates a modern server CPU.

The unnamed CPU was able to recognize the train network of flowers at 4.8 FPS. As Jensen pointed out humans would not be able to recognize most of the distinct flowers while CPU based system flawlessly recognized every single one.

http://fudzilla.com/news/graphics/44...encing-by-100x