A new hardware system intended for running artificial intelligence systems has been created by Microsoft. Its Brainwave system enables machine learning models to run with high speeds and low latency. Using the Intel Stratix 10 FPGA, it can reach a sustainable 39.5 Teraflops on a large gated recurrent unit without batching, making it possible to get real-time insights from the AI models.
FPGAs (field-programmable gate arrays) have been a focus of Microsoft’s for a while. Machine learning algorithms can be written into them and they’re both programmable and efficient.
This kind of specialized system allows for superior performance than what’s attainable with regular CPUs and GPUs.
