AI is quickly turning into an integral a part of day by day life. Samsung Electronics’ “AI for All” imaginative and prescient focuses on offering customers with enriching AI experiences all through their day by day lives by setting a brand new commonplace for next-generation units with AI-powered cellular units, TVs and residential home equipment.
Central to Samsung’s AI improvements is on-device AI. This know-how permits AI to function independently inside the machine and doesn’t require a server or the cloud. Users profit from fast AI response instances without having a community connection, lowering considerations over private knowledge leakage.
On-device AI has now developed past easy capabilities to deal with calls for requiring huge quantities of knowledge — akin to generative AI — utilizing solely the machine’s inside sources.
Samsung Newsroom explores how Samsung is main the world in on-device AI improvements.
No Cloud Required: Transforming the On-Device AI Experience
Citing the necessity for pace and safety, a lot of the tech trade has centered on working complicated generative AI in an on-device surroundings. With long-term investments that date again greater than a decade, Samsung has already custom-made AI options for a lot of of its units and positioned itself entrance and middle in offering on-device AI experiences for on a regular basis life.
Samsung’s Galaxy AI, for instance, presents on-device capabilities throughout the corporate’s newest cellular units and tablets.1 Now supporting a complete of 20 languages,2 Galaxy AI permits communication with out language limitations together with real-time dialog interpretation in addition to message and net web page translation.
For TVs, Samsung leverages its experience as a worldwide chief available in the market to coach AI fashions. Since 2020, the corporate has repeatedly enhanced its TV-specific processor with a built-in NPU (neural processing unit). The 2024 Neo QLED 8K mannequin’s NQ8 AI Gen3 processor options 512 neural networks for enhanced picture and sound high quality. By analyzing and modifying pixels, frames and sound sources, the processor delivers superior upscaling, easy movement and clear dialogue for a seamless viewing expertise in all conditions.
The key to on-device AI is minimizing mannequin measurement whereas sustaining efficiency. To obtain this, Samsung has centered on environment friendly implementation whereas using specialised AI coaching knowledge tailor-made to particular duties.
▲ Sunmin Kim and Cheulhee Hahm, Master, Visual Display Business, Samsung Electronics clarify on-device AI.
Smaller and Faster: Samsung’s AI Optimization Research
As AI know-how advances and knowledge processing necessities improve, mannequin optimization has develop into essential. In different phrases, high-performance AI fashions should have the ability to function effectively inside the limits of the units’ sources — together with their processors, reminiscences and batteries — whereas retaining efficiency ranges and reliability for day by day use. Key applied sciences for this embody mannequin compression, {hardware} optimization and knowledge processing acceleration.
Samsung has secured varied applied sciences within the subject of mannequin compression to scale back the scale of AI fashions. The firm has succeeded in creating gentle and quick AI fashions by way of strategies like quantization, which reinforces response pace by simplifying algorithms and optimizing computation processes; pruning, which removes non-essential parts of a bigger mannequin; and information distillation, which transfers information from giant fashions to smaller fashions.
Samsung additionally continues to innovate in {hardware} optimization and knowledge processing acceleration to swiftly and effectively run AI. For instance, flash utilization know-how partitions giant AI fashions and considerably reduces reminiscence utilization. Additionally, the corporate has developed patented know-how that’s anticipated to help fast inference on low-end units with out an NPU to broaden AI functions throughout…
