Nvidia shows interest in smaller AI models that run on local hardware

In February, Nvidia acquired OmniML, a two-year-old AI startup known for developing software that compresses machine learning models to run seamlessly on devices instead of in the cloud.

The acquisition could signal Nvidia's intent to improve its AI chips for cars, industrial robots, and drones, and potentially shrink the size of AI software to allow chatbots to run on devices instead of data centers. OmniML has demonstrated significant improvements in model performance and cost savings across multiple industries, running machine learning tasks 10 times faster on a variety of hardware devices. The acquisition is confirmed by the startup's LinkedIn profile and The Information.