Kompact AI, a collaboration between IIT Madras and Bengaluru-based startup Ziroh Labs, has claimed a significant breakthrough in artificial intelligence by enabling large language models to ...

Ziroh Labs, a US-based AI startup, in collaboration with the Indian Institute of Technology, Madras (IIT Madras), has unveiled Kompact AI, a system designed to run large AI models using CPUs ...

IIT Madras and Ziroh Labs have unveiled the first version of Kompact AI, a platform designed to build and run foundational AI models using CPUs. The platform is intended to align with India’s ...

Kompact AI aims to facilitate this process using less expensive central processing units (CPUs), which are widely available on consumer devices like laptops and computers.

Kompact AI enables models to be deployed over CPUs without sacrificing quality and at least 3x performance than the current state of the art, thereby providing GPU-like scale and speed.

Kompact AI offers a library of pre-optimized AI models, covering text, speech, images, and multimodal applications, all designed to run smoothly on CPUs. 6 min read 5 May 2025 Technology ...

Kompact AI can play a transformative role as it leverages multiple optimisations algorithmically and implementation-wise to execute models on the low end without any support required for external ...