Inferact: Building the Infrastructure That Runs Modern AI
The founders of Inferact discuss the challenges of AI infrastructure, the development of the open-source project vLLM, and their goal to create a universal inference layer for running AI models across diverse hardware environments.