From train-time to inference-time compute Scaling laws are moving beyond pre-training to post-training and test-time scaling. Reasoning language models like OpenAI o1 and o3 are engineered to emulate human-like problem-solving.…Read More
In this talk, d-Matrix CTO/Cofounder Sudeep Bhoja discusses the impact that the release of the Deep Seek R1 model is having on inference compute. Stepping through the evolution of reasoning…Read More
Transformers-based large language models (LLMs) have emerged as the underpinning architecture for modern natural language processing. Today, the at-scale deployment of generative AI is gated by the prohibitive cost of…Read More
AI Inference is on an unsustainable trajectory The arrival of ChatGPT in 2022 caught the world’s imagination around AI – and there has been no looking back. The discussions have…Read More
You’ve probably heard the adage, “hardware is hard.” That’s definitely true. When you’re making chips for the rapidly changing world of AI, things really get hard early on. The AI…Read More
