Transforming AI through Hardware-Software Codesign for Gen AI Inference
November 13, 2024
d-Matrix Blog
Featured
How to Bridge Speed and Scale: Redefining AI Inference with Ultra-Low Latency Batched Throughput
Recent breakthroughs in Reasoning AI have shifted focus towards scalable inference-time compute. Enterprises want to leverage these AI advancements to deliver real-time, interactive user experiences while also serving a vast… Read More
February 27, 2025
The Complete Recipe to Unlock AI Reasoning at Enterprise Scale
Impact of the DeepSeek Moment on Inference Compute
Think more vs. Train more
D-Matrix Targets Fast LLM Inference for ‘Real World Scenarios’
Next-Gen Techniques for AI Inference from d-Matrix Spotlighted at NeurIPS
Forget GPUs, d-Matrix uses DIMC to win AI Inference
Trending
How to Bridge Speed and Scale: Redefining AI Inference with Ultra-Low Latency Batched Throughput
Impact of the DeepSeek Moment on Inference Compute
The Complete Recipe to Unlock AI Reasoning at Enterprise Scale
Transforming AI: d-Matrix’s Pivotal Moments in Pursuit of Gen AI Inference At Scale
Transforming AI through Hardware-Software Codesign for Gen AI Inference
Featured Video
The DeepSeek Moment
In this short talk, d-Matrix CTO Sudeep Bhoja discusses the release of the Deep Seek R1 model, highlighting its impact on inference compute. He discusses the evolution of reasoning models and the significance of inference time compute in enhancing model performance.
Learn more about d-Matrix
