Bangalore, January 30, 2024 — At the forefront of technological innovation, the 2024 IESA Vision Summit witnessed a groundbreaking keynote by Sid Sheth, CEO of d-Matrix. His presentation not only shed light on the burgeoning field of generative AI but also underscored India’s pivotal role in this global tech revolution.
India’s Economic Leap with AI
- A Trillion-Dollar Opportunity: Research indicates that generative AI could bolster India’s GDP by a staggering $1.2 trillion by FY30. This growth is mirrored in the burgeoning startup ecosystem, boasting 102 unicorns and attracting $65 billion in foreign investments.
- Government’s Vision: The Ministry of Electronics and Information Technology (MeitY) is not just observing but actively shaping this future. Initiatives like Project Bhashini aim to democratize digital advancements, ensuring widespread access and collaboration.
Tackling Generative AI’s Challenges
- The GPU Dilemma: Current AI applications, like ChatGPT, rely heavily on GPUs. These are not only expensive but also energy-intensive, contributing to a significant carbon footprint.
- The Need for Sustainable AI: To truly democratize AI, it must be made sustainable and affordable. This calls for a specialized solution, tailored for AI inference, balancing performance with power efficiency.
Also Read: Godrej & Boyce Celebrates India’s Diverse Strengths in New Video
d-Matrix’s Game-Changing DIMC Solution
- Revolutionizing Memory and Compute: d-Matrix’s DIMC solution addresses key challenges in memory bandwidth and computational needs during AI inference.
- Benchmarking Success: The Jayhawk 2 solution from d-Matrix boasts a 150 TB/s throughput in memory bandwidth, a quantum leap from the 3-4 TB/s offered by current High Bandwidth Memory (HBM) in GPUs.
- Enhanced Performance Metrics: The solution offers a 13-27x improvement in total cost of ownership compared to GPUs, alongside a 20x increase in power efficiency, reduced latency, and higher memory bandwidth.
d-Matrix’s Global Footprint and Opportunities
- A Global Leader from Silicon Valley: With $160 million in funding, d-Matrix is not just a local hero but a global pioneer, with design centers in Bengaluru, Sydney, and Toronto.
- Expanding Horizons: The company is scaling up, moving to larger facilities, and is on a hiring spree, offering a plethora of opportunities for tech enthusiasts.
d-Matrix’s innovations represent not just a technological leap but a significant economic opportunity for India. As the nation embraces AI, it stands on the brink of an unprecedented era of growth and innovation.
About d-Matrix
d-Matrix is a leading supplier of Digital In-Memory Computing (DIMC) solutions that address the growing demand for transformer and generative AI inference acceleration. d-Matrix creates flexible solutions for inference at scale using innovative DIMC circuit techniques, a chiplet-based architecture, high-bandwidth BoW (chiplet) interconnects and a full stack of machine learning and large language model tools and software. Founded in 2019, the company is backed by top investors and strategic partners including Playground Global, M12 (Microsoft Venture Fund), SK Hynix, Nautilus Venture Partners, Marvell Technology and Entrada Ventures.
