Moreh

Moreh, established in 2020, is a company specializing in the development of the MoAI platform, a comprehensive infrastructure software designed for the LLM (Large Language Model) era. The platform spans from PyTorch to GPUs and supports AMD ROCm, with plans to incorporate additional accelerators. Headquartered in Santa Clara, CA, Moreh also has offices in Seoul and Hanoi. The company has raised a total of $30 million in funding, including $22 million in Series B funding. The MoAI platform is currently powering over 2,000 GPUs for commercial IaaS/PaaS clouds and on-premise LLM training systems. Notably, Moreh trained the largest-ever Korean LLM, featuring 221 billion parameters, on a 1,200 AMD MI250 GPU cluster. The platform facilitates the programming and scaling of models with billions or even trillions of parameters and includes a virtualization layer for GPUs, enhancing utilization and providing failover capabilities. KT has utilized the MoAI platform to train large AI models and address challenges in public cloud services.