Cancel
See Linkedin
About Yulong Liu
Yulong Liu, founder of Empower, launched its public beta on February 15, 2024, introducing a high-performance LoRA inference engine that outperforms competitors in throughput and latency while being significantly cost-effective.
Known information
Yulong Liu is the founder of Empower, a company recognized for its innovative LoRA inference engine developed using Rust. On February 15, 2024, Liu announced the public beta launch of Empower, marking a significant milestone in the field of machine learning deployment. Empower’s engine has been rigorously benchmarked against competitors such as AnyScale, Modal, vLLM, and LoraX, demonstrating superior performance with higher throughput and lower latency in various query per second (QPS) scenarios. Notably, Empower’s cold start time is over 80% faster than its competitors, and it offers a cost reduction of 80% to 90%. Additionally, the platform supports importing models from Hugging Face and is compatible with any PEFT-based LoRA models, ensuring flexibility for users. A key feature of Empower is its commitment to user autonomy, allowing clients to retain ownership of their models without vendor lock-in.
About Empower
Empower, formerly known as LogUnify, is a serverless LLM hosting platform based in San Mateo, CA, specializing in cost-effective deployment of fine-tuned models with a focus on B2B analytics.
Report inaccurate information
