-
Pre-training multi-billion parameter LLMs on a single GPU with Flora - RBC Borealis
First, we show how to incorporate Flora into code. Second, we give a high-level overview of how Flora works. Third, we provide benchmark training results. Finally, we compare Flora to the subsequent and closely related GaLore method.
-
Causmos: Machine Intelligence beyond Predictive ML - RBC Borealis
With the Causmos program at RBC Borealis, we aim to build machine intelligence beyond predictive ML for financial services by conducting research in areas such as causality, out-of-distribution (OOD) generalization, reasoning and planning in large language models (LLMs) and reinforcement learning.
-
Just a moment...