The pace of AI development continues to be nothing short of astounding. We’re witnessing breakthroughs that are not only powerful but also incredibly efficient, thanks to innovations like QLoRA.
QLoRA enables users to train new models on Colab, resulting in models which are „reaching 99.3% of the performance level of ChatGPT while only requiring 24 hours of finetuning on a single GPU.“
To be honest, I had anticipated developments of this caliber much later – perhaps in about seven months from now. This underscores the profound impact of exponential growth in technology. It’s increasingly difficult for those of us in the innovation business to track progress and form accurate hypotheses accordingly.
Elon Musk’s expectation of Artificial General Intelligence (AGI) arriving sooner than many thought possible might not be too far off, given this current trajectory.
A special shout-out to:
- Moritz Laurer and Christopher for the Huggingface reference via LinkedIn.
- Itamar Golan for the enlightening Twitter post.