The COVID-19 outbreak stimulated an outbreak of online learning in many institutions in Sub-Saharan Africa. Educational institutions went beyond fighting the COVID-19 through social distancing norms to tackling Sustainable Development Goal Four (SDG 4) with the adoption of online learning as the new modality for instruction. Online learning has the propensity to ensure learners from all geographical regions have access to education, thereby addressing the inequalities in education. However, the disparities in the access to digital infrastructure had a negative impact on the online instruction in Sub-Saharan Africa. The online learning experienced is best described as a “challenge-ridden online learning” with many teachers suffering from burnout and students lamenting on limited ICT resources, inadequate access to affordable and reliable internet, power outages, and anxiety over academic outcomes. Despite the challenges, the COVID-19 has presented a silver lining to online learning in Sub-Saharan Africa. Aside the attempt to massify online learning, many institutions have come up with novel technological innovations and inventions to bridge the digital divide in the region. The review gives an overview of the challenges, prospects, and practical implications of online learning in Sub-Saharan Africa.