Contact tracing mobile applications have been emerging as potentially automating surveillance technology to help stem the spread of the novel coronavirus (SARS-COV-2) by tracking individuals and those they come into exposure with. The avalanche of these apps left the software security researchers' with concerns about vulnerabilities in hastily written software. On the other hand, the COVID-19 pandemic has motivated the recent interest of leveraging blockchain for healthcare-related scenarios, including proposing and developing blockchain-based contact tracing apps. Utilizing the cryptographic concepts of blockchain to secure the collected data could help in winning the level of public engagement required to fight the spread of COVID-19. But will blockchain be a panacea to all the challenges accompanying these apps? Motivated by answering this question and following a twofold process, this paper: (i) explores the current landscape of contact tracing mobile apps, (ii) examines how blockchain technology can contribute positively to this landscape, and (iii) reports on the technical and social challenges that still accompany the deployment of blockchain-based contact tracing apps.