Study shows importance of evaluating mHealth programs
One the biggest issues in mHealth and mobile campaigning in the developing world is the lack of evaluation. Well, the Lancet published an article last week that measured the effectiveness of mobile phone text message reminders on Kenyan health workers’ adherence to malaria treatment guidelines.
What the study found was that text messages can be a cost effective way to improve the care for malaria treatment in African children. Even though the study focused on malaria treatment, the results of the study suggest that using text messages can be an effective weapon to fight many different health burdens with.
According to the study, half of children received the correct treatment at the end of the study, more than double the starting figure. At the beginning of the study, 20.5% of children were correctly managed, this increased to 49.6% after the six month study.
The effect appeared to persist after the texts stopped. Six months after the trial ended, 51.4% of children were receiving the correct treatment due to the text messaging.
Professor Bob Snow, who headed the research group, said, “The role of the mobile phone in improving health providers’ performance, health service management and patient adherence to new medicines across much of Africa has a huge potential.”
Despite the positive numbers, the authors acknowledge that “we do not fully understand why the intervention was successful”. They speculate that the presence of the texts themselves serve as a reminder and reinforce the importance of the message itself.
One of the conclusions in the study is that “text-message reminders should be used to complement existing interventions—which themselves should be qualitatively improved—to target weak points” in health management practices.
The study however, sheds light on the importance of evaluating an mHealth campaign. Through evaluations, stakeholders can figure out whether a program is meeting its goals and how much of an impact it is making on the health issue it was designed for.
Currently in the developing world, numerous mHealth programs are being implemented on a small scale basis without monitoring and evaluation components. This not only leaves the project unfinished, but it is irresponsible as well. If a given program is appropriate to scale up to a wider population, we would never have the statistics to prove it. Then again, that hasn’t stopped NGO’s and governments before.
Evaluating mHealth programs is not a complicated task. Perhaps stakeholders are afraid to discover that their programs are not actually producing the impact they envisioned in the board room. This study has shown that positive results can indeed manifest from text messaging campaigns, and it is worthwhile to evaluate such campaigns.
The world needs to know what works and what doesn’t for the sake of the populations that are supposed to be the beneficiaries of the programs they are involuntarily thrown into. Otherwise, stakeholders are shooting in the dark with the well-being of innocent people.