Research impact is often hard to prove. It takes years before our findings change the world and the change is often small. This new abstract published in the Trials journal summarizes a poster presentation from the conference of the Core Outcome Measures in Trials (COMET) Initiative. This year the conference was in Calgary, Canada, on May 20-21.
Cite this article as: Klimas et al.: Reducing drinking in concurrent
problem alcohol and illicit drug users: an impact story. Trials 2015
16(Suppl 3):P11. doi:10.1186/1745-6215-16-S3-P11
- Health services research
- Qualitative and mixed methods
- Systematic and non-systematic reviews of literature
- Training and education
Researching primary health in worsening economic situation is becoming increasingly difficult. Through pooling our resources we can make it easier and more effective.
Interested in knowing more about how whales form groups in nature compared to captivity?
check out: http://blackfishmovie.com/
3.6% response rate? Shocking! For our new feasibility study, we sent over 200 invitations to primary care doctors in Ireland and the invitees sent us back a very strong signal. “We are not interested”, or “we are too busy”, or “we don’t have enough eligible patients”? Whatever the reason, the message remained the same: No, thanks.
Power in research experiments is about finding the truth. Experimenters want to know whether their drugs or treatments work. If the drug or treatment works and they give it to a group of people, some of them will improve, some won’t. There’s a lot of chance and uncertainty in any drug or treatment administration. If we want to know the truth beyond the effects of chance, we need to give the drug or treatment to the right number of people. There’s a formula for it, known to most statisticians. It depends on many things, like the size of the improvement that you want to observe in the treated group, or other confounding factors. The higher power in a study, the more likely it says true (see, e.g., Dr Paul D Ellis’, PhD site here).
A rule of thumb says that the more people are in the study, the higher the chances of finding a meaningful impact of the intervention. Common sense also tells us that the more people in the trial, the more representative they are of the whole population – the more confidence you can be that your results apply to all; except for Martians – unless you really want to study Martian citizenship.
The easiest would be to call some friends, doctors, and ask for a favor. This should work, but it’s not really scientific. Or you can shut down the study and conclude that it’s not feasible. Or you can do the study with the small number of interested participants. Or you can send another mailshot, a reminder, to all – sometimes that can help.
Clinical trials use elaborate methods to make sure that everybody does the exact thing as they planned. Measuring treatment fidelity is checking the agreement between study plan and practice. Some health problems require complex changes. How to measure fidelity in trials of complex interventions? Here are some ideas for fidelity checking.
Fidelity in our PINTA study
Guidelines for primary care providers to manage problem alcohol use among problem drug users
- Scripted curriculum for the group training of providers
Booster session (practice visits) to prevent drift in provider skills
- Access of providers to research staff for questions about the intervention
Instructional video of patient–doctor interaction to standardize the delivery
- Cards with examples of standard drinks and scripted responses – to standardize the delivery
- Question about patient scenario in follow-up questionnaires (telephone contact)
SBIRT checklist for providers (process measure)
- Pre- and post training test (knowledge measure)
- Patient follow-up questionnaire will check whether each component of the intervention was delivered
Measuring fidelity in trials of complex interventions is important. It is not technically demanding. Ultimately this becomes a question of personal development and credibility – willingness to have one’s skills analysed and improved is the basis of reflective practice.
the screening and treatment processes should be more systematic and proactive in all problem drug users, especially in those with concurrent chronic illnesses or psychiatric co-morbidity,
lower thresholds should be applied for both identification and intervention of problem alcohol use and referral to specialist services,
special skills and specialist supervision is required if managing persistent/dependent alcohol use in primary care.