PROJECT METHODOLOGY 3

 Health Evidence Bulletins - Wales (logo)

Appaisal Checklists

Health Evidence Bulletins - Wales: Questions to assist with the critical appraisal of an interventional study without randomisation (Type III evidence)
Sources used: Critical Appraisal Skills Programme (CASP, Anglia and Oxford RHA) questions, NHS Centre for Reviews & Dissemination, Guidelines for those carrying out or commissioning reviews. CRD report No. 4, 1996. Polgar A, Thomas SA. Chapter 22. Critical evaluation of published research in Introduction to research in the health sciences. 3rd edition. Melbourne: Churchill Livingstone, 1995.

Paper details Authors:
Title:
Source:

A/ What is this paper about?

  Yes Can't tell No
1. Is the study relevant to the needs of the Project?      
2. Does the paper address a clearly focused issue?
Are the aims of the investigation clearly stated?		      

B/ Do I trust it?

  Yes Can't tell No
3. Have the authors reflected the current state of knowledge according to an unbiased review of the literature?
  • Has a sufficiently complete search of the relevant literature been carried out?
  • Is evidence included which is unfavourable to the authors' point of view?
      
4. Is the choice of study method appropriate?
  • Has an acceptable method been chosen (eg interventional without randomisation, before-and-after study)?
  • Are the inclusion/exclusion criteria given?
  • Is the choice of control group (if included) adequate?
      

Top

C/ What did they find?

5. Are tables/graphs adequately labelled and understandable? Yes Can't tell No
6. Are you confident with the authors' choice and use of statistical methods, if employed?      
7. What are the results of this piece of research?
Are the authors' conclusions adequately supported by the information cited?		      

D/ Are the results relevant locally?
  Yes Can't tell No
8. Can the results be applied to the local situation?
Consider differences between the local and study populations (eg cultural, geographical, ethical) which could affect the relevance of the study.		      
9. Were all important outcomes/results considered?      
10. Accept for further use as Type III evidence?   Refer to Team Leader  

Comments:

Draft Statement (if appropriate):
(Remember to include the relevant target group (age range, sex etc.); the measured outcomes/benefits with quantitative information if available; and the health gain notation)