Document Type : Original Article
Authors
1 Assistant Professor, Health Care Management, Medical Informatics Research Center, Institute of Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran
2 MSc Student, Health Economics, Research Center for Health Services Management, Institute of Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran (Corresponding Author) Email: leilazarei89@gmail.com
3 Health Care Management, Student Research Committee, Kerman University of Medical Sciences, Kerman, Iran
Abstract
Introduction: Evaluation of hospital information system (HIS) is a complex endeavor, in which all
human, technical and organizational aspects should be considered. This study aimed to develop indicators
for HIS evaluation.
Methods: Present qualitative study was carried out through a cross-sectional method in 2012 in Kerman
province, Iran, using Delphi technique. Given the objectives of this study, three independent phases were
performed including literature review, providing draft indicators for HIS evaluation and reaching
consensus. Required data were obtained through interviews and designed forms. Twenty-three experts
composed the study population in interview and reaching consensus phases. Validity and reliability were
confirmed through content validity and test-retest method, respectively. Data were analyzed using
descriptive statistics.
Results: Final set of indicators for HIS evaluation consisted of ninety-one indicators under 8 main topics,
i.e. technical quality, software quality, architecture and interface quality, vendor quality, after-sale services
quality, workflow support quality, support department, outcome quality and HIS cost.
Conclusion: Given the complexity of information system evaluation, all human, technical and
organizational aspects have to be taken into account in any evaluation. Proposed indicators provide the
possibility of comprehensive evaluation of HIS.
Keywords
management. Electronic Journal of Scientific Information and Documentation Center of Iran 2005; 3(4): 102-12.
[In Persian].
2. Anvari Rostami A. Understanding the basics of management information systems. Tehran, Iran: Tarahan,
Publication; 1996. p. 15-8. [In Persian].
3. Gray P. Manager's guide to making decisions about information systems. New Jersey, NJ; 2005.
4. Abdelhak M, Grostick S, Hanken MA, Jacobs E. Health Information: Management of a Strategic Resource -
ExaMaster. Philadelphia, PA: Elsevier - Health Sciences Division; 2001.
5. Azizi A, Hajavi A, Haghani Hamid, Shojaei Baghini M. Respect rate of hospital information system criteria of
American college of physicians in educational hospitals of Iran, Tehran, and Shahid Beheshti Medical Sciences
Universities. Health Information Management 2010; 7(3): 323-29. [In Persian]
6. Ghazi-Saeedi M, Davarpanah A, Safdari R. Health information management. 1st ed. Tehran, Iran: Mahan
Publication; 2007. [In Persian].
7. Hajavi A., Shahmoradi L. Problems in hospital information systems evaluation and solutions. Proceedings of the
1st International Conference on Information and Communication Technology Management; 2004 Jan 3-5;
Tehran, Iran; 2004. [In Persian].
8. Abdelhak M, Grostick S, Hanken MA, Jacobs EB. Health information: management of a strategic resource. 3rd
ed. Philadelphia, PA: Saunders/Elsevier; 2007.
9. Doreen N., Kayla G, Donald M, Mike B, Shelia T, Sandra C, et al. Toward an Evaluation Framework for
Electronic Health Records Initiatives [Online]. 2004; Available from: URL:http://www.hc-sc.gc.ca/hcssss/
pubs/kdec/nf_eval/index-eng.php/
10.Nirel N, Rosen B, Sharon A, Blondheim O, Sherf M, Samuel H, et al. The impact of an integrated hospitalcommunity
medical information system on quality and service utilization in hospital departments. Int J Med
Inform 2010; 79(9): 649-57.
11.Oroviogoicoechea C, Watson R. A quantitative analysis of the impact of a computerised information system on
nurses' clinical practice using a realistic evaluation framework. Int J Med Inform 2009; 78(12): 839-49. 12. Shortliffe EH, Perreault LE. Medical informatics: computer applications in health care and biomedicine. 2nd ed.
Berlin, Germany: Springer; 2001.
13. Shahmorad L, Ahmadi M, Haghani H. Defining evaluation indicators of health information systemsand a Model.
J Health Adm 2007; 10(28): 15-24.
14. Littlejohns P, Wyatt JC, Garvican L. Evaluating computerised health information systems: hard lessons still to be
learnt. BMJ 2003; 326(7394): 860-3.
15.Hamborg KC, Vehse B. Questionnaire Based Usability Evaluation of Hospital Information Systems. Electronic
Journal of Information Systems Evaluation 2004; 7(1): 21-30.
16.DeLone WH, McLean ER. The DeLone and McLean Model of Information Systems Success: A Ten-Year
Update. Journal of Management Information Systems 2003; 19(4): 9-30.
17. Kaplan B. Social interactions framework for information systems studies. In: Neville D, Kayla G, Donald MD, Mike
B, Shelia T, Sandra C, et al. Editors. Towards an Evaluation Framework for Electronic Health Records Initiatives: A
Proposal for an Evaluation. John's, NL: Newfoundland and Labrador Centre for Health Information; 2004.
18.Kushniruk A. Evaluation in the design of health information systems: application of approaches emerging from
usability engineering. Comput Biol Med 2002; 32(3): 141-9.
19.Yusof MM, Papazafeiropoulou A, Paul RJ, Stergioulas LK. Investigating evaluation frameworks for health
information systems. Int J Med Inform 2008; 77(6): 377-85.
20. Fedele L, Bianchi S, Zanconato G. Evaluating Health care Information Systems: Methods and Applications. In:
Blum BI, Editor. Information systems for patient care. New York, NY: Springer-Verlag; 1995. p. 427-37.
)