Abstract: | Despite the high ambitions of the e-government programs, which are in progress in many countries, aiming at the development of highly complex information systems in public administration, the reality is quite different: many failures of information systems (IS) projects, and especially of the largest ones, are reported, which result in waste of huge financial resources, loss of opportunities, disappointment of the public and heavy criticism by the press. If these failures are not drastically reduced, the progress towards e-government, and in general towards the ‘information society’, will be significantly retarded. Appropriate evaluation of these IS projects can highly contribute to the reduction of these failures and to the increase of the benefits from the IS of public sector. However, although extensive theoretical research has been conducted in the area of IS evaluation, which has analyzed its inherent difficulty and complexity and has produced several IS evaluation directions and frameworks, only limited research has been conducted towards their practical application in large and complex ‘real-life’ projects. In the present paper is analyzed the experience gained from the evaluation of a complex inter-organizational G2G collaboration support environment, which has been developed in the ICTE-PAN project of the IST Program of the European Union. We present a user-driven evaluation methodology, which has been developed for this purpose, based on the ISO/IEC 14589 and ISO/IEC 9126 standards. Also we analyze the application of this methodology for the evaluation of the above large inter-organizational IS by the user-partners of this project, its results and also the conclusions drawn from the whole evaluation process. |