This paper presents a project evaluation framework for capacity building ICT projects, and describes an action research initiative in which the framework was piloted. The framework is a five stage process that draws on soft systems thinking and best practice in areas like ICTs for development and information systems evaluation. The action research was a collaborative undertaking between the author and an international non-governmental organization, and involved a project to develop information management solutions for four non-governmental organizations in Armenia.