There are international standards that define a standard of quality assurance for educational institutions. These criteria consist of several aspects and each aspect has specific conditions and requirements. Each requirement has specific weight. there is a minimum degree to accept the sobriety of the educational institution.
In our Ministry of science and Technology (MoST), we have so many research centers, Chemistry, Physics, water treatments, Energy, electronics & communications, agriculture, ete etc. Our planning & follow-up Directorate started to establish a policy to assess/ evaluate the performance of these centers.
These centers consist of so many PhD's & MSc's & researchers. They work on research and development projects.
Dear Hazim: There are three main databases known to give the order of research institutes after evaluating their research number and quality. these databases are 1-web of science (can be accessed from iraqi virtual science library) 2-scopus 3-researchgate.
Dear Mudar, Thanks for your reply. We are trying to create an application forms depending on the following criteria:
Norms, indications, Measurement weights, impact assessment , etc.
ResearchGate can assess/evaluate the performance of research centers/institutes by the performance of their members, but for example a member can score just by putting questions and answering other's questions- here is an example : See this person "Joachim Pimiskern " , he has RG Score of 166.87!!!!!!
Can you see what I mean, ie RG scores depends on your scientific CONTRIBUTIONS, INTERACTIONS ( question & Answer ),REPUTATION ( passed from researcher to researcher ) etc..
Dear Hazim: You can eliminate the effect of questions and answers by multiplying the RG score by its publication score, for example, my RG score is 25.8 multiplied by 0.84 (publication ratio) that results in my publication score which is 21.67. In the web of science (from Iraq virtual library) there are no questions or answers in addition to calculating the (H index) which is a measure of scientific research impact. I also forgot to tell you about (publish or perish) which is a free software that is also available that include many other scientific research measures.
I quite agree with the several measures that Ian has suggested. But don't forget the effect on the community. Some of our friends on RG do research to improve their students, some others research to have a positive impact on the socio economic status of the community. (I'm one of those who research to enhance the learning of my students and Prof Rao's research has contributed to the livelihood of his community in Uttar Pradesh, India. Impact of research is perhaps as important as impact factor. Let me place his profile.)
Let me bring you to the top public university in my country. RG is measuring University of Malaya based on RG score, impact points and publications. And we know roughly some of the components of RG score that include interaction on Q and A. Perhaps we can suggest some even better ways of measuring the performance of any university or research center on this site...
IT IS REALLY A TOP QUESTION. In my personal opinion, you can account all the things what said by Ian and Now a days, most important factor is the presence of NOBLE LAUREATE in the respective Research Centres/Institution.
Research centers/institutes mainly focus on studying real problems and search for solutions. Their effectiveness therefore is measured not only by the number of publications they produce but by the real impacts their results have shown in addressing the problems of society or the environment or the type of research they work on.
For an institution, the outcome is the bench mark for quality assessment. Number of researches, their impacts, doctoral researches, projects, social implications etc. are the points which determine the quality of a research institute.
The SIR World Reports (http://www.scimagoir.com/) evaluate the research performance of leading research institutions in the world, using bibliometric data from Scopus (www.scopus.com), an Elsevier product.
The bibliometric analysis is based on indicators addressing issues like the scientific impact, thematic specialization, output size and international collaboration networks of the institutions.
Performance framework indicators - Condition or impact indicators describe the conditions of economy which the programme is seeking to influence. Other condition indicators include increased aspirant numbers in seeking to carryout research.. These condition indicators need to be estimated during the development of the programme (i.e. the base-line), preferably during its implementation, and after its work is completed. The overall impact would ideally be assessed following (some) years of the project having been installed and commissioned.
Thanks for your reply, but do you use a special form with Norms, indications, Measurement weights, impact assessment , etc. for your universities/ research centers/ institutes assessments.
There are international standards that define a standard of quality assurance for educational institutions. These criteria consist of several aspects and each aspect has specific conditions and requirements. Each requirement has specific weight. there is a minimum degree to accept the sobriety of the educational institution.
It is useful to take an idea about a successful research institute such as the Industrial Technology Research Institute, Taiwan. I have been there in 2010. The outcome of this institute is about 1000 high technology patents per year.
"The Industrial Technology Research Institute (ITRI; Chinese: 工業技術研究院; pinyin: Gōngyè Jìshù Yánjiùyuàn) is a nonprofit R&D organization engaging in applied research and technical services originated from Taiwan. Founded in 1973, ITRI has played a vital role in transforming Taiwan’s economy from a labor-intensive industry to a high-tech industry. Numerous well-known, high-tech companies in Taiwan, such as leaders in the semiconductor industry TSMC and UMC, can trace their origins to ITRI. ITRI, headquartered in Taiwan, has offices in the United States, Japan, Russia and Germany in an effort to extend its R&D scope and promote opportunities for international cooperation.
ITRI employs 5,561 personnel, including 1,310 who hold Ph.D.s and 3,030 with master’s degrees. By disseminating both technology and talent, ITRI has led the technology industry into the 21st century and has cultivated over 140 CEOs in the local high-tech industry. In addition to its headquarters in Taiwan, ITRI has branch offices in the California Silicon Valley, Tokyo, Berlin, Moscow and Eindhoven" (see link)
The work flow ,work culture, ethics,meticulously laid down SOPs and zero tolerance for any nepotism or partiality high quality papers with strivings for better and research that would aid the human race and civilization as a whole would make a good research institute.Core research involves lots of finances and that sent should be only used for betterment
Dear @Hazim, I do bring to you and the followers an excellent document : The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management!
Some of the main findings are:
"There is considerable scepticism among researchers, universities, representative bodies and learned societies about the broader use of metrics in research assessment and management.
Peer review, despite its flaws, continues to command widespread support as the primary basis for evaluating research outputs, proposals and individuals. However, a significant minority are enthusiastic about greater use of metrics, provided appropriate care is taken.
Carefully selected indicators can complement decision-making, but a ‘variable geometry’ of expert judgement, quantitative indicators and qualitative measures that respect research diversity will be required.
There is legitimate concern that some indicators can be misused or ‘gamed’: journal impact factors, university rankings and citation counts being three prominent examples.
The data infrastructure that underpins the use of metrics and information about research remains fragmented, with insufficient interoperability between systems..."
The best way to assess/evaluate the performance of research center/institute is to follow the number of patents this center or institute is producing per given period of time. Other means of assessment/evaluation are not as good as patents because dishonest games can be played to present unreal value or level for a place of research. Dishonesty sneaked into faking research , publications, citations, impact factors, metrics, propaganda leaflets ...you name it. A patent indicates true production & cannot be played with.
I started to follow in the footsteps of our Great Prof. Ljubomir Jacić by bring to you a really very interesting articles relating to our thread. but even though I could not obtain a specific evaluation/ assessment form that a university / institute uses!!!
Dear @Subhash, are you aware of Indian Citation Index? I have read about in The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management which I have attached in my previous answer.
It is counted by NAAC in India while evaluating universities. Rather team of NAAC verified H-index, Web of Science, etc. during visit to our university.
The performances of research institutes depend on research management. Here is fine reading about Metrics are no substitute for good research management! You can’t measure human skills the way you do engineering systems, Robert Dingwall and Mary Byrne McDonnell observe in the article.
In marine R&D for example, the "best" ways to evaluate performance of Research Centers/institutes are Knowledge diffusion, Cooperation and Technology Transfer, Valorization through Intellectual Property Rights (copy rights, patents, etc.)...
You could find interesting information in the following document:
Assessing performance of an institution or center is normally based on to what extend that institution or center has achieved its organizational goals or objectives. For research centers, the concerns are mainly on the following:
1. Number of research grants obtained
2. Amount (value) of research grants obtained
3. Number of research projects that can be finished vs. unfinished
4. Number of reseachers involves in research
5. Number of "Principal Investigator" from the centers involved in research
6. Number of collaborators involve in research/publication projects
7. Number of publications
8. Impact factors of publications
9. Number of consultation projects
10. Value of consultation projects
Hope this can contribute in answering the question.