| Referral & Review |
January 2000
|
The Scientific Review Administrator (SRA) works in partnership with the scientific community to ensure that the scientific review group (study section) identifies the most meritorious science for funding by the Institutes and Centers. Below are some of the key functions carried out by the SRA. PRE-MEETING ACTIVITIES:Referral of Applications to the Study Section: The SRA examines each application assigned to the study section and determines whether the science covered is appropriate for review by that group. If it is not appropriate, the SRA takes steps to have the application assigned to a different study section. Identifying and Recruiting Reviewers: Possibly the most important role of the SRA is to ensure that the reviewers present at the study section meeting have all the needed expertise to evaluate the applications under review. In choosing regular members for study sections, it is essential that the SRA recognizes current trends in the field and ensures that the membership reflects where the field is now and where it is going. It is also critical that the expertise of each nominee complements that of the other members and strengthens the study section as a whole. The SRA works with members of the community to identify the most qualified individuals. In many cases, the SRA begins considering potential members two or more years before their expected nomination. Consideration is given to: scientific excellence (as demonstrated by grant and publication record); respect in the scientific community; breadth of expertise; fairness and evenhandedness in review; and performance as a reviewer. In addition to these considerations, the SRAs must ensure that ethnic, gender, and geographical diversity is maintained. Temporary members are chosen by a very similar set of criteria. The advice of respected members of the community, including but not limited to the chair and members of the study section, is an important source of information for identifying potential reviewers. Attendance at scientific meetings also enables the SRA to learn about new directions in the field and to identify potential reviewers in those areas. Scientific societies, as well as program staff in the Institutes and other SRAs, can be valuable sources of advice. Literature and funded-grant databases and the NIH consultant file are also used. Interactions with Chair: Whenever appropriate, the chair and SRA have substantive discussions in preparation for the study section meeting. This is particularly important when the chair and SRA have never worked together in this capacity or when new policies are to be implemented. Teamwork between the chair and SRA is a critical component of a successful study section meeting. Assignment of Applications to Specific Reviewers: The SRA assigns applications to particular reviewers by matching the science in the application to the reviewer's expertise. Assignment considerations include: reviewer knowledge about, and interest in, the goals of the project; expertise in the techniques proposed; reviewer workload; and real or perceived conflicts of interest. If the SRA has questions about the expertise needed for a particular application, he/she solicits advice from committee members knowledgeable in that area. The SRA encourages reviewers to let him/her know of any concerns that they have about their assignments. This would include conflicts of interest, concerns about the appropriateness of the assignment, or the need for additional expertise. Administrative Review of the Applications: The SRA and the grants technical assistant (GTA) make sure that all applications are complete, and that human subjects/ animal use approvals have been received. Streamlined Review: For review of grant mechanisms eligible for streamlined review, the SRA compiles a list of applications recommended by reviewers prior to the meeting as not being among the better half of applications. This list is forwarded to all reviewers for their consideration before finalization at the review meeting. Other Pre-meeting Duties: The SRA works with a GTA to make sure that the logistical issues are handled well. This would include, for example, the organization and mailing of application materials and hotel arrangements. Within CSR guidelines, the SRA sets the rules and deadlines for supplemental materials from applicants and answers applicant concerns and questions. He/she also answers reviewers' questions and makes sure that new reviewers understand the process. In addition, the SRA handles questions and/or concerns raised by program staff. THE STUDY SECTION MEETINGConvening the Meeting/Opening Remarks: The study section cannot legally be held without the presence of the SRA, who is the official government representative. Before the review of grant applications begins, the SRA reminds the study section about conflict of interest and confidentiality rules and informs the study section about review policy changes. At this time, the SRA also explains important review procedures and updates reviewers on news from NIH. Depending on the particular needs of the study section, the SRA will also remind the study section about best review practices and let them know if they need to work harder in some particular area. Order of Review: The SRA has a number of things to consider in determining the order in which applications are discussed and scored. Applications using the same grant mechanism are often grouped together to avoid requiring reviewers to make multiple switches in mind-set and review criteria. Another consideration is the clustering of applications assigned to the same NIH Institute so that the program administrators can easily hear the review of all applications assigned to them. The general flow of the meeting as well as distributing each reviewer's responsibilities over the meeting is another consideration. If possible, the SRA also should honor requests from program staff and/or reviewers for a change in the planned order. Sometimes one goal, such as reviewing all R21 applications together, conflicts with another, for example, having all applications from an Institute clustered together. It is up to the SRA to balance these sometimes-conflicting goals and determine an order that maximizes overall fairness and efficiency. Making Sure That Policy Is Followed: The SRA introduces each grant mechanism and the review criteria right before applications for that mechanism are reviewed. The SRA works as a team with the chair to make sure that these criteria are properly applied in the discussion of the application. Likewise, the SRA and Chair make sure that other important issues are properly covered in the review. This would include: human subjects, vertebrate animals, and biohazards comments or concerns, and proper use of gender, minority and child coding. Questions about appropriate NIH policy should be directed to the SRA. The SRA (or chair) will intervene during the review if a reviewer strays from accepted policy. Keeping The Meeting Moving: Although the chair should play the major role in keeping the meeting flowing, this is also the responsibility of the SRA. Watching the time spent early in the meeting is important in order to make sure that there is ample time to discuss applications that come at the end of the review order. Taking Good Notes: The SRA takes notes during the discussion of each application. This is important for writing the Resume and Summary of Discussion. In addition, the SRA reminds reviewers to modify their critiques to reflect appropriate changes as a result of the discussion, and asks discussants who raised particularly important points to provide these comments in a brief paragraph. POST STUDY SECTION:Recording Scores and Budgets: During the first several days after the meeting, the GTA enters the reviewers' scores into the NIH computer system; the SRA checks scores, as well as any budget comments or calculations, and gender/minority/children coding. Interactions with Applicants: Although applicants are instructed to contact the program administrator if they have questions following the completion of the review meeting, they sometimes contact the SRA asking about their score, etc. Although the SRA does not give out the scores, he/she does respond to the phone calls or E-mail messages, and directs applicants to their program officers, if that is appropriate. Once applicants receive their summary statements, program officers have primary responsibility for answering questions about the interpretation of the critiques, and about preparation and submission of a new application. However, SRAs are available to speak to the applicant about these issues if the program officer was not at the study section meeting and suggests that the applicant contact the SRA. Interactions with Present and Prospective New Members: After the meeting, the SRA may contact the chair and several of the senior members to get feedback about the meeting. Some of this feedback will involve suggestions about which temporary members might be good additions to the committee. All members should feel free to call the SRA and offer advice and suggestions. Similarly, if a particular incident at the meeting suggests it, the SRA will contact reviewers to tactfully educate them about review issues. The SRA may contact the temporary members soon after the meeting to thank them for their participation and/or invite them back to serve again as a temporary or permanent member. Production of Summary Statements -- Pressure For Speed, Quality of Resume: The SRA is given the charge of producing high quality summary statements and doing this as quickly as possible. It is important that the Resume and Summary of Discussion conveys the issues that were most important in determining the priority score. Careful SRA notes along with the reviewers' critiques are usually sufficient. If there are issues that need clarification, then the SRA will contact the reviewers. Appeals/Attending Councils: The SRA works with program administrators to respond to applicants who appeal their review. The SRA attends council meetings whenever possible, but particularly when applications reviewed by their study section are discussed. Final note about timing: The pre-meeting and post-meeting duties actually overlap in time. Therefore, the SRA is examining applications and recruiting new reviewers for the next study section meeting at the same time he/she is writing summary statements and performing other post-meeting duties. Most SRAs have responsibility for some special reviews in addition to their main study section.
|