Computing Research Assessment
We have identified several areas of computing research that have strategic importance for Florida Tech, the College of Engineering, and the Department of Computer Sciences and Cybersecurity. Within a few years, we expect to achieve goals that have been documented in Computing Research Objectives. To determine if we are moving in the right direction, we have specified immediate and continual results that can be measured to determine progress toward our objectives. These expectations are documented in Computing Research Outcomes. To reiterate, these outcomes are specified for the department as a whole and do not imply expectations on any individuals. However, individual members of the faculty and student body must contribute to attain the expected results.
We view specific estimates or dictums of research growth such as: "Research funding will double in five years" or "Faculty will publish two refereed journal papers per year" at best vague predictions and at worst threatening and counterproductive. At present, we only require that research increase as a function of time, faculty size, and student population. Later, after sufficient monitoring and measurement, we should be able to specify a sustained rate of increase.
How, what, and when our research outcomes will be measured is described below. Both quality and quantity will be used to measure research activity. Measuring quality is elusive, but refereed publications and peer-reviewed research serve as guides to estimating quality.
Quality of Research
We expect the following to increase in total, per faculty, and per student.
- The number of papers published in refereed journals.
- The number of papers published in refereed conferences.
- The level of external funding received though competitive peer-reviewed awards.
Quantity of Research
We expect the following to increase in total, per faculty, and per student.
- The annual (fiscal year) departmental research expenditure.
- The total amount of grants and contracts under award.
- The number of students by degree level on sponsored research.
- The amount of support (tuition and stipends) provided to students.
- The number of books authored.
- The number of book chapters authored.
- The number of presentations at reviewed conferences
- The number of presentations at workshops
- The number of technical reports written.
- The number of invited and keynote addresses given.
- The number of conference workshops and sessions organized by faculty.
- The number of useful software applications developed, licensed, and distributed.
Research Infrastructure
We expect the following to increase until they are adequate.
- Space devoted to research laboratories.
- Space devoted for research offices, primarily office space for doctor of philosophy students, but for other research staff and students too.
- Computing equipment available for dedicated research.
- The number of faculty actively engaged in research and scholarly activities.
- The number of students actively engaged in research and scholarly activities.
Assessment Timeline
Publications, Addresses, and Applications
Each January the department will tabulate the number of papers published by category: refereed journal, refereed conference, reviewed journal, reviewed conference, reviewed workshops, workshops, technical reports, invited addresses, keynote addresses, and software applications developed. This information will be tabulated by faculty and by student, although these sets are not disjoint. Individual members of the faculty must assume responsibility for submitting their publication record to the department. The department's monthly news is the recommended mechanism for reporting publications and addresses.
External Funding
Research expenditures and the total amount of awards are reported by the Office of Sponsored Programs. Research expenditures are reported by August of each year. Total awards are reported continually.
Research Infrastructure
Space devoted to research laboratories and offices is cataloged yearly along with inventory of computing equipment. Faculty research awards are reported in the department's monthly news. Each term, the university's roster reports the number of students engaged in funded research.