Is NUSTEM making a difference?
Our research team are working to evaluate the impact of NUSTEM against the project’s key aims:
The team is working to determine what changes have occurred within the initial three-year period of the project, and also to determine the extent to which NUSTEM was responsible for any impact generated.
We have developed a short, medium and long-term strategy for evaluating the success of NUSTEM.
|Short Term||Medium Term||Long Term|
|Evaluation forms at one off events||Pre, post and follow up evaluation of short courses. e.g. Science for Families||Baseline measures and repeat data taken every 2 years with Y3, Y5, Y7, Y9 and Y11 children.|
|Informal feedback from teachers and participants||Feedback through teacher forums||Extended interviewing and focus groups with partner school teachers|
|Aimed at increasing staff knowledge and understanding, and setting future direction||Aimed at finding out the success of individual programmes of activity and which ‘work’||Aimed at evaluating the overall success of the project in achieving its intended aims|
We are measuring long-term impacts of the project in these areas through a mixed methods approach, involving both quantitative methods and qualitative tools that measure concepts of ‘science capital’ at primary and secondary, impacts on A-Level physics numbers and observed impacts from teachers.
The research team employ:
Our baseline comprises of data from primary and secondary age groups.
In September 2017 we will again collect data from pupils in our partner schools using the same tools, and analyse the latest government data. We look at the differences in pupils’ perceptions, attitudes and opinions before and after project interventions, as well as A-Level Physics uptake, to see what impact has been achieved. While this is not an exact science, we will endeavour to control for other influences that may have an effect on our results, and also compare against regional and national averages to account for any impacts caused by national or local policies.