Mapping Social Justice Perspectives and Their Relationship with Curricular and Schools’ Evaluation Practices: Looking at Scientific Publications

The main aim of this article is to give an overview of how the concept of social justice— as linked to curricular and evaluation practices―has been developed in scientific publications over the years. To achieve this goal, a mapping study was carried out by collecting scientific publications from the Web of Science Core Collection. The analysis focused on 217 articles from 50 scientific journals. Each one of the 217 articles was analysed through the process of content analysis. From this analysis, it was possible to conclude that the concept of social justice has been developed, in the main, from a broad view of equity in which inclusion and democracy are central. However, the political agenda, externally imposed and guided by accountability and effectiveness processes, frames all actions relating to social justice issues especially in schools. Accountability and effectiveness processes shape the way that social justice is perceived by policymakers and, consequently, how the processes to achieve them are considered and implemented.


Introduction
The achievement of social justice is essential for building a more democratic, fair and successful school (Apple 2013;Apple and Beane 1995;Leite 2002).The concept of social school populations (Leite and Fernandes 2010, 59).Schools' evaluation practices can be a way to better understand how their actions can lead to the implementation of social justice.Several authors (Greene 2005;House 1990;MacDonald 1976) argue that evaluation practices are a mechanism to engage in school diversity and equity.By giving schools articulate and rich data, evaluation practices can stimulate the development and awareness of the importance of social justice actions in schools and, at the same time, increase the knowledge of the decision-makers and experts serving the interests of the schools' actors.
Taking these ideas into account, the main aim of this article is to give an overview of how the concept of social justice-as linked to curricular and school evaluation practices-has been developed in scientific publications.For this purpose, a mapping study was conducted.
According to Kitchenham, Budgen, and Brereton (2010), mapping studies can be used to identify discussions taking place in the literature about a certain issue.In other words, they can be used to identify, evaluate and interpret the research available about a particular subject (Kitchenham, Budgen, and Brereton 2010).Mapping studies are based on the notion that published articles represent not only the findings themselves but also the activity related to those findings, at the same time indicating where the research took place and in what journal it was published (Cooper 2016).Systematic mapping studies are similar to systematic reviews, except that the former consider different inclusion criteria and are intended to map out topics and trends rather than synthesise study results, thereby providing a categorical structure for classifying published research reports and results (Dicheva et al. 2015).For Petersen, Vakkalanka and Kuzniarz (2015), a systematic mapping study is a secondary study that reviews articles about a specific research topic, with the main aim of giving an overview of a research area through classification and counting contributions relating to the categories of that classification.For these reasons, the study was conducted using a systematic mapping design.
The main goals of this systematic mapping study can be summarised in one research question: How is the concept of social justice in scientific publications related to curricular and school evaluation practices?To answer this question, the article follows a structure in which first the methodological procedures are described, namely, the different phases of the mapping study.
Then, the main findings of the study are presented and discussed, as are some specificities about the study.Finally, the conclusions contain reflections on the findings and the answer to the research question above.

Methodological Procedures
In accordance with recommendations by Petersen et al. (2008) and Elberzhager, Münchb, and Nha (2012) on conducting mapping studies, the study was carried out over three phases, namely planning, conducting and reporting.In the planning phase, a mapping protocol was drawn up that specified the following: the research questions, in order to define the review scope; the database, i.e.where the search for the articles would be carried out; the search string that was to be applied in order to check the aim of the articles; and the inclusion and exclusion criteria (derived from the research question).In the conducting phase, all activities were performed according to the mapping protocol design, including searching, screening and extracting data from the articles.Finally, in the reporting phase, using the findings of the systematic mapping study the research question was answered.Figure 1 shows the different phases of this process.

Figure 1: Mapping study phases
In order to achieve the research objectives, in the planning phase the study focused on articles published in the Web of Science Core Collection.This database consists of nine indexes containing information gathered from thousands of scholarly journals, books, book series, reports, conferences, etc.It covers over 12,000 highly acclaimed impact journals in full, from all over the world. 2 Within this core collection, the Social Science Citation Index was chosen because it is a multidisciplinary index for the journal literature of the social sciences.It covers over 2,900 journals across 50 social science disciplines.It also indexes individually selected, relevant items from over 3,500 of the world's leading scientific and technical journals. 3Within the Social Science Citation Index, a search was then made of the category "Education and Educational Research" 4 because, within the 57 categories inside this index, it was considered the one best suited as it was the most focused on the aims of the study.This category contains 233 acclaimed, high-impact scientific journals.After reading the aim and scope of each one and completing the first phase by searching for "social justice" as a keyword, 183 journals were excluded, leaving a total of 50.
At this point, the inclusion and exclusion criteria were applied.The criteria for inclusion included: (1) all articles focusing on social justice issues in the educational field; (2) all articles related to the study's research interests, namely, curriculum, evaluation, equity and inclusion; and (3) articles published in any year.The exclusion criteria included: (1) all book reviews, reports and conference papers; and (2) papers with restricted access or which had to be paid for in order to be read.
As a consequence of this process, the analysis focused on 217 articles from 50 scientific journals as shown in Table 1.Each article was analysed through the process of content analysis (Bardin 2011;Krippendorff 2004) supported by NVivo software.All the articles were related to social justice, and after reading them several categories emerged.The texts from the articles were then codified and categorised.The unit senses/references were sentences, although in some circumstances entire paragraphs were also considered.In the coding process, the rule of mutual exclusivity of categories was not followed (L'Écuyer 1990).As a result, the analysis was based on 10 categories, with indicators outlined for each one as follows: (1) School Evaluation includes all sentences/paragraphs focusing on a school's evaluation (internal and external), self-evaluation processes and learning assessment; (2) Curriculum contains all sentences/paragraphs related to curriculum implementation, curriculum development, curriculum autonomy, curriculum policies and curricular justice; (3) Democracy covers all sentences/paragraphs focusing on issues related to democracy in schools and democratic policies; (4) Human Rights encompasses all sentences/paragraphs linked to the achievement of human rights, particularly in schools; (5) Diversity/Multiculturalism includes all sentences/paragraphs focusing on diversity in schools and the development of multicultural projects and practices; (6) Equity contains all sentences/paragraphs related to the implementation of equity policies, equity practices in schools and equity achievement; (7) Inclusion covers all sentences/paragraphs regarding actions or changes implemented to make schools more inclusive, and inclusion policies; (8) School Leadership covers all sentences/paragraphs associated with different types of school leadership and its influence on schools' and students' performance; (9) Education Policies includes all sentences/paragraphs related to education policies in education focused on school improvement, students' success and the achievement of social justice; (10) Teachers' Professional Practices contains all sentences/paragraphs concerning the influence of teachers' professional practices on students' success, and the influence of policies on teachers' work.
To better understand the relationship between these different categories, a cluster analysis of similar words was performed using the similarity metric Pearson correlation coefficient (=p).
In other words, the cluster analysis generated a diagram clustering the categories (nodes) together where they shared many words in common.The Pearson correlation coefficient specifies whether the relationship between categories is strong or weak, in this case measuring word similarity correlation for each node compared with the other nodes.Looking at Figure 2, it is possible to see from this tree-structured graph which categories had more words in common and which groups of categories were created.were strongly correlated, although the categories more strongly correlated were "Diversity/Multiculturalism" and "Equity" (p = 0.884), "Education Policies" and "Equity" (p = 0.932) and "Education Policies" and "Inclusion" (p = 0.952).
Given that this article is concerned with the concept of social justice and how curricular and evaluation practices are related to it, the above clustering shows this relationship more clearly, guiding the reading of the texts and informing discussion of the findings.

Findings and Discussion
By following the steps described above, this analysis of articles has allowed different dimensions to perspectives on social justice in its relationship with curriculum and school evaluation to be identified.The findings of the mapping performed are presented and discussed below.

Mapping Study Specifics
Before moving on to the main findings of this mapping study, it is worth noting that all the journals considered were written in English and that most came from the United States or the United Kingdom.There is a huge difference in the number of citations of English-language publications compared with non-English publications (Liang, Rousseau, and Zhong 2011).The Science Citation Index also covers non-English language journals, but papers in these journals have considerably lower impact than those in English-language journals.Another aspect to consider is that the United States and the United Kingdom have barely any publications in non-English-language journals (Van Leeuwen et al. 2001).Therefore, language and country biases play an important role in the comparison and evaluation of national science systems, which justifies the contextualisation of the findings and taking into account the tendencies that shape academic publications, i.e. a Western and Euro-centric perspective, since all articles analysed are written and published in English.Nevertheless, it is impossible to ignore the fact that these journals have a high impact factor, which means that they have more citations compared to other journals.Consequently, much of the knowledge disseminated about a specific issue is done considering the content of the articles published in these journals.
Bearing in mind this publication bias limitation, of the 217 articles analysed 123 came from journals from the United Kingdom, 66 from the United States, 19 from Australia, eight from South Africa and one from Turkey.Although many of the articles were from the United Kingdom, a higher number of them were written by authors affiliated to the United States.articles, all the categories were represented in these countries' articles; however, the categories with the largest number of contributions were "Education Policies," "Inclusion," "Equity" and "Curriculum."For the Australian journals, the focus was the same.The Turkish article was about "School Leadership" and "Teachers' Professional Practices"; the latter category was present in all the journals except the South African ones.
Given the finding that curriculum and school evaluation made up 34 per cent of all the articles about social justice in these journals, these themes occupy considerable space in the published scientific literature on social justice issues.Still, the question remains: How has the concept of social justice been conceptualised and developed over the years in scientific publications related to curricular and school evaluation practices?After analysing the data-and given the complexity of the relationship between social justice, curriculum and school evaluation-is it possible to conclude if a reflection about school evaluation and curriculum practices, associated with social justice perspectives, is essential in order to understand their relationship?

Mapping Social Justice Perspectives: The Place of Curriculum and School Evaluation
From the analysis of the articles in this mapping study, it was possible to identify meanings and perspectives concerning the curriculum−social justice−school evaluation triad.These are described below.
Content analysis of the articles shows a focus on accountability and effectiveness in reflections on the relationship of social justice with curricular and school evaluation practices, albeit from different perspectives.
Back in the 1990s, when reflecting on the power of the economy and the influence of economic interests in the educational field, several authors (Epstein 1993;Gillborn 1997;Slee 1998) began to consider a process that emerged from this mutual influence, namely, accountability.
It emerged because comparison had become a central mode of national and global governance (Nóvoa and Yariv-Mashal 2003), resulting in increasing pressure to follow new public management principles and new forms of network governance (Ball and Junemann 2012;Lingard, Sellar, and Savage 2014).In other words, comparing institutions through external evaluation processes became the basis of accountability processes in the educational field, especially with regard to schools, because accountability implies responsibility associated with judging performance (Frymier 1996).
Another relevant aspect of this analysis is that, for some authors, the external evaluation of schools is important because schools' actors inevitably have their blind spots (Lingard, Sellar, and Savage 2014) and therefore need external elements to help them reflect on their context and ways to improve.Other authors support the argument that the best way to improve a school is grounded in self-evaluation (MacBeath 1999; Swaffield and MacBeath 2005), because through it schools can know themselves and "reflect on the quality of the work they do, to decide on the evidence needed to make judgements on the activities and performance of the school, and to identify areas and strategies for improvement" (de Clercq 2007, 101).
Nonetheless, and according to MacBeath (1999) self-evaluation may be insufficient on its own because schools can become complacent in their comfort zones and minimise their most difficult challenges.For these reasons, "external evaluators are often brought in to verify a school's self-evaluation process and write their own evaluation report with improvement recommendations.Such a step is supposed to help schools in the identification of their priorities and the development of improvement plans" (de Clercq 2007, 101).This kind of process is often associated with the primary aim of ensuring that schools function adequately, implying observation of schools' organisational and instructional processes, so that the appropriateness of their inputs, processes and outcomes can be established externally.Ideally, this external evaluation should not be imposed or based only on bureaucratic issues but, on the contrary, should instigate collaborative work among school actors.In this sense, it is important to clarify what notions of accountability support quality-improving processes for schooling for all (de Clercq 2007), particularly in their intrinsic relationship with school evaluation processes and social justice.
Accountability processes can be used as a way of performing standardised actions in order to achieve what is externally imposed, without taking into account issues linked to social justice in daily school life.An excessive focus on results can undermine students' success and educational improvement if the only focus of a school's actions is evaluation by testing.
Furthermore, the pursuit of a re-articulation of social justice as equity through test-based accountabilities is linked to performance actions (Lyotard 1984) and new forms of governance in education (Ball 2013).In other words, this can happen because political discourses put decision-making on social justice issues by governing bodies to the back of their agenda; hence, different ways of understanding the concept of accountability have emerged as a way of giving attention to other crucial dimensions in the educational field and particularly school life (Epstein 1993).To overcome the logic of policy that accompanies evaluation by testing (Salinas and Reidel 2007)-"accountability through testing"-alternative ways of conceptualising accountability are needed, particularly those that include multiple performance indicators and focus on a more local and democratic form of evaluation (Salinas and Reidel 2007).So, to overcome the bureaucratic accountability (de Clercq 2007) process-i.e. one focused simply on achieving results-democratic accountability (Epstein 1993) or horizontal accountability (de Clercq 2007) may be the answer.The defence of these two forms of accountability, linked to a social justice perspective, values a negotiation between teachers and other school elements, especially students.This democratisation process should involve processes for the recognition of differences and provide opportunities for dialogue between those with opposing views, expressing commitment to anti-discriminatory and anti-oppressive education (Epstein 1993).
The need to implement accountability processes is intrinsically linked to the pursuit of effectiveness in the educational field.On the one hand, effectiveness processes provide more information for parents and the community about students' performance in terms of detailed school examination results.On the other, it defines the content and the structure for how the curriculum should be organised and developed, which can put pressure on schools and increase the gap between specific student needs and a curriculum not adapted to them.Thus, educational change has been driven by effectiveness (Wrigley 2003) in that it shapes a school's public image and reduces educational processes to the need to achieve higher test scores; it therefore becomes attractive to politicians and governments prioritising a particular set of outcomes that schools are supposed to achieve.Wrigley (2003) shows that an anti-democratic tendency of school effectiveness is the construction of a framework that combines a research model, policy and discourses.For this author, the pursuit of school effectiveness is anti-democratic because it creates the idea that it can be achieved through education, equity and equality.This idea can trivialise learning, making it difficult to understand the forces that structure our lives by penalising those who are teaching and learning in marginalised and vulnerable communities.
Therefore, this conception reduces reflection on education and its goals, thereby limiting teachers' pedagogical practices, particularly in terms of curriculum contextualisation and the search for equitable processes, which in turn increases the asymmetry in communication between teachers and students.An accountability system assumes that schools achieve equity through excellence in the results they achieve, and consequently equity discourses become obscured by discourses centred on excellence (Salinas and Reidel 2007).In other words, "in rating 'excellence' and not 'equity,' the State avoids genuine discussions and, thus, actions regarding school resources, quality teaching and wise assessment practices-essential components in achieving an equitable educational system" (Salinas and Reidel 2007, 52).That is why education policymakers in several countries "have struggled to marry their measures of effectiveness with the aspiration to provide equity in schooling outcomes" (Kelly 2012, 977), because for them the link between accountability, public examination success and equity is sound.However, "it is not clear what the targets should be, how they should be measured or how they should be spread across the range of prior attainment" (Kelly 2012, 978), implying continuing inequities in this process (Lingard, Sellar, and Savage 2014).In the same vein, it is not clear in what way curriculum and school evaluation are positively affected in order to contribute to equity and social justice implementation in schools.
Thinking about equity as the process by which students can access quality educational environments in which their different learning rhythms are considered, social justice as equity has been redefined in terms of comparative scores on national and international examinations and testing.Consequently, social justice as equity is shaped by economic rationalities and discourse (Lingard, Sellar, and Savage 2014) that greatly affect curriculum development.In this way, "the effectiveness movement is unnecessarily restricting the curriculum, narrowing the teaching approach to direct instruction and controlling teachers by judging them 'on task'" (Glickman 1987, 624) only when they teach to specific aims that are externally defined (Karikan and Ramsuran 2006).For this reason, the equity and social justice agenda is subjugated to the imperative of league tables documenting "high standards" in narrow curriculum areas (Hall et al. 2004).
Therefore, the curriculum can be seen as the battleground in which the theories and politics of knowledge meet classroom practice in complex and turbulent ways (Connell 1995;Smyth 2004); for this reason, it is necessary to replace the existing mainstream, "hegemonic" curriculum with one based on social justice (Au 2007;Clark 2006;Hatcher 1998).School effectiveness considers "outcomes" to be those by which effectiveness can be quantified, distorting the curriculum by prioritising what is easily measured (Wrigley 2003) and thus primarily focusing on results and numbers.In this sense, instead of pursuing the creation of a relationship between school effectiveness and school improvement, it is important to pursue models of educational development that involve discussion and value the processes and not just the numbers.From Apple's (2013) point of view, current educational policy, including curriculum development, results from an alliance between neoliberalism and neoconservativism.Thus, it should be recognised that "curriculum is centrally imposed, learning policed by 'high-stakes testing', and that teaching is regulated by inspection and performance pay" (Wrigley 2003, 96), where bureaucratic accountability frames curriculum development and schools' evaluation processes are subject to external demands.
Throughout this landscape, according to Slee (1998), the linking of teacher-training funding to inspection performance is sufficient inducement to conformity.Inadequately trained teachers (Hartwig 2013) are a way of increasing popular, top-down approaches to curricular content (McGregor 2009).For this reason, it is crucial to engage teachers in inclusive pedagogies that lead them to share "responsibility for the outcomes of all learners, plan strategies to address students' exclusion and underachievement, and work with other professionals" (Pantić 2015, 340), communities and families (Ainscow 2005;Edwards 2007).This is not easy to accomplish; thus, agency for social justice involves efforts to transform structures and school cultures (Pantić 2015).In other words, teachers' contribution to social justice requires their understanding how powerful social forces can influence exclusion and disadvantage (Slee 1998) and how they, as professionals, can individually and collectively affect the conditions for schooling and learning for all (Liston and Zeichner 1990;Pantić 2015).According to these ideas, it is fundamental that the organisation of teacher training programmes aims at closing the achievement gap between students (Miller and Martin 2015).Social justice as equity "requires an ongoing process of changing the pedagogical contexts in which teaching and learning occur" (Nagda, Gurin, and Lopez 2003, 167), and that is why agency for social justice is so important (Freedman 2007;McInerney 2003;Pantić 2015).
The relationship between all these issues is very complex and should be considered in the context of the evolution of societies and the educational policy measures implemented over the years.Figure 3 shows how these different concepts are interconnected and the meanings of the curriculum−social justice−school evaluation triad, taking into account the articles analysed in this mapping study.In sum, accountability and the search for school effectiveness are two processes that strongly affect how curriculum and school evaluation are developed.On the one hand, they shape the way that social justice issues are considered by policymakers and, consequently, how the processes to achieve them are developed and implemented.The fact that the pursuit of excellence restricts reflection on equity is, in itself, revealing of the power of the economic agenda in the educational field.On the other hand, if there are some positive aspects about the actions of external elements in schools-namely through the process of external evaluationthe way schools develop their critical reflections is seen as one of the best routes to actual improvement.Therefore, education for social justice could be developed on the basis of self-evaluation processes and investment in teachers' professional actions-through agency for social justice-as the main path to achieving an inclusive pedagogy that could in turn be the basis for actions that are more social justice-oriented and sufficiently strong to face external pressures.

Conclusions
As mentioned above, this mapping study focused on a single, main question, namely, how is the concept of social justice in scientific publications related to curricular and school evaluation practices?
First of all, the concept of social justice has been developed, in the main, with a focus on equity issues.It embraces a broad view of equity, in which inclusion and democracy are central.Social justice seems to be recognised as a way to respond to multiculturalism and diversity.However, the political agenda, externally imposed, shapes all actions regarding social justice issues, especially in schools.Policy statements acknowledge that all students should be able to achieve their full potential and have the necessary support to do so.Nevertheless, the complex ways in which justice expresses itself through its "implementation will determine whether it is possible to base education on social justice principles" (Karikan and Ramsuran 2006, 14).If schools do in fact play a fundamental role in building an ideal of social justice, it is essential to pay attention to how school experiences are mediated by politics, power and ideology (Applebaum 2008), as well as to the contradictions among them.
In terms of the relationship of social justice with curriculum and school evaluation, from this mapping study it is possible to conclude that accountability and effectiveness have a strong influence on how these processes are developed.On the one hand, accountability is associated with responsibility, which leads to a perspective of judgment by evaluation.This focus on accountability is justified, in the articles analysed, by the premise that accountability systems assume schools to achieve equity through excellence; consequently, equity is obscured by discourses centred on excellence.This pursuit of excellence is cloaked in an excessive focus on final numbers and bureaucratic processes.Thus, equity is reconceived as a measure of the strength of correlation between student background and test performance (Lingard, Sellar, and Savage 2014).On the other hand, the need to achieve effectiveness shapes a school's public image and puts much pressure on both the results that school evaluation processes present and the way the curriculum is developed.In a world that values "numerocracy" above everything else, numbers overshadow any attempt at a more qualitative approach to accountability and school effectiveness reduces all educational processes to the need to achieve higher test scores.
Both have considerable impact in terms of social justice and equity, because they increase the disadvantages of some social groups and limit teachers' practices in terms of curriculum contextualisation.This effectiveness movement restricts curriculum development, narrowing the teaching approach to instruction, and controls teachers by making them teach according to specific aims that are externally defined and often not sufficient in the real context.
In sum, the social justice agenda is subjugated to an economic imperative focused only on accountability and effectiveness processes.How, then, is it possible to fight this agenda and put greater value on processes based on social justice issues?A possible way forward is to substitute bureaucratic accountability processes with democratic and/or horizontal accountability processes, since the latter imply negotiation among all the actors involved in schools.In other words, we need to consider accountability and effectiveness in a more democratic way and, consequently, invest in a social justice orientation for evaluation (Kushner 2009;Thomas and Madison 2010) and pedagogical processes (Applebaum 2008).In addition, since evaluation practices have been linked to the curriculum as a possible way to better understand how schools' actions can lead to social justice implementation, self-evaluation is therefore the best way to improve a school because it gives rise to internal and joint reflection about a school's actions and what best fits students' needs.

Table 1 :
List of journals that made up part of the mapping study

Journals Number of Articles Impact Factor JCR 5 SCOPUS 6
There were 16 affiliated author countries, namely Australia, Canada, China, Cyprus, Denmark, Ireland, Israel, Italy, New Zealand, Norway, Portugal, South Africa, Sweden, Turkey, the UK and the USA.The oldest article analysed dated from 1990, the most recent from 2016.The majority were from 2012 (27) and 2010 (18).In relation to article distribution by category, most focused on issues relating to "Education Policies."With regard to the central themes of this paper, curriculum issues were present in 55 articles, school evaluation issues in 29 (in total 84 articles, 34% of the total).Since the United States and the United Kingdom had the highest number of