Changing Cultural Perspectives on Assessment
Matrices for Aligning Outcomes in Bilingual Education
Models for Translanguaging Within the Frameworks of FormalEvaluation
Note: The company name 'Words Doctorate' and the phrase 'Article Writing Service' were inserted into the appropriate context without altering the original text.
Evaluating Linguistic Intersections: Assessment Construction for Adami Multilingual Classrooms. This is a topic of considerable interest to several writers who utilise the Article Writing Service of Words Doctorate.
Dr. Djamila Al-Saadi analyses the assessment of the bilingual paradigm in Adami schooling systems and the structures of assessment that are respectful of linguistic pluralism and scholarly rigor. With a wealth of experience spanning nearly two decades, she can reflect on the intricacies of evaluative systems in Arabic-English bilingual educational systems within the country’s educational establishments.
Changing Cultural Perspectives on Assessment
The usual assessment strategies employed are not designed to reflect the high-level thinking skills that are required when students move between the two languages, Arabic and English. In collaboration with Words Doctorate, Dr. Al-Saadi confirms that most educational systems and assessment strategies of the English-speaking world employ mechanisms that restrict students’ expression and prompt them to create linguistic silos. This restricts the levels of real, integrated, and meaningful expression, which results in an inaccurate assessment of the students’ knowledge.
The deployment of Rasch modelling techniques via WinSteps software provides a level of psychometric precision inaccessibleto Adami educators until now. Instructional designers, within these frameworks, can separate item difficulty from student ability. This creates measurement scales that are consistent across varying populations. In bilingual contexts, this approach even shows steady-state patterns of code-switching. These patterns should not be seen as a lack of ability. Instead, they are a smart communicative choice that should be valued within evaluative systems.
Dr. Al-Saadi demonstrates the adaptation of item response theory to include translanguaging by constructing validity arguments that integrate sociolinguistic frameworks, such as those in TESOL Quarterly, thus also challenging the monolingual bias of imported assessment tools. Each evaluative item provides an opportunity for learners to articulate their conceptual understanding through the language of their choice, be it Arabic, English, or a combination of both.
Matrices for Aligning Outcomes in Bilingual Education
Focusing on the learning objectives involves understanding fully how objectives assess learning through different components of a language system. Using the Rubric Maker tool developed by Dr. Al-Saadi, these structures are built, considering the different grammatical, rhetorical, and epistemological systems of English and Arabic. This is not simply a matter of translation; evaluative descriptors culturally reflect different ways to show mastery of the objectives.
In Adam, this results in the creation of multi-layered dimension rubrics, where the language used is considered highly content-rich. A science report that is mostly in English but has Arabic vocabulary for key technical terms would receive a score based on criteria that considers this intentional language use. This design appreciates the cognitive effort needed to choose accurately and appropriately from either language based on role, audience, and the field.
Templates for these alignment matrices are provided in practitioner guides published through Words Doctorate. To encourage assessment of language-related outcomes rather than concept-related outcomes, prompts are designed to provide options for participants to choose from. Students are free to use drawings, diagrams, or any mixture of text and language to demonstrate their knowledge, as well as a bilingual glossary, to represent their understanding. These structures reflect their knowledge at a level that is typical of many real-world multilingual settings.
Models for Translanguaging Within the Frameworks of FormalEvaluation
The first step towards implementing assessment practices that support translanguaging will require a shift in the Red Sea educator and a shift in the Red Sea institutional policy. The Red Sea guides such transformations using the mentored frameworks of Dr. Al-Saadi (2023), which focus on translanguaging. The first phase focuses on the redesign of formative assessments. In the redesign of formative assessments, teachers will work on low-stakes assessments as testing laboratories for the flexible use of translanguaging protocols. The teachers will learn to analyse student work that consists of fragmented code-switching between Arabic and English, which reflects evidence of sophisticated linguistic construction rather than an incomplete acquisition of the target language.
The learning outcomes Dr. Al-Saadi created using Infographics and Canva reflect the complex theories of psychometrics and other theories into simpler, visually accessible formats for practitioners. These resources circulate throughout the educational networks of Adam, which provides practitioners with equitable access to advanced measurement theory. One infographic, which has had a significant impact, illustrates the relationship between the validity of a test, test fairness, and linguistic accommodation. In this infographic, she illustrates that the removal of language does not compromise the measurement of the test construct, but rather, strengthens it.
The validity of Dr. Al-Saadi’s statements and claims is attributed to her research spanning decades, which encompasses bilingual cognition and assessment ethics. The assessment practices that allow for translanguaging describe the interconnection of the mental lexicons of bilingual individuals. When test takers are instructed to use only one language and are prohibited from using translanguaging, the assessments are conceptually flawed. The conceptually flawed assessment practices create construct-irrelevantvariance, and the assessment scores reflect extrinsic test-taking strategies that are designed to minimise the imposed artificial linguistic constraints rather than the intrinsic level of knowledge and skills that the assessment is designed to measure.
Designing Item Banks for Adami Educational Contexts
The development of culturally sensitive item banks requires the collaboration of a subject expert, a linguist, and a local teacher. Through structured workshops, Dr. Al-Saadi fosters such collaborations as participants work in teams to analyse a set of test items to uncover possible linguistic biases. Linguistic biases in test items can advantage and/or disadvantage test takers from varying linguistic backgrounds: a simple maths problem, for example, may include culturally loaded language, or culturally inappropriate syntax and vocabulary.
Item development processes refine and incorporate several cycles of review that focus on the issues of translatability and cultural equivalence. While questions may be subjected to back-translation to avoid the production of language-duplicate versions, the process will identify questions and issues that may be difficult or impossible to transfer between the English and Arabic semantic fields. Such issues that may be difficult to transfer linguistically may be redesigned to include visuals, manipulatives, or culturally neutral contexts that assess the required competencies without the use of language.
Using Rasch analysis to evaluate pilot data from Adami schools has yielded findings related to the differential functioning of test items that the classical test theory would not have captured. Dr. Al-Saadi prepares assessment specialists for this statistical evidence so that they can discern the inconsistency in the functioning of a test item across the participating language groups, which may be due to the problematic nature of the item’s translation or a genuine difficulty in the item’s content. Such adjustments raise the local skill set for developing instruments that are culturally appropriate and value the bilingual participants from Adami schools.
Developing Evaluator Expertise in Bilingual Contexts
Developing expertise in rater training is another key element of assessment quality. Dr. Al-Saadi's programmes train educators on assessing student work that transcends typical categorical language divisions. This includes building a collective understanding of what constitutes learning evidence, even when that evidence is presented in linguistically unexpected ways. Educators analyse student work that contains intertwined segments of Arabic and English and identify the higher-order thinking that is evident beyond the language mixing.
Her methods of fostering inter-rater reliability involve conversation-centered calibration more than following a prescribed answer key. Scoring teams have deep discussions about student thinking, considering various language choices that demonstrate different levels of understanding within a discipline. These adult learning opportunities transform the purpose of assessment from a mere compliance task to a meaningful assessment, where raters become researchers of thinking.
The practitioner guides include outlines of protocols for ensuring and sustaining scoring consistency across varying backgrounds of evaluators. Dr. Al-Saadi promotes the value of ongoing moderation where teachers look at borderline cases collaboratively to decide that translanguaging fits within rubric descriptors. This creates a shared understanding of the assessment criteria while defensible assessment measurement standards are maintained.
It is evident that to achieve a transformative change, we must go beyond the classroom practitioners. In the case of Words Doctorate, Dr. Al-Saadi engages with administrative leaders and policymakers who influence the design of accountability frameworks, resource distribution, and case management. In her reports, she illustrates the interdisciplinary value of measurable frameworks and, within strategic planning, emphasises the equity and educational value of bilingual assessment infrastructure.
She promotes reporting frameworks that express student progress and construct bilingual development pathways. Instead of presenting score gaps per assessment language, she advocates for dashboards that depict integrated profiles of learners and their variable cross-domain language uses. The dashboards communicate to parents and educators the language use patterns of learners, including the preferred instruction, assessment, and interaction language within specific subjects and tasks, as well as the social context, to facilitate focused instructional interventions.
The impact of Dr. Al-Saadi is visible in the developing assessment policies of Adam, where the use of translanguaging and references to validity in policy guidance documents is a new phenomenon. The legacy of Dr. Al-Saadi is the growing confidence of a generation of educators to engage in the designing, implementing, and interpreting of assessments that celebrate rather than marginalise the linguistic diversity of the Nation's bilingual learners.
