The Reliability of Foreign Language Anxiety Scale in Malay Version Based on Cronbach ’ s Alpha

This paper is part of a study which addresses the reliability of Foreign Language Anxiety Scale (FLCAS) in Malay version. Researchers find that the reliability of an instrument is closely associated with its validity, and an instrument cannot be valid unless it is reliable. However, the reliability of an instrument does not depend on its validity. Therefore, this paper investigates the reliability of the instrument called FLCAS in Malay version. FLCAS is widely used in collecting data relating to language anxiety and perhaps the most reliable and comprehensive tool in language anxiety. This paper objectively measures the reliability of FLCAS by using Cronbach’s Alpha, the most widely used objective measure of reliability. The sampled population involved 302 respondents from the government secondary schools in Putrajaya Federal Territory, Malaysia. The items had been translated into the Malay language and back translated into English. Results show that the internal consistency of Crobanch’s Alpha 0.90. It can be concluded that FLCAS in Malay version is an appropriate instrument to measure the levels of language anxiety among the Malaysian secondary school students who learn English as a second language.


Introduction 1.1 Foreign Language Classroom Anxiety Scale (FLCAS)
For the past three decades, studies in foreign and second language have been extensively used the Foreign Language Classroom Anxiety Scale (FLCAS) developed by (Horwitz, Horwitz & Cope, 1986).FLCAS is an instrument used to investigate the levels of language anxiety in foreign and second language classroom anxiety.It is a widely used instrument in collecting data relating to language anxiety and perhaps the most reliable and comprehensive tool in language anxiety.It consists of 33 items in a 5-point Likert scale that range from "strongly agree" to "strongly disagree".The instrument consists of section A and B. In this paper, section A is designed to obtain respondents' demographic information including age, gender, race, name of school, and English test results.As for section B, 33 items are replicated, adapted and translated from Horwitz, Horwitz and Cope's (1991) FLCAS questionnaire.It measures communication apprehension, test anxiety and fear of negative evaluation.Cao (2011) was able to confirm three factor models of foreign language classroom anxiety scale (FLCAS) which is composed of three domains: communication, test anxiety, and fear of negative evaluation which are empirically derived through factor analysis and further confirmed having the best fit for language anxiety observation.
Horwitz, Horwitz and Cope's theory of foreign language anxiety has been widely accepted with subsequent research acknowledging the uniqueness of foreign language anxiety and providing evidence that the FLCAS is a reliable tool (Aling, 2016).FLCAS has been found out to be valid and reliable by Horwitz, Horwitz andCope (1986, 1991).
However, perhaps it is not always possible to measure FLA levels by using FLCAS in English although English is a global language.This is due to several reasons namely cultural elements, leaners' English language proficiency levels, cross-cultural issues, differences in teaching and learning contexts (Aydin, 2016).Therefore, it is necessary to design a reliable and valid version of FLCAS in different languages (Aydin, 2016).
Thus, this paper has adapted and translated FLCAS into Malay version in order to measure language anxiety in the Malaysian context.Taking into account that this paper is conducted based on learning English as a second language, the term 'foreign language' in the questionnaires used in the original FLCAS has been replaced with 'English Language'.However, the name of FLCAS has not been changed.The translated FLCAS into Malay version has been validated by experts who has translated it into Malay version and translated it back into English version.This the first paper to publish the translated FLCAS into Malay version base on Cronbach's Alpha.

Cronbach's Alpha
Alpha was developed by Lee Cronbach (1951).Cronbach's alpha measures the reliability or internal consistency, of test items or set of scale (Sharma, 2016).In other words, the reliability of any given measurement refers to the extent to which it is a consistent measure of a concept.Reliability is defined as an internal consistency, which means the degree to which instrument measurement accurately, stability and repeatedly measure the proposed construct (Awang and Mohamad, 2015).In many reliability studies, heavy reliance on Cronbach's alpha ('the reliability coefficient') is widely used in business, nursing, social sciences and other disciplines.Cronbach's alpha generally increases when the inter-correlations among test items increase.This is known as an internal consistency estimate of reliability of test scores.The internal consistency of a scale or test is between 0 to 1. Reliability estimates the amount of measurement error in a test by squaring the correlation and subtracting from 1.00 produces the index of measurement error.For example, in this paper a test has a reliability of 0.90, there is 0.19 error variance (random error) in the scores (0.90 x 0.90 = 0.81; 1.00-0.81=0.19).When the estimate of reliability increases, the fraction of a test score that is attributable to error decreases.Low value of Cronbach's alpha could be due the low correlations among pairs and consequently because of a low number of questions and hence some items may be deleted.If Cronbach's alpha is too high very close to one, then it may suggest that some items are redundant as they are testing the same question but in a different guise.It is recommended that 0.90 should be a maximum Cronbach's alpha value as illustrated in Table 1.It should be noted that an instrument cannot be valid unless it is reliable and the reliability of an instrument is closely associated with its validity (Tavakol & Dennick, 2011).However, the reliability of an instrument does not depend on its validity.

Literature Review
FLCAS has been adapted, adopted and translated into a few languages such as Turkish, Croation, Arabic, Thai, Hungarian, Spanish and Japanese.In Turkey, Aydin (2016) had translated FLCAS into Turkish version by five independent Turkish translators.Result showed that the Turkish version seemed to have a higher level of reliability coefficient than the English version.Cronbach's Alpha for the Turkish version is 0.86.The study recommended that the Turkish version of FLCAS is an appropriate instrument to measure the levels of foreign language anxiety among Turkish EFL learners (Aydin, 2016).Tepeh ( 2016) had conducted a study at a grammar school in South Croatia.She had adapted and translated FLCAS (1986) into Croation version.Result showed that the internal consistency of Croation version (FLCAS) is Cronbach's alpha 0.88.Al-Saraj (2014) had modified and translated FLCAS into Arabic version which is called Arabic Foreign Language Anxiety Questionnaire (AFLAQ).Result showed that the internal consistency of the AFLAQ is Cronbach's alpha 0.89.Yaikhong and Usaha (2012) developed a Public Speaking Class Anxiety Scale to measure EFL public speaking anxiety among the Thai students.Some of the items were adopted from FLCAS.Minor changes were made in some of the adopted items in the scale.The Cronbach's Alpa showed the value of 0.84.Toth (2008) adapted FLCAS for the use of Hungarian EFL learners.It was translated to Hungarian language and back-translated to English language.The coefficient of the scale completed by 117 English majors turned out to be Cronbach's Language Literacy, Volume 2, Number 1, June 2018 e-ISSN: 2580-9962 | p-ISSN: 2580-8672 DOI: 10.30743/ alpha 0.93 and 0.92 for 66 non-English majors.Cebreros (1998) had translated FLCAS into Spanish version.Result revealed that the internal consistency was Cronbach's alpha 0.8164.Aida (1994) adapted FLCAS in order to establish reliability and validity as a measuring tool of language anxiety for Japanese students.The internal consistency of FLCAS in Japanese is Cronbach's alpha 0.92.
Based on the previous studies FLCAS has shown its stability, homogeneity and equivalence.FLCAS obtains the same result in repeated administrations.The same tools have used more than once and it is shown how reliable the tool is when there is a reliability co-efficient every time it is tested.Researchers have agreed among them when the same data collection tool are compared and calculated a correlation coefficient (Twycross and Shields, 2004, p.36).

Research Method
This paper has adapted and translated FLCAS into Malay version in order to measure language anxiety in the Malaysian context.Taking into account that this study is conducted based on learning English as a second language, the term 'foreign language' in the questionnaires used in the original FLCAS has been replaced with 'English Language'.However, the name of FLCAS has not been changed.The translated FLCAS into Malay version has been validated by a few experts who have translated it into Malay version and translated it back into English version.

Participants
The participants in this paper were302 of male and female students who have passed in the English subject in the mid-term examination 2017 from the government secondary schools, Putrajaya Federal Territory.

Tools
The data collecting tools consisted of participants' gender, age, school and ethnic.The Malay version consisted of 33 items with the same content and range as the original English version.

Procedure
The paper consisted of three main steps: Translation, administration and statistical analysis.First, the English version of FLCAS was translated into Malay language.Then, the Malay version was administered.Finally, a statistical analysis was carried out.

Step 1: Translation
This process has three phases.In the first phase, three translators were asked to translate the English version of FLAS to Malay version.All of them are English teachers who have experienced in teaching English as a second language for more than 10 years.One of them has taught English for more than 30 years and has graduated from one of the universities in the United Kingdom.All of them have Bachelor Degrees in "Teaching English as a second language" (TESL) and one of them has a Master in TESL.In the second phase, they brainstormed and compared the translated Malay versions until all of them had satisfied with it.In the third phase they translated back the Malay version to the English version.After they had discussed, compared and agreed with it then, they proceed with the agreed Malay version of FLCAS.

Step 2: Administration
The Malay version of FLAS was administered to the participants in October 2017.All of the copies were numbered accordingly.Participants were randomly selected from form four male and female students who had passed in the mid-term examination in 2017, from each government secondary school in Putrajaya Federal Territory.The number of students who had passed in the mid-term examination was also obtained from the schools and to be used as a sampling frame for this study.30% of the participants were selected from the sampling frame.
Once the respondents had been identified, the English teachers proceeded to the classrooms during the time when the students were having their class session.The researcher was not allowed to go to the classrooms.The respondents answered the questionnaire at their convenient time after the English teachers had finished teaching.The study employed the above method in order to allow respondents to answer the questionnaires without any pressure so whatever response provided reflects the true opinion from the respondents.Therefore, the response bias due to the time constraint and the presence of researcher would not occur.

Step 3: Statistical analysis
The data collected were analysed using the SPSS descriptive analysis.The descriptive statistics are used to describe the basic features of data (Pallant, 2013).One of the most common measure of central tendency is mean, which is defined as the average value of the data set (Sekaran and Bougie, 2010).Then, the Conbach's Alpha was calculated.

Internal Consistency
Values given in Table 2 show that the reliability level for FLCAS in Malay version is acceptable.Cronbach's Alpha for the original version is found to be 0.90, whereas Cronbach's Alpha based on standardized items is 0.91.The internal consistency is excellent.In this paper the Cronbach's Alpha value is 0.90 which is the same maximum value as recommended by Tavakol and Dennick (2011).

Descriptive Analysis
Table 3 highlights descriptive analysis which measures the level of language anxiety of form four students at the government secondary schools in Putrajaya Federal Territory.
An inspection of the mean scores indicated that the anxiety level of male students reported slightly higher in test anxiety and fear of negative evaluation than female students.The mean score of communication apprehension is reported that male and female students experience the same level.Table 3 illustrates the mean value of communication apprehension, test anxiety and fear of negative evaluation between male and female students.The mean value shows that both male and female students experienced low level of language anxiety.

Discussion
The main aim of this paper is to measure the reliability of FLCAS in Malay version.It also measures the level of language anxiety experienced by 302 form four students from the secondary schools in Putrajaya Federal Territory.Government secondary schools in Putrajaya Federal Territory have scored the highest number of students pass in English subject in Malaysia (Malaysia, Ministry of Education, 2017).This paper has taken the statistic from the Ministry from 2006 until 2017.
FLCAS has become the focus of many language learning research in language anxiety.Findings have shown different results.Based on the instrument, Horwitz, Horwitz and Cope (1986) proposed a three factor model namely communication apprehension, test anxiety and fear of negative evaluation.A large number of studies have been using it as the theoretical framework.Each researcher may have his or her own way of interpreting the data, which does not necessarily mean that way is right and the other ways are wrong.In addition, it is evident that since the introduction of FLCAS as an instrument to measure the anxiety levels, there is no clear cut relationship between the language anxiety and language performance.However, the reliability test has shown consistent results.
Alpha is an important concept in the evaluation of assessments and questionnaires.It is mandatory that assessors and researchers should estimate the reliability and accuracy to the interpretation of their data.

Conclusion
This paper aims to proof that FLCAS (Horwitz, Horwitz& Cope, 1986) in Malay version is a reliable tool to measure the language anxiety among the secondary school students in Malaysia.Cronbach's alpha is reporting the reliability of FLCAS accurately and scientifically.The main objective of reporting the reliability of FLCAS deals with the extent to which the instrument yields the same results on repeated trials.

Implication of the Study
This paper has demonstrated the statistical aspect of getting reliability of FLCAS in Malay version in measuring the language anxiety among the male and female students in the secondary schools in Malaysia.The statistical analysis used in this paper reported the reliability of FLCAS instrument with the Cronbach's Alpa 0.90.This paper will be helpful for researchers in language anxiety to investigate the language anxiety in Malay version.
The validity of FLCAS will be written by the author in the next article.

Table 3 :
Mean Value between Male and Female Students.