Shukur scale: Test Development and Content Validation

Aira Afiqa Ahmad Sukery, Mohamad Azrul Iraqi Zainol Iraqi, Nur Aliya Nashrah Mohd Sabir, Munirah Mohamad, Siti Nur Aisyah Ibrahim

International Islamic University Malaysia, 53100 Jalan Gombak, Kuala Lumpur.

ABSTRACT

This paper reports the conceptualization and content validation exercise of a newly developed scale to measure the construct Shukur. This exercise was implemented to conceptualize the construct Shukur, construct the items that measure the construct, and assess whether the items in the scales represent the content areas of the construct specified in the scale. The conceptualization stage necessitated the developers to define the construct in order for them to identify the domains related to construct Shukur. As for the next stage is item construction, this exercise has engaged subject matter experts whereby the items have been subjected to the content validation exercise which gather the degree of experts’ agreement on the essentiality of an item in measuring a domain. 10 subject matter experts have been engaged to rate the essentiality of the items in a measuring a particular construct. The subject matter experts deal with the items whether or not the sample of items have adequately represented a particular domain of the construct. Next, the developers also need to calculate the content validity ratio which was important to provide evidence on the inclusion of an item in the scales, and, in turn, leads to the index for high content validity.

Keywords: content validation, content validity, content validity ratio, psychological variables, shukur.

INTRODUCTION Shukur can be defined as gratitude and thankfulness (al-Jawziyyah, 1997). It appears

that gratitude has been neglected in psychology field and very little attention given by social sciences towards gratitude (Emmons & Crumpler, 2000). Al-Seheel (n.d.) stated that praising and thanking Allah for His blessing is greatly valued in Islam. He stated that those who are grateful to Allah truly worship him as noted in Al-Qur’an (2: 173), “…and be grateful to Allah, if it is Him you worship”. As mentioned by Aghababaei and Tabik (2013), gratitude is essential to being religious person. Hence, gratitude can be expressed by a specific behaviour such as in rituals. Shukur has been mentioned in the Qur’an many times. In surah Luqman, verse 12, Allah said “We bestowed (in the past) Wisdom on Luqman: Show (your) gratitude to Allah.” any who is (so) grateful does so to the profit of his own soul: but if any is ungrateful, verily Allah is free of all wants, worthy of all praise.”

Reviewed literature have shown that there are other similar gratitude scales available

which are GQ-6, Appreciation Scale (AS) and Gratitude, Appreciation, and Resentment Test (GRAT). However, the scales that exist were developed in the different culture, value and context. Thus, there is a need for this test because there is no existing test available to measure shukur (religious gratitude) among Muslims.

This test will be used by educators, employers, Muslim psychologists, and Mental

Health Association. As for educators, this test will be used in school settings, for example, the

educators help to improve test takers’ motivation and reinforce their behaviors to be more grateful (shukur). While for employers and Muslim psychologist, this test may be helpful for employers in accessing employees’ attitude towards shukur to predict their behavior and state. As for Mental Health Association, this test can be used to predict well-being of test takers as gratitude has positive correlation with well-being (Wood, Froh & Geraghty, 2010).

By knowing the level of gratitude (shukur), the test takers would be able to improve

their shukur state. Among the potential group of professional who may benefit from the test are: (1) Muslim psychologist, religious employers and educators. They may use information gathered by the test to design intervention programmes to improve or increase the level of shukur. (2) Mental Health Association, gratitude (shukur) predicts the well-being of individuals. By knowing the result, this association may predict test taker’s well-being.

SCALE CONCEPTUALIZATION

The construct is designed to measure shukur. The literature review of shukur studies found that there are various aspects that can stand as psychological variable of shukur. The identified aspects from the initial exercise are:

Shukur is learning to be thankful and regularly expressing it (Muhamad Abdullah, 2012).

Shukur is gratitude and thankfulness in which Muslim should look for to assist in their entire life. The reality or gratitude is performing any actions according to Allah’s command (Jawziyyah, 1997).

Shukur is speaking of Allah’s blessing, give thanks for a small blessing and people (Hadith of Prophet Muhammad, as cited in Jawziyyah, 1997).

Shukur is the feeling of comfort in the heart, praise to Allah towards all the ni’mah and obedience to Allah (Fauzan, as cited in Satria, 2014).

Thankfulness should be best demonstrated via faith and obedience to Allah (Frisk, 2009)

Based on above definitions, the construct Shukur in this scale includes the following domains:-

a. Thankfulness, defined as the expression of thankfulness by speaking of Allah’s blessings and thanking Allah (Muhammad Abdullah, 2012; Jawziyyah, 1997; Hadith of Prophet Muhammad narrated by Abu’d-Dunya). In this scale thankfulness can be categorised to three sub domain which are appreciation, thanking and good deeds.

b. Faith, refers to thankfulness can be best demonstrated via faith (Frisk, 2009). This construct refers to behaviors that manifest individual’s shukur in terms of belief and knowledge.

c. Obedience, refers to the reality of thankfulness by performing any actions according to Allah’s command and can be demonstrated via obedience to Allah (Jawziyyah, 1997; Fauzan, as cited in Satria, 2014; Frisk, 2009). In this scale, obedience refers to submission and authority as to indicate shukur.

The above definitions specify a number of relevant domains for the construct shukur. The content domains identified at this stage helped scale developers to construct items which were representative of behaviour for the domains. This step is essential as the proposed psychological scales adopted a content-oriented test construction procedure. The domains for the psychological variables are listed in the Table 1. TABLE 1 Blueprint of Shukur

Construct Domain Sub-Domain No. of Item in Item Pool

No. of Item to appear in the actual form

In this scale, it is defined to include the following:

Expression of

thankfulness by speaking of Allah’s blessings and thanking Allah (Muhammad Abdullah, 2012; Jawziyyah, 1997; Hadith of Prophet Muhammad narrated by Abu’d-Dunya)

Total items = 19 Thankfulness can be

best demonstrated via faith (Frisk, 2009)

Total items = 11 The reality of

thankfulness is performing any actions according to

Thankfulness Appreciation 4 1

Thanking 6 2

Good deeds 9 2

Faith Belief 6 3

Knowledge 5 2

Obedience Submission 7 4

Authority 3 3

Allah’s command and can be demonstrated via obedience to Allah (Jawziyyah, 1997; Fauzan, as cited in Satria, 2014; Frisk, 2009)

Total items =10 Thus, shukur can be defined as thankfulness towards Allah and demonstrated via faith and obedience.

The objective of this test is to measure the level shukur among Muslims. The test will cover three domains which are:

Thankfulness: Expression of thankfulness by speaking of Allah’s blessings and thanking Allah (Muhammad Abdullah, 2012; Jawziyyah, 1997; Hadith of Prophet Muhammad narrated by Abu’d-Dunya, as cited in Jawziyyah, 1997)

Faith: Thankfulness can be best demonstrated via faith (Frisk, 2009) Obedience: The reality of thankfulness is performing any actions according to Allah’s

command and can be demonstrated via obedience to Allah (Jawziyyah, 1997; Fauzan, as cited in Satria, 2014; Frisk, 2009)

The test will be administered in both formats that are the use of pencil-and-paper inventory (this will offer immediate response) and the use of computerized test (this would be convenience in term of test-takers’ time availability and can be taken anywhere and everywhere via computer). In addition, computer administration is highly efficient test-scorer. The test can be administered in group and the instruction given will be the same. The ideal format of the test will include self-report based specifically the item format, scaling and scoring. The item format is the selected-response format (Likert scale) which requires test takers to select a response from a set of alternative responses. Likert Scale format in term of frequency (Always, Very Often, Sometimes, Rarely, and Never). The higher the score, the higher the level of gratitude.

The test has been developed in two forms which are original and alternate form. The original form will be developed in English whereas alternate form in Bahasa Malaysia. It is to make sure two different forms are equivalent in their meaning or properties or technical qualities. Alternate form is developed to help people who do not understand English to

answer the questionnaires. This test is suitable for those who are capable in reading and writing excluding people with disabilities for instance blind or dyslexia.

No special training will be required for the test users for administering or interpreting the test because it is a clear cut statement. The test users will be able to administer and interpret the test by referring to the test manual. Moreover, the procedure does not involve stress-induced to the test taker. However, the result of the test may cause psychological harm (mental or emotion) to the test taker who feel bad about the score. Yet, debriefing and advice will be included for test takers to improve their level of gratitude.

b. Scale construction

Scaling: The items in this scale adopted a rating-scale format, referred to as a group of statement on which judgments of the strength of agreement on a particular statement is given for the respondents to choose (Cohen, Swerdlik, & Sturman, 2013).

The rating scale used was the Likert–type Scale, with five alternative responses ranging from 1 to 5. Likert scale format contain responses in term of frequency (Never, Rarely, Sometimes, Very often, Always).

CONTENT VALIDITATION A scale contains sample of items that that represent sample of population of

behaviors that reflect a construct. To know whether an item measures the construct or not. it requires an evidence. The evidence can be established via the content validation exercise. Content validation can be defined a judgement of how accurate a test samples behaviors that represent behavior from the universe that the test was designed to measure (Cohen, 2013). If the behavior does not represent the universe of behavior, the scale will be considered as no basis of evidences. According to Rico, Dios and Ruch (2012) there are several stages of obtaining content validity (1) Definition of the content domain to be assessed, (2) item construction and (3) subject matter of expert.

1. Conceptual definition of the construct The evidence can be obtained with specifically defined the construct. The guarantee of content validity evidence is depend on the accuracy and the relevance of the construct defined (Haladyna, 2004). An obscure or imprecise of the definition could lead to poor understanding and will be hard to perform critical analysis on conceptual basis.

2. Item construction There are test from the previous study but new test should be develop. The test consist an items that represent sample of population behavior relate with construct. For this study our construct is Shukur. This items should be develop based on the understanding of the original construct. This will leads to better item constructions that suit the culture. Considering the definition of a construct, new items will be develop based on the domain.

3. Subject matter expert (SME) or Domain expert This scale aimed to measure the level of “Shukur”. The items of the test were developed based on the sample of behaviors from the population. The construct that was developed is a dynamic construct. In order to get its content validity, Subject Matter Experts were involved to rate the items whether they represent the construct. Subject matter expert or

domain expert is a person who has authority and knowledge in particular area. The objective of content validation is to analyze the items which represents the construct and its relevance (Beck and Gable 2001; Mastaglia, Toye & kristtjanson, 2003). The items that been constructed will be analyze and they will respond to the question whether it essential, useful but not essential or not necessary (Cohen, Swerdlik, & Sturman, 2013). This has been proposed by Lawshe (1975) that each of the items will be rated by how essential a particular items and if the items indicate half of the panelist it will be at least some content validity. The formula that been used and develop by lawshe: Content validation rating or CVR = e - N/2 N/2 CVR= content validity ratio, e = number of panellist indicating “essential” and N= total number of panellist. CVR result can be negative, zero and positive in the result:

1) Negative CVR occurred when number of panellist is less than half of the panellist. Eg: 3/10 is less than half of the panellist.

2) Zero CVR, when exactly half the panellist indicate “essential”, the CVR is zero: Eg: 5/10 is half of the panellist

3) Positive CVR, more than half but not all the panellist indicates “essential”. Eg: 8/10 is more than half.

By using content validation rating, we will choose which item will be retain or rejected.

METHOD Participants

Ten subject matter experts from International Islamic University Malaysia were involved in this study. To be considered as experts in this area, the SMEs have to fulfil the following criteria: they must have an academic background in one of these fields: Islamic studies and Psychology. 7 SMEs who involved in content validation have academic background in psychology and the other 3 SMEs have academic background in Islamic studies. Procedures of Quantitative Content Validation

The content validation forms were distributed to each ten of subject matter experts to rate how essential a particular item was in measuring the constructs of the scale. The SMEs were requested to select an appropriate rating which reflects the level of essentiality of an item in measuring a particular domain of the construct They were to judge whether the idea or statement describe in each item is a) ‘essential’, b) ‘useful, but nor essential’, or c) ‘not necessary’ in measuring the domain of construct shukur. In the quantitative content validation procedure, CVR was calculated for the 38 items with a panel of 10 subject matter experts (SMEs) by the test developers.

RESULTS AND DISCUSSION

The content validation was conducted to measure construct shukur. The content

validation involves SMEs to rate an appropriate rating which reflects the items’ essentiality.

The Content Validaty Ratio (CVR) for the identified psychological constructs were calculated. The results of the CVR exercise are as presented in Table 2. With the size of 10 panel members, Lawshe (1975) suggested that the minimum indicator of item acceptance CVR value is 0.62.

TABLE 2 Shukur

Domain Items Content

Validity Ratio

Remark

Thankfulness I recite du’a before and after eating 0.4 Rejected

I praise Allah while observing the

beauty of nature

0.8 Accepted

I feel empathy toward the difficulty

face by others

0 Rejected

I understand the challenges that

faced by my parents in raising me

up

0.6 Rejected

I say Alhamdulillah to show my

gratitude

0.6 Rejected

I say thank you to the people who

give aid to me

0.8 Accepted

I perform sujud shukur every time I

receive a good news

0.8 Accepted

I celebrate my success by having

thanks-giving feast

-0.4 Rejected

I am really thankful for the ni’mah

that has been bestowed upon me.

0.4 Rejected

I pray for other people in my prayer 0.4 Rejected

I give charity without hesitation 0.8 Accepted

I give present to my friend -0.2 Rejected

I feed the poor people and homeless 0.2 Rejected

I have my daily schedule on

performing Ibadah (mutabaah amal)

0.8 Accepted

I reflect myself before going to sleep -0.2 Rejected

I zikir wherever I am -0.4 Rejected

I have positive thought (husnudzon)

towards other people

-0.6 Rejected

Faith I follow Prophet sunnah 0 Rejected

I believe the story narrated in the

Quran

0.8 Accepted

I believe there is reason(hikmah)

behind any circumstances

0.8 Accepted

I remember Allah in my heart 0.6 Rejected

I believe in hereafter 0.6 Rejected

I believe in angel 0.8 Accepted

I realize that knowledge comes from

Allah

0.8 Accepted

I believe that beneficial knowledge

can strengthen my faith.

0.8 Accepted

I know the Divine attribute of

Tawhid (Oneness of Allah)

0.6 Rejected

I gains knowledge by observing

Allah’s creation

-0.6 Rejected

I know the consequences if I disobey

Allah’s command

0.4 Rejected

Obedience I will perform hajj if l can afford it 0.8 Accepted

I pray to Allah as a symbol of

submission

0.8 Accepted

I fulfil Allah command 0.6 Rejected

I try my best to avoid Allah’s

prohibition

0.8

I submit to the will of Allah 0.2 Rejected

I repent if I made sins 0 Rejected

I depend Islam and its religion 0.8 Accepted

I believe blessings of parents are

blessing of Allah

0.8 Accepted

I believe Allah’s regulation are

benefit for mankind

0.8 Accepted

I believe that Allah is the Best

Planner.

0.8 Accepted

Based on Lawshe's Table (1975), there are 21 out of 38 items which CVR values are

below 0.62. The other 17 showed significant level of CVR; i.e. CVR values of 0.62 and above. The 21 items will be omitted from the scale based on the assumption made by Lawshe (1975) that a CVR of 0.00 means that 50% of the experts in the panel believe that a measurement item is “essential” and, therefore, is content valid to a certain degree. Thus, if more than 50% of the experts’ agreement is obtained the item has some reasonable degree of content validity. Using the CVR cut-off of 0.62 the final number of items retained was 17.

CONCLUSION The demonstration of content validity of a measure is a critical exercise to gauge the

extent to which an item constructed is essential in measuring the domain-in-question. The content validation exercise in the development of the Shukur scales has helped the test developers to identify the items which would be retained in the try out stage of the test development. The content was assessed using the Content Validity Ratio (CVR) (Lawshe, 1975) approach in which subject-matter experts indicated whether or not an item is essential. The judgments from the SMEs are then used to compute the CVR, which values range from -1.00 until + 1.00. A CVR of 0.00 means 50% of SMEs have judged an item to be an essential one. The item is also considered to be high in its face validity (Lawshe, 1975). In other words, the judgment on items’ essentiality by the subject matter experts has provided evidences for the content validity and clarity of the Shukur scales. Their judgments have provided evidences for the relevance of the items based on the considerable degree of agreement between opinions of the relevant SMEs. Based on the results of this process, 17 out of 38 items in three domains were confirmed. These findings imply that the developed scales are suitable for use in the study on shukur.

ACKNOWLEDGEMENT

This research was supported by the Department of Psychology, International Islamic University Malaysia (IIUM). The authors wish to express their gratefulness to the subject-matter experts for their willingness on rating the appropriateness on the items.

References Al Seheel, A. Y. (n.d). Gratitude Intervention and Happiness: An Experimental Investigation on

IIUM Students. Retrieved from http://bsris.swu.ac.th/iprc/8th/115_126_04_Ali.pdf Aghababaei, N., & Tabik, M. T. (2013). Gratitude and mental health: differences between

religious and general gratitude in a Muslim context. Mental Health, Religion & Culture, Beck, C.T. and Gable, R.K. (2001). Ensuring content validity: An illustration of the process.

Journal of Nursing Measurement, 9, 201-215. Cohen, R. J., Swerdlik, M. E., & Sturman, E. (2013). Psychological testing and assessment: An to

tests and measurement (8th ed.). New York, NY: McGraw Hill.

Haladyna, T. (2004). Developing and validating multiple-choice test items. New York: Lawrence Erlbaum Associates

Ibn Qayyim al-Jawziyyah, 1997. Patience and Gratitude. Retrieved from http://www.missionislam.com/knowledge/books/Patience_and_Gratitude.pdf

Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563-575.

Muhammad Abdullah, (2012, October 26). From Taqwa to Istiqamah, Our Doors to Sustenance. The Brunei Times. Retrieved from http://www.bt.com.bn/files/digital/Islamia/Issue223/BT26Oct.4.pdf

Rico, E. D., Dios, H. C., & Ruch, W. (2012). Content validity evidences in test development: An applied perspective. International journal of clinical and health psychology, 12(3), 449-460.

Satria,J.P. (2014) Syukur : Sebuah Konsep Psikologi Indigenous Islami. Jurnal Pemikiran dan Penelitian Psikologi, Vol. 7, No. 2, 35-44. Retrieved from http://www.ejournal-unisma.net/ojs/index.php/soul/article/view

Sylva,F. (2009). Submitting to God: Women and Islam in Urban Malaysia. Malaysia, NIAS Press. Retrieved from https://books.google.com.my/books?id=jqqBn3pqiZkC&printsec=frontcover&source=gbs_ge_summary_r&cad=0#v=onepage&q&f=false

Wood, A. M., Froh, J. J., & Geraghty, A. W. A. (2010). Gratitude and well-being: A review and theoretical integration. Clinical Psychology Review, 2-16. doi:10.1016/j.cpr.2010.03.005