Upload
hatuyen
View
217
Download
0
Embed Size (px)
Citation preview
Factors AffectingtheEffectivenessof
WebSAMSinHongKongSecondarySchools
By
LeungCheukKwan
03007189
InformationSystemsManagementOption
AnHonoursDegreeProjectSubmittedtotheSchoolofBusinessin
PartialFulfillmentoftheGraduationRequirementfortheDegreeof
BachelorofBusinessAdministration(Honours)
HongKongBaptistUniversity
HongKong
April2006
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools i
Acknowledgement
I must take this opportunity to express my gratitude to my project supervisor, Dr.
TonyC.K.Wong.Hecouldunderstandandtakeuptheprogressofmyresearchstudy
rapidly and provided many valuable feedbacks in a pretty professional manner to
facilitatemyresearchstudy.Thoughhewasextremelybusy,hecouldstillbewilling
tocontributehisvaluabletimeonmy research.
Iwouldalsoliketogiveappreciationtomypreviousprojectsupervisor,Ms.SharonS.
F. Tang. She helped me a lot in preparing the early work of my research study,
especiallyprovidingrecommendationsinfindingusefulmaterials.
Iwasalsogratefultothosesecondaryschoolsteachersandadministrativestaffwhich
hadtakentheirvaluabletimeinrespondingthequestionnaires.Withouttheirsupports,
Icouldnotbeabletofinishtheresearchstudy.
Through theproject, Ihave learnthowto conduct aresearchstudy formally. Ihave
beenmorefamiliarwiththesourceofjournalsandthewaytoreadandanalysisthose
literatures.Theprojectalsogavemeachancetolearnpracticalstatisticanalysisskills,
whichcouldbeveryusefulinthefuturecareerorhigherstudy.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools ii
Abstract
WebSAMS(WebSchoolAdministrationandManagementSystem) isa newonline
schoolmanagement information system launched by Hong Kong S.A.R. Education
andManpowerBureau(EMB)in2003.Itwasexpectedto improvetheefficiencyof
schooladministrativeworksandthecommunicationsbetweentheschoolsandEMB.
Unfortunately,thesystemwascomplainedlargelythatitwasnoteffectiveenoughto
bring in the expected benefits to the schools. This research paper is hereby to
investigate the influential factors that would affect the system effectiveness of
WebSAMS, so that appropriate steps could be taken thereafter to improve the
effectivenessofWebSAMS.
Thisstudymadeuseof thegoalcenteredviewandthesystemsresourceviewfrom
the literature review to define the system effectiveness.Aquestionnaire surveywas
conducted, which had collected the responses from 119 WebSAMS Users from
different secondary schools in Hong Kong. The survey result focused on how
WebSAMS users perceived the five factors (system quality, information quality,
servicequality,presenceof real timesupportandpresenceof training)wouldaffect
theperceivedusefulnessandtheusersatisfactionofWebSAMSandeventuallyaffect
theeffectivenessofWebSAMSinHongKongsecondaryschoolswithreferenceto the
literaturereview.
Theresearchresultsuggestedthatthesignificantfactors,includingthesystemquality,
presenceofrealtimesupportandpresenceof training,wouldpositively affecttheuser
satisfaction and eventually increase the effectiveness of WebSAMS, which proved
thatthesystemsresourceviewisvalidinthisstudy.Theresultfurtherprovedthatthe
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools iii
system quality is themost vital factor in affecting the effectiveness ofWebSAMS,
whichwassameastheresultofthefivefactorspriority rankingby therespondentsin
the survey. Therefore in order to improve the effectiveness of WebSAMS
fundamentally,EMBandtheWebSAMSofficialunitwererecommendedtoimprove
the WebSAMSs system quality by minimizing the existing system bugs and
upgradingtheserverhardware,andcomplementthesystemqualitybyprovidingmore
adequaterealtimesupportandtrainingtotheWebSAMSusers.
Last but not least, the research result showed us that perceived usefulness is
insignificant to affect the users intention to useWebSAMS, which indeed is also
insignificanttoaffecttheeffectivenessofWebSAMSaltogether,whichindicatedthat
thegoalcenteredviewisnotapplicableinthisstudy.
Keywords:educationalIT,schoolmanagement,systemeffectiveness,WebSAMS
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools iv
TableofContent
1. Introduction 1
2. Objectives 2
3. LiteratureReview 3
4. ResearchMethodology 15
5. Resultsandfindings 19
6. ImplicationsandDiscussions 30
7. Limitations 32
8. Conclusion 32
9. Recommendations 34
References 36
AppendixA:FunctionsofWebSAMS 44
AppendixB:MeasurementItems 47
AppendixC:QuestionnaireSample 53
Appendix D:StatisticData 56
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 1
1. Introduction
Nowadays, information technology has been widely popularized and applied in
educational area. Different kinds of school management information systems1 were
implemented in facilitatingschooladministrationbymanydifferenttypesofschools
throughout the world in the recent decade (Kalay & Chen, 2002). The
computerization of school administration has therefore become a central issue in
currentschoolmanagement.(Telem,1999)
InHongKong, since the educational policy SchoolBasedManagement (SBM) has
beenintroducedtoallsecondaryschoolin1999,theschoolshavegotmorelibertyin
administrative management. To facilitate SBM, Education and Manpower Bureau
(EMB) has introduced the Web School Administration and Management System
(WebSAMS)since2003,whichexpectedtoprovidetheappliedschoolswithcertain
planning and operational functions needed in many areas such as general
administrationandstudentaffairs.Mostsecondaryschools(94.6%)haveadoptedthe
systembecauseofthepromotionofEMBinthesetwoyears(EMB,2005).Therefore,
WebSAMS has become the main school management information system used for
administrationbysecondaryschoolsinHongKong.
The idea ofWebSAMS is through a central internetbased system and database, to
helptheschoolsontheadministrativeactivitiesespeciallyonthetimeconsumingdata
processing and data exchange (EMB, 2005). However, the situation is not so
optimistic.There isanewsreport(SingPaoDailyNews,Mar3,2004)showedsome
WebSAMSuserscomplained that thenewsystemwas notyetperfect foroperation.
1 ExamplesincludeOverseerbyRobustSoftwareInc.,SchoolGenbyEdvantageIndiaSoftwareSolutionandSchoolWritebyBBASoftware.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 2
They claimed a lot of problems have been aroused when using the system. For
examples, lack of expected data2 which should be included on the exam report,
hardwarefailurebecauseofbigamountofdataprocessing,theexistenceofbugs,etc.
Besides, users could not master the system well due to insufficient support. The
effectiveness of WebSAMS was consequently affected. Absolutely, this is not the
desiredoutcome.Thoughthepublicisinterestedininvestigatinghowtomeasureand
improve the effectiveness of WebSAMS efficiently, most people realize that
measuring information system effectiveness is not an easy task. (Visscher and
Bloemen,1999)
2. Objectives
This paper is going to take up the challenge in discovering and investigating the
practicalfactors that canmeasureandaffect theeffectivenessofWebSAMS,sothat
theWebSAMSdeveloperswouldhaveareferenceonimprovingthesystem.DeLone
andMcLean(1992,2003)haddevelopedanISSuccessModelinordertomeasurean
information systems performance. It has been widely adapted by IS researchers.
(DeLone and McLean, 2003) By further applying the model in this study, we are
going to look at what factors are significantly affecting the effectiveness of
WebSAMS in Hong Kong secondary school. Possible factors affecting system
effectivenesswillbefoundfromliteraturereview.Surveywillbeconducedtoobtain
currentWebSAMS users perception on these factors. By analyzing the results and
findings, some suggestions will be made for improving the effectiveness of
WebSAMSinHongKongsecondaryschool.
2 Examplesoflackingexpecteddataincludeextracurricularactivitiesrecord,awardsandpunishmentsrecordandtotalnumberofstudentsineachform.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 3
Besides, it is obvious that management information systemhas taken an important
role in educational management in this recent. However, there is still insufficient
researchonconductinganevaluationoftheeffectsofthesesystemsonadministrative
activities in the school (Kalay & Chen, 2002). Therefore this paper is hoped to
contribute to the inadequate literature libraryabout the effectiveness of information
systemsineducationaladministration.
3. LiteratureReview
3.1WebSAMS
WebSAMS,short forWebSchoolAdministrationandManagementSystem, isa
web based school management information system introduced by Hong Kong
S.A.R. Education andManpower Bureau (EMB) since 2003. It totally costs 30
millionsHongKongdollarsforthewholedevelopment.Thelatestversionis4.8.
(EMB,2005)
WebSAMSrequirestwoDedicatedServers:WebSAMSandHTTPServer.Every
school has to install both servers in order to useWebSAMS.Table 1 shows the
basichardwareandsoftwarerequirementforbothserversineachschool.
WebSAMSServer HTTPServer
CPU PIII600MHz PII400MHz
RAM 1GBRAM 128MBRAM
Harddisk 3x9GB 4GB
Other Windows2000
Backup
AntiVirusSoftware
ExistingSAMSServer
PCclass
Table1.BasicHardwareandSoftwareRequirementsforWebSAMS
(Li,2003)
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 4
3.2ArchitectureofWebSAMS
WebSAMSprovidestheusersaninterfacetoinputandretrievethedataneededby
theschools.Brieflysayingthere isaWebSAMSserverstoringall thedataasan
internal center and a HTTP server serving the external communication in each
school. The Internet users are connecting to the school network via an internet
gatewaywhichprovidestheIPpacketfilteringandNetworkAddressTranslation
(NAT) functions.Usually the schoolswill use a routerwith firewall or a proxy
serverasaninternetgateway.Theschoolnetworkisdividedbyarouterintotwo
segments: intranet and internet segments. WebSAMS is only connecting to the
school server and form an intranet network, but not directly connecting to the
public internet network. Internet users must have authority to connect to the
school network via theHTTP server and then eventually connect toWebSAMS
serverviaaninternalfirewallprotectedrouter.
Internet
W ebSAMSServer HTTPServerW ebSAMSPCs ITEdPCs
W ebSAMSSwitch ITEdSw itchRouter/Firew allintegratingW ebSAMS& ITEdsegments
InternetUsers
ISPModem /Transceiver
InternetGateway
WebSAMSSegm ent
ITEdSegment
Figure 1.Networking Infrastructure betweenWebSAMS, schools and the internet
users(EMB,2003)
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 5
3.3FunctionsofWebSAMS
According to WebSAMS Central Document Repository, WebSAMS mainly
providesthefollowing16functionalareas3:
1. Attendance 2. Award&Punishment
3. CodeManagement 4. Communication&DeliverySystem
5. DataManagement 6. FinancialMonitoring&Planning
7. HongKongAttainmentTests 8. HKEAA
9. ReportManagement 10.SchoolManagement
11.SchoolPlacesAllocation 12.SpecialAssessment
13.Staff 14.StaffDeployment
15.Student 16.StudentActivities
3.4DefinitionofEffectiveness
Itwassofaradifficultissuetodefineandmeasureeffectivenessintheviewofan
informationsystem(VisscherandBloemen,1999).Pyzdek(2003)suggestedthat
the effectiveness of a system is a result of three elements, they are reliability,
availability and design capability. However they are not general enough to
conclude what effectiveness is. Typically Grover, Jeong and Segars (1996)
suggested some representative definitions of IS effectiveness based on previous
literature and analysis. The first one is based on the goalcentered approach,
whichdefinesISeffectivenessasthedegreetowhichtheobjectivesofsystems,
ortheorganizationalunitutilizingthesystems,areachieved(p.180).Thesecond
definition is based on the systems resource approach and defines that IS
effectiveness is determined by the attainment of a normative state [ideal case]
ratherthantheachievementifspecifictaskobjectives(p.180).
3 ExamplesofUseineachfunctionalareaarelistedinAppendixA
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 6
l TheGoalCenteredView
InthegoalcenteredviewwefocusontheoutcomesoftheITfunction.We
determinethetaskobjectivesofthesystemandthenestablishthecriteriafor
measuringwhethertheseobjectiveshavebeenachieved.(Groveretal.1996)
l TheSystemsResourceView
Inthesystemsresourceviewwefocusontheprocessorfunctionalaspects
of thesystem. In thiscaseeffectiveness ismeasuredagainst such thingsas
userjobsatisfaction,communicationbetweenITstaffandusers,andquality
ofservice.(Groveretal.1996)
Therefore, this study will be based on these two definitions, to see how other
factorsaffectingtheeffectiveness.Thefactorswillbegroupedintosystemfactors
andexternalfactors.
3.5DeLoneandMcLeanISSuccessModel
The original model (Figure 2) was first developed in 1992 by DeLone and
McLean.Sincethen,nearly300articlesinreferredjournalshavereferredtoorgot
useofthemodel(DeLoneandMcLean,2003),thusit isastrongevidenceofthe
widepopularityof thismodel.Themodeloffered acompleteandcoherent,yet
conceptualdepictionoftheinterdependentsuccesscomponents inaninformation
system.(Grembergen,2001).Withreferencetothe later literaturesreviewsand
criticsonthemodel,DeLoneandMcLeanrevisedtheISSuccessModel in2003
(Figure 3) by adding service quality as well as intention to use and replacing
individual impact and organizational impact with a new construct, net benefits.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 7
Themodelwasusedtoexplainthesignificanceofthemeasureddimensionstothe
informationsystemsuccessaswellasitseffectiveness.
Figure2. TheoriginalD&MISSuccessModel(DeLoneandMcLean,1992)
Figure3.UpdatedD&MISSuccessModel(DeLoneandMcLean,2003)
Ononehand, it isobviousthattheISSuccessmodel isnotspecificallyaimedto
school management information system originally. On the other hand, it rather
focusesonhowthesystemaffects theusersusewithoutattempttoincludehow
theusersaffecttheeffectivenessof thesystem.Thereforerelevantfactorsshould
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 8
be added to the model in order to increase its descriptive power on the
effectivenessofWebSAMSbothfromthesystemssideandtheuserssideofview.
Model for effective use of a school management information system was
developed by Barret (1999)in order to explain how external factors affect the
effectiveness of a studentmanagement information system.The external factors
used in that model ,including presence of training and presence of real time
supportarevaluableforreferencetothemodifiedD&MISSuccessmodelwhich
will be used in this study in order to investigate the factors affecting the
effectivenessofWebSAMSfromtheusersside.
3.6FactorsaffectingEffectiveness
SYSTEMFACTORS
I. InformationQuality
Pitt,WatsonandKavan(1995)pointedoutthatfortheusers,theinformation
is paramount and the deliverymechanism secondary.Kaydos (1998) stated
thatoneof themost important factorsaffecting themeasurementof system
effectiveness is how relevant the information is. Chang and King (2005)
mentioned that measures of information effectiveness are to assess the
quality of the information provided by IS as well as the effects of the
information on the users job. Therefore, with higher information quality,
usersaresupposedtobemoresatisfiedwiththesystemandthinkthesystem
ismoreuseful.
Wang and Strong (1996), Chang and King (2005) proved the significant
relationship between accessibility, contextual quality, flexibility, intrinsic
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 9
quality, presentational quality, reliability, usefulness and the information
quality.Themeasure items of information quality that previous researchers
havesupportedweresummarizedasinTable2.
MeasureItems Definitions Reference
Accessibility Whethertheoutputinformationwouldbe
approachedwhenevertheusersdemand
forit.
[6],[16],[43]
ContextualQuality Whethertheoutputinformationis
consistentwiththeotherinformation
providedbythesamesystem.
[6],[16] ,[43]
IntrinsicQuality Qualityoftheinformationcontent. [6],[16] ,[43]
Presentational
Quality
Materialdesignandthelayoutofthe
outputinformation.
[6],[16] ,[43]
Reliability Correctnessoftheoutputinformation [6],[16] ,[43]
Usefulness Usevalueoftheoutputinformation. [16] ,[43]
Table2.Suggestedmeasureitemsofinformationquality
II. SystemQuality
MeasuresofSystemQualitytypicallyfocusonperformancecharacteristics
of the system under study (Association for Information Systems). Nelson
andTodd (2005)claimed that information quality is relatedmost closely to
theoutputofanIS,systemqualityreflectstheinformationprocessingsystem
required to produce that output. Thus, the dimensions of system quality
represent user perceptions of interactionwith the system over time. In this
sense, higherquality systems should be perceived as easier to use and,
ultimately,havehigherlevelsofusefulnessanduse.
McLean and DeLone (2003) stated that System quality was measured in
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 10
terms of easeofuse, functionality, reliability, flexibility, data quality,
portability, integration, and importance. While the Association for
InformationSystemsclaimedthatservicequalityshouldincludethemeasure
of adaptability and response time as well. The measure items of system
quality that previous researchers have supported were summarized as in
Table3.
MeasureItems Definitions Reference
Adaptability Theeaseofadaptingthenewchanged
modeofworkingduetothesystem.
[44]
EaseofUse UserFriendly. [6],[8],[25],
[37],[44]
Flexibility Thequalityofthesystemtobechangedto
fitthecircumstance.
[6],[8],[44]
Functionality Varityofthesystemfunctions [8],[44]
Integration Theabilityofthesystemtobe
incorporatedintothecommunity
[8],[44]
Reliability Whetheritisdependableforwork [8],[44]
ResponseTime Elapsedtimebetweenuserrequestandthe
systemreply.
[6],[44]
Table3.Suggestedmeasureitemsof system quality
III. ServiceQuality
Pittetal.(1995)observedthatcommonlyusedmeasuresofISeffectiveness
focusontheproductsratherthantheservicesoftheISfunction.Thus,there
isadangerthatISresearcherswillmismeasureISeffectivenessiftheydonot
include in their assessment package a measure of IS service quality This
observation indicated that servicequality isan important factor inaffecting
the effectiveness of the information system. That was why DeLone and
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 11
McLean (2003) responded to the literatures which have similar views and
updatedtheISsuccessmodelwithadditionalfactorofservicequality.
Liu andAmett (2000) stated that service quality is refer to responsiveness,
assurance, empathy, and followingup service. Moller and Licker (2001)
claimed that service quality can also be measured by the effectiveness of
online support capabilities, such as answers to frequently asked questions
and customized site intelligence. Themeasure items of service quality that
previousresearchershavesupportedweresummarizedasinTable4.
MeasureItems Definitions Reference
Assurance Knowledgeandcourtesyofemployees
andtheirabilitytoinspiretrustand
confidence.
[20],
[29],[31]
Empathy Caring,Individualizedattentionthe
serviceprovidergivesitscustomers.
[20],
[29],[31]
FollowingupService Subsequentserviceoncaringthe
problemofthecustomer
[20], [29]
Responsiveness Willingnesstohelpcustomersand
providepromptservice
[20],[29],[31]
Effectivenessof
onlinesupport
capabilities
Onlinesupportcapabilities,such as
answerstofrequentlyaskedquestions
andcustomizedsiteintelligence.
[22]
Table4.Suggestedmeasureitemsof ServiceQuality
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 12
EXTERNALFACTORS
IV. PresenceofRealTimeSupport
Inthisstudythescopeofrealtimesupportwouldmeanthepeoplearoundthe
userscanproviderealtimetechnicalsupporttotheuserswhenevertheusers
get some difficulties or problemswhen using theWebSAMS.Higgins and
Compeau (1995) found that support has a positive effect on the user
expectationandthesystemsperformancefortheobjective.Insuch,realtime
support is an important factor to affect whether the system could perform
effectively.
V. PresenceofTraining
Studiesby Barrett(1999)showedthateitherrequestforadditionaltrainingor
lack of training were the major opinions collected from the questionnaire
whichwouldbeabarriertoeffectiveness.Thatisobviousthathowgoodthe
systemis,andhownicetheuserinterfaceis,stillareuselessunlesstheusers
are welltrained with the system and the interface for an effective
performance.
OTHERFACTORS
VI. PerceivedUsefulnessforObjective
Perceived Usefulness was originally one of the constructs in the Daviss
TAMmodel (1989). It isdefinedasthedegree towhichapersonbelieves
thatusingaparticularsystemwouldenhancehisorherjobperformance.In
this study,perceivedusefulness forobjective isaddedandexpected tobea
factor to affect the system effectiveness because of the goalcentered
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 13
approach(Groveretal,1996).Perceivedusefulnesswasfoundthatitdirectly
affecttheintentiontocomputeruseasstatedintheTAM.(Calisir,2004)
VII.UserSatisfaction
UserSatisfactionisknownastherecipientresponsetotheuseoftheoutput
ofanIS.(Arnold,1995)Thestudy resultsof Calisir(2004)indicatethatboth
perceived usefulness and learnability are determinants of enduser
satisfaction.Bhattacherjee(2001)alsostatedthatusersatisfaction,inturn,is
influenced by their confirmation of expectation from prior IS use and
perceivedusefulness.Besides, the empirical resultsof the study bySeddon
(1997)providesubstantialsupportforthe"upstream"twothirdsofDeLone
and McLean's model. Three factors, System Quality, Information Quality,
andUsefulness,arefoundtoexplain75%ofthevarianceintheoverallUser
Satisfaction measure. DeLone and McLean (2003) proved that user
satisfactionisthefactoraffectingthenetbenefitsin theISSuccessModel.
VIII. IntentiontoUseandUse
Intention to use is an attitude, whereas use is a behavior. As DeLone and
McLean(2003)saidattitudes,andtheirlinkswithbehavior,arenotoriously
difficulttomeasureThereforeIntentiontoUseandUsearecombinedin
the study. Intention to use and use were found that they will significantly
affecttheISnetbenefits.(Rai,LangandWelker,2002)
IX. NetBenefits
Net Benefits was originally a term specified by Seddon (1997) in his
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 14
characterizationoftheoutcomesintheD&MISSuccessModel.Itwasbeing
used in theUpdatedD&MISSuccessModel toreplace the term Impact.
AccordingtoDeLoneandMcLean(2003),thetermNetBenefitsiswholly
positive, without any negative consequence. However, the context of Net
Benefits did not being specified in the model due to the possibility of
different opinions on what constitutes a benefit. Therefore DeLone and
McLean (2003) claimed that The focus of any proposed study must be
definedbut eachmay have a very different definition ofwhat constitutes
net benefits and thus IS success. In other words, It merely transfers the
needtospecifythefocusofanalysistotheresearcher.Followingthisclaim,
wecanspecifythefocusofNetBenefitsaccordingtoourstudysfocus.In
thisstudy,wearegoingtofocusontheeffectivenessoftheWebSAMSasits
netbenefit,thusthemeasureofNetBenefitwillbemainlyfocusedonthe
effectivenessofWebSAMS.
Grover et al. (1996) argue that IS effectiveness is related to the extent to
whichISsatisfiestherequirementsoforganizationsmembers.Theempirical
resultsofthestudybySeddon(1996)alsoprovidesubstantialsupportforthe
useofUsefulnessasan ISSuccessmeasure, andof thehithertounreported
importanceof"Importanceofthetask"inuserperceptionsofISUsefulness.
Therefore user satisfaction and perceived usefulness should be positively
relatedtoeffectiveness.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 15
4. ResearchMethodology
4.1 TheoreticalFramework
The researchmodelwill be constructedwith reference to the literature reviewwith
relative hypothesis. The model is based on the Updated D&M IS Success Model
developedbyDeLoneandMcLean(2003).
Basedontheliteraturereview,18itemswereidentifiedtoaffecttheeffectivenessof
informationsystemandweregroupedintothe3factorsfromtheoriginalISSuccess
Model(InformationQuality,SystemQuality,ServiceQuality)andweresummarized
inTable5.
Factors Elements
InformationQuality Accessibility,ContextualQuality,
IntrinsicQuality,PresentationalQuality,
Reliability,Usefulness
SystemQuality Adaptability,EaseofUse,Flexibility,
Functionality,Integration,Reliability,
ResponseTime
ServiceQuality Assurance,Empathy,Effectivenessof
OnlineSupportCapabilities,
FollowingupService,Responsiveness
Table5.Factorsaftergrouping
The 3 system factors plus 2 external factors (presence of real time support and
presenceoftraining)formthefundamentalconstructsintheresearchmodelwhichare
affecting theperceivedusefulness forobjectiveanduser satisfaction,andeventually
affectingtheintentiontouse/useandthenetbenefits.Thetheoreticalmodelisshown
asbelow:(Figure4)
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 16
Figure4.ResearchModel
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 17
Hypothesizesaredrawnfromthetheoreticalmodeltodeterminetherelationship
betweendifferentfactors:
H1a:InformationQualityispositivelyrelatedtotheperceivedusefulnessforobjective
H1b:InformationQualityispositivelyrelatedtotheusersatisfaction
H2a:SystemQualityispositivelyrelatedtotheperceivedusefulnessforobjective
H2b:SystemQualityispositivelyrelatedtotheusersatisfaction
H3a:ServiceQualityispositivelyrelatedtotheperceivedusefulnessforobjective
H3b:ServiceQualityispositivelyrelatedtotheusersatisfaction
H4a:PresenceofRealTimeSupportincreaseperceivedusefulnessforobjective
H4b:PresenceofRealTimeSupportincreaseusersatisfaction
H5a:PresenceofTrainingincreaseperceivedusefulnessforobjective
H5b:PresenceofTrainingincreaseusersatisfaction
H6:PerceivedUsefulnessforObjectivewillpositivelyrelatetoIntentiontoUseandUse
H7:IntentiontoUseandUsearepositivelyrelatedtoUserSatisfaction
H8:IntentiontoUsewillpositivelyrelatetonetbenefits
H9:UserSatisfactionwillpositivelyrelatetonetbenefits
As mentioned earlier, the study is based on the goalcentered view and the systems
resourceviewtodefinesystemeffectiveness.Thereforetheresearchmodelisdesigned
tocoverbothviewsinaffectingthesystemeffectiveness.Thepathsaresummarizedas
intable6.
Path ViewH1a,H2a,H3a,H4a,H5aH6H8 GoalCenteredViewH1b,H2b,H3b,H4b,H5bH9 SystemsResourceViewTable6.Thepathsforthetwoviewsindefiningsystemeffectiveness
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 18
4.2Sampling
ThetargetsofthequestionnaireweretheusersofWebSAMSfromdifferentsecondary
schools in Hong Kong. Concerning different WebSAMS application environment in
different secondary schools might contribute different results, coverage as many
differentsecondaryschoolsWebSAMSuserssamplesaspossiblefromall18districts
inHongKongwas preferred.Subject to the financial and time limit, therewas some
selection rules applied during the choices of targeted schools. Firstly, the
questionnaires targets focused on all the Governmentaided secondary schools4,
becausemost (376/572, 66%)of the secondary schools inHongKong are belong to
Governmentaided secondary school (EMB, 2005). Then, in each district, out of all
listedGovernmentaided secondary schools fromEMB (2005), at least 50%of those
were selected. The decision of those at least 50% schools was simply following the
alphabeticalorder and select the schools from the top half of the list in each district.
Thenumberoftargetedschoolsandselectedschoolsin each districtisshownintable7.
4.3ResearchDesign
The questionnaires5 aim to obtain users opinion based on their fresh experience of
usingWebSAMSgenerally.Therefore respondentswhohavenotusedWebSAMS for
sixmonthsormorearenotexpectedtoanswerthequestionnaires.Questionswillbe
4 In this study, the schools which belong to the following categories are excluded fromGovernmentaidedsecondaryschoolsascategorizedbyEMB:1. DirectSubsidy Scheme Secondary Schools,2. PrivateSecondarySchools(Day/Evening),3. GovernmentSecondary Schools,4. Caput Secondary Schools,5. EnglishSchoolsFoundation(Secondary)
5 ThemeasurementitemsinquestionnairesarelistedinAppendixBandaquestionnairesampleisshowninAppendixC.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 19
Region District TotalNumberoftargetedschools
TotalNumberofselectedschools
Central&Western 8 4HongKongEast 24 12Islands 10 5Southern 16 8WanChai 11 6
HongKong
Subtotal 69 35KowloonCity 28 14KwunTong 25 13SaiKung 18 9ShumShuiPo 15 8WongTaiSin 22 11YauTsimMong 12 6
Kowloon
Subtotal 120 61North 17 9ShaTin 39 20TaiPo 20 11
NewTerritoriesEast
Subtotal 76 50KwaiChung&TsingYi 31 16TsuenWan 13 7Tuen Mun 36 18YuenLong 31 16
NewTerritoriesWest
Subtotal 111 57Total 376 203
Table7.QuestionnairesTargetedandSelectedSampleSize
askedrelatingtothefivefactors(InformationQuality,SystemQuality,ServiceQuality,
RealTimeSupportandPresenceofTraining)affectingtheeffectivenessofWebSAMS.
Ontheotherhandthepriorityofthefactorswillbeasked.23questionnairesweresent
directly to every selected school by mass post. The respondents might fill in their
representing schools name, but it was not mandatory. Thus the respondents could
reserve the right to choose whether disclosing the responses for their representing
schoolsorasanonymoususers.
5.ResultsandFindings
5.1RespondentsBackground
There are 119 respondents in total, 116 out of those are valid respondentswho have
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 20
finished the questionnaires completely6 and returned the questionnaires successfully.
Table8showsthesummaryofthebackgroundofthe116validrespondents.
Theagedistributionshowsthatthereisnotanyseriousageunbalanceexist.76.7%of
therespondentsweremale.Thiswasprobablybecausetheschoolshavedistributedthe
questionnaires to the teachers and school staff that are known to be related to
informationtechnologyintheirschoolsandwhoaremostlymale.Onlyasmall8.6%of
therespondentsareexpertincomputerskill,whichmeansthatthesurveyresponsedid
notcontainseriousprofessionalbiaswhichisdifferentfromnormalsystemuser.
Variables Frequency(validn=116) ValidPercentAge1925 16 13.82630 29 25.03135 11 9.53640 15 12.94145 20 17.24650 14 12.151orabove 11 9.5
GenderMale 89 76.7Female 27 23.3
ComputerSkillRookie 31 26.7Intermediate 38 32.8Advance 37 31.9Expert 10 8.6
WebSAMSAdministratorYes 65 56No 51 44
TimesSpentonWebSAMS(AverageWorkingdays)AlmostNever 2 1.7Lessthanhour 65 56.0Fromhourto1hour 22 19.012hours 18 15.5Morethan2hours 9 7.8
Table8. Validrespondentsbackgroundinformation
6 FinishedcompletelymeansthattherespondentsdidnotneitherchoseWebSAMSwasnotinstalledinmyschoolnorIdidntuseWebSAMSforatleast6months.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 21
AlmosthalfoftherespondentsarenotWebSAMsAdministratorsandtheotherare,this
showsthatthesurveycanreflecttheopinionsbothfromtheadministratorssideandthe
users sideevenly.Only about2%ofthe respondentshadalmostnever spent timeon
WebSAMS on average working days, which indicates that most respondents have
sufficientWebSAMSexperiencetoanswerthequestionnaires.
5.2DescriptiveStatisticandNonparametricTest
Table 9 shows the priority of importance towards the five factors affecting the
effectiveness of WebSAMS from the respondents. The five factors affecting the
effectivenessofWebSAMSwereprioritizedbytherespondentsforbyranking from1
to5(5:mostimportant,1:leastimportant).
Accordingtotheprioritygivenbytherespondents,theythinkthatthemost important
factoraffectingtheeffectivesofWebSAMSwastheSystemQualitywithameanpoint
of4.05andtheleastfactorwasthePresenceofTrainingwithameanpointof2.28.The
resultofFriedmantestandKendallsW(AppendixD)showthattheimportanceofthe
fivefactorsisdifferent(significance=0.000
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 22
The respondents mean score of each measurement items in the five factors are
calculated and summarized in each factors reliability test result in Appendix D.
Generallyalmostallofthemeanscoresareatleast largerthanzeroina7pointsscale
range from3 (Mostlydisagree) to3 (MostlyAgree), except thetwo items in system
quality, theyarethe inexistenceofsystembugsandacceptableelapsedresponsetime,
which have the negative mean scores of 0.33 and 0.41 respectively. The result
indicated that the problems of system bugs existence and unsatisfactory elapsed
responsetimearepresent.
5.3ReliabilityandValidity Test
The Factor Structure Matrix Model shown on Figure 5 presents the individual item
loadings and cross loadings, and shows that the individual item loadings and internal
consistenciesmeetorexceedthe0.7criteria(FornellandLarcker,1981)except3cases.
However, given that the overall statistics were adequate, it was felt that a set of
measurement revisionswould be inappropriate (Compeau andHiggins, 1995). It also
showsthatnoneoftheindividualitemsloadmorehighlyonanotherconstructthanthey
do on the construct they were designed to measure, which were surrounded by the
rectangleareas.Table10showsthereliabilitytestresultamongthe9constructsinthe
researchmodel.TheseconstructsdisplayedCronbachsAlphaBasedonStandardizedItems
above0.7,whichsuggestsasatisfactorylevelofreliability(Nunnally,1978)
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 23
Figure5.FactorStructureMatrixModel
CronbachsAlphaBasedonStandardizedItemsInformationQuality 0.924SystemQuality 0.883ServiceQuality 0.922RealTimeSupport 0.908Training 0.922PerceivedUsefulness 0.972UserSatisfaction 0.937IntentiontoUse/Use 0.703NetBenefits 0.960
Table10.ReliabilityTestResult
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 24
5.4HypothesesTest
A.Theeffectof thefivefactors: InformationQuality,SystemQuality,ServiceQuality,
PresenceofRealTimeSupportandPresenceofTrainingaretheindependentvariables
determiningthedependentvariablePerceivedUsefulness:
Figure6.ResultofRegression(5FactorsagainstPerceivedUsefulness)
Hypotheses BetaValue PValue
(1Tailed)
Result
H1a InformationQualityispositively
relatedtotheperceivedusefulness
forobjective
0.151 0.917 NotSupported
(pvalue>0.05,
beta0.05)
H4a PresenceofRealTimeSupport
increaseperceivedusefulnessfor
objective
0.236 0.003 Supported
(pvalue0)
H5a PresenceofTrainingincrease
perceivedusefulnessforobjective
0.202 0.011 Supported
(pvalue0)
Table11.ResultofRegressionforthe5hypothesesH1a,H2a,H3a,H4a,H5a
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 25
Figure 6 shows the SPSS regression result of the five factors against Perceived
Usefulness.WithaRof0.628,62.8%oftheperceivedusefulnesswasexpectedtobe
predictedbythe five factors.Table11concludes theresultof theregression for the5
hypotheses.TheresultsuggeststhatH2a,H4aandH5aweresupportedwithsignificant
coefficients and positive beta values. On the other hand H1a and H3a were not
supportedwithinsignificantcoefficient.
B.Theeffectof thefivefactors: InformationQuality,SystemQuality,ServiceQuality,
PresenceofRealTimeSupportandPresenceofTrainingaretheindependentvariables
determiningthedependentvariableUserSatisfaction:
Figure7.ResultofRegression(5FactorsagainstUserSatisfaction)
Figure7showstheSPSSregressionresultofthefivefactorsagainstUserSatisfaction.
WithaRof0.590,59%of theuser satisfactionwasexpected tobepredictedby the
five factors.Table12concludestheresultof theregression for the5hypotheses.The
resultsuggeststhatH2b,H4bandH5bweresupportedwithsignificantcoefficientsand
positivebetavalues.OntheotherhandH1b,H3bwerenotsupportedwithinsignificant
coefficient.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 26
Hypotheses BetaValue PValue(1Tailed)
Result
H1b InformationQualityispositivelyrelatedtothe usersatisfaction
0.035 0.612 NotSupported(pvalue>0.05,beta0.05)
H4b PresenceofRealTimeSupportincrease usersatisfaction
0.293 0.001 Supported(pvalue0)
H5b PresenceofTrainingincrease usersatisfaction
0.182 0.033 Supported(pvalue0)
Table12.ResultofRegressionforthe5hypothesesH1b,H2b,H3b,H4b,H5b
C.TheeffectofthePerceivedUsefulnesstowardsIntentiontoUse/Use:
Figure8.RegressionResultof PerceivedUsefulnessandIntentiontoUse/Use)
From the SPSS regression result in Figure 8, with a R of 0.015, only 1.5% of the
intentiontouseandusewasexpectedtobepredictedbytheperceivedusefulness.We
can findthattherelationship isnotsignificantenoughwithasignificantcoefficientof
0.092>0.05.Thustherelationship issuggestedtobeinsignificant.HypothesisResult
isshowninTable13.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 27
D.TheeffectoftheIntentiontoUse/UsetowardsUserSatisfaction:
Figure9.RegressionResultof IntentiontoUse/UseandUserSatisfaction)
Atthesametime,fromtheSPSSregressionresultinFigure9,withaRof0.036,3.6%
oftheusersatisfactionwasexpectedtobepredictedbytheintentiontouseanduse.We
can find that the relationship is significant enough with a significant coefficient of
0.022 0.05)
H7 Intention toUseandUsearepositivelyrelatedtoUserSatisfaction
0.307 0.022 Supported(pvalue0)
Table13.ResultofRegressionforthe2hypothesesH6,H7
E. The effect of the two factors: Intention to Use/Use and User Satisfaction are the
independentvariablesdeterminingthedependentvariableNetBenefits:
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 28
Figure10showstheSPSSregressionresultofthetwofactorsIntentiontoUse/Useand
UserSatisfactiontowardsNetBenefits.WithaRof0.569,56.9%ofthenetbenefits
were expected to be predicted by the intention to use and use and user satisfaction.
Besides,theresultisconcludedinTable14.ItsuggeststhatH8isnotacceptablewitha
negativebetavalueandapvalueof0.435>0.05whileH9issupportedbyapositive
betavalueof0.756andapvalueof0.0000.05)
H9 UserSatisfactionwillpositivelyrelatetonetbenefits
0.676 0.000 Supported(pvalue0)
Table14.ResultofRegressionforthe2hypothesesH8,H9
Figure11showsthemarkedresearchmodelaccordingtothestatisticresultsabove.The
6 insignificant relationshipsH1a,H1b,H3a,H3b,H6andH8arerepresentedbydots
linesinsteadofnormalstraight line.ImplicationsandDiscussionoftheresultswillbe
madeinthefollowingsection.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 29
Figure11.Resultmarkedonoriginalresearchmodel5. Limitations
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 30
6. ImplicationsandDiscussion
Theresultsprovideussomeimplications.
SystemFactors
Outofthethreesystemfactors,onlysystemqualitywasasignificantfactoraffectingboth
the perceivedusefulness and user satisfaction ofWebSAMS,while information quality
and service quality were not qualified as significant factors. Did it mean that the
informationqualityandservicequalityare totally irrelevant to theuser satisfactionand
perceivedusefulness?By followingup individualcases,wecould findthat someof the
respondentsgavesomehighscorestotheinformationqualityandservicequalitysection
while theymight either give some lowor highscores in perceivedusefulness and user
satisfactionoppositely,probablybecausethesystemqualitydominatedtheirdecisionon
thescoresofperceivedusefulnessandusersatisfaction.Thereforetheonlyreasonisthe
unexpectedenormouseffectofsystemqualityoverrodetheeffectsofinformationquality
andservicequalitywitharelativelyhighbetavalueof0.445and0.438towardsperceived
usefulnessandusersatisfactionrespectively.Anyway,whatwearesureisonlyveryfew
respondents (6.1%) of the survey gave a low mean score of lower than 4 in a 7
pointsscale (from 1 Most Disagree to 7 Most Agree) to the information quality of
WebSAMSasshown inFigure12,reflectingthatthe informationqualityofWebSAMS
wasprettysatisfactory,thoughthewholesystemmightormightnotbesatisfactoryatall.
Figure12.Frequencyofmeanscore(InformationQuality)
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 31
ExternalFactors
The result shows that both the external factors, presence of real time support and
presenceof trainingsignificantlyaffectbothperceivedusefulnessanduser satisfaction,
andeventuallyaffect theeffectiveness.Theseproved that theeffectsofexternal factors
are significant andarewhatwehaveexpected in the literature reviewand the research
study.
Other Factors
Theresultsshowedthatperceivedusefulnesswasnotsignificantlyaffecting intentionto
useoruse.Thiswasareallyamazingfindinganditwascloselyrelatedtothemandatory
implementation of WebSAMS by EMB. Since WebSAMS has became a mandatory
system tool for all governmentsubsidy secondary schools in these recent years, most
secondaryschoolsstaffhavepreparedthemselvestoacceptandadaptthesystemforthe
school administrative works. Though they might not really satisfied much with the
system, and even they knew the systemwas notperfect, this stilldid not distract them
from using WebSAMS because they realized that the system was actually useful,
especially on the information provided by the system. This could be reflected by their
highmeanscoreofinformationqualityofWebSAMS.ActuallyWebSAMSwastheonly
tooltheschoolscouldusetoobtaindatafromandprovidedatatoEMB,forinstancethe
public exam result of the individual school, the profile of the schools, the students
profiles, etc. Thus intention to use did not have adequate correlation with perceived
usefulness of the system is understandable. And the same reason had also contributed
thereafter to the insignificant relationshipbetween intention touseandthenetbenefits,
referringtoeffectivenessinthisstudy.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 32
7. Limitations
Firstofall,duetothefinancialandtimeshortage,thesamplesizewaslimited.Therefore
therewereonlyabouthalfofthegovernmentaidedsecondaryschoolsweretargetedfor
thesample.Secondly,thequestionnairesweredeliveredtotheschoolsbypostwhichthe
encouragementinresponsewasnotsufficient.Ifpossible,interviewingorquestionnaires
deliveryinpersonswouldbethebestchoice.Thirdly,thesurveytargets,whichwerethe
schoolsstaff,wereextremelybusyontheirjobduties.Itwasnoteasyforthemtopickup
somesparetime fordoingthequestionnaires.Thereforeeventheyhadmaderesponses,
someofthemmightnotresponsethequestionnaireswiththinkingdeeplyandaccurately.
Fourthly, since the system quality ultimately affected the most users perceptions to
WebSAMS ina very highextent, thismightcreatesomebiasas the respondentsmight
feel unsatisfied with WebSAMS easily even the information or service quality of
WebSAMSweresatisfactory,orthereweresufficientrealtimesupportandtraining.
8. Conclusion
Theresultoftheresearchsuggestedthatthesystemquality,presenceofrealtimesupport
and presence of training would affect the user satisfaction of WebSAMS and would
eventuallyaffect thenetbenefit,which is theeffectivenessofWebSAMS in this study.
The result was matched with the news report (SingPao Daily News, Mar 3, 2004)
claimingthatsomeWebSAMSuserscomplainedtheeffectivenessofWebSAMSbecause
they found that the system was not perfect and was not free of bugs, and they have
receivedinsufficientsupportandtraining.
Amongthesethreefactors,systemqualitywassuggestedasthemainfactoraffectingthe
effectiveness of WebSAMS the most, which conformed to the priority ranking of the
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 33
factorsaffectingeffectivenessofWebSAMSfromthe respondents in thequestionnaires
survey (Table 9). However, the finding showed that the existence of system bugs and
unacceptable elapsed response time are critical factors which are limiting the system
quality currently.
InformationQuality and ServiceQualitywere suggested less effective in affecting the
effectiveness of WebSAMS. This told us that most WebSAMS users looked into the
systemquality,realtimesupportandtrainingmorethan informationqualityandservice
quality of WebSAMS. Besides, recall what we have defined the effectiveness by two
views: the goalcentered view and the systems resource view. Perceived usefulness is
insignificant toaffect intention touseandeventuallyaffect theeffectiveness.Thus, the
result told us that the goalcentered viewwas not applicable to the case ofWebSAMS
while the systems resource view was valid because the user satisfaction is proved
significantly abletoaffecttheeffectiveness.
Rather than making a list of effectiveness determinants and seeking them out in
benchmarking partnerships with the view to replicating them, the alternative way of
proceeding is to seek out ineffectiveness determinantswith a view to avoiding them.
(Kelly, 2001). Though we know the significant factors affecting the effectiveness of
WebSAMS,thefutureresearchersshouldcontinuetoworkoutthefactorsthatcausethe
WebSAMS ineffectiveness so that the WebSAMS developers would try their best to
avoidthem inthefutures WebSAMSeditions.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 34
9. Recommendations
Since the system quality is the most vital factor in affecting the effectiveness of
WebSAMS,therefore,inordertoimprovetheeffectivenessofWebSAMSfundamentally,
thesystemdevelopersmustworkoutthesolutionstoimprovethesystemqualityassoon
as possible. From the survey result we can see that the existence of system bugs and
unacceptableelapsedresponsetimearethemostcriticalweaknessofthesystemquality.
Hencethesolutionscanbeincludingthefollowing:
Minimizationoftheexistingbugs
It is obvious that a free of bug system is not possible in only some years. Bugs
would be made by programming mistakes unexpectedly. Therefore while the
WebSAMS developers are trying their efforts on debugging the system, they are
suggestedtocollectbugsinformationfromtheusers.Theymayprovideafeedback
function for the users tomakedirect bugs report in the system, so thatwhen the
users encounter system bugs they would be encouraged to report the bugs
conveniently.Launchinganautomaticbugtrackingsystemisalsoanefficientway
indetectingpotentialandexistingbugsinthesystem.Whenevertheusershasmade
unexpected system fault, the detail of the fault and the users identity would be
savedintologfilesothatappropriatefollowupdiagnosiswouldbetaken.
Hardwareupgradeandnetworkimprovement
Unacceptableelapsedresponsetimeisdefinitelyrelatedtoeitherthesystemhosting
servers hardware quality or the network connection speed. As some of the
respondents claimed in an openended question in the survey that the schools
server hardware is toooutdated (PII 800MHZ, 256MBRAM), therefore themost
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 35
direct way to improve the effectiveness of WebSAMS is to upgrade the server
hardwaretoamoreupdatedconfiguration,sothattheresponsetimeof thesystem
would be increase.On the other handEMB should providemore subsidy to help
somerelativelyold schoolsonbuildingabetternetwork infrastructure inorder to
receive a better connection quality in both the intranet and internet, which is
essentialtoensuretheresponsetimeofWebSAMSisacceptable.
Besides from improving the system quality, providing realtime supports and training
wouldalso improve theeffectivenessofWebSAMSas suggestedby the result. In short
term the WebSAMS Official Unit might send some system technicians for real time
support to those schools which have installed the system recently. In long term
WebSAMSOfficialUnit should train one to two staff in each school into professional
WebSAMSadministrators, sothat theycouldhelptheir fellowworkmatesbyproviding
real time support and training in their schools on WebSAMS. However, it is
understandablethatschoolstaff isbusyenoughontheirownschoolduties.Itwouldbe
noteasytoinviteavailableschool staff toreceiveextraprofessionaltraining.Therefore
EMB might provide more subsidies to the schools to employ more IT technicians for
supporting the WebSAMS operation, so that the WebSAMS users would receive
sufficientrealtimesupportandtrainingwhentheyencounteredsomeproblems.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 36
References
[1] Almutairi,HelailSubramanian,GirishH.(2005).AnEmpiricalApplicationof the
DeLone andMcLeanModel in the Kuwaiti Private Sector. Journal of Computer
InformationSystems, Spring45,3
[2] Arnold,Vicky.(1995).Discussionofanexperimentalevaluationofmeasurementsof
informationsystemeffectiveness,Journalof InformationSystems,Vol.9 Issue2,
p85,7p
[3] Barrett, Scott. (1999). Information systems: An exploration of the factors
influencingeffectiveuse.JournalofResearchonComputinginEducation,Vol.32
Issue1,pp.417
[4] Bhattacherjee,Anol. (2001).Understanding InformationSystemsContinuance:An
ExpectationConfirmationModel,MISQuarterly,Minneapolis:Sep.Vol.25,Issue.
3p.351,20p
[5] Calisir, Ferah. (2004).The relation of interface usability characteristics, perceived
usefulness, and perceived ease of use to enduser satisfaction with enterprise
resource planning (ERP) systems, Computers in Human Behavior, July, Vol. 20
Issue4,p505,11p
[6] Chang, Jerry ChaJan King, William R. (2005). Measuring the Performance of
Information Systems: A Functional Scorecard. Journal of Management
InformationSystems,Volume22,Number1,pp.85115
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 37
[7] Dale,DenisM.Habib,AdelG.(1991).AdministrativecomputingintheAustralian
educational system. Journal of Research on Computing in Education, Vol. 24
Issue1,p120,26p,1chart,1diagram(AN9609221604)
[8] DeLone,WilliamH.McLean,EphraimR.(2003).TheDeLoneandMcLeanModel
of Information Systems Success: A TenYear Update. Journal of Management
InformationSystems,Volume19,Number4,pp.930
[9] DeLone,WilliamH.McLean,EphraimR.(2004).MeasuringeCommerceSuccess:
Applying the DeLone & McLean Information Systems Success Model.
InternationalJournalofElectronicCommerce,Volume9,Number1,pp.3147
[10]Fornell, C. Larcker, VF. (1991). Evaluating structural equation models with
unobservablevariablesandmeasurementerror.JournalofMarketingResearch,18,
3950.
[11]Fung,AlexC.W. (1991).Computer assisted school administration inHongKong.
Journal of Research on Computing in Education, Vol. 24 Issue 1, p41, 21p, 1
chart,1diagram
[12]Grembergen,WimVan.(2001).InformationTechnologyEvaluationMethodsand
Management: IdeaGroupInc(IGI),332p,ISBN:187828990X
[13]Grover,Varun Jeong, SeungRyulSegars,AlbertH. (1996). Information systems
effectiveness: the construct space and patterns of application, Information and
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 38
Management, Volume31Issue4
[14]Higgins, Christopher A Compeau, Deborah R. (1995). Computer selfefficacy:
Development of a measure and initial test. MIS Quarterly, Jun 19, 2
ABI/INFORMGlobalpg.189
[15]Johnson, David Yen, David C. (1991). Management Information Systems and
StudentAffairs,JournalofResearchonComputingEducation,23(1),pp.127139.
[16]Kalay, Poria Chen, David. (2002). Integrating a Decision Support System into a
School:TheEffectsonStudentFunctioning,JournalofResearchonTechnologyin
Education,Vol.34Issue4,p435,18p(AN7554384)
[17]Kaydos,Will. (1998).OperationalPerformanceMeasurement:CRCPress,272p,
ISBN:1574440993
[18]Kelly, Anthony. (2003). Benchmarking for School Improvement: A Practical
GuideforComparingandAchievingEffectiveness:Routledge(UK),184p,ISBN:
0415256666
[19]Li,Raymond.(2003). PreparationForumforWebSAMSImplementation,May17
[20]Liu, C., and Arnett, K. (2000). Exploring the factors associated with Web site
successinthecontextofelectroniccommerce.Information&Management,38,1,
2333.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 39
[21]MaslowskiVisscher,Ralf. (1999).Formativeevaluation ineducationalcomputing
research and development., Journal of Research on Computing in Education,
Winter,Vol.32Issue2,p239,17p,1chart,3diagrams (AN2656463)
[22]Molla, A., and Licker, P.S. (2001). Ecommerce systems success: An attempt to
extend and respecify the DeLone and McLean model of IS success. Journal of
ElectronicCommerceResearch,2,4,111.
[23]Money,ArthurSherwoodSmith,MichaelRemenyi,DanIrani,ZahirTwite, Alan.
(2000). The Effective Measurement andManagement of It Costs and Benefits:
Elsevier,384p,ISBN:0750644206
[24]Nissen,MarkE. (2000).AnExperiment toAssess thePerformance of aRedesign
Knowledge System. Journal of Management Information Systems, Volume 17,
Number3,pp.2543
[25]Nelson, R. Ryan Todd, Peter A. (2005). Antecedents of Information and System
Quality: An Empirical Examination Within the Context of Data Warehousing.
JournalofManagement InformationSystems,Volume21,Number4,April ,pp.
199235
[26]NunnallyJC.(1978). Psychometrictheory.2ndedition:NewYork:McGrawHill.
[27]Padro,Susan.(2003).ComputerAssistedSchool InformationSystems:Backtothe
Future.CanadianJournalofScience,Mathematics,&TechnologyEducation,Jan,
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 40
Vol.3Issue1,p157,7p(AN9427053)
[28]Pitt, L. F. Watson, R. T. Kavan. (1995). C.B. Service quality: A measure of
informationsystemseffectiveness.MISQuarterly,19, 2,173188.
[29]Porter, Lynnette. (2003). Developing an Online Curriculum: Technologies &
Techniques:IdeaGroupInc(IGI) ,340p, ISBN:1591401364
[30]Pyzdek, Thomas. (2003). The Six Sigma Handbook, Revised and Expanded:
McGrawHillProfessional,848p,ISBN:0071410155
[31]Rai,A.Lang,S.S. andWelker,R.B. (2002).Assessing thevalidityof IS success
models:Anempirical testandtheoreticalanalysis.InformationSystemsResearch,
13,1,pp.5069.
[32]Seddon,P.B.Kiew,MY. (1996).APartialTestandDevelopmentofDeLoneand
McLean'sModelofISSuccess(revisionoftheICIS94paper),AustralianJournal
ofInformationSystems,September, Vol.4Issue1,p90,20p
[33]Seddon,P.B. (1997). ArespecificationandextensionoftheDeLoneandMcLean
modelofISsuccess.InformationSystemsResearch,8,3,240253.
[34]Segars,A.H. Grover, Varun.(1993).Reexaminingperceivedeaseofuseand
usefulness:Aconfirmatoryfactoranalysis.MISQuarterly,December,517522
[35]Subramanian,GirishH.(1994).Areplicationofperceivedusefulnessandperceived
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 41
easeofusemeasurement,DecisionSciences,SepDec,Vol.25Issue5/6,p863,11p
[36]Telem, Moshe. (1999). A Case Study of the Impact of School Administration
Computerization on the Department Head's Role, Journal of Research on
ComputinginEducation,Vol.31Issue4,p385,17p,1chart (AN2780737)
[37]Telem,MosheAvidov,Orit. (1995)Theeffectof schoolmanagement information
systems on the nature of a looselyJournal of Research on Computing in
Education,Winter,Vol.28Issue2,p258,12p,1chart(AN9602291846)
[38]Venkatesh,Viswanath. (2000).DeterminantsofPerceivedEaseofUse: Integrating
Control,IntrinsicMotivation,andEmotionintotheTechnologyAcceptanceModel,
InformationSystemsResearch,December,Vol.11Issue4,p342,24p
[39]Visscher,Adrie J. (1994).A fundamental methodology for designingmanagement
informationsystemsforschools.JournalofResearchonComputinginEducation,
Winter,Vol.27Issue2,p231,19p,3charts,2diagrams(AN9506202179)
[40]Visscher, Adrie J. Bloemen, P. P. M. (1999). Evaluation of the use of
computerassistedmanagement information systems in Dutch schools. Journal of
Research on Computing in Education, Vol. 32 Issue 1, p172, 17p, 7 charts, 1
diagram(AN2780725)
[41]Visscher, Adrie J. Spuck, Dennis W. (1991). Computer assisted school
administration andmanagement:The state of the art in seven nations. Journal of
ResearchonComputinginEducation,Vol.24Issue1,p146,23p,4charts
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 42
[42]Visscher,AdrieJWild,PhilSmith,DebbieNewton,Len.(2003).Evaluationofthe
implementation,useandeffectsofacomputerisedmanagementinformationsystem
in English secondary schools. British Journal of Educational Technology, June,
Vol.34Issue3,p357,10p366DOI:10.1111/14678535.00332(AN9815587)
[43]Wang,R.Y.,andStrong,D.M.(1996).Beyondaccuracy:Whatdataqualitymeans
todataconsumers.JournalofManagementInformationSystems,12,4,Spring,pp.
534
[44]Homepage of Association for Information Systems [online] from the world wide
web:http://www.isworld.org/
[45]Homepage of Hong Kong Special Administration Region Government, Education
andManpowerBureau[online]fromtheworldwideweb:http://www.emb.gov.hk
[46]Homepage of Hong Kong Special Administration Region Government, Education
andManpower Bureau, School BasedManagement [online] from the world wide
web:http://www.emb.gov.hk/index.aspx?nodeID=180&langno=1
[47]Homepage of WebSAMS Central Document Repository [online] from the world
wideweb:http://cdr.websams.emb.gov.hk/
[48]Editorial, 3000 .
SingPaoDailyNews(HongKong),inMar03,2004,A16
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 43
[49]Editorial, , Ta Kung Pao
(HongKong),inAug17,2005,A07
[50]Editorial, SingTao Daily News (Hong
Kong),inAug17,2005,A04
[51] , [online] from the world wide web:
http://www.emb.gov.hk/index.aspx?langno=2&nodeid=480
http://www.emb.gov.hk/index.aspx?langno=2&nodeid=480
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 44
Appendix A:FunctionsofWebSAMS
FunctionalAreas ExamplesofUses1. Attendance l Inputtingstudentattendance
record
l Realtimeorscheduledchecking
l Reportingofabsent
2. Award&Punishment l Inputtingstudentsawardand
punishmentsdata
l Printingofawardletterand
warningletter
l Listingofstudentsawardand
punishmentrecord
3. CodeManagement l Furtherdesigningthecodefor
specialneedsoftheschools
l Providinglongercodetablefield
4. Communication&Delivery
System
l DeliveringdefaultformattoEMB
l Checkingoutputdata
l Simplifyingoutputprocess
5. Communication&Delivery
System
l DeliveringdefaultformattoEMB
l Checkingoutputdata
l Simplifyingoutputprocess
6. DataManagement l Exportingdataindifferentformats
l Providingentityrelationship
diagrams
l DataTablesindex
7. FinancialMonitoring&
Planning
l Monitoringthestatusofincome
andexpenditure
l Copyingyearfinancialdatafor
financialplanning
l Printingoffinancialreport
8. HongKongAttainment
Tests
l Inputtingtestresultdata
l Listingofstudentswhoseresult
requiredinputting
l Comparingstudentsresults
9. HongKongExaminations&
AssessmentAuthority
l DownloadingformsfromEAA
l FasterwaytochangedatainEAA
10.ReportManagement l Providingwiderangeofformatsof
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 45
report
l Uploadingfromcrystalreport
11.SchoolManagement l Framingtimetableandschool
calendar
l Definingclassesstructureand
subjectsissues
l Uploading/Downloadingschool
documents
12.SchoolPlacesAllocation l Providingafastandefficient
communicationchanneltothe
SchoolPlacesAllocationUnit
l Receivingschoolplaceallocation
datainamoresafeway
l Checkingofindividualstudents
schoolplaceallocationresult
13.SpecialAssessment l Recordingstudentsspecial
assessmentdata
l Providingdifferentspecialgrading
methods
14.Staff l Updatingpersonaldata
l Batchinputtingteachersduties
l Showingteacherstimetableand
dutiesonline
l LeftofficeTeachersdata
recovering
l Virtualteachers
15.StaffDeployment l Processingstaffabsentandsick
leaverecord
l Assigningavailablestaffforabsent
staff
l Settingdifferentcriterionsfor
deploymentrule
16.Student l Processingnewstudentsdata
input
l Updatingexistingstudentsrecords
17.StudentActivities l Onlinereceivingapplicationfor
activities
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 46
l Inputtingstudentsperformance
andpositions
l Listingofattendancerecord
(DatafromWebSAMSCentralDocumentRepository)
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 47
AppendixB: MeasurementItems
Factors Questions OriginalQuestions Ref. SPSSVariablenames
Q.4.Theoutputinformationprovidedby
WebSAMSisaccessibleatatimesuitableforits
use.
Howdoyouevaluatetheavailabilityofthe
outputinformationatatimesuitableforitsuse?
(Accessibility)
[6],[16],[43]
IQ4
Q.5.TheinformationprovidedbyWebSAMSis
trueandaccurate.
Howdoyouevaluatethecorrectnessofthe
outputinformation? (Reliability)
[6],[16],[43]
IQ5
Q.6.TheinformationprovidedbyWebSAMSis
mostupdated.
Howdoyouevaluatetheageoftheoutput
information? (IntrinsicQuality)
[6],[16],[43]
IQ6
Q.7.Theinformation contentprovidedby
WebSAMSiscomplete.
Howdoyouevaluatethecomprehensivenessof
theoutputcontent? (IntrinsicQuality)
[6],[16],[43]
IQ7
Q.8.Theoutputinformation providedby
WebSAMSisconsistent.
Howdoyouevaluatetheconsistencyand
dependabilityoftheoutputinformation?
(ContextualQuality)
[6],[16],[43]
IQ8
Q.9.Thematerialdesignofthelayoutand
displayoftheoutputcontentsareeasytoread.
Howdoyouevaluatethematerialdesignofthe
layoutanddisplayoftheoutputcontents?
(PresentationalQuality)
[6],[16],[43]
IQ9
Information
Quality
Q.10. Theinformation contentprovidedby (Usefulness) [16], IQ10
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 48
WebSAMSisusefulfortheschools
administrativeworks.
[43]
Q.11. WebSAMSisflexibletochangeor
adjustinresponsetonewconditions,demands,
orcircumstances.
Howdoyouevaluatethecapacityofthe
informationsystemtochangeoradjustin
responsetonewconditions,demands,or
circumstances? (Flexibility)
[6],[40] SQ11
Q.12. WebSAMSiseasytouseandutilizeits
capability.
Howdoyouevaluatetheeaseordifficultyof
utilizingthecapabilityofthecomputersystem?
(Easeofuse)
[6],[8],[25],[37],[44]
SQ12
Q.13. WebSAMSprovidedmethefunctions
thatIexpectedtocompletetheschools
administrativeworks.
(Functionality) [6],[8],[44]
SQ13
Q.14. WebSAMSprovidedmethefunctions
thatwithouttheexistenceofbugs.
(Functionality,Reliability) [6],[8],[44]
SQ14
Q.15. WebSAMSiseasytoadapt. (Adaptability) [8],[44] SQ15
Q.16. WebSAMScancompletelyintegrate
intomyschoolsadministrativeworks.
(Integration) [8],[44] SQ16
System
Quality
Q.17. Theelapsedtimebetweena
userinitiatedrequestforserviceoractionand
replytothatrequestbyWebSAMSisacceptable.
Howdoyouevaluatetheelapsedtimebetween
auserinitiatedrequestforserviceoractionand
replytothatrequest? (ResponseTime)
[6],[44] SQ17
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 49
Q.18. WhenIhaveaproblem,theofficial
WebSAMSsupportunitswill showasincere
interestinsolvingit.
Whenusershaveaproblem,theseISunitswill
showasincereinterestinsolvingit.
(Responsiveness)
[20],[29],[31]
SerQ18
Q.19. Theemployeesoftheofficial
WebSAMSsupportunitshavetheknowledgeto
maintainthesystemandsolveproblemswell.
ISemployeeshavetheknowledgetodotheir
jobswell.(Assurance)
[20],[29],[31]
SerQ19
Q.20. Theemployeesoftheofficial
WebSAMSsupportunitshavegivenme
personalattentions.
ISemployeeshavegivenuserpersonal
attentions.(Empathy)
[20],[29],[31]
SerQ20
Q.21. Theemployeesoftheofficial
WebSAMSsupportunitshavefollowingup
servicetoensureIandotherworkmatescanbe
abletoadaptWebSAMS.
(FollowingupService) [20],[29]
SerQ21
Service
Quality
Q.22. WhenIhaveaproblemonusing
WebSAMSIcanfindsupportsfromcertain
onlinesupportsources.(e.g.Email,WebForum)
(OnlineSupportCapabilities) [22] SerQ22
Q.23. Varietyofrealtimesupportofferedby
myschool(e.g.ITTeam,Workmates)is
sufficient.
RTS23Presenceof
RealTime
Support
Q.24. Myschoolhassupportedme(e.g.IT RTS24
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 50
Team,Workmates)onusingWebSAMS.
Q.25. Realtimesupportcouldhelpmealot
onusingWebSAMS.
RTS25
Q.26. Varietyoftrainingprogramsor
workshopsofferedbytheofficialWebSAMS
supportunitsissufficient.
VarietyoftrainingprogramsofferedbytheIS
functionissufficient.
[16] T26
Q.27. Ithinkthetrainingprogramsor
workshopsofferedbytheofficialWebSAMS
supportunitsareuseful.
TrainingprogramsofferedbytheISfunction
areuseful.
[16] T27
Q.28. Varietyoftrainingprogramsor
workshopsofferedbymyschoolissufficient.
T28
Presenceof
Training
Q.29. Ithinkthetrainingprogramsor
workshopsofferedbymyschoolareuseful.
T29
Q.30. WebSAMSenablesmetoaccomplish
studentrelatedtasksmorequickly.
UsingSISenablesmetoaccomplish
studentrelatedtasksmorequickly.
[25],[37] PU30
Q.31. WebSAMSimprovesmyjob
performance.
UsingSISimprovesmyjobperformance. [25],[37] PU31
Q.32. UsingWebSAMSinmyjobincrease
myproductivity.
UsingSISinmyjobincreasemyproductivity. [25],[37] PU32
Perceived
Usefulness
Q.33. UsingWebSAMSenhancesmy UsingSISenhancesmyeffectivenessonthe [25],[37] PU33
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 51
effectivenessonthejob. job.
Q.34. UsingWebSAMSmakesiteasiertodo
myjob.
UsingSISmakesiteasiertodomyjob. [25],[37] PU34
Q.35. Overall,IfindWebSAMSusefulon
myjob.
IfindSISusefulonmyjob. [25],[37] PU35
Q.36. IfeelWebSAMScanmeetsthe
informationprocessingneededofmyareaof
responsibility.
Howadequatelydoyoufeelthatthesystem
meetstheinformationprocessingneededof
yourareaofresponsibility?
[6] US36User
Satisfaction
Q.37. Overall,Iamsatisfiedwith
WebSAMS.
HowwouldyourateyoursatisfactionwithSIS? [25],[37] US37
Q.38. ImproveeffectivenessofWebSAMS
helpmetoachievemygoalofwork.
NB38
Q.39. ImproveeffectivenessofWebSAMS
makemetobemoresatisfied.
NB39
Q.40. ImproveeffectivenessofWebSAMS
meanproducemorenetbenefits.
NB40
Q.41. Overall,IthinkWebSAMSendsup
withhigheffectivenessonmosttaskscurrently.
NB41
NetBenefits
(Effectiveness)
Q.42. PleaseprioritizethefactorsaffectingtheeffectivenessofWebSAMS(1:least,5:mostimportant,
pleaseuseeachnumberforonlyonetime)
NB42_IQNB42_SQNB42_SerQ
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 52
__InformationQuality __SystemQuality __ServiceQuality __PresenceofRealTimeSupport
__PresenceofTraining
NB42_RTSNB42_T
Q.43. IthinkIamabletomasterWebSAMS
verywell.
IU43Intentionto
Use
Q.44. Ihavefacedalotofproblemsinusing
WebSAMSsofar.
IU44_Recode
Howwouldyourateyourcomputerskill?
1)None2)Rookie3)Intermediate
4)Advance5)Expert
Q.45. IamadministeringtoWebSAMS
operationinmyworkingschool.
Other
Q.46. Onaverageworkingdays,howmuch
timedoyouspendonthesystem?
1)Almostnever
2)Lessthan1/2hour
3)From1/2hourto1hour
4)12hours
5)Morethan2hours
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 53
AppendixC:QuestionnaireSample
QuestionnaireforacademicresearchworkonFactorsaffectingtheeffectivenessofWebSAMSinHongKongSecondarySchools
ThisquestionnaireconstitutespartofastudentsindividualacademicresearchworkforanHonoursProjectinpartialfulfillmentofthe
BBAgraduation requirement.While theHongKongBaptistUniversity respects andabides by thePrivacyDataOrdinance, it is the
studentsresponsibilitytocomplywiththeOrdinanceduringeveryaspectoftheproject.Pleasecontactthesenderofthisquestionnaire
forspecificdetails.Pleaseignorethisquestionnaireifyouhaverespondedorarenotinterestedinrespondingtoit.Thankyou.
SchoolName:____________________________________________________________(Optional,onlyforfutureacknowledgement)
PartI.GeneralInformation(Pleasetickyouranswer)1. WebSAMS(WebSchoolAdministrationandManagementSystem) isinstalledinyourschool.
Yes. No.[Endofquestionnaire.Thanksforyourkindsupport]2. YouhaveeverusedWebSAMSinthepast6months.
Yes. No.[GotoPartIII]
PartII.PleasebaseonyourexperienceofusingWebSAMStoanswerthefollowingquestions.(Pleasecircleoneofthenumbersinthesevenpointscalethatbestdescribeyourpointsofview)
A.InformationQuality StronglyAgree StronglyDisagree
Q.47. TheinformationprovidedbyWebSAMSisaccessibleatanyrequestedtime. 7 6 5 4 3 2 1
Q.48. TheinformationprovidedbyWebSAMSistrueandaccurate. 7 6 5 4 3 2 1
Q.49. TheinformationprovidedbyWebSAMSisupdated. 7 6 5 4 3 2 1
Q.50. TheinformationcontentprovidedbyWebSAMSiscomplete. 7 6 5 4 3 2 1
Q.51. TheoutputinformationprovidedbyWebSAMSisconsistent. 7 6 5 4 3 2 1
Q.52. Thescreendisplayoftheoutputcontentsareeasytoread. 7 6 5 4 3 2 1
Q.53. Thematerialdesignoftheprintedreportlayoutiseasytoread. 7 6 5 4 3 2 1
B.SystemQuality StronglyAgree StronglyDisagree
Q.54.WebSAMSisflexibletochangeorupdateinresponsetonewconditions,
demands,orcircumstances.
7 6 5 4 3 2 1
Q.55.WebSAMSiseasytouseandutilizeitscapability. 7 6 5 4 3 2 1
Q.56.WebSAMSprovidedme thefunctions thatIexpectedtocompletetheschools
administrativeworks.
7 6 5 4 3 2 1
Q.57. Icouldnotdiscovertheexistenceofbugsinthesystem. 7 6 5 4 3 2 1
Q.58.WebSAMSiseasytoadapt. 7 6 5 4 3 2 1
Q.59.WebSAMScancompletelyintegrateintomyschoolsadministrativeworks. 7 6 5 4 3 2 1
Q.60. Theelapsedtimebetweenauserinitiatedrequestforserviceoractionand
replytothatrequestbyWebSAMSisacceptable.
7 6 5 4 3 2 1
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 54
C.ServiceQuality StronglyAgree StronglyDisagree
Q.61.WhenIhaveaproblem,theofficialWebSAMSsupportunitswillshowa
sincereinterestinsolvingit.
7 6 5 4 3 2 1
Q.62. TheemployeesoftheofficialWebSAMSsupportunitshavetheknowledgeto
maintainthesystemandsolveproblemswell.
7 6 5 4 3 2 1
Q.63. TheemployeesoftheofficialWebSAMSsupportunitshavegivenme
personalattentions.
7 6 5 4 3 2 1
Q.64. TheemployeesoftheofficialWebSAMSsupportunitshavefollowingup
servicetoensureIandotherworkmatescanbeabletoadaptWebSAMS.
7 6 5 4 3 2 1
Q.65.WhenIhaveaproblemonusingWebSAMSIcanfindsupportsfromcertain
onlinesupportsources.(e.g.Email,WebForum)
7 6 5 4 3 2 1
D.PresenceofRealTimeSupport StronglyAgree StronglyDisagree
Q.66. Varietyofrealtimesupportofferedbymyschool(e.g.ITTeam,Workmates)
issufficient.
7 6 5 4 3 2 1
Q.67. Myschoolsupportsme(e.g.ITTeam,Workmates)usingWebSAMS. 7 6 5 4 3 2 1
Q.68. RealtimesupportcouldhelpmealotonusingWebSAMS. 7 6 5 4 3 2 1
E.PresenceofTraining StronglyAgree StronglyDisagree
Q.69. VarietyoftrainingprogramsorworkshopsofferedbytheofficialWebSAMS
supportunits issufficient.
7 6 5 4 3 2 1
Q.70. IthinkthetrainingprogramsorworkshopsofferedbytheofficialWebSAMS
supportunitsareuseful.
7 6 5 4 3 2 1
Q.71. Varietyoftrainingprogramsorworkshopsofferedbymyschoolissufficient. 7 6 5 4 3 2 1
Q.72. Ithinkthetrainingprogramsorworkshopsofferedbymyschoolareuseful. 7 6 5 4 3 2 1
F.PerceivedUsefulness StronglyAgree StronglyDisagree
Q.73.WebSAMSenablesmetoaccomplishstudentrelatedtasksmorequickly. 7 6 5 4 3 2 1
Q.74.WebSAMSimprovesmyjobperformance. 7 6 5 4 3 2 1
Q.75. UsingWebSAMSinmyjobincreasemyproductivity. 7 6 5 4 3 2 1
Q.76. UsingWebSAMSenhancesmyeffectivenessonthejob. 7 6 5 4 3 2 1
Q.77. UsingWebSAMSmakesiteasiertodomyjob. 7 6 5 4 3 2 1
Q.78. Overall,IfindWebSAMSusefulonmyjob. 7 6 5 4 3 2 1
G.UserSatisfaction StronglyAgree StronglyDisagree
Q.79. IfeelWebSAMScanmeetstheinformationprocessingneededofmyareaof
responsibility.
7 6 5 4 3 2 1
Q.80. Overall,IamsatisfiedwithWebSAMS. 7 6 5 4 3 2 1
H.NetBenefits StronglyAgree StronglyDisagree
Q.81. ImproveeffectivenessofWebSAMShelpmetoachievemygoalofwork. 7 6 5 4 3 2 1
Q.82. ImproveeffectivenessofWebSAMSmakemetobemoresatisfied. 7 6 5 4 3 2 1
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 55
Q.83. ImproveeffectivenessofWebSAMSmeanproducemorenetbenefits. 7 6 5 4 3 2 1
Q.84. Overall,IthinkWebSAMSendsupwithhigheffectivenessonmosttasks
currently.
7 6 5 4 3 2 1
Q.85. PleaseprioritizethefactorsaffectingtheeffectivenessofWebSAMS(1:least,5:mostimportant,pleaseuseeachnumberfor
onlyonetime)
__InformationQuality __SystemQuality __ServiceQuality __PresenceofRealTimeSupport __PresenceofTraining
I.UsageInformation StronglyAgree StronglyDisagree
Q.86. IthinkIamabletomasterWebSAMSverywell. 7 6 5 4 3 2 1
Q.87. IhavefacedalotofproblemsinusingWebSAMSsofar. 7 6 5 4 3 2 1
Q.88. IamadministeringtoWebSAMSoperationinmyworkingschool.
Yes. No.Q.89. Onaverageworkingdays,howmuchtimedoyouspendonthesystem?
1)Almostnever 2)Lessthan1/2hour 3)From1/2hourto1hour
4)12hours 5)Morethan2hoursQ.90.Whatwouldyousuggesttoimprovetheeffectivenessof WebSAMS?
____________________________________________________________________________________________________
____________________________________________________________________________________________________
PartIII.Demographicdata (Pleaseticktheappropriatebox)Gender
M F
Age
1)18orbelow 2)1925 3)2630 4)3135
5)3640 6)4145 7)4650 8)51orabove
Howwouldyourateyourcomputerskill?
1)None 2)Rookie 3)Intermediate 4)Advance 5)Expert
Thisistheendofquestionnaire,thankyou!Pleasesendbackthisquestionnairewiththereturnenvelopsattachedwiththismail.
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 56
AppendixD:StatisticData
Frequencies
Age
Frequency Percent ValidPercent CumulativePercent
1925 16 13.4 13.8 13.8
2630 29 24.4 25.0 38.8
3135 11 9.2 9.5 48.3
3640 15 12.6 12.9 61.2
4145 20 16.8 17.2 78.4
4650 14 11.8 12.1 90.5
51orabove 11 9.2 9.5 100.0
Valid
Total 116 97.5 100.0
Missing 0 3 2.5
Total 119 100.0
Gender
Frequency Percent ValidPercent CumulativePercent
Male 89 74.8 76.7 76.7
Female 27 22.7 23.3 100.0Valid
Total 116 97.5 100.0
Missing 0 3 2.5
Total 119 100.0
ComputerSkill
Frequency Percent ValidPercent CumulativePercent
Rookie 31 26.1 26.7 26.7
Intermediate 38 31.9 32.8 59.5
Advance 37 31.1 31.9 91.4
Expert 10 8.4 8.6 100.0
Valid
Total 116 97.5 100.0
Missing 0 3 2.5
Total 119 100.0
WebSAMSAdministrator
Frequency Percent ValidPercent CumulativePercent
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 57
Yes 65 54.6 56.0 56.0
No 51 42.9 44.0 100.0Valid
Total 116 97.5 100.0
Missing 0 3 2.5
Total 119 100.0
TimeSpentonWebSAMSonAverageWorkingDays
Frequency Percent ValidPercent CumulativePercent
Almostnever 2 1.7 1.7 1.7
Lessthan1/2hour 65 54.6 56.0 57.8
From1/2hourto1hour 22 18.5 19.0 76.7
12hours 18 15.1 15.5 92.2
Morethan2hours 9 7.6 7.8 100.0
Valid
Total 116 97.5 100.0
Missing 0 3 2.5
Total 119 100.0
NParTests
Warnings
TheCochranTestforPriorityoffactorsaffectingeffectiveness(InformationQuality)Priorityoffactorsaffectingeffectiveness(SystemQuality)Priorityoffactorsaffectingeffectiveness(ServiceQuality)Priorityoffactorsaffectingeffectiveness(RealTimeSupport)Priorityoffactorsaffectingeffectiveness(Training)isnotperformedbecauseallvariablesarenotdichotomouswiththesamevalues.
DescriptiveStatistics
PercentilesN Mean Std.Deviation Minimum Maximum 25th 50th(Median) 75th
Priorityoffactorsaffectingeffectiveness(InformationQuality)
116 3.02 1.292 1 5 2.00 3.00 4.00
Priorityoffactorsaffectingeffectiveness(SystemQuality) 116 4.05 1.357 1 5 3.00 5.00 5.00
Priorityoffactorsaffectingeffectiveness(ServiceQuality) 116 3.16 1.087 1 5 3.00 3.00 4.00
Priorityoffactorsaffectingeffectiveness(RealTimeSupport)
116 2.49 1.059 1 5 2.00 2.00 3.00
Priorityoffactorsaffectingeffectiveness(Training) 116 2.29 1.527 1 5 1.00 2.00 3.00
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 58
FriedmanTestRanks
MeanRank
Priorityoffactorsaffectingeffectiveness(InformationQuality) 3.01
Priorityoffactorsaffectingeffectiveness(SystemQuality) 4.05
Priorityoffactorsaffectingeffectiveness(ServiceQuality) 3.16
Priorityoffactorsaffectingeffectiveness(RealTimeSupport) 2.49
Priorityoffactorsaffectingeffectiveness(Training) 2.28
TestStatistics
N 116
ChiSquare 88.578
df 4
Asymp.Sig. .000
Kendall'sWTestRanks
MeanRank
Priorityoffactorsaffectingeffectiveness(InformationQuality) 3.01
Priorityoffactorsaffectingeffectiveness(SystemQuality) 4.05
Priorityoffactorsaffectingeffectiveness(ServiceQuality) 3.16
Priorityoffactorsaffectingeffectiveness(RealTimeSupport) 2.49
Priorityoffactorsaffectingeffectiveness(Training) 2.28
TestStatistics
N 116
Kendall'sW .191
ChiSquare 88.578
df 4
Asymp.Sig. .000
Proximities
CaseProcessingSummary
LeungCheukKwanBBAISM03007189 HKBUHonoursDegreeProject/April06
FactorsAffectingTheEffectivenessofWebSAMSinHongKongSecondarySchools 59
Cases
Valid Missing Total
N Percent N Percent N Percent
116 97.5% 3 2.5% 119 100.0%
ProximityMatrix
InformationQuality
SystemQuality
ServiceQuality
PresenceofRealTime
Support
Presenceof
Training
PerceivedUsefulness
UserSatisfaction
Intentionto
Use/Use
NetBenefits
IQ4 .836 .552 .260 .326 .307 .373 .417 .078 .369
IQ5 .857 .488 .229 .396 .259 .313 .399 .262 .405
IQ6 .817 .585 .299 .462 .322 .481 .531 .231 .526
IQ7 .810 .643 .237 .281 .312 .357 .422 .096 .388
IQ8 .821 .558 .225 .347 .268 .276 .310 .201 .350
IQ9 .846 .626 .301 .321 .340 .356 .382 .183 .463
IQ10 .816 .591 .321 .295 .327 .257 .298 .089 .335
SQ11 .589 .807 .480 .419 .458 .594 .542 .028 .482
SQ12 .629 .855 .505 .425 .422 .608 .596 .120 .531
SQ13 .602 .790 .473 .435 .394 .546 .540 .068 .496
SQ14 .360 .574 .316 .283 .323 .252 .297 .172 .277
SQ15 .619 .818 .522 .503 .497 .606 .598 .157 .536
SQ16 .585 .771 .391 .338 .419 .590 .574 .017 .471
SQ17 .399 .737 .369 .360 .376 .460 .510 .268 .431
SerQ18 .254 .485 .886 .503 .564 .555 .500 .154 .502
SerQ19 .276 .443 .867 .595 .591 .538 .502 .181 .510
SerQ20 .285 .526 .893 .531 .618 .580 .496 .142 .471
SerQ21 .345 .527 .860 .530 .566 .542 .422 .191 .441
SerQ22 .259 .492 .858 .620 .564 .560 .547 .255 .522
RTS23 .411 .471 .608 .892 .683 .615 .577 .173 .544
RTS24 .365 .472 .588 .935 .595 .604 .594 .184 .547
RTS25 .376 .471 .567 .931 .601 .574 .588 .137 .563
T26 .350 .496 .642 .546 .892 .548 .492 .139 .425
T27 .282 .461 .609 .615 .897 .560 .540 .017 .536
T28 .353 .459 .543 .620 .891 .587 .541 .013 .453
T29 .345 .526 .598 .670 .921 .669 .642 .031 .576
PU30 .376 .619 .607 .616 .594 .914 .755 .077 .715
PU31 .408 .644 .625 .598 .617 .944 .787 .136 .