F
o
r R
ev
ie
w
O
n
ly
35($1$/<7,&$/(5525635(/,0,1$5<$3352$&+727+( 32,172)9,(:2)35,0$5<+($/7+&$5(*,9(56
-RXUQDO &OLQLFDO&KHPLVWU\DQG/DERUDWRU\0HGLFLQH 0DQXVFULSW,' &&/05
0DQXVFULSW7\SH 2ULJLQDO$UWLFOH
'DWH6XEPLWWHGE\WKH$XWKRU -XO
&RPSOHWH/LVWRI$XWKRUV 5RPHUR$GROIR+RVSLWDO8QLYHUVLWDULR9LUJHQGHOD9LFWRULD8*& +HPDWRORJtD\/DERUDWRULR
*RPH]6DOJDGR-XDQ8QLYHUVLW\RI+XHOYD'HSDUWPHQWRI1XUVLQJDQG 'HSDUWPHQWRI(QYLURQPHQWDO%LRORJ\DQG3XEOLF+HDOWK8
&DSDUUyV,VDEHO8QLYHUVLWDU\+RVSLWDO9LUJHQGHOD9LFWRULD/DERUDWRU\ DQG+DHPDWRORJ\'HSDUWPHQW
%$5%$0$5,$',675,726$1,7$5,20$/$*$*8$'$/+25&(&(1752 '(6$/8'/$6'(/,&,$6
5(,1$0$5*$5,7$',675,726$1,7$5,20$/$*$*8$'$/+25&( &(1752'(6$/8'&2,1
5XL]B)UXWRV&DUORV8QLYHUVLW\RI+XHOYD'HSDUWPHQWRI(QYLURQPHQWDO %LRORJ\DQG3XEOLF+HDOWK
6HFWLRQ&DWHJRU\ 0HWKRG(YDOXDWLRQ
&ODVVLILFDWLRQV
(YDOXDWLRQRXWFRPH
,QVWUXPHQWV6\VWHPV(YDOXDWLRQ2XWFRPH3DWLHQWVDIHWH\ (YDOXDWLRQRXWFRPH
,QVWUXPHQWV6\VWHPV(YDOXDWLRQ2XWFRPH3UHDQDO\WLFDOHUURU (YDOXDWLRQRXWFRPH
,QVWUXPHQWV6\VWHPV(YDOXDWLRQ2XWFRPH$QDO\WLFDOHUURU (YDOXDWLRQRXWFRPH
,QVWUXPHQWV6\VWHPV(YDOXDWLRQ2XWFRPH
.H\ZRUGV 35($1$/<7,&$/0,67$.(635,0$5<&$5(48$/,7$7,9($3352$&+
F
o
r R
ev
ie
w
O
n
ly
We think that “ancillary” and “auxiliary” are synonyms in this context. However, we
corrected the text.
F
o
r R
ev
ie
w
O
n
ly
$%675$&7
7KH LQFLGHQFH DQG W\SHV RI HUURUV LQ WKH SUHDQDO\WLFDO SKDVH LV D ZLGHO\ VWXGLHG WRSLF +RZHYHU
LQIRUPDWLRQUHJDUGLQJWKHSHUVSHFWLYHRIWKHLQYROYHGSURIHVVLRQDOVLVUDWKHUVFDQW
7ZRIRFDOJURXSVRISURIHVVLRQDOVIURP3ULPDU\&DUHLQYROYHGLQWKHSUHDQDO\WLFDOSHULRGJHQHUDO
SUDFWLWLRQHUV >*3@ FRPPXQLW\ QXUVHV >&1@ DQG RWKHU DX[LOLDU\ KHDOWK ZRUNHUV LQFOXGLQJ
DGPLQLVWUDWLYH SHUVRQQHO >$+:@ ZHUH FRQYHQHG$ TXDOLWDWLYH DQDO\VLV ZLWK D SKHQRPHQRORJLFDO
DSSURDFKZDVSHUIRUPHGE\XVLQJWKHVWUXFWXUHRI6:276WUHQJWK:HDNQHVV2SSRUWXQLWLHVDQG
7KUHDWVDQDO\VLVDVDJXLGHDQGUHVXOWVFDWHJRULVHGE\JURXSLQJWKHUHVXOWDQWGLPHQVLRQVDFFRUGLQJ
WRWKLVVWUXFWXUH
2YHUDOOSURIHVVLRQDOV*3&1DQG$+:ZHUHGLVWULEXWHGLQWZRJURXSV$JHDQGJHQGHU
GLVWULEXWLRQ ZHUH VLPLODU EHWZHHQ JURXSV 7KH PRVW FRPPHQWHG 6WUHQJWKV ZHUH RUJDQLVDWLRQDO
FDSDELOLW\DQG WHDPZRUN 0DLQ:HDNQHVV ZDV WKH ZRUNORDGLQFUHDVH FRPSDUHGWRWKH VKRUWWLPH
VSHQWLQVDPSOHSURFXUHPHQW2SSRUWXQLWLHVZHUHUHODWHGWRZRUNORDGRSWLPLVDWLRQWKURXJKRQOLQH
DQDO\WLFDOUHTXHVW7KUHDWVZHUHUHODWHGWRWKHORQJWLPHHODSVHGEHWZHHQVDPSOHGUDZLQJDW3ULPDU\
&DUHGHOLYHU\DWWKH&HQWUDO/DERUDWRU\
7KH SKHQRPHQRORJLFDO DSSURDFK DOORZV NQRZLQJ WKRVH DVSHFWV WKDW FDQQRW EH HQWLUHO\
HOXFLGDWHG E\ REMHFWLYH GDWD PHDVXUHPHQW 3DUWLFLSDQWV VRXJKW SHUVRQQHO¶V SURIHVVLRQDOLVP
DQG FRPPLWPHQW DV D EDVLF WRRO WR RYHUFRPH UHGXFH SUHDQDO\WLFDO HUURUV $WWLWXGHV
FRQVLGHUHG DV SRVLWLYH FDQ EH H[SORLWHG E\ WKH LQVWLWXWLRQ ZKHUHDV WKRVH FRQVLGHUHG DV
QHJDWLYHDOHUWRQSRVVLEOHIXWXUHSUREOHPV
3ULPDU\&DUHSURIHVVLRQDOVRIIHUHGDGLIIHUHQWSRLQWRIYLHZWKDQODERUDWRULHVVWDIIEXWERWK
UHFRJQL]HG KLJK ZRUNORDG DV WKH PDLQ WKUHDW DQG RQOLQH DQDO\WLFDO UHTXHVW DV WKH EHVW
RSSRUWXQLW\
7KHVHSHUVSHFWLYHVPD\KHOSDWLPSURYLQJWKHGHWHFWLRQDQGGHFUHDVLQJWKHQXPEHURISUHDQDO\WLFDO
PLVWDNHVLQWKHQHDUIXWXUH
ZRUGV
.(<:25'6
35($1$/,7<&$/0,67$.(635,0$5<&$5(48$/,7$7,9($3352$&+
7KH$XWKRUVZLVKWRWKDQNLWVFROODERUDWLRQLQWUDQVODWLRQDQGUHYLVLRQWR3URI00XxR]6FKRRORI
0HGLFLQH8QLYHUVLW\RI0iODJD6SDLQ
F
o
r R
ev
ie
w
O
n
ly
,1752'8&7,21
7KHSUHVHQFHRIHUURUVLQWKHSUHDQDO\WLFDOSKDVHLVDZLGHO\VWXGLHGWRSLF)URPWKHHDUO\VWXGLHV
E\3OHEDQLHWDOVHYHUDOUHVHDUFKHUVKDYHLQYHVWLJDWHGRQWKHKLJKUDWHVRIPLVWDNHVLQWKLVSKDVH
RIWKHODERUDWRU\SURFHVVDOWKRXJKXVLQJGLIIHUHQWDSSURDFKHVDQGVXJJHVWLQJGLIIHUHQWVROXWLRQVWR
DYRLGWKLVSUREOHP
7KXV VRPH UHVHDUFKHUV IRFXVHG RQ WKH VDPSOH TXDOLW\ VSHFLILFDOO\ WKH SUHVHQFH RI KDHPRO\VLV
VWUHVVLQJWKHLPSRUWDQFH RILWVDEVHQFHDQGDQDO\VLQJWKHLU PRVWOLNHO\ FDXVHV LH EORRGVDPSOLQJ
PHWKRG RU XVH RI SQHXPDWLF GHYLFHV IRU VDPSOHV WUDQVSRUWDWLRQ 2WKHU IRFXVHG RQ WKH
UHODWLRQVKLS EHWZHHQ WKH SUHVHQFH RI SUHDQDO\WLFDO HUURUV DQG WKH FRPPLWPHQW WR SDWLHQW¶V VDIHW\
VWUHVVLQJ WKH SRVVLEOH PLVLQWHUSUHWDWLRQ RI WKH UHVXOWV 7KLV DUJXPHQW EHFDPH SDUWLFXODUO\
LPSRUWDQWDIWHUWKHSXEOLFDWLRQRIWKHUHSRUW³7RHUULVKXPDQ%XLOGLQJDVDIHUKHDOWKV\VWHP´
DGRFXPHQWWKDWFRQWULEXWHGVWURQJO\WRDSDUDGLJPVKLIWRQKRZ WRGHDOZLWKWKHSUREOHPVDULVLQJ
UHODWHGWRSDWLHQW¶VVDIHW\
$QRWKHUOLQHRIUHVHDUFKKDVIRFXVHGRQWKHUHSRUWLQJRIPDOSUDFWLFHVLQEORRGVDPSOLQJGHYHORSLQJ
VSHFLILF TXHVWLRQQDLUHV IRU WKH SURIHVVLRQDOV LQYROYHG RQ FULWLFDO VWHSVHJ VDPSOH ODEHOLQJ
RIIHULQJ D KROLVWLF DSSURDFK WR WKH SUREOHP DQG DGGLQJ WKH LQIRUPDWLRQ IURP SUHYLRXV VWXGLHV DW
KRVSLWDOZDUGVDQGH[WUDFWLRQVURRPV
*UHDWDWWHQWLRQKDVEHHQSDLGWRWKHGHWHFWLRQDQGGHVFULSWLRQRIWKHVHHUURUVIROORZHGE\
WKHGHYHORSPHQWRIDFWLRQVIRUSUHYHQWLQJWKHPHVSHFLDOO\DIWHUUHDOL]LQJWKDWWKLVSUREOHPIDU
IURPVROYHGSHUVLVWHGGHVSLWHWKHWHFKQRORJLFDOFKDQJHVWKDWKDGRFFXUUHGGXULQJWKHODVWWHQ\HDUV
)LQDOO\ DQ REVHUYDWLRQDO VWXG\ VRXJKW WR LGHQWLI\ WKH VRXUFHV RI HUURUV WKDW PD\ RFFXU IURP
VDPSOHGUDZLQJDWWKHKHDOWKFDUHSRLQWWRWKHVDPSOHGHOLYHU\DWWKHFHQWUDOODERUDWRU\
+RZHYHULQIRUPDWLRQ UHJDUGLQJ WKH SHUVSHFWLYHRI WKH SURIHVVLRQDOV LQYROYHG LQ WKHSUHDQDO\WLFDO
SKDVH LV UDWKHUVFDQW ,Q UHFHQWO\ UHSRUW RQ WKH SHUVSHFWLYH RI ODERUDWRU\ RQ WKLV WRSLF ZH
QRWHG WKDW ERWK QHJDWLYH ZHDNQHVVHV DQG WKUHDWV DQG SRVLWLYH DVSHFWV VWUHQJWKV DQG
RSSRUWXQLWLHVDURVHIURPRUJDQL]DWLRQDODVSHFWVWKRXJKSRVLWLYHRQHVZHUHDOVRLQIOXHQFHGE\
VWDIISURIHVVLRQDOLVPDQGFRPPLWPHQW
7R WKH EHVW RI RXU NQRZOHGJH QR VWXG\ KDV GHDOW ZLWK WKH SHUVSHFWLYH RI SULPDU\ KHDOWK FDUH
SURIHVVLRQDOV RQ SUHDQDO\WLFDO HUURUV 7KH SUHVHQW VWXG\ ZDV DLPHG WR H[SORUH WKH SHUVSHFWLYH RI
F
o
r R
ev
ie
w
O
n
ly
SULPDU\ FDUH SURIHVVLRQDOV DSSO\LQJ WKH VDPH PHWKRGRORJ\ SUHYLRXVO\ XVHG IRU ODERUDWRU\
SHUVRQQHO
F
o
r R
ev
ie
w
O
n
ly
0(7+2'6
'HVLJQ
$IWHUDSSURYDOE\RXULQVWLWXWLRQDO5HVHDUFK(WKLFV&RPPLWWHHZHFRQYHQHGWZRIDFHWRIDFH
JURXSLQWHUYLHZVRISURIHVVLRQDOVIURP3ULPDU\&DUH&HQWUHV3&&LQYROYHGLQWKHSUHDQDO\WLFDO
SHULRG JHQHUDO SUDFWLWLRQHUV >*3@ FRPPXQLW\ QXUVHV >&1@ DQG RWKHUDX[LOLDU\ SHUVRQQHO
LQFOXGLQJ DGPLQLVWUDWLYH SHUVRQQHO3DUWLFLSDQWV ZHUH VHOHFWHG DPRQJ SURIHVVLRQDOV IURP WKH
3&& ³/DV 'HOLFLDV´ 0iODJD FLW\ GLVWULFW 3&& ³&RtQ´ DQG 3&& ³$OKDXUtQ HO *UDQGH´
*XDGDOKRUFH UXUDO GLVWULFW RQ WKH EDVLV RI IXOILOOLQJ WZR LQFOXVLRQ FULWHULD FDSDELOLW\ IRU
WUDQVPLWWLQJ LQIRUPDWLRQ UHJDUGLQJ WKH LQYHVWLJDWHG LVVXH DQG ³VRFLDOVLJQLILFDQFH´ DQQH[HG
WRGLIIHUHQWUROHVZLWKLQWKHSUHDQDO\WLFDOSURFHVVHV
$ PHPEHU RI WKH UHVHDUFK WHDP FKDLUHG ERWK VHVVLRQV IROORZLQJ D FRPPRQ JXLGHOLQH DQG
IRUPXODWLQJ VLPSOH TXHVWLRQV GLUHFWO\ UHIHUULQJ WR VWUHQJWKV ZHDNQHVVHV RSSRUWXQLWLHV DQG
WKUHDWV6:27SHUFHLYHGLQWKHSUHDQDO\WLFDOSKDVH(DFKSDUWLFLSDQWZDVDVNHGWRH[SODLQ
DOOWKH6:27VGHWHFWHGLQWKHGLIIHUHQWVWHSVRIWKHSUHDQDO\WLFDOSKDVHDFFRUGLQJWRKLVRZQ
H[SHULHQFH7KLVUHIHUUHGWRWKHZKROHSUHDQDO\WLFDOSKDVHDQGQRWRQO\WRWKHVWHSVIRUZKLFK
KH ZDV UHVSRQVLEOH 3DUWLFLSDQWV ZHUH QRW FRPSHOOHG WR UHVSRQG WR HYHU\ LWHP GXULQJ WKH
SHUVRQDO LQWHUYLHZ VR WKH\ FRXOG H[SUHVV WKHLU RSLQLRQ DW DQ\ PRPHQW GXULQJ WKH PHHWLQJ
7KH VHVVLRQV ZHUH DXGLRUHFRUGHG DQG KDQG DQQRWDWLRQV ZHUH WDNHQ E\ WKH FKDLUSHUVRQ
,QIRUPDWLRQVDWXUDWLRQZDVDFKLHYHGLQDQGPLQXWHVUHVSHFWLYHO\
$QDO\VLV
8VXDOO\WKH6:27DQDO\VLVLVVHHQDVWKHILQDOVWHSRIWKHVWUDWHJLFDQDO\VLV+RZHYHUZH
XVH WKH 6:27 VWUXFWXUH DV D JXLGH ZH SHUIRUPHG D TXDOLWDWLYH DQDO\VLV ZLWK D
SKHQRPHQRORJLFDO DSSURDFK RIIHULQJ D GLIIHUHQW ZD\ DERXW KRZ WR REWDLQ WKH LQIRUPDWLRQ
SURYLGHGE\WKHUHVHDUFKSDUWLFLSDQWVEDVHGLQWKHTXDOLWDWLYHSDUDGLJP
:H FDWHJRULVHG WKH UHVXOWV E\ JURXSLQJ WKH UHVXOWDQW GLPHQVLRQV DFFRUGLQJWR 6:27 VWUXFWXUHIRU
REWDLQLQJ GLPHQVLRQV ZKLFK JLYH H[SODQDWLRQ WR WKH SKHQRPHQRQ7KH QXPEHU RI FLWDWLRQV DUH
UHFRUGHGWKHQXPEHURIFLWDWLRQVDUHFRXQWHGWRHVWDEOLVKWKHLPSRUWDQFHRIGLVFRXUVHVEDVHG
RQWKHQXPEHURIWLPHVGLVFXVVHG
F
o
r R
ev
ie
w
O
n
ly
5(68/76
2YHUDOOSURIHVVLRQDOVPHWWKHLQFOXVLRQFULWHULDEXWRQO\DWWHQGHGWKHVHVVLRQV*3
&1 DQG DX[LOLDU\ SHUVRQQHO ZKR ZHUH GLVWULEXWHG LQ WZR JURXSV DQG $JH RFFXSDWLRQ
SURIHVVLRQDODSSRLQWPHQWDQGJHQGHUZHUHVLPLODUO\GLVWULEXWHGEHWZHHQJURXSV7KHQXPEHURI
FRPPHQWDULHVIRUHDFKLWHPLVJLYHQZLWKLQVTXDUHGEUDFNHWV
7KHPRVWFRPPHQWHG6WUHQJWKVZHUHWKHRUJDQLVDWLRQDOIUDPHZRUNDQGWHDPZRUN>@ZLWKSUREOHP
VROYLQJFDSDELOLW\>@DQGXWLOL]DWLRQRIDQLQWUDQHWEDVHGWHVWUHTXHVW>@
0DLQ :HDNQHVV ZDV WKH LQFUHDVH LQ ZRUNORDG UHODWHG ZLWK OLWWOH WLPH DYDLODEOH IRU EORRG
VDPSOLQJ LH LI WKH\ KDYH RQH KRXU IRU EORRG VDPSOLQJ DQG WKH VDPH QXPEHU RI SDWLHQWV D
ORZHU QXPEHURIQXUVHVUHVXOWVLQVKRUWHVWWLPHIRUHDFKEORRGVDPSOLQJ>@7KHSDUWLFLSDQWV
DOVR UHSRUWHG WKH DEVHQFH RI GHWDLOHG DQDO\WLFDO WHVW SURILOH IRU VSHFLILF UHTXHVW HJ EDVLF
KDHPRVWDVLV>@GHOD\V LQ VDPSOHV WUDQVSRUWDWLRQ>@ ORQJ GLVWDQFH EHWZHHQ 3&& DQG FHQWUDO
ODERUDWRULHV>@ VRPH FKDUDFWHULVWLFV RI SDWLHQWV HJ HOGHUO\ SHRSOHXVXDOO\ ZLWK SRRU YHQRXV
DFFHVV UHTXLUHV PRUH WLPH IRU VDPSOLQJ >@ DQG ODFN RI ORZ IOH[LELOLW\ LQ VRPH DQDO\WLFDO
UHTXHVWVHJHOHFWURQLFIRUPDUHXVHGRQO\IRUDQDO\WLFDOSURILOHVEXWQRWIRUVLQJOHSDUDPHWHU
UHTXHVWV>@
7KH2SSRUWXQLWLHVZHUHUHODWHGWRWKHRSWLPLVDWLRQRIWKHZRUNORDGWKURXJKRQOLQHHOHFWURQLFIRUP
IRUDQDO\WLFDOUHTXHVW>@DQGWKHDGRSWLRQRIVRPHSURWRFROPRGLILFDWLRQVIRULPSURYLQJWKHZKROH
SURFHVVHJFHQWULIXJDWLRQRIVDPSOHVDW3&&UHIULJHUDWHGWUDQVSRUW>@
7KH7KUHDWVZHUHUHODWHGWRWKHORQJWLPHHODSVHGIURPEORRGVDPSOLQJDW3&&WRVDPSOHGHOLYHU\DW
WKH&HQWUDO/DERUDWRU\SUREOHPVZLWKFROGVWRUDJHHJGDPDJHGUHIULJHUDWRUVWKHSHUVLVWHQFHRI
KLJKZRUNORDGVRYHUWKHWLPHDQGSUREOHPVZLWKWKHXVH RISDSHUIRUPVZKHQWKHUHTXHVWHGWHVWV
ZHUHQRWLQFOXGHGLQWKHHOHFWURQLFIRUP>@6HHLQGHWDLODW7DEOH
:H FDQ ILQG RWKHU UHVXOWV LQ VRPH LWHPV WKH QXPEHU RI SDUWLFLSDQWV ZLWK QR OLPLW WRH[SODLQ WKHLU
RSLQLRQVRQO\WKHLQIRUPDWLRQRYHUORDGLVUHTXLUHGWRVWRSFROOHFWLQJGDWD
1
F
o
r R
ev
ie
w
O
n
ly
',6&866,21
7KRXJK WKH SUHVHQFH RI HUURUV LQ WKHSUHDQDO\WLFDO SKDVH LV DQ XQFRQWURYHUWHG IDFW DQG PRVW RI
WKHLU FDXVHV KDYH EHHQ LGHQWLILHG LWV FRUUHFWLRQ LV QRW VR VWUDLJKWIRUZDUG 'LIIHUHQW DSSURDFKHV WR
WKH SUREOHP KDYH FRQWULEXWHG PLJKWLO\ WR H[SODLQLWV FRPSOH[LW\ EXW DQ DSSUR[LPDWLRQ WR WKH
RSLQLRQ RI SURIHVVLRQDOV LQYROYHG LQ WKLV SURFHVV LV ODFNLQJ 6HYHUDO UHVHDUFKHUV KDYH SHUIRUPHG
TXDOLWDWLYHDSSURDFKHVWRWKLVSUREOHPDPRQJQXUVHVIURP3&&XVLQJDTXHVWLRQQDLUHWKDWPRVWO\
GHDOWZLWKWHFKQLFDOLVVXHVEXWQRWVSHFLILFDOO\ZLWKSHUVRQDOSHUVSHFWLYHV
,QWKLVUHJDUGZKHQLQTXLULQJDJURXSRIODERUDWRU\SURIHVVLRQDOVDERXWWKHLUYLHZVRQWKLVSUREOHP
D SUHYLRXV VWXG\ UHYHDOHG WKHLU LQYROYHPHQW LQ WKLV SKDVH DQG DOVR WKHLU YLHZV RQ ZKDW NLQG RI
SUREOHPV H[HUW D PDMRU LQIOXHQFH RQ WKH GHYHORSPHQW RI WKHLU SURIHVVLRQDODFWLYLW\ :LWK WKLV
H[FHSWLRQ DQ DSSURDFK WR WKH SUREOHP IURP WKH SKHQRPHQRORJLFDO SRLQW RI YLHZ KDV QRW EHHQ
DFFRPSOLVKHG7KLVDSSURDFKDOORZVQRWRQO\WRYDOLGDWHPRGHOVRUK\SRWKHVHVEXWWRGHYHORSQHZ
FRQFHSWV DQG LGHDV RQ WKH EDVLV RI FROOHFWHG GDWD ,W DOVR DOORZV WKH UHVHDUFKHU WR KDYH D IXOO
YLVLRQRIWKHILHOGRILQWHUHVWVLQFHLQGLYLGXDOCVSHUFHSWLRQVDUHQRWMXVWUHGXFHGWRYDULDEOHV
EXWFRQVLGHUHGDVDZKROH
7RWKLVHQGWKHVHDUFKIRULQIRUPDWLRQZDVVWUXFWXUHGXVLQJWKHWHFKQLTXHRIIRFDOJURXSVZLWK
WKH6:27DQDO\VLVDVDJXLGHIRUVWUXFWXULQJWKHSHUVSHFWLYHVRIIHUHGE\SDUWLFLSDQWV
,WPXVWEHERUQHLQPLQGWKDWWKH6:27LVDFWXDOO\DPHWKRGRORJ\ZKLFKLVRULHQWHGPDLQO\WRKHOS
LQPDNLQJGHFLVLRQVRQDQ\DVSHFWWKDWQHHGVWREHUHVROYHGRULPSURYHG,WKDVDVWUDWHJLFIRFXVDV
LWOHWVRQHUHDOL]HVWKDWWKUHDWVFRPHIURPWKHIXWXUHDQGWKHZHDNQHVVIURPWKHSUHVHQWEXWFKURQLF
ZHDNQHVV FDQ EH DOVR FRQVLGHUHG DV D WKUHDW +RZHYHU WKLV LV D GLIIHUHQW ZD\ RI XVLQJ
6:27EHFDXVHXVXDOO\WKLVDQDO\VLVGRHVQ¶WLQFOXGHDSKHQRPHQRORJLFDODQDO\VLV
7KH SKHQRPHQRORJLFDO DSSURDFK DOORZV NQRZLQJ WKRVH DVSHFWV WKDW FDQQRW EH HOXFLGDWHG E\
REMHFWLYH GDWD PHDVXUHPHQW ,W LV GLIILFXOW WR PHDVXUH WKH FRPPLWPHQW RI SURIHVVLRQDOV LQ WKH
VROXWLRQRISUREOHPVEXWLWLVSRVVLEOHWRNQRZKRZLPSRUWDQWDUHWKHVHSUREOHPVFRQVLGHUHGE\WKH
SURIHVVLRQDOV $FFRUGLQJ WR GDWD GHSLFWHG LQ 7DEOH SDUWLFLSDQWV VRXJKW SHUVRQQHO¶V
SURIHVVLRQDOLVP DQGFRPPLWPHQWDV EDVLF WRROV WR DYRLG RU PLQLPL]HSUHDQDO\WLFDO HUURUV 7KLV
ZD\ DWWLWXGHV FRQVLGHUHG DV SRVLWLYH VWUHQJWKV DQG RSSRUWXQLWLHV FDQ EH H[SORLWHG E\ WKH
LQVWLWXWLRQ ZKHUHDVWKRVHFRQVLGHUHGDV QHJDWLYH ZHDNQHVVHV DQGWKUHDWVDOHUW RISRVVLEOHIXWXUH
SUREOHPV,QDGGLWLRQLWVGXFWLOLW\DOORZVWKHXVHRIRWKHUVPHWKRGRORJLHVWKDWPD\EHDQHIIHFWLYH
DGMXQFWHJWKHXVHRIFRPSXWHUWRROVFDQOHDGWRHUURUPLQLPL]DWLRQ-RLQLQJWRJHWKHUWKHVHWZR
LGHDVVHHPVWREHRQHRIWKHEDVLFVWUDWHJLHVWRDFKLHYHSRVLWLYHUHVXOWVLQWKLVDUHD
F
o
r R
ev
ie
w
O
n
ly
,Q DJUHHPHQW ZLWK SUHYLRXV YLHZV IURP ODERUDWRU\ SURIHVVLRQDOV IRU 3&& SURIHVVLRQDOV
SUREOHPVDVVRFLDWHGZLWKWKHFXUUHQWFRQWH[WRIHFRQRPLFFULVLVVXFKDVWKHGHFUHDVHLQWKHQXPEHU
RISURIHVVLRQDOVDQGWKHFRQVHTXHQWLQFUHDVHLQZRUNORDGVDORQJZLWKVWUXFWXUDOGHILFLHQFLHVVXFK
DV WKH GLIILFXOWLHV LQ HQVXULQJ WKH FRQVHUYDWLRQ RI VDPSOHV DUH FRQVLGHUHG DV WKUHDWV 7DEOH ,Q
FRQWUDVW3&&SHUVRQQHOGLGQRWFRQVLGHUWKHODFNRIWUDLQLQJSURJUDPVDVDWKUHDWZKHUHDVLW
ZDV DQ LPSRUWDQW LVVXHIRUODERUDWRU\ VWDII7KLV LVLQWHUSUHWHGSHUFHLYHG E\ ODERUDWRU\VWDII
DV D GHILFLHQW NQRZOHGJH RQ ODERUDWRU\ SURFHGXUHV DPRQJ 3&& SURIHVVLRQDOV XQNQRZQ
NQRZQRUXQNQRZQXQNQRZQV
$OWKRXJK ZH EHOLHYH WKDW RXU NQRZOHGJH RQ WKH VRXUFHV SUHDQDO\WLFDO PLVWDNHV LQ 3&&
VDPSOHV IURP SULPDU\ FDUH DW WKLV PRPHQW ZH GRQ¶W GHWHFW DQ\ LPSURYHPHQW SUREDEO\
EHFDXVHZHKDYHQRWSODQQHGDQ\LQWHUYHQWLRQ\HW+RZHYHUZHZLOOXQGHUWDNHDIDLOXUHPRGH
DQDO\VLVDQGHIIHFWV)0($WRHVWDEOLVKWKHFRUUHFWIORZRISUHDQDO\WLFDOPLVWDNHVWRJHWKHU
ZLWKDVSHFLILFWUDLQLQJDFWLYLW\IRUSULPDU\FDUHSURIHVVLRQDOV1HZUHVHDUFKSURMHFWVRI
RXUWHDPVHWDVDPSOHLQFUHDVHLQRUGHUWRLQFOXGHKHDOWKV\VWHPPDQDJHUVDQGSURIHVVLRQDOV
IURPGLIIHUHQWKHDOWKDUHDV
)LQDOO\ZHFRQVLGHUWKDWWKHREWDLQHGLQIRUPDWLRQZLOODOORZDPRUHFRPSUHKHQVLYHXQGHUVWDQGLQJ
RI WKH VRXUFHV RI SUHDQDO\WLFDO HUURUV VRPHWKLQJ WKDW VKRXOG DOZD\V EH D SULRULW\ IRU KHDOWK
SURIHVVLRQDOV ,Q DGGLWLRQ WKH FRPSOHPHQWDU\ LQVLJKWV IURP WZR DSSDUHQWO\ DQWDJRQLVWLF VFLHQWLILF
SDUDGLJPV VKRXOG SURYLGH QHZ SRLQWV RI YLHZ FRQWULEXWLQJ WR D EHWWHU LGHQWLILFDWLRQ RI SUREOHPV
DQGWKHUHIRUHWRDEHWWHUSODQQLQJDQGLPSOHPHQWDWLRQRIYDOLGVROXWLRQV$OOWKLVWRJHWKHUZLWKWKH
SURIHVVLRQDOV¶ SHUFHSWLRQ RI ³EHLQJ KHDUG´ VKRXOG SURYLGH D ZLGHU UDQJH RI LQWHUYHQWLRQ
SRVVLELOLWLHVPDQ\RIZKLFKZRXOGKDYHQRWEHHQGHWHFWHGRWKHUZLVH
1
F
o
r R
ev
ie
w
O
n
ly
5()(5(1&(6
3OHEDQL 0 &DUUDUR 3 0LVWDNHV LQ D VWDW ODERUDWRU\ W\SHV DQG IUHTXHQF\ &OLQ &KHP
±
:LZDQLWNLW 9 7\SHV DQG IUHTXHQF\ RI SUHDQDO\WLFDO PLVWDNHV LQ WKH ILUVW 7KDL ,62
FHUWLILHGFOLQLFDOODERUDWRU\DPRQWKPRQLWRULQJ%0&&OLQ3DWKRO
&DUUDUR33OHEDQL0(UURUVLQDVWDWODERUDWRU\W\SHVDQGIUHTXHQFLHV\HDUVODWHU&OLQ
&KHP±
%RQLQL 3$ 3OHEDQL 0 &HULRWWL ) 5XEEROL ) (UURUV LQ ODERUDWRU\ PHGLFLQH &OLQ &KHP
±
&DUUDUR 3 6HUYLGLR 3 3OHEDQL 0 +HPRO\]HG VSHFLPHQV D UHDVRQ IRU UHMHFWLRQ RU FOLQLFDO
FKDOOHQJH"&OLQ&KHP
5RPHUR5XL]$7URQFKRQLGHORV/ODQRV-6DQFKH]1HJUHWH-9DORUDFLRQGHODDSDULFLRQ
GH KHPROLVLV FRQ WUHV VLVWHPDV GLIHUHQWHV GH H[WUDFFLR Q VDQJXÕQHD 5HY (QIHUP
±
(OOLV *$Q HSLVRGH RI LQFUHDVHG KHPRO\VLV GXH WR D GHIHFWLYH SQHXPDWLF DLU WXEH GHOLYHU\
V\VWHP&OLQ%LRFKHP±
6WDQNRYLF $. 7KH ODERUDWRU\ LV D NH\ SDUWQHU LQ DVVXULQJ SDWLHQW VDIHW\ &OLQ /DE 0HG
±
.DOUD - 0HGLFDO HUURUV LPSDFW RQ FOLQLFDO ODERUDWRULHV DQG RWKHU FULWLFDO DUHDV &OLQ
%LRFKHP±
*DURQ -( 3DWLHQW VDIHW\ DQG WKH SUHDQDO\WLF SKDVH RI WHVWLQJ &OLQ /HDGHUVK 0DQDJ 5HY
,QVWLWXWHRI0HGLFLQH7RHUULVKXPDQ%XLOGLQJDVDIHUKHDOWKV\VWHP%ULHIVXPPDU\
$YDODLEOHDWKWWSZZZLRPHGX)LOHDVS[",' $FFHVHGRQ
:DOOLQ 2 6|GHUEHUJ - 9DQ *XHOSHQ % %UXOLQ & *UDQNYLVW . 3DWLHQWFHQWUHG FDUH
SUHDQDO\WLFDOIDFWRUVGHPDQGDWWHQWLRQDTXHVWLRQQDLUHVWXG\RIYHQRXVEORRGVDPSOLQJDQG
VSHFLPHQKDQGOLQJ6FDQG-&OLQ/DE,QYHVW
6|GHUEHUJ-%UXOLQ&*UDQNYLVW.:DOOLQ23UHDQDO\WLFDOHUURUVLQSULPDU\KHDOWKFDUHD
TXHVWLRQQDLUHVWXG\RILQIRUPDWLRQVHDUFKSURFHGXUHVWHVWUHTXHVWPDQDJHPHQWDQGWHVWWXEH
ODEHOOLQJ&OLQ&KHP/DE0HG
6|GHUEHUJ - -RQVVRQ 3$:DOOLQ 2 *UDQNYLVW . +XOWGLQ -+DHPRO\VLVLQGH[DQ HVWLPDWH
RISUHDQDO\WLFDOTXDOLW\LQSULPDU\KHDOWKFDUH&OLQ&KHP/DE0HG
6|GHUEHUJ - *UDQNYLVW . %UXOLQ & :DOOLQ 2,QFLGHQW UHSRUWLQJ SUDFWLFHV LQ WKH
SUHDQDO\WLFDO SKDVH /RZ UHSRUWHG IUHTXHQFLHV LQ WKH SULPDU\ KHDOWK FDUH VHWWLQJ6FDQG
F
o
r R
ev
ie
w
O
n
ly
&OLQ/DE,QYHVW
6|GHUEHUJ-:DOOLQ2*UDQNYLVW.%UXOLQ&,VWKHWHVWUHVXOWFRUUHFW"$TXHVWLRQQDLUHVWXG\
RIEORRGFROOHFWLRQSUDFWLFHVLQSULPDU\KHDOWKFDUH-(YDO&OLQ3UDFW$XJ
:DOOLQ 2 6|GHUEHUJ -9DQ *XHOSHQ % 6WHQOXQG + *UDQNYLVW . %UXOLQ & %ORRG VDPSOH
FROOHFWLRQ DQG SDWLHQW LGHQWLILFDWLRQ GHPDQG LPSURYHPHQW D TXHVWLRQQDLUH VWXG\ RI
SUHDQDO\WLFDO SUDFWLFHV LQ KRVSLWDO ZDUGV DQG ODERUDWRULHV 6FDQG - &DULQJ 6FL 6HS
3OHEDQL 0 7KH GHWHFWLRQ DQG SUHYHQWLRQ RI HUURUV LQ ODERUDWRU\ PHGLFLQH $QQ &OLQ
%LRFKHP±
&DUUDUR3=DJR73OHEDQL0([SORULQJWKH,QLWLDO6WHSVRIWKH7HVWLQJ3URFHVV)UHTXHQF\
DQG1DWXUHRI3UH3UHDQDO\WLF(UURUV&OLQLFDO&KHPLVWU\±
*yPH]6DOJDGR - 5RPHUR$ &RERV$ &DSDUUyV ,6 *yPH])HUQiQGH] -$ 'RPLQJXH]
-$5XL])UXWRV&3UHDQDO\WLFDOHUURUVWKHSURIHVVLRQDOV¶SHUVSHFWLYH&OLQ/DE&KHP0HG
$SUH
YDQ:LMQJDDUGHQ-'+6FKROWHQ*50YDQ:LMN.36WUDWHJLFDQDO\VLVIRUKHDOWKFDUH
RUJDQL]DWLRQVWKHVXLWDELOLW\RIWKH6:27DQDO\VLV,QW-+HDOWK3ODQQ0JPW
±
*KD]LQRRU\ 6 $EGL 0 $]DGHJDQ0HKU 0 6:27 PHWKRGRORJ\ D VWDWHRIWKHDUW
UHYLHZ IRU WKH SDVW D IUDPHZRUN IRU WKH IXWXUH -RXUQDO RI EXVLQHVV HFRQRPLFV DQG
PDQDJHPHQW
