This section details the steps performed for the MALDI-TOF mass spectrometry prol- ing (proteome screening).
2.2.1 MALDI-TOF Proling
After BALF (bronchoalveolar lavage uid) sample delivery on ice, cells and mucus were removed by centrifugation. Pellet and supernatant were stored at −80◦C. All sam- ples went through one freeze-thaw cycle before proteomic analysis. Supernatant pro- teome constituents were isolated using superparamagnetic particles (MB-WCX,Bruker Daltonics, Bremen, Germany). Samples were processed in duplicate according to mod- ied manufacturers protocols, taking into account the high salt concentration and low protein content (mean 0.1 ± 0.08 µg/µL). A linear MALDI-TOF mass spectrometer (MicroexLT, Bruker Daltonics) was used for prole spectra acquisition. Spectra were preprocessed, as described in Chapter 1.6.3, using the PROcess R-package [129]. Outlier spectra showing elevated/decreased intensity sum or variance over all m/z values were selected by boxplot analysis [214,215]. If visual inspection of these spectra conrmed the bad quality, these were removed from further analysis [124]. For further anaylsis and data mining the mean (median) spectrum of the remaining technical replicates for each sample was calculated [216].
2.2.2 BOS-Specic Proteome Alterations
BOS normally occurs after the rst postoperational year [217,218]. Thus I used the rank product (RP) test [94,104] on samples taken before a persistent F EV1 ≤ 80 per- cent, comparing those obtained during the rst postoperational year to samples from
later years. When ltering directly for BOS-specic proteome alterations between BOS- positive and BOS-negative samples. To adjust for the signicant dierence in time after LTx between BOS+/BOS- (Table 2.4), comparisons were restricted to samples collected within a timeframe of one year. The p-values were adjusted using false discovery rate (FDR) [105], and adjusted p-values of p ≤ 0.05 were considered signicant.
2.2.3 BOS Predictor Model
For BOS classication, I constructed a random forest (RF) predictor model [155,219,220] based on all signicantly regulated peaks (BOS-negative vs BOS-positive and after the rst postoperational year). The RF method is an ensemble classier that consists of many decision trees. Each tree is independently constructed using a subsample of the data. For our analysis the size of the subsample selected from each group was equal to 90% of the smallest class (BOS+). Each subsample was drawn without replacement [221]. A random forest predictor score (RF-score) based on the percentage of trees voting for a specic class, was used for classifying a sample. A simple major vote (RF- score ≥ 50%) dened class assignment. At each bootstrap iteration, the data not in the bootstrap sample is used to estimate the error rate. The mean error estimation over all bootstrap iterations is referred to as the out of bag (OOB) error.
Variable Ranking
The random forest method allows for the assesment of a variables importance by looking how much prediction error increases when the OOB data for that variable is permuted while all others are let unchanged. The necessary calculations for this mean decrease in acccuracy (MDA) measure are performed tree by tree. Let Tb be the tree classier constructed for the bootstrap sample Λb. First drop the OOB observations correspond- ing to Λb down the tree Tb, record the resulting classications, and compute the OOB error rate, P Eb(OOB). Next, randomly permute the OOB values on the jth variable Xj while leaving the data on all other variables unchanged. If Xj is important, permut- ing its observed values will reduce our ability to successfully classify each of the OOB obseravtions. We then drop the altered OOB observations down the tree Tb, record the resulting classications, and compute the OOB prediction error rate, P Eb(OOBj), which should be larger than the error rate of the unaltered data. A raw Tb-score for Xj can be computed by the dierence between those two OOB error rates,
rawb(j) = P Eb(OOBj) − P Eb(OOB), b = 1, 2, . . . , B (2.1) Finally, we average the raw scores over all the B trees in the forest,thus obtaining the MDA score for the jth variable:
M DA(j) = 1 B B X b=1 rawb(j) (2.2)
A high positive MDA value signies an important variable, while a score ≤ 0 describes uninformative variables. This procedure is repeated for each variable, allowing us to rank the variables according to their importance in a classication setting. A common procedure is to scale the MDA values by Z transformation [87], but in the context of this thesis the unscaled values are used. As shown in [222] unbalanced class size can introduce a bias to the calculated MDA. To make the MDA score unbiased by class size, a separate MDA for each respective class was calculated. The nal MDA was then obtained by averaging (mean) over the classwise MDAs.
Variable Selection
Training the random forest on the BOS-positive and BOS-negative samples, the peaks were chosen such that the area under curve (AUC) [222] of the random forests out of bag (OOB) predictions was minimized and peaks considered uninformative according to their RF-based mean decrease inaccuracy score (MDA ≤ 0 ) were excluded (Listing 2.1). For this an RF model was learned using only the highest ranking (low RP) peaks from each of the four lists of interest (up/down BOS+/BOS- and up/down after the rst postoperational year). Subsequent models were learned on a set of peaks increased by the next highest ranked peak from each list. This was repeated as long as it also led to an increase in the AUC of the OOB predictions. Peaks with MDA ≤ 0, according to the RF model learned using the respective peaks, were removed from the list showing the highest AUC. The remaining selected peaks were used to learn the nal RF classier. An unbiased estimation of classier performance was obtained by a specically adapted cross-validation scheme, with all feature selection steps using class information being included in the validation.
Listing 2.1. This listing describes the algorithm behind the newly developed feature selection approach. 1 2 S e l e c t the f e a t u r e l i s t s o f i n t e r e s t . 3 4 Order the f e a t u r e s ( peaks ) in each se p a r a t e l i s t according
5 to t h e i r RP s c o r e ( from lowest to h i g h e s t ) . 6 7 p = 1 8 9 S e l e c t the p h i g h e s t ranked f e a t u r e s 10 from each l i s t o f i n t e r e s t . 11 Call t h i s s e t o f f e a t u r e s G . 12 13 Fit a random f o r e s t F to the data using G .
14
Anew = c a l c u l a t e the AUC o f F based on the OOBF
16
Call the best current f e a t u r e s e t Go
17
Go= G
18 19
Call the best current random f o r e s t c l a s s i f i e r Fo
20 Fo= F 21 22 continue = TRUE 23 24
while( continue == TRUE)
25 26 p = p + 1
27 28 Augment G to i n c l u d e the p h i g h e s t ranked
29 genes from each l i s t of i n t e r e s t .
30
Call t h i s new s e t G+.
31 32
Fit a random f o r e s t F+ to the data using G+.
33
Anew = c a l c u l a t e the AUC
34
f o r F+ based on the OOB+
F 35 36 i f Anew> Aold 37 38 Aold= Anew 39 Go= G+ 40 Fo= F+ 41 42 e l s e 43 44 continue = FALSE 45 46 end i f 47 48 end while 49 50 51
Calculate the unscaled MDA o f each f e a t u r e
52
in Go according to Fo .
53
Remove the genes with M DA ≤ 0 from Go
54
Call t h i s s e t G∗.
55 56
Cross-Validation
To get an estimate of classier performance, I used a cross-validation approach that included all feature selection steps using class information. At each iteration all sam- ples from a respective patient (BOS-positive, BOS-negative and BOS-unclassied) were not part of the training set. Thus the RF predictor score (RF-score) between 0% (= BOS-negative) and 100% (= BOS-positive) assigned to each sample (including the ones labelled as BOS-unclassied) during cross-validation, is not biased by previous knowl- edge of the patient/sample in question. Discriminative power of BOS-positive and BOS- negative classication was evaluated using acuracy, sensitivity, specity and a receiver operating characteristic (ROC) curve [149]. Since the assigned RF scores were unbiased, they were used for further validation by risk assessment on the samples taken before an irreversible drop to F EV1 ≤ 80%.
2.2.4 BOS Risk Monitoring
BOS-free time was dened as the time dierence between date of bronchoscopic sampling and a persistent F EV1 ≤ 80%. For samples taken before an irreversible drop to F EV1 ≤ 80%, the mean follow-up time was 877 days ± 388, and the follow-up for statistical analysis was limited to 3 years after bronchoscopy. Kaplan-Meier plots were used to visualize the BOS-free time distributions, and the signicance of dierences in BOS-free time was evaluated by log-rank tests. Univariate and multivariate analysis of factors signicantly related to BOS-free time was performed using Cox proportional hazard models.
2.2.5 Identication of BALF Proteome Constituents
Mass identication was enabled by MALDI-TOF/TOF analysis and in-gel tryptic diges- tion followed by peptide mass ngerprinting. MALDI-TOF/TOF peptide and protein fragment analysis was performed with an Ultraex I device (Bruker Daltonics). Iden- tication of masses beyond the MALDI-TOF/TOF technical limit of about 3-5 kDa was achieved by horizontal SDS-PAGE of BALF samples (precast 12.5% CleanGels, proprietary neutral SDS buer system; ETC Electrophorese-Technik, Kirchentellinsfurt, Germany). Gels were stained with colloidal Coomassie (Carl Roth GmbH, Karlsruhe, Germany) and prominent bands up to 170 kDa excised for in-gel tryptic digestion ac- cording to standard protocols. Peptide mass mapping using the MASCOT search engine (Matrix Science, London, UK) complemented by MALDI-TOF/TOF data was used to analyze the tryptic digests. Peak identication was further supported [223] with the ExPASy TagIdent tool (SIB, Basle, Switzerland) by database search for unique exact mass matches (pI range 0-14, Mw range 0.5 %). All identication results were further supported by pearson correlation based agglomerative hierarchical clustering.
2.2.6 Enzyme-Linked Immunosorbent Assay
The diagnostic immunoassay for clara cell protein (CCP) was conducted according to the manufacturers instructions (BioVendor, Heidelberg, Germany). Each of the mea- surements was normalized against the baseline value (rst available sample) for the respective patient. BALF samples were divided into two groups. Group 1: ISHLT BOS stage progression in relation to the previous sample (BOS0 -> BOS1 -> BOS2 -> BOS3). Group 2: No ISHLT BOS stage progression in relation to the previous sample. For each sample, the percentage of change in protein concentration in relation to the previous sample was calculated. Signicance of detected changes was assessed using the Wilcoxon rank sum test.