EPSY 906/CLDP 948 Example 04
CFA Example Using Forgiveness of Situations (N = 1103)
The Forgiveness of Situations Subscale includes six items, three of which are reverse-coded, on a seven-point scale:
- When things go wrong for reasons that can’t be controlled, I get stuck in negative thoughts about it. (R)
- With time I can be understanding of bad circumstances in my life.
- If I am disappointed by uncontrollable circumstances in my life, I continue to think negatively about them. (R)
- I eventually make peace with bad situations in my life.
- It’s really hard for me to accept negative situations that aren’t anybody’s fault. (R)
- Eventually I let go of negative thoughts about bad circumstances that are beyond anyone’s control.
Response Anchors:
- 1 = Almost Always False of Me
- 2 = ?
- 3 = More Often False of Me
- 4 = ?
- 5 = More Often True of Me
- 6 = ?
- 7 = Almost Always True of Me
Package Installation and Loading
For this example, we will be using the ggplot2 (for general plotting), melt2 (for data reshaping before plotting), and lavaan (for CFA) packages.
if (require(ggplot2)==FALSE){
install.packages("ggplot2")
}Loading required package: ggplot2library(ggplot2)
if (require(reshape2) == FALSE){
install.packages("reshape2")
}Loading required package: reshape2if (require(lavaan) == FALSE){
install.packages("lavaan")
}Loading required package: lavaan
This is lavaan 0.5-23.1097
lavaan is BETA software! Please report any bugs.library(lavaan)
if (require(psych) == FALSE){
install.packages("psych")
}Loading required package: psych
Attaching package: ‘psych’
The following object is masked from ‘package:lavaan’:
cor2cov
The following objects are masked from ‘package:ggplot2’:
%+%, alphaif (require(knitr) == FALSE){
install.packages("knitr")
}Loading required package: knitrif (require(kableExtra) == FALSE){
install.packages("kableExtra")
}Loading required package: kableExtraData Import into R
The data are in a text file named Study2.dat orignally used in Mplus (so no column names were included at the top of the file). The file contains more items than we will use, so we select only the “Forgiveness of Situations” items from the whole file.
#read in data file (Mplus file format so having to label columns)
hfsData = read.table(file = "Study2.dat", header = FALSE, na.strings = "99999", col.names = c("PersonID", "Self1", "Self2r", "Self3", "Self4r", "Self5", "Self6r", "Other1r", "Other2", "Other3r", "Other4", "Other5r", "Other6", "Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6", "Selfsub", "Othsub", "Sitsub", "HFSsum"))
#select Situations items and PersonID variables
hfsSituations = hfsData[c("PersonID", "Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")]Observed Sample Statistics
Sample Correlation Matrix
The observed correlation matrix, rounded to three digits:
#here the c() function selects only the variables, not the PersionID variable
round(cor(hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")]), digits = 3) Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 1.000 0.240 0.647 0.300 0.453 0.297
Sit2 0.240 1.000 0.317 0.570 0.255 0.457
Sit3r 0.647 0.317 1.000 0.369 0.482 0.356
Sit4 0.300 0.570 0.369 1.000 0.289 0.448
Sit5r 0.453 0.255 0.482 0.289 1.000 0.304
Sit6 0.297 0.457 0.356 0.448 0.304 1.000Sample Means and Variances
The observed means, rounded to three digits:
apply(X = hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")], MARGIN = 2, FUN = function(x) round(mean(x), digits = 3))Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
4.547 5.289 4.896 5.359 4.860 5.321 The observed variances (using \(N\) in the denominator to match ML estimated output and Mplus example), rounded to three digits:
apply(X = hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")], MARGIN = 2, FUN = function(x) round(var(x, na.rm = TRUE)*1102/1103, digits = 3))Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
3.049 1.903 2.543 1.967 2.945 2.341 Sample Covariances
To do a CFA analysis, you only really need means, variances, and either correlations or covariances among items. That said, modern methods of estimation use the raw data (often called full information) rather than the summary statistics as the raw data enable better missing data assumptions when using maximum likelihood and Bayesian estimation methods.
The sample covariance matrix can be found from the sample correlations and variances. Each covariance between a pair of variables \(y_1\) and \(y_2\) is denoted with a \(\sigma_{y_1, y_2}\) and each correlation is denoted with a \(\rho_{y_1, y_2}\). The variance of a variable is denoted by \(\sigma^2_{y_1}\) and the standard deviation of a variable is the square root of the variance \(\sqrt{\sigma^2_{y_1}}\). The covariance can be found by taking the correlation and multiplying it by the product of the standard deviations.
\[\sigma_{y_1, y_2} = \rho_{y_1, y_2}\sqrt{\sigma^2_{y_1}}\sqrt{\sigma^2_{y_2}}. \]
Inversely, the correlation can be found by taking the covariance and dividing it by the product of the standard deviations:
\[\rho_{y_1, y_2} = \frac{\sigma_{y_1, y_2}}{\sqrt{\sigma^2_{y_1}}\sqrt{\sigma^2_{y_2}}}. \] Again, we change the denominator from \(N-1\) to \(N\) to be consistent with the Mplus example, which calculates covariances using maximum likelihood.
round(cov(hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")])*1102/1103, digits = 3) Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 3.049 0.577 1.802 0.734 1.358 0.795
Sit2 0.577 1.903 0.697 1.103 0.604 0.965
Sit3r 1.802 0.697 2.543 0.824 1.319 0.868
Sit4 0.734 1.103 0.824 1.967 0.695 0.962
Sit5r 1.358 0.604 1.319 0.695 2.945 0.798
Sit6 0.795 0.965 0.868 0.962 0.798 2.341Sample Item Response Distributions
The assumptions of CFA (i.e., normally distributed factors, no item-level factor interactions, and conditionally normal distributed items) lead to the overall assumption that our item responses must be normally distributed. From the histograms below, do you think these are normally distributed?
#stack data
melted = melt(hfsSituations, id.vars = "PersonID")
#plot by variable
ggplot(melted, aes(value)) + geom_bar() + facet_wrap(~ variable)
Lavaan Syntax
lavaan syntax is constructed using a long text string and saved in a character object. In the example below model01SyntaxLong = " opens the text string, which continues for multiple lines until the final " terminates the string. The variable model01Syntax now contains the text of the lavaan syntax. Within the syntax string, the R comment character # still functions to comment text around the syntax. Each part of the model syntax corresponds to a set of parameters in the CFA model. You can find information about lavaan at http://lavaan.ugent.be.
model01SyntaxLong = "
# Model 1 -- Fully Z-Scored Factor Identification Approach
# Item factor loadings --> list the factor to the left of the =~ and the items to the right, separated by a plus
# Once the factor is defined it can be used in syntax as if it is an observed variable
# Parameters can be fixed to constant values by using the * command; starting values can be specified by using start()*; labels can be implemented with []
Sit =~ Sit1r + Sit2 + Sit3r + Sit4 + Sit5r + Sit6
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item error (unique) variances and covariances --> use the ~~ command
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Factor variance
Sit ~~ Sit
# Factor mean (intercept)
Sit ~ 0
"To run lavaan, the syntax string variable is passed to the lavaan(model = model01SyntaxLong, ...) function. In the function call, we also supply:
data = hfsSituations: The data frame which contains the variables in the syntax.estimator = "MLR": Enables the use of robust maximum likelihood estimation, which helps for data that are not entirely normal.mimic = "mplus": Ensures compatability with Mplus output, which is often needed in practice (and is certainly needed for our homework system).std.lv = TRUE: Uses the Z-score method of identification, setting all latent variable means to zero, all latent variable variances to one, and estimating all factor loadings.
model01Estimates = lavaan(model = model01SyntaxLong, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)If the model estimation was successful, no errors would be displayed (and no output would be shown). All model information and results are contained within the model01Estimates object. To access a summary of the results use the summary() function with the following arugments:
model01Estimates: The analysis to be summarized.fit.measures=TRUE: Provides model fit indices in summary.rsqaure=TRUE: Provides the proportion of variance “explained” for each variable (\(R^2\)).standardized = TRUE: Provides standardized estimates in the summary.
summary(model01Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 20 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 427.937 307.804
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 1.390
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.787 0.732
Tucker-Lewis Index (TLI) 0.645 0.553
Robust Comparative Fit Index (CFI) 0.787
Robust Tucker-Lewis Index (TLI) 0.646
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11536.404 -11536.404
Scaling correction factor 1.416
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23108.808 23108.808
Bayesian (BIC) 23198.912 23198.912
Sample-size adjusted Bayesian (BIC) 23141.739 23141.739
Root Mean Square Error of Approximation:
RMSEA 0.205 0.173
90 Percent Confidence Interval 0.189 0.222 0.160 0.188
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.205
90 Percent Confidence Interval 0.185 0.224
Standardized Root Mean Square Residual:
SRMR 0.086 0.086
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.234 0.069 17.906 0.000 1.234 0.707
Sit2 0.702 0.074 9.441 0.000 0.702 0.509
Sit3r 1.241 0.063 19.847 0.000 1.241 0.778
Sit4 0.784 0.069 11.333 0.000 0.784 0.559
Sit5r 1.023 0.053 19.179 0.000 1.023 0.596
Sit6 0.819 0.069 11.942 0.000 0.819 0.535
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.604
.Sit2 5.289 0.042 127.346 0.000 5.289 3.834
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.070
.Sit4 5.359 0.042 126.896 0.000 5.359 3.821
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.832
.Sit6 5.321 0.046 115.492 0.000 5.321 3.477
Sit 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.526 0.149 10.217 0.000 1.526 0.500
.Sit2 1.409 0.128 11.014 0.000 1.409 0.741
.Sit3r 1.004 0.135 7.456 0.000 1.004 0.395
.Sit4 1.352 0.127 10.672 0.000 1.352 0.687
.Sit5r 1.899 0.118 16.025 0.000 1.899 0.645
.Sit6 1.671 0.159 10.517 0.000 1.671 0.714
Sit 1.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.500
Sit2 0.259
Sit3r 0.605
Sit4 0.313
Sit5r 0.355
Sit6 0.286Each section contains different portions of model information.
Unstandardized Model Parameter Estmates
FACTOR LOADINGS (regression slopes of item response on factor)
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.234 0.069 17.906 0.000 1.234 0.707
Sit2 0.702 0.074 9.441 0.000 0.702 0.509
Sit3r 1.241 0.063 19.847 0.000 1.241 0.778
Sit4 0.784 0.069 11.333 0.000 0.784 0.559
Sit5r 1.023 0.053 19.179 0.000 1.023 0.596
Sit6 0.819 0.069 11.942 0.000 0.819 0.535Intercepts (of Items) – HERE, ARE ACTUAL ITEM MEANS BECAUSE FACTOR MEAN IS ZERO
Note: the last term in the list, Sit is the “intercept” (mean) of the factor. As it does not have a standard error, this indicates it was fixed to zero and not estimated.
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.604
.Sit2 5.289 0.042 127.346 0.000 5.289 3.834
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.070
.Sit4 5.359 0.042 126.896 0.000 5.359 3.821
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.832
.Sit6 5.321 0.046 115.492 0.000 5.321 3.477
Sit 0.000 0.000 0.000Residual (Unique) Variances (variance of error terms)
Note: the last term in the list, Sit, is the variance of the factor. As it does not have a standard error, this indicates it was fixed to one (from the std.lv = TRUE option we used in the lavaan() function call) and not estimated.
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.526 0.149 10.217 0.000 1.526 0.500
.Sit2 1.409 0.128 11.014 0.000 1.409 0.741
.Sit3r 1.004 0.135 7.456 0.000 1.004 0.395
.Sit4 1.352 0.127 10.672 0.000 1.352 0.687
.Sit5r 1.899 0.118 16.025 0.000 1.899 0.645
.Sit6 1.671 0.159 10.517 0.000 1.671 0.714
Sit 1.000 1.000 1.000Making use of the unstandardized model estimates:
Writing out the model—individual predicted values:
- \(Y_1 = \mu_1 + \lambda_1F + e_1 = 4.547 + 1.234F + e_1\)
Writing out the model—predicted item variances and covariances:
\(Var\left( Y_1 \right) = \left( \lambda^2_1 \right) Var\left(F\right) + Var\left(e_1\right) = (1.234^2)*(1) + 1.526 = 3.049\) (= original item variance)
\(Cov\left( Y_1, Y_2 \right) = \lambda_1 Var\left(F\right) \lambda_2 = (1.234)*(1)*(.702) = .866\) (actual covariance = .577, so the model over-predicted how related items 1 and 2 should be)
Standardized Model Parameter Estimates
The last two columns of the summary output, Std.lv and Std.all, contain the standardized model parameter estimates. To understand the difference between standardized and unstandardized parameter estimates, let’s start with the standardized estimates. Standardized regression coefficients (and factor loadings) have a scale that is “units of Y” per “unit of X”. That is, the slope/loading, represents the increase in the dependent variable \(X\) per unit of the independent variabel \(X\) (in our case, the factor). The units of \(Y\) are given by the standard deviation of \(Y\), or \(SD(Y)\). Similarly, the units of \(X\) are given by the standard deviation of \(X\), or \(SD(X)\). You can think of the units associated by the fraction \(\frac{SD(Y)}{SD(X)}\). So, the first factor loading (a value of 1.234 for the item Sit1r) indicates the numeric response to the item goes up by 1.234 for every one-unit increase in the factor Sit.
The process of standardization removes the units attached to the parameter. So, if the unstandardized factor loadings are expreesed in units of \(\frac{SD(Y)}{SD(X)}\), the standardized units are acheived by either dividing or multiplying by the appropriate standard deviation to make the numerator or denominator of \(\frac{SD(Y)}{SD(X)}\) equal to one. For the standardized estimates under std.lv, the units of the factor \((SD(X))\) are removed (yielding \(\frac{SD(Y)}{1}\)) by multiplying the estimate by the factor standard deviation. Because the factor standard deviation is set to one, all estimates in this column are the same as the unstandardized estimate. These unstandardized estimates can be used to see how parameters would look under the Z-score identifiction method another identification method was used.
The standardized estimates listed under std.all are formed by multiplying the estimate by the standard deviation of the factor and dividing that by the unconditional (raw) standard deviation of the item. For instance, the “fully” standardized factor loading of the first item is found by multiplying the unstandardized coefficient (1.234) by one (the factor standard deviation) and dividing by the item’s standard deviation (\(\sqrt{3.049}\) – the square root of the item variance shown at the beginning of this example). The resulting value, \(1.234\times\frac{1}{\sqrt{3.049}} = 0.707\), represents the factor loading would the analysis have been run (a) with a Z-score factor identification and (b) on an item that was a Z-score.
The process of standardization is the same for all parameters of the model: intercepts, loadings, and residual (unique) variances. The interpretation of standardized item intercepts is difficult and often these are not reported. The standardized versions of factor loadings and unique variances are commonly reported.
Moreover, in for items measuring one factor, the standardized loadings lead directly to the \(R^2\) estimate – the amount of variance in the item responses explained by the factor. The item \(R^2\) is found by the square of the unstandardized factor loading. The R-Square information is found at the end of the model summary, so long as the option rsquare = TRUE is specified in the summary() function call.
R-Square:
Estimate
Sit1r 0.500
Sit2 0.259
Sit3r 0.605
Sit4 0.313
Sit5r 0.355
Sit6 0.286Shortening Lavaan Syntax: Lavaan Default Options
The syntax above is designed to show the mapping of all CFA parameters to all lavaan syntax elements. In reality, all you would need to write to define this model is:
model01SyntaxShort = "
Sit =~ Sit1r + Sit2 + Sit3r + Sit4 + Sit5r + Sit6
"The syntax input into the sem() function uses some defaults:
- All item intercepts are estimated (each item gets its own) and the factor mean is fixed at zero.
- All item error (unique) variances are estimated (each item gets its own).
- All factor variances and covariances are estimated (to do so, the first item after the =~ has its factor loading set to 1 – a marker item identification method)
Similarly, to run this syntax the sem fuction is now called. To see the results, the summary function is used. The sem function simplifies the syntax needed to conduct a confirmatory factor analysis. These are demonstrated below. Note the output is identical to what was run previously.
model01EstimatesShort = sem(model = model01SyntaxShort, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model01EstimatesShort, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 20 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 427.937 307.804
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 1.390
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.787 0.732
Tucker-Lewis Index (TLI) 0.645 0.553
Robust Comparative Fit Index (CFI) 0.787
Robust Tucker-Lewis Index (TLI) 0.646
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11536.404 -11536.404
Scaling correction factor 1.416
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23108.808 23108.808
Bayesian (BIC) 23198.912 23198.912
Sample-size adjusted Bayesian (BIC) 23141.739 23141.739
Root Mean Square Error of Approximation:
RMSEA 0.205 0.173
90 Percent Confidence Interval 0.189 0.222 0.160 0.188
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.205
90 Percent Confidence Interval 0.185 0.224
Standardized Root Mean Square Residual:
SRMR 0.086 0.086
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.234 0.069 17.906 0.000 1.234 0.707
Sit2 0.702 0.074 9.441 0.000 0.702 0.509
Sit3r 1.241 0.063 19.847 0.000 1.241 0.778
Sit4 0.784 0.069 11.333 0.000 0.784 0.559
Sit5r 1.023 0.053 19.179 0.000 1.023 0.596
Sit6 0.819 0.069 11.942 0.000 0.819 0.535
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.604
.Sit2 5.289 0.042 127.346 0.000 5.289 3.834
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.070
.Sit4 5.359 0.042 126.896 0.000 5.359 3.821
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.832
.Sit6 5.321 0.046 115.492 0.000 5.321 3.477
Sit 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.526 0.149 10.217 0.000 1.526 0.500
.Sit2 1.409 0.128 11.014 0.000 1.409 0.741
.Sit3r 1.004 0.135 7.456 0.000 1.004 0.395
.Sit4 1.352 0.127 10.672 0.000 1.352 0.687
.Sit5r 1.899 0.118 16.025 0.000 1.899 0.645
.Sit6 1.671 0.159 10.517 0.000 1.671 0.714
Sit 1.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.500
Sit2 0.259
Sit3r 0.605
Sit4 0.313
Sit5r 0.355
Sit6 0.286Alternative Identification Methods
There are multiple equivalent ways of getting the same CFA model, but with different scaling for the factor mean and variance (i.e., different means of identification). Now let’s see the model parameters when using the marker item for model identification instead. In the marker item identification method:
- The first factor loading of a factor (the first variable after the
=~symbol inlavaansyntax) is set to one - The factor variance is estimated
- The factor mean is set to zero
- All item intercepts and unique variances are estimated (as done in the Z-score identification method)
Factor Mean Zero; Factor Variance Estimated (marker item factor loading)
The lavaan syntax is the same for the marker item identification, but the call to the lavaan() function does not include the std.lv = TRUE option, which defaults to the marker item method of identification:
model02Estimates = sem(model = model01SyntaxShort, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(model02Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 28 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 427.937 307.804
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 1.390
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.787 0.732
Tucker-Lewis Index (TLI) 0.645 0.553
Robust Comparative Fit Index (CFI) 0.787
Robust Tucker-Lewis Index (TLI) 0.646
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11536.404 -11536.404
Scaling correction factor 1.416
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23108.808 23108.808
Bayesian (BIC) 23198.912 23198.912
Sample-size adjusted Bayesian (BIC) 23141.739 23141.739
Root Mean Square Error of Approximation:
RMSEA 0.205 0.173
90 Percent Confidence Interval 0.189 0.222 0.160 0.188
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.205
90 Percent Confidence Interval 0.185 0.224
Standardized Root Mean Square Residual:
SRMR 0.086 0.086
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.000 1.234 0.707
Sit2 0.569 0.083 6.831 0.000 0.702 0.509
Sit3r 1.005 0.035 28.553 0.000 1.241 0.778
Sit4 0.636 0.082 7.741 0.000 0.784 0.559
Sit5r 0.829 0.053 15.698 0.000 1.023 0.596
Sit6 0.664 0.081 8.143 0.000 0.819 0.535
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.604
.Sit2 5.289 0.042 127.346 0.000 5.289 3.834
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.070
.Sit4 5.359 0.042 126.896 0.000 5.359 3.821
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.832
.Sit6 5.321 0.046 115.492 0.000 5.321 3.477
Sit 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.526 0.149 10.217 0.000 1.526 0.500
.Sit2 1.409 0.128 11.014 0.000 1.409 0.741
.Sit3r 1.004 0.135 7.456 0.000 1.004 0.395
.Sit4 1.352 0.127 10.672 0.000 1.352 0.687
.Sit5r 1.899 0.118 16.025 0.000 1.899 0.645
.Sit6 1.671 0.159 10.517 0.000 1.671 0.714
Sit 1.523 0.170 8.953 0.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.500
Sit2 0.259
Sit3r 0.605
Sit4 0.313
Sit5r 0.355
Sit6 0.286Unstandardized Model Results
FACTOR LOADINGS (regression slopes of item response on factor)
Here, loading for SIT1R is not tested and has no standard error (Std.Err) because it is fixed to one. Also, note the Std.lv estimates are identical to the unstandardized estimates in the Z-score factor identification method. Further, the Std.all estimates are equal to the Std.all estimates in the Z-score factor identification method. These will be equal for all identification methods.
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.000 1.234 0.707
Sit2 0.569 0.083 6.831 0.000 0.702 0.509
Sit3r 1.005 0.035 28.553 0.000 1.241 0.778
Sit4 0.636 0.082 7.741 0.000 0.784 0.559
Sit5r 0.829 0.053 15.698 0.000 1.023 0.596
Sit6 0.664 0.081 8.143 0.000 0.819 0.535Intercepts (of Items) – EXPECTED Y WHEN FACTOR = 0, or for mean of factor in sample
Here, all are identical to what was found in the previous Z-score standardization. That is because we left the factor mean to be zero.
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.604
.Sit2 5.289 0.042 127.346 0.000 5.289 3.834
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.070
.Sit4 5.359 0.042 126.896 0.000 5.359 3.821
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.832
.Sit6 5.321 0.046 115.492 0.000 5.321 3.477
Sit 0.000 0.000 0.000Residual (unique) variances and factor variance
Here, the factor variance is estimated, which is different from the previous identification method.
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.526 0.149 10.217 0.000 1.526 0.500
.Sit2 1.409 0.128 11.014 0.000 1.409 0.741
.Sit3r 1.004 0.135 7.456 0.000 1.004 0.395
.Sit4 1.352 0.127 10.672 0.000 1.352 0.687
.Sit5r 1.899 0.118 16.025 0.000 1.899 0.645
.Sit6 1.671 0.159 10.517 0.000 1.671 0.714
Sit 1.523 0.170 8.953 0.000 1.000 1.000Estimating Factor Means: Marker Item Loading (=1) and Marker Item Intercept (=0)
To estimate this model, we have to return to the general lavaan model function. In the syntax below you see 1*Sit1r, setting the factor loading for Sit1r to one (the marker item factor loading). Futher, you see Sit1r ~ 0 setting the item intercept of Sit1r to zero, the marker item intercept. Finally, to estimate the factor mean, we use Sit ~ 1, which estimates the factor mean explicitly.
model03Syntax = "
# Model 1 -- Fully Z-Scored Factor Identification Approach
# Item factor loadings --> list the factor to the left of the =~ and the items to the right, separated by a plus
# Once the factor is defined it can be used in syntax as if it is an observed variable
# Parameters can be fixed to constant values by using the * command; starting values can be specified by using start()*; labels can be implemented with []
Sit =~ 1*Sit1r + Sit2 + Sit3r + Sit4 + Sit5r + Sit6
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 0; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item error (unique) variances and covariances --> use the ~~ command
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Factor variance
Sit ~~ Sit
# Factor mean (intercept)
Sit ~ 1
"
model03Estimates = sem(model = model03Syntax, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(model03Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 55 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 427.937 307.804
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 1.390
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.787 0.732
Tucker-Lewis Index (TLI) 0.645 0.553
Robust Comparative Fit Index (CFI) 0.787
Robust Tucker-Lewis Index (TLI) 0.646
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11536.404 -11536.404
Scaling correction factor 1.416
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23108.808 23108.808
Bayesian (BIC) 23198.912 23198.912
Sample-size adjusted Bayesian (BIC) 23141.739 23141.739
Root Mean Square Error of Approximation:
RMSEA 0.205 0.173
90 Percent Confidence Interval 0.189 0.222 0.160 0.188
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.205
90 Percent Confidence Interval 0.185 0.224
Standardized Root Mean Square Residual:
SRMR 0.086 0.086
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.000 1.234 0.707
Sit2 0.569 0.083 6.831 0.000 0.702 0.509
Sit3r 1.005 0.035 28.553 0.000 1.241 0.778
Sit4 0.636 0.082 7.741 0.000 0.784 0.559
Sit5r 0.829 0.053 15.698 0.000 1.023 0.596
Sit6 0.664 0.081 8.143 0.000 0.819 0.535
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 0.000 0.000 0.000
.Sit2 2.701 0.383 7.045 0.000 2.701 1.958
.Sit3r 0.325 0.171 1.899 0.058 0.325 0.204
.Sit4 2.469 0.380 6.502 0.000 2.469 1.760
.Sit5r 1.092 0.246 4.431 0.000 1.092 0.636
.Sit6 2.304 0.369 6.249 0.000 2.304 1.506
Sit 4.547 0.053 86.474 0.000 3.684 3.684
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.526 0.149 10.217 0.000 1.526 0.500
.Sit2 1.409 0.128 11.014 0.000 1.409 0.741
.Sit3r 1.004 0.135 7.456 0.000 1.004 0.395
.Sit4 1.352 0.127 10.672 0.000 1.352 0.687
.Sit5r 1.899 0.118 16.025 0.000 1.899 0.645
.Sit6 1.671 0.159 10.517 0.000 1.671 0.714
Sit 1.523 0.170 8.953 0.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.500
Sit2 0.259
Sit3r 0.605
Sit4 0.313
Sit5r 0.355
Sit6 0.286Here, you will note the model is identical to the previous two – the log-likelihood is -11536.404, same as previously. Now, the itercepts has the mean of item Sit1r set to zero and the mean of the factor estimated.
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 0.000 0.000 0.000
.Sit2 2.701 0.383 7.045 0.000 2.701 1.958
.Sit3r 0.325 0.171 1.899 0.058 0.325 0.204
.Sit4 2.469 0.380 6.502 0.000 2.469 1.760
.Sit5r 1.092 0.246 4.431 0.000 1.092 0.636
.Sit6 2.304 0.369 6.249 0.000 2.304 1.506
Sit 4.547 0.053 86.474 0.000 3.684 3.684The mean of the factor is 4.547, which, in this case, is the mean of item Sit1r. That is because the factor loading of the item is set to 1.0. You will also notice that the other item intercepts have changed from previous models. In general, an item’s mean is found by adding the item intercept to the product of the factor loading times the factor mean, or \(\mu_i + \lambda_i\mu_F\).
Model Fit Information for a Single-Factor Model (same regardless of factor scaling method):
Calculating model degrees of freedom (v is number of observed variables in a model):
- Total df = \(\frac{v(v+1)}{2} + v = 27\)
- Number of parameters in our model: 18
- Degrees of freedom = 27-18 = 9
Loglikelihood – use for testing differences in model fit across nested models
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11536.404 -11536.404
Scaling correction factor 1.416
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction- Loglikelihood user model (H0): this is for your specified model
- Scaling correction factor for the MLR correction: indicates how far off from normal=1
- H1 Value: this is for a saturated (perfect) model
Information Criteria “smaller is better” – use for nested or non-nested model comparisons
Number of free parameters 18 18
Akaike (AIC) 23108.808 23108.808
Bayesian (BIC) 23198.912 23198.912
Sample-size adjusted Bayesian (BIC) 23141.739 23141.739- is # of estimated parameters (“free” to be not 0)
- AIC = (-2\(LL_{H0}\)) + (2estimated parameters)
- BIC = (-2\(LL_{H0}\)) + (LN Nestimated parameters)
- Sample-size adjusted Bayesian (BIC) = BIC replacing N with (N + 2) / 24
Chi-Square Test of Model Fit (Significance is bad here) for your specified model
Estimator ML Robust
Minimum Function Test Statistic 427.937 307.804
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 1.390
for the Yuan-Bentler correction (Mplus variant)- Estimator: Look at robust column for MLR version of test
- Minimum Function Test Statistic: leftover after estimating our one-factor model
- Scaling correction factor for the Yuan-Bentler correction (Mplus variant): indicates how far off from normal=1
Where does this \(\chi^2\) value for “model fit” come from? A rescaled −2LL model comparison of this one-factor model (H0) against the saturated model (H1) that perfectly reproduces the data covariances:
- Step 1: Original −2ΔLL = −2*(LLfewer – LLmore) = −2(−11,536.404 + 11,322.435) = 427.938
- Step 2: Scaling correction = [ (#parmsfewerscalefewer) – (#parmsmorescalemore) ] / (#parmsfewer – #parmsmore) = [ (18 * 1.4158) – (27 * 1.4073) ] / (18 – 27) = −12.501 / −9 = 1.3903
- Step 3: Rescaled −2ΔLL = −2ΔLL / scaling correction = 427.938 / 1.903 = 307.803 ~matches model \(\chi^2\)
- Step 4: Difference in df = #parmsmore – #parmsfewer = 27 – 18 = 9
Where the Saturated (H1) Model Comes From: All Means, Variances, and Covariances Estimated
How to fit the saturated (Unstructured) Baseline Model: Item means, variances, and covariances in original data:
modelSaturated = "
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item variances and covariances --> use the ~~ command
# Variances:
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Covariances:
Sit1r ~~ Sit2; Sit1r ~~ Sit3r; Sit1r ~~ Sit4; Sit1r ~~ Sit5r; Sit1r ~~ Sit6;
Sit2 ~~ Sit3r; Sit2 ~~ Sit4; Sit2 ~~ Sit5r; Sit2 ~~ Sit6;
Sit3r ~~ Sit4; Sit3r ~~ Sit5r; Sit3r ~~ Sit6;
Sit4 ~~ Sit5r; Sit4 ~~ Sit6;
Sit5r ~~ Sit6;
"
modelSaturatedEstimates = sem(model = modelSaturated, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(modelSaturatedEstimates, fit.measures = TRUE)Note that H0 and H1 are now the same! Our H0 model IS the H1 saturated model: the log-likelihood of H0 and H1 are the same. Also, note there are 27 free parameters (six item means, six item variances, and 15 covariances).
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11322.435 -11322.435
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Number of free parameters 27 27
Akaike (AIC) 22698.870 22698.870
Bayesian (BIC) 22834.027 22834.027
Sample-size adjusted Bayesian (BIC) 22748.268 22748.268Also note how the model \(\chi^2\) test has zero degrees of freedom: this is because all 27 possible free parameters were estimated. This model fits the data perfectly.
Estimator ML Robust
Minimum Function Test Statistic 0.000 0.000
Degrees of freedom 0 0
Minimum Function Value 0.0000000000000
Scaling correction factor NA
for the Yuan-Bentler correction (Mplus variant)The Rest of the One-Factor Model Fit Statistics
User model versus baseline model:
Comparative Fit Index (CFI) 0.787 0.732
Tucker-Lewis Index (TLI) 0.645 0.553
Robust Comparative Fit Index (CFI) 0.787
Robust Tucker-Lewis Index (TLI) 0.646
Root Mean Square Error of Approximation:
RMSEA 0.205 0.173
90 Percent Confidence Interval 0.189 0.222 0.160 0.188
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.205
90 Percent Confidence Interval 0.185 0.224
Standardized Root Mean Square Residual:
SRMR 0.086 0.086- CFI/TLI: Want close to one (1 = saturated model)
- RMSEA: Want close to zero (0 = saturated model)
- SRMR (Standardized Root Mean Square Residual): want close to zero (0 = saturated model)
Chi-Square Test of Model Fit for the Baseline Model (for the “no covariances” model)
This compares the estimated model to the one that has no covariances. It is a last-resort type model in that if the estimated model has a test with a non-significant p-value, then this indicates there will be no factors to be found in the data.
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000Where does this χ2 value for “fit of the baseline model” come from? A rescaled −2LL model comparison of the independence model with NO covariances to the saturated model:
- Step 1: Original −2ΔLL = −2*(LLfewer – LLmore) = −2(−12,312.952 + 11,322.435) = 1,981.034
Step 2: Scaling correction = [ (#parmsfewerscalefewer) – (#parmsmorescalemore) ] / (#parmsfewer – #parmsmore) = [ (12 * 0.9725) – (27 * 1.4073) ] / (12 – 27) = –26.372 / −15 = 1.7551
- Step 3: Rescaled −2ΔLL = −2ΔLL / scaling correction = 1,981.034 / 1.7551 = 1,128.704 ~matches baseline \(\chi^2\)
Step 4: Difference in df = #parmsmore – #parmsfewer = 27 – 12 = 15
What’s the point? This baseline model fit test tells us whether there are any covariances at all (i.e., whether it even makes sense to try to fit latent factors to predict them).
How to fit the Independence (Null) Baseline Model: Item means and variances, but NO covariances
modelIndependence = "
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item variances and covariances --> use the ~~ command
# Variances:
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
"
modelIndependenceEstimates = sem(model = modelIndependence, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(modelIndependenceEstimates, fit.measures = TRUE)Note how the test of the model vs. saturated is identical to the test of the model vs. baseline: that indicates this model is the baseline model.
Although not 0, this is the worst possible RMSEA while still allowing separate means and variances per item in these data. RMSEA is a parsimony-corrected absolute fit index (so, its fit is relative to the saturated model).
CFI and TLI are 0 because they are “incremental fit” indices relative to the independence model (which this is).
SRMR is also an absolute fit index (relative to saturated model), so this is the worst it gets for these data, too.
Poor Model Fit: Need for Model Modifications
For this section, any of the three equivalent single factor models can be used.
Modification Indices
So global fit for the one-factor model is not so good (RMSEA = .173, CFI = .732). What do the voo-doo modification indices suggest we do to fix it? To get modification indices, use the modificationindices() function. Here, the function is called with options:
object = model01Estimates: The model estimates object from which to derive modification indices.sort. = TRUE: Sort the output from highest to lowest modification index.
modificationindices(object = model01Estimates, sort. = TRUE) lhs op rhs mi mi.scaled epc sepc.lv sepc.all sepc.nox
27 Sit2 ~~ Sit4 224.295 161.330 0.702 0.702 0.363 0.363
22 Sit1r ~~ Sit3r 199.679 143.624 1.023 1.023 0.368 0.368
29 Sit2 ~~ Sit6 88.836 63.897 0.486 0.486 0.230 0.230
21 Sit1r ~~ Sit2 68.985 49.619 -0.464 -0.464 -0.193 -0.193
34 Sit4 ~~ Sit6 64.710 46.544 0.415 0.415 0.193 0.193
23 Sit1r ~~ Sit4 50.442 36.281 -0.403 -0.403 -0.164 -0.164
26 Sit2 ~~ Sit3r 48.505 34.888 -0.357 -0.357 -0.162 -0.162
30 Sit3r ~~ Sit4 40.616 29.214 -0.336 -0.336 -0.150 -0.150
25 Sit1r ~~ Sit6 33.475 24.078 -0.358 -0.358 -0.134 -0.134
32 Sit3r ~~ Sit6 31.132 22.392 -0.319 -0.319 -0.131 -0.131
28 Sit2 ~~ Sit5r 7.117 5.119 -0.151 -0.151 -0.064 -0.064
33 Sit4 ~~ Sit5r 6.906 4.967 -0.149 -0.149 -0.062 -0.062
24 Sit1r ~~ Sit5r 6.417 4.615 0.176 0.176 0.059 0.059
31 Sit3r ~~ Sit5r 3.548 2.552 0.123 0.123 0.045 0.045
35 Sit5r ~~ Sit6 0.736 0.529 -0.053 -0.053 -0.020 -0.020The output includes:
lhs: Left hand side for parameter (inlavaansyntax)op: Operation of parameter:~~is for (residual) covariances;=~is for additional factor loadings. All otherlavaansyntax types are possible, too, but here item means and variances fit perfectly (see below)rhs: Right hand side for parameter (inlavaansyntax)mi: Modification index using MLmi.scaled: Modification index using MLR (use this one)epc: Expected parameter change (from zero)sepc.lv: Standardized expected parameter change usingstd.lvstandardizationsepc.all: Standardized expected parameter change usingstd.allstandardizationsepc.nox: Standardized expected parameter change usingstd.noxstandardization
Highest values are for error covariances (for unknown multidimensionality).
Another approach: Residual Covariance Matrices
Another approach—how about we examine local fit and see where the problems seem to be?
The means and variances of the items will be perfectly reproduced, so that’s not an issue. Misfit results from the difference between the observed and model-predicted covariances.
lavaan gives us the “residual” (defined as observed – predicted) or “leftover” covariance matrix, but it is scale dependent and thus not so helpful. We can use the resid() function to obtain the residual covariance matrix (observed covariances minus model-implied covariances):
resid(object = model01Estimates, type = "raw")$type
[1] "raw"
$cov
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 0.000
Sit2 -0.290 0.000
Sit3r 0.271 -0.174 0.000
Sit4 -0.234 0.552 -0.149 0.000
Sit5r 0.096 -0.114 0.050 -0.108 0.000
Sit6 -0.216 0.390 -0.149 0.319 -0.040 0.000
$mean
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
0 0 0 0 0 0 lavaan also gives us “normalized” residuals, which can be thought of as z-scores for how large the residual leftover covariance is in absolute terms. Because the denominator decreases with sample size, however, these values may be inflated in large samples, so look for relatively large values.
“Normalized” Residuals for Inter-Item Covariances = (observed – predicted) / SD(observed):
resid(object = model01Estimates, type = "normalized")$type
[1] "normalized"
$cov
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 0.000
Sit2 -3.503 0.000
Sit3r 2.977 -2.253 0.000
Sit4 -2.928 6.560 -1.959 0.000
Sit5r 0.960 -1.434 0.548 -1.372 0.000
Sit6 -2.345 4.721 -1.756 3.925 -0.444 0.000
$mean
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
0 0 0 0 0 0 NEGATIVE NORMALIZED RESIDUAL: Less related than you predicted (don’t want to be together) POSITIVE NORMALIZED RESIDUAL: More related than you predicted (want to be more together)
Why might the normalized residuals (leftover correlations) for the positive-worded items be larger than for the negatively-worded items?
These results suggest that wording valence is playing a larger role in the pattern of covariance across items than what the one-factor model predicts. Rather than adding voo-doo covariances among the residuals for specific items, how about a two-factor model based on wording instead?
Model 4. Fully Z-Scored, 2-Factor Model
Here, we use the shortened syntax and the sem() function to get results.
model04Syntax = "
# SitP loadings (all estimated)
SitP =~ Sit2 + Sit4 + Sit6
# SitN loadings (all estimated)
SitN =~ Sit1r + Sit3r + Sit5r
"
model04Estimates = sem(model = model04Syntax, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 23 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 35.410 24.924
Degrees of freedom 8 8
P-value (Chi-square) 0.000 0.002
Scaling correction factor 1.421
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.986 0.985
Tucker-Lewis Index (TLI) 0.974 0.972
Robust Comparative Fit Index (CFI) 0.988
Robust Tucker-Lewis Index (TLI) 0.977
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11340.140 -11340.140
Scaling correction factor 1.402
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction
Number of free parameters 19 19
Akaike (AIC) 22718.281 22718.281
Bayesian (BIC) 22813.391 22813.391
Sample-size adjusted Bayesian (BIC) 22753.042 22753.042
Root Mean Square Error of Approximation:
RMSEA 0.056 0.044
90 Percent Confidence Interval 0.038 0.075 0.028 0.061
P-value RMSEA <= 0.05 0.277 0.708
Robust RMSEA 0.052
90 Percent Confidence Interval 0.030 0.076
Standardized Root Mean Square Residual:
SRMR 0.029 0.029
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP =~
Sit2 1.007 0.052 19.487 0.000 1.007 0.730
Sit4 1.064 0.050 21.195 0.000 1.064 0.759
Sit6 0.956 0.053 18.203 0.000 0.956 0.625
SitN =~
Sit1r 1.325 0.048 27.698 0.000 1.325 0.759
Sit3r 1.349 0.044 30.514 0.000 1.349 0.846
Sit5r 1.009 0.055 18.358 0.000 1.009 0.588
Covariances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP ~~
SitN 0.564 0.041 13.775 0.000 0.564 0.564
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 5.289 0.042 127.346 0.000 5.289 3.834
.Sit4 5.359 0.042 126.896 0.000 5.359 3.821
.Sit6 5.321 0.046 115.492 0.000 5.321 3.477
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.604
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.070
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.832
SitP 0.000 0.000 0.000
SitN 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 0.888 0.097 9.173 0.000 0.888 0.467
.Sit4 0.835 0.093 9.003 0.000 0.835 0.425
.Sit6 1.428 0.134 10.684 0.000 1.428 0.610
.Sit1r 1.294 0.103 12.547 0.000 1.294 0.425
.Sit3r 0.724 0.092 7.857 0.000 0.724 0.285
.Sit5r 1.926 0.119 16.128 0.000 1.926 0.654
SitP 1.000 1.000 1.000
SitN 1.000 1.000 1.000
R-Square:
Estimate
Sit2 0.533
Sit4 0.575
Sit6 0.390
Sit1r 0.575
Sit3r 0.715
Sit5r 0.346This model fits better (we would call this good fit). We can also compare the fit of this model with Model 1 using the anova() function. Here, the null hypothesis is that Model 1 fits as well as Model 4.
anova(model01Estimates, model04Estimates)Scaled Chi Square Difference Test (method = "satorra.bentler.2001")
Df AIC BIC Chisq Chisq diff Df diff Pr(>Chisq)
model04Estimates 8 22718 22813 35.41
model01Estimates 9 23109 23199 427.94 342.29 1 < 2.2e-16 ***
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1This function conducts the MLR version of the likelihood ratio test for us. The significant difference indicates that Model 4 fits better than Model 1.
Let’s see: Any more local fit problems? The modification indices are better (values of a little over 10 seem okay).
modificationindices(object = model04Estimates, sort. = TRUE) lhs op rhs mi mi.scaled epc sepc.lv sepc.all sepc.nox
29 SitN =~ Sit6 15.383 10.827 0.245 0.245 0.160 0.160
30 Sit2 ~~ Sit4 15.382 10.827 0.332 0.332 0.172 0.172
35 Sit4 ~~ Sit6 13.886 9.774 -0.273 -0.273 -0.127 -0.127
27 SitN =~ Sit2 13.886 9.773 -0.224 -0.224 -0.162 -0.162
24 SitP =~ Sit1r 9.244 6.507 -0.223 -0.223 -0.128 -0.128
44 Sit3r ~~ Sit5r 9.244 6.507 -0.277 -0.277 -0.101 -0.101
42 Sit1r ~~ Sit3r 7.549 5.313 0.409 0.409 0.147 0.147
26 SitP =~ Sit5r 7.549 5.313 0.191 0.191 0.111 0.111
32 Sit2 ~~ Sit1r 6.685 4.705 -0.115 -0.115 -0.048 -0.048
41 Sit6 ~~ Sit5r 5.847 4.115 0.138 0.138 0.052 0.052
40 Sit6 ~~ Sit3r 1.321 0.930 0.052 0.052 0.021 0.021
43 Sit1r ~~ Sit5r 0.667 0.469 0.071 0.071 0.024 0.024
25 SitP =~ Sit3r 0.667 0.469 0.060 0.060 0.037 0.037
33 Sit2 ~~ Sit3r 0.402 0.283 -0.025 -0.025 -0.012 -0.012
39 Sit6 ~~ Sit1r 0.346 0.244 0.030 0.030 0.011 0.011
36 Sit4 ~~ Sit1r 0.307 0.216 -0.025 -0.025 -0.010 -0.010
38 Sit4 ~~ Sit5r 0.201 0.142 0.022 0.022 0.009 0.009
34 Sit2 ~~ Sit5r 0.129 0.091 0.017 0.017 0.007 0.007
37 Sit4 ~~ Sit3r 0.101 0.071 0.013 0.013 0.006 0.006
31 Sit2 ~~ Sit6 0.023 0.016 0.010 0.010 0.005 0.005
28 SitN =~ Sit4 0.023 0.016 0.009 0.009 0.007 0.007The normalized residuals have two values that are bigger in absolute value than 2:
resid(object = model04Estimates, type = "normalized")$type
[1] "normalized"
$cov
Sit2 Sit4 Sit6 Sit1r Sit3r Sit5r
Sit2 0.000
Sit4 0.370 0.000
Sit6 0.031 -0.676 0.000
Sit1r -2.125 -0.768 0.870 0.000
Sit3r -0.896 0.192 1.658 0.172 0.000
Sit5r 0.382 1.128 2.847 0.212 -0.464 0.000
$mean
Sit2 Sit4 Sit6 Sit1r Sit3r Sit5r
0 0 0 0 0 0 Because we have no real theoretical or defendable reason to fit any of these suggested parameters, we will not add any new parameters. This will be about as good as it gets.
Calculating Reliabilities
As we have demonstrated good model fit, estimates of trait reliabilities can now be found. Although I do not dispense such advice, many people use a CFA to indicate model fit then proceed to use sum scores for each trait in a model. I do not like this because sum scores are perfectly correlated with the factor scores from the parallel items model – but we never tested that model (should it not fit we may get a reversal in the rank ordering of people by score).
Reliabilities for Sum Scores (Omega)
That said, reliabilities for sum scores can be found by using CFA model parameters. This reliability coefficient is called “Omega” by Rod McDonald and is calculated:
\[ \rho_\omega = \frac{\sigma^2_F\left( \sum_{i=1}^{Items} \lambda_i \right)^2}{\sigma^2_F\left( \sum_{i=1}^{Items} \lambda_i \right)^2 \sum_{i=1}^{Items} \sum_{j=1}^{Items} \psi_{ij}}\]
In words, Omega = Var(Factor)* (Sum of loadings)^2 / [ Var(Factor)* (Sum of loadings)^2 + Sum of error variances + 2* Sum of error covariances]
For our data:
- Omega for Positive Factor = .744
(1.007+1.064+0.956)2 / (1.007+1.064+0.956)2 + (0.888+0.835+1.428) + 2*0
(alpha was .746)
- Omega for Negative Factor = .775 (1.325+1.349+1.009)2 / (1.325+1.349+1.009)2 + (1.294+0.724+1.926) + 2*0
(alpha was .780)
Calculating Omega from lavaan
Through the use of parameter labels and new parameters, you can use lavaan to calculate Omega. In this syntax, the terms before the items are labels representing the factor loadings and unique variances. They can be used later in the syntax to form new parameters or to put constraints on the model.
model04SyntaxOmega = "
# SitP loadings (all estimated)
SitP =~ L2*Sit2 + L4*Sit4 + L6*Sit6
# SitN loadings (all estimated)
SitN =~ L1*Sit1r + L3*Sit3r + L5*Sit5r
# Unique Variances:
Sit1r ~~ E1*Sit1r; Sit2 ~~ E2*Sit2; Sit3r ~~ E3*Sit3r; Sit4 ~~ E4*Sit4; Sit5r ~~ E5*Sit5r; Sit6 ~~ E6*Sit6;
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((L2 + L4 + L6)^2) / ( ((L2 + L4 + L6)^2) + E2 + E4 + E6)
OmegaN := ((L1 + L3 + L5)^2) / ( ((L1 + L3 + L5)^2) + E1 + E3 + E5)
"
model04EstimatesOmega = sem(model = model04SyntaxOmega, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04EstimatesOmega, fit.measures = FALSE, rsquare = FALSE, standardized = FALSE, header = FALSE)
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|)
SitP =~
Sit2 (L2) 1.007 0.052 19.487 0.000
Sit4 (L4) 1.064 0.050 21.195 0.000
Sit6 (L6) 0.956 0.053 18.203 0.000
SitN =~
Sit1r (L1) 1.325 0.048 27.698 0.000
Sit3r (L3) 1.349 0.044 30.514 0.000
Sit5r (L5) 1.009 0.055 18.358 0.000
Covariances:
Estimate Std.Err z-value P(>|z|)
SitP ~~
SitN 0.564 0.041 13.775 0.000
Intercepts:
Estimate Std.Err z-value P(>|z|)
.Sit2 5.289 0.042 127.346 0.000
.Sit4 5.359 0.042 126.896 0.000
.Sit6 5.321 0.046 115.492 0.000
.Sit1r 4.547 0.053 86.474 0.000
.Sit3r 4.896 0.048 101.959 0.000
.Sit5r 4.860 0.052 94.060 0.000
SitP 0.000
SitN 0.000
Variances:
Estimate Std.Err z-value P(>|z|)
.Sit1r (E1) 1.294 0.103 12.547 0.000
.Sit2 (E2) 0.888 0.097 9.173 0.000
.Sit3r (E3) 0.724 0.092 7.857 0.000
.Sit4 (E4) 0.835 0.093 9.003 0.000
.Sit5r (E5) 1.926 0.119 16.128 0.000
.Sit6 (E6) 1.428 0.134 10.684 0.000
SitP 1.000
SitN 1.000
Defined Parameters:
Estimate Std.Err z-value P(>|z|)
OmegaP 0.744 0.020 37.956 0.000
OmegaN 0.775 0.014 56.802 0.000Calculating Omega through `lavaan also provides its standard error. Note: the Omega equation used above is for the Z-score factor identification method. If the marker-item method is used for factor loadings, then multiply the sum of the loadings by the variance of the factor, as shown in the equation above.
Of note about Omega: If we constrain all factor loadings of a trait to be equal (called Tau-Equivalent), Omega is equal to Alpha. In the syntax below, putting the labels LP and LN in multiple places causes the factor loadings for those places to be constrained to be equal:
model04SyntaxAlpha = "
# SitP loadings (all estimated)
SitP =~ LP*Sit2 + LP*Sit4 + LP*Sit6
# SitN loadings (all estimated)
SitN =~ LN*Sit1r + LN*Sit3r + LN*Sit5r
# Unique Variances:
Sit1r ~~ E1*Sit1r; Sit2 ~~ E2*Sit2; Sit3r ~~ E3*Sit3r; Sit4 ~~ E4*Sit4; Sit5r ~~ E5*Sit5r; Sit6 ~~ E6*Sit6;
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((3*LP)^2) / ( ((3*LP)^2) + E2 + E4 + E6)
OmegaN := ((3*LN)^2) / ( ((3*LN)^2) + E1 + E3 + E5)
"
model04EstimatesAlpha = sem(model = model04SyntaxAlpha, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04EstimatesAlpha, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 18 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 73.500 55.487
Degrees of freedom 12 12
P-value (Chi-square) 0.000 0.000
Scaling correction factor 1.325
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.969 0.961
Tucker-Lewis Index (TLI) 0.961 0.951
Robust Comparative Fit Index (CFI) 0.971
Robust Tucker-Lewis Index (TLI) 0.963
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11359.185 -11359.185
Scaling correction factor 1.163
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction
Number of free parameters 15 15
Akaike (AIC) 22748.370 22748.370
Bayesian (BIC) 22823.457 22823.457
Sample-size adjusted Bayesian (BIC) 22775.813 22775.813
Root Mean Square Error of Approximation:
RMSEA 0.068 0.057
90 Percent Confidence Interval 0.054 0.084 0.044 0.071
P-value RMSEA <= 0.05 0.021 0.167
Robust RMSEA 0.066
90 Percent Confidence Interval 0.049 0.084
Standardized Root Mean Square Residual:
SRMR 0.061 0.061
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP =~
Sit2 (LP) 1.014 0.036 28.384 0.000 1.014 0.734
Sit4 (LP) 1.014 0.036 28.384 0.000 1.014 0.733
Sit6 (LP) 1.014 0.036 28.384 0.000 1.014 0.653
SitN =~
Sit1r (LN) 1.254 0.032 38.954 0.000 1.254 0.735
Sit3r (LN) 1.254 0.032 38.954 0.000 1.254 0.804
Sit5r (LN) 1.254 0.032 38.954 0.000 1.254 0.682
Covariances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP ~~
SitN 0.578 0.041 14.230 0.000 0.578 0.578
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 5.289 0.042 127.346 0.000 5.289 3.827
.Sit4 5.359 0.042 126.896 0.000 5.359 3.872
.Sit6 5.321 0.046 115.492 0.000 5.321 3.427
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.667
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.141
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.645
SitP 0.000 0.000 0.000
SitN 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r (E1) 1.335 0.083 16.168 0.000 1.335 0.459
.Sit2 (E2) 0.882 0.083 10.610 0.000 0.882 0.462
.Sit3r (E3) 0.857 0.069 12.339 0.000 0.857 0.353
.Sit4 (E4) 0.887 0.075 11.779 0.000 0.887 0.463
.Sit5r (E5) 1.805 0.115 15.710 0.000 1.805 0.534
.Sit6 (E6) 1.382 0.118 11.703 0.000 1.382 0.573
SitP 1.000 1.000 1.000
SitN 1.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.541
Sit2 0.538
Sit3r 0.647
Sit4 0.537
Sit5r 0.466
Sit6 0.427
Defined Parameters:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
OmegaP 0.746 0.020 38.193 0.000 0.746 0.764
OmegaN 0.780 0.013 58.288 0.000 0.780 0.783Compared with what the psych package gives:
alpha(x = hfsSituations[c("Sit2", "Sit4", "Sit6")], use = "all.obs")
Reliability analysis
Call: alpha(x = hfsSituations[c("Sit2", "Sit4", "Sit6")], use = "all.obs")
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd
0.74 0.74 0.67 0.49 2.9 0.014 5.3 1.2
lower alpha upper 95% confidence boundaries
0.71 0.74 0.77
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se
Sit2 0.62 0.62 0.45 0.45 1.6 0.023
Sit4 0.63 0.63 0.46 0.46 1.7 0.022
Sit6 0.73 0.73 0.57 0.57 2.7 0.016
Item statistics
n raw.r std.r r.cor r.drop mean sd
Sit2 1103 0.82 0.83 0.71 0.60 5.3 1.4
Sit4 1103 0.82 0.83 0.70 0.59 5.4 1.4
Sit6 1103 0.80 0.78 0.59 0.51 5.3 1.5
Non missing response frequency for each item
1 2 3 4 5 6 7 miss
Sit2 0.02 0.02 0.05 0.13 0.31 0.24 0.22 0
Sit4 0.02 0.02 0.04 0.15 0.27 0.24 0.25 0
Sit6 0.03 0.03 0.06 0.14 0.23 0.25 0.27 0alpha(x = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], use = "all.obs")
Reliability analysis
Call: alpha(x = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], use = "all.obs")
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd
0.77 0.77 0.7 0.53 3.3 0.012 4.8 1.4
lower alpha upper 95% confidence boundaries
0.74 0.77 0.79
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se
Sit1r 0.65 0.65 0.48 0.48 1.9 0.021
Sit3r 0.62 0.62 0.45 0.45 1.7 0.023
Sit5r 0.78 0.79 0.65 0.65 3.7 0.013
Item statistics
n raw.r std.r r.cor r.drop mean sd
Sit1r 1103 0.85 0.85 0.74 0.63 4.5 1.7
Sit3r 1103 0.85 0.86 0.76 0.66 4.9 1.6
Sit5r 1103 0.78 0.78 0.58 0.51 4.9 1.7
Non missing response frequency for each item
1 2 3 4 5 6 7 miss
Sit1r 0.05 0.08 0.16 0.19 0.18 0.17 0.17 0
Sit3r 0.03 0.05 0.12 0.20 0.21 0.20 0.20 0
Sit5r 0.04 0.06 0.13 0.18 0.18 0.19 0.22 0Reliabilities for Factor Scores
Factor scores have a long history with many critiques and complaints. That said, factor scores can be constructed analogously across measurement models using Bayesian estmates. We will describe this more in a later lecture. For our purposes, in CFA, the two main types of Bayesian Estimates (MAP: Maximum A Posteriori and EAP: Expected A Posteriori) are identical. lavaan will not provide standard errors for factor scores, so I created a function factorScores() to not only create the factor scores using EAP (again, identical to MAP) but also to give standard errors for each score. The function takes the lavaan model output and returns a list of three elements: scores containing factor scores and standard errors, factorCov containing the theoretical covariance matrix of the factor scores, and factorCor the theoretical correlation matrix of the factor scores.
To determine the reliability of a factor score, we must return to our classical notion of what reliability means: \[ \rho = \frac{Var(True)}{Var(Total)} = \frac{Var(True)}{Var(True) + Var(Error)} = \frac{Var(F)}{Var(F)+SE(F)^2}\] In CFA, \(Var(True)\) is found by the estimated factor variance and \(Var(Error)\) comes from the squared standard error of a factor score (from an observation with complete data).
I created a function named factorScoreReliability() to calculate the reliability for factor scores. Using the function we can see that the reliabiltiy of our factor scores is .817 for SitP and .851 for SitN, which har higher than the Omega reliablities for sum scores. In general, factor score reliabilities are greater than what is found in Omega and Alpha due to the use of a prior distribution for the factor itself and due to the factor correlation allowing indirect information from other factors to help in the estimation of each factor.
factorScores = function(lavObject){
output = inspect(object = lavObject, what = "est")
sigma = output$lambda %*% output$psi %*% t(output$lambda) + output$theta
modelData = lavObject@Data@X[[1]]
scores = t(output$alpha%*%matrix(1, nrow=1, ncol=dim(modelData)[1]) +
output$psi %*% t(output$lambda) %*% solve(sigma)%*%(t(modelData) - output$nu%*%matrix(1, nrow=1, ncol=dim(modelData)[1])))
varscores = output$psi - output$psi %*% t(output$lambda) %*% solve(sigma) %*% output$lambda %*% output$psi
factorSE = sqrt(diag(varscores))
names(factorSE) = paste0(names(factorSE), ".SE")
factorSEmat = matrix(1, nrow=nrow(scores), ncol = 1) %*% matrix(factorSE, nrow = 1, ncol = ncol(scores))
colnames(factorSEmat) = names(factorSE)
result = data.frame(cbind(scores, factorSEmat))
names(result)
odds = seq(1, ncol(result)-1, 2)
evens = seq(2, ncol(result), 2)
result = result[c(odds,evens)]
factorCov = varscores
factorCorr = solve(sqrt(diag(diag(varscores)))) %*% varscores %*% solve(sqrt(diag(diag(varscores))))
return(list(scores = result, factorCov = factorCov, factorCorr = factorCorr))
}
factorScoreReliability = function(lavObject){
output = inspect(object = lavObject, what = "est")
sigma = output$lambda %*% output$psi %*% t(output$lambda) + output$theta
varscores = output$psi - output$psi %*% t(output$lambda) %*% solve(sigma) %*% output$lambda %*% output$psi
return(diag(output$psi)/(diag(output$psi) + diag(varscores)))
}
factorScoreReliability(lavObject = model04Estimates) SitP SitN
0.8177844 0.8510698 Testing Assumptions of Classical Test Theory
We can also compare the model fit of the CFA model with the tau-equivalent model, essentially testing whether or not CTT (and alpha) is appropriate:
anova(model04EstimatesAlpha, model04EstimatesOmega)Scaled Chi Square Difference Test (method = "satorra.bentler.2001")
Df AIC BIC Chisq Chisq diff Df diff Pr(>Chisq)
model04EstimatesOmega 8 22718 22813 35.41
model04EstimatesAlpha 12 22748 22824 73.50 33.635 4 8.851e-07 ***
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1The significant difference indicates that the tau-equivalent assumptions of equal item loadings do not hold for all of the data. In the Mplus handout, Lesa Hoffman shows that tau equivalence holds for one of the subscales, but we don’t need to have tau equivalence to move forward with results as CFA is subsumes the tau-equivalent model (meaning it will be tau equivalent if the data are tau equivalent but can also be more general).
Another model often discussed in CTT is the parallel items model. The CFA version of the parallel items model is a model where all factor loadings for a factor are constrained to be equal and all unique variances for a factor are constrained to be equal. This model is one step more restrictive than the tau equivalent items model. Syntax for this model is as follows:
model04SyntaxSB = "
# SitP loadings (all estimated)
SitP =~ LP*Sit2 + LP*Sit4 + LP*Sit6
# SitN loadings (all estimated)
SitN =~ LN*Sit1r + LN*Sit3r + LN*Sit5r
# Unique Variances:
Sit1r ~~ EN*Sit1r; Sit2 ~~ EP*Sit2; Sit3r ~~ EN*Sit3r; Sit4 ~~ EP*Sit4; Sit5r ~~ EN*Sit5r; Sit6 ~~ EP*Sit6;
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((3*LP)^2) / ( ((3*LP)^2) + 3*EP)
OmegaN := ((3*LN)^2) / ( ((3*LN)^2) + 3*EN)
"
model04EstimatesSB = sem(model = model04SyntaxSB, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04EstimatesSB, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 12 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 181.247 132.341
Degrees of freedom 16 16
P-value (Chi-square) 0.000 0.000
Scaling correction factor 1.370
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.916 0.896
Tucker-Lewis Index (TLI) 0.921 0.902
Robust Comparative Fit Index (CFI) 0.918
Robust Tucker-Lewis Index (TLI) 0.924
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11413.059 -11413.059
Scaling correction factor 0.847
for the MLR correction
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Scaling correction factor 1.407
for the MLR correction
Number of free parameters 11 11
Akaike (AIC) 22848.117 22848.117
Bayesian (BIC) 22903.181 22903.181
Sample-size adjusted Bayesian (BIC) 22868.242 22868.242
Root Mean Square Error of Approximation:
RMSEA 0.097 0.081
90 Percent Confidence Interval 0.084 0.110 0.070 0.092
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.095
90 Percent Confidence Interval 0.080 0.110
Standardized Root Mean Square Residual:
SRMR 0.088 0.088
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP =~
Sit2 (LP) 1.005 0.035 28.455 0.000 1.005 0.698
Sit4 (LP) 1.005 0.035 28.455 0.000 1.005 0.698
Sit6 (LP) 1.005 0.035 28.455 0.000 1.005 0.698
SitN =~
Sit1r (LN) 1.222 0.032 38.250 0.000 1.222 0.724
Sit3r (LN) 1.222 0.032 38.250 0.000 1.222 0.724
Sit5r (LN) 1.222 0.032 38.250 0.000 1.222 0.724
Covariances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP ~~
SitN 0.596 0.041 14.422 0.000 0.596 0.596
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 5.289 0.042 127.346 0.000 5.289 3.676
.Sit4 5.359 0.042 126.896 0.000 5.359 3.724
.Sit6 5.321 0.046 115.492 0.000 5.321 3.698
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.695
.Sit3r 4.896 0.048 101.959 0.000 4.896 2.902
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.881
SitP 0.000 0.000 0.000
SitN 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r (EN) 1.353 0.060 22.722 0.000 1.353 0.475
.Sit2 (EP) 1.060 0.061 17.452 0.000 1.060 0.512
.Sit3r (EN) 1.353 0.060 22.722 0.000 1.353 0.475
.Sit4 (EP) 1.060 0.061 17.452 0.000 1.060 0.512
.Sit5r (EN) 1.353 0.060 22.722 0.000 1.353 0.475
.Sit6 (EP) 1.060 0.061 17.452 0.000 1.060 0.512
SitP 1.000 1.000 1.000
SitN 1.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.525
Sit2 0.488
Sit3r 0.525
Sit4 0.488
Sit5r 0.525
Sit6 0.488
Defined Parameters:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
OmegaP 0.741 0.020 36.909 0.000 0.741 0.741
OmegaN 0.768 0.015 52.547 0.000 0.768 0.768The values resulting from Omega are the Spearman-Brown reliablity estimates. Note that reliablity for parallel items < reliability for tau equivalent items < reliability for CFA, but that the estimates are very close. That is common when a model fits the data.
Examining Factor Score Distributions
The positive factor scores have an estimated mean of 0 with a variance of 0.78 instead of 1.00 (due to the effect of the prior distribution – this is called “shrinkage”). The SE for each person’s factor score is .472. Treating factor scores as observed variables is like saying SE = 0.
95% confidence interval for positive factor score = Score ± 2*.472 = Score ± .944.
# calculate factor scores using function above:
fscores = factorScores(lavObject = model04Estimates)
#show variance of factor score:
var(fscores$scores$SitP)[1] 0.7778887# Histogram overlaid with kernel density curve
ggplot(fscores$scores, aes(x=SitP)) +
geom_histogram(aes(y=..density..), # Histogram with density instead of count on y-axis
binwidth=.5,
colour="black", fill="white") + xlim(c(-4,4)) + labs(title = "Positive Situation Forgiveness Factor Score") +
geom_density(alpha=.2, fill="#FF6666") # Overlay with transparent density plot
The negative factor scores have an estimated mean of 0 with a variance of 0.825 instead of 1.00. The SE for each person’s factor score is .418, so the 80% confidence interval is Score ± .836.
The negative factor scores retain more variance (and have a smaller SE) because there is more information in them, due to higher factor loadings (greater reliability) of their items.
#show variance of factor score:
var(fscores$scores$SitN)[1] 0.8257565# Histogram overlaid with kernel density curve
ggplot(fscores$scores, aes(x=SitN)) +
geom_histogram(aes(y=..density..), # Histogram with density instead of count on y-axis
binwidth=.5,
colour="black", fill="white") + xlim(c(-4,4)) + labs(title = "Negative Situation Forgiveness Factor Score") +
geom_density(alpha=.2, fill="#FF6666") # Overlay with transparent density plot
Factor Scores from Parallel Items Model are Sum Scores with a Different Scale
The parallel items model constrains the item factor loadings to be equal and unique variances to be equal for a given factor. When estimated separately (or when when estimated with a factor correlation), the corrlation of factor scores from the parallel items model and the sum scores from CTT is equal to one. What this means is that to be able to use sum scores in an analysis, the parallel items model must hold. To demonstrate, the lavaan syntax below sets the factor covariance to zero (and therefore the correlation between factors to zero) by using 0* in the statement SitP ~~ 0*SitN:
model04SyntaxSBzeroCor = "
# SitP loadings (all estimated)
SitP =~ LP*Sit2 + LP*Sit4 + LP*Sit6
# SitN loadings (all estimated)
SitN =~ LN*Sit1r + LN*Sit3r + LN*Sit5r
# Unique Variances:
Sit1r ~~ EN*Sit1r; Sit2 ~~ EP*Sit2; Sit3r ~~ EN*Sit3r; Sit4 ~~ EP*Sit4; Sit5r ~~ EN*Sit5r; Sit6 ~~ EP*Sit6;
SitP ~~ 0*SitN
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((3*LP)^2) / ( ((3*LP)^2) + 3*EP)
OmegaN := ((3*LN)^2) / ( ((3*LN)^2) + 3*EN)
"
model04SyntaxSBzeroCorEstimates = sem(model = model04SyntaxSBzeroCor, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
sumscoresP = apply(X = hfsSituations[c("Sit2", "Sit4", "Sit6")], MARGIN = 1, FUN = sum)
sumscoresN = apply(X = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], MARGIN = 1, FUN = sum)
fscoresPI = factorScores(lavObject = model04SyntaxSBzeroCorEstimates)
par(mfrow = c(1,2))
plot(x = fscores$scores$SitP, y = sumscoresP, xlab = "SitP: Full CFA Factor Scores", ylab = "SitP: Sum Score", xlim = c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscores$scores$SitP, sumscoresP), digits = 3))))plot(x = fscores$scores$SitN, y = sumscoresN, xlab = "SitN: Full CFA Factor Scores", ylab = "SitN: Sum Score", xlim = c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscores$scores$SitN, sumscoresN), digits = 3))))
plot(x = fscoresPI$scores$SitP, y = sumscoresP, xlab = "SitP: Full CFA Factor Scores", ylab = "SitP: Sum Score", xlim=c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscoresPI$scores$SitP, sumscoresP), digits = 3))))plot(x = fscoresPI$scores$SitN, y = sumscoresN, xlab = "SitN: Full CFA Factor Scores", ylab = "SitN: Sum Score", xlim=c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscoresPI$scores$SitN, sumscoresN), digits = 3))))par(mfrow = c(1,1))
Model-Predicted Item Responses by Factor Scores with Dashed Lines for Floor and Ceiling Effects:
We can also see how reasonable our choice of a continuous distribution was for these Likert data by plotting the predicted item scores for each item across a the range of observed factor scores. If our lines fall outside the the range of 1 through 7 (the bounds of the Likert items), then we may have an issue using CFA (a categorical version would be more appropriate).
lavObject = model04Estimates
cfaPlots = function(lavObject){
output = inspect(object = lavObject, what = "est")
#build matrix plot elements
#get factor scores
fscores = factorScores(lavObject = lavObject)
nfactors = ncol(fscores$scores)/2
#get max observed data
itemMax = max(apply(X = lavObject@Data@X[[1]], MARGIN = 2, FUN = max))
itemMin = min(apply(X = lavObject@Data@X[[1]], MARGIN = 2, FUN = min))
#get range for all scores
factorMax = max(apply(X = fscores$scores[seq(1, ncol(fscores$scores), 2)], MARGIN = 2, FUN = max))
factorMin = min(apply(X = fscores$scores[seq(1, ncol(fscores$scores), 2)], MARGIN = 2, FUN = min))
#set up x values
x = seq(factorMin, factorMax, .01)
par(mfrow = c(1, nfactors))
#make plots by factor
factor=1
for (factor in 1:nfactors){
xmat = NULL
ymat = NULL
inames = NULL
for (item in 1:nrow(output$lambda)){
if (output$lambda[item, factor] != 0){
inames = c(inames, rownames(output$lambda)[item])
y = output$nu[item] + output$lambda[item, factor]*x
xmat = cbind(xmat, x)
ymat = cbind(ymat, y)
}
}
matplot(x = xmat, y = ymat, type = "l", lwd = 5, lty=2:(ncol(xmat)+1), ylim = c(itemMin-1, itemMax+1), xlim = c(factorMin, factorMax),
ylab = "Predicted Item Response", xlab = colnames(output$lambda)[factor], col = 2:(ncol(xmat)+1))
lines(x = c(factorMin,factorMax), y = c(itemMin, itemMin), lty = 3, lwd = 5)
lines(x = c(factorMin,factorMax), y = c(itemMax, itemMax), lty = 3, lwd = 5)
legend(x = -3, y = 7, legend = inames, lty = 2:(ncol(xmat)+1), lwd = 5, col = 2:(ncol(xmat)+1))
}
par(mfrow = c(1,1))
}
par(mfrow = c(1,2))
cfaPlots(lavObject = model04Estimates)
Comparing Sum Scores with Factor Scores
What if we had just taken the sum (or, here, the mean) of the three items for each subscale?
PosMean = apply(X = hfsSituations[c("Sit2", "Sit4", "Sit6")], MARGIN = 1, FUN = mean)
NegMean = apply(X = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], MARGIN = 1, FUN = mean)
par(mfrow = c(1,2))
plot(y = PosMean, x = fscores$scores$SitP, xlim = c(-3.5,2), ylim = c(1,7), xlab = "SitP Factor Score", ylab = "Postive Items Mean")
text(x = -3, y = 6, labels = paste("r = ", as.character(round(cor(PosMean, fscores$scores$SitP), digits = 3))))plot(y = NegMean, x = fscores$scores$SitN, xlim = c(-3.5,2), ylim = c(1,7), xlab = "SitN Factor Score", ylab = "Negative Items Mean")
text(x = -3, y = 6, labels = paste("r = ", as.character(round(cor(NegMean, fscores$scores$SitN), digits = 3))))par(mfrow = c(1,1))
We can also plot how the two types of scores look together:
par(mfrow = c(1,2))
plot(x = PosMean, y = NegMean, xlim = c(1,8), ylim = c(1,8), xlab = "Postive Items Mean", ylab = "Negative Items Mean")
text(x = 1.85, y = 8, labels = paste("r = ", as.character(round(cor(PosMean, NegMean), digits = 3))))plot(x = fscores$scores$SitP, y = fscores$scores$SitN, xlim = c(-3.5,2), ylim = c(-3.5,2), xlab = "SitP Factor Score", ylab = "SitN Factor Score")
text(x = -2.5, y = 1.9, labels = paste("r = ", as.character(round(cor(fscores$scores$SitP, fscores$scores$SitN), digits = 3))))par(mfrow = c(1,1))
There are problems with either of these observed variable approaches: The mean of the items appears to have less variability (i.e., fewer possible scores) and assumes that all items should be weighted equally and have no error. The estimated factor scores do not have the same properties as estimated for the factor in the model (i.e., less variance for each factor, higher correlation among the factors). Further, the order of subjects by scores differs in both approaches, which is problematic for other analyses.
What to do instead of either of these? Stay tuned for how to use plausible values, Bayesian methods, or SEM.
Example Write-Up Describing These Analyses
R code to build objects reported in results (don’t show this typically)
#number of observations
format(x = model04Estimates@Data@nobs[[1]][1], big.mark = ",")[1] "1,103"#low and high standardized loadings for one factor model
stdLoadings = inspect(object = model01Estimates, what = "std.all")
stdLoadingsLow = round(min(apply(X = stdLoadings$lambda, MARGIN = 2, FUN = function(x) min(x[which(x !=0)]))), digits = 3)
stdLoadingsHigh = round(max(apply(X = stdLoadings$lambda, MARGIN = 2, FUN = function(x) max(x[which(x !=0)]))), digits = 3)
# estimated correlation between factors in two-factor model
stdCov04 = inspect(object = model04Estimates, what = "std.all")$psi
estCorr = format(x = stdCov04[2,1], digits = 3)
#standardized loadings positive
stdLoadings04P = inspect(object = model04Estimates, what = "std.all")$lambda[,1]
minSitP = round(min(stdLoadings04P[which(stdLoadings04P != 0)]), digits = 3)
maxSitP = round(max(stdLoadings04P[which(stdLoadings04P != 0)]), digits = 3)
#standardized loadings negative
stdLoadings04N = inspect(object = model04Estimates, what = "std.all")$lambda[,2]
minSitN = round(min(stdLoadings04N[which(stdLoadings04N != 0)]), digits = 3)
maxSitN = round(max(stdLoadings04N[which(stdLoadings04N != 0)]), digits = 3)
factorRel = factorScoreReliability(lavObject = model04Estimates)(Note: You may borrow the phrasing contained in this example to describe various aspects of your analyses, but your own results sections will not mimic this example exactly—they should be customized to describe the how and the why of what you did, specifically).
(Descriptive information for the sample and items would have already been given in the method section…)
The reliability and dimensionality of six items each assessing forgiveness of situations was assessed in a sample of 1,103 persons with a confirmatory factor analysis using robust maximum likelihood estimation (MLR) in the lavaan package (Rosseel, 2012) in R (R Core Team, 2017). All models were identified by setting any latent factor means to 0 and latent factor variances to 1, such that all item intercepts, item factor loadings, and item residual variances were then estimated. The six items utilized a seven-point response scale, and three items were reverse-coded prior to analysis such that higher values then indicated greater levels of forgiveness of situations for all items. Model fit statistics reported in Table 1 include the obtained model \(\chi^2\), its scaling factor (in which values different than 1.000 indicate deviations from normality), its degrees of freedom, and its p-value (in which non-significance is desirable for good fit), CFI, or Comparative Fit Index (in which values higher than .95 are desirable for good fit), and the RMSEA, or Root Mean Square Error of Approximation, point estimate and 90% confidence interval (in which values lower than .06 are desirable for good fit). As reported in Table 2, nested model comparisons were conducted using the rescaled \(−2\Delta LL\) with degrees of freedom equal to the rescaled difference in the number of parameters between models (i.e., a rescaled likelihood ratio test). The specific models examined are described in detail below.
Although a one-factor model was initially posited to account for the pattern of covariance across these six items, it resulted in poor fit, as shown in Table 1. Although each item had a significant factor loading (with standardized loadings ranging from 0.509 to 0.778), a single latent factor did not adequately describe the pattern of relationship across these six items as initially hypothesized. Sources of local misfit were identified using the normalized residual covariance matrix, available via the resid() function in lavaan, in which individual values were calculated as: (observed covariance – expected covariance) / SD(observed covariance). Relatively large positive residual covariances were observed among items 2, 4, and 6 (the positively-worded items), indicating that these items were more related than was predicted by the single-factor model. Modification indices, available via the modificationindices() function in lavaan, corroborated this pattern, further suggesting additional remaining relationships among the negatively-worded items as well.
The necessity of separate latent factors for the positively-worded and negatively-worded items was tested by specifying a two-factor model in which the positively-worded items 2, 4, and 6 indicated a forgiveness factor, and in which negatively-worded items 1, 3, and 5 indicated a not unforgiveness factor, and in which the two factors were allowed to correlate. The two-factor model fit was acceptable by every criterion except the significant \(\chi^2\), likely due to the large sample. In addition, the two-factor model fit significantly better than the one-factor model, as reported in Table 2, indicating that the estimated correlation between the two factors of 0.564 was significantly less than 1.000. Thus, the six items appeared to measure two separate but related constructs. Further examination of local fit via normalized residual covariances and modification indices yielded no interpretable remaining relationships, and thus this two-factor model was retained.
Table 3 provides the estimates and their standard errors for the item factor loadings, intercepts, and residual variances from both the unstandardized and standardized solutions. All factor loadings and the factor covariance were statistically significant. As shown in Table 3, standardized loadings for the forgiveness factor items ranged from 0.625 to 0.759 (with \(R^2\) values for the amount of item variance accounted for by the factor ranging from 0.391 to 0.759), and standardized loadings for the not unforgiveness factor ranged from 0.588 to 0.846 (with R2 values of 0.346 to 0.716), suggesting the factor loadings were practically significant as well. Factor score reliaiblity was 1 for the forgiveness factor and 1 for the not unforgiveness factor, suggesting marginal reliability for both of the three-item scales.
The resulting distribution of the EAP estimates of factor score as shown in Figure 1. Figure 2 shows the predicted response for each item as a linear function of the latent factor based on the estimated model parameters. As shown, the predicted item response goes above the highest response option just before a latent factor score of 2 (i.e., 2 SDs above the mean), resulting in a ceiling effect for both sets of factor scores, as also shown in Figure 1. In addition, for the not unforgiveness factor, the predicted item response goes below the lowest response option just before a latent factor score of -3 (i.e., 3 SDs below the mean), resulting in a floor effect for the not unforgiveness factor, as also shown in Figure 1.
The extent to which the items within each factor could be seen as exchangeable was then examined via an additional set of nested model comparisons, as reported in Table 1 (for fit) and Table 2 (for comparisons of fit). First, the assumption of tau-equivalence (i.e., true-score equivalence, equal discrimination across items) was examined by constraining the factor loadings to be equal within a factor. For the not unforgiveness factor, the tau-equivalent model fit was acceptable but was significantly worse than the original two-factor model fit (i.e., in which all loadings were estimated freely). For the forgiveness factor, however, the tau-equivalent model fit was acceptable and was not significantly worse than the original two-factor model fit. Thus, the assumption of tau-equivalence held for the forgiveness factor items only. Finally, the assumption of parallel items (i.e., equal factor loadings and equal residual variances, or equal reliability across items) was examined for the forgiveness factor items only, and the resulting model fit was acceptable but was significantly worse than the tau-equivalent forgiveness factor model fit. Thus, the assumption of parallel items did not hold for the forgiveness factor items. In summary, while the not unforgiveness factor items were not exchangeable, the forgiveness factor items were exchangeable with respect to their factor loadings only (i.e., equal discrimination, but not equal residual variances or reliability).
References:
R Core Team (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
Rosseel, Y (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. URL http://www.jstatsoft.org/v48/i02/.
citation()
To cite R in publications use:
R Core Team (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna,
Austria. URL https://www.R-project.org/.
A BibTeX entry for LaTeX users is
@Manual{,
title = {R: A Language and Environment for Statistical Computing},
author = {{R Core Team}},
organization = {R Foundation for Statistical Computing},
address = {Vienna, Austria},
year = {2017},
url = {https://www.R-project.org/},
}
We have invested a lot of time and effort in creating R, please cite it when using it for data analysis. See also
‘citation("pkgname")’ for citing R packages.citation("lavaan")
To cite lavaan in publications use:
Yves Rosseel (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. URL
http://www.jstatsoft.org/v48/i02/.
A BibTeX entry for LaTeX users is
@Article{,
title = {{lavaan}: An {R} Package for Structural Equation Modeling},
author = {Yves Rosseel},
journal = {Journal of Statistical Software},
year = {2012},
volume = {48},
number = {2},
pages = {1--36},
url = {http://www.jstatsoft.org/v48/i02/},
}Tables
Table 1: Model Fit Statistics Using MLR
fitstats01 = fitmeasures(object = model01Estimates)
fitstats04 = fitmeasures(object = model04Estimates)
fitstats04A = fitmeasures(object = model04EstimatesAlpha)
table1 = cbind(ncol(model01Estimates@SampleStats@cov[[1]]), fitstats01[1], fitstats01[6], fitstats01[9], fitstats01[7], fitstats01[8], fitstats01[25],
fitstats01[48], fitstats01[49], fitstats01[50], fitstats01[51])
colnames(table1) = c("# Items", "# Parameters", "Scaled Chi-Square", "Chi-Square Scale Factor", "DF", "p-value", "CFI", "RMSEA", "RMSEA Lower",
"RMSEA Upper", "RMSEA p-value")
rownames(table1) = "One-Factor"
table1 = rbind(table1, cbind(ncol(model04Estimates@SampleStats@cov[[1]]), fitstats04[1], fitstats04[6], fitstats04[9], fitstats04[7], fitstats04[8],
fitstats04[25], fitstats04[48], fitstats04[49], fitstats04[50], fitstats04[51]))
rownames(table1)[2] = "Two-Factor"
table1 = rbind(table1, cbind(ncol(model04Estimates@SampleStats@cov[[1]]), fitstats04A[1], fitstats04A[6], fitstats04A[9], fitstats04A[7], fitstats04A[8],
fitstats04A[25], fitstats04A[48], fitstats04A[49], fitstats04A[50], fitstats04A[51]))
rownames(table1)[3] = "Two-Factor Tau-Equivalent"
kable(table1, format = "html", digits = 3) %>% kable_styling("striped")| # Items | # Parameters | Scaled Chi-Square | Chi-Square Scale Factor | DF | p-value | CFI | RMSEA | RMSEA Lower | RMSEA Upper | RMSEA p-value | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| One-Factor | 6 | 18 | 307.804 | 1.390 | 9 | 0.000 | 0.732 | 0.173 | 0.160 | 0.188 | 0.000 |
| Two-Factor | 6 | 19 | 24.924 | 1.421 | 8 | 0.002 | 0.985 | 0.044 | 0.028 | 0.061 | 0.708 |
| Two-Factor Tau-Equivalent | 6 | 15 | 55.487 | 1.325 | 12 | 0.000 | 0.961 | 0.057 | 0.044 | 0.071 | 0.167 |
Table 2: Model Comparisons
table2 = anova(modelSaturatedEstimates, model01Estimates)[2,-c(2:4)]
rownames(table2) = "One-Factor vs. Saturated"
table2 = rbind(table2,anova(model01Estimates, model04Estimates)[2,-c(2:4)])
rownames(table2)[2] = "One-Factor vs. Two-Factor"
table2 = rbind(table2,anova(modelSaturatedEstimates, model04Estimates)[2,-c(2:4)])
rownames(table2)[3] = "Two-Factor vs. Saturated"
table2 = rbind(table2,anova(model04EstimatesAlpha, model04Estimates)[2,-c(2:4)])
rownames(table2)[4] = "Two-Factor vs. Two-Factor Tau-Equivalent"
kable(table2, format = "html", digits = 3) %>% kable_styling("striped")| Df | Chisq diff | Df diff | Pr(>Chisq) | |
|---|---|---|---|---|
| One-Factor vs. Saturated | 9 | 307.804 | 9 | 0.000 |
| One-Factor vs. Two-Factor | 9 | 342.292 | 1 | 0.000 |
| Two-Factor vs. Saturated | 8 | 24.924 | 8 | 0.002 |
| Two-Factor vs. Two-Factor Tau-Equivalent | 12 | 33.635 | 4 | 0.000 |
Table 3: Model Estimates
unstandardizedLoadings = inspect(object = model04Estimates, what = "est")
unstandardizedSE = inspect(object = model04Estimates, what = "se")
standardizedLoadings = inspect(object = model04Estimates, what = "std.all")
table3 = cbind(unstandardizedLoadings$lambda[1:3,1], unstandardizedSE$lambda[1:3,1], standardizedLoadings$lambda[1:3,1])
colnames(table3) = c("Estimate", "SE", "Estimate")
rownames(table3) = c("Item 2", "Item 4", "Item 6")
table3 = rbind(table3, cbind(cbind(unstandardizedLoadings$lambda[4:6,2]), cbind(unstandardizedSE$lambda[4:6,2]), cbind(standardizedLoadings$lambda[4:6,2])))
rownames(table3)[4:6] = c("Item 1", "Item 3", "Item 5")
table3 = rbind(table3, c(unstandardizedLoadings$psi[2,1], unstandardizedSE$psi[2,1], standardizedLoadings$psi[2,1]))
rownames(table3)[7] = "Factor Covariance"
interceptsOrder = c(4,1,5,2,6,3)
table3 = rbind(table3, cbind(cbind(unstandardizedLoadings$nu[1:6,1][interceptsOrder]), cbind(unstandardizedSE$nu[1:6,1][interceptsOrder]),
cbind(standardizedLoadings$nu[1:6,1][interceptsOrder])))
rownames(table3)[8:13] = paste("Item", 1:6)
table3 = rbind(table3, cbind(cbind(diag(unstandardizedLoadings$theta)[interceptsOrder]), cbind(diag(unstandardizedSE$theta)[interceptsOrder]),
cbind(diag(standardizedLoadings$theta)[interceptsOrder])))
rownames(table3)[14:19] = paste("Item", 1:6)
kable(table3, format = "html", digits = 3) %>% kable_styling("striped") %>% add_header_above(c(" " = 1, "Unstandardized" = 2, "Standardized" = 1)) %>% group_rows("Forgiveness Factor Loadings", 1,3) %>% group_rows("Not Unforgiveness Factor Loadings", 4,6) %>%
group_rows("Factor Covariance", 7,7) %>% group_rows("Item Intercepts", 8,13) %>% group_rows("Item Unique Variances", 14, 19)| Estimate | SE | Estimate | |
|---|---|---|---|
| Forgiveness Factor Loadings | |||
| Item 2 | 1.007 | 0.052 | 0.730 |
| Item 4 | 1.064 | 0.050 | 0.759 |
| Item 6 | 0.956 | 0.053 | 0.625 |
| Not Unforgiveness Factor Loadings | |||
| Item 1 | 1.325 | 0.048 | 0.759 |
| Item 3 | 1.349 | 0.044 | 0.846 |
| Item 5 | 1.009 | 0.055 | 0.588 |
| Factor Covariance | |||
| Factor Covariance | 0.564 | 0.041 | 0.564 |
| Item Intercepts | |||
| Item 1 | 4.547 | 0.053 | 2.604 |
| Item 2 | 5.289 | 0.042 | 3.834 |
| Item 3 | 4.896 | 0.048 | 3.070 |
| Item 4 | 5.359 | 0.042 | 3.821 |
| Item 5 | 4.860 | 0.052 | 2.832 |
| Item 6 | 5.321 | 0.046 | 3.477 |
| Item Unique Variances | |||
| Item 1 | 1.294 | 0.103 | 0.425 |
| Item 2 | 0.888 | 0.097 | 0.467 |
| Item 3 | 0.724 | 0.092 | 0.285 |
| Item 4 | 0.835 | 0.093 | 0.425 |
| Item 5 | 1.926 | 0.119 | 0.654 |
| Item 6 | 1.428 | 0.134 | 0.610 |
Figures
Figure 1: Factor Score Distributions
modelSaturated = "
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item variances and covariances --> use the ~~ command
# Variances:
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Covariances:
Sit1r ~~ Sit2; Sit1r ~~ Sit3r; Sit1r ~~ Sit4; Sit1r ~~ Sit5r; Sit1r ~~ Sit6;
Sit2 ~~ Sit3r; Sit2 ~~ Sit4; Sit2 ~~ Sit5r; Sit2 ~~ Sit6;
Sit3r ~~ Sit4; Sit3r ~~ Sit5r; Sit3r ~~ Sit6;
Sit4 ~~ Sit5r; Sit4 ~~ Sit6;
Sit5r ~~ Sit6;
"
modelSaturatedEstimates = sem(model = modelSaturated, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(modelSaturatedEstimates, fit.measures = TRUE)lavaan (0.5-23.1097) converged normally after 46 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 0.000 0.000
Degrees of freedom 0 0
Minimum Function Value 0.0000000000000
Scaling correction factor NA
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 1981.034 1128.693
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 1.000 1.000
Tucker-Lewis Index (TLI) 1.000 1.000
Robust Comparative Fit Index (CFI) NA
Robust Tucker-Lewis Index (TLI) NA
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11322.435 -11322.435
Loglikelihood unrestricted model (H1) -11322.435 -11322.435
Number of free parameters 27 27
Akaike (AIC) 22698.870 22698.870
Bayesian (BIC) 22834.027 22834.027
Sample-size adjusted Bayesian (BIC) 22748.268 22748.268
Root Mean Square Error of Approximation:
RMSEA 0.000 0.000
90 Percent Confidence Interval 0.000 0.000 0.000 0.000
P-value RMSEA <= 0.05 NA NA
Robust RMSEA 0.000
90 Percent Confidence Interval 0.000 0.000
Standardized Root Mean Square Residual:
SRMR 0.000 0.000
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Covariances:
Estimate Std.Err z-value P(>|z|)
Sit1r ~~
Sit2 0.577 0.083 6.974 0.000
Sit3r 1.802 0.091 19.800 0.000
Sit4 0.734 0.080 9.170 0.000
Sit5r 1.358 0.100 13.638 0.000
Sit6 0.795 0.092 8.620 0.000
Sit2 ~~
Sit3r 0.697 0.077 9.023 0.000
Sit4 1.103 0.084 13.112 0.000
Sit5r 0.604 0.080 7.578 0.000
Sit6 0.965 0.083 11.687 0.000
Sit3r ~~
Sit4 0.824 0.076 10.848 0.000
Sit5r 1.319 0.091 14.495 0.000
Sit6 0.868 0.085 10.261 0.000
Sit4 ~~
Sit5r 0.695 0.079 8.843 0.000
Sit6 0.962 0.081 11.821 0.000
Sit5r ~~
Sit6 0.798 0.089 8.955 0.000
Intercepts:
Estimate Std.Err z-value P(>|z|)
Sit1r 4.547 0.053 86.474 0.000
Sit2 5.289 0.042 127.346 0.000
Sit3r 4.896 0.048 101.959 0.000
Sit4 5.359 0.042 126.896 0.000
Sit5r 4.860 0.052 94.060 0.000
Sit6 5.321 0.046 115.492 0.000
Variances:
Estimate Std.Err z-value P(>|z|)
Sit1r 3.049 0.098 31.216 0.000
Sit2 1.903 0.093 20.547 0.000
Sit3r 2.543 0.092 27.763 0.000
Sit4 1.967 0.095 20.683 0.000
Sit5r 2.945 0.100 29.595 0.000
Sit6 2.341 0.108 21.771 0.000Figure 2 : Expected Item Response Plots
par(mfrow = c(1,2))
cfaPlots(lavObject = model04Estimates)
par(mfrow = c(1,1))
LS0tCnRpdGxlOiAiRVBTWSA5MDYvQ0xEUCA5NDggRXhhbXBsZSAwNCIKb3V0cHV0OgogIGh0bWxfbm90ZWJvb2s6IGRlZmF1bHQKICBodG1sX2RvY3VtZW50OiBkZWZhdWx0Ci0tLQoKPHNjcmlwdCB0eXBlPSJ0ZXh0L3gtbWF0aGpheC1jb25maWciPgpNYXRoSmF4Lkh1Yi5Db25maWcoewogIFRlWDogeyAKICAgICAgZXF1YXRpb25OdW1iZXJzOiB7IAogICAgICAgICAgICBhdXRvTnVtYmVyOiAiYWxsIiwKICAgICAgICAgICAgZm9ybWF0TnVtYmVyOiBmdW5jdGlvbiAobikge3JldHVybiBufQogICAgICB9IAogIH0KfSk7Cjwvc2NyaXB0PgoKCiMjIENGQSBFeGFtcGxlIFVzaW5nIEZvcmdpdmVuZXNzIG9mIFNpdHVhdGlvbnMgKE4gPSAxMTAzKQoKVGhlIEZvcmdpdmVuZXNzIG9mIFNpdHVhdGlvbnMgU3Vic2NhbGUgaW5jbHVkZXMgc2l4IGl0ZW1zLCB0aHJlZSBvZiB3aGljaCBhcmUgcmV2ZXJzZS1jb2RlZCwgb24gYSBzZXZlbi1wb2ludCBzY2FsZToKCjEuCVdoZW4gdGhpbmdzIGdvIHdyb25nIGZvciByZWFzb25zIHRoYXQgY2Fu4oCZdCBiZSBjb250cm9sbGVkLCBJIGdldCBzdHVjayBpbiBuZWdhdGl2ZSB0aG91Z2h0cyBhYm91dCBpdC4gKFIpCjIuCVdpdGggdGltZSBJIGNhbiBiZSB1bmRlcnN0YW5kaW5nIG9mIGJhZCBjaXJjdW1zdGFuY2VzIGluIG15IGxpZmUuCjMuCUlmIEkgYW0gZGlzYXBwb2ludGVkIGJ5IHVuY29udHJvbGxhYmxlIGNpcmN1bXN0YW5jZXMgaW4gbXkgbGlmZSwgSSBjb250aW51ZSB0byB0aGluayBuZWdhdGl2ZWx5IGFib3V0IHRoZW0uIChSKQo0LglJIGV2ZW50dWFsbHkgbWFrZSBwZWFjZSB3aXRoIGJhZCBzaXR1YXRpb25zIGluIG15IGxpZmUuCjUuCUl04oCZcyByZWFsbHkgaGFyZCBmb3IgbWUgdG8gYWNjZXB0IG5lZ2F0aXZlIHNpdHVhdGlvbnMgdGhhdCBhcmVu4oCZdCBhbnlib2R54oCZcyBmYXVsdC4gKFIpCjYuCUV2ZW50dWFsbHkgSSBsZXQgZ28gb2YgbmVnYXRpdmUgdGhvdWdodHMgYWJvdXQgYmFkIGNpcmN1bXN0YW5jZXMgdGhhdCBhcmUgYmV5b25kIGFueW9uZeKAmXMgY29udHJvbC4KClJlc3BvbnNlIEFuY2hvcnM6IAoKKiAxID0gQWxtb3N0IEFsd2F5cyBGYWxzZSBvZiBNZQoqIDIgPSA/IAoqIDMgPSBNb3JlIE9mdGVuIEZhbHNlIG9mIE1lCiogNCA9ID8gCiogNSA9IE1vcmUgT2Z0ZW4gVHJ1ZSBvZiBNZQoqIDYgPSA/IAoqIDcgPSBBbG1vc3QgQWx3YXlzIFRydWUgb2YgTWUKCiMjIyBQYWNrYWdlIEluc3RhbGxhdGlvbiBhbmQgTG9hZGluZyAKCkZvciB0aGlzIGV4YW1wbGUsIHdlIHdpbGwgYmUgdXNpbmcgdGhlIGBgYGdncGxvdDJgYGAgKGZvciBnZW5lcmFsIHBsb3R0aW5nKSwgYGBgbWVsdDJgYGAgKGZvciBkYXRhIHJlc2hhcGluZyBiZWZvcmUgcGxvdHRpbmcpLCBhbmQgYGBgbGF2YWFuYGBgIChmb3IgQ0ZBKSBwYWNrYWdlcy4KCmBgYHtyIHNldHVwLCBpbmNsdWRlPVRSVUV9CgppZiAocmVxdWlyZShnZ3Bsb3QyKT09RkFMU0UpewogIGluc3RhbGwucGFja2FnZXMoImdncGxvdDIiKQp9CmxpYnJhcnkoZ2dwbG90MikKCmlmIChyZXF1aXJlKHJlc2hhcGUyKSA9PSBGQUxTRSl7CiAgaW5zdGFsbC5wYWNrYWdlcygicmVzaGFwZTIiKQp9CgppZiAocmVxdWlyZShsYXZhYW4pID09IEZBTFNFKXsKICBpbnN0YWxsLnBhY2thZ2VzKCJsYXZhYW4iKQp9CmxpYnJhcnkobGF2YWFuKQoKaWYgKHJlcXVpcmUocHN5Y2gpID09IEZBTFNFKXsKICBpbnN0YWxsLnBhY2thZ2VzKCJwc3ljaCIpCn0KCmlmIChyZXF1aXJlKGtuaXRyKSA9PSBGQUxTRSl7CiAgaW5zdGFsbC5wYWNrYWdlcygia25pdHIiKQp9CgppZiAocmVxdWlyZShrYWJsZUV4dHJhKSA9PSBGQUxTRSl7CiAgaW5zdGFsbC5wYWNrYWdlcygia2FibGVFeHRyYSIpCn0KCmBgYAoKIyMjIERhdGEgSW1wb3J0IGludG8gUgpUaGUgZGF0YSBhcmUgaW4gYSB0ZXh0IGZpbGUgbmFtZWQgYGBgU3R1ZHkyLmRhdGBgYCBvcmlnbmFsbHkgdXNlZCBpbiBNcGx1cyAoc28gbm8gY29sdW1uIG5hbWVzIHdlcmUgaW5jbHVkZWQgYXQgdGhlIHRvcCBvZiB0aGUgZmlsZSkuIFRoZSBmaWxlIGNvbnRhaW5zIG1vcmUgaXRlbXMgdGhhbiB3ZSB3aWxsIHVzZSwgc28gd2Ugc2VsZWN0IG9ubHkgdGhlICJGb3JnaXZlbmVzcyBvZiBTaXR1YXRpb25zIiBpdGVtcyBmcm9tIHRoZSB3aG9sZSBmaWxlLgoKYGBge3IgZGF0YSwgaW5jbHVkZT1UUlVFfQoKI3JlYWQgaW4gZGF0YSBmaWxlIChNcGx1cyBmaWxlIGZvcm1hdCBzbyBoYXZpbmcgdG8gbGFiZWwgY29sdW1ucykKaGZzRGF0YSA9IHJlYWQudGFibGUoZmlsZSA9ICJTdHVkeTIuZGF0IiwgaGVhZGVyID0gRkFMU0UsIG5hLnN0cmluZ3MgPSAiOTk5OTkiLCBjb2wubmFtZXMgPSBjKCJQZXJzb25JRCIsICJTZWxmMSIsICJTZWxmMnIiLCAiU2VsZjMiLCAiU2VsZjRyIiwgIlNlbGY1IiwgIlNlbGY2ciIsICJPdGhlcjFyIiwgIk90aGVyMiIsICJPdGhlcjNyIiwgIk90aGVyNCIsICJPdGhlcjVyIiwgIk90aGVyNiIsICJTaXQxciIsICJTaXQyIiwgIlNpdDNyIiwgIlNpdDQiLCAiU2l0NXIiLCAiU2l0NiIsICJTZWxmc3ViIiwgIk90aHN1YiIsICJTaXRzdWIiLCAiSEZTc3VtIikpCgojc2VsZWN0IFNpdHVhdGlvbnMgaXRlbXMgYW5kIFBlcnNvbklEIHZhcmlhYmxlcwpoZnNTaXR1YXRpb25zID0gaGZzRGF0YVtjKCJQZXJzb25JRCIsICJTaXQxciIsICJTaXQyIiwgIlNpdDNyIiwgIlNpdDQiLCAiU2l0NXIiLCAiU2l0NiIpXQoKYGBgCgoKIyMjIE9ic2VydmVkIFNhbXBsZSBTdGF0aXN0aWNzCgojIyMjIFNhbXBsZSBDb3JyZWxhdGlvbiBNYXRyaXgKClRoZSBvYnNlcnZlZCBjb3JyZWxhdGlvbiBtYXRyaXgsIHJvdW5kZWQgdG8gdGhyZWUgZGlnaXRzOgoKYGBge3IgY29ycmVsYXRpb25zLCBpbmNsdWRlPVRSVUV9CiNoZXJlIHRoZSBjKCkgZnVuY3Rpb24gc2VsZWN0cyBvbmx5IHRoZSB2YXJpYWJsZXMsIG5vdCB0aGUgUGVyc2lvbklEIHZhcmlhYmxlCnJvdW5kKGNvcihoZnNTaXR1YXRpb25zW2MoIlNpdDFyIiwgIlNpdDIiLCAiU2l0M3IiLCAiU2l0NCIsICJTaXQ1ciIsICJTaXQ2IildKSwgZGlnaXRzID0gMykKYGBgCgojIyMjIFNhbXBsZSBNZWFucyBhbmQgVmFyaWFuY2VzCgpUaGUgb2JzZXJ2ZWQgbWVhbnMsIHJvdW5kZWQgdG8gdGhyZWUgZGlnaXRzOgpgYGB7ciBtZWFucywgaW5jbHVkZT1UUlVFfQphcHBseShYID0gaGZzU2l0dWF0aW9uc1tjKCJTaXQxciIsICJTaXQyIiwgIlNpdDNyIiwgIlNpdDQiLCAiU2l0NXIiLCAiU2l0NiIpXSwgTUFSR0lOID0gMiwgRlVOID0gZnVuY3Rpb24oeCkgcm91bmQobWVhbih4KSwgZGlnaXRzID0gMykpCmBgYAoKVGhlIG9ic2VydmVkIHZhcmlhbmNlcyAodXNpbmcgJE4kIGluIHRoZSBkZW5vbWluYXRvciB0byBtYXRjaCBNTCBlc3RpbWF0ZWQgb3V0cHV0IGFuZCBNcGx1cyBleGFtcGxlKSwgcm91bmRlZCB0byB0aHJlZSBkaWdpdHM6CmBgYHtyIHZhcmlhbmNlcywgaW5jbHVkZT1UUlVFfQphcHBseShYID0gaGZzU2l0dWF0aW9uc1tjKCJTaXQxciIsICJTaXQyIiwgIlNpdDNyIiwgIlNpdDQiLCAiU2l0NXIiLCAiU2l0NiIpXSwgTUFSR0lOID0gMiwgRlVOID0gZnVuY3Rpb24oeCkgcm91bmQodmFyKHgsIG5hLnJtID0gVFJVRSkqMTEwMi8xMTAzLCBkaWdpdHMgPSAzKSkKCmBgYAoKIyMjIyBTYW1wbGUgQ292YXJpYW5jZXMKClRvIGRvIGEgQ0ZBIGFuYWx5c2lzLCB5b3Ugb25seSByZWFsbHkgbmVlZCBtZWFucywgdmFyaWFuY2VzLCBhbmQgZWl0aGVyIGNvcnJlbGF0aW9ucyBvciBjb3ZhcmlhbmNlcyBhbW9uZyBpdGVtcy4gVGhhdCBzYWlkLCBtb2Rlcm4gbWV0aG9kcyBvZiBlc3RpbWF0aW9uIHVzZSB0aGUgcmF3IGRhdGEgKG9mdGVuIGNhbGxlZCBmdWxsIGluZm9ybWF0aW9uKSByYXRoZXIgdGhhbiB0aGUgc3VtbWFyeSBzdGF0aXN0aWNzIGFzIHRoZSByYXcgZGF0YSBlbmFibGUgYmV0dGVyIG1pc3NpbmcgZGF0YSBhc3N1bXB0aW9ucyB3aGVuIHVzaW5nIG1heGltdW0gbGlrZWxpaG9vZCBhbmQgQmF5ZXNpYW4gZXN0aW1hdGlvbiBtZXRob2RzLgoKVGhlIHNhbXBsZSBjb3ZhcmlhbmNlIG1hdHJpeCBjYW4gYmUgZm91bmQgZnJvbSB0aGUgc2FtcGxlIGNvcnJlbGF0aW9ucyBhbmQgdmFyaWFuY2VzLiBFYWNoIGNvdmFyaWFuY2UgYmV0d2VlbiBhIHBhaXIgb2YgdmFyaWFibGVzICR5XzEkIGFuZCAkeV8yJCBpcyBkZW5vdGVkIHdpdGggYSAkXHNpZ21hX3t5XzEsIHlfMn0kIGFuZCBlYWNoIGNvcnJlbGF0aW9uIGlzIGRlbm90ZWQgd2l0aCBhICRccmhvX3t5XzEsIHlfMn0kLiBUaGUgdmFyaWFuY2Ugb2YgYSB2YXJpYWJsZSBpcyBkZW5vdGVkIGJ5ICRcc2lnbWFeMl97eV8xfSQgYW5kIHRoZSBzdGFuZGFyZCBkZXZpYXRpb24gb2YgYSB2YXJpYWJsZSBpcyB0aGUgc3F1YXJlIHJvb3Qgb2YgdGhlIHZhcmlhbmNlICRcc3FydHtcc2lnbWFeMl97eV8xfX0kLiBUaGUgY292YXJpYW5jZSBjYW4gYmUgZm91bmQgYnkgdGFraW5nIHRoZSBjb3JyZWxhdGlvbiBhbmQgbXVsdGlwbHlpbmcgaXQgYnkgdGhlIHByb2R1Y3Qgb2YgdGhlIHN0YW5kYXJkIGRldmlhdGlvbnMuCgokJFxzaWdtYV97eV8xLCB5XzJ9ID0gXHJob197eV8xLCB5XzJ9XHNxcnR7XHNpZ21hXjJfe3lfMX19XHNxcnR7XHNpZ21hXjJfe3lfMn19LiAkJAoKSW52ZXJzZWx5LCB0aGUgY29ycmVsYXRpb24gY2FuIGJlIGZvdW5kIGJ5IHRha2luZyB0aGUgY292YXJpYW5jZSBhbmQgZGl2aWRpbmcgaXQgYnkgdGhlIHByb2R1Y3Qgb2YgdGhlIHN0YW5kYXJkIGRldmlhdGlvbnM6CgokJFxyaG9fe3lfMSwgeV8yfSA9IFxmcmFje1xzaWdtYV97eV8xLCB5XzJ9fXtcc3FydHtcc2lnbWFeMl97eV8xfX1cc3FydHtcc2lnbWFeMl97eV8yfX19LiAkJApBZ2Fpbiwgd2UgY2hhbmdlIHRoZSBkZW5vbWluYXRvciBmcm9tICROLTEkIHRvICROJCB0byBiZSBjb25zaXN0ZW50IHdpdGggdGhlIE1wbHVzIGV4YW1wbGUsIHdoaWNoIGNhbGN1bGF0ZXMgY292YXJpYW5jZXMgdXNpbmcgbWF4aW11bSBsaWtlbGlob29kLgoKYGBge3IgY292YXJpYW5jZXMsIGluY2x1ZGU9VFJVRX0Kcm91bmQoY292KGhmc1NpdHVhdGlvbnNbYygiU2l0MXIiLCAiU2l0MiIsICJTaXQzciIsICJTaXQ0IiwgIlNpdDVyIiwgIlNpdDYiKV0pKjExMDIvMTEwMywgZGlnaXRzID0gMykKYGBgCgojIyMjIFNhbXBsZSBJdGVtIFJlc3BvbnNlIERpc3RyaWJ1dGlvbnMKClRoZSBhc3N1bXB0aW9ucyBvZiBDRkEgKGkuZS4sIG5vcm1hbGx5IGRpc3RyaWJ1dGVkIGZhY3RvcnMsIG5vIGl0ZW0tbGV2ZWwgZmFjdG9yIGludGVyYWN0aW9ucywgYW5kIGNvbmRpdGlvbmFsbHkgbm9ybWFsIGRpc3RyaWJ1dGVkIGl0ZW1zKSBsZWFkIHRvIHRoZSBvdmVyYWxsIGFzc3VtcHRpb24gdGhhdCBvdXIgaXRlbSByZXNwb25zZXMgbXVzdCBiZSBub3JtYWxseSBkaXN0cmlidXRlZC4gRnJvbSB0aGUgaGlzdG9ncmFtcyBiZWxvdywgZG8geW91IHRoaW5rIHRoZXNlIGFyZSBub3JtYWxseSBkaXN0cmlidXRlZD8KCmBgYHtyIGhpc3RvZ3JhbXMsIGluY2x1ZGU9VFJVRX0KI3N0YWNrIGRhdGEKbWVsdGVkID0gbWVsdChoZnNTaXR1YXRpb25zLCBpZC52YXJzID0gIlBlcnNvbklEIikKCiNwbG90IGJ5IHZhcmlhYmxlCmdncGxvdChtZWx0ZWQsIGFlcyh2YWx1ZSkpICsgZ2VvbV9iYXIoKSArIGZhY2V0X3dyYXAofiB2YXJpYWJsZSkKYGBgCgojIyMgTGF2YWFuIFN5bnRheAoKYGBgbGF2YWFuYGBgIHN5bnRheCBpcyBjb25zdHJ1Y3RlZCB1c2luZyBhIGxvbmcgdGV4dCBzdHJpbmcgYW5kIHNhdmVkIGluIGEgY2hhcmFjdGVyIG9iamVjdC4gSW4gdGhlIGV4YW1wbGUgYmVsb3cgYGBgbW9kZWwwMVN5bnRheExvbmcgPSAiYGBgIG9wZW5zIHRoZSB0ZXh0IHN0cmluZywgd2hpY2ggY29udGludWVzIGZvciBtdWx0aXBsZSBsaW5lcyB1bnRpbCB0aGUgZmluYWwgYGBgImBgYCB0ZXJtaW5hdGVzIHRoZSBzdHJpbmcuIFRoZSB2YXJpYWJsZSBtb2RlbDAxU3ludGF4IG5vdyBjb250YWlucyB0aGUgdGV4dCBvZiB0aGUgYGBgbGF2YWFuYGBgIHN5bnRheC4gV2l0aGluIHRoZSBzeW50YXggc3RyaW5nLCB0aGUgUiBjb21tZW50IGNoYXJhY3RlciBgYGAjYGBgIHN0aWxsIGZ1bmN0aW9ucyB0byBjb21tZW50IHRleHQgYXJvdW5kIHRoZSBzeW50YXguIEVhY2ggcGFydCBvZiB0aGUgbW9kZWwgc3ludGF4IGNvcnJlc3BvbmRzIHRvIGEgc2V0IG9mIHBhcmFtZXRlcnMgaW4gdGhlIENGQSBtb2RlbC4gWW91IGNhbiBmaW5kIGluZm9ybWF0aW9uIGFib3V0IGxhdmFhbiBhdCBodHRwOi8vbGF2YWFuLnVnZW50LmJlLiAKCmBgYHtyIGxhdmFhbkxvbmcsIGluY2x1ZGU9VFJVRX0KbW9kZWwwMVN5bnRheExvbmcgPSAiCgojIE1vZGVsIDEgLS0gIEZ1bGx5IFotU2NvcmVkIEZhY3RvciBJZGVudGlmaWNhdGlvbiBBcHByb2FjaAoKIyBJdGVtIGZhY3RvciBsb2FkaW5ncyAtLT4gbGlzdCB0aGUgZmFjdG9yIHRvIHRoZSBsZWZ0IG9mIHRoZSA9fiBhbmQgdGhlIGl0ZW1zIHRvIHRoZSByaWdodCwgc2VwYXJhdGVkIGJ5IGEgcGx1cwojIE9uY2UgdGhlIGZhY3RvciBpcyBkZWZpbmVkIGl0IGNhbiBiZSB1c2VkIGluIHN5bnRheCBhcyBpZiBpdCBpcyBhbiBvYnNlcnZlZCB2YXJpYWJsZQojIFBhcmFtZXRlcnMgY2FuIGJlIGZpeGVkIHRvIGNvbnN0YW50IHZhbHVlcyBieSB1c2luZyB0aGUgKiBjb21tYW5kOyBzdGFydGluZyB2YWx1ZXMgY2FuIGJlIHNwZWNpZmllZCBieSB1c2luZyBzdGFydCgpKjsgbGFiZWxzIGNhbiBiZSBpbXBsZW1lbnRlZCB3aXRoIFtdCgpTaXQgPX4gU2l0MXIgKyBTaXQyICsgU2l0M3IgKyBTaXQ0ICsgU2l0NXIgKyBTaXQ2CgojIEl0ZW0gaW50ZXJjZXB0cyAtLT4gfiAxIGluZGljYXRlcyBtZWFucyBvciBpbnRlcmNlcHRzCiMgWW91IGNhbiBwdXQgbXVsdGlwbGUgbGluZXMgb2Ygc3ludGF4IG9uIGEgc2luZ2xlIGxpbmUgdXNpbmcgYSA7IApTaXQxciB+IDE7IFNpdDIgfiAxOyBTaXQzciAgfiAxOyBTaXQ0IH4gMTsgU2l0NXIgfiAxOyBTaXQ2IH4gMTsKCiMgSXRlbSBlcnJvciAodW5pcXVlKSB2YXJpYW5jZXMgYW5kIGNvdmFyaWFuY2VzIC0tPiB1c2UgdGhlIH5+IGNvbW1hbmQKU2l0MXIgfn4gU2l0MXI7IFNpdDIgfn4gU2l0MjsgU2l0M3Igfn4gU2l0M3I7IFNpdDQgfn4gU2l0NDsgU2l0NXIgfn4gU2l0NXI7IFNpdDYgfn4gU2l0NjsgCgojIEZhY3RvciB2YXJpYW5jZQpTaXQgfn4gU2l0CgojIEZhY3RvciBtZWFuIChpbnRlcmNlcHQpClNpdCB+IDAKCiIKYGBgCgpUbyBydW4gbGF2YWFuLCB0aGUgc3ludGF4IHN0cmluZyB2YXJpYWJsZSBpcyBwYXNzZWQgdG8gdGhlIGBgYGxhdmFhbihtb2RlbCA9IG1vZGVsMDFTeW50YXhMb25nLCAuLi4pYGBgIGZ1bmN0aW9uLiBJbiB0aGUgZnVuY3Rpb24gY2FsbCwgd2UgYWxzbyBzdXBwbHk6CgoqIGBgYGRhdGEgPSBoZnNTaXR1YXRpb25zYGBgOiBUaGUgZGF0YSBmcmFtZSB3aGljaCBjb250YWlucyB0aGUgdmFyaWFibGVzIGluIHRoZSBzeW50YXguCiogYGBgZXN0aW1hdG9yID0gIk1MUiJgYGA6IEVuYWJsZXMgdGhlIHVzZSBvZiByb2J1c3QgbWF4aW11bSBsaWtlbGlob29kIGVzdGltYXRpb24sIHdoaWNoIGhlbHBzIGZvciBkYXRhIHRoYXQgYXJlIG5vdCBlbnRpcmVseSBub3JtYWwuCiogYGBgbWltaWMgPSAibXBsdXMiYGBgOiBFbnN1cmVzIGNvbXBhdGFiaWxpdHkgd2l0aCBNcGx1cyBvdXRwdXQsIHdoaWNoIGlzIG9mdGVuIG5lZWRlZCBpbiBwcmFjdGljZSAoYW5kIGlzIGNlcnRhaW5seSBuZWVkZWQgZm9yIG91ciBob21ld29yayBzeXN0ZW0pLgoqIGBgYHN0ZC5sdiA9IFRSVUVgYGA6IFVzZXMgdGhlIFotc2NvcmUgbWV0aG9kIG9mIGlkZW50aWZpY2F0aW9uLCBzZXR0aW5nIGFsbCBsYXRlbnQgdmFyaWFibGUgbWVhbnMgdG8gemVybywgYWxsIGxhdGVudCB2YXJpYWJsZSB2YXJpYW5jZXMgdG8gb25lLCBhbmQgZXN0aW1hdGluZyBhbGwgZmFjdG9yIGxvYWRpbmdzLgoKCmBgYHtyIGxhdmFhblJ1bjEsIGluY2x1ZGU9VFJVRX0KbW9kZWwwMUVzdGltYXRlcyA9IGxhdmFhbihtb2RlbCA9IG1vZGVsMDFTeW50YXhMb25nLCBkYXRhID0gaGZzU2l0dWF0aW9ucywgZXN0aW1hdG9yID0gIk1MUiIsIG1pbWljID0gIm1wbHVzIiwgc3RkLmx2ID0gVFJVRSkKYGBgCgpJZiB0aGUgbW9kZWwgZXN0aW1hdGlvbiB3YXMgc3VjY2Vzc2Z1bCwgbm8gZXJyb3JzIHdvdWxkIGJlIGRpc3BsYXllZCAoYW5kIG5vIG91dHB1dCB3b3VsZCBiZSBzaG93bikuIEFsbCBtb2RlbCBpbmZvcm1hdGlvbiBhbmQgcmVzdWx0cyBhcmUgY29udGFpbmVkIHdpdGhpbiB0aGUgYGBgbW9kZWwwMUVzdGltYXRlc2BgYCBvYmplY3QuIFRvIGFjY2VzcyBhIHN1bW1hcnkgb2YgdGhlIHJlc3VsdHMgdXNlIHRoZSBgYGBzdW1tYXJ5KClgYGAgZnVuY3Rpb24gd2l0aCB0aGUgZm9sbG93aW5nIGFydWdtZW50czoKCiogYGBgbW9kZWwwMUVzdGltYXRlc2BgYDogVGhlIGFuYWx5c2lzIHRvIGJlIHN1bW1hcml6ZWQuCiogYGBgZml0Lm1lYXN1cmVzPVRSVUVgYGA6IFByb3ZpZGVzIG1vZGVsIGZpdCBpbmRpY2VzIGluIHN1bW1hcnkuCiogYGBgcnNxYXVyZT1UUlVFYGBgOiBQcm92aWRlcyB0aGUgcHJvcG9ydGlvbiBvZiB2YXJpYW5jZSAiZXhwbGFpbmVkIiBmb3IgZWFjaCB2YXJpYWJsZSAoJFJeMiQpLgoqIGBgYHN0YW5kYXJkaXplZCA9IFRSVUVgYGA6IFByb3ZpZGVzIHN0YW5kYXJkaXplZCBlc3RpbWF0ZXMgaW4gdGhlIHN1bW1hcnkuCgpgYGB7ciBsYXZzdW1tYXJ5MSwgaW5jbHVkZT1UUlVFfQpzdW1tYXJ5KG1vZGVsMDFFc3RpbWF0ZXMsIGZpdC5tZWFzdXJlcyA9IFRSVUUsIHJzcXVhcmUgPSBUUlVFLCBzdGFuZGFyZGl6ZWQgPSBUUlVFKQpgYGAKCkVhY2ggc2VjdGlvbiBjb250YWlucyBkaWZmZXJlbnQgcG9ydGlvbnMgb2YgbW9kZWwgaW5mb3JtYXRpb24uIAoKIyMjIyBVbnN0YW5kYXJkaXplZCBNb2RlbCBQYXJhbWV0ZXIgRXN0bWF0ZXMKCiMjIyMjIEZBQ1RPUiBMT0FESU5HUyAocmVncmVzc2lvbiBzbG9wZXMgb2YgaXRlbSByZXNwb25zZSBvbiBmYWN0b3IpCgpgYGAKTGF0ZW50IFZhcmlhYmxlczoKICAgICAgICAgICAgICAgICAgIEVzdGltYXRlICBTdGQuRXJyICB6LXZhbHVlICBQKD58enwpICAgU3RkLmx2ICBTdGQuYWxsCiAgU2l0ID1+ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIAogICAgU2l0MXIgICAgICAgICAgICAgMS4yMzQgICAgMC4wNjkgICAxNy45MDYgICAgMC4wMDAgICAgMS4yMzQgICAgMC43MDcKICAgIFNpdDIgICAgICAgICAgICAgIDAuNzAyICAgIDAuMDc0ICAgIDkuNDQxICAgIDAuMDAwICAgIDAuNzAyICAgIDAuNTA5CiAgICBTaXQzciAgICAgICAgICAgICAxLjI0MSAgICAwLjA2MyAgIDE5Ljg0NyAgICAwLjAwMCAgICAxLjI0MSAgICAwLjc3OAogICAgU2l0NCAgICAgICAgICAgICAgMC43ODQgICAgMC4wNjkgICAxMS4zMzMgICAgMC4wMDAgICAgMC43ODQgICAgMC41NTkKICAgIFNpdDVyICAgICAgICAgICAgIDEuMDIzICAgIDAuMDUzICAgMTkuMTc5ICAgIDAuMDAwICAgIDEuMDIzICAgIDAuNTk2CiAgICBTaXQ2ICAgICAgICAgICAgICAwLjgxOSAgICAwLjA2OSAgIDExLjk0MiAgICAwLjAwMCAgICAwLjgxOSAgICAwLjUzNQpgYGAKCiMjIyMjIEludGVyY2VwdHMgKG9mIEl0ZW1zKSDigJMgSEVSRSwgQVJFIEFDVFVBTCBJVEVNIE1FQU5TIEJFQ0FVU0UgRkFDVE9SIE1FQU4gSVMgWkVSTwoKTm90ZTogdGhlIGxhc3QgdGVybSBpbiB0aGUgbGlzdCwgYGBgU2l0YGBgIGlzIHRoZSAiaW50ZXJjZXB0IiAobWVhbikgb2YgdGhlIGZhY3Rvci4gQXMgaXQgZG9lcyBub3QgaGF2ZSBhIHN0YW5kYXJkIGVycm9yLCB0aGlzIGluZGljYXRlcyBpdCB3YXMgZml4ZWQgdG8gemVybyBhbmQgbm90IGVzdGltYXRlZC4KCmBgYApJbnRlcmNlcHRzOgogICAgICAgICAgICAgICAgICAgRXN0aW1hdGUgIFN0ZC5FcnIgIHotdmFsdWUgIFAoPnx6fCkgICBTdGQubHYgIFN0ZC5hbGwKICAgLlNpdDFyICAgICAgICAgICAgIDQuNTQ3ICAgIDAuMDUzICAgODYuNDc0ICAgIDAuMDAwICAgIDQuNTQ3ICAgIDIuNjA0CiAgIC5TaXQyICAgICAgICAgICAgICA1LjI4OSAgICAwLjA0MiAgMTI3LjM0NiAgICAwLjAwMCAgICA1LjI4OSAgICAzLjgzNAogICAuU2l0M3IgICAgICAgICAgICAgNC44OTYgICAgMC4wNDggIDEwMS45NTkgICAgMC4wMDAgICAgNC44OTYgICAgMy4wNzAKICAgLlNpdDQgICAgICAgICAgICAgIDUuMzU5ICAgIDAuMDQyICAxMjYuODk2ICAgIDAuMDAwICAgIDUuMzU5ICAgIDMuODIxCiAgIC5TaXQ1ciAgICAgICAgICAgICA0Ljg2MCAgICAwLjA1MiAgIDk0LjA2MCAgICAwLjAwMCAgICA0Ljg2MCAgICAyLjgzMgogICAuU2l0NiAgICAgICAgICAgICAgNS4zMjEgICAgMC4wNDYgIDExNS40OTIgICAgMC4wMDAgICAgNS4zMjEgICAgMy40NzcKICAgIFNpdCAgICAgICAgICAgICAgIDAuMDAwICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDAuMDAwICAgIDAuMDAwCmBgYCAKCiMjIyMjICBSZXNpZHVhbCAoVW5pcXVlKSBWYXJpYW5jZXMgKHZhcmlhbmNlIG9mIGVycm9yIHRlcm1zKQoKTm90ZTogdGhlIGxhc3QgdGVybSBpbiB0aGUgbGlzdCwgYGBgU2l0YGBgLCBpcyB0aGUgdmFyaWFuY2Ugb2YgdGhlIGZhY3Rvci4gQXMgaXQgZG9lcyBub3QgaGF2ZSBhIHN0YW5kYXJkIGVycm9yLCB0aGlzIGluZGljYXRlcyBpdCB3YXMgZml4ZWQgdG8gb25lIChmcm9tIHRoZSBgYGBzdGQubHYgPSBUUlVFYGBgIG9wdGlvbiB3ZSB1c2VkIGluIHRoZSBgYGBsYXZhYW4oKWBgYCBmdW5jdGlvbiBjYWxsKSBhbmQgbm90IGVzdGltYXRlZC4KCmBgYApWYXJpYW5jZXM6CiAgICAgICAgICAgICAgICAgICBFc3RpbWF0ZSAgU3RkLkVyciAgei12YWx1ZSAgUCg+fHp8KSAgIFN0ZC5sdiAgU3RkLmFsbAogICAuU2l0MXIgICAgICAgICAgICAgMS41MjYgICAgMC4xNDkgICAxMC4yMTcgICAgMC4wMDAgICAgMS41MjYgICAgMC41MDAKICAgLlNpdDIgICAgICAgICAgICAgIDEuNDA5ICAgIDAuMTI4ICAgMTEuMDE0ICAgIDAuMDAwICAgIDEuNDA5ICAgIDAuNzQxCiAgIC5TaXQzciAgICAgICAgICAgICAxLjAwNCAgICAwLjEzNSAgICA3LjQ1NiAgICAwLjAwMCAgICAxLjAwNCAgICAwLjM5NQogICAuU2l0NCAgICAgICAgICAgICAgMS4zNTIgICAgMC4xMjcgICAxMC42NzIgICAgMC4wMDAgICAgMS4zNTIgICAgMC42ODcKICAgLlNpdDVyICAgICAgICAgICAgIDEuODk5ICAgIDAuMTE4ICAgMTYuMDI1ICAgIDAuMDAwICAgIDEuODk5ICAgIDAuNjQ1CiAgIC5TaXQ2ICAgICAgICAgICAgICAxLjY3MSAgICAwLjE1OSAgIDEwLjUxNyAgICAwLjAwMCAgICAxLjY3MSAgICAwLjcxNAogICAgU2l0ICAgICAgICAgICAgICAgMS4wMDAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMS4wMDAgICAgMS4wMDAKYGBgCgojIyMjIE1ha2luZyB1c2Ugb2YgdGhlIHVuc3RhbmRhcmRpemVkIG1vZGVsIGVzdGltYXRlczoKCl9Xcml0aW5nIG91dCB0aGUgbW9kZWzigJRpbmRpdmlkdWFsIHByZWRpY3RlZCB2YWx1ZXM6XwoKKiAkWV8xID0gXG11XzEgKyBcbGFtYmRhXzFGICsgZV8xID0gNC41NDcgKyAxLjIzNEYgKyBlXzEkCgpfV3JpdGluZyBvdXQgdGhlIG1vZGVs4oCUcHJlZGljdGVkIGl0ZW0gdmFyaWFuY2VzIGFuZCBjb3ZhcmlhbmNlczpfCgoqICRWYXJcbGVmdCggWV8xIFxyaWdodCkgPSBcbGVmdCggXGxhbWJkYV4yXzEgXHJpZ2h0KSBWYXJcbGVmdChGXHJpZ2h0KSArIFZhclxsZWZ0KGVfMVxyaWdodCkgPSAoMS4yMzReMikqKDEpICsgMS41MjYgPSAzLjA0OSQgKD0gb3JpZ2luYWwgaXRlbSB2YXJpYW5jZSkKCiogJENvdlxsZWZ0KCBZXzEsIFlfMiBccmlnaHQpID0gXGxhbWJkYV8xIFZhclxsZWZ0KEZccmlnaHQpIFxsYW1iZGFfMiA9ICgxLjIzNCkqKDEpKiguNzAyKSA9IC44NjYkIChhY3R1YWwgY292YXJpYW5jZSA9IC41NzcsIHNvIHRoZSBtb2RlbCBvdmVyLXByZWRpY3RlZCBob3cgcmVsYXRlZCBpdGVtcyAxIGFuZCAyIHNob3VsZCBiZSkKCiMjIyMgU3RhbmRhcmRpemVkIE1vZGVsIFBhcmFtZXRlciBFc3RpbWF0ZXMKClRoZSBsYXN0IHR3byBjb2x1bW5zIG9mIHRoZSBzdW1tYXJ5IG91dHB1dCwgYGBgU3RkLmx2YGBgIGFuZCBgYGBTdGQuYWxsYGBgLCBjb250YWluIHRoZSBzdGFuZGFyZGl6ZWQgbW9kZWwgcGFyYW1ldGVyIGVzdGltYXRlcy4gVG8gdW5kZXJzdGFuZCB0aGUgZGlmZmVyZW5jZSBiZXR3ZWVuIHN0YW5kYXJkaXplZCBhbmQgdW5zdGFuZGFyZGl6ZWQgcGFyYW1ldGVyIGVzdGltYXRlcywgbGV0J3Mgc3RhcnQgd2l0aCB0aGUgc3RhbmRhcmRpemVkIGVzdGltYXRlcy4gU3RhbmRhcmRpemVkIHJlZ3Jlc3Npb24gY29lZmZpY2llbnRzIChhbmQgZmFjdG9yIGxvYWRpbmdzKSBoYXZlIGEgc2NhbGUgdGhhdCBpcyAidW5pdHMgb2YgWSIgcGVyICJ1bml0IG9mIFgiLiBUaGF0IGlzLCB0aGUgc2xvcGUvbG9hZGluZywgcmVwcmVzZW50cyB0aGUgaW5jcmVhc2UgaW4gdGhlIGRlcGVuZGVudCB2YXJpYWJsZSAkWCQgcGVyIHVuaXQgb2YgdGhlIGluZGVwZW5kZW50IHZhcmlhYmVsICRYJCAoaW4gb3VyIGNhc2UsIHRoZSBmYWN0b3IpLiBUaGUgdW5pdHMgb2YgJFkkIGFyZSBnaXZlbiBieSB0aGUgc3RhbmRhcmQgZGV2aWF0aW9uIG9mICRZJCwgb3IgJFNEKFkpJC4gU2ltaWxhcmx5LCB0aGUgdW5pdHMgb2YgJFgkIGFyZSBnaXZlbiBieSB0aGUgc3RhbmRhcmQgZGV2aWF0aW9uIG9mICRYJCwgb3IgJFNEKFgpJC4gWW91IGNhbiB0aGluayBvZiB0aGUgdW5pdHMgYXNzb2NpYXRlZCBieSB0aGUgZnJhY3Rpb24gJFxmcmFje1NEKFkpfXtTRChYKX0kLiBTbywgdGhlIGZpcnN0IGZhY3RvciBsb2FkaW5nIChhIHZhbHVlIG9mIDEuMjM0IGZvciB0aGUgaXRlbSBTaXQxcikgaW5kaWNhdGVzIHRoZSBudW1lcmljIHJlc3BvbnNlIHRvIHRoZSBpdGVtIGdvZXMgdXAgYnkgMS4yMzQgZm9yIGV2ZXJ5IG9uZS11bml0IGluY3JlYXNlIGluIHRoZSBmYWN0b3IgU2l0LiAKClRoZSBwcm9jZXNzIG9mIHN0YW5kYXJkaXphdGlvbiByZW1vdmVzIHRoZSB1bml0cyBhdHRhY2hlZCB0byB0aGUgcGFyYW1ldGVyLiBTbywgaWYgdGhlIHVuc3RhbmRhcmRpemVkIGZhY3RvciBsb2FkaW5ncyBhcmUgZXhwcmVlc2VkIGluIHVuaXRzIG9mICRcZnJhY3tTRChZKX17U0QoWCl9JCwgdGhlIHN0YW5kYXJkaXplZCB1bml0cyBhcmUgYWNoZWl2ZWQgYnkgZWl0aGVyIGRpdmlkaW5nIG9yIG11bHRpcGx5aW5nIGJ5IHRoZSBhcHByb3ByaWF0ZSBzdGFuZGFyZCBkZXZpYXRpb24gdG8gbWFrZSB0aGUgbnVtZXJhdG9yIG9yIGRlbm9taW5hdG9yIG9mICRcZnJhY3tTRChZKX17U0QoWCl9JCBlcXVhbCB0byBvbmUuIEZvciB0aGUgc3RhbmRhcmRpemVkIGVzdGltYXRlcyB1bmRlciAgYGBgc3RkLmx2YGBgLCB0aGUgdW5pdHMgb2YgdGhlIGZhY3RvciAkKFNEKFgpKSQgYXJlIHJlbW92ZWQgKHlpZWxkaW5nICRcZnJhY3tTRChZKX17MX0kKSBieSBtdWx0aXBseWluZyB0aGUgZXN0aW1hdGUgYnkgdGhlIGZhY3RvciBzdGFuZGFyZCBkZXZpYXRpb24uIEJlY2F1c2UgdGhlIGZhY3RvciBzdGFuZGFyZCBkZXZpYXRpb24gaXMgc2V0IHRvIG9uZSwgYWxsIGVzdGltYXRlcyBpbiB0aGlzIGNvbHVtbiBhcmUgdGhlIHNhbWUgYXMgdGhlIHVuc3RhbmRhcmRpemVkIGVzdGltYXRlLiBUaGVzZSB1bnN0YW5kYXJkaXplZCBlc3RpbWF0ZXMgY2FuIGJlIHVzZWQgdG8gc2VlIGhvdyBwYXJhbWV0ZXJzIHdvdWxkIGxvb2sgdW5kZXIgdGhlIFotc2NvcmUgaWRlbnRpZmljdGlvbiAgbWV0aG9kIGFub3RoZXIgaWRlbnRpZmljYXRpb24gbWV0aG9kIHdhcyB1c2VkLiAKClRoZSBzdGFuZGFyZGl6ZWQgZXN0aW1hdGVzIGxpc3RlZCB1bmRlciBgYGBzdGQuYWxsYGBgIGFyZSBmb3JtZWQgYnkgbXVsdGlwbHlpbmcgdGhlIGVzdGltYXRlIGJ5IHRoZSBzdGFuZGFyZCBkZXZpYXRpb24gb2YgdGhlIGZhY3RvciBhbmQgZGl2aWRpbmcgdGhhdCBieSB0aGUgdW5jb25kaXRpb25hbCAocmF3KSBzdGFuZGFyZCBkZXZpYXRpb24gb2YgdGhlIGl0ZW0uIEZvciBpbnN0YW5jZSwgdGhlICJmdWxseSIgc3RhbmRhcmRpemVkIGZhY3RvciBsb2FkaW5nIG9mIHRoZSBmaXJzdCBpdGVtIGlzIGZvdW5kIGJ5IG11bHRpcGx5aW5nIHRoZSB1bnN0YW5kYXJkaXplZCBjb2VmZmljaWVudCAoMS4yMzQpIGJ5IG9uZSAodGhlIGZhY3RvciBzdGFuZGFyZCBkZXZpYXRpb24pIGFuZCBkaXZpZGluZyBieSB0aGUgaXRlbSdzIHN0YW5kYXJkIGRldmlhdGlvbiAoJFxzcXJ0ezMuMDQ5fSQgLS0gdGhlIHNxdWFyZSByb290IG9mIHRoZSBpdGVtIHZhcmlhbmNlIHNob3duIGF0IHRoZSBiZWdpbm5pbmcgb2YgdGhpcyBleGFtcGxlKS4gVGhlIHJlc3VsdGluZyB2YWx1ZSwgJDEuMjM0XHRpbWVzXGZyYWN7MX17XHNxcnR7My4wNDl9fSA9IDAuNzA3JCwgcmVwcmVzZW50cyB0aGUgZmFjdG9yIGxvYWRpbmcgd291bGQgdGhlIGFuYWx5c2lzIGhhdmUgYmVlbiBydW4gKGEpIHdpdGggYSBaLXNjb3JlIGZhY3RvciBpZGVudGlmaWNhdGlvbiBhbmQgKGIpIG9uIGFuIGl0ZW0gdGhhdCB3YXMgYSBaLXNjb3JlLiAKClRoZSBwcm9jZXNzIG9mIHN0YW5kYXJkaXphdGlvbiBpcyB0aGUgc2FtZSBmb3IgYWxsIHBhcmFtZXRlcnMgb2YgdGhlIG1vZGVsOiBpbnRlcmNlcHRzLCBsb2FkaW5ncywgYW5kIHJlc2lkdWFsICh1bmlxdWUpIHZhcmlhbmNlcy4gVGhlIGludGVycHJldGF0aW9uIG9mIHN0YW5kYXJkaXplZCBpdGVtIGludGVyY2VwdHMgaXMgZGlmZmljdWx0IGFuZCBvZnRlbiB0aGVzZSBhcmUgbm90IHJlcG9ydGVkLiBUaGUgc3RhbmRhcmRpemVkIHZlcnNpb25zIG9mIGZhY3RvciBsb2FkaW5ncyBhbmQgdW5pcXVlIHZhcmlhbmNlcyBhcmUgY29tbW9ubHkgcmVwb3J0ZWQuCgpNb3Jlb3ZlciwgaW4gZm9yIGl0ZW1zIG1lYXN1cmluZyBvbmUgZmFjdG9yLCB0aGUgc3RhbmRhcmRpemVkIGxvYWRpbmdzIGxlYWQgZGlyZWN0bHkgdG8gdGhlICRSXjIkIGVzdGltYXRlIC0tIHRoZSBhbW91bnQgb2YgdmFyaWFuY2UgaW4gdGhlIGl0ZW0gcmVzcG9uc2VzIGV4cGxhaW5lZCBieSB0aGUgZmFjdG9yLiBUaGUgaXRlbSAkUl4yJCBpcyBmb3VuZCBieSB0aGUgc3F1YXJlIG9mIHRoZSB1bnN0YW5kYXJkaXplZCBmYWN0b3IgbG9hZGluZy4gVGhlIFItU3F1YXJlIGluZm9ybWF0aW9uIGlzIGZvdW5kIGF0IHRoZSBlbmQgb2YgdGhlIG1vZGVsIHN1bW1hcnksIHNvIGxvbmcgYXMgdGhlIG9wdGlvbiBgYGByc3F1YXJlID0gVFJVRWBgYCBpcyBzcGVjaWZpZWQgaW4gdGhlIGBgYHN1bW1hcnkoKWBgYCBmdW5jdGlvbiBjYWxsLgoKYGBgClItU3F1YXJlOgogICAgICAgICAgICAgICAgICAgRXN0aW1hdGUKICAgIFNpdDFyICAgICAgICAgICAgIDAuNTAwCiAgICBTaXQyICAgICAgICAgICAgICAwLjI1OQogICAgU2l0M3IgICAgICAgICAgICAgMC42MDUKICAgIFNpdDQgICAgICAgICAgICAgIDAuMzEzCiAgICBTaXQ1ciAgICAgICAgICAgICAwLjM1NQogICAgU2l0NiAgICAgICAgICAgICAgMC4yODYKYGBgCgojIyMgU2hvcnRlbmluZyBMYXZhYW4gU3ludGF4OiBMYXZhYW4gRGVmYXVsdCBPcHRpb25zCgpUaGUgc3ludGF4IGFib3ZlIGlzIGRlc2lnbmVkIHRvIHNob3cgdGhlIG1hcHBpbmcgb2YgYWxsIENGQSBwYXJhbWV0ZXJzIHRvIGFsbCBsYXZhYW4gc3ludGF4IGVsZW1lbnRzLiBJbiByZWFsaXR5LCBhbGwgeW91IHdvdWxkIG5lZWQgdG8gd3JpdGUgdG8gZGVmaW5lIHRoaXMgbW9kZWwgaXM6CgpgYGB7ciBsYXZhYW5TaG9ydCwgaW5jbHVkZT1UUlVFfQptb2RlbDAxU3ludGF4U2hvcnQgPSAiCgpTaXQgPX4gU2l0MXIgKyBTaXQyICsgU2l0M3IgKyBTaXQ0ICsgU2l0NXIgKyBTaXQ2CgoiCmBgYAoKVGhlIHN5bnRheCBpbnB1dCBpbnRvIHRoZSBgYGBzZW0oKWBgYCBmdW5jdGlvbiB1c2VzIHNvbWUgZGVmYXVsdHM6CgoqIEFsbCBpdGVtIGludGVyY2VwdHMgYXJlIGVzdGltYXRlZCAoZWFjaCBpdGVtIGdldHMgaXRzIG93bikgYW5kIHRoZSBmYWN0b3IgbWVhbiBpcyBmaXhlZCBhdCB6ZXJvLgoqIEFsbCBpdGVtIGVycm9yICh1bmlxdWUpIHZhcmlhbmNlcyBhcmUgZXN0aW1hdGVkIChlYWNoIGl0ZW0gZ2V0cyBpdHMgb3duKS4KKiBBbGwgZmFjdG9yIHZhcmlhbmNlcyBhbmQgY292YXJpYW5jZXMgYXJlIGVzdGltYXRlZCAodG8gZG8gc28sIHRoZSBmaXJzdCBpdGVtIGFmdGVyIHRoZSA9fiBoYXMgaXRzIGZhY3RvciBsb2FkaW5nIHNldCB0byAxIC0tIGEgbWFya2VyIGl0ZW0gaWRlbnRpZmljYXRpb24gbWV0aG9kKQoKU2ltaWxhcmx5LCB0byBydW4gdGhpcyBzeW50YXggdGhlIGBgYHNlbWBgYCBmdWN0aW9uIGlzIG5vdyBjYWxsZWQuIFRvIHNlZSB0aGUgcmVzdWx0cywgdGhlIGBgYHN1bW1hcnlgYGAgZnVuY3Rpb24gaXMgdXNlZC4gVGhlIGBgYHNlbWBgYCBmdW5jdGlvbiBzaW1wbGlmaWVzIHRoZSBzeW50YXggbmVlZGVkIHRvIGNvbmR1Y3QgYSBjb25maXJtYXRvcnkgZmFjdG9yIGFuYWx5c2lzLiBUaGVzZSBhcmUgZGVtb25zdHJhdGVkIGJlbG93LiBOb3RlIHRoZSBvdXRwdXQgaXMgaWRlbnRpY2FsIHRvIHdoYXQgd2FzIHJ1biBwcmV2aW91c2x5LgogCmBgYHtyIGxhdmFhbnNob3J0LCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDFFc3RpbWF0ZXNTaG9ydCA9IHNlbShtb2RlbCA9IG1vZGVsMDFTeW50YXhTaG9ydCwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIsIHN0ZC5sdiA9IFRSVUUpCnN1bW1hcnkobW9kZWwwMUVzdGltYXRlc1Nob3J0LCBmaXQubWVhc3VyZXMgPSBUUlVFLCByc3F1YXJlID0gVFJVRSwgc3RhbmRhcmRpemVkID0gVFJVRSkKYGBgCgojIyMgQWx0ZXJuYXRpdmUgSWRlbnRpZmljYXRpb24gTWV0aG9kcwoKVGhlcmUgYXJlIG11bHRpcGxlIGVxdWl2YWxlbnQgd2F5cyBvZiBnZXR0aW5nIHRoZSBzYW1lIENGQSBtb2RlbCwgYnV0IHdpdGggZGlmZmVyZW50IHNjYWxpbmcgZm9yIHRoZSBmYWN0b3IgbWVhbiBhbmQgdmFyaWFuY2UgKGkuZS4sIGRpZmZlcmVudCBtZWFucyBvZiBpZGVudGlmaWNhdGlvbikuIE5vdyBsZXTigJlzIHNlZSB0aGUgbW9kZWwgcGFyYW1ldGVycyB3aGVuIHVzaW5nIHRoZSBtYXJrZXIgaXRlbSBmb3IgbW9kZWwgaWRlbnRpZmljYXRpb24gaW5zdGVhZC4gSW4gdGhlIG1hcmtlciBpdGVtIGlkZW50aWZpY2F0aW9uIG1ldGhvZDoKCiogVGhlIGZpcnN0IGZhY3RvciBsb2FkaW5nIG9mIGEgZmFjdG9yICh0aGUgZmlyc3QgdmFyaWFibGUgYWZ0ZXIgdGhlIGBgYD1+YGBgIHN5bWJvbCBpbiBgYGBsYXZhYW5gYGAgc3ludGF4KSBpcyBzZXQgdG8gb25lCiogVGhlIGZhY3RvciB2YXJpYW5jZSBpcyBlc3RpbWF0ZWQKKiBUaGUgZmFjdG9yIG1lYW4gaXMgc2V0IHRvIHplcm8KKiBBbGwgaXRlbSBpbnRlcmNlcHRzIGFuZCB1bmlxdWUgdmFyaWFuY2VzIGFyZSBlc3RpbWF0ZWQgKGFzIGRvbmUgaW4gdGhlIFotc2NvcmUgaWRlbnRpZmljYXRpb24gbWV0aG9kKQoKIyMjIyBGYWN0b3IgTWVhbiBaZXJvOyBGYWN0b3IgVmFyaWFuY2UgRXN0aW1hdGVkIChtYXJrZXIgaXRlbSBmYWN0b3IgbG9hZGluZykKClRoZSBgYGBsYXZhYW5gYGAgc3ludGF4IGlzIHRoZSBzYW1lIGZvciB0aGUgbWFya2VyIGl0ZW0gaWRlbnRpZmljYXRpb24sIGJ1dCB0aGUgY2FsbCB0byB0aGUgYGBgbGF2YWFuKClgYGAgZnVuY3Rpb24gZG9lcyBub3QgaW5jbHVkZSB0aGUgYGBgc3RkLmx2ID0gVFJVRWBgYCBvcHRpb24sIHdoaWNoIGRlZmF1bHRzIHRvIHRoZSBtYXJrZXIgaXRlbSBtZXRob2Qgb2YgaWRlbnRpZmljYXRpb246CgpgYGB7ciBtYXJrZXIsIGluY2x1ZGU9VFJVRX0KbW9kZWwwMkVzdGltYXRlcyA9IHNlbShtb2RlbCA9IG1vZGVsMDFTeW50YXhTaG9ydCwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIpCnN1bW1hcnkobW9kZWwwMkVzdGltYXRlcywgZml0Lm1lYXN1cmVzID0gVFJVRSwgcnNxdWFyZSA9IFRSVUUsIHN0YW5kYXJkaXplZCA9IFRSVUUpCmBgYAoKIyMjIyBVbnN0YW5kYXJkaXplZCBNb2RlbCBSZXN1bHRzCgojIyMjIyBGQUNUT1IgTE9BRElOR1MgKHJlZ3Jlc3Npb24gc2xvcGVzIG9mIGl0ZW0gcmVzcG9uc2Ugb24gZmFjdG9yKQoKSGVyZSwgbG9hZGluZyBmb3IgU0lUMVIgaXMgbm90IHRlc3RlZCBhbmQgaGFzIG5vIHN0YW5kYXJkIGVycm9yIChgYGBTdGQuRXJyYGBgKSBiZWNhdXNlIGl0IGlzIGZpeGVkIHRvIG9uZS4gQWxzbywgbm90ZSB0aGUgYGBgU3RkLmx2YGBgIGVzdGltYXRlcyBhcmUgaWRlbnRpY2FsIHRvIHRoZSB1bnN0YW5kYXJkaXplZCBlc3RpbWF0ZXMgaW4gdGhlIFotc2NvcmUgZmFjdG9yIGlkZW50aWZpY2F0aW9uIG1ldGhvZC4gRnVydGhlciwgdGhlIGBgYFN0ZC5hbGxgYGAgZXN0aW1hdGVzIGFyZSBlcXVhbCB0byB0aGUgYGBgU3RkLmFsbGBgYCBlc3RpbWF0ZXMgaW4gdGhlIFotc2NvcmUgZmFjdG9yIGlkZW50aWZpY2F0aW9uIG1ldGhvZC4gVGhlc2Ugd2lsbCBiZSBlcXVhbCBmb3IgYWxsIGlkZW50aWZpY2F0aW9uIG1ldGhvZHMuCgpgYGAKTGF0ZW50IFZhcmlhYmxlczoKICAgICAgICAgICAgICAgICAgRXN0aW1hdGUgIFN0ZC5FcnIgIHotdmFsdWUgIFAoPnx6fCkgIFN0ZC5sdiAgU3RkLmFsbAogIFNpdCA9fgogICAgU2l0MXIgICAgICAgICAgICAxLjAwMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAxLjIzNCAgICAwLjcwNwogICAgU2l0MiAgICAgICAgICAgICAwLjU2OSAgICAwLjA4MyAgICA2LjgzMSAgICAwLjAwMCAgICAwLjcwMiAgICAwLjUwOQogICAgU2l0M3IgICAgICAgICAgICAxLjAwNSAgICAwLjAzNSAgIDI4LjU1MyAgICAwLjAwMCAgICAxLjI0MSAgICAwLjc3OAogICAgU2l0NCAgICAgICAgICAgICAwLjYzNiAgICAwLjA4MiAgICA3Ljc0MSAgICAwLjAwMCAgICAwLjc4NCAgICAwLjU1OQogICAgU2l0NXIgICAgICAgICAgICAwLjgyOSAgICAwLjA1MyAgIDE1LjY5OCAgICAwLjAwMCAgICAxLjAyMyAgICAwLjU5NgogICAgU2l0NiAgICAgICAgICAgICAwLjY2NCAgICAwLjA4MSAgICA4LjE0MyAgICAwLjAwMCAgICAwLjgxOSAgICAwLjUzNQpgYGAKCiMjIyMjIEludGVyY2VwdHMgKG9mIEl0ZW1zKSDigJMgRVhQRUNURUQgWSBXSEVOIEZBQ1RPUiA9IDAsIG9yIGZvciBtZWFuIG9mIGZhY3RvciBpbiBzYW1wbGUKCkhlcmUsIGFsbCBhcmUgaWRlbnRpY2FsIHRvIHdoYXQgd2FzIGZvdW5kIGluIHRoZSBwcmV2aW91cyBaLXNjb3JlIHN0YW5kYXJkaXphdGlvbi4gVGhhdCBpcyBiZWNhdXNlIHdlIGxlZnQgdGhlIGZhY3RvciBtZWFuIHRvIGJlIHplcm8uCgpgYGAKSW50ZXJjZXB0czoKICAgICAgICAgICAgICAgICAgIEVzdGltYXRlICBTdGQuRXJyICB6LXZhbHVlICBQKD58enwpICAgU3RkLmx2ICBTdGQuYWxsCiAgIC5TaXQxciAgICAgICAgICAgICA0LjU0NyAgICAwLjA1MyAgIDg2LjQ3NCAgICAwLjAwMCAgICA0LjU0NyAgICAyLjYwNAogICAuU2l0MiAgICAgICAgICAgICAgNS4yODkgICAgMC4wNDIgIDEyNy4zNDYgICAgMC4wMDAgICAgNS4yODkgICAgMy44MzQKICAgLlNpdDNyICAgICAgICAgICAgIDQuODk2ICAgIDAuMDQ4ICAxMDEuOTU5ICAgIDAuMDAwICAgIDQuODk2ICAgIDMuMDcwCiAgIC5TaXQ0ICAgICAgICAgICAgICA1LjM1OSAgICAwLjA0MiAgMTI2Ljg5NiAgICAwLjAwMCAgICA1LjM1OSAgICAzLjgyMQogICAuU2l0NXIgICAgICAgICAgICAgNC44NjAgICAgMC4wNTIgICA5NC4wNjAgICAgMC4wMDAgICAgNC44NjAgICAgMi44MzIKICAgLlNpdDYgICAgICAgICAgICAgIDUuMzIxICAgIDAuMDQ2ICAxMTUuNDkyICAgIDAuMDAwICAgIDUuMzIxICAgIDMuNDc3CiAgICBTaXQgICAgICAgICAgICAgICAwLjAwMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjAwMCAgICAwLjAwMApgYGAKCiMjIyMjIFJlc2lkdWFsICh1bmlxdWUpIHZhcmlhbmNlcyBhbmQgZmFjdG9yIHZhcmlhbmNlCgpIZXJlLCB0aGUgZmFjdG9yIHZhcmlhbmNlIGlzIGVzdGltYXRlZCwgd2hpY2ggaXMgZGlmZmVyZW50IGZyb20gdGhlIHByZXZpb3VzIGlkZW50aWZpY2F0aW9uIG1ldGhvZC4KCmBgYApWYXJpYW5jZXM6CiAgICAgICAgICAgICAgICAgICBFc3RpbWF0ZSAgU3RkLkVyciAgei12YWx1ZSAgUCg+fHp8KSAgIFN0ZC5sdiAgU3RkLmFsbAogICAuU2l0MXIgICAgICAgICAgICAgMS41MjYgICAgMC4xNDkgICAxMC4yMTcgICAgMC4wMDAgICAgMS41MjYgICAgMC41MDAKICAgLlNpdDIgICAgICAgICAgICAgIDEuNDA5ICAgIDAuMTI4ICAgMTEuMDE0ICAgIDAuMDAwICAgIDEuNDA5ICAgIDAuNzQxCiAgIC5TaXQzciAgICAgICAgICAgICAxLjAwNCAgICAwLjEzNSAgICA3LjQ1NiAgICAwLjAwMCAgICAxLjAwNCAgICAwLjM5NQogICAuU2l0NCAgICAgICAgICAgICAgMS4zNTIgICAgMC4xMjcgICAxMC42NzIgICAgMC4wMDAgICAgMS4zNTIgICAgMC42ODcKICAgLlNpdDVyICAgICAgICAgICAgIDEuODk5ICAgIDAuMTE4ICAgMTYuMDI1ICAgIDAuMDAwICAgIDEuODk5ICAgIDAuNjQ1CiAgIC5TaXQ2ICAgICAgICAgICAgICAxLjY3MSAgICAwLjE1OSAgIDEwLjUxNyAgICAwLjAwMCAgICAxLjY3MSAgICAwLjcxNAogICAgU2l0ICAgICAgICAgICAgICAgMS41MjMgICAgMC4xNzAgICAgOC45NTMgICAgMC4wMDAgICAgMS4wMDAgICAgMS4wMDAKYGBgCgojIyMjIEVzdGltYXRpbmcgRmFjdG9yIE1lYW5zOiBNYXJrZXIgSXRlbSBMb2FkaW5nICg9MSkgYW5kIE1hcmtlciBJdGVtIEludGVyY2VwdCAoPTApCgpUbyBlc3RpbWF0ZSB0aGlzIG1vZGVsLCB3ZSBoYXZlIHRvIHJldHVybiB0byB0aGUgZ2VuZXJhbCBgYGBsYXZhYW5gYGAgbW9kZWwgZnVuY3Rpb24uIEluIHRoZSBzeW50YXggYmVsb3cgeW91IHNlZSBgYGAxKlNpdDFyYGBgLCBzZXR0aW5nIHRoZSBmYWN0b3IgbG9hZGluZyBmb3IgYGBgU2l0MXJgYGAgdG8gb25lICh0aGUgbWFya2VyIGl0ZW0gZmFjdG9yIGxvYWRpbmcpLiBGdXRoZXIsIHlvdSBzZWUgYGBgU2l0MXIgfiAwYGBgIHNldHRpbmcgdGhlIGl0ZW0gaW50ZXJjZXB0IG9mIGBgYFNpdDFyYGBgIHRvIHplcm8sIHRoZSBtYXJrZXIgaXRlbSBpbnRlcmNlcHQuIEZpbmFsbHksIHRvIGVzdGltYXRlIHRoZSBmYWN0b3IgbWVhbiwgd2UgdXNlIGBgYFNpdCB+IDFgYGAsIHdoaWNoIGVzdGltYXRlcyB0aGUgZmFjdG9yIG1lYW4gZXhwbGljaXRseS4KCmBgYHtyIGxhdmFhbjMsIGluY2x1ZGU9VFJVRX0KbW9kZWwwM1N5bnRheCA9ICIKCiMgTW9kZWwgMSAtLSAgRnVsbHkgWi1TY29yZWQgRmFjdG9yIElkZW50aWZpY2F0aW9uIEFwcHJvYWNoCgojIEl0ZW0gZmFjdG9yIGxvYWRpbmdzIC0tPiBsaXN0IHRoZSBmYWN0b3IgdG8gdGhlIGxlZnQgb2YgdGhlID1+IGFuZCB0aGUgaXRlbXMgdG8gdGhlIHJpZ2h0LCBzZXBhcmF0ZWQgYnkgYSBwbHVzCiMgT25jZSB0aGUgZmFjdG9yIGlzIGRlZmluZWQgaXQgY2FuIGJlIHVzZWQgaW4gc3ludGF4IGFzIGlmIGl0IGlzIGFuIG9ic2VydmVkIHZhcmlhYmxlCiMgUGFyYW1ldGVycyBjYW4gYmUgZml4ZWQgdG8gY29uc3RhbnQgdmFsdWVzIGJ5IHVzaW5nIHRoZSAqIGNvbW1hbmQ7IHN0YXJ0aW5nIHZhbHVlcyBjYW4gYmUgc3BlY2lmaWVkIGJ5IHVzaW5nIHN0YXJ0KCkqOyBsYWJlbHMgY2FuIGJlIGltcGxlbWVudGVkIHdpdGggW10KClNpdCA9fiAxKlNpdDFyICsgU2l0MiArIFNpdDNyICsgU2l0NCArIFNpdDVyICsgU2l0NgoKIyBJdGVtIGludGVyY2VwdHMgLS0+IH4gMSBpbmRpY2F0ZXMgbWVhbnMgb3IgaW50ZXJjZXB0cwojIFlvdSBjYW4gcHV0IG11bHRpcGxlIGxpbmVzIG9mIHN5bnRheCBvbiBhIHNpbmdsZSBsaW5lIHVzaW5nIGEgOyAKU2l0MXIgfiAwOyBTaXQyIH4gMTsgU2l0M3IgIH4gMTsgU2l0NCB+IDE7IFNpdDVyIH4gMTsgU2l0NiB+IDE7CgojIEl0ZW0gZXJyb3IgKHVuaXF1ZSkgdmFyaWFuY2VzIGFuZCBjb3ZhcmlhbmNlcyAtLT4gdXNlIHRoZSB+fiBjb21tYW5kClNpdDFyIH5+IFNpdDFyOyBTaXQyIH5+IFNpdDI7IFNpdDNyIH5+IFNpdDNyOyBTaXQ0IH5+IFNpdDQ7IFNpdDVyIH5+IFNpdDVyOyBTaXQ2IH5+IFNpdDY7IAoKIyBGYWN0b3IgdmFyaWFuY2UKU2l0IH5+IFNpdAoKIyBGYWN0b3IgbWVhbiAoaW50ZXJjZXB0KQpTaXQgfiAxCgoiCm1vZGVsMDNFc3RpbWF0ZXMgPSBzZW0obW9kZWwgPSBtb2RlbDAzU3ludGF4LCBkYXRhID0gaGZzU2l0dWF0aW9ucywgZXN0aW1hdG9yID0gIk1MUiIsIG1pbWljID0gIm1wbHVzIikKc3VtbWFyeShtb2RlbDAzRXN0aW1hdGVzLCBmaXQubWVhc3VyZXMgPSBUUlVFLCByc3F1YXJlID0gVFJVRSwgc3RhbmRhcmRpemVkID0gVFJVRSkKYGBgCgpIZXJlLCB5b3Ugd2lsbCBub3RlIHRoZSBtb2RlbCBpcyBpZGVudGljYWwgdG8gdGhlIHByZXZpb3VzIHR3byAtLSB0aGUgbG9nLWxpa2VsaWhvb2QgaXMgLTExNTM2LjQwNCwgc2FtZSBhcyBwcmV2aW91c2x5LiBOb3csIHRoZSBpdGVyY2VwdHMgaGFzIHRoZSBtZWFuIG9mIGl0ZW0gYGBgU2l0MXJgYGAgc2V0IHRvIHplcm8gYW5kIHRoZSBtZWFuIG9mIHRoZSBmYWN0b3IgZXN0aW1hdGVkLiAKCmBgYApJbnRlcmNlcHRzOgogICAgICAgICAgICAgICAgICAgRXN0aW1hdGUgIFN0ZC5FcnIgIHotdmFsdWUgIFAoPnx6fCkgICBTdGQubHYgIFN0ZC5hbGwKICAgLlNpdDFyICAgICAgICAgICAgIDAuMDAwICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDAuMDAwICAgIDAuMDAwCiAgIC5TaXQyICAgICAgICAgICAgICAyLjcwMSAgICAwLjM4MyAgICA3LjA0NSAgICAwLjAwMCAgICAyLjcwMSAgICAxLjk1OAogICAuU2l0M3IgICAgICAgICAgICAgMC4zMjUgICAgMC4xNzEgICAgMS44OTkgICAgMC4wNTggICAgMC4zMjUgICAgMC4yMDQKICAgLlNpdDQgICAgICAgICAgICAgIDIuNDY5ICAgIDAuMzgwICAgIDYuNTAyICAgIDAuMDAwICAgIDIuNDY5ICAgIDEuNzYwCiAgIC5TaXQ1ciAgICAgICAgICAgICAxLjA5MiAgICAwLjI0NiAgICA0LjQzMSAgICAwLjAwMCAgICAxLjA5MiAgICAwLjYzNgogICAuU2l0NiAgICAgICAgICAgICAgMi4zMDQgICAgMC4zNjkgICAgNi4yNDkgICAgMC4wMDAgICAgMi4zMDQgICAgMS41MDYKICAgIFNpdCAgICAgICAgICAgICAgIDQuNTQ3ICAgIDAuMDUzICAgODYuNDc0ICAgIDAuMDAwICAgIDMuNjg0ICAgIDMuNjg0CmBgYAoKVGhlIG1lYW4gb2YgdGhlIGZhY3RvciBpcyA0LjU0Nywgd2hpY2gsIGluIHRoaXMgY2FzZSwgIGlzIHRoZSBtZWFuIG9mIGl0ZW0gYGBgU2l0MXJgYGAuIFRoYXQgaXMgYmVjYXVzZSB0aGUgZmFjdG9yIGxvYWRpbmcgb2YgdGhlIGl0ZW0gaXMgc2V0IHRvIDEuMC4gWW91IHdpbGwgYWxzbyBub3RpY2UgdGhhdCB0aGUgb3RoZXIgaXRlbSBpbnRlcmNlcHRzIGhhdmUgY2hhbmdlZCBmcm9tIHByZXZpb3VzIG1vZGVscy4gSW4gZ2VuZXJhbCwgYW4gaXRlbSdzIG1lYW4gaXMgZm91bmQgYnkgYWRkaW5nIHRoZSBpdGVtIGludGVyY2VwdCB0byB0aGUgcHJvZHVjdCBvZiB0aGUgZmFjdG9yIGxvYWRpbmcgdGltZXMgdGhlIGZhY3RvciBtZWFuLCBvciAkXG11X2kgKyBcbGFtYmRhX2lcbXVfRiQuCgojIyMgTW9kZWwgRml0IEluZm9ybWF0aW9uIGZvciBhIFNpbmdsZS1GYWN0b3IgTW9kZWwgKHNhbWUgcmVnYXJkbGVzcyBvZiBmYWN0b3Igc2NhbGluZyBtZXRob2QpOgoKQ2FsY3VsYXRpbmcgbW9kZWwgZGVncmVlcyBvZiBmcmVlZG9tICh2IGlzIG51bWJlciBvZiBvYnNlcnZlZCB2YXJpYWJsZXMgaW4gYSBtb2RlbCk6CgoqIFRvdGFsIGRmID0gJFxmcmFje3YodisxKX17Mn0gKyB2ID0gMjckCiogTnVtYmVyIG9mIHBhcmFtZXRlcnMgaW4gb3VyIG1vZGVsOiAxOAoqIERlZ3JlZXMgb2YgZnJlZWRvbSA9IDI3LTE4ID0gOQoKIyMjIyBMb2dsaWtlbGlob29kIOKAkyB1c2UgZm9yIHRlc3RpbmcgZGlmZmVyZW5jZXMgaW4gbW9kZWwgZml0IGFjcm9zcyBuZXN0ZWQgbW9kZWxzCgpgYGAKTG9nbGlrZWxpaG9vZCBhbmQgSW5mb3JtYXRpb24gQ3JpdGVyaWE6CgogIExvZ2xpa2VsaWhvb2QgdXNlciBtb2RlbCAoSDApICAgICAgICAgICAgIC0xMTUzNi40MDQgIC0xMTUzNi40MDQKICBTY2FsaW5nIGNvcnJlY3Rpb24gZmFjdG9yICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDEuNDE2CiAgICBmb3IgdGhlIE1MUiBjb3JyZWN0aW9uCiAgTG9nbGlrZWxpaG9vZCB1bnJlc3RyaWN0ZWQgbW9kZWwgKEgxKSAgICAgLTExMzIyLjQzNSAgLTExMzIyLjQzNQogIFNjYWxpbmcgY29ycmVjdGlvbiBmYWN0b3IgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMS40MDcKICAgIGZvciB0aGUgTUxSIGNvcnJlY3Rpb24KYGBgCgoqIExvZ2xpa2VsaWhvb2QgdXNlciBtb2RlbCAoSDApOiB0aGlzIGlzIGZvciB5b3VyIHNwZWNpZmllZCBtb2RlbAoqIFNjYWxpbmcgY29ycmVjdGlvbiBmYWN0b3IgZm9yIHRoZSBNTFIgY29ycmVjdGlvbjogaW5kaWNhdGVzIGhvdyBmYXIgb2ZmIGZyb20gbm9ybWFsPTEKKiBIMSBWYWx1ZTogdGhpcyBpcyBmb3IgYSBzYXR1cmF0ZWQgKHBlcmZlY3QpIG1vZGVsCgojIyMjIEluZm9ybWF0aW9uIENyaXRlcmlhICDigJxzbWFsbGVyIGlzIGJldHRlcuKAnSDigJMgdXNlIGZvciBuZXN0ZWQgb3Igbm9uLW5lc3RlZCBtb2RlbCBjb21wYXJpc29ucwoKYGBgCiAgTnVtYmVyIG9mIGZyZWUgcGFyYW1ldGVycyAgICAgICAgICAgICAgICAgICAgICAgICAxOCAgICAgICAgICAxOAogIEFrYWlrZSAoQUlDKSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAyMzEwOC44MDggICAyMzEwOC44MDgKICBCYXllc2lhbiAoQklDKSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMjMxOTguOTEyICAgMjMxOTguOTEyCiAgU2FtcGxlLXNpemUgYWRqdXN0ZWQgQmF5ZXNpYW4gKEJJQykgICAgICAgIDIzMTQxLjczOSAgIDIzMTQxLjczOQpgYGAKCiogaXMgIyBvZiBlc3RpbWF0ZWQgcGFyYW1ldGVycyAo4oCcZnJlZeKAnSB0byBiZSBub3QgMCkKKiBBSUMgPSAoLTIqJExMX3tIMH0kKSArICgyKmVzdGltYXRlZCBwYXJhbWV0ZXJzKQoqIEJJQyA9ICgtMiokTExfe0gwfSQpICsgKExOIE4qZXN0aW1hdGVkIHBhcmFtZXRlcnMpCiogU2FtcGxlLXNpemUgYWRqdXN0ZWQgQmF5ZXNpYW4gKEJJQykgPSBCSUMgcmVwbGFjaW5nIE4gd2l0aCAoTiArIDIpIC8gMjQKCiMjIyMgQ2hpLVNxdWFyZSBUZXN0IG9mIE1vZGVsIEZpdCAoU2lnbmlmaWNhbmNlIGlzIGJhZCBoZXJlKSBmb3IgeW91ciBzcGVjaWZpZWQgbW9kZWwKCmBgYAogIEVzdGltYXRvciAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgTUwgICAgICBSb2J1c3QKICBNaW5pbXVtIEZ1bmN0aW9uIFRlc3QgU3RhdGlzdGljICAgICAgICAgICAgICA0MjcuOTM3ICAgICAzMDcuODA0CiAgRGVncmVlcyBvZiBmcmVlZG9tICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgOSAgICAgICAgICAgOQogIFAtdmFsdWUgKENoaS1zcXVhcmUpICAgICAgICAgICAgICAgICAgICAgICAgICAgMC4wMDAgICAgICAgMC4wMDAKICBTY2FsaW5nIGNvcnJlY3Rpb24gZmFjdG9yICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDEuMzkwCiAgICBmb3IgdGhlIFl1YW4tQmVudGxlciBjb3JyZWN0aW9uIChNcGx1cyB2YXJpYW50KQpgYGAKCiogRXN0aW1hdG9yOiBMb29rIGF0IHJvYnVzdCBjb2x1bW4gZm9yIE1MUiB2ZXJzaW9uIG9mIHRlc3QKKiBNaW5pbXVtIEZ1bmN0aW9uIFRlc3QgU3RhdGlzdGljOiBsZWZ0b3ZlciBhZnRlciBlc3RpbWF0aW5nIG91ciBvbmUtZmFjdG9yIG1vZGVsCiogU2NhbGluZyBjb3JyZWN0aW9uIGZhY3RvciBmb3IgdGhlIFl1YW4tQmVudGxlciBjb3JyZWN0aW9uIChNcGx1cyB2YXJpYW50KTogaW5kaWNhdGVzIGhvdyBmYXIgb2ZmIGZyb20gbm9ybWFsPTEKCldoZXJlIGRvZXMgdGhpcyAkXGNoaV4yJCB2YWx1ZSBmb3Ig4oCcbW9kZWwgZml04oCdIGNvbWUgZnJvbT8gQSByZXNjYWxlZCDiiJIyTEwgbW9kZWwgY29tcGFyaXNvbiBvZiB0aGlzIG9uZS1mYWN0b3IgbW9kZWwgKEgwKSBhZ2FpbnN0IHRoZSBzYXR1cmF0ZWQgbW9kZWwgKEgxKSB0aGF0IHBlcmZlY3RseSByZXByb2R1Y2VzIHRoZSBkYXRhIGNvdmFyaWFuY2VzOgoKKiBTdGVwIDE6IE9yaWdpbmFsIOKIkjLOlExMID0g4oiSMiooTExmZXdlciDigJMgTExtb3JlKSA9IOKIkjIo4oiSMTEsNTM2LjQwNCArIDExLDMyMi40MzUpID0gNDI3LjkzOAoqIFN0ZXAgMjogU2NhbGluZyBjb3JyZWN0aW9uID0gWyAoI3Bhcm1zZmV3ZXIqc2NhbGVmZXdlcikg4oCTICgjcGFybXNtb3JlKnNjYWxlbW9yZSkgIF0gLyAoI3Bhcm1zZmV3ZXIg4oCTICNwYXJtc21vcmUpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgPSBbICgxOCAqIDEuNDE1OCkg4oCTICgyNyAqIDEuNDA3MykgXSAvICgxOCDigJMgMjcpID0gIOKIkjEyLjUwMSAvIOKIkjkgPSAxLjM5MDMKKiBTdGVwIDM6IFJlc2NhbGVkIOKIkjLOlExMID0g4oiSMs6UTEwgLyBzY2FsaW5nIGNvcnJlY3Rpb24gPSA0MjcuOTM4IC8gMS45MDMgPSAzMDcuODAzICAgfm1hdGNoZXMgbW9kZWwgJFxjaGleMiQKKiBTdGVwIDQ6IERpZmZlcmVuY2UgaW4gZGYgPSAjcGFybXNtb3JlIOKAkyAjcGFybXNmZXdlciA9IDI3IOKAkyAxOCA9IDkKCiMjIyMgV2hlcmUgdGhlIFNhdHVyYXRlZCAoSDEpIE1vZGVsIENvbWVzIEZyb206IEFsbCBNZWFucywgVmFyaWFuY2VzLCBhbmQgQ292YXJpYW5jZXMgRXN0aW1hdGVkCgpIb3cgdG8gZml0IHRoZSBzYXR1cmF0ZWQgKFVuc3RydWN0dXJlZCkgQmFzZWxpbmUgTW9kZWw6IEl0ZW0gbWVhbnMsIHZhcmlhbmNlcywgYW5kIGNvdmFyaWFuY2VzIGluIG9yaWdpbmFsIGRhdGE6CgpgYGB7ciwgbW9kZWxTYXQsIGluY2x1ZGU9VFJVRX0KbW9kZWxTYXR1cmF0ZWQgPSAiCiMgSXRlbSBpbnRlcmNlcHRzIC0tPiB+IDEgaW5kaWNhdGVzIG1lYW5zIG9yIGludGVyY2VwdHMKIyBZb3UgY2FuIHB1dCBtdWx0aXBsZSBsaW5lcyBvZiBzeW50YXggb24gYSBzaW5nbGUgbGluZSB1c2luZyBhIDsgClNpdDFyIH4gMTsgU2l0MiB+IDE7IFNpdDNyICB+IDE7IFNpdDQgfiAxOyBTaXQ1ciB+IDE7IFNpdDYgfiAxOwoKIyBJdGVtIHZhcmlhbmNlcyBhbmQgY292YXJpYW5jZXMgLS0+IHVzZSB0aGUgfn4gY29tbWFuZAoKIyBWYXJpYW5jZXM6ClNpdDFyIH5+IFNpdDFyOyBTaXQyIH5+IFNpdDI7IFNpdDNyIH5+IFNpdDNyOyBTaXQ0IH5+IFNpdDQ7IFNpdDVyIH5+IFNpdDVyOyBTaXQ2IH5+IFNpdDY7IAoKIyBDb3ZhcmlhbmNlczoKU2l0MXIgfn4gU2l0MjsgU2l0MXIgfn4gU2l0M3I7IFNpdDFyIH5+IFNpdDQ7IFNpdDFyIH5+IFNpdDVyOyBTaXQxciB+fiBTaXQ2OwpTaXQyIH5+IFNpdDNyOyBTaXQyIH5+IFNpdDQ7IFNpdDIgfn4gU2l0NXI7IFNpdDIgfn4gU2l0NjsKU2l0M3Igfn4gU2l0NDsgU2l0M3Igfn4gU2l0NXI7IFNpdDNyIH5+IFNpdDY7ClNpdDQgfn4gU2l0NXI7IFNpdDQgfn4gU2l0NjsKU2l0NXIgfn4gU2l0NjsKIgptb2RlbFNhdHVyYXRlZEVzdGltYXRlcyA9IHNlbShtb2RlbCA9IG1vZGVsU2F0dXJhdGVkLCBkYXRhID0gaGZzU2l0dWF0aW9ucywgZXN0aW1hdG9yID0gIk1MUiIsIG1pbWljID0gIm1wbHVzIikKc3VtbWFyeShtb2RlbFNhdHVyYXRlZEVzdGltYXRlcywgZml0Lm1lYXN1cmVzID0gVFJVRSkKYGBgCgpOb3RlIHRoYXQgSDAgYW5kIEgxIGFyZSBub3cgdGhlIHNhbWUhIE91ciBIMCBtb2RlbCBJUyB0aGUgSDEgc2F0dXJhdGVkIG1vZGVsOiB0aGUgbG9nLWxpa2VsaWhvb2Qgb2YgSDAgYW5kIEgxIGFyZSB0aGUgc2FtZS4gQWxzbywgbm90ZSB0aGVyZSBhcmUgMjcgZnJlZSBwYXJhbWV0ZXJzIChzaXggaXRlbSBtZWFucywgc2l4IGl0ZW0gdmFyaWFuY2VzLCBhbmQgMTUgY292YXJpYW5jZXMpLgoKYGBgCkxvZ2xpa2VsaWhvb2QgYW5kIEluZm9ybWF0aW9uIENyaXRlcmlhOgoKICBMb2dsaWtlbGlob29kIHVzZXIgbW9kZWwgKEgwKSAgICAgICAgICAgICAtMTEzMjIuNDM1ICAtMTEzMjIuNDM1CiAgTG9nbGlrZWxpaG9vZCB1bnJlc3RyaWN0ZWQgbW9kZWwgKEgxKSAgICAgLTExMzIyLjQzNSAgLTExMzIyLjQzNQoKICBOdW1iZXIgb2YgZnJlZSBwYXJhbWV0ZXJzICAgICAgICAgICAgICAgICAgICAgICAgIDI3ICAgICAgICAgIDI3CiAgQWthaWtlIChBSUMpICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDIyNjk4Ljg3MCAgIDIyNjk4Ljg3MAogIEJheWVzaWFuIChCSUMpICAgICAgICAgICAgICAgICAgICAgICAgICAgICAyMjgzNC4wMjcgICAyMjgzNC4wMjcKICBTYW1wbGUtc2l6ZSBhZGp1c3RlZCBCYXllc2lhbiAoQklDKSAgICAgICAgMjI3NDguMjY4ICAgMjI3NDguMjY4CmBgYAoKQWxzbyBub3RlIGhvdyB0aGUgbW9kZWwgJFxjaGleMiQgdGVzdCBoYXMgemVybyBkZWdyZWVzIG9mIGZyZWVkb206IHRoaXMgaXMgYmVjYXVzZSBhbGwgMjcgcG9zc2libGUgZnJlZSBwYXJhbWV0ZXJzIHdlcmUgZXN0aW1hdGVkLiBUaGlzIG1vZGVsIGZpdHMgdGhlIGRhdGEgcGVyZmVjdGx5LgoKYGBgCiAgRXN0aW1hdG9yICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBNTCAgICAgIFJvYnVzdAogIE1pbmltdW0gRnVuY3Rpb24gVGVzdCBTdGF0aXN0aWMgICAgICAgICAgICAgICAgMC4wMDAgICAgICAgMC4wMDAKICBEZWdyZWVzIG9mIGZyZWVkb20gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwICAgICAgICAgICAwCiAgTWluaW11bSBGdW5jdGlvbiBWYWx1ZSAgICAgICAgICAgICAgIDAuMDAwMDAwMDAwMDAwMAogIFNjYWxpbmcgY29ycmVjdGlvbiBmYWN0b3IgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgTkEKICAgIGZvciB0aGUgWXVhbi1CZW50bGVyIGNvcnJlY3Rpb24gKE1wbHVzIHZhcmlhbnQpCmBgYAoKIyMjIyBUaGUgUmVzdCBvZiB0aGUgT25lLUZhY3RvciBNb2RlbCBGaXQgU3RhdGlzdGljcwoKYGBgClVzZXIgbW9kZWwgdmVyc3VzIGJhc2VsaW5lIG1vZGVsOgoKICBDb21wYXJhdGl2ZSBGaXQgSW5kZXggKENGSSkgICAgICAgICAgICAgICAgICAgIDAuNzg3ICAgICAgIDAuNzMyCiAgVHVja2VyLUxld2lzIEluZGV4IChUTEkpICAgICAgICAgICAgICAgICAgICAgICAwLjY0NSAgICAgICAwLjU1MwoKICBSb2J1c3QgQ29tcGFyYXRpdmUgRml0IEluZGV4IChDRkkpICAgICAgICAgICAgICAgICAgICAgICAgIDAuNzg3CiAgUm9idXN0IFR1Y2tlci1MZXdpcyBJbmRleCAoVExJKSAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjY0NgogIApSb290IE1lYW4gU3F1YXJlIEVycm9yIG9mIEFwcHJveGltYXRpb246CgogIFJNU0VBICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMC4yMDUgICAgICAgMC4xNzMKICA5MCBQZXJjZW50IENvbmZpZGVuY2UgSW50ZXJ2YWwgICAgICAgICAgMC4xODkgIDAuMjIyICAgICAgIDAuMTYwICAwLjE4OAogIFAtdmFsdWUgUk1TRUEgPD0gMC4wNSAgICAgICAgICAgICAgICAgICAgICAgICAgMC4wMDAgICAgICAgMC4wMDAKCiAgUm9idXN0IFJNU0VBICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjIwNQogIDkwIFBlcmNlbnQgQ29uZmlkZW5jZSBJbnRlcnZhbCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMC4xODUgIDAuMjI0CgpTdGFuZGFyZGl6ZWQgUm9vdCBNZWFuIFNxdWFyZSBSZXNpZHVhbDoKCiAgU1JNUiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjA4NiAgICAgICAwLjA4NgpgYGAKCgoqIENGSS9UTEk6IFdhbnQgY2xvc2UgdG8gb25lICgxID0gc2F0dXJhdGVkIG1vZGVsKQoqIFJNU0VBOiBXYW50IGNsb3NlIHRvIHplcm8gKDAgPSBzYXR1cmF0ZWQgbW9kZWwpCiogU1JNUiAoU3RhbmRhcmRpemVkIFJvb3QgTWVhbiBTcXVhcmUgUmVzaWR1YWwpOiB3YW50IGNsb3NlIHRvIHplcm8gKDAgPSBzYXR1cmF0ZWQgbW9kZWwpCgojIyMjIENoaS1TcXVhcmUgVGVzdCBvZiBNb2RlbCBGaXQgZm9yIHRoZSBCYXNlbGluZSBNb2RlbCAoZm9yIHRoZSDigJxubyBjb3ZhcmlhbmNlc+KAnSBtb2RlbCkKClRoaXMgY29tcGFyZXMgdGhlIGVzdGltYXRlZCBtb2RlbCB0byB0aGUgb25lIHRoYXQgaGFzIG5vIGNvdmFyaWFuY2VzLiBJdCBpcyBhIGxhc3QtcmVzb3J0IHR5cGUgbW9kZWwgaW4gdGhhdCBpZiB0aGUgZXN0aW1hdGVkIG1vZGVsIGhhcyBhIHRlc3Qgd2l0aCBhIG5vbi1zaWduaWZpY2FudCBwLXZhbHVlLCB0aGVuIHRoaXMgaW5kaWNhdGVzIHRoZXJlIHdpbGwgYmUgbm8gZmFjdG9ycyB0byBiZSBmb3VuZCBpbiB0aGUgZGF0YS4KCmBgYApNb2RlbCB0ZXN0IGJhc2VsaW5lIG1vZGVsOgoKICBNaW5pbXVtIEZ1bmN0aW9uIFRlc3QgU3RhdGlzdGljICAgICAgICAgICAgIDE5ODEuMDM0ICAgIDExMjguNjkzCiAgRGVncmVlcyBvZiBmcmVlZG9tICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAxNSAgICAgICAgICAxNQogIFAtdmFsdWUgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMC4wMDAgICAgICAgMC4wMDAKYGBgCgpXaGVyZSBkb2VzIHRoaXMgz4cyIHZhbHVlIGZvciDigJxmaXQgb2YgdGhlIGJhc2VsaW5lIG1vZGVs4oCdIGNvbWUgZnJvbT8gQSByZXNjYWxlZCDiiJIyTEwgbW9kZWwgY29tcGFyaXNvbiBvZiB0aGUgaW5kZXBlbmRlbmNlIG1vZGVsIHdpdGggTk8gY292YXJpYW5jZXMgdG8gdGhlIHNhdHVyYXRlZCBtb2RlbDoKCiogU3RlcCAxOiBPcmlnaW5hbCDiiJIyzpRMTCA9IOKIkjIqKExMZmV3ZXIg4oCTIExMbW9yZSkgPSDiiJIyKOKIkjEyLDMxMi45NTIgKyAxMSwzMjIuNDM1KSA9IDEsOTgxLjAzNAoqIFN0ZXAgMjogU2NhbGluZyBjb3JyZWN0aW9uID0gWyAoI3Bhcm1zZmV3ZXIqc2NhbGVmZXdlcikg4oCTICgjcGFybXNtb3JlKnNjYWxlbW9yZSkgIF0gLyAoI3Bhcm1zZmV3ZXIg4oCTICNwYXJtc21vcmUpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgID0gWyAoMTIgKiAwLjk3MjUpIOKAkyAoMjcgKiAxLjQwNzMpIF0gLyAoMTIg4oCTIDI3KSA9ICDigJMyNi4zNzIgLyDiiJIxNSA9IDEuNzU1MQoKKiBTdGVwIDM6IFJlc2NhbGVkIOKIkjLOlExMID0g4oiSMs6UTEwgLyBzY2FsaW5nIGNvcnJlY3Rpb24gPSAxLDk4MS4wMzQgLyAxLjc1NTEgPSAxLDEyOC43MDQgICB+bWF0Y2hlcyBiYXNlbGluZSAkXGNoaV4yJCAKKiBTdGVwIDQ6IERpZmZlcmVuY2UgaW4gZGYgPSAjcGFybXNtb3JlIOKAkyAjcGFybXNmZXdlciA9IDI3IOKAkyAxMiA9IDE1CgpXaGF04oCZcyB0aGUgcG9pbnQ/IFRoaXMgYmFzZWxpbmUgbW9kZWwgZml0IHRlc3QgdGVsbHMgdXMgd2hldGhlciB0aGVyZSBhcmUgYW55IGNvdmFyaWFuY2VzIGF0IGFsbCAoaS5lLiwgd2hldGhlciBpdCBldmVuIG1ha2VzIHNlbnNlIHRvIHRyeSB0byBmaXQgbGF0ZW50IGZhY3RvcnMgdG8gcHJlZGljdCB0aGVtKS4KCiMjIyMgSG93IHRvIGZpdCB0aGUgSW5kZXBlbmRlbmNlIChOdWxsKSBCYXNlbGluZSBNb2RlbDogSXRlbSBtZWFucyBhbmQgdmFyaWFuY2VzLCBidXQgTk8gY292YXJpYW5jZXMKCgpgYGB7ciwgbW9kZWxJbmQsIGluY2x1ZGU9VFJVRX0KbW9kZWxJbmRlcGVuZGVuY2UgPSAiCiMgSXRlbSBpbnRlcmNlcHRzIC0tPiB+IDEgaW5kaWNhdGVzIG1lYW5zIG9yIGludGVyY2VwdHMKIyBZb3UgY2FuIHB1dCBtdWx0aXBsZSBsaW5lcyBvZiBzeW50YXggb24gYSBzaW5nbGUgbGluZSB1c2luZyBhIDsgClNpdDFyIH4gMTsgU2l0MiB+IDE7IFNpdDNyICB+IDE7IFNpdDQgfiAxOyBTaXQ1ciB+IDE7IFNpdDYgfiAxOwoKIyBJdGVtIHZhcmlhbmNlcyBhbmQgY292YXJpYW5jZXMgLS0+IHVzZSB0aGUgfn4gY29tbWFuZAoKIyBWYXJpYW5jZXM6ClNpdDFyIH5+IFNpdDFyOyBTaXQyIH5+IFNpdDI7IFNpdDNyIH5+IFNpdDNyOyBTaXQ0IH5+IFNpdDQ7IFNpdDVyIH5+IFNpdDVyOyBTaXQ2IH5+IFNpdDY7IAoKIgptb2RlbEluZGVwZW5kZW5jZUVzdGltYXRlcyA9IHNlbShtb2RlbCA9IG1vZGVsSW5kZXBlbmRlbmNlLCBkYXRhID0gaGZzU2l0dWF0aW9ucywgZXN0aW1hdG9yID0gIk1MUiIsIG1pbWljID0gIm1wbHVzIikKc3VtbWFyeShtb2RlbEluZGVwZW5kZW5jZUVzdGltYXRlcywgZml0Lm1lYXN1cmVzID0gVFJVRSkKYGBgCgpOb3RlIGhvdyB0aGUgdGVzdCBvZiB0aGUgbW9kZWwgdnMuIHNhdHVyYXRlZCBpcyBpZGVudGljYWwgdG8gdGhlIHRlc3Qgb2YgdGhlIG1vZGVsIHZzLiBiYXNlbGluZTogdGhhdCBpbmRpY2F0ZXMgdGhpcyBtb2RlbCBpcyB0aGUgYmFzZWxpbmUgbW9kZWwuCgpBbHRob3VnaCBub3QgMCwgdGhpcyBpcyB0aGUgd29yc3QgcG9zc2libGUgUk1TRUEgd2hpbGUgc3RpbGwgYWxsb3dpbmcgc2VwYXJhdGUgbWVhbnMgYW5kIHZhcmlhbmNlcyBwZXIgaXRlbSBpbiB0aGVzZSBkYXRhLiBSTVNFQSBpcyBhIHBhcnNpbW9ueS1jb3JyZWN0ZWQgYWJzb2x1dGUgZml0IGluZGV4IChzbywgaXRzIGZpdCBpcyByZWxhdGl2ZSB0byB0aGUgc2F0dXJhdGVkIG1vZGVsKS4gCgpDRkkgYW5kIFRMSSBhcmUgMCBiZWNhdXNlIHRoZXkgYXJlIOKAnGluY3JlbWVudGFsIGZpdOKAnSBpbmRpY2VzIHJlbGF0aXZlIHRvIHRoZSBpbmRlcGVuZGVuY2UgbW9kZWwgKHdoaWNoIHRoaXMgaXMpLgoKU1JNUiBpcyBhbHNvIGFuIGFic29sdXRlIGZpdCBpbmRleCAocmVsYXRpdmUgdG8gc2F0dXJhdGVkIG1vZGVsKSwgc28gdGhpcyBpcyB0aGUgd29yc3QgaXQgZ2V0cyBmb3IgdGhlc2UgZGF0YSwgdG9vLgoKIyMjIFBvb3IgTW9kZWwgRml0OiBOZWVkIGZvciBNb2RlbCBNb2RpZmljYXRpb25zCgpGb3IgdGhpcyBzZWN0aW9uLCBhbnkgb2YgdGhlIHRocmVlIGVxdWl2YWxlbnQgc2luZ2xlIGZhY3RvciBtb2RlbHMgY2FuIGJlIHVzZWQuIAoKIyMjIyBNb2RpZmljYXRpb24gSW5kaWNlcwoKU28gZ2xvYmFsIGZpdCBmb3IgdGhlIG9uZS1mYWN0b3IgbW9kZWwgaXMgbm90IHNvIGdvb2QgKFJNU0VBID0gLjE3MywgQ0ZJID0gLjczMikuIFdoYXQgZG8gdGhlIHZvby1kb28gbW9kaWZpY2F0aW9uIGluZGljZXMgc3VnZ2VzdCB3ZSBkbyB0byBmaXggaXQ/IFRvIGdldCBtb2RpZmljYXRpb24gaW5kaWNlcywgdXNlIHRoZSBgYGBtb2RpZmljYXRpb25pbmRpY2VzKClgYGAgZnVuY3Rpb24uIEhlcmUsIHRoZSBmdW5jdGlvbiBpcyBjYWxsZWQgd2l0aCBvcHRpb25zOgoKKiBgYGBvYmplY3QgPSBtb2RlbDAxRXN0aW1hdGVzYGBgOiBUaGUgbW9kZWwgZXN0aW1hdGVzIG9iamVjdCBmcm9tIHdoaWNoIHRvIGRlcml2ZSBtb2RpZmljYXRpb24gaW5kaWNlcy4KKiBgYGBzb3J0LiA9IFRSVUVgYGA6IFNvcnQgdGhlIG91dHB1dCBmcm9tIGhpZ2hlc3QgdG8gbG93ZXN0IG1vZGlmaWNhdGlvbiBpbmRleC4KCmBgYHtyIG1vZGluZGljZXMsIGluY2x1ZGU9VFJVRX0KbW9kaWZpY2F0aW9uaW5kaWNlcyhvYmplY3QgPSBtb2RlbDAxRXN0aW1hdGVzLCBzb3J0LiA9IFRSVUUpCmBgYAoKVGhlIG91dHB1dCBpbmNsdWRlczoKCiogYGBgbGhzYGBgOiBMZWZ0IGhhbmQgc2lkZSBmb3IgcGFyYW1ldGVyIChpbiBgYGBsYXZhYW5gYGAgc3ludGF4KQoqIGBgYG9wYGBgOiBPcGVyYXRpb24gb2YgcGFyYW1ldGVyOiBgYGB+fmBgYCBpcyBmb3IgKHJlc2lkdWFsKSBjb3ZhcmlhbmNlczsgYGBgPX5gYGAgaXMgZm9yIGFkZGl0aW9uYWwgZmFjdG9yIGxvYWRpbmdzLiBBbGwgb3RoZXIgYGBgbGF2YWFuYGBgIHN5bnRheCB0eXBlcyBhcmUgcG9zc2libGUsIHRvbywgYnV0IGhlcmUgaXRlbSBtZWFucyBhbmQgdmFyaWFuY2VzIGZpdCBwZXJmZWN0bHkgKHNlZSBiZWxvdykKKiBgYGByaHNgYGA6IFJpZ2h0IGhhbmQgc2lkZSBmb3IgcGFyYW1ldGVyIChpbiBgYGBsYXZhYW5gYGAgc3ludGF4KQoqIGBgYG1pYGBgOiBNb2RpZmljYXRpb24gaW5kZXggdXNpbmcgTUwgCiogYGBgbWkuc2NhbGVkYGBgOiBNb2RpZmljYXRpb24gaW5kZXggdXNpbmcgTUxSICh1c2UgdGhpcyBvbmUpCiogYGBgZXBjYGBgOiBFeHBlY3RlZCBwYXJhbWV0ZXIgY2hhbmdlIChmcm9tIHplcm8pCiogYGBgc2VwYy5sdmBgYDogU3RhbmRhcmRpemVkIGV4cGVjdGVkIHBhcmFtZXRlciBjaGFuZ2UgdXNpbmcgYGBgc3RkLmx2YGBgIHN0YW5kYXJkaXphdGlvbgoqIGBgYHNlcGMuYWxsYGBgOiBTdGFuZGFyZGl6ZWQgZXhwZWN0ZWQgcGFyYW1ldGVyIGNoYW5nZSB1c2luZyBgYGBzdGQuYWxsYGBgIHN0YW5kYXJkaXphdGlvbgoqIGBgYHNlcGMubm94YGBgOiBTdGFuZGFyZGl6ZWQgZXhwZWN0ZWQgcGFyYW1ldGVyIGNoYW5nZSB1c2luZyBgYGBzdGQubm94YGBgIHN0YW5kYXJkaXphdGlvbgoKSGlnaGVzdCB2YWx1ZXMgYXJlIGZvciBlcnJvciBjb3ZhcmlhbmNlcyAoZm9yIHVua25vd24gbXVsdGlkaW1lbnNpb25hbGl0eSkuCgojIyMjIEFub3RoZXIgYXBwcm9hY2g6IFJlc2lkdWFsIENvdmFyaWFuY2UgTWF0cmljZXMKCkFub3RoZXIgYXBwcm9hY2jigJRob3cgYWJvdXQgd2UgZXhhbWluZSBsb2NhbCBmaXQgYW5kIHNlZSB3aGVyZSB0aGUgcHJvYmxlbXMgc2VlbSB0byBiZT8gCgpUaGUgbWVhbnMgYW5kIHZhcmlhbmNlcyBvZiB0aGUgaXRlbXMgd2lsbCBiZSBwZXJmZWN0bHkgcmVwcm9kdWNlZCwgc28gdGhhdOKAmXMgbm90IGFuIGlzc3VlLiBNaXNmaXQgcmVzdWx0cyBmcm9tIHRoZSBkaWZmZXJlbmNlIGJldHdlZW4gdGhlIG9ic2VydmVkIGFuZCBtb2RlbC1wcmVkaWN0ZWQgY292YXJpYW5jZXMuCgpgYGBsYXZhYW5gYGAgZ2l2ZXMgdXMgdGhlICJyZXNpZHVhbCIgKGRlZmluZWQgYXMgb2JzZXJ2ZWQg4oCTIHByZWRpY3RlZCkgb3IgImxlZnRvdmVyIiBjb3ZhcmlhbmNlIG1hdHJpeCwgYnV0IGl0IGlzIHNjYWxlIGRlcGVuZGVudCBhbmQgdGh1cyBub3Qgc28gaGVscGZ1bC4gV2UgY2FuIHVzZSB0aGUgYGBgcmVzaWQoKWBgYCBmdW5jdGlvbiB0byBvYnRhaW4gdGhlIHJlc2lkdWFsIGNvdmFyaWFuY2UgbWF0cml4IChvYnNlcnZlZCBjb3ZhcmlhbmNlcyBtaW51cyBtb2RlbC1pbXBsaWVkIGNvdmFyaWFuY2VzKToKCmBgYHtyIHJlc2lkLCBpbmNsdWRlPVRSVUV9CnJlc2lkKG9iamVjdCA9IG1vZGVsMDFFc3RpbWF0ZXMsIHR5cGUgPSAicmF3IikKYGBgCmBgYGxhdmFhbmBgYCBhbHNvIGdpdmVzIHVzICJub3JtYWxpemVkIiByZXNpZHVhbHMsIHdoaWNoIGNhbiBiZSB0aG91Z2h0IG9mIGFzIHotc2NvcmVzIGZvciBob3cgbGFyZ2UgdGhlIHJlc2lkdWFsIGxlZnRvdmVyIGNvdmFyaWFuY2UgaXMgaW4gYWJzb2x1dGUgdGVybXMuIEJlY2F1c2UgdGhlIGRlbm9taW5hdG9yIGRlY3JlYXNlcyB3aXRoIHNhbXBsZSBzaXplLCBob3dldmVyLCB0aGVzZSB2YWx1ZXMgbWF5IGJlIGluZmxhdGVkIGluIGxhcmdlIHNhbXBsZXMsIHNvIGxvb2sgZm9yIHJlbGF0aXZlbHkgbGFyZ2UgdmFsdWVzLgoKIk5vcm1hbGl6ZWQiIFJlc2lkdWFscyBmb3IgSW50ZXItSXRlbSBDb3ZhcmlhbmNlcyA9IChvYnNlcnZlZCDigJMgcHJlZGljdGVkKSAvIFNEKG9ic2VydmVkKToKCmBgYHtyIHJlc2lkTiwgaW5jbHVkZT1UUlVFfQpyZXNpZChvYmplY3QgPSBtb2RlbDAxRXN0aW1hdGVzLCB0eXBlID0gIm5vcm1hbGl6ZWQiKQpgYGAKTkVHQVRJVkUgTk9STUFMSVpFRCBSRVNJRFVBTDogTGVzcyByZWxhdGVkIHRoYW4geW91IHByZWRpY3RlZCAoZG9u4oCZdCB3YW50IHRvIGJlIHRvZ2V0aGVyKQpQT1NJVElWRSBOT1JNQUxJWkVEIFJFU0lEVUFMOiBNb3JlIHJlbGF0ZWQgdGhhbiB5b3UgcHJlZGljdGVkICh3YW50IHRvIGJlIG1vcmUgdG9nZXRoZXIpCgpXaHkgbWlnaHQgdGhlIG5vcm1hbGl6ZWQgcmVzaWR1YWxzIChsZWZ0b3ZlciBjb3JyZWxhdGlvbnMpIGZvciB0aGUgcG9zaXRpdmUtd29yZGVkIGl0ZW1zIGJlIGxhcmdlciB0aGFuIGZvciB0aGUgbmVnYXRpdmVseS13b3JkZWQgaXRlbXM/IAoKVGhlc2UgcmVzdWx0cyBzdWdnZXN0IHRoYXQgd29yZGluZyB2YWxlbmNlIGlzIHBsYXlpbmcgYSBsYXJnZXIgcm9sZSBpbiB0aGUgcGF0dGVybiBvZiBjb3ZhcmlhbmNlIGFjcm9zcyBpdGVtcyB0aGFuIHdoYXQgdGhlIG9uZS1mYWN0b3IgbW9kZWwgcHJlZGljdHMuIFJhdGhlciB0aGFuIGFkZGluZyB2b28tZG9vIGNvdmFyaWFuY2VzIGFtb25nIHRoZSByZXNpZHVhbHMgZm9yIHNwZWNpZmljIGl0ZW1zLCBob3cgYWJvdXQgYSB0d28tZmFjdG9yIG1vZGVsIGJhc2VkIG9uIHdvcmRpbmcgaW5zdGVhZD8KCiMjIyBNb2RlbCA0LiBGdWxseSBaLVNjb3JlZCwgMi1GYWN0b3IgTW9kZWwKCkhlcmUsIHdlIHVzZSB0aGUgc2hvcnRlbmVkIHN5bnRheCBhbmQgdGhlIGBgYHNlbSgpYGBgIGZ1bmN0aW9uIHRvIGdldCByZXN1bHRzLgoKYGBge3IgbW9kZWwwNCwgaW5jbHVkZT1UUlVFfQptb2RlbDA0U3ludGF4ID0gIgoKIyBTaXRQIGxvYWRpbmdzIChhbGwgZXN0aW1hdGVkKQpTaXRQID1+IFNpdDIgKyBTaXQ0ICsgU2l0NgoKIyBTaXROIGxvYWRpbmdzIChhbGwgZXN0aW1hdGVkKQpTaXROID1+IFNpdDFyICsgU2l0M3IgKyBTaXQ1cgoKIgoKbW9kZWwwNEVzdGltYXRlcyA9IHNlbShtb2RlbCA9IG1vZGVsMDRTeW50YXgsIGRhdGEgPSBoZnNTaXR1YXRpb25zLCBlc3RpbWF0b3IgPSAiTUxSIiwgbWltaWMgPSAibXBsdXMiLCBzdGQubHYgPSBUUlVFKQpzdW1tYXJ5KG1vZGVsMDRFc3RpbWF0ZXMsIGZpdC5tZWFzdXJlcyA9IFRSVUUsIHJzcXVhcmUgPSBUUlVFLCBzdGFuZGFyZGl6ZWQgPSBUUlVFKQpgYGAKClRoaXMgbW9kZWwgZml0cyBiZXR0ZXIgKHdlIHdvdWxkIGNhbGwgdGhpcyBnb29kIGZpdCkuIFdlIGNhbiBhbHNvIGNvbXBhcmUgdGhlIGZpdCBvZiB0aGlzIG1vZGVsIHdpdGggTW9kZWwgMSB1c2luZyB0aGUgYGBgYW5vdmEoKWBgYCBmdW5jdGlvbi4gSGVyZSwgdGhlIG51bGwgaHlwb3RoZXNpcyBpcyB0aGF0IE1vZGVsIDEgZml0cyBhcyB3ZWxsIGFzIE1vZGVsIDQuCgpgYGB7ciBtb2RlbENvbXAsIGluY2x1ZGU9VFJVRX0KYW5vdmEobW9kZWwwMUVzdGltYXRlcywgbW9kZWwwNEVzdGltYXRlcykKYGBgCgpUaGlzIGZ1bmN0aW9uIGNvbmR1Y3RzIHRoZSBNTFIgdmVyc2lvbiBvZiB0aGUgbGlrZWxpaG9vZCByYXRpbyB0ZXN0IGZvciB1cy4gVGhlIHNpZ25pZmljYW50IGRpZmZlcmVuY2UgaW5kaWNhdGVzIHRoYXQgTW9kZWwgNCBmaXRzIGJldHRlciB0aGFuIE1vZGVsIDEuIAoKTGV04oCZcyBzZWU6IEFueSBtb3JlIGxvY2FsIGZpdCBwcm9ibGVtcz8gVGhlIG1vZGlmaWNhdGlvbiBpbmRpY2VzIGFyZSBiZXR0ZXIgKHZhbHVlcyBvZiBhIGxpdHRsZSBvdmVyIDEwIHNlZW0gb2theSkuCgpgYGB7ciBwb3N0Rml0LCBpbmNsdWRlPVRSVUV9Cm1vZGlmaWNhdGlvbmluZGljZXMob2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcywgc29ydC4gPSBUUlVFKQoKYGBgCgpUaGUgbm9ybWFsaXplZCByZXNpZHVhbHMgaGF2ZSB0d28gdmFsdWVzIHRoYXQgYXJlIGJpZ2dlciBpbiBhYnNvbHV0ZSB2YWx1ZSB0aGFuIDI6CgpgYGB7ciBwb3N0Rml0MiwgaW5jbHVkZT1UUlVFfQpyZXNpZChvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCB0eXBlID0gIm5vcm1hbGl6ZWQiKQpgYGAKQmVjYXVzZSB3ZSBoYXZlIG5vIHJlYWwgdGhlb3JldGljYWwgb3IgZGVmZW5kYWJsZSByZWFzb24gdG8gZml0IGFueSBvZiB0aGVzZSBzdWdnZXN0ZWQgcGFyYW1ldGVycywgd2Ugd2lsbCBub3QgYWRkIGFueSBuZXcgcGFyYW1ldGVycy4gVGhpcyB3aWxsIGJlIGFib3V0IGFzIGdvb2QgYXMgaXQgZ2V0cy4gCgojIyMgQ2FsY3VsYXRpbmcgUmVsaWFiaWxpdGllcwoKQXMgd2UgaGF2ZSBkZW1vbnN0cmF0ZWQgZ29vZCBtb2RlbCBmaXQsIGVzdGltYXRlcyBvZiB0cmFpdCByZWxpYWJpbGl0aWVzIGNhbiBub3cgYmUgZm91bmQuIEFsdGhvdWdoIEkgZG8gbm90IGRpc3BlbnNlIHN1Y2ggYWR2aWNlLCBtYW55IHBlb3BsZSB1c2UgYSBDRkEgdG8gaW5kaWNhdGUgbW9kZWwgZml0IHRoZW4gcHJvY2VlZCB0byB1c2Ugc3VtIHNjb3JlcyBmb3IgZWFjaCB0cmFpdCBpbiBhIG1vZGVsLiBJIGRvIG5vdCBsaWtlIHRoaXMgYmVjYXVzZSBzdW0gc2NvcmVzIGFyZSBwZXJmZWN0bHkgY29ycmVsYXRlZCB3aXRoIHRoZSBmYWN0b3Igc2NvcmVzIGZyb20gdGhlIHBhcmFsbGVsIGl0ZW1zIG1vZGVsIC0tIGJ1dCB3ZSBuZXZlciB0ZXN0ZWQgdGhhdCBtb2RlbCAoc2hvdWxkIGl0IG5vdCBmaXQgd2UgbWF5IGdldCBhIHJldmVyc2FsIGluIHRoZSByYW5rIG9yZGVyaW5nIG9mIHBlb3BsZSBieSBzY29yZSkuCgojIyMjIFJlbGlhYmlsaXRpZXMgZm9yIFN1bSBTY29yZXMgKE9tZWdhKQoKVGhhdCBzYWlkLCByZWxpYWJpbGl0aWVzIGZvciBzdW0gc2NvcmVzIGNhbiBiZSBmb3VuZCBieSB1c2luZyBDRkEgbW9kZWwgcGFyYW1ldGVycy4gVGhpcyByZWxpYWJpbGl0eSBjb2VmZmljaWVudCBpcyBjYWxsZWQgIk9tZWdhIiBieSBSb2QgTWNEb25hbGQgYW5kIGlzIGNhbGN1bGF0ZWQ6CgokJCBccmhvX1xvbWVnYSA9IFxmcmFje1xzaWdtYV4yX0ZcbGVmdCggXHN1bV97aT0xfV57SXRlbXN9IFxsYW1iZGFfaSBccmlnaHQpXjJ9e1xzaWdtYV4yX0ZcbGVmdCggXHN1bV97aT0xfV57SXRlbXN9IFxsYW1iZGFfaSBccmlnaHQpXjIgXHN1bV97aT0xfV57SXRlbXN9IFxzdW1fe2o9MX1ee0l0ZW1zfSBccHNpX3tpan19JCQKCkluIHdvcmRzLCBPbWVnYSA9IFZhcihGYWN0b3IpKiAoU3VtIG9mIGxvYWRpbmdzKV4yIC8gWyBWYXIoRmFjdG9yKSogKFN1bSBvZiBsb2FkaW5ncyleMiArIFN1bSBvZiBlcnJvciB2YXJpYW5jZXMgKyAyKiBTdW0gb2YgZXJyb3IgY292YXJpYW5jZXNdCgpGb3Igb3VyIGRhdGE6IAoKKiBPbWVnYSBmb3IgUG9zaXRpdmUgRmFjdG9yID0gLjc0NCAgIAogICAoMS4wMDcrMS4wNjQrMC45NTYpMiAvCiAgICgxLjAwNysxLjA2NCswLjk1NikyICsKICAgKDAuODg4KzAuODM1KzEuNDI4KSArIDIqMCAKCiAgIChhbHBoYSB3YXMgLjc0NikKCiogT21lZ2EgZm9yIE5lZ2F0aXZlIEZhY3RvciA9IC43NzUKICAgKDEuMzI1KzEuMzQ5KzEuMDA5KTIgLwogICAoMS4zMjUrMS4zNDkrMS4wMDkpMiArCiAgICgxLjI5NCswLjcyNCsxLjkyNikgKyAyKjAgCgogICAoYWxwaGEgd2FzIC43ODApCgojIyMjIENhbGN1bGF0aW5nIE9tZWdhIGZyb20gYGBgbGF2YWFuYGBgCgpUaHJvdWdoIHRoZSB1c2Ugb2YgcGFyYW1ldGVyIGxhYmVscyBhbmQgbmV3IHBhcmFtZXRlcnMsIHlvdSBjYW4gdXNlIGBgYGxhdmFhbmBgYCB0byBjYWxjdWxhdGUgT21lZ2EuIEluIHRoaXMgc3ludGF4LCB0aGUgdGVybXMgYmVmb3JlIHRoZSBpdGVtcyBhcmUgbGFiZWxzIHJlcHJlc2VudGluZyB0aGUgZmFjdG9yIGxvYWRpbmdzIGFuZCB1bmlxdWUgdmFyaWFuY2VzLiBUaGV5IGNhbiBiZSB1c2VkIGxhdGVyIGluIHRoZSBzeW50YXggdG8gZm9ybSBuZXcgcGFyYW1ldGVycyBvciB0byBwdXQgY29uc3RyYWludHMgb24gdGhlIG1vZGVsLgoKYGBge3IgbW9kZWwwNE9tZWdhLCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDRTeW50YXhPbWVnYSA9ICIKCiMgU2l0UCBsb2FkaW5ncyAoYWxsIGVzdGltYXRlZCkKU2l0UCA9fiBMMipTaXQyICsgTDQqU2l0NCArIEw2KlNpdDYKCiMgU2l0TiBsb2FkaW5ncyAoYWxsIGVzdGltYXRlZCkKU2l0TiA9fiBMMSpTaXQxciArIEwzKlNpdDNyICsgTDUqU2l0NXIKCiMgVW5pcXVlIFZhcmlhbmNlczoKU2l0MXIgfn4gRTEqU2l0MXI7IFNpdDIgfn4gRTIqU2l0MjsgU2l0M3Igfn4gRTMqU2l0M3I7IFNpdDQgfn4gRTQqU2l0NDsgU2l0NXIgfn4gRTUqU2l0NXI7IFNpdDYgfn4gRTYqU2l0NjsgCgoKIyBDYWxjdWxhdGUgT21lZ2EgUmVsaWFiaWxpdHkgZm9yIFN1bSBTY29yZXM6Ck9tZWdhUCA6PSAoKEwyICsgTDQgKyBMNileMikgLyAoICgoTDIgKyBMNCArIEw2KV4yKSArIEUyICsgRTQgKyBFNikKT21lZ2FOIDo9ICgoTDEgKyBMMyArIEw1KV4yKSAvICggKChMMSArIEwzICsgTDUpXjIpICsgRTEgKyBFMyArIEU1KQoiCgptb2RlbDA0RXN0aW1hdGVzT21lZ2EgPSBzZW0obW9kZWwgPSBtb2RlbDA0U3ludGF4T21lZ2EsIGRhdGEgPSBoZnNTaXR1YXRpb25zLCBlc3RpbWF0b3IgPSAiTUxSIiwgbWltaWMgPSAibXBsdXMiLCBzdGQubHYgPSBUUlVFKQpzdW1tYXJ5KG1vZGVsMDRFc3RpbWF0ZXNPbWVnYSwgZml0Lm1lYXN1cmVzID0gRkFMU0UsIHJzcXVhcmUgPSBGQUxTRSwgc3RhbmRhcmRpemVkID0gRkFMU0UsIGhlYWRlciA9IEZBTFNFKQpgYGAKCkNhbGN1bGF0aW5nIE9tZWdhIHRocm91Z2ggYGBgbGF2YWFuYGAgYWxzbyBwcm92aWRlcyBpdHMgc3RhbmRhcmQgZXJyb3IuIE5vdGU6IHRoZSBPbWVnYSBlcXVhdGlvbiB1c2VkIGFib3ZlIGlzIGZvciB0aGUgWi1zY29yZSBmYWN0b3IgaWRlbnRpZmljYXRpb24gbWV0aG9kLiBJZiB0aGUgbWFya2VyLWl0ZW0gbWV0aG9kIGlzIHVzZWQgZm9yIGZhY3RvciBsb2FkaW5ncywgdGhlbiBtdWx0aXBseSB0aGUgc3VtIG9mIHRoZSBsb2FkaW5ncyBieSB0aGUgdmFyaWFuY2Ugb2YgdGhlIGZhY3RvciwgYXMgc2hvd24gaW4gdGhlIGVxdWF0aW9uIGFib3ZlLgoKCk9mIG5vdGUgYWJvdXQgT21lZ2E6IElmIHdlIGNvbnN0cmFpbiBhbGwgZmFjdG9yIGxvYWRpbmdzIG9mIGEgdHJhaXQgdG8gYmUgZXF1YWwgKGNhbGxlZCBUYXUtRXF1aXZhbGVudCksIE9tZWdhIGlzIGVxdWFsIHRvIEFscGhhLiBJbiB0aGUgc3ludGF4IGJlbG93LCBwdXR0aW5nIHRoZSBsYWJlbHMgTFAgYW5kIExOIGluIG11bHRpcGxlIHBsYWNlcyBjYXVzZXMgdGhlIGZhY3RvciBsb2FkaW5ncyBmb3IgdGhvc2UgcGxhY2VzIHRvIGJlIGNvbnN0cmFpbmVkIHRvIGJlIGVxdWFsOgoKCmBgYHtyIG1vZGVsMDRBbHBoYSwgaW5jbHVkZT1UUlVFfQptb2RlbDA0U3ludGF4QWxwaGEgPSAiCgojIFNpdFAgbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdFAgPX4gTFAqU2l0MiArIExQKlNpdDQgKyBMUCpTaXQ2CgojIFNpdE4gbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdE4gPX4gTE4qU2l0MXIgKyBMTipTaXQzciArIExOKlNpdDVyCgojIFVuaXF1ZSBWYXJpYW5jZXM6ClNpdDFyIH5+IEUxKlNpdDFyOyBTaXQyIH5+IEUyKlNpdDI7IFNpdDNyIH5+IEUzKlNpdDNyOyBTaXQ0IH5+IEU0KlNpdDQ7IFNpdDVyIH5+IEU1KlNpdDVyOyBTaXQ2IH5+IEU2KlNpdDY7IAoKIyBDYWxjdWxhdGUgT21lZ2EgUmVsaWFiaWxpdHkgZm9yIFN1bSBTY29yZXM6Ck9tZWdhUCA6PSAoKDMqTFApXjIpIC8gKCAoKDMqTFApXjIpICsgRTIgKyBFNCArIEU2KQpPbWVnYU4gOj0gKCgzKkxOKV4yKSAvICggKCgzKkxOKV4yKSArIEUxICsgRTMgKyBFNSkKIgoKbW9kZWwwNEVzdGltYXRlc0FscGhhID0gc2VtKG1vZGVsID0gbW9kZWwwNFN5bnRheEFscGhhLCBkYXRhID0gaGZzU2l0dWF0aW9ucywgZXN0aW1hdG9yID0gIk1MUiIsIG1pbWljID0gIm1wbHVzIiwgc3RkLmx2ID0gVFJVRSkKc3VtbWFyeShtb2RlbDA0RXN0aW1hdGVzQWxwaGEsIGZpdC5tZWFzdXJlcyA9IFRSVUUsIHJzcXVhcmUgPSBUUlVFLCBzdGFuZGFyZGl6ZWQgPSBUUlVFKQpgYGAKCgpDb21wYXJlZCB3aXRoIHdoYXQgdGhlIGBgYHBzeWNoYGBgIHBhY2thZ2UgZ2l2ZXM6CgpgYGB7ciBhbHBoYSwgaW5jbHVkZT1UUlVFfQphbHBoYSh4ID0gaGZzU2l0dWF0aW9uc1tjKCJTaXQyIiwgIlNpdDQiLCAiU2l0NiIpXSwgdXNlID0gImFsbC5vYnMiKQphbHBoYSh4ID0gaGZzU2l0dWF0aW9uc1tjKCJTaXQxciIsICJTaXQzciIsICJTaXQ1ciIpXSwgdXNlID0gImFsbC5vYnMiKQpgYGAKCiMjIyMgUmVsaWFiaWxpdGllcyBmb3IgRmFjdG9yIFNjb3JlcwoKRmFjdG9yIHNjb3JlcyBoYXZlIGEgbG9uZyBoaXN0b3J5IHdpdGggbWFueSBjcml0aXF1ZXMgYW5kIGNvbXBsYWludHMuIFRoYXQgc2FpZCwgZmFjdG9yIHNjb3JlcyBjYW4gYmUgY29uc3RydWN0ZWQgYW5hbG9nb3VzbHkgYWNyb3NzIG1lYXN1cmVtZW50IG1vZGVscyB1c2luZyBCYXllc2lhbiBlc3RtYXRlcy4gV2Ugd2lsbCBkZXNjcmliZSB0aGlzIG1vcmUgaW4gYSBsYXRlciBsZWN0dXJlLiBGb3Igb3VyIHB1cnBvc2VzLCBpbiBDRkEsIHRoZSB0d28gbWFpbiB0eXBlcyBvZiBCYXllc2lhbiBFc3RpbWF0ZXMgKE1BUDogTWF4aW11bSBBIFBvc3RlcmlvcmkgYW5kIEVBUDogRXhwZWN0ZWQgQSBQb3N0ZXJpb3JpKSBhcmUgaWRlbnRpY2FsLiBgYGBsYXZhYW5gYGAgd2lsbCBub3QgcHJvdmlkZSBzdGFuZGFyZCBlcnJvcnMgZm9yIGZhY3RvciBzY29yZXMsIHNvIEkgY3JlYXRlZCBhIGZ1bmN0aW9uIGBgYGZhY3RvclNjb3JlcygpYGBgIHRvIG5vdCBvbmx5IGNyZWF0ZSB0aGUgZmFjdG9yIHNjb3JlcyB1c2luZyBFQVAgKGFnYWluLCBpZGVudGljYWwgdG8gTUFQKSBidXQgYWxzbyB0byBnaXZlIHN0YW5kYXJkIGVycm9ycyBmb3IgZWFjaCBzY29yZS4gVGhlIGZ1bmN0aW9uIHRha2VzIHRoZSBgYGBsYXZhYW5gYGAgbW9kZWwgb3V0cHV0IGFuZCByZXR1cm5zIGEgbGlzdCBvZiB0aHJlZSBlbGVtZW50czogYGBgc2NvcmVzYGBgIGNvbnRhaW5pbmcgZmFjdG9yIHNjb3JlcyBhbmQgc3RhbmRhcmQgZXJyb3JzLCBgYGBmYWN0b3JDb3ZgYGAgY29udGFpbmluZyB0aGUgdGhlb3JldGljYWwgY292YXJpYW5jZSBtYXRyaXggb2YgdGhlIGZhY3RvciBzY29yZXMsIGFuZCBgYGBmYWN0b3JDb3JgYGAgdGhlIHRoZW9yZXRpY2FsIGNvcnJlbGF0aW9uIG1hdHJpeCBvZiB0aGUgZmFjdG9yIHNjb3Jlcy4KClRvIGRldGVybWluZSB0aGUgcmVsaWFiaWxpdHkgb2YgYSBmYWN0b3Igc2NvcmUsIHdlIG11c3QgcmV0dXJuIHRvIG91ciBjbGFzc2ljYWwgbm90aW9uIG9mIHdoYXQgcmVsaWFiaWxpdHkgbWVhbnM6CiQkIFxyaG8gPSBcZnJhY3tWYXIoVHJ1ZSl9e1ZhcihUb3RhbCl9ID0gXGZyYWN7VmFyKFRydWUpfXtWYXIoVHJ1ZSkgKyBWYXIoRXJyb3IpfSA9IFxmcmFje1ZhcihGKX17VmFyKEYpK1NFKEYpXjJ9JCQKSW4gQ0ZBLCAkVmFyKFRydWUpJCBpcyBmb3VuZCBieSB0aGUgZXN0aW1hdGVkIGZhY3RvciB2YXJpYW5jZSBhbmQgJFZhcihFcnJvcikkIGNvbWVzIGZyb20gdGhlIHNxdWFyZWQgc3RhbmRhcmQgZXJyb3Igb2YgYSBmYWN0b3Igc2NvcmUgKGZyb20gYW4gb2JzZXJ2YXRpb24gd2l0aCBjb21wbGV0ZSBkYXRhKS4KCkkgY3JlYXRlZCBhIGZ1bmN0aW9uIG5hbWVkIGBgYGZhY3RvclNjb3JlUmVsaWFiaWxpdHkoKWBgYCB0byBjYWxjdWxhdGUgdGhlIHJlbGlhYmlsaXR5IGZvciBmYWN0b3Igc2NvcmVzLiBVc2luZyB0aGUgZnVuY3Rpb24gd2UgY2FuIHNlZSB0aGF0IHRoZSByZWxpYWJpbHRpeSBvZiBvdXIgZmFjdG9yIHNjb3JlcyBpcyAuODE3IGZvciBTaXRQIGFuZCAuODUxIGZvciBTaXROLCB3aGljaCBoYXIgaGlnaGVyIHRoYW4gdGhlIE9tZWdhIHJlbGlhYmxpdGllcyBmb3Igc3VtIHNjb3Jlcy4gSW4gZ2VuZXJhbCwgZmFjdG9yIHNjb3JlIHJlbGlhYmlsaXRpZXMgYXJlIGdyZWF0ZXIgdGhhbiB3aGF0IGlzIGZvdW5kIGluIE9tZWdhIGFuZCBBbHBoYSBkdWUgdG8gdGhlIHVzZSBvZiBhIHByaW9yIGRpc3RyaWJ1dGlvbiBmb3IgdGhlIGZhY3RvciBpdHNlbGYgYW5kIGR1ZSB0byB0aGUgZmFjdG9yIGNvcnJlbGF0aW9uIGFsbG93aW5nIGluZGlyZWN0IGluZm9ybWF0aW9uIGZyb20gb3RoZXIgZmFjdG9ycyB0byBoZWxwIGluIHRoZSBlc3RpbWF0aW9uIG9mIGVhY2ggZmFjdG9yLgpgYGB7ciBzY29yZXMsIGluY2x1ZGU9VFJVRX0KCmZhY3RvclNjb3JlcyA9IGZ1bmN0aW9uKGxhdk9iamVjdCl7CiAgb3V0cHV0ID0gaW5zcGVjdChvYmplY3QgPSBsYXZPYmplY3QsIHdoYXQgPSAiZXN0IikKICAKICBzaWdtYSA9IG91dHB1dCRsYW1iZGEgJSolIG91dHB1dCRwc2kgJSolIHQob3V0cHV0JGxhbWJkYSkgKyBvdXRwdXQkdGhldGEKICBtb2RlbERhdGEgPSBsYXZPYmplY3RARGF0YUBYW1sxXV0KICAKICBzY29yZXMgPSB0KG91dHB1dCRhbHBoYSUqJW1hdHJpeCgxLCBucm93PTEsIG5jb2w9ZGltKG1vZGVsRGF0YSlbMV0pICsKICAgIG91dHB1dCRwc2kgJSolIHQob3V0cHV0JGxhbWJkYSkgJSolIHNvbHZlKHNpZ21hKSUqJSh0KG1vZGVsRGF0YSkgLSBvdXRwdXQkbnUlKiVtYXRyaXgoMSwgbnJvdz0xLCBuY29sPWRpbShtb2RlbERhdGEpWzFdKSkpCgogIHZhcnNjb3JlcyA9IG91dHB1dCRwc2kgLSBvdXRwdXQkcHNpICUqJSB0KG91dHB1dCRsYW1iZGEpICUqJSBzb2x2ZShzaWdtYSkgJSolIG91dHB1dCRsYW1iZGEgJSolIG91dHB1dCRwc2kKICBmYWN0b3JTRSA9IHNxcnQoZGlhZyh2YXJzY29yZXMpKQogIG5hbWVzKGZhY3RvclNFKSA9IHBhc3RlMChuYW1lcyhmYWN0b3JTRSksICIuU0UiKQogIGZhY3RvclNFbWF0ID0gbWF0cml4KDEsIG5yb3c9bnJvdyhzY29yZXMpLCBuY29sID0gMSkgJSolIG1hdHJpeChmYWN0b3JTRSwgbnJvdyA9IDEsIG5jb2wgPSBuY29sKHNjb3JlcykpCiAgY29sbmFtZXMoZmFjdG9yU0VtYXQpID0gbmFtZXMoZmFjdG9yU0UpCiAgCiAgcmVzdWx0ID0gZGF0YS5mcmFtZShjYmluZChzY29yZXMsIGZhY3RvclNFbWF0KSkKICBuYW1lcyhyZXN1bHQpCiAgb2RkcyA9IHNlcSgxLCBuY29sKHJlc3VsdCktMSwgMikKICBldmVucyA9IHNlcSgyLCBuY29sKHJlc3VsdCksIDIpCiAgcmVzdWx0ID0gcmVzdWx0W2Mob2RkcyxldmVucyldCiAgCiAgZmFjdG9yQ292ID0gdmFyc2NvcmVzCiAgZmFjdG9yQ29yciA9IHNvbHZlKHNxcnQoZGlhZyhkaWFnKHZhcnNjb3JlcykpKSkgJSolIHZhcnNjb3JlcyAlKiUgc29sdmUoc3FydChkaWFnKGRpYWcodmFyc2NvcmVzKSkpKQogIAogIHJldHVybihsaXN0KHNjb3JlcyA9IHJlc3VsdCwgZmFjdG9yQ292ID0gZmFjdG9yQ292LCBmYWN0b3JDb3JyID0gZmFjdG9yQ29ycikpCn0KCgpmYWN0b3JTY29yZVJlbGlhYmlsaXR5ID0gZnVuY3Rpb24obGF2T2JqZWN0KXsKICBvdXRwdXQgPSBpbnNwZWN0KG9iamVjdCA9IGxhdk9iamVjdCwgd2hhdCA9ICJlc3QiKQogIHNpZ21hID0gb3V0cHV0JGxhbWJkYSAlKiUgb3V0cHV0JHBzaSAlKiUgdChvdXRwdXQkbGFtYmRhKSArIG91dHB1dCR0aGV0YQogIHZhcnNjb3JlcyA9IG91dHB1dCRwc2kgLSBvdXRwdXQkcHNpICUqJSB0KG91dHB1dCRsYW1iZGEpICUqJSBzb2x2ZShzaWdtYSkgJSolIG91dHB1dCRsYW1iZGEgJSolIG91dHB1dCRwc2kKICAKICByZXR1cm4oZGlhZyhvdXRwdXQkcHNpKS8oZGlhZyhvdXRwdXQkcHNpKSArIGRpYWcodmFyc2NvcmVzKSkpCiAgCn0KZmFjdG9yU2NvcmVSZWxpYWJpbGl0eShsYXZPYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzKQoKYGBgCgojIyMgVGVzdGluZyBBc3N1bXB0aW9ucyBvZiBDbGFzc2ljYWwgVGVzdCBUaGVvcnkKCldlIGNhbiBhbHNvIGNvbXBhcmUgdGhlIG1vZGVsIGZpdCBvZiB0aGUgQ0ZBIG1vZGVsIHdpdGggdGhlIHRhdS1lcXVpdmFsZW50IG1vZGVsLCBlc3NlbnRpYWxseSB0ZXN0aW5nIHdoZXRoZXIgb3Igbm90IENUVCAoYW5kIGFscGhhKSBpcyBhcHByb3ByaWF0ZToKCmBgYHtyIG1vZGVsQ29tcDIsIGluY2x1ZGU9VFJVRX0KYW5vdmEobW9kZWwwNEVzdGltYXRlc0FscGhhLCBtb2RlbDA0RXN0aW1hdGVzT21lZ2EpCmBgYAoKVGhlIHNpZ25pZmljYW50IGRpZmZlcmVuY2UgaW5kaWNhdGVzIHRoYXQgdGhlIHRhdS1lcXVpdmFsZW50IGFzc3VtcHRpb25zIG9mIGVxdWFsIGl0ZW0gbG9hZGluZ3MgZG8gbm90IGhvbGQgZm9yIGFsbCBvZiB0aGUgZGF0YS4gSW4gdGhlIE1wbHVzIGhhbmRvdXQsIExlc2EgSG9mZm1hbiBzaG93cyB0aGF0IHRhdSBlcXVpdmFsZW5jZSBob2xkcyBmb3Igb25lIG9mIHRoZSBzdWJzY2FsZXMsIGJ1dCAgd2UgZG9uJ3QgbmVlZCB0byBoYXZlIHRhdSBlcXVpdmFsZW5jZSB0byBtb3ZlIGZvcndhcmQgd2l0aCByZXN1bHRzIGFzIENGQSBpcyBzdWJzdW1lcyB0aGUgdGF1LWVxdWl2YWxlbnQgbW9kZWwgKG1lYW5pbmcgaXQgd2lsbCBiZSB0YXUgZXF1aXZhbGVudCBpZiB0aGUgZGF0YSBhcmUgdGF1IGVxdWl2YWxlbnQgYnV0IGNhbiBhbHNvIGJlIG1vcmUgZ2VuZXJhbCkuCgpBbm90aGVyIG1vZGVsIG9mdGVuIGRpc2N1c3NlZCBpbiBDVFQgaXMgdGhlIHBhcmFsbGVsIGl0ZW1zIG1vZGVsLiBUaGUgQ0ZBIHZlcnNpb24gb2YgdGhlIHBhcmFsbGVsIGl0ZW1zIG1vZGVsIGlzIGEgbW9kZWwgd2hlcmUgYWxsIGZhY3RvciBsb2FkaW5ncyBmb3IgYSBmYWN0b3IgYXJlIGNvbnN0cmFpbmVkIHRvIGJlIGVxdWFsIGFuZCBhbGwgdW5pcXVlIHZhcmlhbmNlcyBmb3IgYSBmYWN0b3IgYXJlIGNvbnN0cmFpbmVkIHRvIGJlIGVxdWFsLiBUaGlzIG1vZGVsIGlzIG9uZSBzdGVwIG1vcmUgcmVzdHJpY3RpdmUgdGhhbiB0aGUgdGF1IGVxdWl2YWxlbnQgaXRlbXMgbW9kZWwuIFN5bnRheCBmb3IgdGhpcyBtb2RlbCBpcyBhcyBmb2xsb3dzOgoKYGBge3IgcGFyYWxsZWxJdGVtcywgaW5jbHVkZT1UUlVFfQptb2RlbDA0U3ludGF4U0IgPSAiCgojIFNpdFAgbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdFAgPX4gTFAqU2l0MiArIExQKlNpdDQgKyBMUCpTaXQ2CgojIFNpdE4gbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdE4gPX4gTE4qU2l0MXIgKyBMTipTaXQzciArIExOKlNpdDVyCgojIFVuaXF1ZSBWYXJpYW5jZXM6ClNpdDFyIH5+IEVOKlNpdDFyOyBTaXQyIH5+IEVQKlNpdDI7IFNpdDNyIH5+IEVOKlNpdDNyOyBTaXQ0IH5+IEVQKlNpdDQ7IFNpdDVyIH5+IEVOKlNpdDVyOyBTaXQ2IH5+IEVQKlNpdDY7IAoKIyBDYWxjdWxhdGUgT21lZ2EgUmVsaWFiaWxpdHkgZm9yIFN1bSBTY29yZXM6Ck9tZWdhUCA6PSAoKDMqTFApXjIpIC8gKCAoKDMqTFApXjIpICsgMypFUCkKT21lZ2FOIDo9ICgoMypMTileMikgLyAoICgoMypMTileMikgKyAzKkVOKQoiCgptb2RlbDA0RXN0aW1hdGVzU0IgPSBzZW0obW9kZWwgPSBtb2RlbDA0U3ludGF4U0IsIGRhdGEgPSBoZnNTaXR1YXRpb25zLCBlc3RpbWF0b3IgPSAiTUxSIiwgbWltaWMgPSAibXBsdXMiLCBzdGQubHYgPSBUUlVFKQpzdW1tYXJ5KG1vZGVsMDRFc3RpbWF0ZXNTQiwgZml0Lm1lYXN1cmVzID0gVFJVRSwgcnNxdWFyZSA9IFRSVUUsIHN0YW5kYXJkaXplZCA9IFRSVUUpCmBgYAoKVGhlIHZhbHVlcyByZXN1bHRpbmcgZnJvbSBPbWVnYSBhcmUgdGhlIFNwZWFybWFuLUJyb3duIHJlbGlhYmxpdHkgZXN0aW1hdGVzLiBOb3RlIHRoYXQgcmVsaWFibGl0eSBmb3IgcGFyYWxsZWwgaXRlbXMgPCByZWxpYWJpbGl0eSBmb3IgdGF1IGVxdWl2YWxlbnQgaXRlbXMgPCByZWxpYWJpbGl0eSBmb3IgQ0ZBLCBidXQgdGhhdCB0aGUgZXN0aW1hdGVzIGFyZSB2ZXJ5IGNsb3NlLiBUaGF0IGlzIGNvbW1vbiB3aGVuIGEgbW9kZWwgZml0cyB0aGUgZGF0YS4KCiMjIyBFeGFtaW5pbmcgRmFjdG9yIFNjb3JlIERpc3RyaWJ1dGlvbnMKClRoZSBwb3NpdGl2ZSBmYWN0b3Igc2NvcmVzIGhhdmUgYW4gZXN0aW1hdGVkIG1lYW4gb2YgMCB3aXRoIGEgdmFyaWFuY2Ugb2YgMC43OCBpbnN0ZWFkIG9mIDEuMDAgKGR1ZSB0byB0aGUgZWZmZWN0IG9mIHRoZSBwcmlvciBkaXN0cmlidXRpb24gLS0gdGhpcyBpcyBjYWxsZWQgInNocmlua2FnZSIpLiBUaGUgU0UgZm9yIGVhY2ggcGVyc29u4oCZcyBmYWN0b3Igc2NvcmUgaXMgLjQ3Mi4gVHJlYXRpbmcgZmFjdG9yIHNjb3JlcyBhcyBvYnNlcnZlZCB2YXJpYWJsZXMgaXMgbGlrZSBzYXlpbmcgU0UgPSAwLgoKOTUlIGNvbmZpZGVuY2UgaW50ZXJ2YWwgZm9yIHBvc2l0aXZlIGZhY3RvciBzY29yZSA9IFNjb3JlIMKxIDIqLjQ3MiA9IFNjb3JlIMKxIC45NDQuCgpgYGB7ciBwbG90RjEsIGluY2x1ZGU9VFJVRX0KIyBjYWxjdWxhdGUgZmFjdG9yIHNjb3JlcyB1c2luZyBmdW5jdGlvbiBhYm92ZToKZnNjb3JlcyA9IGZhY3RvclNjb3JlcyhsYXZPYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzKQoKCiNzaG93IHZhcmlhbmNlIG9mIGZhY3RvciBzY29yZToKdmFyKGZzY29yZXMkc2NvcmVzJFNpdFApCgojIEhpc3RvZ3JhbSBvdmVybGFpZCB3aXRoIGtlcm5lbCBkZW5zaXR5IGN1cnZlCmdncGxvdChmc2NvcmVzJHNjb3JlcywgYWVzKHg9U2l0UCkpICsgCiAgICBnZW9tX2hpc3RvZ3JhbShhZXMoeT0uLmRlbnNpdHkuLiksICAgICAgIyBIaXN0b2dyYW0gd2l0aCBkZW5zaXR5IGluc3RlYWQgb2YgY291bnQgb24geS1heGlzCiAgICAgICAgICAgICAgICAgICBiaW53aWR0aD0uNSwKICAgICAgICAgICAgICAgICAgIGNvbG91cj0iYmxhY2siLCBmaWxsPSJ3aGl0ZSIpICsgeGxpbShjKC00LDQpKSArIGxhYnModGl0bGUgPSAiUG9zaXRpdmUgU2l0dWF0aW9uIEZvcmdpdmVuZXNzIEZhY3RvciBTY29yZSIpICsKICAgIGdlb21fZGVuc2l0eShhbHBoYT0uMiwgZmlsbD0iI0ZGNjY2NiIpICAgICMgT3ZlcmxheSB3aXRoIHRyYW5zcGFyZW50IGRlbnNpdHkgcGxvdApgYGAKCgpUaGUgbmVnYXRpdmUgZmFjdG9yIHNjb3JlcyBoYXZlIGFuIGVzdGltYXRlZCBtZWFuIG9mIDAgd2l0aCBhIHZhcmlhbmNlIG9mIDAuODI1IGluc3RlYWQgb2YgMS4wMC4gIFRoZSBTRSBmb3IgZWFjaCBwZXJzb27igJlzIGZhY3RvciBzY29yZSBpcyAuNDE4LCBzbyB0aGUgODAlIGNvbmZpZGVuY2UgaW50ZXJ2YWwgaXMgU2NvcmUgwrEgLjgzNi4KClRoZSBuZWdhdGl2ZSBmYWN0b3Igc2NvcmVzIHJldGFpbiBtb3JlIHZhcmlhbmNlIChhbmQgaGF2ZSBhIHNtYWxsZXIgU0UpIGJlY2F1c2UgdGhlcmUgaXMgbW9yZSBpbmZvcm1hdGlvbiBpbiB0aGVtLCBkdWUgdG8gaGlnaGVyIGZhY3RvciBsb2FkaW5ncyAoZ3JlYXRlciByZWxpYWJpbGl0eSkgb2YgdGhlaXIgaXRlbXMuCgpgYGB7ciBwbG90RjIsIGluY2x1ZGU9VFJVRX0KCiNzaG93IHZhcmlhbmNlIG9mIGZhY3RvciBzY29yZToKdmFyKGZzY29yZXMkc2NvcmVzJFNpdE4pCgojIEhpc3RvZ3JhbSBvdmVybGFpZCB3aXRoIGtlcm5lbCBkZW5zaXR5IGN1cnZlCmdncGxvdChmc2NvcmVzJHNjb3JlcywgYWVzKHg9U2l0TikpICsgCiAgICBnZW9tX2hpc3RvZ3JhbShhZXMoeT0uLmRlbnNpdHkuLiksICAgICAgIyBIaXN0b2dyYW0gd2l0aCBkZW5zaXR5IGluc3RlYWQgb2YgY291bnQgb24geS1heGlzCiAgICAgICAgICAgICAgICAgICBiaW53aWR0aD0uNSwKICAgICAgICAgICAgICAgICAgIGNvbG91cj0iYmxhY2siLCBmaWxsPSJ3aGl0ZSIpICsgeGxpbShjKC00LDQpKSArIGxhYnModGl0bGUgPSAiTmVnYXRpdmUgU2l0dWF0aW9uIEZvcmdpdmVuZXNzIEZhY3RvciBTY29yZSIpICsKICAgIGdlb21fZGVuc2l0eShhbHBoYT0uMiwgZmlsbD0iI0ZGNjY2NiIpICAgICMgT3ZlcmxheSB3aXRoIHRyYW5zcGFyZW50IGRlbnNpdHkgcGxvdApgYGAKCiMjIyMgRmFjdG9yIFNjb3JlcyBmcm9tIFBhcmFsbGVsIEl0ZW1zIE1vZGVsIGFyZSBTdW0gU2NvcmVzIHdpdGggYSBEaWZmZXJlbnQgU2NhbGUKClRoZSBwYXJhbGxlbCBpdGVtcyBtb2RlbCBjb25zdHJhaW5zIHRoZSBpdGVtIGZhY3RvciBsb2FkaW5ncyB0byBiZSBlcXVhbCBhbmQgdW5pcXVlIHZhcmlhbmNlcyB0byBiZSBlcXVhbCBmb3IgYSBnaXZlbiBmYWN0b3IuIFdoZW4gZXN0aW1hdGVkIHNlcGFyYXRlbHkgKG9yIHdoZW4gd2hlbiBlc3RpbWF0ZWQgd2l0aCBhIGZhY3RvciBjb3JyZWxhdGlvbiksIHRoZSBjb3JybGF0aW9uIG9mIGZhY3RvciBzY29yZXMgZnJvbSB0aGUgcGFyYWxsZWwgaXRlbXMgbW9kZWwgYW5kIHRoZSBzdW0gc2NvcmVzIGZyb20gQ1RUIGlzIGVxdWFsIHRvIG9uZS4gV2hhdCB0aGlzIG1lYW5zIGlzIHRoYXQgdG8gYmUgYWJsZSB0byB1c2Ugc3VtIHNjb3JlcyBpbiBhbiBhbmFseXNpcywgdGhlIHBhcmFsbGVsIGl0ZW1zIG1vZGVsIG11c3QgaG9sZC4gVG8gZGVtb25zdHJhdGUsIHRoZSBgYGBsYXZhYW5gYGAgc3ludGF4IGJlbG93IHNldHMgdGhlIGZhY3RvciBjb3ZhcmlhbmNlIHRvIHplcm8gKGFuZCB0aGVyZWZvcmUgdGhlIGNvcnJlbGF0aW9uIGJldHdlZW4gZmFjdG9ycyB0byB6ZXJvKSBieSB1c2luZyAwXCogaW4gdGhlIHN0YXRlbWVudCBgYGBTaXRQIH5+IDAqU2l0TmBgYDoKCmBgYHtyIGZhY3RvclN1bSwgaW5jbHVkZT1UUlVFfQptb2RlbDA0U3ludGF4U0J6ZXJvQ29yID0gIgoKIyBTaXRQIGxvYWRpbmdzIChhbGwgZXN0aW1hdGVkKQpTaXRQID1+IExQKlNpdDIgKyBMUCpTaXQ0ICsgTFAqU2l0NgoKIyBTaXROIGxvYWRpbmdzIChhbGwgZXN0aW1hdGVkKQpTaXROID1+IExOKlNpdDFyICsgTE4qU2l0M3IgKyBMTipTaXQ1cgoKIyBVbmlxdWUgVmFyaWFuY2VzOgpTaXQxciB+fiBFTipTaXQxcjsgU2l0MiB+fiBFUCpTaXQyOyBTaXQzciB+fiBFTipTaXQzcjsgU2l0NCB+fiBFUCpTaXQ0OyBTaXQ1ciB+fiBFTipTaXQ1cjsgU2l0NiB+fiBFUCpTaXQ2OyAKClNpdFAgfn4gMCpTaXROCgojIENhbGN1bGF0ZSBPbWVnYSBSZWxpYWJpbGl0eSBmb3IgU3VtIFNjb3JlczoKT21lZ2FQIDo9ICgoMypMUCleMikgLyAoICgoMypMUCleMikgKyAzKkVQKQpPbWVnYU4gOj0gKCgzKkxOKV4yKSAvICggKCgzKkxOKV4yKSArIDMqRU4pCiIKbW9kZWwwNFN5bnRheFNCemVyb0NvckVzdGltYXRlcyA9IHNlbShtb2RlbCA9IG1vZGVsMDRTeW50YXhTQnplcm9Db3IsIGRhdGEgPSBoZnNTaXR1YXRpb25zLCBlc3RpbWF0b3IgPSAiTUxSIiwgbWltaWMgPSAibXBsdXMiLCBzdGQubHYgPSBUUlVFKQoKc3Vtc2NvcmVzUCA9IGFwcGx5KFggPSBoZnNTaXR1YXRpb25zW2MoIlNpdDIiLCAiU2l0NCIsICJTaXQ2IildLCBNQVJHSU4gPSAxLCBGVU4gPSBzdW0pCnN1bXNjb3Jlc04gPSBhcHBseShYID0gaGZzU2l0dWF0aW9uc1tjKCJTaXQxciIsICJTaXQzciIsICJTaXQ1ciIpXSwgTUFSR0lOID0gMSwgRlVOID0gc3VtKQoKZnNjb3Jlc1BJID0gZmFjdG9yU2NvcmVzKGxhdk9iamVjdCA9IG1vZGVsMDRTeW50YXhTQnplcm9Db3JFc3RpbWF0ZXMpCgpwYXIobWZyb3cgPSBjKDEsMikpCnBsb3QoeCA9IGZzY29yZXMkc2NvcmVzJFNpdFAsIHkgPSBzdW1zY29yZXNQLCB4bGFiID0gIlNpdFA6IEZ1bGwgQ0ZBIEZhY3RvciBTY29yZXMiLCB5bGFiID0gIlNpdFA6IFN1bSBTY29yZSIsIHhsaW0gPSBjKC0zLjUsIDIpKQp0ZXh0KHggPSAtMiwgeSA9IDIwLCBsYWJlbHMgPSBwYXN0ZSgiciA9IiwgYXMuY2hhcmFjdGVyKHJvdW5kKHggPSBjb3IoZnNjb3JlcyRzY29yZXMkU2l0UCwgc3Vtc2NvcmVzUCksIGRpZ2l0cyA9IDMpKSkpCnBsb3QoeCA9IGZzY29yZXMkc2NvcmVzJFNpdE4sIHkgPSBzdW1zY29yZXNOLCB4bGFiID0gIlNpdE46IEZ1bGwgQ0ZBIEZhY3RvciBTY29yZXMiLCB5bGFiID0gIlNpdE46IFN1bSBTY29yZSIsIHhsaW0gPSBjKC0zLjUsIDIpKQp0ZXh0KHggPSAtMiwgeSA9IDIwLCBsYWJlbHMgPSBwYXN0ZSgiciA9IiwgYXMuY2hhcmFjdGVyKHJvdW5kKHggPSBjb3IoZnNjb3JlcyRzY29yZXMkU2l0Tiwgc3Vtc2NvcmVzTiksIGRpZ2l0cyA9IDMpKSkpCgpwbG90KHggPSBmc2NvcmVzUEkkc2NvcmVzJFNpdFAsIHkgPSBzdW1zY29yZXNQLCB4bGFiID0gIlNpdFA6IEZ1bGwgQ0ZBIEZhY3RvciBTY29yZXMiLCB5bGFiID0gIlNpdFA6IFN1bSBTY29yZSIsIHhsaW09YygtMy41LCAyKSkKdGV4dCh4ID0gLTIsIHkgPSAyMCwgbGFiZWxzID0gcGFzdGUoInIgPSIsIGFzLmNoYXJhY3Rlcihyb3VuZCh4ID0gY29yKGZzY29yZXNQSSRzY29yZXMkU2l0UCwgc3Vtc2NvcmVzUCksIGRpZ2l0cyA9IDMpKSkpCgpwbG90KHggPSBmc2NvcmVzUEkkc2NvcmVzJFNpdE4sIHkgPSBzdW1zY29yZXNOLCB4bGFiID0gIlNpdE46IEZ1bGwgQ0ZBIEZhY3RvciBTY29yZXMiLCB5bGFiID0gIlNpdE46IFN1bSBTY29yZSIsIHhsaW09YygtMy41LCAyKSkKdGV4dCh4ID0gLTIsIHkgPSAyMCwgbGFiZWxzID0gcGFzdGUoInIgPSIsIGFzLmNoYXJhY3Rlcihyb3VuZCh4ID0gY29yKGZzY29yZXNQSSRzY29yZXMkU2l0Tiwgc3Vtc2NvcmVzTiksIGRpZ2l0cyA9IDMpKSkpCnBhcihtZnJvdyA9IGMoMSwxKSkKYGBgCgoKIyMjIE1vZGVsLVByZWRpY3RlZCBJdGVtIFJlc3BvbnNlcyBieSBGYWN0b3IgU2NvcmVzIHdpdGggRGFzaGVkIExpbmVzIGZvciBGbG9vciBhbmQgQ2VpbGluZyBFZmZlY3RzOgoKV2UgY2FuIGFsc28gc2VlIGhvdyByZWFzb25hYmxlIG91ciBjaG9pY2Ugb2YgYSBjb250aW51b3VzIGRpc3RyaWJ1dGlvbiB3YXMgZm9yIHRoZXNlIExpa2VydCBkYXRhIGJ5IHBsb3R0aW5nIHRoZSBwcmVkaWN0ZWQgaXRlbSBzY29yZXMgZm9yIGVhY2ggaXRlbSBhY3Jvc3MgYSB0aGUgcmFuZ2Ugb2Ygb2JzZXJ2ZWQgZmFjdG9yIHNjb3Jlcy4gSWYgb3VyIGxpbmVzIGZhbGwgb3V0c2lkZSB0aGUgdGhlIHJhbmdlIG9mIDEgdGhyb3VnaCA3ICh0aGUgYm91bmRzIG9mIHRoZSBMaWtlcnQgaXRlbXMpLCB0aGVuIHdlIG1heSBoYXZlIGFuIGlzc3VlIHVzaW5nIENGQSAoYSBjYXRlZ29yaWNhbCB2ZXJzaW9uIHdvdWxkIGJlIG1vcmUgYXBwcm9wcmlhdGUpLgoKYGBge3IgaXRlbXBsb3QsIGluY2x1ZGU9VFJVRX0KbGF2T2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcwpjZmFQbG90cyA9IGZ1bmN0aW9uKGxhdk9iamVjdCl7CiAgb3V0cHV0ID0gaW5zcGVjdChvYmplY3QgPSBsYXZPYmplY3QsIHdoYXQgPSAiZXN0IikKICAKICAjYnVpbGQgbWF0cml4IHBsb3QgZWxlbWVudHMKICAKICAjZ2V0IGZhY3RvciBzY29yZXMKICBmc2NvcmVzID0gZmFjdG9yU2NvcmVzKGxhdk9iamVjdCA9IGxhdk9iamVjdCkKICAKICBuZmFjdG9ycyA9IG5jb2woZnNjb3JlcyRzY29yZXMpLzIKICAKICAjZ2V0IG1heCBvYnNlcnZlZCBkYXRhCiAgaXRlbU1heCA9IG1heChhcHBseShYID0gbGF2T2JqZWN0QERhdGFAWFtbMV1dLCBNQVJHSU4gPSAyLCBGVU4gPSBtYXgpKQogIGl0ZW1NaW4gPSBtaW4oYXBwbHkoWCA9IGxhdk9iamVjdEBEYXRhQFhbWzFdXSwgTUFSR0lOID0gMiwgRlVOID0gbWluKSkKICAgIAogICNnZXQgcmFuZ2UgZm9yIGFsbCBzY29yZXMKICBmYWN0b3JNYXggPSBtYXgoYXBwbHkoWCA9IGZzY29yZXMkc2NvcmVzW3NlcSgxLCBuY29sKGZzY29yZXMkc2NvcmVzKSwgMildLCBNQVJHSU4gPSAyLCBGVU4gPSBtYXgpKQogIGZhY3Rvck1pbiA9IG1pbihhcHBseShYID0gZnNjb3JlcyRzY29yZXNbc2VxKDEsIG5jb2woZnNjb3JlcyRzY29yZXMpLCAyKV0sIE1BUkdJTiA9IDIsIEZVTiA9IG1pbikpCiAgCiAgI3NldCB1cCB4IHZhbHVlcwogIHggPSBzZXEoZmFjdG9yTWluLCBmYWN0b3JNYXgsIC4wMSkKICAKICBwYXIobWZyb3cgPSBjKDEsIG5mYWN0b3JzKSkKICAjbWFrZSBwbG90cyBieSBmYWN0b3IKICBmYWN0b3I9MQogIGZvciAoZmFjdG9yIGluIDE6bmZhY3RvcnMpewogICAgeG1hdCA9IE5VTEwKICAgIHltYXQgPSBOVUxMCiAgICBpbmFtZXMgPSBOVUxMCiAgICBmb3IgKGl0ZW0gaW4gMTpucm93KG91dHB1dCRsYW1iZGEpKXsKICAgICAgaWYgKG91dHB1dCRsYW1iZGFbaXRlbSwgZmFjdG9yXSAhPSAwKXsKICAgICAgICBpbmFtZXMgPSBjKGluYW1lcywgcm93bmFtZXMob3V0cHV0JGxhbWJkYSlbaXRlbV0pCiAgICAgICAgeSA9IG91dHB1dCRudVtpdGVtXSArIG91dHB1dCRsYW1iZGFbaXRlbSwgZmFjdG9yXSp4CiAgICAgICAgeG1hdCA9IGNiaW5kKHhtYXQsIHgpCiAgICAgICAgeW1hdCA9IGNiaW5kKHltYXQsIHkpCiAgICAgIH0KICAgICAgCiAgICB9CiAgICBtYXRwbG90KHggPSB4bWF0LCB5ID0geW1hdCwgdHlwZSA9ICJsIiwgbHdkID0gNSwgbHR5PTI6KG5jb2woeG1hdCkrMSksIHlsaW0gPSBjKGl0ZW1NaW4tMSwgaXRlbU1heCsxKSwgeGxpbSA9IGMoZmFjdG9yTWluLCBmYWN0b3JNYXgpLCAgCiAgICAgICAgICAgIHlsYWIgPSAiUHJlZGljdGVkIEl0ZW0gUmVzcG9uc2UiLCB4bGFiID0gY29sbmFtZXMob3V0cHV0JGxhbWJkYSlbZmFjdG9yXSwgY29sID0gMjoobmNvbCh4bWF0KSsxKSkgCiAgICBsaW5lcyh4ID0gYyhmYWN0b3JNaW4sZmFjdG9yTWF4KSwgeSA9IGMoaXRlbU1pbiwgaXRlbU1pbiksIGx0eSA9IDMsIGx3ZCA9IDUpCiAgICBsaW5lcyh4ID0gYyhmYWN0b3JNaW4sZmFjdG9yTWF4KSwgeSA9IGMoaXRlbU1heCwgaXRlbU1heCksIGx0eSA9IDMsIGx3ZCA9IDUpCiAgICBsZWdlbmQoeCA9IC0zLCB5ID0gNywgbGVnZW5kID0gaW5hbWVzLCBsdHkgPSAyOihuY29sKHhtYXQpKzEpLCBsd2QgPSA1LCBjb2wgPSAyOihuY29sKHhtYXQpKzEpKQogIH0KICBwYXIobWZyb3cgPSBjKDEsMSkpCn0KcGFyKG1mcm93ID0gYygxLDIpKQpjZmFQbG90cyhsYXZPYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzKQoKYGBgCgojIyMgQ29tcGFyaW5nIFN1bSBTY29yZXMgd2l0aCBGYWN0b3IgU2NvcmVzCgpXaGF0IGlmIHdlIGhhZCBqdXN0IHRha2VuIHRoZSBzdW0gKG9yLCBoZXJlLCB0aGUgbWVhbikgb2YgdGhlIHRocmVlIGl0ZW1zIGZvciBlYWNoIHN1YnNjYWxlPwoKYGBge3IgcGxvdFNjb3JlczIsIGluY2x1ZGU9VFJVRX0KUG9zTWVhbiA9IGFwcGx5KFggPSBoZnNTaXR1YXRpb25zW2MoIlNpdDIiLCAiU2l0NCIsICJTaXQ2IildLCBNQVJHSU4gPSAxLCBGVU4gPSBtZWFuKQpOZWdNZWFuID0gYXBwbHkoWCA9IGhmc1NpdHVhdGlvbnNbYygiU2l0MXIiLCAiU2l0M3IiLCAiU2l0NXIiKV0sIE1BUkdJTiA9IDEsIEZVTiA9IG1lYW4pCgpwYXIobWZyb3cgPSBjKDEsMikpCnBsb3QoeSA9IFBvc01lYW4sIHggPSBmc2NvcmVzJHNjb3JlcyRTaXRQLCB4bGltID0gYygtMy41LDIpLCB5bGltID0gYygxLDcpLCB4bGFiID0gIlNpdFAgRmFjdG9yIFNjb3JlIiwgeWxhYiA9ICJQb3N0aXZlIEl0ZW1zIE1lYW4iKQp0ZXh0KHggPSAtMywgeSA9IDYsIGxhYmVscyA9IHBhc3RlKCJyID0gIiwgYXMuY2hhcmFjdGVyKHJvdW5kKGNvcihQb3NNZWFuLCBmc2NvcmVzJHNjb3JlcyRTaXRQKSwgZGlnaXRzID0gMykpKSkKcGxvdCh5ID0gTmVnTWVhbiwgeCA9IGZzY29yZXMkc2NvcmVzJFNpdE4sIHhsaW0gPSBjKC0zLjUsMiksIHlsaW0gPSBjKDEsNyksIHhsYWIgPSAiU2l0TiBGYWN0b3IgU2NvcmUiLCB5bGFiID0gIk5lZ2F0aXZlIEl0ZW1zIE1lYW4iKQp0ZXh0KHggPSAtMywgeSA9IDYsIGxhYmVscyA9IHBhc3RlKCJyID0gIiwgYXMuY2hhcmFjdGVyKHJvdW5kKGNvcihOZWdNZWFuLCBmc2NvcmVzJHNjb3JlcyRTaXROKSwgZGlnaXRzID0gMykpKSkKcGFyKG1mcm93ID0gYygxLDEpKQpgYGAKCldlIGNhbiBhbHNvIHBsb3QgaG93IHRoZSB0d28gdHlwZXMgb2Ygc2NvcmVzIGxvb2sgdG9nZXRoZXI6CgpgYGB7ciBwbG90c2NvcmVzMywgaW5jbHVkZT1UUlVFfQpwYXIobWZyb3cgPSBjKDEsMikpCnBsb3QoeCA9IFBvc01lYW4sIHkgPSBOZWdNZWFuLCB4bGltID0gYygxLDgpLCB5bGltID0gYygxLDgpLCB4bGFiICA9ICJQb3N0aXZlIEl0ZW1zIE1lYW4iLCB5bGFiID0gIk5lZ2F0aXZlIEl0ZW1zIE1lYW4iKQp0ZXh0KHggPSAxLjg1LCB5ID0gOCwgbGFiZWxzID0gcGFzdGUoInIgPSAiLCBhcy5jaGFyYWN0ZXIocm91bmQoY29yKFBvc01lYW4sIE5lZ01lYW4pLCBkaWdpdHMgPSAzKSkpKQoKcGxvdCh4ID0gZnNjb3JlcyRzY29yZXMkU2l0UCwgeSA9IGZzY29yZXMkc2NvcmVzJFNpdE4sIHhsaW0gPSBjKC0zLjUsMiksIHlsaW0gPSBjKC0zLjUsMiksIHhsYWIgID0gIlNpdFAgRmFjdG9yIFNjb3JlIiwgeWxhYiA9ICJTaXROIEZhY3RvciBTY29yZSIpCnRleHQoeCA9IC0yLjUsIHkgPSAxLjksIGxhYmVscyA9IHBhc3RlKCJyID0gIiwgYXMuY2hhcmFjdGVyKHJvdW5kKGNvcihmc2NvcmVzJHNjb3JlcyRTaXRQLCBmc2NvcmVzJHNjb3JlcyRTaXROKSwgZGlnaXRzID0gMykpKSkKcGFyKG1mcm93ID0gYygxLDEpKQoKYGBgCgpUaGVyZSBhcmUgcHJvYmxlbXMgd2l0aCBlaXRoZXIgb2YgdGhlc2Ugb2JzZXJ2ZWQgdmFyaWFibGUgYXBwcm9hY2hlczogVGhlIG1lYW4gb2YgdGhlIGl0ZW1zIGFwcGVhcnMgdG8gaGF2ZSBsZXNzIHZhcmlhYmlsaXR5IChpLmUuLCBmZXdlciBwb3NzaWJsZSBzY29yZXMpIGFuZCBhc3N1bWVzIHRoYXQgYWxsIGl0ZW1zIHNob3VsZCBiZSB3ZWlnaHRlZCBlcXVhbGx5IGFuZCBoYXZlIG5vIGVycm9yLiBUaGUgZXN0aW1hdGVkIGZhY3RvciBzY29yZXMgZG8gbm90IGhhdmUgdGhlIHNhbWUgcHJvcGVydGllcyBhcyBlc3RpbWF0ZWQgZm9yIHRoZSBmYWN0b3IgaW4gdGhlIG1vZGVsIChpLmUuLCBsZXNzIHZhcmlhbmNlIGZvciBlYWNoIGZhY3RvciwgaGlnaGVyIGNvcnJlbGF0aW9uIGFtb25nIHRoZSBmYWN0b3JzKS4gRnVydGhlciwgdGhlIG9yZGVyIG9mIHN1YmplY3RzIGJ5IHNjb3JlcyBkaWZmZXJzIGluIGJvdGggYXBwcm9hY2hlcywgd2hpY2ggaXMgcHJvYmxlbWF0aWMgZm9yIG90aGVyIGFuYWx5c2VzLiAKCldoYXQgdG8gZG8gaW5zdGVhZCBvZiBlaXRoZXIgb2YgdGhlc2U/IFN0YXkgdHVuZWQgZm9yIGhvdyB0byB1c2UgcGxhdXNpYmxlIHZhbHVlcywgQmF5ZXNpYW4gbWV0aG9kcywgb3IgU0VNLgoKIyMjIEV4YW1wbGUgV3JpdGUtVXAgRGVzY3JpYmluZyBUaGVzZSBBbmFseXNlcwoKUiBjb2RlIHRvIGJ1aWxkIG9iamVjdHMgcmVwb3J0ZWQgaW4gcmVzdWx0cyAoZG9uJ3Qgc2hvdyB0aGlzIHR5cGljYWxseSkKYGBge3IgcHJlcmVzdWx0cywgaW5jbHVkZT1UUlVFfQoKI251bWJlciBvZiBvYnNlcnZhdGlvbnMKZm9ybWF0KHggPSBtb2RlbDA0RXN0aW1hdGVzQERhdGFAbm9ic1tbMV1dWzFdLCBiaWcubWFyayA9ICIsIikKCiNsb3cgYW5kIGhpZ2ggc3RhbmRhcmRpemVkIGxvYWRpbmdzIGZvciBvbmUgZmFjdG9yIG1vZGVsCnN0ZExvYWRpbmdzID0gaW5zcGVjdChvYmplY3QgPSBtb2RlbDAxRXN0aW1hdGVzLCB3aGF0ID0gInN0ZC5hbGwiKQoKc3RkTG9hZGluZ3NMb3cgPSByb3VuZChtaW4oYXBwbHkoWCA9IHN0ZExvYWRpbmdzJGxhbWJkYSwgTUFSR0lOID0gMiwgRlVOID0gZnVuY3Rpb24oeCkgbWluKHhbd2hpY2goeCAhPTApXSkpKSwgZGlnaXRzID0gMykKc3RkTG9hZGluZ3NIaWdoID0gcm91bmQobWF4KGFwcGx5KFggPSBzdGRMb2FkaW5ncyRsYW1iZGEsIE1BUkdJTiA9IDIsIEZVTiA9IGZ1bmN0aW9uKHgpIG1heCh4W3doaWNoKHggIT0wKV0pKSksIGRpZ2l0cyA9IDMpCgojIGVzdGltYXRlZCBjb3JyZWxhdGlvbiBiZXR3ZWVuIGZhY3RvcnMgaW4gdHdvLWZhY3RvciBtb2RlbApzdGRDb3YwNCA9IGluc3BlY3Qob2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcywgd2hhdCA9ICJzdGQuYWxsIikkcHNpCmVzdENvcnIgPSBmb3JtYXQoeCA9IHN0ZENvdjA0WzIsMV0sIGRpZ2l0cyA9IDMpCgojc3RhbmRhcmRpemVkIGxvYWRpbmdzIHBvc2l0aXZlCnN0ZExvYWRpbmdzMDRQID0gaW5zcGVjdChvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCB3aGF0ID0gInN0ZC5hbGwiKSRsYW1iZGFbLDFdCm1pblNpdFAgPSByb3VuZChtaW4oc3RkTG9hZGluZ3MwNFBbd2hpY2goc3RkTG9hZGluZ3MwNFAgIT0gMCldKSwgZGlnaXRzID0gMykKbWF4U2l0UCA9IHJvdW5kKG1heChzdGRMb2FkaW5nczA0UFt3aGljaChzdGRMb2FkaW5nczA0UCAhPSAwKV0pLCBkaWdpdHMgPSAzKQoKI3N0YW5kYXJkaXplZCBsb2FkaW5ncyBuZWdhdGl2ZQpzdGRMb2FkaW5nczA0TiA9IGluc3BlY3Qob2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcywgd2hhdCA9ICJzdGQuYWxsIikkbGFtYmRhWywyXQptaW5TaXROID0gcm91bmQobWluKHN0ZExvYWRpbmdzMDROW3doaWNoKHN0ZExvYWRpbmdzMDROICE9IDApXSksIGRpZ2l0cyA9IDMpCm1heFNpdE4gPSByb3VuZChtYXgoc3RkTG9hZGluZ3MwNE5bd2hpY2goc3RkTG9hZGluZ3MwNE4gIT0gMCldKSwgZGlnaXRzID0gMykKCmZhY3RvclJlbCA9IGZhY3RvclNjb3JlUmVsaWFiaWxpdHkobGF2T2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcykKCgpgYGAKKE5vdGU6IFlvdSBtYXkgYm9ycm93IHRoZSBwaHJhc2luZyBjb250YWluZWQgaW4gdGhpcyBleGFtcGxlIHRvIGRlc2NyaWJlIHZhcmlvdXMgYXNwZWN0cyBvZiB5b3VyIGFuYWx5c2VzLCBidXQgeW91ciBvd24gcmVzdWx0cyBzZWN0aW9ucyB3aWxsIG5vdCBtaW1pYyB0aGlzIGV4YW1wbGUgZXhhY3RseeKAlHRoZXkgc2hvdWxkIGJlIGN1c3RvbWl6ZWQgdG8gZGVzY3JpYmUgdGhlIGhvdyBhbmQgdGhlIHdoeSBvZiB3aGF0IHlvdSBkaWQsIHNwZWNpZmljYWxseSkuCgooRGVzY3JpcHRpdmUgaW5mb3JtYXRpb24gZm9yIHRoZSBzYW1wbGUgYW5kIGl0ZW1zIHdvdWxkIGhhdmUgYWxyZWFkeSBiZWVuIGdpdmVuIGluIHRoZSBtZXRob2Qgc2VjdGlvbuKApikKClRoZSByZWxpYWJpbGl0eSBhbmQgZGltZW5zaW9uYWxpdHkgb2Ygc2l4IGl0ZW1zIGVhY2ggYXNzZXNzaW5nIGZvcmdpdmVuZXNzIG9mIHNpdHVhdGlvbnMgd2FzIGFzc2Vzc2VkIGluIGEgc2FtcGxlIG9mIGByIGZvcm1hdCh4ID0gbW9kZWwwNEVzdGltYXRlc0BEYXRhQG5vYnNbWzFdXVsxXSwgYmlnLm1hcmsgPSAiLCIpYCBwZXJzb25zIHdpdGggYSBjb25maXJtYXRvcnkgZmFjdG9yIGFuYWx5c2lzIHVzaW5nIHJvYnVzdCBtYXhpbXVtIGxpa2VsaWhvb2QgZXN0aW1hdGlvbiAoTUxSKSBpbiB0aGUgX2xhdmFhbl8gcGFja2FnZSAoUm9zc2VlbCwgMjAxMikgaW4gUiAoUiBDb3JlIFRlYW0sIDIwMTcpLiBBbGwgbW9kZWxzIHdlcmUgaWRlbnRpZmllZCBieSBzZXR0aW5nIGFueSBsYXRlbnQgZmFjdG9yIG1lYW5zIHRvIDAgYW5kIGxhdGVudCBmYWN0b3IgdmFyaWFuY2VzIHRvIDEsIHN1Y2ggdGhhdCBhbGwgaXRlbSBpbnRlcmNlcHRzLCBpdGVtIGZhY3RvciBsb2FkaW5ncywgYW5kIGl0ZW0gcmVzaWR1YWwgdmFyaWFuY2VzIHdlcmUgdGhlbiBlc3RpbWF0ZWQuIFRoZSBzaXggaXRlbXMgdXRpbGl6ZWQgYSBzZXZlbi1wb2ludCByZXNwb25zZSBzY2FsZSwgYW5kIHRocmVlIGl0ZW1zIHdlcmUgcmV2ZXJzZS1jb2RlZCBwcmlvciB0byBhbmFseXNpcyBzdWNoIHRoYXQgaGlnaGVyIHZhbHVlcyB0aGVuIGluZGljYXRlZCBncmVhdGVyIGxldmVscyBvZiBmb3JnaXZlbmVzcyBvZiBzaXR1YXRpb25zIGZvciBhbGwgaXRlbXMuIE1vZGVsIGZpdCBzdGF0aXN0aWNzIHJlcG9ydGVkIGluIFRhYmxlIDEgaW5jbHVkZSB0aGUgb2J0YWluZWQgbW9kZWwgJFxjaGleMiQsIGl0cyBzY2FsaW5nIGZhY3RvciAoaW4gd2hpY2ggdmFsdWVzIGRpZmZlcmVudCB0aGFuIDEuMDAwIGluZGljYXRlIGRldmlhdGlvbnMgZnJvbSBub3JtYWxpdHkpLCBpdHMgZGVncmVlcyBvZiBmcmVlZG9tLCBhbmQgaXRzIHAtdmFsdWUgKGluIHdoaWNoIG5vbi1zaWduaWZpY2FuY2UgaXMgZGVzaXJhYmxlIGZvciBnb29kIGZpdCksIENGSSwgb3IgQ29tcGFyYXRpdmUgRml0IEluZGV4IChpbiB3aGljaCB2YWx1ZXMgaGlnaGVyIHRoYW4gLjk1IGFyZSBkZXNpcmFibGUgZm9yIGdvb2QgZml0KSwgYW5kIHRoZSBSTVNFQSwgb3IgUm9vdCBNZWFuIFNxdWFyZSBFcnJvciBvZiBBcHByb3hpbWF0aW9uLCBwb2ludCBlc3RpbWF0ZSBhbmQgOTAlIGNvbmZpZGVuY2UgaW50ZXJ2YWwgKGluIHdoaWNoIHZhbHVlcyBsb3dlciB0aGFuIC4wNiBhcmUgZGVzaXJhYmxlIGZvciBnb29kIGZpdCkuIEFzIHJlcG9ydGVkIGluIFRhYmxlIDIsIG5lc3RlZCBtb2RlbCBjb21wYXJpc29ucyB3ZXJlIGNvbmR1Y3RlZCB1c2luZyB0aGUgcmVzY2FsZWQgJOKIkjJcRGVsdGEgTEwkIHdpdGggZGVncmVlcyBvZiBmcmVlZG9tIGVxdWFsIHRvIHRoZSByZXNjYWxlZCBkaWZmZXJlbmNlIGluIHRoZSBudW1iZXIgb2YgcGFyYW1ldGVycyBiZXR3ZWVuIG1vZGVscyAoaS5lLiwgYSByZXNjYWxlZCBsaWtlbGlob29kIHJhdGlvIHRlc3QpLiBUaGUgc3BlY2lmaWMgbW9kZWxzIGV4YW1pbmVkIGFyZSBkZXNjcmliZWQgaW4gZGV0YWlsIGJlbG93LgoKQWx0aG91Z2ggYSBvbmUtZmFjdG9yIG1vZGVsIHdhcyBpbml0aWFsbHkgcG9zaXRlZCB0byBhY2NvdW50IGZvciB0aGUgcGF0dGVybiBvZiBjb3ZhcmlhbmNlIGFjcm9zcyB0aGVzZSBzaXggaXRlbXMsIGl0IHJlc3VsdGVkIGluIHBvb3IgZml0LCBhcyBzaG93biBpbiBUYWJsZSAxLiBBbHRob3VnaCBlYWNoIGl0ZW0gaGFkIGEgc2lnbmlmaWNhbnQgZmFjdG9yIGxvYWRpbmcgKHdpdGggc3RhbmRhcmRpemVkIGxvYWRpbmdzIHJhbmdpbmcgZnJvbSBgciBzdGRMb2FkaW5nc0xvd2AgdG8gYHIgc3RkTG9hZGluZ3NIaWdoYCksIGEgc2luZ2xlIGxhdGVudCBmYWN0b3IgZGlkIG5vdCBhZGVxdWF0ZWx5IGRlc2NyaWJlIHRoZSBwYXR0ZXJuIG9mIHJlbGF0aW9uc2hpcCBhY3Jvc3MgdGhlc2Ugc2l4IGl0ZW1zIGFzIGluaXRpYWxseSBoeXBvdGhlc2l6ZWQuIFNvdXJjZXMgb2YgbG9jYWwgbWlzZml0IHdlcmUgaWRlbnRpZmllZCB1c2luZyB0aGUgbm9ybWFsaXplZCByZXNpZHVhbCBjb3ZhcmlhbmNlIG1hdHJpeCwgYXZhaWxhYmxlIHZpYSB0aGUgKnJlc2lkKCkqIGZ1bmN0aW9uIGluICpsYXZhYW4qLCBpbiB3aGljaCBpbmRpdmlkdWFsIHZhbHVlcyB3ZXJlIGNhbGN1bGF0ZWQgYXM6IChvYnNlcnZlZCBjb3ZhcmlhbmNlIOKAkyBleHBlY3RlZCBjb3ZhcmlhbmNlKSAvIFNEKG9ic2VydmVkIGNvdmFyaWFuY2UpLiBSZWxhdGl2ZWx5IGxhcmdlIHBvc2l0aXZlIHJlc2lkdWFsIGNvdmFyaWFuY2VzIHdlcmUgb2JzZXJ2ZWQgYW1vbmcgaXRlbXMgMiwgNCwgYW5kIDYgKHRoZSBwb3NpdGl2ZWx5LXdvcmRlZCBpdGVtcyksIGluZGljYXRpbmcgdGhhdCB0aGVzZSBpdGVtcyB3ZXJlIG1vcmUgcmVsYXRlZCB0aGFuIHdhcyBwcmVkaWN0ZWQgYnkgdGhlIHNpbmdsZS1mYWN0b3IgbW9kZWwuIE1vZGlmaWNhdGlvbiBpbmRpY2VzLCBhdmFpbGFibGUgdmlhIHRoZSAqbW9kaWZpY2F0aW9uaW5kaWNlcygpKiBmdW5jdGlvbiBpbiAqbGF2YWFuKiwgY29ycm9ib3JhdGVkIHRoaXMgcGF0dGVybiwgZnVydGhlciBzdWdnZXN0aW5nIGFkZGl0aW9uYWwgcmVtYWluaW5nIHJlbGF0aW9uc2hpcHMgYW1vbmcgdGhlIG5lZ2F0aXZlbHktd29yZGVkIGl0ZW1zIGFzIHdlbGwuIAoKVGhlIG5lY2Vzc2l0eSBvZiBzZXBhcmF0ZSBsYXRlbnQgZmFjdG9ycyBmb3IgdGhlIHBvc2l0aXZlbHktd29yZGVkIGFuZCBuZWdhdGl2ZWx5LXdvcmRlZCBpdGVtcyB3YXMgdGVzdGVkIGJ5IHNwZWNpZnlpbmcgYSB0d28tZmFjdG9yIG1vZGVsIGluIHdoaWNoIHRoZSBwb3NpdGl2ZWx5LXdvcmRlZCBpdGVtcyAyLCA0LCBhbmQgNiBpbmRpY2F0ZWQgYSBmb3JnaXZlbmVzcyBmYWN0b3IsIGFuZCBpbiB3aGljaCBuZWdhdGl2ZWx5LXdvcmRlZCBpdGVtcyAxLCAzLCBhbmQgNSBpbmRpY2F0ZWQgYSBub3QgdW5mb3JnaXZlbmVzcyBmYWN0b3IsIGFuZCBpbiB3aGljaCB0aGUgdHdvIGZhY3RvcnMgd2VyZSBhbGxvd2VkIHRvIGNvcnJlbGF0ZS4gVGhlIHR3by1mYWN0b3IgbW9kZWwgZml0IHdhcyBhY2NlcHRhYmxlIGJ5IGV2ZXJ5IGNyaXRlcmlvbiBleGNlcHQgdGhlIHNpZ25pZmljYW50ICRcY2hpXjIkLCBsaWtlbHkgZHVlIHRvIHRoZSBsYXJnZSBzYW1wbGUuIEluIGFkZGl0aW9uLCB0aGUgdHdvLWZhY3RvciBtb2RlbCBmaXQgc2lnbmlmaWNhbnRseSBiZXR0ZXIgdGhhbiB0aGUgb25lLWZhY3RvciBtb2RlbCwgYXMgcmVwb3J0ZWQgaW4gVGFibGUgMiwgaW5kaWNhdGluZyB0aGF0IHRoZSBlc3RpbWF0ZWQgY29ycmVsYXRpb24gYmV0d2VlbiB0aGUgdHdvIGZhY3RvcnMgb2YgYHIgZXN0Q29ycmAgd2FzIHNpZ25pZmljYW50bHkgbGVzcyB0aGFuIDEuMDAwLiBUaHVzLCB0aGUgc2l4IGl0ZW1zIGFwcGVhcmVkIHRvIG1lYXN1cmUgdHdvIHNlcGFyYXRlIGJ1dCByZWxhdGVkIGNvbnN0cnVjdHMuIEZ1cnRoZXIgZXhhbWluYXRpb24gb2YgbG9jYWwgZml0IHZpYSBub3JtYWxpemVkIHJlc2lkdWFsIGNvdmFyaWFuY2VzIGFuZCBtb2RpZmljYXRpb24gaW5kaWNlcyB5aWVsZGVkIG5vIGludGVycHJldGFibGUgcmVtYWluaW5nIHJlbGF0aW9uc2hpcHMsIGFuZCB0aHVzIHRoaXMgdHdvLWZhY3RvciBtb2RlbCB3YXMgcmV0YWluZWQuIAoKVGFibGUgMyBwcm92aWRlcyB0aGUgZXN0aW1hdGVzIGFuZCB0aGVpciBzdGFuZGFyZCBlcnJvcnMgZm9yIHRoZSBpdGVtIGZhY3RvciBsb2FkaW5ncywgaW50ZXJjZXB0cywgYW5kIHJlc2lkdWFsIHZhcmlhbmNlcyBmcm9tIGJvdGggdGhlIHVuc3RhbmRhcmRpemVkIGFuZCBzdGFuZGFyZGl6ZWQgc29sdXRpb25zLiBBbGwgZmFjdG9yIGxvYWRpbmdzIGFuZCB0aGUgZmFjdG9yIGNvdmFyaWFuY2Ugd2VyZSBzdGF0aXN0aWNhbGx5IHNpZ25pZmljYW50LiBBcyBzaG93biBpbiBUYWJsZSAzLCBzdGFuZGFyZGl6ZWQgbG9hZGluZ3MgZm9yIHRoZSBmb3JnaXZlbmVzcyBmYWN0b3IgaXRlbXMgcmFuZ2VkIGZyb20gYHIgbWluU2l0UGAgdG8gYHIgbWF4U2l0UGAgKHdpdGggJFJeMiQgdmFsdWVzIGZvciB0aGUgYW1vdW50IG9mIGl0ZW0gdmFyaWFuY2UgYWNjb3VudGVkIGZvciBieSB0aGUgZmFjdG9yIHJhbmdpbmcgZnJvbSBgciByb3VuZChtaW5TaXRQXjIsIGRpZ2l0cz0zKWAgdG8gYHIgcm91bmQobWF4U2l0UCwgZGlnaXRzPTMpYCksIGFuZCBzdGFuZGFyZGl6ZWQgbG9hZGluZ3MgZm9yIHRoZSBub3QgdW5mb3JnaXZlbmVzcyBmYWN0b3IgcmFuZ2VkIGZyb20gYHIgbWluU2l0TmAgdG8gYHIgbWF4U2l0TmAgKHdpdGggUjIgdmFsdWVzIG9mIGByIHJvdW5kKG1pblNpdE5eMiwgZGlnaXRzPTMpYCB0byBgciByb3VuZChtYXhTaXROXjIsIGRpZ2l0cz0zKWApLCBzdWdnZXN0aW5nIHRoZSBmYWN0b3IgbG9hZGluZ3Mgd2VyZSBwcmFjdGljYWxseSBzaWduaWZpY2FudCBhcyB3ZWxsLiBGYWN0b3Igc2NvcmUgcmVsaWFpYmxpdHkgd2FzIGByIHJvdW5kKGZhY3RvclJlbFsxXSlgIGZvciB0aGUgZm9yZ2l2ZW5lc3MgZmFjdG9yIGFuZCBgciByb3VuZChmYWN0b3JSZWxbMl0pYCBmb3IgdGhlIG5vdCB1bmZvcmdpdmVuZXNzIGZhY3Rvciwgc3VnZ2VzdGluZyBtYXJnaW5hbCByZWxpYWJpbGl0eSBmb3IgYm90aCBvZiB0aGUgdGhyZWUtaXRlbSBzY2FsZXMuIAoKVGhlIHJlc3VsdGluZyBkaXN0cmlidXRpb24gb2YgdGhlIEVBUCBlc3RpbWF0ZXMgb2YgZmFjdG9yIHNjb3JlIGFzIHNob3duIGluIEZpZ3VyZSAxLiBGaWd1cmUgMiBzaG93cyB0aGUgcHJlZGljdGVkIHJlc3BvbnNlIGZvciBlYWNoIGl0ZW0gYXMgYSBsaW5lYXIgZnVuY3Rpb24gb2YgdGhlIGxhdGVudCBmYWN0b3IgYmFzZWQgb24gdGhlIGVzdGltYXRlZCBtb2RlbCBwYXJhbWV0ZXJzLiBBcyBzaG93biwgdGhlIHByZWRpY3RlZCBpdGVtIHJlc3BvbnNlIGdvZXMgYWJvdmUgdGhlIGhpZ2hlc3QgcmVzcG9uc2Ugb3B0aW9uIGp1c3QgYmVmb3JlIGEgbGF0ZW50IGZhY3RvciBzY29yZSBvZiAyIChpLmUuLCAyIFNEcyBhYm92ZSB0aGUgbWVhbiksIHJlc3VsdGluZyBpbiBhIGNlaWxpbmcgZWZmZWN0IGZvciBib3RoIHNldHMgb2YgZmFjdG9yIHNjb3JlcywgYXMgYWxzbyBzaG93biBpbiBGaWd1cmUgMS4gSW4gYWRkaXRpb24sIGZvciB0aGUgbm90IHVuZm9yZ2l2ZW5lc3MgZmFjdG9yLCB0aGUgcHJlZGljdGVkIGl0ZW0gcmVzcG9uc2UgZ29lcyBiZWxvdyB0aGUgbG93ZXN0IHJlc3BvbnNlIG9wdGlvbiBqdXN0IGJlZm9yZSBhIGxhdGVudCBmYWN0b3Igc2NvcmUgb2YgLTMgKGkuZS4sIDMgU0RzIGJlbG93IHRoZSBtZWFuKSwgcmVzdWx0aW5nIGluIGEgZmxvb3IgZWZmZWN0IGZvciB0aGUgbm90IHVuZm9yZ2l2ZW5lc3MgZmFjdG9yLCBhcyBhbHNvIHNob3duIGluIEZpZ3VyZSAxLgoKVGhlIGV4dGVudCB0byB3aGljaCB0aGUgaXRlbXMgd2l0aGluIGVhY2ggZmFjdG9yIGNvdWxkIGJlIHNlZW4gYXMgZXhjaGFuZ2VhYmxlIHdhcyB0aGVuIGV4YW1pbmVkIHZpYSBhbiBhZGRpdGlvbmFsIHNldCBvZiBuZXN0ZWQgbW9kZWwgY29tcGFyaXNvbnMsIGFzIHJlcG9ydGVkIGluIFRhYmxlIDEgKGZvciBmaXQpIGFuZCBUYWJsZSAyIChmb3IgY29tcGFyaXNvbnMgb2YgZml0KS4gRmlyc3QsIHRoZSBhc3N1bXB0aW9uIG9mIHRhdS1lcXVpdmFsZW5jZSAoaS5lLiwgdHJ1ZS1zY29yZSBlcXVpdmFsZW5jZSwgZXF1YWwgZGlzY3JpbWluYXRpb24gYWNyb3NzIGl0ZW1zKSB3YXMgZXhhbWluZWQgYnkgY29uc3RyYWluaW5nIHRoZSBmYWN0b3IgbG9hZGluZ3MgdG8gYmUgZXF1YWwgd2l0aGluIGEgZmFjdG9yLiBGb3IgdGhlIG5vdCB1bmZvcmdpdmVuZXNzIGZhY3RvciwgdGhlIHRhdS1lcXVpdmFsZW50IG1vZGVsIGZpdCB3YXMgYWNjZXB0YWJsZSBidXQgd2FzIHNpZ25pZmljYW50bHkgd29yc2UgdGhhbiB0aGUgb3JpZ2luYWwgdHdvLWZhY3RvciBtb2RlbCBmaXQgKGkuZS4sIGluIHdoaWNoIGFsbCBsb2FkaW5ncyB3ZXJlIGVzdGltYXRlZCBmcmVlbHkpLiBGb3IgdGhlIGZvcmdpdmVuZXNzIGZhY3RvciwgaG93ZXZlciwgdGhlIHRhdS1lcXVpdmFsZW50IG1vZGVsIGZpdCB3YXMgYWNjZXB0YWJsZSBhbmQgd2FzIG5vdCBzaWduaWZpY2FudGx5IHdvcnNlIHRoYW4gdGhlIG9yaWdpbmFsIHR3by1mYWN0b3IgbW9kZWwgZml0LiBUaHVzLCB0aGUgYXNzdW1wdGlvbiBvZiB0YXUtZXF1aXZhbGVuY2UgaGVsZCBmb3IgdGhlIGZvcmdpdmVuZXNzIGZhY3RvciBpdGVtcyBvbmx5LiBGaW5hbGx5LCB0aGUgYXNzdW1wdGlvbiBvZiBwYXJhbGxlbCBpdGVtcyAoaS5lLiwgZXF1YWwgZmFjdG9yIGxvYWRpbmdzIGFuZCBlcXVhbCByZXNpZHVhbCB2YXJpYW5jZXMsIG9yIGVxdWFsIHJlbGlhYmlsaXR5IGFjcm9zcyBpdGVtcykgd2FzIGV4YW1pbmVkIGZvciB0aGUgZm9yZ2l2ZW5lc3MgZmFjdG9yIGl0ZW1zIG9ubHksIGFuZCB0aGUgcmVzdWx0aW5nIG1vZGVsIGZpdCB3YXMgYWNjZXB0YWJsZSBidXQgd2FzIHNpZ25pZmljYW50bHkgd29yc2UgdGhhbiB0aGUgdGF1LWVxdWl2YWxlbnQgZm9yZ2l2ZW5lc3MgZmFjdG9yIG1vZGVsIGZpdC4gVGh1cywgdGhlIGFzc3VtcHRpb24gb2YgcGFyYWxsZWwgaXRlbXMgZGlkIG5vdCBob2xkIGZvciB0aGUgZm9yZ2l2ZW5lc3MgZmFjdG9yIGl0ZW1zLiBJbiBzdW1tYXJ5LCB3aGlsZSB0aGUgbm90IHVuZm9yZ2l2ZW5lc3MgZmFjdG9yIGl0ZW1zIHdlcmUgbm90IGV4Y2hhbmdlYWJsZSwgdGhlIGZvcmdpdmVuZXNzIGZhY3RvciBpdGVtcyB3ZXJlIGV4Y2hhbmdlYWJsZSB3aXRoIHJlc3BlY3QgdG8gdGhlaXIgZmFjdG9yIGxvYWRpbmdzIG9ubHkgKGkuZS4sIGVxdWFsIGRpc2NyaW1pbmF0aW9uLCBidXQgbm90IGVxdWFsIHJlc2lkdWFsIHZhcmlhbmNlcyBvciByZWxpYWJpbGl0eSkuCgojIyMjIFJlZmVyZW5jZXM6CgpSIENvcmUgVGVhbSAoMjAxNykuIFI6IEEgbGFuZ3VhZ2UgYW5kIGVudmlyb25tZW50IGZvciBzdGF0aXN0aWNhbCBjb21wdXRpbmcuIFIgRm91bmRhdGlvbiBmb3IgU3RhdGlzdGljYWwgQ29tcHV0aW5nLCBWaWVubmEsCiAgQXVzdHJpYS4gVVJMIGh0dHBzOi8vd3d3LlItcHJvamVjdC5vcmcvLgogIApSb3NzZWVsLCBZICgyMDEyKS4gbGF2YWFuOiBBbiBSIFBhY2thZ2UgZm9yIFN0cnVjdHVyYWwgRXF1YXRpb24gTW9kZWxpbmcuICpKb3VybmFsIG9mIFN0YXRpc3RpY2FsIFNvZnR3YXJlKiwgNDgoMiksIDEtMzYuIFVSTAogIGh0dHA6Ly93d3cuanN0YXRzb2Z0Lm9yZy92NDgvaTAyLy4KICAKYGBge3IgY2l0ZSwgaW5jbHVkZT1UUlVFfQpjaXRhdGlvbigpCmNpdGF0aW9uKCJsYXZhYW4iKQpgYGAKCiMjIyBUYWJsZXMKCiMjIyMgVGFibGUgMTogTW9kZWwgRml0IFN0YXRpc3RpY3MgVXNpbmcgTUxSCgpgYGB7ciB0YWJsZTEsIGluY2x1ZGU9VFJVRSwgZWNobz1UUlVFfQpmaXRzdGF0czAxID0gZml0bWVhc3VyZXMob2JqZWN0ID0gbW9kZWwwMUVzdGltYXRlcykKZml0c3RhdHMwNCA9IGZpdG1lYXN1cmVzKG9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMpCmZpdHN0YXRzMDRBID0gZml0bWVhc3VyZXMob2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlc0FscGhhKQoKdGFibGUxID0gY2JpbmQobmNvbChtb2RlbDAxRXN0aW1hdGVzQFNhbXBsZVN0YXRzQGNvdltbMV1dKSwgZml0c3RhdHMwMVsxXSwgZml0c3RhdHMwMVs2XSwgZml0c3RhdHMwMVs5XSwgZml0c3RhdHMwMVs3XSwgZml0c3RhdHMwMVs4XSwgZml0c3RhdHMwMVsyNV0sCiAgICAgICAgICAgICAgIGZpdHN0YXRzMDFbNDhdLCBmaXRzdGF0czAxWzQ5XSwgZml0c3RhdHMwMVs1MF0sIGZpdHN0YXRzMDFbNTFdKQpjb2xuYW1lcyh0YWJsZTEpID0gYygiIyBJdGVtcyIsICIjIFBhcmFtZXRlcnMiLCAiU2NhbGVkIENoaS1TcXVhcmUiLCAiQ2hpLVNxdWFyZSBTY2FsZSBGYWN0b3IiLCAiREYiLCAicC12YWx1ZSIsICJDRkkiLCAiUk1TRUEiLCAiUk1TRUEgTG93ZXIiLCAKICAgICAgICAgICAgICAgICAgICAgIlJNU0VBIFVwcGVyIiwgIlJNU0VBIHAtdmFsdWUiKQpyb3duYW1lcyh0YWJsZTEpID0gIk9uZS1GYWN0b3IiCgp0YWJsZTEgPSByYmluZCh0YWJsZTEsIGNiaW5kKG5jb2wobW9kZWwwNEVzdGltYXRlc0BTYW1wbGVTdGF0c0Bjb3ZbWzFdXSksIGZpdHN0YXRzMDRbMV0sIGZpdHN0YXRzMDRbNl0sIGZpdHN0YXRzMDRbOV0sIGZpdHN0YXRzMDRbN10sIGZpdHN0YXRzMDRbOF0sCiAgICAgICAgICAgICAgICAgICAgICAgICBmaXRzdGF0czA0WzI1XSwgZml0c3RhdHMwNFs0OF0sIGZpdHN0YXRzMDRbNDldLCBmaXRzdGF0czA0WzUwXSwgZml0c3RhdHMwNFs1MV0pKQpyb3duYW1lcyh0YWJsZTEpWzJdID0gIlR3by1GYWN0b3IiCgp0YWJsZTEgPSByYmluZCh0YWJsZTEsIGNiaW5kKG5jb2wobW9kZWwwNEVzdGltYXRlc0BTYW1wbGVTdGF0c0Bjb3ZbWzFdXSksIGZpdHN0YXRzMDRBWzFdLCBmaXRzdGF0czA0QVs2XSwgZml0c3RhdHMwNEFbOV0sIGZpdHN0YXRzMDRBWzddLCBmaXRzdGF0czA0QVs4XSwKICAgICAgICAgICAgICAgICAgICAgICAgIGZpdHN0YXRzMDRBWzI1XSwgZml0c3RhdHMwNEFbNDhdLCBmaXRzdGF0czA0QVs0OV0sIGZpdHN0YXRzMDRBWzUwXSwgZml0c3RhdHMwNEFbNTFdKSkKcm93bmFtZXModGFibGUxKVszXSA9ICJUd28tRmFjdG9yIFRhdS1FcXVpdmFsZW50IgprYWJsZSh0YWJsZTEsIGZvcm1hdCA9ICJodG1sIiwgZGlnaXRzID0gMykgJT4lIGthYmxlX3N0eWxpbmcoInN0cmlwZWQiKQoKYGBgCgojIyMjIFRhYmxlIDI6IE1vZGVsIENvbXBhcmlzb25zCgpgYGB7ciB0YWJsZTIsIGluY2x1ZGU9VFJVRSwgZWNobz1UUlVFfQp0YWJsZTIgPSBhbm92YShtb2RlbFNhdHVyYXRlZEVzdGltYXRlcywgbW9kZWwwMUVzdGltYXRlcylbMiwtYygyOjQpXQpyb3duYW1lcyh0YWJsZTIpID0gIk9uZS1GYWN0b3IgdnMuIFNhdHVyYXRlZCIKCnRhYmxlMiA9IHJiaW5kKHRhYmxlMixhbm92YShtb2RlbDAxRXN0aW1hdGVzLCBtb2RlbDA0RXN0aW1hdGVzKVsyLC1jKDI6NCldKQpyb3duYW1lcyh0YWJsZTIpWzJdID0gIk9uZS1GYWN0b3IgdnMuIFR3by1GYWN0b3IiCgp0YWJsZTIgPSByYmluZCh0YWJsZTIsYW5vdmEobW9kZWxTYXR1cmF0ZWRFc3RpbWF0ZXMsIG1vZGVsMDRFc3RpbWF0ZXMpWzIsLWMoMjo0KV0pCnJvd25hbWVzKHRhYmxlMilbM10gPSAiVHdvLUZhY3RvciB2cy4gU2F0dXJhdGVkIgoKdGFibGUyID0gcmJpbmQodGFibGUyLGFub3ZhKG1vZGVsMDRFc3RpbWF0ZXNBbHBoYSwgbW9kZWwwNEVzdGltYXRlcylbMiwtYygyOjQpXSkKcm93bmFtZXModGFibGUyKVs0XSA9ICJUd28tRmFjdG9yIHZzLiBUd28tRmFjdG9yIFRhdS1FcXVpdmFsZW50IgoKa2FibGUodGFibGUyLCBmb3JtYXQgPSAiaHRtbCIsIGRpZ2l0cyA9IDMpICU+JSBrYWJsZV9zdHlsaW5nKCJzdHJpcGVkIikKYGBgCgojIyMjIFRhYmxlIDM6IE1vZGVsIEVzdGltYXRlcwoKYGBge3IgdGFibGUzLCBpbmNsdWRlPVRSVUUsIGVjaG89VFJVRX0KdW5zdGFuZGFyZGl6ZWRMb2FkaW5ncyA9IGluc3BlY3Qob2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcywgd2hhdCA9ICJlc3QiKQp1bnN0YW5kYXJkaXplZFNFID0gaW5zcGVjdChvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCB3aGF0ID0gInNlIikKc3RhbmRhcmRpemVkTG9hZGluZ3MgPSBpbnNwZWN0KG9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMsIHdoYXQgPSAic3RkLmFsbCIpCgp0YWJsZTMgPSBjYmluZCh1bnN0YW5kYXJkaXplZExvYWRpbmdzJGxhbWJkYVsxOjMsMV0sIHVuc3RhbmRhcmRpemVkU0UkbGFtYmRhWzE6MywxXSwgc3RhbmRhcmRpemVkTG9hZGluZ3MkbGFtYmRhWzE6MywxXSkKY29sbmFtZXModGFibGUzKSA9IGMoIkVzdGltYXRlIiwgIlNFIiwgIkVzdGltYXRlIikKcm93bmFtZXModGFibGUzKSA9IGMoIkl0ZW0gMiIsICJJdGVtIDQiLCAiSXRlbSA2IikKdGFibGUzID0gcmJpbmQodGFibGUzLCBjYmluZChjYmluZCh1bnN0YW5kYXJkaXplZExvYWRpbmdzJGxhbWJkYVs0OjYsMl0pLCBjYmluZCh1bnN0YW5kYXJkaXplZFNFJGxhbWJkYVs0OjYsMl0pLCBjYmluZChzdGFuZGFyZGl6ZWRMb2FkaW5ncyRsYW1iZGFbNDo2LDJdKSkpCnJvd25hbWVzKHRhYmxlMylbNDo2XSA9IGMoIkl0ZW0gMSIsICJJdGVtIDMiLCAiSXRlbSA1IikKdGFibGUzID0gcmJpbmQodGFibGUzLCBjKHVuc3RhbmRhcmRpemVkTG9hZGluZ3MkcHNpWzIsMV0sIHVuc3RhbmRhcmRpemVkU0UkcHNpWzIsMV0sIHN0YW5kYXJkaXplZExvYWRpbmdzJHBzaVsyLDFdKSkKcm93bmFtZXModGFibGUzKVs3XSA9ICJGYWN0b3IgQ292YXJpYW5jZSIKaW50ZXJjZXB0c09yZGVyID0gYyg0LDEsNSwyLDYsMykKdGFibGUzID0gcmJpbmQodGFibGUzLCBjYmluZChjYmluZCh1bnN0YW5kYXJkaXplZExvYWRpbmdzJG51WzE6NiwxXVtpbnRlcmNlcHRzT3JkZXJdKSwgY2JpbmQodW5zdGFuZGFyZGl6ZWRTRSRudVsxOjYsMV1baW50ZXJjZXB0c09yZGVyXSksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY2JpbmQoc3RhbmRhcmRpemVkTG9hZGluZ3MkbnVbMTo2LDFdW2ludGVyY2VwdHNPcmRlcl0pKSkKcm93bmFtZXModGFibGUzKVs4OjEzXSA9IHBhc3RlKCJJdGVtIiwgMTo2KQp0YWJsZTMgPSByYmluZCh0YWJsZTMsIGNiaW5kKGNiaW5kKGRpYWcodW5zdGFuZGFyZGl6ZWRMb2FkaW5ncyR0aGV0YSlbaW50ZXJjZXB0c09yZGVyXSksIGNiaW5kKGRpYWcodW5zdGFuZGFyZGl6ZWRTRSR0aGV0YSlbaW50ZXJjZXB0c09yZGVyXSksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY2JpbmQoZGlhZyhzdGFuZGFyZGl6ZWRMb2FkaW5ncyR0aGV0YSlbaW50ZXJjZXB0c09yZGVyXSkpKQoKcm93bmFtZXModGFibGUzKVsxNDoxOV0gPSBwYXN0ZSgiSXRlbSIsIDE6NikKCgprYWJsZSh0YWJsZTMsIGZvcm1hdCA9ICJodG1sIiwgZGlnaXRzID0gMykgJT4lIGthYmxlX3N0eWxpbmcoInN0cmlwZWQiKSAlPiUgYWRkX2hlYWRlcl9hYm92ZShjKCIgIiA9IDEsICJVbnN0YW5kYXJkaXplZCIgPSAyLCAiU3RhbmRhcmRpemVkIiA9IDEpKSAlPiUgZ3JvdXBfcm93cygiRm9yZ2l2ZW5lc3MgRmFjdG9yIExvYWRpbmdzIiwgMSwzKSAlPiUgZ3JvdXBfcm93cygiTm90IFVuZm9yZ2l2ZW5lc3MgRmFjdG9yIExvYWRpbmdzIiwgNCw2KSAlPiUgCiAgZ3JvdXBfcm93cygiRmFjdG9yIENvdmFyaWFuY2UiLCA3LDcpICU+JSBncm91cF9yb3dzKCJJdGVtIEludGVyY2VwdHMiLCA4LDEzKSAlPiUgZ3JvdXBfcm93cygiSXRlbSBVbmlxdWUgVmFyaWFuY2VzIiwgMTQsIDE5KQoKYGBgCgojIyMgRmlndXJlcyAKCiMjIyMgRmlndXJlIDE6IEZhY3RvciBTY29yZSBEaXN0cmlidXRpb25zCgpgYGB7ciwgaW5jbHVkZT1UUlVFLCBlY2hvPVRSVUV9CgojIEhpc3RvZ3JhbSBvdmVybGFpZCB3aXRoIGtlcm5lbCBkZW5zaXR5IGN1cnZlCmdncGxvdChmc2NvcmVzJHNjb3JlcywgYWVzKHg9U2l0UCkpICsgCiAgICBnZW9tX2hpc3RvZ3JhbShhZXMoeT0uLmRlbnNpdHkuLiksICAgICAgIyBIaXN0b2dyYW0gd2l0aCBkZW5zaXR5IGluc3RlYWQgb2YgY291bnQgb24geS1heGlzCiAgICAgICAgICAgICAgICAgICBiaW53aWR0aD0uNSwKICAgICAgICAgICAgICAgICAgIGNvbG91cj0iYmxhY2siLCBmaWxsPSJ3aGl0ZSIpICsgeGxpbShjKC00LDQpKSArIGxhYnModGl0bGUgPSAiUG9zaXRpdmUgU2l0dWF0aW9uIEZvcmdpdmVuZXNzIEZhY3RvciBTY29yZSIpICsKICAgIGdlb21fZGVuc2l0eShhbHBoYT0uMiwgZmlsbD0iI0ZGNjY2NiIpICAgICMgT3ZlcmxheSB3aXRoIHRyYW5zcGFyZW50IGRlbnNpdHkgcGxvdAoKIyBIaXN0b2dyYW0gb3ZlcmxhaWQgd2l0aCBrZXJuZWwgZGVuc2l0eSBjdXJ2ZQpnZ3Bsb3QoZnNjb3JlcyRzY29yZXMsIGFlcyh4PVNpdE4pKSArIAogICAgZ2VvbV9oaXN0b2dyYW0oYWVzKHk9Li5kZW5zaXR5Li4pLCAgICAgICMgSGlzdG9ncmFtIHdpdGggZGVuc2l0eSBpbnN0ZWFkIG9mIGNvdW50IG9uIHktYXhpcwogICAgICAgICAgICAgICAgICAgYmlud2lkdGg9LjUsCiAgICAgICAgICAgICAgICAgICBjb2xvdXI9ImJsYWNrIiwgZmlsbD0id2hpdGUiKSArIHhsaW0oYygtNCw0KSkgKyBsYWJzKHRpdGxlID0gIk5lZ2F0aXZlIFNpdHVhdGlvbiBGb3JnaXZlbmVzcyBGYWN0b3IgU2NvcmUiKSArCiAgICBnZW9tX2RlbnNpdHkoYWxwaGE9LjIsIGZpbGw9IiNGRjY2NjYiKSAgICAjIE92ZXJsYXkgd2l0aCB0cmFuc3BhcmVudCBkZW5zaXR5IHBsb3QKCmBgYAoKIyMjIyBGaWd1cmUgMiA6IEV4cGVjdGVkIEl0ZW0gUmVzcG9uc2UgUGxvdHMKCmBgYHtyIGZpZ3VyZTIsIGluY2x1ZGU9VFJVRSwgZWNobz1UUlVFfQpwYXIobWZyb3cgPSBjKDEsMikpCmNmYVBsb3RzKGxhdk9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMpCnBhcihtZnJvdyA9IGMoMSwxKSkKYGBgCgoK