EPSY 906/CLDP 948 Example 04
CFA Example Using Simulated Forgiveness of Situations (N = 1103)
The Forgiveness of Situations Subscale includes six items, three of which are reverse-coded, on a seven-point scale:
- When things go wrong for reasons that can’t be controlled, I get stuck in negative thoughts about it. (R)
- With time I can be understanding of bad circumstances in my life.
- If I am disappointed by uncontrollable circumstances in my life, I continue to think negatively about them. (R)
- I eventually make peace with bad situations in my life.
- It’s really hard for me to accept negative situations that aren’t anybody’s fault. (R)
- Eventually I let go of negative thoughts about bad circumstances that are beyond anyone’s control.
Response Anchors:
- 1 = Almost Always False of Me
- 2 = ?
- 3 = More Often False of Me
- 4 = ?
- 5 = More Often True of Me
- 6 = ?
- 7 = Almost Always True of Me
Note: the data for this example are simulated based on the results of the real data analysis. These results will be different than those reported in the other example file but are used to show you how to execute the syntax in this analysis.
Package Installation and Loading
For this example, we will be using the ggplot2 (for general plotting), melt2 (for data reshaping before plotting), and lavaan (for CFA) packages.
if (require(ggplot2)==FALSE){
install.packages("ggplot2")
}
library(ggplot2)
if (require(reshape2) == FALSE){
install.packages("reshape2")
}
if (require(lavaan) == FALSE){
install.packages("lavaan")
}
library(lavaan)
if (require(psych) == FALSE){
install.packages("psych")
}
if (require(knitr) == FALSE){
install.packages("knitr")
}
if (require(kableExtra) == FALSE){
install.packages("kableExtra")
}
if (require(semPlot) == FALSE){
install.packages("semPlot")
}Data Import into R
The data are in a text file named Study2.dat originally used in Mplus (so no column names were included at the top of the file). The file contains more items than we will use, so we select only the “Forgiveness of Situations” items from the whole file.
#syntax from previous example: commented to remove for simulation
# #read in data file (Mplus file format so having to label columns)
# hfsData = read.table(file = "Study2.dat", header = FALSE, na.strings = "99999", col.names = c("PersonID", "Self1", "Self2r", "Self3", "Self4r", "Self5", "Self6r", "Other1r", "Other2", "Other3r", "Other4", "Other5r", "Other6", "Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6", "Selfsub", "Othsub", "Sitsub", "HFSsum"))
#
# #select Situations items and PersonID variables
# hfsSituations = hfsData[c("PersonID", "Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")]
#setting seed for output constancy across machines
set.seed(04092017)
# simulating data for analysis based on results of model04estimates
model04Simulate = "
# SitP loadings (all estimated)
SitP =~ 1.007*Sit2 + 1.064*Sit4 + 0.956*Sit6
# SitN loadings (all estimated)
SitN =~ 1.325*Sit1r + 1.349*Sit3r + 1.009*Sit5r
# Unique Variances:
Sit1r ~~ 1.294*Sit1r; Sit2 ~~ 0.888*Sit2; Sit3r ~~ 0.724*Sit3r; Sit4 ~~ 0.835*Sit4; Sit5r ~~ 1.926*Sit5r; Sit6 ~~ 1.428*Sit6;
# Item Intercepts:
Sit2 ~ 5.289*1
Sit4 ~ 5.359*1
Sit6 ~ 5.321*1
Sit1r ~ 4.547*1
Sit3r ~ 4.896*1
Sit5r ~ 4.860*1
# Factor Covariances
SitP ~~ .564*SitN
"
#generate data
hfsSituations = simulateData(model = model04Simulate, sample.nobs = 1103L, model.type = "sem")
#add ID variable
hfsSituations = data.frame(PersonID = 1:1103, hfsSituations)
#reorder variables to match data file
hfsSituations = hfsSituations[c("PersonID", "Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")]Observed Sample Statistics
Sample Correlation Matrix
The observed correlation matrix, rounded to three digits:
#here the c() function selects only the variables, not the PersionID variable
round(cor(hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")]), digits = 3) Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 1.000 0.360 0.658 0.348 0.450 0.284
Sit2 0.360 1.000 0.412 0.588 0.257 0.464
Sit3r 0.658 0.412 1.000 0.400 0.497 0.315
Sit4 0.348 0.588 0.400 1.000 0.277 0.440
Sit5r 0.450 0.257 0.497 0.277 1.000 0.193
Sit6 0.284 0.464 0.315 0.440 0.193 1.000Sample Means and Variances
The observed means, rounded to three digits:
apply(X = hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")], MARGIN = 2, FUN = function(x) round(mean(x), digits = 3))Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
4.443 5.287 4.778 5.314 4.761 5.263 The observed variances (using \(N\) in the denominator to match ML estimated output and Mplus example), rounded to three digits:
apply(X = hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")], MARGIN = 2, FUN = function(x) round(var(x, na.rm = TRUE)*1102/1103, digits = 3))Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
3.209 2.007 2.616 1.976 2.979 2.281 Sample Covariances
To do a CFA analysis, you only really need means, variances, and either correlations or covariances among items. That said, modern methods of estimation use the raw data (often called full information) rather than the summary statistics as the raw data enable better missing data assumptions when using maximum likelihood and Bayesian estimation methods.
The sample covariance matrix can be found from the sample correlations and variances. Each covariance between a pair of variables \(y_1\) and \(y_2\) is denoted with a \(\sigma_{y_1, y_2}\) and each correlation is denoted with a \(\rho_{y_1, y_2}\). The variance of a variable is denoted by \(\sigma^2_{y_1}\) and the standard deviation of a variable is the square root of the variance \(\sqrt{\sigma^2_{y_1}}\). The covariance can be found by taking the correlation and multiplying it by the product of the standard deviations.
\[\sigma_{y_1, y_2} = \rho_{y_1, y_2}\sqrt{\sigma^2_{y_1}}\sqrt{\sigma^2_{y_2}}. \]
Inversely, the correlation can be found by taking the covariance and dividing it by the product of the standard deviations:
\[\rho_{y_1, y_2} = \frac{\sigma_{y_1, y_2}}{\sqrt{\sigma^2_{y_1}}\sqrt{\sigma^2_{y_2}}}. \] Again, we change the denominator from \(N-1\) to \(N\) to be consistent with the Mplus example, which calculates covariances using maximum likelihood.
round(cov(hfsSituations[c("Sit1r", "Sit2", "Sit3r", "Sit4", "Sit5r", "Sit6")])*1102/1103, digits = 3) Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 3.209 0.914 1.905 0.876 1.391 0.768
Sit2 0.914 2.007 0.945 1.170 0.629 0.994
Sit3r 1.905 0.945 2.616 0.909 1.386 0.769
Sit4 0.876 1.170 0.909 1.976 0.673 0.934
Sit5r 1.391 0.629 1.386 0.673 2.979 0.502
Sit6 0.768 0.994 0.769 0.934 0.502 2.281Sample Item Response Distributions
The assumptions of CFA (i.e., normally distributed factors, no item-level factor interactions, and conditionally normal distributed items) lead to the overall assumption that our item responses must be normally distributed. From the histograms below, do you think these are normally distributed?
#stack data
melted = melt(hfsSituations, id.vars = "PersonID")
#plot by variable
ggplot(melted, aes(value)) + geom_density() + facet_wrap(~ variable)
Lavaan Syntax
lavaan syntax is constructed using a long text string and saved in a character object. In the example below model01SyntaxLong = " opens the text string, which continues for multiple lines until the final " terminates the string. The variable model01Syntax now contains the text of the lavaan syntax. Within the syntax string, the R comment character # still functions to comment text around the syntax. Each part of the model syntax corresponds to a set of parameters in the CFA model. You can find information about lavaan at http://lavaan.ugent.be.
model01SyntaxLong = "
# Model 1 -- Fully Z-Scored Factor Identification Approach
# Item factor loadings --> list the factor to the left of the =~ and the items to the right, separated by a plus
# Once the factor is defined it can be used in syntax as if it is an observed variable
# Parameters can be fixed to constant values by using the * command; starting values can be specified by using start()*; labels can be implemented with []
Sit =~ Sit1r + Sit2 + Sit3r + Sit4 + Sit5r + Sit6
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item error (unique) variances and covariances --> use the ~~ command
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Factor variance
Sit ~~ 100*Sit
# Factor mean (intercept)
Sit ~ 0
"To run lavaan, the syntax string variable is passed to the lavaan(model = model01SyntaxLong, ...) function. In the function call, we also supply:
data = hfsSituations: The data frame which contains the variables in the syntax.estimator = "MLR": Enables the use of robust maximum likelihood estimation, which helps for data that are not entirely normal.mimic = "mplus": Ensures compatibility with Mplus output, which is often needed in practice (and is certainly needed for our homework system).std.lv = TRUE: Uses the Z-score method of identification, setting all latent variable means to zero, all latent variable variances to one, and estimating all factor loadings.
model01Estimates = lavaan(model = model01SyntaxLong, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = FALSE)If the model estimation was successful, no errors would be displayed (and no output would be shown). All model information and results are contained within the model01Estimates object. To access a summary of the results use the summary() function with the following arguments:
model01Estimates: The analysis to be summarized.fit.measures=TRUE: Provides model fit indices in summary.rsqaure=TRUE: Provides the proportion of variance “explained” for each variable (\(R^2\)).standardized = TRUE: Provides standardized estimates in the summary.
summary(model01Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 39 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 387.333 467.448
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 0.829
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.817 0.779
Tucker-Lewis Index (TLI) 0.694 0.632
Robust Comparative Fit Index (CFI) 0.816
Robust Tucker-Lewis Index (TLI) 0.693
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11535.690 -11535.690
Scaling correction factor 1.076
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23107.380 23107.380
Bayesian (BIC) 23197.484 23197.484
Sample-size adjusted Bayesian (BIC) 23140.311 23140.311
Root Mean Square Error of Approximation:
RMSEA 0.195 0.215
90 Percent Confidence Interval 0.179 0.212 0.197 0.233
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.196
90 Percent Confidence Interval 0.181 0.211
Standardized Root Mean Square Residual:
SRMR 0.079 0.079
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 0.132 0.006 21.977 0.000 1.317 0.735
Sit2 0.084 0.006 14.718 0.000 0.844 0.596
Sit3r 0.129 0.006 23.254 0.000 1.287 0.796
Sit4 0.082 0.006 14.340 0.000 0.824 0.586
Sit5r 0.097 0.006 17.607 0.000 0.970 0.562
Sit6 0.072 0.006 12.137 0.000 0.720 0.477
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.443 0.054 82.373 0.000 4.443 2.480
.Sit2 5.287 0.043 123.919 0.000 5.287 3.731
.Sit3r 4.778 0.049 98.116 0.000 4.778 2.954
.Sit4 5.314 0.042 125.550 0.000 5.314 3.780
.Sit5r 4.761 0.052 91.624 0.000 4.761 2.759
.Sit6 5.263 0.045 115.739 0.000 5.263 3.485
Sit 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.475 0.108 13.649 0.000 1.475 0.460
.Sit2 1.294 0.082 15.747 0.000 1.294 0.645
.Sit3r 0.959 0.093 10.279 0.000 0.959 0.367
.Sit4 1.298 0.081 16.072 0.000 1.298 0.657
.Sit5r 2.037 0.108 18.787 0.000 2.037 0.684
.Sit6 1.762 0.088 20.034 0.000 1.762 0.772
Sit 100.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.540
Sit2 0.355
Sit3r 0.633
Sit4 0.343
Sit5r 0.316
Sit6 0.228Each section contains different portions of model information.
Unstandardized Model Parameter Estmates
FACTOR LOADINGS (regression slopes of item response on factor)
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.234 0.069 17.906 0.000 1.234 0.707
Sit2 0.702 0.074 9.441 0.000 0.702 0.509
Sit3r 1.241 0.063 19.847 0.000 1.241 0.778
Sit4 0.784 0.069 11.333 0.000 0.784 0.559
Sit5r 1.023 0.053 19.179 0.000 1.023 0.596
Sit6 0.819 0.069 11.942 0.000 0.819 0.535Intercepts (of Items) – HERE, ARE ACTUAL ITEM MEANS BECAUSE FACTOR MEAN IS ZERO
Note: the last term in the list, Sit is the “intercept” (mean) of the factor. As it does not have a standard error, this indicates it was fixed to zero and not estimated.
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.547 0.053 86.474 0.000 4.547 2.604
.Sit2 5.289 0.042 127.346 0.000 5.289 3.834
.Sit3r 4.896 0.048 101.959 0.000 4.896 3.070
.Sit4 5.359 0.042 126.896 0.000 5.359 3.821
.Sit5r 4.860 0.052 94.060 0.000 4.860 2.832
.Sit6 5.321 0.046 115.492 0.000 5.321 3.477
Sit 0.000 0.000 0.000Residual (Unique) Variances (variance of error terms)
Note: the last term in the list, Sit, is the variance of the factor. As it does not have a standard error, this indicates it was fixed to one (from the std.lv = TRUE option we used in the lavaan() function call) and not estimated.
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.526 0.149 10.217 0.000 1.526 0.500
.Sit2 1.409 0.128 11.014 0.000 1.409 0.741
.Sit3r 1.004 0.135 7.456 0.000 1.004 0.395
.Sit4 1.352 0.127 10.672 0.000 1.352 0.687
.Sit5r 1.899 0.118 16.025 0.000 1.899 0.645
.Sit6 1.671 0.159 10.517 0.000 1.671 0.714
Sit 1.000 1.000 1.000Making use of the unstandardized model estimates:
Writing out the model—individual predicted values:
- \(Y_1 = \mu_1 + \lambda_1F + e_1 = 4.547 + 1.234F + e_1\)
Writing out the model—predicted item variances and covariances:
\(Var\left( Y_1 \right) = \left( \lambda^2_1 \right) Var\left(F\right) + Var\left(e_1\right) = (1.234^2)*(1) + 1.526 = 3.049\) (= original item variance)
\(Cov\left( Y_1, Y_2 \right) = \lambda_1 Var\left(F\right) \lambda_2 = (1.234)*(1)*(.702) = .866\) (actual covariance = .577, so the model over-predicted how related items 1 and 2 should be)
Plotting Path Diagrams
The R package semPlot helps provide a path diagram of a model. Here is an example:
semPaths(object = model01Estimates, what = "est")
Standardized Model Parameter Estimates
The last two columns of the summary output, Std.lv and Std.all, contain the standardized model parameter estimates. To understand the difference between standardized and unstandardized parameter estimates, let’s start with the standardized estimates. Standardized regression coefficients (and factor loadings) have a scale that is “units of Y” per “unit of X”. That is, the slope/loading, represents the increase in the dependent variable \(X\) per unit of the independent variable \(X\) (in our case, the factor). The units of \(Y\) are given by the standard deviation of \(Y\), or \(SD(Y)\). Similarly, the units of \(X\) are given by the standard deviation of \(X\), or \(SD(X)\). You can think of the units associated by the fraction \(\frac{SD(Y)}{SD(X)}\). So, the first factor loading (a value of 1.234 for the item Sit1r) indicates the numeric response to the item goes up by 1.234 for every one-unit increase in the factor Sit.
The process of standardization removes the units attached to the parameter. So, if the unstandardized factor loadings are expressed in units of \(\frac{SD(Y)}{SD(X)}\), the standardized units are achieved by either dividing or multiplying by the appropriate standard deviation to make the numerator or denominator of \(\frac{SD(Y)}{SD(X)}\) equal to one. For the standardized estimates under std.lv, the units of the factor \((SD(X))\) are removed (yielding \(\frac{SD(Y)}{1}\)) by multiplying the estimate by the factor standard deviation. Because the factor standard deviation is set to one, all estimates in this column are the same as the unstandardized estimate. These unstandardized estimates can be used to see how parameters would look under the Z-score identification method another identification method was used.
The standardized estimates listed under std.all are formed by multiplying the estimate by the standard deviation of the factor and dividing that by the unconditional (raw) standard deviation of the item. For instance, the “fully” standardized factor loading of the first item is found by multiplying the unstandardized coefficient (1.234) by one (the factor standard deviation) and dividing by the item’s standard deviation (\(\sqrt{3.049}\) – the square root of the item variance shown at the beginning of this example). The resulting value, \(1.234\times\frac{1}{\sqrt{3.049}} = 0.707\), represents the factor loading would the analysis have been run (a) with a Z-score factor identification and (b) on an item that was a Z-score.
The process of standardization is the same for all parameters of the model: intercepts, loadings, and residual (unique) variances. The interpretation of standardized item intercepts is difficult and often these are not reported. The standardized versions of factor loadings and unique variances are commonly reported.
Moreover, in for items measuring one factor, the standardized loadings lead directly to the \(R^2\) estimate – the amount of variance in the item responses explained by the factor. The item \(R^2\) is found by the square of the unstandardized factor loading. The R-Square information is found at the end of the model summary, so long as the option rsquare = TRUE is specified in the summary() function call.
R-Square:
Estimate
Sit1r 0.500
Sit2 0.259
Sit3r 0.605
Sit4 0.313
Sit5r 0.355
Sit6 0.286Shortening Lavaan Syntax: Lavaan Default Options
The syntax above is designed to show the mapping of all CFA parameters to all lavaan syntax elements. In reality, all you would need to write to define this model is:
model01SyntaxShort = "
Sit =~ Sit1r + Sit2 + Sit3r + Sit4 + Sit5r + Sit6
"The syntax input into the sem() function uses some defaults:
- All item intercepts are estimated (each item gets its own) and the factor mean is fixed at zero.
- All item error (unique) variances are estimated (each item gets its own).
- All factor variances and covariances are estimated (to do so, the first item after the =~ has its factor loading set to 1 – a marker item identification method)
Similarly, to run this syntax the sem function is now called. To see the results, the summary function is used. The sem function simplifies the syntax needed to conduct a confirmatory factor analysis. These are demonstrated below. Note the output is identical to what was run previously.
model01EstimatesShort = sem(model = model01SyntaxShort, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model01EstimatesShort, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 20 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 387.333 467.448
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 0.829
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.817 0.779
Tucker-Lewis Index (TLI) 0.694 0.632
Robust Comparative Fit Index (CFI) 0.816
Robust Tucker-Lewis Index (TLI) 0.693
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11535.690 -11535.690
Scaling correction factor 1.076
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23107.380 23107.380
Bayesian (BIC) 23197.484 23197.484
Sample-size adjusted Bayesian (BIC) 23140.311 23140.311
Root Mean Square Error of Approximation:
RMSEA 0.195 0.215
90 Percent Confidence Interval 0.179 0.212 0.197 0.233
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.196
90 Percent Confidence Interval 0.181 0.211
Standardized Root Mean Square Residual:
SRMR 0.079 0.079
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.317 0.060 21.977 0.000 1.317 0.735
Sit2 0.844 0.057 14.718 0.000 0.844 0.596
Sit3r 1.287 0.055 23.255 0.000 1.287 0.796
Sit4 0.824 0.057 14.340 0.000 0.824 0.586
Sit5r 0.970 0.055 17.607 0.000 0.970 0.562
Sit6 0.720 0.059 12.137 0.000 0.720 0.477
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.443 0.054 82.373 0.000 4.443 2.480
.Sit2 5.287 0.043 123.919 0.000 5.287 3.731
.Sit3r 4.778 0.049 98.116 0.000 4.778 2.954
.Sit4 5.314 0.042 125.550 0.000 5.314 3.780
.Sit5r 4.761 0.052 91.624 0.000 4.761 2.759
.Sit6 5.263 0.045 115.739 0.000 5.263 3.485
Sit 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.475 0.108 13.649 0.000 1.475 0.460
.Sit2 1.294 0.082 15.747 0.000 1.294 0.645
.Sit3r 0.959 0.093 10.279 0.000 0.959 0.367
.Sit4 1.298 0.081 16.072 0.000 1.298 0.657
.Sit5r 2.037 0.108 18.787 0.000 2.037 0.684
.Sit6 1.762 0.088 20.034 0.000 1.762 0.772
Sit 1.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.540
Sit2 0.355
Sit3r 0.633
Sit4 0.343
Sit5r 0.316
Sit6 0.228Alternative Identification Methods
There are multiple equivalent ways of getting the same CFA model, but with different scaling for the factor mean and variance (i.e., different means of identification). Now let’s see the model parameters when using the marker item for model identification instead. In the marker item identification method:
- The first factor loading of a factor (the first variable after the
=~symbol inlavaansyntax) is set to one - The factor variance is estimated
- The factor mean is set to zero
- All item intercepts and unique variances are estimated (as done in the Z-score identification method)
Factor Mean Zero; Factor Variance Estimated (marker item factor loading)
The lavaan syntax is the same for the marker item identification, but the call to the lavaan() function does not include the std.lv = TRUE option, which defaults to the marker item method of identification:
model02Estimates = sem(model = model01SyntaxShort, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(model02Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 26 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 387.333 467.449
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 0.829
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.817 0.779
Tucker-Lewis Index (TLI) 0.694 0.632
Robust Comparative Fit Index (CFI) 0.816
Robust Tucker-Lewis Index (TLI) 0.693
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11535.690 -11535.690
Scaling correction factor 1.076
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23107.380 23107.380
Bayesian (BIC) 23197.484 23197.484
Sample-size adjusted Bayesian (BIC) 23140.311 23140.311
Root Mean Square Error of Approximation:
RMSEA 0.195 0.215
90 Percent Confidence Interval 0.179 0.212 0.197 0.233
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.196
90 Percent Confidence Interval 0.181 0.211
Standardized Root Mean Square Residual:
SRMR 0.079 0.079
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.000 1.317 0.735
Sit2 0.641 0.060 10.741 0.000 0.844 0.596
Sit3r 0.977 0.036 27.335 0.000 1.287 0.796
Sit4 0.625 0.059 10.586 0.000 0.824 0.586
Sit5r 0.737 0.041 17.832 0.000 0.970 0.562
Sit6 0.547 0.058 9.445 0.000 0.720 0.477
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.443 0.054 82.373 0.000 4.443 2.480
.Sit2 5.287 0.043 123.919 0.000 5.287 3.731
.Sit3r 4.778 0.049 98.116 0.000 4.778 2.954
.Sit4 5.314 0.042 125.550 0.000 5.314 3.780
.Sit5r 4.761 0.052 91.624 0.000 4.761 2.759
.Sit6 5.263 0.045 115.739 0.000 5.263 3.485
Sit 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.475 0.108 13.649 0.000 1.475 0.460
.Sit2 1.294 0.082 15.747 0.000 1.294 0.645
.Sit3r 0.959 0.093 10.279 0.000 0.959 0.367
.Sit4 1.298 0.081 16.072 0.000 1.298 0.657
.Sit5r 2.037 0.108 18.787 0.000 2.037 0.684
.Sit6 1.762 0.088 20.034 0.000 1.762 0.772
Sit 1.734 0.158 10.988 0.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.540
Sit2 0.355
Sit3r 0.633
Sit4 0.343
Sit5r 0.316
Sit6 0.228Unstandardized Model Results
FACTOR LOADINGS (regression slopes of item response on factor)
Here, loading for SIT1R is not tested and has no standard error (Std.Err) because it is fixed to one. Also, note the Std.lv estimates are identical to the unstandardized estimates in the Z-score factor identification method. Further, the Std.all estimates are equal to the Std.all estimates in the Z-score factor identification method. These will be equal for all identification methods.
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.000 1.317 0.735
Sit2 0.641 0.060 10.741 0.000 0.844 0.596
Sit3r 0.977 0.036 27.335 0.000 1.287 0.796
Sit4 0.625 0.059 10.586 0.000 0.824 0.586
Sit5r 0.737 0.041 17.832 0.000 0.970 0.562
Sit6 0.547 0.058 9.445 0.000 0.720 0.477Intercepts (of Items) – EXPECTED Y WHEN FACTOR = 0, or for mean of factor in sample
Here, all are identical to what was found in the previous Z-score standardization. That is because we left the factor mean to be zero.
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 4.443 0.054 82.373 0.000 4.443 2.480
.Sit2 5.287 0.043 123.919 0.000 5.287 3.731
.Sit3r 4.778 0.049 98.116 0.000 4.778 2.954
.Sit4 5.314 0.042 125.550 0.000 5.314 3.780
.Sit5r 4.761 0.052 91.624 0.000 4.761 2.759
.Sit6 5.263 0.045 115.739 0.000 5.263 3.485
Sit 0.000 0.000 0.000Residual (unique) variances and factor variance
Here, the factor variance is estimated, which is different from the previous identification method.
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.475 0.108 13.649 0.000 1.475 0.460
.Sit2 1.294 0.082 15.747 0.000 1.294 0.645
.Sit3r 0.959 0.093 10.279 0.000 0.959 0.367
.Sit4 1.298 0.081 16.072 0.000 1.298 0.657
.Sit5r 2.037 0.108 18.787 0.000 2.037 0.684
.Sit6 1.762 0.088 20.034 0.000 1.762 0.772
Sit 1.734 0.158 10.988 0.000 1.000 1.000Estimating Factor Means: Marker Item Loading (=1) and Marker Item Intercept (=0)
To estimate this model, we have to return to the general lavaan model function. In the syntax below you see 1*Sit1r, setting the factor loading for Sit1r to one (the marker item factor loading). Further, you see Sit1r ~ 0 setting the item intercept of Sit1r to zero, the marker item intercept. Finally, to estimate the factor mean, we use Sit ~ 1, which estimates the factor mean explicitly.
model03Syntax = "
# Model 1 -- Fully Z-Scored Factor Identification Approach
# Item factor loadings --> list the factor to the left of the =~ and the items to the right, separated by a plus
# Once the factor is defined it can be used in syntax as if it is an observed variable
# Parameters can be fixed to constant values by using the * command; starting values can be specified by using start()*; labels can be implemented with []
Sit =~ 1*Sit1r + Sit2 + Sit3r + Sit4 + Sit5r + Sit6
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 0; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item error (unique) variances and covariances --> use the ~~ command
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Factor variance
Sit ~~ Sit
# Factor mean (intercept)
Sit ~ 1
"
model03Estimates = sem(model = model03Syntax, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(model03Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 54 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 387.333 467.447
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 0.829
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.817 0.779
Tucker-Lewis Index (TLI) 0.694 0.632
Robust Comparative Fit Index (CFI) 0.816
Robust Tucker-Lewis Index (TLI) 0.693
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11535.690 -11535.690
Scaling correction factor 1.076
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction
Number of free parameters 18 18
Akaike (AIC) 23107.380 23107.380
Bayesian (BIC) 23197.484 23197.484
Sample-size adjusted Bayesian (BIC) 23140.311 23140.311
Root Mean Square Error of Approximation:
RMSEA 0.195 0.215
90 Percent Confidence Interval 0.179 0.212 0.197 0.233
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.196
90 Percent Confidence Interval 0.181 0.211
Standardized Root Mean Square Residual:
SRMR 0.079 0.079
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
Sit =~
Sit1r 1.000 1.317 0.735
Sit2 0.641 0.060 10.741 0.000 0.844 0.596
Sit3r 0.977 0.036 27.335 0.000 1.287 0.796
Sit4 0.625 0.059 10.586 0.000 0.824 0.586
Sit5r 0.737 0.041 17.832 0.000 0.970 0.562
Sit6 0.547 0.058 9.445 0.000 0.720 0.477
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 0.000 0.000 0.000
.Sit2 2.438 0.268 9.112 0.000 2.438 1.720
.Sit3r 0.436 0.162 2.682 0.007 0.436 0.269
.Sit4 2.536 0.265 9.558 0.000 2.536 1.804
.Sit5r 1.488 0.192 7.768 0.000 1.488 0.862
.Sit6 2.833 0.261 10.862 0.000 2.833 1.876
Sit 4.443 0.054 82.373 0.000 3.374 3.374
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 1.475 0.108 13.649 0.000 1.475 0.460
.Sit2 1.294 0.082 15.747 0.000 1.294 0.645
.Sit3r 0.959 0.093 10.279 0.000 0.959 0.367
.Sit4 1.298 0.081 16.072 0.000 1.298 0.657
.Sit5r 2.037 0.108 18.787 0.000 2.037 0.684
.Sit6 1.762 0.088 20.034 0.000 1.762 0.772
Sit 1.734 0.158 10.988 0.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.540
Sit2 0.355
Sit3r 0.633
Sit4 0.343
Sit5r 0.316
Sit6 0.228Here, you will note the model is identical to the previous two – the log-likelihood is 11535.690, same as previously. Now, the intercepts has the mean of item Sit1r set to zero and the mean of the factor estimated.
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r 0.000 0.000 0.000
.Sit2 2.438 0.268 9.112 0.000 2.438 1.720
.Sit3r 0.436 0.162 2.682 0.007 0.436 0.269
.Sit4 2.536 0.265 9.558 0.000 2.536 1.804
.Sit5r 1.488 0.192 7.768 0.000 1.488 0.862
.Sit6 2.833 0.261 10.862 0.000 2.833 1.876
Sit 4.443 0.054 82.373 0.000 3.374 3.374The mean of the factor is 4.443, which, in this case, is the mean of item Sit1r. That is because the factor loading of the item is set to 1.0. You will also notice that the other item intercepts have changed from previous models. In general, an item’s mean is found by adding the item intercept to the product of the factor loading times the factor mean, or \(\mu_i + \lambda_i\mu_F\).
Model Fit Information for a Single-Factor Model (same regardless of factor scaling method):
Calculating model degrees of freedom (v is number of observed variables in a model):
- Total df = \(\frac{v(v+1)}{2} + v = 27\)
- Number of parameters in our model: 18
- Degrees of freedom = 27-18 = 9
Loglikelihood – use for testing differences in model fit across nested models
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11535.690 -11535.690
Scaling correction factor 1.076
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction- Loglikelihood user model (H0): this is for your specified model
- Scaling correction factor for the MLR correction: indicates how far off from normal=1
- H1 Value: this is for a saturated (perfect) model
Information Criteria “smaller is better” – use for nested or non-nested model comparisons
Number of free parameters 18 18
Akaike (AIC) 23107.380 23107.380
Bayesian (BIC) 23197.484 23197.484
Sample-size adjusted Bayesian (BIC) 23140.311 23140.311- is # of estimated parameters (“free” to be not 0)
- AIC = (-2\(LL_{H0}\)) + (2estimated parameters)
- BIC = (-2\(LL_{H0}\)) + (LN Nestimated parameters)
- Sample-size adjusted Bayesian (BIC) = BIC replacing N with (N + 2) / 24
Chi-Square Test of Model Fit (Significance is bad here) for your specified model
Estimator ML Robust
Minimum Function Test Statistic 387.333 467.447
Degrees of freedom 9 9
P-value (Chi-square) 0.000 0.000
Scaling correction factor 0.829
for the Yuan-Bentler correction (Mplus variant)- Estimator: Look at robust column for MLR version of test
- Minimum Function Test Statistic: leftover after estimating our one-factor model
- Scaling correction factor for the Yuan-Bentler correction (Mplus variant): indicates how far off from normal=1
Where does this \(\chi^2\) value for “model fit” come from? A rescaled −2LL model comparison of this one-factor model (H0) against the saturated model (H1) that perfectly reproduces the data covariances.
Where the Saturated (H1) Model Comes From: All Means, Variances, and Covariances Estimated
How to fit the saturated (Unstructured) Baseline Model: Item means, variances, and covariances in original data:
modelSaturated = "
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item variances and covariances --> use the ~~ command
# Variances:
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Covariances:
Sit1r ~~ Sit2; Sit1r ~~ Sit3r; Sit1r ~~ Sit4; Sit1r ~~ Sit5r; Sit1r ~~ Sit6;
Sit2 ~~ Sit3r; Sit2 ~~ Sit4; Sit2 ~~ Sit5r; Sit2 ~~ Sit6;
Sit3r ~~ Sit4; Sit3r ~~ Sit5r; Sit3r ~~ Sit6;
Sit4 ~~ Sit5r; Sit4 ~~ Sit6;
Sit5r ~~ Sit6;
"
modelSaturatedEstimates = sem(model = modelSaturated, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(modelSaturatedEstimates, fit.measures = TRUE)Note that H0 and H1 are now the same! Our H0 model IS the H1 saturated model: the log-likelihood of H0 and H1 are the same. Also, note there are 27 free parameters (six item means, six item variances, and 15 covariances).
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11342.023 -11342.023
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Number of free parameters 27 27
Akaike (AIC) 22738.046 22738.046
Bayesian (BIC) 22873.202 22873.202
Sample-size adjusted Bayesian (BIC) 22787.444 22787.444Also note how the model \(\chi^2\) test has zero degrees of freedom: this is because all 27 possible free parameters were estimated. This model fits the data perfectly.
Estimator ML Robust
Minimum Function Test Statistic 0.000 0.000
Degrees of freedom 0 0
Minimum Function Value 0.0000000000000
Scaling correction factor NA
for the Yuan-Bentler correction (Mplus variant)The Rest of the One-Factor Model Fit Statistics
User model versus baseline model:
Comparative Fit Index (CFI) 0.817 0.779
Tucker-Lewis Index (TLI) 0.694 0.632
Robust Comparative Fit Index (CFI) 0.816
Robust Tucker-Lewis Index (TLI) 0.693
Root Mean Square Error of Approximation:
RMSEA 0.195 0.215
90 Percent Confidence Interval 0.179 0.212 0.197 0.233
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.196
90 Percent Confidence Interval 0.181 0.211
Standardized Root Mean Square Residual:
SRMR 0.079 0.079- CFI/TLI: Want close to one (1 = saturated model)
- RMSEA: Want close to zero (0 = saturated model)
- SRMR (Standardized Root Mean Square Residual): want close to zero (0 = saturated model)
Chi-Square Test of Model Fit for the Baseline Model (for the “no covariances” model)
This compares the estimated model to the one that has no covariances. It is a last-resort type model in that if the estimated model has a test with a non-significant p-value, then this indicates there will be no factors to be found in the data.
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000Where does this \(\chi^2\) value for “fit of the baseline model” come from? A rescaled −2LL model comparison of the independence model with NO covariances to the saturated model.
What’s the point? This baseline model fit test tells us whether there are any covariances at all (i.e., whether it even makes sense to try to fit latent factors to predict them).
How to fit the Independence (Null) Baseline Model: Item means and variances, but NO covariances
modelIndependence = "
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item variances and covariances --> use the ~~ command
# Variances:
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
"
modelIndependenceEstimates = sem(model = modelIndependence, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(modelIndependenceEstimates, fit.measures = TRUE)Note how the test of the model vs. saturated is identical to the test of the model vs. baseline: that indicates this model is the baseline model.
Although not 0, this is the worst possible RMSEA while still allowing separate means and variances per item in these data. RMSEA is a parsimony-corrected absolute fit index (so, its fit is relative to the saturated model).
CFI and TLI are 0 because they are “incremental fit” indices relative to the independence model (which this is).
SRMR is also an absolute fit index (relative to saturated model), so this is the worst it gets for these data, too.
Poor Model Fit: Need for Model Modifications
For this section, any of the three equivalent single factor models can be used.
Modification Indices
So global fit for the one-factor model is not so good (RMSEA = .173, CFI = .732). What do the voodoo modification indices suggest we do to fix it? To get modification indices, use the modificationindices() function. Here, the function is called with options:
object = model01Estimates: The model estimates object from which to derive modification indices.sort. = TRUE: Sort the output from highest to lowest modification index.
modificationindices(object = model01Estimates, sort. = TRUE) lhs op rhs mi mi.scaled epc sepc.lv sepc.all sepc.nox
27 Sit2 ~~ Sit4 202.064 243.858 0.648 0.648 0.325 0.325
22 Sit1r ~~ Sit3r 146.031 176.235 0.890 0.890 0.307 0.307
29 Sit2 ~~ Sit6 89.803 108.377 0.482 0.482 0.225 0.225
34 Sit4 ~~ Sit6 69.493 83.867 0.423 0.423 0.199 0.199
30 Sit3r ~~ Sit4 47.610 57.457 -0.356 -0.356 -0.157 -0.157
23 Sit1r ~~ Sit4 45.765 55.230 -0.380 -0.380 -0.151 -0.151
26 Sit2 ~~ Sit3r 43.491 52.487 -0.344 -0.344 -0.150 -0.150
21 Sit1r ~~ Sit2 42.222 50.955 -0.368 -0.368 -0.145 -0.145
32 Sit3r ~~ Sit6 31.735 38.299 -0.308 -0.308 -0.126 -0.126
31 Sit3r ~~ Sit5r 23.728 28.635 0.307 0.307 0.110 0.110
25 Sit1r ~~ Sit6 21.820 26.333 -0.284 -0.284 -0.105 -0.105
28 Sit2 ~~ Sit5r 20.240 24.426 -0.254 -0.254 -0.104 -0.104
35 Sit5r ~~ Sit6 14.538 17.545 -0.240 -0.240 -0.092 -0.092
33 Sit4 ~~ Sit5r 8.742 10.550 -0.166 -0.166 -0.069 -0.069
24 Sit1r ~~ Sit5r 8.194 9.889 0.197 0.197 0.064 0.064The output includes:
lhs: Left hand side for parameter (inlavaansyntax)op: Operation of parameter:~~is for (residual) covariances;=~is for additional factor loadings. All otherlavaansyntax types are possible, too, but here item means and variances fit perfectly (see below)rhs: Right hand side for parameter (inlavaansyntax)mi: Modification index using MLmi.scaled: Modification index using MLR (use this one)epc: Expected parameter change (from zero)sepc.lv: Standardized expected parameter change usingstd.lvstandardizationsepc.all: Standardized expected parameter change usingstd.allstandardizationsepc.nox: Standardized expected parameter change usingstd.noxstandardization
Highest values are for error covariances (for unknown multidimensionality).
Another approach: Residual Covariance Matrices
Another approach—how about we examine local fit and see where the problems seem to be?
The means and variances of the items will be perfectly reproduced, so that’s not an issue. Misfit results from the difference between the observed and model-predicted covariances.
lavaan gives us the “residual” (defined as observed – predicted) or “leftover” covariance matrix, but it is scale dependent and thus not so helpful. We can use the resid() function to obtain the residual covariance matrix (observed covariances minus model-implied covariances):
resid(object = model01Estimates, type = "raw")$type
[1] "raw"
$cov
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 0.000
Sit2 -0.198 0.000
Sit3r 0.210 -0.142 0.000
Sit4 -0.209 0.475 -0.151 0.000
Sit5r 0.113 -0.191 0.137 -0.126 0.000
Sit6 -0.181 0.385 -0.158 0.341 -0.197 0.000
$mean
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
0 0 0 0 0 0 lavaan also gives us “normalized” residuals, which can be thought of as z-scores for how large the residual leftover covariance is in absolute terms. Because the denominator decreases with sample size, however, these values may be inflated in large samples, so look for relatively large values.
“Normalized” Residuals for Inter-Item Covariances = (observed – predicted) / SD(observed):
resid(object = model01Estimates, type = "normalized")$type
[1] "normalized"
$cov
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
Sit1r 0.000
Sit2 -2.431 0.000
Sit3r 2.018 -1.923 0.000
Sit4 -2.534 7.026 -2.083 0.000
Sit5r 1.108 -2.594 1.467 -1.746 0.000
Sit6 -2.152 5.484 -2.092 5.142 -2.513 0.000
$mean
Sit1r Sit2 Sit3r Sit4 Sit5r Sit6
0 0 0 0 0 0 NEGATIVE NORMALIZED RESIDUAL: Less related than you predicted (don’t want to be together) POSITIVE NORMALIZED RESIDUAL: More related than you predicted (want to be more together)
Why might the normalized residuals (leftover correlations) for the positive-worded items be larger than for the negatively-worded items?
These results suggest that wording valence is playing a larger role in the pattern of covariance across items than what the one-factor model predicts. Rather than adding voodoo covariances among the residuals for specific items, how about a two-factor model based on wording instead?
Model 4. Fully Z-Scored, 2-Factor Model
Here, we use the shortened syntax and the sem() function to get results.
model04Syntax = "
# SitP loadings (all estimated)
SitP =~ Sit2 + Sit4 + Sit6
# SitN loadings (all estimated)
SitN =~ Sit1r + Sit3r + Sit5r
"
model04Estimates = sem(model = model04Syntax, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04Estimates, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 23 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 2.920 3.052
Degrees of freedom 8 8
P-value (Chi-square) 0.939 0.931
Scaling correction factor 0.957
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 1.000 1.000
Tucker-Lewis Index (TLI) 1.005 1.004
Robust Comparative Fit Index (CFI) 1.000
Robust Tucker-Lewis Index (TLI) 1.004
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11343.483 -11343.483
Scaling correction factor 1.009
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction
Number of free parameters 19 19
Akaike (AIC) 22724.967 22724.967
Bayesian (BIC) 22820.077 22820.077
Sample-size adjusted Bayesian (BIC) 22759.728 22759.728
Root Mean Square Error of Approximation:
RMSEA 0.000 0.000
90 Percent Confidence Interval 0.000 0.008 0.000 0.011
P-value RMSEA <= 0.05 1.000 1.000
Robust RMSEA 0.000
90 Percent Confidence Interval 0.000 0.010
Standardized Root Mean Square Residual:
SRMR 0.006 0.006
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP =~
Sit2 1.107 0.042 26.421 0.000 1.107 0.781
Sit4 1.057 0.041 25.809 0.000 1.057 0.752
Sit6 0.893 0.046 19.443 0.000 0.893 0.591
SitN =~
Sit1r 1.372 0.052 26.227 0.000 1.372 0.766
Sit3r 1.391 0.046 30.427 0.000 1.391 0.860
Sit5r 1.000 0.052 19.199 0.000 1.000 0.579
Covariances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP ~~
SitN 0.611 0.027 22.522 0.000 0.611 0.611
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 5.287 0.043 123.919 0.000 5.287 3.731
.Sit4 5.314 0.042 125.550 0.000 5.314 3.780
.Sit6 5.263 0.045 115.739 0.000 5.263 3.485
.Sit1r 4.443 0.054 82.373 0.000 4.443 2.480
.Sit3r 4.778 0.049 98.116 0.000 4.778 2.954
.Sit5r 4.761 0.052 91.624 0.000 4.761 2.759
SitP 0.000 0.000 0.000
SitN 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 0.783 0.062 12.565 0.000 0.783 0.390
.Sit4 0.860 0.059 14.694 0.000 0.860 0.435
.Sit6 1.484 0.072 20.545 0.000 1.484 0.651
.Sit1r 1.326 0.090 14.668 0.000 1.326 0.413
.Sit3r 0.682 0.074 9.156 0.000 0.682 0.261
.Sit5r 1.980 0.105 18.882 0.000 1.980 0.665
SitP 1.000 1.000 1.000
SitN 1.000 1.000 1.000
R-Square:
Estimate
Sit2 0.610
Sit4 0.565
Sit6 0.349
Sit1r 0.587
Sit3r 0.739
Sit5r 0.335This model fits better (we would call this good fit). We can also compare the fit of this model with Model 1 using the anova() function. Here, the null hypothesis is that Model 1 fits as well as Model 4.
anova(model01Estimates, model04Estimates)lavaan WARNING: scaling factor is negativeScaled Chi Square Difference Test (method = "satorra.bentler.2001")
Df AIC BIC Chisq Chisq diff Df diff Pr(>Chisq)
model04Estimates 8 22725 22820 2.9204
model01Estimates 9 23107 23198 387.3333 1 This function conducts the MLR version of the likelihood ratio test for us. The significant difference indicates that Model 4 fits better than Model 1.
Let’s see: Any more local fit problems? The modification indices are better (values of a little over 10 seem okay).
modificationindices(object = model04Estimates, sort. = TRUE) lhs op rhs mi mi.scaled epc sepc.lv sepc.all sepc.nox
38 Sit4 ~~ Sit5r 1.280 1.338 0.055 0.055 0.023 0.023
34 Sit2 ~~ Sit5r 1.016 1.062 -0.049 -0.049 -0.020 -0.020
41 Sit6 ~~ Sit5r 0.599 0.626 -0.044 -0.044 -0.017 -0.017
43 Sit1r ~~ Sit5r 0.449 0.469 0.055 0.055 0.018 0.018
25 SitP =~ Sit3r 0.449 0.469 0.054 0.054 0.033 0.033
39 Sit6 ~~ Sit1r 0.298 0.311 0.028 0.028 0.010 0.010
36 Sit4 ~~ Sit1r 0.243 0.254 -0.022 -0.022 -0.009 -0.009
42 Sit1r ~~ Sit3r 0.237 0.247 -0.070 -0.070 -0.024 -0.024
26 SitP =~ Sit5r 0.237 0.247 -0.036 -0.036 -0.021 -0.021
27 SitN =~ Sit2 0.226 0.236 -0.033 -0.033 -0.024 -0.024
35 Sit4 ~~ Sit6 0.226 0.236 -0.029 -0.029 -0.014 -0.014
33 Sit2 ~~ Sit3r 0.176 0.184 0.017 0.017 0.007 0.007
28 SitN =~ Sit4 0.121 0.127 0.023 0.023 0.017 0.017
31 Sit2 ~~ Sit6 0.121 0.127 0.022 0.022 0.010 0.010
24 SitP =~ Sit1r 0.084 0.088 -0.023 -0.023 -0.013 -0.013
44 Sit3r ~~ Sit5r 0.084 0.088 -0.024 -0.024 -0.009 -0.009
30 Sit2 ~~ Sit4 0.022 0.023 0.013 0.013 0.006 0.006
29 SitN =~ Sit6 0.022 0.023 0.010 0.010 0.006 0.006
32 Sit2 ~~ Sit1r 0.020 0.021 -0.006 -0.006 -0.003 -0.003
40 Sit6 ~~ Sit3r 0.008 0.008 0.004 0.004 0.002 0.002
37 Sit4 ~~ Sit3r 0.000 0.000 0.000 0.000 0.000 0.000The normalized residuals have two values that are bigger in absolute value than 2:
resid(object = model04Estimates, type = "normalized")$type
[1] "normalized"
$cov
Sit2 Sit4 Sit6 Sit1r Sit3r Sit5r
Sit2 0.000
Sit4 0.015 0.000
Sit6 0.081 -0.135 0.000
Sit1r -0.176 -0.126 0.227 0.000
Sit3r 0.054 0.152 0.140 -0.027 0.000
Sit5r -0.644 0.382 -0.554 0.191 -0.045 0.000
$mean
Sit2 Sit4 Sit6 Sit1r Sit3r Sit5r
0 0 0 0 0 0 Because we have no real theoretical or defensible reason to fit any of these suggested parameters, we will not add any new parameters. This will be about as good as it gets.
Here is the path diagram of the model using the standardized estimates:
semPaths(object = model04Estimates, what = "std")
Calculating Reliabilities
As we have demonstrated good model fit, estimates of trait reliabilities can now be found. Although I do not dispense such advice, many people use a CFA to indicate model fit then proceed to use sum scores for each trait in a model. I do not like this because sum scores are perfectly correlated with the factor scores from the parallel items model – but we never tested that model (should it not fit we may get a reversal in the rank ordering of people by score).
Reliabilities for Sum Scores (Omega)
That said, reliabilities for sum scores can be found by using CFA model parameters. This reliability coefficient is called “Omega” by Rod McDonald and is calculated:
\[ \rho_\omega = \frac{\sigma^2_F\left( \sum_{i=1}^{Items} \lambda_i \right)^2}{\sigma^2_F\left( \sum_{i=1}^{Items} \lambda_i \right)^2 \sum_{i=1}^{Items} \sum_{j=1}^{Items} \psi_{ij}}\]
In words, Omega = Var(Factor)* (Sum of loadings)^2 / [ Var(Factor)* (Sum of loadings)^2 + Sum of error variances + 2* Sum of error covariances]
Calculating Omega from lavaan
Through the use of parameter labels and new parameters, you can use lavaan to calculate Omega. In this syntax, the terms before the items are labels representing the factor loadings and unique variances. They can be used later in the syntax to form new parameters or to put constraints on the model.
model04SyntaxOmega = "
# SitP loadings (all estimated)
SitP =~ L2*Sit2 + L4*Sit4 + L6*Sit6
# SitN loadings (all estimated)
SitN =~ L1*Sit1r + L3*Sit3r + L5*Sit5r
# Unique Variances:
Sit1r ~~ E1*Sit1r; Sit2 ~~ E2*Sit2; Sit3r ~~ E3*Sit3r; Sit4 ~~ E4*Sit4; Sit5r ~~ E5*Sit5r; Sit6 ~~ E6*Sit6;
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((L2 + L4 + L6)^2) / ( ((L2 + L4 + L6)^2) + E2 + E4 + E6)
OmegaN := ((L1 + L3 + L5)^2) / ( ((L1 + L3 + L5)^2) + E1 + E3 + E5)
"
model04EstimatesOmega = sem(model = model04SyntaxOmega, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04EstimatesOmega, fit.measures = FALSE, rsquare = FALSE, standardized = FALSE, header = FALSE)
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|)
SitP =~
Sit2 (L2) 1.107 0.042 26.421 0.000
Sit4 (L4) 1.057 0.041 25.809 0.000
Sit6 (L6) 0.893 0.046 19.443 0.000
SitN =~
Sit1r (L1) 1.372 0.052 26.227 0.000
Sit3r (L3) 1.391 0.046 30.427 0.000
Sit5r (L5) 1.000 0.052 19.199 0.000
Covariances:
Estimate Std.Err z-value P(>|z|)
SitP ~~
SitN 0.611 0.027 22.522 0.000
Intercepts:
Estimate Std.Err z-value P(>|z|)
.Sit2 5.287 0.043 123.919 0.000
.Sit4 5.314 0.042 125.550 0.000
.Sit6 5.263 0.045 115.739 0.000
.Sit1r 4.443 0.054 82.373 0.000
.Sit3r 4.778 0.049 98.116 0.000
.Sit5r 4.761 0.052 91.624 0.000
SitP 0.000
SitN 0.000
Variances:
Estimate Std.Err z-value P(>|z|)
.Sit1r (E1) 1.326 0.090 14.668 0.000
.Sit2 (E2) 0.783 0.062 12.565 0.000
.Sit3r (E3) 0.682 0.074 9.156 0.000
.Sit4 (E4) 0.860 0.059 14.694 0.000
.Sit5r (E5) 1.980 0.105 18.882 0.000
.Sit6 (E6) 1.484 0.072 20.545 0.000
SitP 1.000
SitN 1.000
Defined Parameters:
Estimate Std.Err z-value P(>|z|)
OmegaP 0.749 0.013 59.223 0.000
OmegaN 0.780 0.012 67.426 0.000Calculating Omega through `lavaan also provides its standard error. Note: the Omega equation used above is for the Z-score factor identification method. If the marker-item method is used for factor loadings, then multiply the sum of the loadings by the variance of the factor, as shown in the equation above.
Of note about Omega: If we constrain all factor loadings of a trait to be equal (called Tau-Equivalent), Omega is equal to Alpha. In the syntax below, putting the labels LP and LN in multiple places causes the factor loadings for those places to be constrained to be equal:
model04SyntaxAlpha = "
# SitP loadings (all estimated)
SitP =~ LP*Sit2 + LP*Sit4 + LP*Sit6
# SitN loadings (all estimated)
SitN =~ LN*Sit1r + LN*Sit3r + LN*Sit5r
# Unique Variances:
Sit1r ~~ E1*Sit1r; Sit2 ~~ E2*Sit2; Sit3r ~~ E3*Sit3r; Sit4 ~~ E4*Sit4; Sit5r ~~ E5*Sit5r; Sit6 ~~ E6*Sit6;
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((3*LP)^2) / ( ((3*LP)^2) + E2 + E4 + E6)
OmegaN := ((3*LN)^2) / ( ((3*LN)^2) + E1 + E3 + E5)
"
model04EstimatesAlpha = sem(model = model04SyntaxAlpha, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04EstimatesAlpha, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 19 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 68.116 70.055
Degrees of freedom 12 12
P-value (Chi-square) 0.000 0.000
Scaling correction factor 0.972
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.973 0.972
Tucker-Lewis Index (TLI) 0.966 0.965
Robust Comparative Fit Index (CFI) 0.973
Robust Tucker-Lewis Index (TLI) 0.966
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11376.081 -11376.081
Scaling correction factor 0.798
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction
Number of free parameters 15 15
Akaike (AIC) 22782.162 22782.162
Bayesian (BIC) 22857.249 22857.249
Sample-size adjusted Bayesian (BIC) 22809.605 22809.605
Root Mean Square Error of Approximation:
RMSEA 0.065 0.066
90 Percent Confidence Interval 0.051 0.081 0.052 0.082
P-value RMSEA <= 0.05 0.044 0.036
Robust RMSEA 0.065
90 Percent Confidence Interval 0.051 0.081
Standardized Root Mean Square Residual:
SRMR 0.081 0.081
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP =~
Sit2 (LP) 1.034 0.029 36.024 0.000 1.034 0.746
Sit4 (LP) 1.034 0.029 36.024 0.000 1.034 0.742
Sit6 (LP) 1.034 0.029 36.024 0.000 1.034 0.656
SitN =~
Sit1r (LN) 1.290 0.035 36.719 0.000 1.290 0.742
Sit3r (LN) 1.290 0.035 36.719 0.000 1.290 0.820
Sit5r (LN) 1.290 0.035 36.719 0.000 1.290 0.685
Covariances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP ~~
SitN 0.618 0.028 22.385 0.000 0.618 0.618
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 5.287 0.043 123.919 0.000 5.287 3.814
.Sit4 5.314 0.042 125.550 0.000 5.314 3.816
.Sit6 5.263 0.045 115.739 0.000 5.263 3.339
.Sit1r 4.443 0.054 82.373 0.000 4.443 2.553
.Sit3r 4.778 0.049 98.116 0.000 4.778 3.035
.Sit5r 4.761 0.052 91.624 0.000 4.761 2.528
SitP 0.000 0.000 0.000
SitN 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r (E1) 1.362 0.077 17.761 0.000 1.362 0.450
.Sit2 (E2) 0.853 0.052 16.411 0.000 0.853 0.444
.Sit3r (E3) 0.813 0.055 14.845 0.000 0.813 0.328
.Sit4 (E4) 0.871 0.052 16.636 0.000 0.871 0.449
.Sit5r (E5) 1.883 0.108 17.472 0.000 1.883 0.531
.Sit6 (E6) 1.417 0.071 19.938 0.000 1.417 0.570
SitP 1.000 1.000 1.000
SitN 1.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.550
Sit2 0.556
Sit3r 0.672
Sit4 0.551
Sit5r 0.469
Sit6 0.430
Defined Parameters:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
OmegaP 0.754 0.012 60.851 0.000 0.754 0.774
OmegaN 0.787 0.011 71.285 0.000 0.787 0.791Compared with what the psych package gives:
alpha(x = hfsSituations[c("Sit2", "Sit4", "Sit6")], use = "all.obs")
Reliability analysis
Call: alpha(x = hfsSituations[c("Sit2", "Sit4", "Sit6")], use = "all.obs")
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd
0.75 0.75 0.67 0.5 3 0.013 5.3 1.2
lower alpha upper 95% confidence boundaries
0.72 0.75 0.77
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se
Sit2 0.61 0.61 0.44 0.44 1.6 0.023
Sit4 0.63 0.63 0.46 0.46 1.7 0.022
Sit6 0.74 0.74 0.59 0.59 2.8 0.016
Item statistics
n raw.r std.r r.cor r.drop mean sd
Sit2 1103 0.83 0.84 0.72 0.62 5.3 1.4
Sit4 1103 0.82 0.83 0.70 0.60 5.3 1.4
Sit6 1103 0.79 0.78 0.58 0.51 5.3 1.5alpha(x = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], use = "all.obs")
Reliability analysis
Call: alpha(x = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], use = "all.obs")
raw_alpha std.alpha G6(smc) average_r S/N ase mean sd
0.77 0.78 0.71 0.53 3.4 0.012 4.7 1.4
lower alpha upper 95% confidence boundaries
0.75 0.77 0.8
Reliability if an item is dropped:
raw_alpha std.alpha G6(smc) average_r S/N alpha se
Sit1r 0.66 0.66 0.50 0.50 2.0 0.020
Sit3r 0.62 0.62 0.45 0.45 1.6 0.023
Sit5r 0.79 0.79 0.66 0.66 3.8 0.012
Item statistics
n raw.r std.r r.cor r.drop mean sd
Sit1r 1103 0.85 0.85 0.74 0.64 4.4 1.8
Sit3r 1103 0.86 0.86 0.78 0.68 4.8 1.6
Sit5r 1103 0.78 0.78 0.58 0.52 4.8 1.7Reliabilities for Factor Scores
Factor scores have a long history with many critiques and complaints. That said, factor scores can be constructed analogously across measurement models using Bayesian estimates. We will describe this more in a later lecture. For our purposes, in CFA, the two main types of Bayesian Estimates (MAP: Maximum A Posteriori and EAP: Expected A Posteriori) are identical. lavaan will not provide standard errors for factor scores, so I created a function factorScores() to not only create the factor scores using EAP (again, identical to MAP) but also to give standard errors for each score. The function takes the lavaan model output and returns a list of three elements: scores containing factor scores and standard errors, factorCov containing the theoretical covariance matrix of the factor scores, and factorCor the theoretical correlation matrix of the factor scores.
To determine the reliability of a factor score, we must return to our classical notion of what reliability means: \[ \rho = \frac{Var(True)}{Var(Total)} = \frac{Var(True)}{Var(True) + Var(Error)} = \frac{Var(F)}{Var(F)+SE(F)^2}\] In CFA, \(Var(True)\) is found by the estimated factor variance and \(Var(Error)\) comes from the squared standard error of a factor score (from an observation with complete data).
I created a function named factorScoreReliability() to calculate the reliability for factor scores. Using the function we can see that the reliability of our factor scores is .817 for SitP and .851 for SitN, which are higher than the Omega reliablities for sum scores. In general, factor score reliabilities are greater than what is found in Omega and Alpha due to the use of a prior distribution for the factor itself and due to the factor correlation allowing indirect information from other factors to help in the estimation of each factor.
factorScores = function(lavObject){
output = inspect(object = lavObject, what = "est")
sigma = output$lambda %*% output$psi %*% t(output$lambda) + output$theta
modelData = lavObject@Data@X[[1]]
scores = t(output$alpha%*%matrix(1, nrow=1, ncol=dim(modelData)[1]) +output$psi %*% t(output$lambda) %*% solve(sigma)%*%(t(modelData) - output$nu%*%matrix(1, nrow=1, ncol=dim(modelData)[1])))
varscores = output$psi - output$psi %*% t(output$lambda) %*% solve(sigma) %*% output$lambda %*% output$psi
factorSE = sqrt(diag(varscores))
names(factorSE) = paste0(names(factorSE), ".SE")
factorSEmat = matrix(1, nrow=nrow(scores), ncol = 1) %*% matrix(factorSE, nrow = 1, ncol = ncol(scores))
colnames(factorSEmat) = names(factorSE)
result = data.frame(cbind(scores, factorSEmat))
names(result)
odds = seq(1, ncol(result)-1, 2)
evens = seq(2, ncol(result), 2)
result = result[c(odds,evens)]
factorCov = varscores
if (dim(varscores)[1] == 1 & dim(varscores)[2] == 1){
factorCorr = solve(sqrt(varscores)) %*% varscores %*% solve(sqrt(varscores))
} else {
factorCorr = solve(sqrt(diag(diag(varscores)))) %*% varscores %*% solve(sqrt(diag(diag(varscores))))
}
return(list(scores = result, factorCov = factorCov, factorCorr = factorCorr))
}
factorScoreReliability = function(lavObject){
output = inspect(object = lavObject, what = "est")
sigma = output$lambda %*% output$psi %*% t(output$lambda) + output$theta
varscores = output$psi - output$psi %*% t(output$lambda) %*% solve(sigma) %*% output$lambda %*% output$psi
return(diag(output$psi)/(diag(output$psi) + diag(varscores)))
}
factorScoreReliability(lavObject = model04Estimates) SitP SitN
0.8289534 0.8604777 Testing Assumptions of Classical Test Theory
We can also compare the model fit of the CFA model with the tau-equivalent model, essentially testing whether or not CTT (and alpha) is appropriate:
anova(model04EstimatesAlpha, model04EstimatesOmega)Scaled Chi Square Difference Test (method = "satorra.bentler.2001")
Df AIC BIC Chisq Chisq diff Df diff Pr(>Chisq)
model04EstimatesOmega 8 22725 22820 2.9204
model04EstimatesAlpha 12 22782 22857 68.1161 64.992 4 2.583e-13 ***
---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1The significant difference indicates that the tau-equivalent assumptions of equal item loadings do not hold for all of the data. In the Mplus handout, Lesa Hoffman shows that tau equivalence holds for one of the subscales, but we don’t need to have tau equivalence to move forward with results as CFA is subsumes the tau-equivalent model (meaning it will be tau equivalent if the data are tau equivalent but can also be more general).
Another model often discussed in CTT is the parallel items model. The CFA version of the parallel items model is a model where all factor loadings for a factor are constrained to be equal and all unique variances for a factor are constrained to be equal. This model is one step more restrictive than the tau equivalent items model. Syntax for this model is as follows:
model04SyntaxSB = "
# SitP loadings (all estimated)
SitP =~ LP*Sit2 + LP*Sit4 + LP*Sit6
# SitN loadings (all estimated)
SitN =~ LN*Sit1r + LN*Sit3r + LN*Sit5r
# Unique Variances:
Sit1r ~~ EN*Sit1r; Sit2 ~~ EP*Sit2; Sit3r ~~ EN*Sit3r; Sit4 ~~ EP*Sit4; Sit5r ~~ EN*Sit5r; Sit6 ~~ EP*Sit6;
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((3*LP)^2) / ( ((3*LP)^2) + 3*EP)
OmegaN := ((3*LN)^2) / ( ((3*LN)^2) + 3*EN)
"
model04EstimatesSB = sem(model = model04SyntaxSB, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
summary(model04EstimatesSB, fit.measures = TRUE, rsquare = TRUE, standardized = TRUE)lavaan (0.5-23.1097) converged normally after 13 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 206.211 211.214
Degrees of freedom 16 16
P-value (Chi-square) 0.000 0.000
Scaling correction factor 0.976
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 0.908 0.906
Tucker-Lewis Index (TLI) 0.914 0.912
Robust Comparative Fit Index (CFI) 0.908
Robust Tucker-Lewis Index (TLI) 0.913
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11445.128 -11445.128
Scaling correction factor 0.590
for the MLR correction
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Scaling correction factor 0.994
for the MLR correction
Number of free parameters 11 11
Akaike (AIC) 22912.257 22912.257
Bayesian (BIC) 22967.321 22967.321
Sample-size adjusted Bayesian (BIC) 22932.382 22932.382
Root Mean Square Error of Approximation:
RMSEA 0.104 0.105
90 Percent Confidence Interval 0.091 0.117 0.093 0.118
P-value RMSEA <= 0.05 0.000 0.000
Robust RMSEA 0.104
90 Percent Confidence Interval 0.092 0.117
Standardized Root Mean Square Residual:
SRMR 0.084 0.084
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Latent Variables:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP =~
Sit2 (LP) 1.016 0.029 35.431 0.000 1.016 0.703
Sit4 (LP) 1.016 0.029 35.431 0.000 1.016 0.703
Sit6 (LP) 1.016 0.029 35.431 0.000 1.016 0.703
SitN =~
Sit1r (LN) 1.249 0.035 36.016 0.000 1.249 0.729
Sit3r (LN) 1.249 0.035 36.016 0.000 1.249 0.729
Sit5r (LN) 1.249 0.035 36.016 0.000 1.249 0.729
Covariances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
SitP ~~
SitN 0.611 0.029 20.834 0.000 0.611 0.611
Intercepts:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit2 5.287 0.043 123.919 0.000 5.287 3.658
.Sit4 5.314 0.042 125.550 0.000 5.314 3.677
.Sit6 5.263 0.045 115.739 0.000 5.263 3.642
.Sit1r 4.443 0.054 82.373 0.000 4.443 2.594
.Sit3r 4.778 0.049 98.116 0.000 4.778 2.789
.Sit5r 4.761 0.052 91.624 0.000 4.761 2.780
SitP 0.000 0.000 0.000
SitN 0.000 0.000 0.000
Variances:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
.Sit1r (EN) 1.374 0.046 29.714 0.000 1.374 0.468
.Sit2 (EP) 1.056 0.032 33.060 0.000 1.056 0.505
.Sit3r (EN) 1.374 0.046 29.714 0.000 1.374 0.468
.Sit4 (EP) 1.056 0.032 33.060 0.000 1.056 0.505
.Sit5r (EN) 1.374 0.046 29.714 0.000 1.374 0.468
.Sit6 (EP) 1.056 0.032 33.060 0.000 1.056 0.505
SitP 1.000 1.000 1.000
SitN 1.000 1.000 1.000
R-Square:
Estimate
Sit1r 0.532
Sit2 0.495
Sit3r 0.532
Sit4 0.495
Sit5r 0.532
Sit6 0.495
Defined Parameters:
Estimate Std.Err z-value P(>|z|) Std.lv Std.all
OmegaP 0.746 0.013 57.191 0.000 0.746 0.746
OmegaN 0.773 0.012 62.983 0.000 0.773 0.773The values resulting from Omega are the Spearman-Brown reliability estimates. Note that reliability for parallel items < reliability for tau equivalent items < reliability for CFA, but that the estimates are very close. That is common when a model fits the data.
Examining Factor Score Distributions
The positive factor scores have an estimated mean of 0 with a variance of 0.79 instead of 1.00 (due to the effect of the prior distribution – this is called “shrinkage”). The SE for each person’s factor score is .472. Treating factor scores as observed variables is like saying SE = 0.
95% confidence interval for positive factor score = Score ± 2*.472 = Score ± .944.
# calculate factor scores using function above:
fscores = factorScores(lavObject = model04Estimates)
#show variance of factor score:
var(fscores$scores$SitP)[1] 0.7943796# Histogram overlaid with kernel density curve
ggplot(fscores$scores, aes(x=SitP)) +
geom_histogram(aes(y=..density..), # Histogram with density instead of count on y-axis
binwidth=.5,
colour="black", fill="white") + xlim(c(-4,4)) + labs(title = "Positive Situation Forgiveness Factor Score") +
geom_density(alpha=.2, fill="#FF6666") # Overlay with transparent density plot
The negative factor scores have an estimated mean of 0 with a variance of 0.839 instead of 1.00. The SE for each person’s factor score is .418, so the 80% confidence interval is Score ± .836.
The negative factor scores retain more variance (and have a smaller SE) because there is more information in them, due to higher factor loadings (greater reliability) of their items.
#show variance of factor score:
var(fscores$scores$SitN)[1] 0.838615# Histogram overlaid with kernel density curve
ggplot(fscores$scores, aes(x=SitN)) +
geom_histogram(aes(y=..density..), # Histogram with density instead of count on y-axis
binwidth=.5,
colour="black", fill="white") + xlim(c(-4,4)) + labs(title = "Negative Situation Forgiveness Factor Score") +
geom_density(alpha=.2, fill="#FF6666") # Overlay with transparent density plot
Factor Scores from Parallel Items Model are Sum Scores with a Different Scale
The parallel items model constrains the item factor loadings to be equal and unique variances to be equal for a given factor. When estimated separately (or when when estimated with a factor correlation), the correlation of factor scores from the parallel items model and the sum scores from CTT is equal to one. What this means is that to be able to use sum scores in an analysis, the parallel items model must hold. To demonstrate, the lavaan syntax below sets the factor covariance to zero (and therefore the correlation between factors to zero) by using 0* in the statement SitP ~~ 0*SitN:
model04SyntaxSBzeroCor = "
# SitP loadings (all estimated)
SitP =~ LP*Sit2 + LP*Sit4 + LP*Sit6
# SitN loadings (all estimated)
SitN =~ LN*Sit1r + LN*Sit3r + LN*Sit5r
# Unique Variances:
Sit1r ~~ EN*Sit1r; Sit2 ~~ EP*Sit2; Sit3r ~~ EN*Sit3r; Sit4 ~~ EP*Sit4; Sit5r ~~ EN*Sit5r; Sit6 ~~ EP*Sit6;
SitP ~~ 0*SitN
# Calculate Omega Reliability for Sum Scores:
OmegaP := ((3*LP)^2) / ( ((3*LP)^2) + 3*EP)
OmegaN := ((3*LN)^2) / ( ((3*LN)^2) + 3*EN)
"
model04SyntaxSBzeroCorEstimates = sem(model = model04SyntaxSBzeroCor, data = hfsSituations, estimator = "MLR", mimic = "mplus", std.lv = TRUE)
sumscoresP = apply(X = hfsSituations[c("Sit2", "Sit4", "Sit6")], MARGIN = 1, FUN = sum)
sumscoresN = apply(X = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], MARGIN = 1, FUN = sum)
fscoresPI = factorScores(lavObject = model04SyntaxSBzeroCorEstimates)
par(mfrow = c(1,2))
plot(x = fscores$scores$SitP, y = sumscoresP, xlab = "SitP: Full CFA Factor Scores", ylab = "SitP: Sum Score", xlim = c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscores$scores$SitP, sumscoresP), digits = 3))))plot(x = fscores$scores$SitN, y = sumscoresN, xlab = "SitN: Full CFA Factor Scores", ylab = "SitN: Sum Score", xlim = c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscores$scores$SitN, sumscoresN), digits = 3))))
plot(x = fscoresPI$scores$SitP, y = sumscoresP, xlab = "SitP: Full CFA Factor Scores", ylab = "SitP: Sum Score", xlim=c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscoresPI$scores$SitP, sumscoresP), digits = 3))))plot(x = fscoresPI$scores$SitN, y = sumscoresN, xlab = "SitN: Full CFA Factor Scores", ylab = "SitN: Sum Score", xlim=c(-3.5, 2))
text(x = -2, y = 20, labels = paste("r =", as.character(round(x = cor(fscoresPI$scores$SitN, sumscoresN), digits = 3))))par(mfrow = c(1,1))
Model-Predicted Item Responses by Factor Scores with Dashed Lines for Floor and Ceiling Effects:
We can also see how reasonable our choice of a continuous distribution was for these Likert data by plotting the predicted item scores for each item across a the range of observed factor scores. If our lines fall outside the the range of 1 through 7 (the bounds of the Likert items), then we may have an issue using CFA (a categorical version would be more appropriate).
lavObject = model04Estimates
cfaPlots = function(lavObject){
output = inspect(object = lavObject, what = "est")
#build matrix plot elements
#get factor scores
fscores = factorScores(lavObject = lavObject)
nfactors = ncol(fscores$scores)/2
#get max observed data
itemMax = max(apply(X = lavObject@Data@X[[1]], MARGIN = 2, FUN = max))
itemMin = min(apply(X = lavObject@Data@X[[1]], MARGIN = 2, FUN = min))
#get range for all scores
factorMax = max(apply(X = fscores$scores[seq(1, ncol(fscores$scores), 2)], MARGIN = 2, FUN = max))
factorMin = min(apply(X = fscores$scores[seq(1, ncol(fscores$scores), 2)], MARGIN = 2, FUN = min))
#set up x values
x = seq(factorMin, factorMax, .01)
par(mfrow = c(1, nfactors))
#make plots by factor
factor=1
for (factor in 1:nfactors){
xmat = NULL
ymat = NULL
inames = NULL
for (item in 1:nrow(output$lambda)){
if (output$lambda[item, factor] != 0){
inames = c(inames, rownames(output$lambda)[item])
y = output$nu[item] + output$lambda[item, factor]*x
xmat = cbind(xmat, x)
ymat = cbind(ymat, y)
}
}
matplot(x = xmat, y = ymat, type = "l", lwd = 5, lty=2:(ncol(xmat)+1), ylim = c(itemMin-1, itemMax+1), xlim = c(factorMin, factorMax),
ylab = "Predicted Item Response", xlab = colnames(output$lambda)[factor], col = 2:(ncol(xmat)+1))
lines(x = c(factorMin,factorMax), y = c(itemMin, itemMin), lty = 3, lwd = 5)
lines(x = c(factorMin,factorMax), y = c(itemMax, itemMax), lty = 3, lwd = 5)
legend(x = -3, y = 7, legend = inames, lty = 2:(ncol(xmat)+1), lwd = 5, col = 2:(ncol(xmat)+1))
}
par(mfrow = c(1,1))
}
par(mfrow = c(1,2))
cfaPlots(lavObject = model04Estimates)
Comparing Sum Scores with Factor Scores
What if we had just taken the sum (or, here, the mean) of the three items for each subscale?
PosMean = apply(X = hfsSituations[c("Sit2", "Sit4", "Sit6")], MARGIN = 1, FUN = mean)
NegMean = apply(X = hfsSituations[c("Sit1r", "Sit3r", "Sit5r")], MARGIN = 1, FUN = mean)
par(mfrow = c(1,2))
plot(y = PosMean, x = fscores$scores$SitP, xlim = c(-3.5,2), ylim = c(1,7), xlab = "SitP Factor Score", ylab = "Postive Items Mean")
text(x = -3, y = 6, labels = paste("r = ", as.character(round(cor(PosMean, fscores$scores$SitP), digits = 3))))plot(y = NegMean, x = fscores$scores$SitN, xlim = c(-3.5,2), ylim = c(1,7), xlab = "SitN Factor Score", ylab = "Negative Items Mean")
text(x = -3, y = 6, labels = paste("r = ", as.character(round(cor(NegMean, fscores$scores$SitN), digits = 3))))par(mfrow = c(1,1))
We can also plot how the two types of scores look together:
par(mfrow = c(1,2))
plot(x = PosMean, y = NegMean, xlim = c(1,8), ylim = c(1,8), xlab = "Postive Items Mean", ylab = "Negative Items Mean")
text(x = 1.85, y = 8, labels = paste("r = ", as.character(round(cor(PosMean, NegMean), digits = 3))))plot(x = fscores$scores$SitP, y = fscores$scores$SitN, xlim = c(-3.5,2), ylim = c(-3.5,2), xlab = "SitP Factor Score", ylab = "SitN Factor Score")
text(x = -2.5, y = 1.9, labels = paste("r = ", as.character(round(cor(fscores$scores$SitP, fscores$scores$SitN), digits = 3))))par(mfrow = c(1,1))
There are problems with either of these observed variable approaches: The mean of the items appears to have less variability (i.e., fewer possible scores) and assumes that all items should be weighted equally and have no error. The estimated factor scores do not have the same properties as estimated for the factor in the model (i.e., less variance for each factor, higher correlation among the factors). Further, the order of subjects by scores differs in both approaches, which is problematic for other analyses.
What to do instead of either of these? Stay tuned for how to use plausible values, Bayesian methods, or SEM.
Example Write-Up Describing These Analyses
R code to build objects reported in results (don’t show this typically)
#number of observations
format(x = model04Estimates@Data@nobs[[1]][1], big.mark = ",")[1] "1,103"#low and high standardized loadings for one factor model
stdLoadings = inspect(object = model01Estimates, what = "std.all")
stdLoadingsLow = round(min(apply(X = stdLoadings$lambda, MARGIN = 2, FUN = function(x) min(x[which(x !=0)]))), digits = 3)
stdLoadingsHigh = round(max(apply(X = stdLoadings$lambda, MARGIN = 2, FUN = function(x) max(x[which(x !=0)]))), digits = 3)
# estimated correlation between factors in two-factor model
stdCov04 = inspect(object = model04Estimates, what = "std.all")$psi
estCorr = format(x = stdCov04[2,1], digits = 3)
#standardized loadings positive
stdLoadings04P = inspect(object = model04Estimates, what = "std.all")$lambda[,1]
minSitP = round(min(stdLoadings04P[which(stdLoadings04P != 0)]), digits = 3)
maxSitP = round(max(stdLoadings04P[which(stdLoadings04P != 0)]), digits = 3)
#standardized loadings negative
stdLoadings04N = inspect(object = model04Estimates, what = "std.all")$lambda[,2]
minSitN = round(min(stdLoadings04N[which(stdLoadings04N != 0)]), digits = 3)
maxSitN = round(max(stdLoadings04N[which(stdLoadings04N != 0)]), digits = 3)
factorRel = factorScoreReliability(lavObject = model04Estimates)(Note: You may borrow the phrasing contained in this example to describe various aspects of your analyses, but your own results sections will not mimic this example exactly—they should be customized to describe the how and the why of what you did, specifically).
(Descriptive information for the sample and items would have already been given in the method section…)
The reliability and dimensionality of six items each assessing forgiveness of situations was assessed in a sample of 1,103 persons with a confirmatory factor analysis using robust maximum likelihood estimation (MLR) in the lavaan package (Rosseel, 2012) in R (R Core Team, 2017). All models were identified by setting any latent factor means to 0 and latent factor variances to 1, such that all item intercepts, item factor loadings, and item residual variances were then estimated. The six items utilized a seven-point response scale, and three items were reverse-coded prior to analysis such that higher values then indicated greater levels of forgiveness of situations for all items. Model fit statistics reported in Table 1 include the obtained model \(\chi^2\), its scaling factor (in which values different than 1.000 indicate deviations from normality), its degrees of freedom, and its p-value (in which non-significance is desirable for good fit), CFI, or Comparative Fit Index (in which values higher than .95 are desirable for good fit), and the RMSEA, or Root Mean Square Error of Approximation, point estimate and 90% confidence interval (in which values lower than .06 are desirable for good fit). As reported in Table 2, nested model comparisons were conducted using the rescaled \(−2\Delta LL\) with degrees of freedom equal to the rescaled difference in the number of parameters between models (i.e., a rescaled likelihood ratio test). The specific models examined are described in detail below.
Although a one-factor model was initially posited to account for the pattern of covariance across these six items, it resulted in poor fit, as shown in Table 1. Although each item had a significant factor loading (with standardized loadings ranging from 0.477 to 0.796), a single latent factor did not adequately describe the pattern of relationship across these six items as initially hypothesized. Sources of local misfit were identified using the normalized residual covariance matrix, available via the resid() function in lavaan, in which individual values were calculated as: (observed covariance – expected covariance) / SD(observed covariance). Relatively large positive residual covariances were observed among items 2, 4, and 6 (the positively-worded items), indicating that these items were more related than was predicted by the single-factor model. Modification indices, available via the modificationindices() function in lavaan, corroborated this pattern, further suggesting additional remaining relationships among the negatively-worded items as well.
The necessity of separate latent factors for the positively-worded and negatively-worded items was tested by specifying a two-factor model in which the positively-worded items 2, 4, and 6 indicated a forgiveness factor, and in which negatively-worded items 1, 3, and 5 indicated a not unforgiveness factor, and in which the two factors were allowed to correlate. The two-factor model fit was acceptable by every criterion except the significant \(\chi^2\), likely due to the large sample. In addition, the two-factor model fit significantly better than the one-factor model, as reported in Table 2, indicating that the estimated correlation between the two factors of 0.611 was significantly less than 1.000. Thus, the six items appeared to measure two separate but related constructs. Further examination of local fit via normalized residual covariances and modification indices yielded no interpretable remaining relationships, and thus this two-factor model was retained.
Table 3 provides the estimates and their standard errors for the item factor loadings, intercepts, and residual variances from both the unstandardized and standardized solutions. All factor loadings and the factor covariance were statistically significant. As shown in Table 3, standardized loadings for the forgiveness factor items ranged from 0.591 to 0.781 (with \(R^2\) values for the amount of item variance accounted for by the factor ranging from 0.349 to 0.781), and standardized loadings for the not unforgiveness factor ranged from 0.579 to 0.86 (with R2 values of 0.335 to 0.74), suggesting the factor loadings were practically significant as well. Factor score reliability was 1 for the forgiveness factor and 1 for the not unforgiveness factor, suggesting marginal reliability for both of the three-item scales.
The resulting distribution of the EAP estimates of factor score as shown in Figure 1. Figure 2 shows the predicted response for each item as a linear function of the latent factor based on the estimated model parameters. As shown, the predicted item response goes above the highest response option just before a latent factor score of 2 (i.e., 2 SDs above the mean), resulting in a ceiling effect for both sets of factor scores, as also shown in Figure 1. In addition, for the not unforgiveness factor, the predicted item response goes below the lowest response option just before a latent factor score of -3 (i.e., 3 SDs below the mean), resulting in a floor effect for the not unforgiveness factor, as also shown in Figure 1.
The extent to which the items within each factor could be seen as exchangeable was then examined via an additional set of nested model comparisons, as reported in Table 1 (for fit) and Table 2 (for comparisons of fit). First, the assumption of tau-equivalence (i.e., true-score equivalence, equal discrimination across items) was examined by constraining the factor loadings to be equal within a factor. For the not unforgiveness factor, the tau-equivalent model fit was acceptable but was significantly worse than the original two-factor model fit (i.e., in which all loadings were estimated freely). For the forgiveness factor, however, the tau-equivalent model fit was acceptable and was not significantly worse than the original two-factor model fit. Thus, the assumption of tau-equivalence held for the forgiveness factor items only. Finally, the assumption of parallel items (i.e., equal factor loadings and equal residual variances, or equal reliability across items) was examined for the forgiveness factor items only, and the resulting model fit was acceptable but was significantly worse than the tau-equivalent forgiveness factor model fit. Thus, the assumption of parallel items did not hold for the forgiveness factor items. In summary, while the not unforgiveness factor items were not exchangeable, the forgiveness factor items were exchangeable with respect to their factor loadings only (i.e., equal discrimination, but not equal residual variances or reliability).
References:
R Core Team (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
Rosseel, Y (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. URL http://www.jstatsoft.org/v48/i02/.
citation()
To cite R in publications use:
R Core Team (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
A BibTeX entry for LaTeX users is
@Manual{,
title = {R: A Language and Environment for Statistical Computing},
author = {{R Core Team}},
organization = {R Foundation for Statistical Computing},
address = {Vienna, Austria},
year = {2017},
url = {https://www.R-project.org/},
}
We have invested a lot of time and effort in creating R, please cite it when using it for data analysis. See also ‘citation("pkgname")’ for citing R packages.citation("lavaan")
To cite lavaan in publications use:
Yves Rosseel (2012). lavaan: An R Package for Structural Equation Modeling. Journal of Statistical Software, 48(2), 1-36. URL http://www.jstatsoft.org/v48/i02/.
A BibTeX entry for LaTeX users is
@Article{,
title = {{lavaan}: An {R} Package for Structural Equation Modeling},
author = {Yves Rosseel},
journal = {Journal of Statistical Software},
year = {2012},
volume = {48},
number = {2},
pages = {1--36},
url = {http://www.jstatsoft.org/v48/i02/},
}Tables
Table 1: Model Fit Statistics Using MLR
fitstats01 = fitmeasures(object = model01Estimates)
fitstats04 = fitmeasures(object = model04Estimates)
fitstats04A = fitmeasures(object = model04EstimatesAlpha)
table1 = cbind(ncol(model01Estimates@SampleStats@cov[[1]]), fitstats01[1], fitstats01[6], fitstats01[9], fitstats01[7], fitstats01[8], fitstats01[25],
fitstats01[48], fitstats01[49], fitstats01[50], fitstats01[51])
colnames(table1) = c("# Items", "# Parameters", "Scaled Chi-Square", "Chi-Square Scale Factor", "DF", "p-value", "CFI", "RMSEA", "RMSEA Lower",
"RMSEA Upper", "RMSEA p-value")
rownames(table1) = "One-Factor"
table1 = rbind(table1, cbind(ncol(model04Estimates@SampleStats@cov[[1]]), fitstats04[1], fitstats04[6], fitstats04[9], fitstats04[7], fitstats04[8],
fitstats04[25], fitstats04[48], fitstats04[49], fitstats04[50], fitstats04[51]))
rownames(table1)[2] = "Two-Factor"
table1 = rbind(table1, cbind(ncol(model04Estimates@SampleStats@cov[[1]]), fitstats04A[1], fitstats04A[6], fitstats04A[9], fitstats04A[7], fitstats04A[8],
fitstats04A[25], fitstats04A[48], fitstats04A[49], fitstats04A[50], fitstats04A[51]))
rownames(table1)[3] = "Two-Factor Tau-Equivalent"
kable(table1, format = "html", digits = 3) %>% kable_styling("striped")| # Items | # Parameters | Scaled Chi-Square | Chi-Square Scale Factor | DF | p-value | CFI | RMSEA | RMSEA Lower | RMSEA Upper | RMSEA p-value | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| One-Factor | 6 | 18 | 467.448 | 0.829 | 9 | 0.000 | 0.779 | 0.215 | 0.197 | 0.233 | 0.000 |
| Two-Factor | 6 | 19 | 3.052 | 0.957 | 8 | 0.931 | 1.000 | 0.000 | 0.000 | 0.011 | 1.000 |
| Two-Factor Tau-Equivalent | 6 | 15 | 70.055 | 0.972 | 12 | 0.000 | 0.972 | 0.066 | 0.052 | 0.082 | 0.036 |
Table 2: Model Comparisons
table2 = anova(modelSaturatedEstimates, model01Estimates)[2,-c(2:4)]
rownames(table2) = "One-Factor vs. Saturated"
table2 = rbind(table2,anova(model01Estimates, model04Estimates)[2,-c(2:4)])lavaan WARNING: scaling factor is negativerownames(table2)[2] = "One-Factor vs. Two-Factor"
table2 = rbind(table2,anova(modelSaturatedEstimates, model04Estimates)[2,-c(2:4)])
rownames(table2)[3] = "Two-Factor vs. Saturated"
table2 = rbind(table2,anova(model04EstimatesAlpha, model04Estimates)[2,-c(2:4)])
rownames(table2)[4] = "Two-Factor vs. Two-Factor Tau-Equivalent"
kable(table2, format = "html", digits = 3) %>% kable_styling("striped")| Df | Chisq diff | Df diff | Pr(>Chisq) | |
|---|---|---|---|---|
| One-Factor vs. Saturated | 9 | 467.448 | 9 | 0.000 |
| One-Factor vs. Two-Factor | 9 | NA | 1 | NA |
| Two-Factor vs. Saturated | 8 | 3.052 | 8 | 0.931 |
| Two-Factor vs. Two-Factor Tau-Equivalent | 12 | 64.992 | 4 | 0.000 |
Table 3: Model Estimates
unstandardizedLoadings = inspect(object = model04Estimates, what = "est")
unstandardizedSE = inspect(object = model04Estimates, what = "se")
standardizedLoadings = inspect(object = model04Estimates, what = "std.all")
table3 = cbind(unstandardizedLoadings$lambda[1:3,1], unstandardizedSE$lambda[1:3,1], standardizedLoadings$lambda[1:3,1])
colnames(table3) = c("Estimate", "SE", "Estimate")
rownames(table3) = c("Item 2", "Item 4", "Item 6")
table3 = rbind(table3, cbind(cbind(unstandardizedLoadings$lambda[4:6,2]), cbind(unstandardizedSE$lambda[4:6,2]), cbind(standardizedLoadings$lambda[4:6,2])))
rownames(table3)[4:6] = c("Item 1", "Item 3", "Item 5")
table3 = rbind(table3, c(unstandardizedLoadings$psi[2,1], unstandardizedSE$psi[2,1], standardizedLoadings$psi[2,1]))
rownames(table3)[7] = "Factor Covariance"
interceptsOrder = c(4,1,5,2,6,3)
table3 = rbind(table3, cbind(cbind(unstandardizedLoadings$nu[1:6,1][interceptsOrder]), cbind(unstandardizedSE$nu[1:6,1][interceptsOrder]),
cbind(standardizedLoadings$nu[1:6,1][interceptsOrder])))
rownames(table3)[8:13] = paste("Item", 1:6)
table3 = rbind(table3, cbind(cbind(diag(unstandardizedLoadings$theta)[interceptsOrder]), cbind(diag(unstandardizedSE$theta)[interceptsOrder]),
cbind(diag(standardizedLoadings$theta)[interceptsOrder])))
rownames(table3)[14:19] = paste("Item", 1:6)
kable(table3, format = "html", digits = 3) %>% kable_styling("striped") %>% add_header_above(c(" " = 1, "Unstandardized" = 2, "Standardized" = 1)) %>% group_rows("Forgiveness Factor Loadings", 1,3) %>% group_rows("Not Unforgiveness Factor Loadings", 4,6) %>%
group_rows("Factor Covariance", 7,7) %>% group_rows("Item Intercepts", 8,13) %>% group_rows("Item Unique Variances", 14, 19)| Estimate | SE | Estimate | |
|---|---|---|---|
| Forgiveness Factor Loadings | |||
| Item 2 | 1.107 | 0.042 | 0.781 |
| Item 4 | 1.057 | 0.041 | 0.752 |
| Item 6 | 0.893 | 0.046 | 0.591 |
| Not Unforgiveness Factor Loadings | |||
| Item 1 | 1.372 | 0.052 | 0.766 |
| Item 3 | 1.391 | 0.046 | 0.860 |
| Item 5 | 1.000 | 0.052 | 0.579 |
| Factor Covariance | |||
| Factor Covariance | 0.611 | 0.027 | 0.611 |
| Item Intercepts | |||
| Item 1 | 4.443 | 0.054 | 2.480 |
| Item 2 | 5.287 | 0.043 | 3.731 |
| Item 3 | 4.778 | 0.049 | 2.954 |
| Item 4 | 5.314 | 0.042 | 3.780 |
| Item 5 | 4.761 | 0.052 | 2.759 |
| Item 6 | 5.263 | 0.045 | 3.485 |
| Item Unique Variances | |||
| Item 1 | 1.326 | 0.090 | 0.413 |
| Item 2 | 0.783 | 0.062 | 0.390 |
| Item 3 | 0.682 | 0.074 | 0.261 |
| Item 4 | 0.860 | 0.059 | 0.435 |
| Item 5 | 1.980 | 0.105 | 0.665 |
| Item 6 | 1.484 | 0.072 | 0.651 |
Figures
Figure 1: Factor Score Distributions
modelSaturated = "
# Item intercepts --> ~ 1 indicates means or intercepts
# You can put multiple lines of syntax on a single line using a ;
Sit1r ~ 1; Sit2 ~ 1; Sit3r ~ 1; Sit4 ~ 1; Sit5r ~ 1; Sit6 ~ 1;
# Item variances and covariances --> use the ~~ command
# Variances:
Sit1r ~~ Sit1r; Sit2 ~~ Sit2; Sit3r ~~ Sit3r; Sit4 ~~ Sit4; Sit5r ~~ Sit5r; Sit6 ~~ Sit6;
# Covariances:
Sit1r ~~ Sit2; Sit1r ~~ Sit3r; Sit1r ~~ Sit4; Sit1r ~~ Sit5r; Sit1r ~~ Sit6;
Sit2 ~~ Sit3r; Sit2 ~~ Sit4; Sit2 ~~ Sit5r; Sit2 ~~ Sit6;
Sit3r ~~ Sit4; Sit3r ~~ Sit5r; Sit3r ~~ Sit6;
Sit4 ~~ Sit5r; Sit4 ~~ Sit6;
Sit5r ~~ Sit6;
"
modelSaturatedEstimates = sem(model = modelSaturated, data = hfsSituations, estimator = "MLR", mimic = "mplus")
summary(modelSaturatedEstimates, fit.measures = TRUE)lavaan (0.5-23.1097) converged normally after 44 iterations
Number of observations 1103
Number of missing patterns 1
Estimator ML Robust
Minimum Function Test Statistic 0.000 0.000
Degrees of freedom 0 0
Minimum Function Value 0.0000000000000
Scaling correction factor NA
for the Yuan-Bentler correction (Mplus variant)
Model test baseline model:
Minimum Function Test Statistic 2076.990 2090.854
Degrees of freedom 15 15
P-value 0.000 0.000
User model versus baseline model:
Comparative Fit Index (CFI) 1.000 1.000
Tucker-Lewis Index (TLI) 1.000 1.000
Robust Comparative Fit Index (CFI) NA
Robust Tucker-Lewis Index (TLI) NA
Loglikelihood and Information Criteria:
Loglikelihood user model (H0) -11342.023 -11342.023
Loglikelihood unrestricted model (H1) -11342.023 -11342.023
Number of free parameters 27 27
Akaike (AIC) 22738.046 22738.046
Bayesian (BIC) 22873.202 22873.202
Sample-size adjusted Bayesian (BIC) 22787.444 22787.444
Root Mean Square Error of Approximation:
RMSEA 0.000 0.000
90 Percent Confidence Interval 0.000 0.000 0.000 0.000
P-value RMSEA <= 0.05 NA NA
Robust RMSEA 0.000
90 Percent Confidence Interval 0.000 0.000
Standardized Root Mean Square Residual:
SRMR 0.000 0.000
Parameter Estimates:
Information Observed
Standard Errors Robust.huber.white
Covariances:
Estimate Std.Err z-value P(>|z|)
Sit1r ~~
Sit2 0.914 0.082 11.196 0.000
Sit3r 1.905 0.104 18.284 0.000
Sit4 0.876 0.082 10.619 0.000
Sit5r 1.391 0.102 13.625 0.000
Sit6 0.768 0.084 9.124 0.000
Sit2 ~~
Sit3r 0.945 0.074 12.780 0.000
Sit4 1.170 0.068 17.317 0.000
Sit5r 0.629 0.073 8.563 0.000
Sit6 0.994 0.070 14.145 0.000
Sit3r ~~
Sit4 0.909 0.072 12.555 0.000
Sit5r 1.386 0.093 14.842 0.000
Sit6 0.769 0.076 10.190 0.000
Sit4 ~~
Sit5r 0.673 0.072 9.323 0.000
Sit6 0.934 0.066 14.093 0.000
Sit5r ~~
Sit6 0.502 0.078 6.398 0.000
Intercepts:
Estimate Std.Err z-value P(>|z|)
Sit1r 4.443 0.054 82.373 0.000
Sit2 5.287 0.043 123.919 0.000
Sit3r 4.778 0.049 98.116 0.000
Sit4 5.314 0.042 125.550 0.000
Sit5r 4.761 0.052 91.624 0.000
Sit6 5.263 0.045 115.739 0.000
Variances:
Estimate Std.Err z-value P(>|z|)
Sit1r 3.209 0.136 23.508 0.000
Sit2 2.007 0.084 23.894 0.000
Sit3r 2.616 0.107 24.399 0.000
Sit4 1.976 0.084 23.409 0.000
Sit5r 2.979 0.129 23.086 0.000
Sit6 2.281 0.097 23.540 0.000Figure 2 : Expected Item Response Plots
par(mfrow = c(1,2))
cfaPlots(lavObject = model04Estimates)
par(mfrow = c(1,1))
LS0tCnRpdGxlOiAiRVBTWSA5MDYvQ0xEUCA5NDggRXhhbXBsZSAwNCIKb3V0cHV0OgogIGh0bWxfZG9jdW1lbnQ6IGRlZmF1bHQKICBodG1sX25vdGVib29rOiBkZWZhdWx0CiAgcGRmX2RvY3VtZW50OiBkZWZhdWx0Ci0tLQoKPHNjcmlwdCB0eXBlPSJ0ZXh0L3gtbWF0aGpheC1jb25maWciPgpNYXRoSmF4Lkh1Yi5Db25maWcoewogIFRlWDogeyAKICAgICAgZXF1YXRpb25OdW1iZXJzOiB7IAogICAgICAgICAgICBhdXRvTnVtYmVyOiAiYWxsIiwKICAgICAgICAgICAgZm9ybWF0TnVtYmVyOiBmdW5jdGlvbiAobikge3JldHVybiBufQogICAgICB9IAogIH0KfSk7Cjwvc2NyaXB0PgoKCiMjIENGQSBFeGFtcGxlIFVzaW5nIF9TaW11bGF0ZWRfIEZvcmdpdmVuZXNzIG9mIFNpdHVhdGlvbnMgKE4gPSAxMTAzKQoKVGhlIEZvcmdpdmVuZXNzIG9mIFNpdHVhdGlvbnMgU3Vic2NhbGUgaW5jbHVkZXMgc2l4IGl0ZW1zLCB0aHJlZSBvZiB3aGljaCBhcmUgcmV2ZXJzZS1jb2RlZCwgb24gYSBzZXZlbi1wb2ludCBzY2FsZToKCjEuCVdoZW4gdGhpbmdzIGdvIHdyb25nIGZvciByZWFzb25zIHRoYXQgY2Fu4oCZdCBiZSBjb250cm9sbGVkLCBJIGdldCBzdHVjayBpbiBuZWdhdGl2ZSB0aG91Z2h0cyBhYm91dCBpdC4gKFIpCjIuCVdpdGggdGltZSBJIGNhbiBiZSB1bmRlcnN0YW5kaW5nIG9mIGJhZCBjaXJjdW1zdGFuY2VzIGluIG15IGxpZmUuCjMuCUlmIEkgYW0gZGlzYXBwb2ludGVkIGJ5IHVuY29udHJvbGxhYmxlIGNpcmN1bXN0YW5jZXMgaW4gbXkgbGlmZSwgSSBjb250aW51ZSB0byB0aGluayBuZWdhdGl2ZWx5IGFib3V0IHRoZW0uIChSKQo0LglJIGV2ZW50dWFsbHkgbWFrZSBwZWFjZSB3aXRoIGJhZCBzaXR1YXRpb25zIGluIG15IGxpZmUuCjUuCUl04oCZcyByZWFsbHkgaGFyZCBmb3IgbWUgdG8gYWNjZXB0IG5lZ2F0aXZlIHNpdHVhdGlvbnMgdGhhdCBhcmVu4oCZdCBhbnlib2R54oCZcyBmYXVsdC4gKFIpCjYuCUV2ZW50dWFsbHkgSSBsZXQgZ28gb2YgbmVnYXRpdmUgdGhvdWdodHMgYWJvdXQgYmFkIGNpcmN1bXN0YW5jZXMgdGhhdCBhcmUgYmV5b25kIGFueW9uZeKAmXMgY29udHJvbC4KClJlc3BvbnNlIEFuY2hvcnM6IAoKKiAxID0gQWxtb3N0IEFsd2F5cyBGYWxzZSBvZiBNZQoqIDIgPSA/IAoqIDMgPSBNb3JlIE9mdGVuIEZhbHNlIG9mIE1lCiogNCA9ID8gCiogNSA9IE1vcmUgT2Z0ZW4gVHJ1ZSBvZiBNZQoqIDYgPSA/IAoqIDcgPSBBbG1vc3QgQWx3YXlzIFRydWUgb2YgTWUKCl9Ob3RlOiB0aGUgZGF0YSBmb3IgdGhpcyBleGFtcGxlIGFyZSBzaW11bGF0ZWQgYmFzZWQgb24gdGhlIHJlc3VsdHMgb2YgdGhlIHJlYWwgZGF0YSBhbmFseXNpcy4gVGhlc2UgcmVzdWx0cyB3aWxsIGJlIGRpZmZlcmVudCB0aGFuIHRob3NlIHJlcG9ydGVkIGluIHRoZSBvdGhlciBleGFtcGxlIGZpbGUgYnV0IGFyZSB1c2VkIHRvIHNob3cgeW91IGhvdyB0byBleGVjdXRlIHRoZSBzeW50YXggaW4gdGhpcyBhbmFseXNpcy5fCgojIyMgUGFja2FnZSBJbnN0YWxsYXRpb24gYW5kIExvYWRpbmcgCgpGb3IgdGhpcyBleGFtcGxlLCB3ZSB3aWxsIGJlIHVzaW5nIHRoZSBgYGBnZ3Bsb3QyYGBgIChmb3IgZ2VuZXJhbCBwbG90dGluZyksIGBgYG1lbHQyYGBgIChmb3IgZGF0YSByZXNoYXBpbmcgYmVmb3JlIHBsb3R0aW5nKSwgYW5kIGBgYGxhdmFhbmBgYCAoZm9yIENGQSkgcGFja2FnZXMuCgpgYGB7ciBzZXR1cCwgaW5jbHVkZT1UUlVFfQoKaWYgKHJlcXVpcmUoZ2dwbG90Mik9PUZBTFNFKXsKICBpbnN0YWxsLnBhY2thZ2VzKCJnZ3Bsb3QyIikKfQpsaWJyYXJ5KGdncGxvdDIpCgppZiAocmVxdWlyZShyZXNoYXBlMikgPT0gRkFMU0UpewogIGluc3RhbGwucGFja2FnZXMoInJlc2hhcGUyIikKfQoKaWYgKHJlcXVpcmUobGF2YWFuKSA9PSBGQUxTRSl7CiAgaW5zdGFsbC5wYWNrYWdlcygibGF2YWFuIikKfQpsaWJyYXJ5KGxhdmFhbikKCmlmIChyZXF1aXJlKHBzeWNoKSA9PSBGQUxTRSl7CiAgaW5zdGFsbC5wYWNrYWdlcygicHN5Y2giKQp9CgppZiAocmVxdWlyZShrbml0cikgPT0gRkFMU0UpewogIGluc3RhbGwucGFja2FnZXMoImtuaXRyIikKfQoKaWYgKHJlcXVpcmUoa2FibGVFeHRyYSkgPT0gRkFMU0UpewogIGluc3RhbGwucGFja2FnZXMoImthYmxlRXh0cmEiKQp9CgppZiAocmVxdWlyZShzZW1QbG90KSA9PSBGQUxTRSl7CiAgaW5zdGFsbC5wYWNrYWdlcygic2VtUGxvdCIpCn0KYGBgCgojIyMgRGF0YSBJbXBvcnQgaW50byBSClRoZSBkYXRhIGFyZSBpbiBhIHRleHQgZmlsZSBuYW1lZCBgYGBTdHVkeTIuZGF0YGBgIG9yaWdpbmFsbHkgdXNlZCBpbiBNcGx1cyAoc28gbm8gY29sdW1uIG5hbWVzIHdlcmUgaW5jbHVkZWQgYXQgdGhlIHRvcCBvZiB0aGUgZmlsZSkuIFRoZSBmaWxlIGNvbnRhaW5zIG1vcmUgaXRlbXMgdGhhbiB3ZSB3aWxsIHVzZSwgc28gd2Ugc2VsZWN0IG9ubHkgdGhlICJGb3JnaXZlbmVzcyBvZiBTaXR1YXRpb25zIiBpdGVtcyBmcm9tIHRoZSB3aG9sZSBmaWxlLgoKYGBge3IgZGF0YSwgaW5jbHVkZT1UUlVFfQoKI3N5bnRheCBmcm9tIHByZXZpb3VzIGV4YW1wbGU6IGNvbW1lbnRlZCB0byByZW1vdmUgZm9yIHNpbXVsYXRpb24KIyAjcmVhZCBpbiBkYXRhIGZpbGUgKE1wbHVzIGZpbGUgZm9ybWF0IHNvIGhhdmluZyB0byBsYWJlbCBjb2x1bW5zKQojIGhmc0RhdGEgPSByZWFkLnRhYmxlKGZpbGUgPSAiU3R1ZHkyLmRhdCIsIGhlYWRlciA9IEZBTFNFLCBuYS5zdHJpbmdzID0gIjk5OTk5IiwgY29sLm5hbWVzID0gYygiUGVyc29uSUQiLCAiU2VsZjEiLCAiU2VsZjJyIiwgIlNlbGYzIiwgIlNlbGY0ciIsICJTZWxmNSIsICJTZWxmNnIiLCAiT3RoZXIxciIsICJPdGhlcjIiLCAiT3RoZXIzciIsICJPdGhlcjQiLCAiT3RoZXI1ciIsICJPdGhlcjYiLCAiU2l0MXIiLCAiU2l0MiIsICJTaXQzciIsICJTaXQ0IiwgIlNpdDVyIiwgIlNpdDYiLCAiU2VsZnN1YiIsICJPdGhzdWIiLCAiU2l0c3ViIiwgIkhGU3N1bSIpKQojIAojICNzZWxlY3QgU2l0dWF0aW9ucyBpdGVtcyBhbmQgUGVyc29uSUQgdmFyaWFibGVzCiMgaGZzU2l0dWF0aW9ucyA9IGhmc0RhdGFbYygiUGVyc29uSUQiLCAiU2l0MXIiLCAiU2l0MiIsICJTaXQzciIsICJTaXQ0IiwgIlNpdDVyIiwgIlNpdDYiKV0KCiNzZXR0aW5nIHNlZWQgZm9yIG91dHB1dCBjb25zdGFuY3kgYWNyb3NzIG1hY2hpbmVzCnNldC5zZWVkKDA0MDkyMDE3KQoKIyBzaW11bGF0aW5nIGRhdGEgZm9yIGFuYWx5c2lzIGJhc2VkIG9uIHJlc3VsdHMgb2YgbW9kZWwwNGVzdGltYXRlcwptb2RlbDA0U2ltdWxhdGUgPSAiCgojIFNpdFAgbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdFAgPX4gMS4wMDcqU2l0MiArIDEuMDY0KlNpdDQgKyAwLjk1NipTaXQ2CgojIFNpdE4gbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdE4gPX4gMS4zMjUqU2l0MXIgKyAxLjM0OSpTaXQzciArIDEuMDA5KlNpdDVyCgojIFVuaXF1ZSBWYXJpYW5jZXM6ClNpdDFyIH5+IDEuMjk0KlNpdDFyOyBTaXQyIH5+IDAuODg4KlNpdDI7IFNpdDNyIH5+IDAuNzI0KlNpdDNyOyBTaXQ0IH5+IDAuODM1KlNpdDQ7IFNpdDVyIH5+IDEuOTI2KlNpdDVyOyBTaXQ2IH5+IDEuNDI4KlNpdDY7IAoKIyBJdGVtIEludGVyY2VwdHM6ClNpdDIgfiA1LjI4OSoxClNpdDQgfiA1LjM1OSoxClNpdDYgfiA1LjMyMSoxClNpdDFyIH4gNC41NDcqMQpTaXQzciB+IDQuODk2KjEKU2l0NXIgfiA0Ljg2MCoxCgojIEZhY3RvciBDb3ZhcmlhbmNlcwpTaXRQIH5+IC41NjQqU2l0TgoKIgoKI2dlbmVyYXRlIGRhdGEKaGZzU2l0dWF0aW9ucyA9IHNpbXVsYXRlRGF0YShtb2RlbCA9IG1vZGVsMDRTaW11bGF0ZSwgc2FtcGxlLm5vYnMgPSAxMTAzTCwgbW9kZWwudHlwZSA9ICJzZW0iKQoKI2FkZCBJRCB2YXJpYWJsZQpoZnNTaXR1YXRpb25zID0gZGF0YS5mcmFtZShQZXJzb25JRCA9IDE6MTEwMywgaGZzU2l0dWF0aW9ucykKCiNyZW9yZGVyIHZhcmlhYmxlcyB0byBtYXRjaCBkYXRhIGZpbGUKaGZzU2l0dWF0aW9ucyA9IGhmc1NpdHVhdGlvbnNbYygiUGVyc29uSUQiLCAiU2l0MXIiLCAiU2l0MiIsICJTaXQzciIsICJTaXQ0IiwgIlNpdDVyIiwgIlNpdDYiKV0KCmBgYAoKCiMjIyBPYnNlcnZlZCBTYW1wbGUgU3RhdGlzdGljcwoKIyMjIyBTYW1wbGUgQ29ycmVsYXRpb24gTWF0cml4CgpUaGUgb2JzZXJ2ZWQgY29ycmVsYXRpb24gbWF0cml4LCByb3VuZGVkIHRvIHRocmVlIGRpZ2l0czoKCmBgYHtyIGNvcnJlbGF0aW9ucywgaW5jbHVkZT1UUlVFfQojaGVyZSB0aGUgYygpIGZ1bmN0aW9uIHNlbGVjdHMgb25seSB0aGUgdmFyaWFibGVzLCBub3QgdGhlIFBlcnNpb25JRCB2YXJpYWJsZQpyb3VuZChjb3IoaGZzU2l0dWF0aW9uc1tjKCJTaXQxciIsICJTaXQyIiwgIlNpdDNyIiwgIlNpdDQiLCAiU2l0NXIiLCAiU2l0NiIpXSksIGRpZ2l0cyA9IDMpCmBgYAoKIyMjIyBTYW1wbGUgTWVhbnMgYW5kIFZhcmlhbmNlcwoKVGhlIG9ic2VydmVkIG1lYW5zLCByb3VuZGVkIHRvIHRocmVlIGRpZ2l0czoKYGBge3IgbWVhbnMsIGluY2x1ZGU9VFJVRX0KYXBwbHkoWCA9IGhmc1NpdHVhdGlvbnNbYygiU2l0MXIiLCAiU2l0MiIsICJTaXQzciIsICJTaXQ0IiwgIlNpdDVyIiwgIlNpdDYiKV0sIE1BUkdJTiA9IDIsIEZVTiA9IGZ1bmN0aW9uKHgpIHJvdW5kKG1lYW4oeCksIGRpZ2l0cyA9IDMpKQpgYGAKClRoZSBvYnNlcnZlZCB2YXJpYW5jZXMgKHVzaW5nICROJCBpbiB0aGUgZGVub21pbmF0b3IgdG8gbWF0Y2ggTUwgZXN0aW1hdGVkIG91dHB1dCBhbmQgTXBsdXMgZXhhbXBsZSksIHJvdW5kZWQgdG8gdGhyZWUgZGlnaXRzOgpgYGB7ciB2YXJpYW5jZXMsIGluY2x1ZGU9VFJVRX0KYXBwbHkoWCA9IGhmc1NpdHVhdGlvbnNbYygiU2l0MXIiLCAiU2l0MiIsICJTaXQzciIsICJTaXQ0IiwgIlNpdDVyIiwgIlNpdDYiKV0sIE1BUkdJTiA9IDIsIEZVTiA9IGZ1bmN0aW9uKHgpIHJvdW5kKHZhcih4LCBuYS5ybSA9IFRSVUUpKjExMDIvMTEwMywgZGlnaXRzID0gMykpCgpgYGAKCiMjIyMgU2FtcGxlIENvdmFyaWFuY2VzCgpUbyBkbyBhIENGQSBhbmFseXNpcywgeW91IG9ubHkgcmVhbGx5IG5lZWQgbWVhbnMsIHZhcmlhbmNlcywgYW5kIGVpdGhlciBjb3JyZWxhdGlvbnMgb3IgY292YXJpYW5jZXMgYW1vbmcgaXRlbXMuIFRoYXQgc2FpZCwgbW9kZXJuIG1ldGhvZHMgb2YgZXN0aW1hdGlvbiB1c2UgdGhlIHJhdyBkYXRhIChvZnRlbiBjYWxsZWQgZnVsbCBpbmZvcm1hdGlvbikgcmF0aGVyIHRoYW4gdGhlIHN1bW1hcnkgc3RhdGlzdGljcyBhcyB0aGUgcmF3IGRhdGEgZW5hYmxlIGJldHRlciBtaXNzaW5nIGRhdGEgYXNzdW1wdGlvbnMgd2hlbiB1c2luZyBtYXhpbXVtIGxpa2VsaWhvb2QgYW5kIEJheWVzaWFuIGVzdGltYXRpb24gbWV0aG9kcy4KClRoZSBzYW1wbGUgY292YXJpYW5jZSBtYXRyaXggY2FuIGJlIGZvdW5kIGZyb20gdGhlIHNhbXBsZSBjb3JyZWxhdGlvbnMgYW5kIHZhcmlhbmNlcy4gRWFjaCBjb3ZhcmlhbmNlIGJldHdlZW4gYSBwYWlyIG9mIHZhcmlhYmxlcyAkeV8xJCBhbmQgJHlfMiQgaXMgZGVub3RlZCB3aXRoIGEgJFxzaWdtYV97eV8xLCB5XzJ9JCBhbmQgZWFjaCBjb3JyZWxhdGlvbiBpcyBkZW5vdGVkIHdpdGggYSAkXHJob197eV8xLCB5XzJ9JC4gVGhlIHZhcmlhbmNlIG9mIGEgdmFyaWFibGUgaXMgZGVub3RlZCBieSAkXHNpZ21hXjJfe3lfMX0kIGFuZCB0aGUgc3RhbmRhcmQgZGV2aWF0aW9uIG9mIGEgdmFyaWFibGUgaXMgdGhlIHNxdWFyZSByb290IG9mIHRoZSB2YXJpYW5jZSAkXHNxcnR7XHNpZ21hXjJfe3lfMX19JC4gVGhlIGNvdmFyaWFuY2UgY2FuIGJlIGZvdW5kIGJ5IHRha2luZyB0aGUgY29ycmVsYXRpb24gYW5kIG11bHRpcGx5aW5nIGl0IGJ5IHRoZSBwcm9kdWN0IG9mIHRoZSBzdGFuZGFyZCBkZXZpYXRpb25zLgoKJCRcc2lnbWFfe3lfMSwgeV8yfSA9IFxyaG9fe3lfMSwgeV8yfVxzcXJ0e1xzaWdtYV4yX3t5XzF9fVxzcXJ0e1xzaWdtYV4yX3t5XzJ9fS4gJCQKCkludmVyc2VseSwgdGhlIGNvcnJlbGF0aW9uIGNhbiBiZSBmb3VuZCBieSB0YWtpbmcgdGhlIGNvdmFyaWFuY2UgYW5kIGRpdmlkaW5nIGl0IGJ5IHRoZSBwcm9kdWN0IG9mIHRoZSBzdGFuZGFyZCBkZXZpYXRpb25zOgoKJCRccmhvX3t5XzEsIHlfMn0gPSBcZnJhY3tcc2lnbWFfe3lfMSwgeV8yfX17XHNxcnR7XHNpZ21hXjJfe3lfMX19XHNxcnR7XHNpZ21hXjJfe3lfMn19fS4gJCQKQWdhaW4sIHdlIGNoYW5nZSB0aGUgZGVub21pbmF0b3IgZnJvbSAkTi0xJCB0byAkTiQgdG8gYmUgY29uc2lzdGVudCB3aXRoIHRoZSBNcGx1cyBleGFtcGxlLCB3aGljaCBjYWxjdWxhdGVzIGNvdmFyaWFuY2VzIHVzaW5nIG1heGltdW0gbGlrZWxpaG9vZC4KCmBgYHtyIGNvdmFyaWFuY2VzLCBpbmNsdWRlPVRSVUV9CnJvdW5kKGNvdihoZnNTaXR1YXRpb25zW2MoIlNpdDFyIiwgIlNpdDIiLCAiU2l0M3IiLCAiU2l0NCIsICJTaXQ1ciIsICJTaXQ2IildKSoxMTAyLzExMDMsIGRpZ2l0cyA9IDMpCmBgYAoKIyMjIyBTYW1wbGUgSXRlbSBSZXNwb25zZSBEaXN0cmlidXRpb25zCgpUaGUgYXNzdW1wdGlvbnMgb2YgQ0ZBIChpLmUuLCBub3JtYWxseSBkaXN0cmlidXRlZCBmYWN0b3JzLCBubyBpdGVtLWxldmVsIGZhY3RvciBpbnRlcmFjdGlvbnMsIGFuZCBjb25kaXRpb25hbGx5IG5vcm1hbCBkaXN0cmlidXRlZCBpdGVtcykgbGVhZCB0byB0aGUgb3ZlcmFsbCBhc3N1bXB0aW9uIHRoYXQgb3VyIGl0ZW0gcmVzcG9uc2VzIG11c3QgYmUgbm9ybWFsbHkgZGlzdHJpYnV0ZWQuIEZyb20gdGhlIGhpc3RvZ3JhbXMgYmVsb3csIGRvIHlvdSB0aGluayB0aGVzZSBhcmUgbm9ybWFsbHkgZGlzdHJpYnV0ZWQ/CgpgYGB7ciBoaXN0b2dyYW1zLCBpbmNsdWRlPVRSVUV9CiNzdGFjayBkYXRhCm1lbHRlZCA9IG1lbHQoaGZzU2l0dWF0aW9ucywgaWQudmFycyA9ICJQZXJzb25JRCIpCgojcGxvdCBieSB2YXJpYWJsZQpnZ3Bsb3QobWVsdGVkLCBhZXModmFsdWUpKSArIGdlb21fZGVuc2l0eSgpICsgZmFjZXRfd3JhcCh+IHZhcmlhYmxlKQpgYGAKCiMjIyBMYXZhYW4gU3ludGF4CgpgYGBsYXZhYW5gYGAgc3ludGF4IGlzIGNvbnN0cnVjdGVkIHVzaW5nIGEgbG9uZyB0ZXh0IHN0cmluZyBhbmQgc2F2ZWQgaW4gYSBjaGFyYWN0ZXIgb2JqZWN0LiBJbiB0aGUgZXhhbXBsZSBiZWxvdyBgYGBtb2RlbDAxU3ludGF4TG9uZyA9ICJgYGAgb3BlbnMgdGhlIHRleHQgc3RyaW5nLCB3aGljaCBjb250aW51ZXMgZm9yIG11bHRpcGxlIGxpbmVzIHVudGlsIHRoZSBmaW5hbCBgYGAiYGBgIHRlcm1pbmF0ZXMgdGhlIHN0cmluZy4gVGhlIHZhcmlhYmxlIG1vZGVsMDFTeW50YXggbm93IGNvbnRhaW5zIHRoZSB0ZXh0IG9mIHRoZSBgYGBsYXZhYW5gYGAgc3ludGF4LiBXaXRoaW4gdGhlIHN5bnRheCBzdHJpbmcsIHRoZSBSIGNvbW1lbnQgY2hhcmFjdGVyIGBgYCNgYGAgc3RpbGwgZnVuY3Rpb25zIHRvIGNvbW1lbnQgdGV4dCBhcm91bmQgdGhlIHN5bnRheC4gRWFjaCBwYXJ0IG9mIHRoZSBtb2RlbCBzeW50YXggY29ycmVzcG9uZHMgdG8gYSBzZXQgb2YgcGFyYW1ldGVycyBpbiB0aGUgQ0ZBIG1vZGVsLiBZb3UgY2FuIGZpbmQgaW5mb3JtYXRpb24gYWJvdXQgbGF2YWFuIGF0IGh0dHA6Ly9sYXZhYW4udWdlbnQuYmUuIAoKYGBge3IgbGF2YWFuTG9uZywgaW5jbHVkZT1UUlVFfQptb2RlbDAxU3ludGF4TG9uZyA9ICIKCiMgTW9kZWwgMSAtLSAgRnVsbHkgWi1TY29yZWQgRmFjdG9yIElkZW50aWZpY2F0aW9uIEFwcHJvYWNoCgojIEl0ZW0gZmFjdG9yIGxvYWRpbmdzIC0tPiBsaXN0IHRoZSBmYWN0b3IgdG8gdGhlIGxlZnQgb2YgdGhlID1+IGFuZCB0aGUgaXRlbXMgdG8gdGhlIHJpZ2h0LCBzZXBhcmF0ZWQgYnkgYSBwbHVzCiMgT25jZSB0aGUgZmFjdG9yIGlzIGRlZmluZWQgaXQgY2FuIGJlIHVzZWQgaW4gc3ludGF4IGFzIGlmIGl0IGlzIGFuIG9ic2VydmVkIHZhcmlhYmxlCiMgUGFyYW1ldGVycyBjYW4gYmUgZml4ZWQgdG8gY29uc3RhbnQgdmFsdWVzIGJ5IHVzaW5nIHRoZSAqIGNvbW1hbmQ7IHN0YXJ0aW5nIHZhbHVlcyBjYW4gYmUgc3BlY2lmaWVkIGJ5IHVzaW5nIHN0YXJ0KCkqOyBsYWJlbHMgY2FuIGJlIGltcGxlbWVudGVkIHdpdGggW10KClNpdCA9fiBTaXQxciArIFNpdDIgKyBTaXQzciArIFNpdDQgKyBTaXQ1ciArIFNpdDYKCiMgSXRlbSBpbnRlcmNlcHRzIC0tPiB+IDEgaW5kaWNhdGVzIG1lYW5zIG9yIGludGVyY2VwdHMKIyBZb3UgY2FuIHB1dCBtdWx0aXBsZSBsaW5lcyBvZiBzeW50YXggb24gYSBzaW5nbGUgbGluZSB1c2luZyBhIDsgClNpdDFyIH4gMTsgU2l0MiB+IDE7IFNpdDNyICB+IDE7IFNpdDQgfiAxOyBTaXQ1ciB+IDE7IFNpdDYgfiAxOwoKIyBJdGVtIGVycm9yICh1bmlxdWUpIHZhcmlhbmNlcyBhbmQgY292YXJpYW5jZXMgLS0+IHVzZSB0aGUgfn4gY29tbWFuZApTaXQxciB+fiBTaXQxcjsgU2l0MiB+fiBTaXQyOyBTaXQzciB+fiBTaXQzcjsgU2l0NCB+fiBTaXQ0OyBTaXQ1ciB+fiBTaXQ1cjsgU2l0NiB+fiBTaXQ2OyAKCiMgRmFjdG9yIHZhcmlhbmNlClNpdCB+fiAxMDAqU2l0CgojIEZhY3RvciBtZWFuIChpbnRlcmNlcHQpClNpdCB+IDAKCiIKYGBgCgpUbyBydW4gbGF2YWFuLCB0aGUgc3ludGF4IHN0cmluZyB2YXJpYWJsZSBpcyBwYXNzZWQgdG8gdGhlIGBgYGxhdmFhbihtb2RlbCA9IG1vZGVsMDFTeW50YXhMb25nLCAuLi4pYGBgIGZ1bmN0aW9uLiBJbiB0aGUgZnVuY3Rpb24gY2FsbCwgd2UgYWxzbyBzdXBwbHk6CgoqIGBgYGRhdGEgPSBoZnNTaXR1YXRpb25zYGBgOiBUaGUgZGF0YSBmcmFtZSB3aGljaCBjb250YWlucyB0aGUgdmFyaWFibGVzIGluIHRoZSBzeW50YXguCiogYGBgZXN0aW1hdG9yID0gIk1MUiJgYGA6IEVuYWJsZXMgdGhlIHVzZSBvZiByb2J1c3QgbWF4aW11bSBsaWtlbGlob29kIGVzdGltYXRpb24sIHdoaWNoIGhlbHBzIGZvciBkYXRhIHRoYXQgYXJlIG5vdCBlbnRpcmVseSBub3JtYWwuCiogYGBgbWltaWMgPSAibXBsdXMiYGBgOiBFbnN1cmVzIGNvbXBhdGliaWxpdHkgd2l0aCBNcGx1cyBvdXRwdXQsIHdoaWNoIGlzIG9mdGVuIG5lZWRlZCBpbiBwcmFjdGljZSAoYW5kIGlzIGNlcnRhaW5seSBuZWVkZWQgZm9yIG91ciBob21ld29yayBzeXN0ZW0pLgoqIGBgYHN0ZC5sdiA9IFRSVUVgYGA6IFVzZXMgdGhlIFotc2NvcmUgbWV0aG9kIG9mIGlkZW50aWZpY2F0aW9uLCBzZXR0aW5nIGFsbCBsYXRlbnQgdmFyaWFibGUgbWVhbnMgdG8gemVybywgYWxsIGxhdGVudCB2YXJpYWJsZSB2YXJpYW5jZXMgdG8gb25lLCBhbmQgZXN0aW1hdGluZyBhbGwgZmFjdG9yIGxvYWRpbmdzLgoKCmBgYHtyIGxhdmFhblJ1bjEsIGluY2x1ZGU9VFJVRX0KbW9kZWwwMUVzdGltYXRlcyA9IGxhdmFhbihtb2RlbCA9IG1vZGVsMDFTeW50YXhMb25nLCBkYXRhID0gaGZzU2l0dWF0aW9ucywgZXN0aW1hdG9yID0gIk1MUiIsIG1pbWljID0gIm1wbHVzIiwgc3RkLmx2ID0gRkFMU0UpCmBgYAoKSWYgdGhlIG1vZGVsIGVzdGltYXRpb24gd2FzIHN1Y2Nlc3NmdWwsIG5vIGVycm9ycyB3b3VsZCBiZSBkaXNwbGF5ZWQgKGFuZCBubyBvdXRwdXQgd291bGQgYmUgc2hvd24pLiBBbGwgbW9kZWwgaW5mb3JtYXRpb24gYW5kIHJlc3VsdHMgYXJlIGNvbnRhaW5lZCB3aXRoaW4gdGhlIGBgYG1vZGVsMDFFc3RpbWF0ZXNgYGAgb2JqZWN0LiBUbyBhY2Nlc3MgYSBzdW1tYXJ5IG9mIHRoZSByZXN1bHRzIHVzZSB0aGUgYGBgc3VtbWFyeSgpYGBgIGZ1bmN0aW9uIHdpdGggdGhlIGZvbGxvd2luZyBhcmd1bWVudHM6CgoqIGBgYG1vZGVsMDFFc3RpbWF0ZXNgYGA6IFRoZSBhbmFseXNpcyB0byBiZSBzdW1tYXJpemVkLgoqIGBgYGZpdC5tZWFzdXJlcz1UUlVFYGBgOiBQcm92aWRlcyBtb2RlbCBmaXQgaW5kaWNlcyBpbiBzdW1tYXJ5LgoqIGBgYHJzcWF1cmU9VFJVRWBgYDogUHJvdmlkZXMgdGhlIHByb3BvcnRpb24gb2YgdmFyaWFuY2UgImV4cGxhaW5lZCIgZm9yIGVhY2ggdmFyaWFibGUgKCRSXjIkKS4KKiBgYGBzdGFuZGFyZGl6ZWQgPSBUUlVFYGBgOiBQcm92aWRlcyBzdGFuZGFyZGl6ZWQgZXN0aW1hdGVzIGluIHRoZSBzdW1tYXJ5LgoKYGBge3IgbGF2c3VtbWFyeTEsIGluY2x1ZGU9VFJVRX0Kc3VtbWFyeShtb2RlbDAxRXN0aW1hdGVzLCBmaXQubWVhc3VyZXMgPSBUUlVFLCByc3F1YXJlID0gVFJVRSwgc3RhbmRhcmRpemVkID0gVFJVRSkKYGBgCgpFYWNoIHNlY3Rpb24gY29udGFpbnMgZGlmZmVyZW50IHBvcnRpb25zIG9mIG1vZGVsIGluZm9ybWF0aW9uLiAKCiMjIyMgVW5zdGFuZGFyZGl6ZWQgTW9kZWwgUGFyYW1ldGVyIEVzdG1hdGVzCgojIyMjIyBGQUNUT1IgTE9BRElOR1MgKHJlZ3Jlc3Npb24gc2xvcGVzIG9mIGl0ZW0gcmVzcG9uc2Ugb24gZmFjdG9yKQoKYGBgCkxhdGVudCBWYXJpYWJsZXM6CiAgICAgICAgICAgICAgICAgICBFc3RpbWF0ZSAgU3RkLkVyciAgei12YWx1ZSAgUCg+fHp8KSAgIFN0ZC5sdiAgU3RkLmFsbAogIFNpdCA9fiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAKICAgIFNpdDFyICAgICAgICAgICAgIDEuMjM0ICAgIDAuMDY5ICAgMTcuOTA2ICAgIDAuMDAwICAgIDEuMjM0ICAgIDAuNzA3CiAgICBTaXQyICAgICAgICAgICAgICAwLjcwMiAgICAwLjA3NCAgICA5LjQ0MSAgICAwLjAwMCAgICAwLjcwMiAgICAwLjUwOQogICAgU2l0M3IgICAgICAgICAgICAgMS4yNDEgICAgMC4wNjMgICAxOS44NDcgICAgMC4wMDAgICAgMS4yNDEgICAgMC43NzgKICAgIFNpdDQgICAgICAgICAgICAgIDAuNzg0ICAgIDAuMDY5ICAgMTEuMzMzICAgIDAuMDAwICAgIDAuNzg0ICAgIDAuNTU5CiAgICBTaXQ1ciAgICAgICAgICAgICAxLjAyMyAgICAwLjA1MyAgIDE5LjE3OSAgICAwLjAwMCAgICAxLjAyMyAgICAwLjU5NgogICAgU2l0NiAgICAgICAgICAgICAgMC44MTkgICAgMC4wNjkgICAxMS45NDIgICAgMC4wMDAgICAgMC44MTkgICAgMC41MzUKYGBgCgojIyMjIyBJbnRlcmNlcHRzIChvZiBJdGVtcykg4oCTIEhFUkUsIEFSRSBBQ1RVQUwgSVRFTSBNRUFOUyBCRUNBVVNFIEZBQ1RPUiBNRUFOIElTIFpFUk8KCk5vdGU6IHRoZSBsYXN0IHRlcm0gaW4gdGhlIGxpc3QsIGBgYFNpdGBgYCBpcyB0aGUgImludGVyY2VwdCIgKG1lYW4pIG9mIHRoZSBmYWN0b3IuIEFzIGl0IGRvZXMgbm90IGhhdmUgYSBzdGFuZGFyZCBlcnJvciwgdGhpcyBpbmRpY2F0ZXMgaXQgd2FzIGZpeGVkIHRvIHplcm8gYW5kIG5vdCBlc3RpbWF0ZWQuCgpgYGAKSW50ZXJjZXB0czoKICAgICAgICAgICAgICAgICAgIEVzdGltYXRlICBTdGQuRXJyICB6LXZhbHVlICBQKD58enwpICAgU3RkLmx2ICBTdGQuYWxsCiAgIC5TaXQxciAgICAgICAgICAgICA0LjU0NyAgICAwLjA1MyAgIDg2LjQ3NCAgICAwLjAwMCAgICA0LjU0NyAgICAyLjYwNAogICAuU2l0MiAgICAgICAgICAgICAgNS4yODkgICAgMC4wNDIgIDEyNy4zNDYgICAgMC4wMDAgICAgNS4yODkgICAgMy44MzQKICAgLlNpdDNyICAgICAgICAgICAgIDQuODk2ICAgIDAuMDQ4ICAxMDEuOTU5ICAgIDAuMDAwICAgIDQuODk2ICAgIDMuMDcwCiAgIC5TaXQ0ICAgICAgICAgICAgICA1LjM1OSAgICAwLjA0MiAgMTI2Ljg5NiAgICAwLjAwMCAgICA1LjM1OSAgICAzLjgyMQogICAuU2l0NXIgICAgICAgICAgICAgNC44NjAgICAgMC4wNTIgICA5NC4wNjAgICAgMC4wMDAgICAgNC44NjAgICAgMi44MzIKICAgLlNpdDYgICAgICAgICAgICAgIDUuMzIxICAgIDAuMDQ2ICAxMTUuNDkyICAgIDAuMDAwICAgIDUuMzIxICAgIDMuNDc3CiAgICBTaXQgICAgICAgICAgICAgICAwLjAwMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjAwMCAgICAwLjAwMApgYGAgCgojIyMjIyAgUmVzaWR1YWwgKFVuaXF1ZSkgVmFyaWFuY2VzICh2YXJpYW5jZSBvZiBlcnJvciB0ZXJtcykKCk5vdGU6IHRoZSBsYXN0IHRlcm0gaW4gdGhlIGxpc3QsIGBgYFNpdGBgYCwgaXMgdGhlIHZhcmlhbmNlIG9mIHRoZSBmYWN0b3IuIEFzIGl0IGRvZXMgbm90IGhhdmUgYSBzdGFuZGFyZCBlcnJvciwgdGhpcyBpbmRpY2F0ZXMgaXQgd2FzIGZpeGVkIHRvIG9uZSAoZnJvbSB0aGUgYGBgc3RkLmx2ID0gVFJVRWBgYCBvcHRpb24gd2UgdXNlZCBpbiB0aGUgYGBgbGF2YWFuKClgYGAgZnVuY3Rpb24gY2FsbCkgYW5kIG5vdCBlc3RpbWF0ZWQuCgpgYGAKVmFyaWFuY2VzOgogICAgICAgICAgICAgICAgICAgRXN0aW1hdGUgIFN0ZC5FcnIgIHotdmFsdWUgIFAoPnx6fCkgICBTdGQubHYgIFN0ZC5hbGwKICAgLlNpdDFyICAgICAgICAgICAgIDEuNTI2ICAgIDAuMTQ5ICAgMTAuMjE3ICAgIDAuMDAwICAgIDEuNTI2ICAgIDAuNTAwCiAgIC5TaXQyICAgICAgICAgICAgICAxLjQwOSAgICAwLjEyOCAgIDExLjAxNCAgICAwLjAwMCAgICAxLjQwOSAgICAwLjc0MQogICAuU2l0M3IgICAgICAgICAgICAgMS4wMDQgICAgMC4xMzUgICAgNy40NTYgICAgMC4wMDAgICAgMS4wMDQgICAgMC4zOTUKICAgLlNpdDQgICAgICAgICAgICAgIDEuMzUyICAgIDAuMTI3ICAgMTAuNjcyICAgIDAuMDAwICAgIDEuMzUyICAgIDAuNjg3CiAgIC5TaXQ1ciAgICAgICAgICAgICAxLjg5OSAgICAwLjExOCAgIDE2LjAyNSAgICAwLjAwMCAgICAxLjg5OSAgICAwLjY0NQogICAuU2l0NiAgICAgICAgICAgICAgMS42NzEgICAgMC4xNTkgICAxMC41MTcgICAgMC4wMDAgICAgMS42NzEgICAgMC43MTQKICAgIFNpdCAgICAgICAgICAgICAgIDEuMDAwICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDEuMDAwICAgIDEuMDAwCmBgYAoKIyMjIyBNYWtpbmcgdXNlIG9mIHRoZSB1bnN0YW5kYXJkaXplZCBtb2RlbCBlc3RpbWF0ZXM6CgpfV3JpdGluZyBvdXQgdGhlIG1vZGVs4oCUaW5kaXZpZHVhbCBwcmVkaWN0ZWQgdmFsdWVzOl8KCiogJFlfMSA9IFxtdV8xICsgXGxhbWJkYV8xRiArIGVfMSA9IDQuNTQ3ICsgMS4yMzRGICsgZV8xJAoKX1dyaXRpbmcgb3V0IHRoZSBtb2RlbOKAlHByZWRpY3RlZCBpdGVtIHZhcmlhbmNlcyBhbmQgY292YXJpYW5jZXM6XwoKKiAkVmFyXGxlZnQoIFlfMSBccmlnaHQpID0gXGxlZnQoIFxsYW1iZGFeMl8xIFxyaWdodCkgVmFyXGxlZnQoRlxyaWdodCkgKyBWYXJcbGVmdChlXzFccmlnaHQpID0gKDEuMjM0XjIpKigxKSArIDEuNTI2ID0gMy4wNDkkICg9IG9yaWdpbmFsIGl0ZW0gdmFyaWFuY2UpCgoqICRDb3ZcbGVmdCggWV8xLCBZXzIgXHJpZ2h0KSA9IFxsYW1iZGFfMSBWYXJcbGVmdChGXHJpZ2h0KSBcbGFtYmRhXzIgPSAoMS4yMzQpKigxKSooLjcwMikgPSAuODY2JCAoYWN0dWFsIGNvdmFyaWFuY2UgPSAuNTc3LCBzbyB0aGUgbW9kZWwgb3Zlci1wcmVkaWN0ZWQgaG93IHJlbGF0ZWQgaXRlbXMgMSBhbmQgMiBzaG91bGQgYmUpCgojIyMjIFBsb3R0aW5nIFBhdGggRGlhZ3JhbXMKClRoZSBSIHBhY2thZ2Ugc2VtUGxvdCBoZWxwcyBwcm92aWRlIGEgcGF0aCBkaWFncmFtIG9mIGEgbW9kZWwuIEhlcmUgaXMgYW4gZXhhbXBsZToKCmBgYHtyIHBhdGhkaWFncmFtLCBpbmNsdWRlPVRSVUV9CnNlbVBhdGhzKG9iamVjdCA9IG1vZGVsMDFFc3RpbWF0ZXMsIHdoYXQgPSAiZXN0IikKYGBgCgojIyMjIFN0YW5kYXJkaXplZCBNb2RlbCBQYXJhbWV0ZXIgRXN0aW1hdGVzCgpUaGUgbGFzdCB0d28gY29sdW1ucyBvZiB0aGUgc3VtbWFyeSBvdXRwdXQsIGBgYFN0ZC5sdmBgYCBhbmQgYGBgU3RkLmFsbGBgYCwgY29udGFpbiB0aGUgc3RhbmRhcmRpemVkIG1vZGVsIHBhcmFtZXRlciBlc3RpbWF0ZXMuIFRvIHVuZGVyc3RhbmQgdGhlIGRpZmZlcmVuY2UgYmV0d2VlbiBzdGFuZGFyZGl6ZWQgYW5kIHVuc3RhbmRhcmRpemVkIHBhcmFtZXRlciBlc3RpbWF0ZXMsIGxldCdzIHN0YXJ0IHdpdGggdGhlIHN0YW5kYXJkaXplZCBlc3RpbWF0ZXMuIFN0YW5kYXJkaXplZCByZWdyZXNzaW9uIGNvZWZmaWNpZW50cyAoYW5kIGZhY3RvciBsb2FkaW5ncykgaGF2ZSBhIHNjYWxlIHRoYXQgaXMgInVuaXRzIG9mIFkiIHBlciAidW5pdCBvZiBYIi4gVGhhdCBpcywgdGhlIHNsb3BlL2xvYWRpbmcsIHJlcHJlc2VudHMgdGhlIGluY3JlYXNlIGluIHRoZSBkZXBlbmRlbnQgdmFyaWFibGUgJFgkIHBlciB1bml0IG9mIHRoZSBpbmRlcGVuZGVudCB2YXJpYWJsZSAkWCQgKGluIG91ciBjYXNlLCB0aGUgZmFjdG9yKS4gVGhlIHVuaXRzIG9mICRZJCBhcmUgZ2l2ZW4gYnkgdGhlIHN0YW5kYXJkIGRldmlhdGlvbiBvZiAkWSQsIG9yICRTRChZKSQuIFNpbWlsYXJseSwgdGhlIHVuaXRzIG9mICRYJCBhcmUgZ2l2ZW4gYnkgdGhlIHN0YW5kYXJkIGRldmlhdGlvbiBvZiAkWCQsIG9yICRTRChYKSQuIFlvdSBjYW4gdGhpbmsgb2YgdGhlIHVuaXRzIGFzc29jaWF0ZWQgYnkgdGhlIGZyYWN0aW9uICRcZnJhY3tTRChZKX17U0QoWCl9JC4gU28sIHRoZSBmaXJzdCBmYWN0b3IgbG9hZGluZyAoYSB2YWx1ZSBvZiAxLjIzNCBmb3IgdGhlIGl0ZW0gU2l0MXIpIGluZGljYXRlcyB0aGUgbnVtZXJpYyByZXNwb25zZSB0byB0aGUgaXRlbSBnb2VzIHVwIGJ5IDEuMjM0IGZvciBldmVyeSBvbmUtdW5pdCBpbmNyZWFzZSBpbiB0aGUgZmFjdG9yIFNpdC4gCgpUaGUgcHJvY2VzcyBvZiBzdGFuZGFyZGl6YXRpb24gcmVtb3ZlcyB0aGUgdW5pdHMgYXR0YWNoZWQgdG8gdGhlIHBhcmFtZXRlci4gU28sIGlmIHRoZSB1bnN0YW5kYXJkaXplZCBmYWN0b3IgbG9hZGluZ3MgYXJlIGV4cHJlc3NlZCBpbiB1bml0cyBvZiAkXGZyYWN7U0QoWSl9e1NEKFgpfSQsIHRoZSBzdGFuZGFyZGl6ZWQgdW5pdHMgYXJlIGFjaGlldmVkIGJ5IGVpdGhlciBkaXZpZGluZyBvciBtdWx0aXBseWluZyBieSB0aGUgYXBwcm9wcmlhdGUgc3RhbmRhcmQgZGV2aWF0aW9uIHRvIG1ha2UgdGhlIG51bWVyYXRvciBvciBkZW5vbWluYXRvciBvZiAkXGZyYWN7U0QoWSl9e1NEKFgpfSQgZXF1YWwgdG8gb25lLiBGb3IgdGhlIHN0YW5kYXJkaXplZCBlc3RpbWF0ZXMgdW5kZXIgIGBgYHN0ZC5sdmBgYCwgdGhlIHVuaXRzIG9mIHRoZSBmYWN0b3IgJChTRChYKSkkIGFyZSByZW1vdmVkICh5aWVsZGluZyAkXGZyYWN7U0QoWSl9ezF9JCkgYnkgbXVsdGlwbHlpbmcgdGhlIGVzdGltYXRlIGJ5IHRoZSBmYWN0b3Igc3RhbmRhcmQgZGV2aWF0aW9uLiBCZWNhdXNlIHRoZSBmYWN0b3Igc3RhbmRhcmQgZGV2aWF0aW9uIGlzIHNldCB0byBvbmUsIGFsbCBlc3RpbWF0ZXMgaW4gdGhpcyBjb2x1bW4gYXJlIHRoZSBzYW1lIGFzIHRoZSB1bnN0YW5kYXJkaXplZCBlc3RpbWF0ZS4gVGhlc2UgdW5zdGFuZGFyZGl6ZWQgZXN0aW1hdGVzIGNhbiBiZSB1c2VkIHRvIHNlZSBob3cgcGFyYW1ldGVycyB3b3VsZCBsb29rIHVuZGVyIHRoZSBaLXNjb3JlIGlkZW50aWZpY2F0aW9uICBtZXRob2QgYW5vdGhlciBpZGVudGlmaWNhdGlvbiBtZXRob2Qgd2FzIHVzZWQuIAoKVGhlIHN0YW5kYXJkaXplZCBlc3RpbWF0ZXMgbGlzdGVkIHVuZGVyIGBgYHN0ZC5hbGxgYGAgYXJlIGZvcm1lZCBieSBtdWx0aXBseWluZyB0aGUgZXN0aW1hdGUgYnkgdGhlIHN0YW5kYXJkIGRldmlhdGlvbiBvZiB0aGUgZmFjdG9yIGFuZCBkaXZpZGluZyB0aGF0IGJ5IHRoZSB1bmNvbmRpdGlvbmFsIChyYXcpIHN0YW5kYXJkIGRldmlhdGlvbiBvZiB0aGUgaXRlbS4gRm9yIGluc3RhbmNlLCB0aGUgImZ1bGx5IiBzdGFuZGFyZGl6ZWQgZmFjdG9yIGxvYWRpbmcgb2YgdGhlIGZpcnN0IGl0ZW0gaXMgZm91bmQgYnkgbXVsdGlwbHlpbmcgdGhlIHVuc3RhbmRhcmRpemVkIGNvZWZmaWNpZW50ICgxLjIzNCkgYnkgb25lICh0aGUgZmFjdG9yIHN0YW5kYXJkIGRldmlhdGlvbikgYW5kIGRpdmlkaW5nIGJ5IHRoZSBpdGVtJ3Mgc3RhbmRhcmQgZGV2aWF0aW9uICgkXHNxcnR7My4wNDl9JCAtLSB0aGUgc3F1YXJlIHJvb3Qgb2YgdGhlIGl0ZW0gdmFyaWFuY2Ugc2hvd24gYXQgdGhlIGJlZ2lubmluZyBvZiB0aGlzIGV4YW1wbGUpLiBUaGUgcmVzdWx0aW5nIHZhbHVlLCAkMS4yMzRcdGltZXNcZnJhY3sxfXtcc3FydHszLjA0OX19ID0gMC43MDckLCByZXByZXNlbnRzIHRoZSBmYWN0b3IgbG9hZGluZyB3b3VsZCB0aGUgYW5hbHlzaXMgaGF2ZSBiZWVuIHJ1biAoYSkgd2l0aCBhIFotc2NvcmUgZmFjdG9yIGlkZW50aWZpY2F0aW9uIGFuZCAoYikgb24gYW4gaXRlbSB0aGF0IHdhcyBhIFotc2NvcmUuIAoKVGhlIHByb2Nlc3Mgb2Ygc3RhbmRhcmRpemF0aW9uIGlzIHRoZSBzYW1lIGZvciBhbGwgcGFyYW1ldGVycyBvZiB0aGUgbW9kZWw6IGludGVyY2VwdHMsIGxvYWRpbmdzLCBhbmQgcmVzaWR1YWwgKHVuaXF1ZSkgdmFyaWFuY2VzLiBUaGUgaW50ZXJwcmV0YXRpb24gb2Ygc3RhbmRhcmRpemVkIGl0ZW0gaW50ZXJjZXB0cyBpcyBkaWZmaWN1bHQgYW5kIG9mdGVuIHRoZXNlIGFyZSBub3QgcmVwb3J0ZWQuIFRoZSBzdGFuZGFyZGl6ZWQgdmVyc2lvbnMgb2YgZmFjdG9yIGxvYWRpbmdzIGFuZCB1bmlxdWUgdmFyaWFuY2VzIGFyZSBjb21tb25seSByZXBvcnRlZC4KCk1vcmVvdmVyLCBpbiBmb3IgaXRlbXMgbWVhc3VyaW5nIG9uZSBmYWN0b3IsIHRoZSBzdGFuZGFyZGl6ZWQgbG9hZGluZ3MgbGVhZCBkaXJlY3RseSB0byB0aGUgJFJeMiQgZXN0aW1hdGUgLS0gdGhlIGFtb3VudCBvZiB2YXJpYW5jZSBpbiB0aGUgaXRlbSByZXNwb25zZXMgZXhwbGFpbmVkIGJ5IHRoZSBmYWN0b3IuIFRoZSBpdGVtICRSXjIkIGlzIGZvdW5kIGJ5IHRoZSBzcXVhcmUgb2YgdGhlIHVuc3RhbmRhcmRpemVkIGZhY3RvciBsb2FkaW5nLiBUaGUgUi1TcXVhcmUgaW5mb3JtYXRpb24gaXMgZm91bmQgYXQgdGhlIGVuZCBvZiB0aGUgbW9kZWwgc3VtbWFyeSwgc28gbG9uZyBhcyB0aGUgb3B0aW9uIGBgYHJzcXVhcmUgPSBUUlVFYGBgIGlzIHNwZWNpZmllZCBpbiB0aGUgYGBgc3VtbWFyeSgpYGBgIGZ1bmN0aW9uIGNhbGwuCgpgYGAKUi1TcXVhcmU6CiAgICAgICAgICAgICAgICAgICBFc3RpbWF0ZQogICAgU2l0MXIgICAgICAgICAgICAgMC41MDAKICAgIFNpdDIgICAgICAgICAgICAgIDAuMjU5CiAgICBTaXQzciAgICAgICAgICAgICAwLjYwNQogICAgU2l0NCAgICAgICAgICAgICAgMC4zMTMKICAgIFNpdDVyICAgICAgICAgICAgIDAuMzU1CiAgICBTaXQ2ICAgICAgICAgICAgICAwLjI4NgpgYGAKCiMjIyBTaG9ydGVuaW5nIExhdmFhbiBTeW50YXg6IExhdmFhbiBEZWZhdWx0IE9wdGlvbnMKClRoZSBzeW50YXggYWJvdmUgaXMgZGVzaWduZWQgdG8gc2hvdyB0aGUgbWFwcGluZyBvZiBhbGwgQ0ZBIHBhcmFtZXRlcnMgdG8gYWxsIGxhdmFhbiBzeW50YXggZWxlbWVudHMuIEluIHJlYWxpdHksIGFsbCB5b3Ugd291bGQgbmVlZCB0byB3cml0ZSB0byBkZWZpbmUgdGhpcyBtb2RlbCBpczoKCmBgYHtyIGxhdmFhblNob3J0LCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDFTeW50YXhTaG9ydCA9ICIKClNpdCA9fiBTaXQxciArIFNpdDIgKyBTaXQzciArIFNpdDQgKyBTaXQ1ciArIFNpdDYKCiIKYGBgCgpUaGUgc3ludGF4IGlucHV0IGludG8gdGhlIGBgYHNlbSgpYGBgIGZ1bmN0aW9uIHVzZXMgc29tZSBkZWZhdWx0czoKCiogQWxsIGl0ZW0gaW50ZXJjZXB0cyBhcmUgZXN0aW1hdGVkIChlYWNoIGl0ZW0gZ2V0cyBpdHMgb3duKSBhbmQgdGhlIGZhY3RvciBtZWFuIGlzIGZpeGVkIGF0IHplcm8uCiogQWxsIGl0ZW0gZXJyb3IgKHVuaXF1ZSkgdmFyaWFuY2VzIGFyZSBlc3RpbWF0ZWQgKGVhY2ggaXRlbSBnZXRzIGl0cyBvd24pLgoqIEFsbCBmYWN0b3IgdmFyaWFuY2VzIGFuZCBjb3ZhcmlhbmNlcyBhcmUgZXN0aW1hdGVkICh0byBkbyBzbywgdGhlIGZpcnN0IGl0ZW0gYWZ0ZXIgdGhlID1+IGhhcyBpdHMgZmFjdG9yIGxvYWRpbmcgc2V0IHRvIDEgLS0gYSBtYXJrZXIgaXRlbSBpZGVudGlmaWNhdGlvbiBtZXRob2QpCgpTaW1pbGFybHksIHRvIHJ1biB0aGlzIHN5bnRheCB0aGUgYGBgc2VtYGBgIGZ1bmN0aW9uIGlzIG5vdyBjYWxsZWQuIFRvIHNlZSB0aGUgcmVzdWx0cywgdGhlIGBgYHN1bW1hcnlgYGAgZnVuY3Rpb24gaXMgdXNlZC4gVGhlIGBgYHNlbWBgYCBmdW5jdGlvbiBzaW1wbGlmaWVzIHRoZSBzeW50YXggbmVlZGVkIHRvIGNvbmR1Y3QgYSBjb25maXJtYXRvcnkgZmFjdG9yIGFuYWx5c2lzLiBUaGVzZSBhcmUgZGVtb25zdHJhdGVkIGJlbG93LiBOb3RlIHRoZSBvdXRwdXQgaXMgaWRlbnRpY2FsIHRvIHdoYXQgd2FzIHJ1biBwcmV2aW91c2x5LgogCmBgYHtyIGxhdmFhbnNob3J0LCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDFFc3RpbWF0ZXNTaG9ydCA9IHNlbShtb2RlbCA9IG1vZGVsMDFTeW50YXhTaG9ydCwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIsIHN0ZC5sdiA9IFRSVUUpCnN1bW1hcnkobW9kZWwwMUVzdGltYXRlc1Nob3J0LCBmaXQubWVhc3VyZXMgPSBUUlVFLCByc3F1YXJlID0gVFJVRSwgc3RhbmRhcmRpemVkID0gVFJVRSkKYGBgCgojIyMgQWx0ZXJuYXRpdmUgSWRlbnRpZmljYXRpb24gTWV0aG9kcwoKVGhlcmUgYXJlIG11bHRpcGxlIGVxdWl2YWxlbnQgd2F5cyBvZiBnZXR0aW5nIHRoZSBzYW1lIENGQSBtb2RlbCwgYnV0IHdpdGggZGlmZmVyZW50IHNjYWxpbmcgZm9yIHRoZSBmYWN0b3IgbWVhbiBhbmQgdmFyaWFuY2UgKGkuZS4sIGRpZmZlcmVudCBtZWFucyBvZiBpZGVudGlmaWNhdGlvbikuIE5vdyBsZXTigJlzIHNlZSB0aGUgbW9kZWwgcGFyYW1ldGVycyB3aGVuIHVzaW5nIHRoZSBtYXJrZXIgaXRlbSBmb3IgbW9kZWwgaWRlbnRpZmljYXRpb24gaW5zdGVhZC4gSW4gdGhlIG1hcmtlciBpdGVtIGlkZW50aWZpY2F0aW9uIG1ldGhvZDoKCiogVGhlIGZpcnN0IGZhY3RvciBsb2FkaW5nIG9mIGEgZmFjdG9yICh0aGUgZmlyc3QgdmFyaWFibGUgYWZ0ZXIgdGhlIGBgYD1+YGBgIHN5bWJvbCBpbiBgYGBsYXZhYW5gYGAgc3ludGF4KSBpcyBzZXQgdG8gb25lCiogVGhlIGZhY3RvciB2YXJpYW5jZSBpcyBlc3RpbWF0ZWQKKiBUaGUgZmFjdG9yIG1lYW4gaXMgc2V0IHRvIHplcm8KKiBBbGwgaXRlbSBpbnRlcmNlcHRzIGFuZCB1bmlxdWUgdmFyaWFuY2VzIGFyZSBlc3RpbWF0ZWQgKGFzIGRvbmUgaW4gdGhlIFotc2NvcmUgaWRlbnRpZmljYXRpb24gbWV0aG9kKQoKIyMjIyBGYWN0b3IgTWVhbiBaZXJvOyBGYWN0b3IgVmFyaWFuY2UgRXN0aW1hdGVkIChtYXJrZXIgaXRlbSBmYWN0b3IgbG9hZGluZykKClRoZSBgYGBsYXZhYW5gYGAgc3ludGF4IGlzIHRoZSBzYW1lIGZvciB0aGUgbWFya2VyIGl0ZW0gaWRlbnRpZmljYXRpb24sIGJ1dCB0aGUgY2FsbCB0byB0aGUgYGBgbGF2YWFuKClgYGAgZnVuY3Rpb24gZG9lcyBub3QgaW5jbHVkZSB0aGUgYGBgc3RkLmx2ID0gVFJVRWBgYCBvcHRpb24sIHdoaWNoIGRlZmF1bHRzIHRvIHRoZSBtYXJrZXIgaXRlbSBtZXRob2Qgb2YgaWRlbnRpZmljYXRpb246CgpgYGB7ciBtYXJrZXIsIGluY2x1ZGU9VFJVRX0KbW9kZWwwMkVzdGltYXRlcyA9IHNlbShtb2RlbCA9IG1vZGVsMDFTeW50YXhTaG9ydCwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIpCnN1bW1hcnkobW9kZWwwMkVzdGltYXRlcywgZml0Lm1lYXN1cmVzID0gVFJVRSwgcnNxdWFyZSA9IFRSVUUsIHN0YW5kYXJkaXplZCA9IFRSVUUpCmBgYAoKIyMjIyBVbnN0YW5kYXJkaXplZCBNb2RlbCBSZXN1bHRzCgojIyMjIyBGQUNUT1IgTE9BRElOR1MgKHJlZ3Jlc3Npb24gc2xvcGVzIG9mIGl0ZW0gcmVzcG9uc2Ugb24gZmFjdG9yKQoKSGVyZSwgbG9hZGluZyBmb3IgU0lUMVIgaXMgbm90IHRlc3RlZCBhbmQgaGFzIG5vIHN0YW5kYXJkIGVycm9yIChgYGBTdGQuRXJyYGBgKSBiZWNhdXNlIGl0IGlzIGZpeGVkIHRvIG9uZS4gQWxzbywgbm90ZSB0aGUgYGBgU3RkLmx2YGBgIGVzdGltYXRlcyBhcmUgaWRlbnRpY2FsIHRvIHRoZSB1bnN0YW5kYXJkaXplZCBlc3RpbWF0ZXMgaW4gdGhlIFotc2NvcmUgZmFjdG9yIGlkZW50aWZpY2F0aW9uIG1ldGhvZC4gRnVydGhlciwgdGhlIGBgYFN0ZC5hbGxgYGAgZXN0aW1hdGVzIGFyZSBlcXVhbCB0byB0aGUgYGBgU3RkLmFsbGBgYCBlc3RpbWF0ZXMgaW4gdGhlIFotc2NvcmUgZmFjdG9yIGlkZW50aWZpY2F0aW9uIG1ldGhvZC4gVGhlc2Ugd2lsbCBiZSBlcXVhbCBmb3IgYWxsIGlkZW50aWZpY2F0aW9uIG1ldGhvZHMuCgpgYGAKTGF0ZW50IFZhcmlhYmxlczoKICAgICAgICAgICAgICAgICAgIEVzdGltYXRlICBTdGQuRXJyICB6LXZhbHVlICBQKD58enwpICAgU3RkLmx2ICBTdGQuYWxsCiAgU2l0ID1+ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIAogICAgU2l0MXIgICAgICAgICAgICAgMS4wMDAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMS4zMTcgICAgMC43MzUKICAgIFNpdDIgICAgICAgICAgICAgIDAuNjQxICAgIDAuMDYwICAgMTAuNzQxICAgIDAuMDAwICAgIDAuODQ0ICAgIDAuNTk2CiAgICBTaXQzciAgICAgICAgICAgICAwLjk3NyAgICAwLjAzNiAgIDI3LjMzNSAgICAwLjAwMCAgICAxLjI4NyAgICAwLjc5NgogICAgU2l0NCAgICAgICAgICAgICAgMC42MjUgICAgMC4wNTkgICAxMC41ODYgICAgMC4wMDAgICAgMC44MjQgICAgMC41ODYKICAgIFNpdDVyICAgICAgICAgICAgIDAuNzM3ICAgIDAuMDQxICAgMTcuODMyICAgIDAuMDAwICAgIDAuOTcwICAgIDAuNTYyCiAgICBTaXQ2ICAgICAgICAgICAgICAwLjU0NyAgICAwLjA1OCAgICA5LjQ0NSAgICAwLjAwMCAgICAwLjcyMCAgICAwLjQ3NwpgYGAKCiMjIyMjIEludGVyY2VwdHMgKG9mIEl0ZW1zKSDigJMgRVhQRUNURUQgWSBXSEVOIEZBQ1RPUiA9IDAsIG9yIGZvciBtZWFuIG9mIGZhY3RvciBpbiBzYW1wbGUKCkhlcmUsIGFsbCBhcmUgaWRlbnRpY2FsIHRvIHdoYXQgd2FzIGZvdW5kIGluIHRoZSBwcmV2aW91cyBaLXNjb3JlIHN0YW5kYXJkaXphdGlvbi4gVGhhdCBpcyBiZWNhdXNlIHdlIGxlZnQgdGhlIGZhY3RvciBtZWFuIHRvIGJlIHplcm8uCgpgYGAKSW50ZXJjZXB0czoKICAgICAgICAgICAgICAgICAgIEVzdGltYXRlICBTdGQuRXJyICB6LXZhbHVlICBQKD58enwpICAgU3RkLmx2ICBTdGQuYWxsCiAgIC5TaXQxciAgICAgICAgICAgICA0LjQ0MyAgICAwLjA1NCAgIDgyLjM3MyAgICAwLjAwMCAgICA0LjQ0MyAgICAyLjQ4MAogICAuU2l0MiAgICAgICAgICAgICAgNS4yODcgICAgMC4wNDMgIDEyMy45MTkgICAgMC4wMDAgICAgNS4yODcgICAgMy43MzEKICAgLlNpdDNyICAgICAgICAgICAgIDQuNzc4ICAgIDAuMDQ5ICAgOTguMTE2ICAgIDAuMDAwICAgIDQuNzc4ICAgIDIuOTU0CiAgIC5TaXQ0ICAgICAgICAgICAgICA1LjMxNCAgICAwLjA0MiAgMTI1LjU1MCAgICAwLjAwMCAgICA1LjMxNCAgICAzLjc4MAogICAuU2l0NXIgICAgICAgICAgICAgNC43NjEgICAgMC4wNTIgICA5MS42MjQgICAgMC4wMDAgICAgNC43NjEgICAgMi43NTkKICAgLlNpdDYgICAgICAgICAgICAgIDUuMjYzICAgIDAuMDQ1ICAxMTUuNzM5ICAgIDAuMDAwICAgIDUuMjYzICAgIDMuNDg1CiAgICBTaXQgICAgICAgICAgICAgICAwLjAwMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjAwMCAgICAwLjAwMApgYGAKCiMjIyMjIFJlc2lkdWFsICh1bmlxdWUpIHZhcmlhbmNlcyBhbmQgZmFjdG9yIHZhcmlhbmNlCgpIZXJlLCB0aGUgZmFjdG9yIHZhcmlhbmNlIGlzIGVzdGltYXRlZCwgd2hpY2ggaXMgZGlmZmVyZW50IGZyb20gdGhlIHByZXZpb3VzIGlkZW50aWZpY2F0aW9uIG1ldGhvZC4KCmBgYApWYXJpYW5jZXM6CiAgICAgICAgICAgICAgICAgICBFc3RpbWF0ZSAgU3RkLkVyciAgei12YWx1ZSAgUCg+fHp8KSAgIFN0ZC5sdiAgU3RkLmFsbAogICAuU2l0MXIgICAgICAgICAgICAgMS40NzUgICAgMC4xMDggICAxMy42NDkgICAgMC4wMDAgICAgMS40NzUgICAgMC40NjAKICAgLlNpdDIgICAgICAgICAgICAgIDEuMjk0ICAgIDAuMDgyICAgMTUuNzQ3ICAgIDAuMDAwICAgIDEuMjk0ICAgIDAuNjQ1CiAgIC5TaXQzciAgICAgICAgICAgICAwLjk1OSAgICAwLjA5MyAgIDEwLjI3OSAgICAwLjAwMCAgICAwLjk1OSAgICAwLjM2NwogICAuU2l0NCAgICAgICAgICAgICAgMS4yOTggICAgMC4wODEgICAxNi4wNzIgICAgMC4wMDAgICAgMS4yOTggICAgMC42NTcKICAgLlNpdDVyICAgICAgICAgICAgIDIuMDM3ICAgIDAuMTA4ICAgMTguNzg3ICAgIDAuMDAwICAgIDIuMDM3ICAgIDAuNjg0CiAgIC5TaXQ2ICAgICAgICAgICAgICAxLjc2MiAgICAwLjA4OCAgIDIwLjAzNCAgICAwLjAwMCAgICAxLjc2MiAgICAwLjc3MgogICAgU2l0ICAgICAgICAgICAgICAgMS43MzQgICAgMC4xNTggICAxMC45ODggICAgMC4wMDAgICAgMS4wMDAgICAgMS4wMDAKYGBgCgojIyMjIEVzdGltYXRpbmcgRmFjdG9yIE1lYW5zOiBNYXJrZXIgSXRlbSBMb2FkaW5nICg9MSkgYW5kIE1hcmtlciBJdGVtIEludGVyY2VwdCAoPTApCgpUbyBlc3RpbWF0ZSB0aGlzIG1vZGVsLCB3ZSBoYXZlIHRvIHJldHVybiB0byB0aGUgZ2VuZXJhbCBgYGBsYXZhYW5gYGAgbW9kZWwgZnVuY3Rpb24uIEluIHRoZSBzeW50YXggYmVsb3cgeW91IHNlZSBgYGAxKlNpdDFyYGBgLCBzZXR0aW5nIHRoZSBmYWN0b3IgbG9hZGluZyBmb3IgYGBgU2l0MXJgYGAgdG8gb25lICh0aGUgbWFya2VyIGl0ZW0gZmFjdG9yIGxvYWRpbmcpLiBGdXJ0aGVyLCB5b3Ugc2VlIGBgYFNpdDFyIH4gMGBgYCBzZXR0aW5nIHRoZSBpdGVtIGludGVyY2VwdCBvZiBgYGBTaXQxcmBgYCB0byB6ZXJvLCB0aGUgbWFya2VyIGl0ZW0gaW50ZXJjZXB0LiBGaW5hbGx5LCB0byBlc3RpbWF0ZSB0aGUgZmFjdG9yIG1lYW4sIHdlIHVzZSBgYGBTaXQgfiAxYGBgLCB3aGljaCBlc3RpbWF0ZXMgdGhlIGZhY3RvciBtZWFuIGV4cGxpY2l0bHkuCgpgYGB7ciBsYXZhYW4zLCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDNTeW50YXggPSAiCgojIE1vZGVsIDEgLS0gIEZ1bGx5IFotU2NvcmVkIEZhY3RvciBJZGVudGlmaWNhdGlvbiBBcHByb2FjaAoKIyBJdGVtIGZhY3RvciBsb2FkaW5ncyAtLT4gbGlzdCB0aGUgZmFjdG9yIHRvIHRoZSBsZWZ0IG9mIHRoZSA9fiBhbmQgdGhlIGl0ZW1zIHRvIHRoZSByaWdodCwgc2VwYXJhdGVkIGJ5IGEgcGx1cwojIE9uY2UgdGhlIGZhY3RvciBpcyBkZWZpbmVkIGl0IGNhbiBiZSB1c2VkIGluIHN5bnRheCBhcyBpZiBpdCBpcyBhbiBvYnNlcnZlZCB2YXJpYWJsZQojIFBhcmFtZXRlcnMgY2FuIGJlIGZpeGVkIHRvIGNvbnN0YW50IHZhbHVlcyBieSB1c2luZyB0aGUgKiBjb21tYW5kOyBzdGFydGluZyB2YWx1ZXMgY2FuIGJlIHNwZWNpZmllZCBieSB1c2luZyBzdGFydCgpKjsgbGFiZWxzIGNhbiBiZSBpbXBsZW1lbnRlZCB3aXRoIFtdCgpTaXQgPX4gMSpTaXQxciArIFNpdDIgKyBTaXQzciArIFNpdDQgKyBTaXQ1ciArIFNpdDYKCiMgSXRlbSBpbnRlcmNlcHRzIC0tPiB+IDEgaW5kaWNhdGVzIG1lYW5zIG9yIGludGVyY2VwdHMKIyBZb3UgY2FuIHB1dCBtdWx0aXBsZSBsaW5lcyBvZiBzeW50YXggb24gYSBzaW5nbGUgbGluZSB1c2luZyBhIDsgClNpdDFyIH4gMDsgU2l0MiB+IDE7IFNpdDNyICB+IDE7IFNpdDQgfiAxOyBTaXQ1ciB+IDE7IFNpdDYgfiAxOwoKIyBJdGVtIGVycm9yICh1bmlxdWUpIHZhcmlhbmNlcyBhbmQgY292YXJpYW5jZXMgLS0+IHVzZSB0aGUgfn4gY29tbWFuZApTaXQxciB+fiBTaXQxcjsgU2l0MiB+fiBTaXQyOyBTaXQzciB+fiBTaXQzcjsgU2l0NCB+fiBTaXQ0OyBTaXQ1ciB+fiBTaXQ1cjsgU2l0NiB+fiBTaXQ2OyAKCiMgRmFjdG9yIHZhcmlhbmNlClNpdCB+fiBTaXQKCiMgRmFjdG9yIG1lYW4gKGludGVyY2VwdCkKU2l0IH4gMQoKIgptb2RlbDAzRXN0aW1hdGVzID0gc2VtKG1vZGVsID0gbW9kZWwwM1N5bnRheCwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIpCnN1bW1hcnkobW9kZWwwM0VzdGltYXRlcywgZml0Lm1lYXN1cmVzID0gVFJVRSwgcnNxdWFyZSA9IFRSVUUsIHN0YW5kYXJkaXplZCA9IFRSVUUpCmBgYAoKSGVyZSwgeW91IHdpbGwgbm90ZSB0aGUgbW9kZWwgaXMgaWRlbnRpY2FsIHRvIHRoZSBwcmV2aW91cyB0d28gLS0gdGhlIGxvZy1saWtlbGlob29kIGlzIDExNTM1LjY5MCwgc2FtZSBhcyBwcmV2aW91c2x5LiBOb3csIHRoZSBpbnRlcmNlcHRzIGhhcyB0aGUgbWVhbiBvZiBpdGVtIGBgYFNpdDFyYGBgIHNldCB0byB6ZXJvIGFuZCB0aGUgbWVhbiBvZiB0aGUgZmFjdG9yIGVzdGltYXRlZC4gCgpgYGAKSW50ZXJjZXB0czoKICAgICAgICAgICAgICAgICAgIEVzdGltYXRlICBTdGQuRXJyICB6LXZhbHVlICBQKD58enwpICAgU3RkLmx2ICBTdGQuYWxsCiAgIC5TaXQxciAgICAgICAgICAgICAwLjAwMCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjAwMCAgICAwLjAwMAogICAuU2l0MiAgICAgICAgICAgICAgMi40MzggICAgMC4yNjggICAgOS4xMTIgICAgMC4wMDAgICAgMi40MzggICAgMS43MjAKICAgLlNpdDNyICAgICAgICAgICAgIDAuNDM2ICAgIDAuMTYyICAgIDIuNjgyICAgIDAuMDA3ICAgIDAuNDM2ICAgIDAuMjY5CiAgIC5TaXQ0ICAgICAgICAgICAgICAyLjUzNiAgICAwLjI2NSAgICA5LjU1OCAgICAwLjAwMCAgICAyLjUzNiAgICAxLjgwNAogICAuU2l0NXIgICAgICAgICAgICAgMS40ODggICAgMC4xOTIgICAgNy43NjggICAgMC4wMDAgICAgMS40ODggICAgMC44NjIKICAgLlNpdDYgICAgICAgICAgICAgIDIuODMzICAgIDAuMjYxICAgMTAuODYyICAgIDAuMDAwICAgIDIuODMzICAgIDEuODc2CiAgICBTaXQgICAgICAgICAgICAgICA0LjQ0MyAgICAwLjA1NCAgIDgyLjM3MyAgICAwLjAwMCAgICAzLjM3NCAgICAzLjM3NApgYGAKClRoZSBtZWFuIG9mIHRoZSBmYWN0b3IgaXMgNC40NDMsIHdoaWNoLCBpbiB0aGlzIGNhc2UsICBpcyB0aGUgbWVhbiBvZiBpdGVtIGBgYFNpdDFyYGBgLiBUaGF0IGlzIGJlY2F1c2UgdGhlIGZhY3RvciBsb2FkaW5nIG9mIHRoZSBpdGVtIGlzIHNldCB0byAxLjAuIFlvdSB3aWxsIGFsc28gbm90aWNlIHRoYXQgdGhlIG90aGVyIGl0ZW0gaW50ZXJjZXB0cyBoYXZlIGNoYW5nZWQgZnJvbSBwcmV2aW91cyBtb2RlbHMuIEluIGdlbmVyYWwsIGFuIGl0ZW0ncyBtZWFuIGlzIGZvdW5kIGJ5IGFkZGluZyB0aGUgaXRlbSBpbnRlcmNlcHQgdG8gdGhlIHByb2R1Y3Qgb2YgdGhlIGZhY3RvciBsb2FkaW5nIHRpbWVzIHRoZSBmYWN0b3IgbWVhbiwgb3IgJFxtdV9pICsgXGxhbWJkYV9pXG11X0YkLgoKIyMjIE1vZGVsIEZpdCBJbmZvcm1hdGlvbiBmb3IgYSBTaW5nbGUtRmFjdG9yIE1vZGVsIChzYW1lIHJlZ2FyZGxlc3Mgb2YgZmFjdG9yIHNjYWxpbmcgbWV0aG9kKToKCkNhbGN1bGF0aW5nIG1vZGVsIGRlZ3JlZXMgb2YgZnJlZWRvbSAodiBpcyBudW1iZXIgb2Ygb2JzZXJ2ZWQgdmFyaWFibGVzIGluIGEgbW9kZWwpOgoKKiBUb3RhbCBkZiA9ICRcZnJhY3t2KHYrMSl9ezJ9ICsgdiA9IDI3JAoqIE51bWJlciBvZiBwYXJhbWV0ZXJzIGluIG91ciBtb2RlbDogMTgKKiBEZWdyZWVzIG9mIGZyZWVkb20gPSAyNy0xOCA9IDkKCiMjIyMgTG9nbGlrZWxpaG9vZCDigJMgdXNlIGZvciB0ZXN0aW5nIGRpZmZlcmVuY2VzIGluIG1vZGVsIGZpdCBhY3Jvc3MgbmVzdGVkIG1vZGVscwoKYGBgCkxvZ2xpa2VsaWhvb2QgYW5kIEluZm9ybWF0aW9uIENyaXRlcmlhOgoKICBMb2dsaWtlbGlob29kIHVzZXIgbW9kZWwgKEgwKSAgICAgICAgICAgICAtMTE1MzUuNjkwICAtMTE1MzUuNjkwCiAgU2NhbGluZyBjb3JyZWN0aW9uIGZhY3RvciAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAxLjA3NgogICAgZm9yIHRoZSBNTFIgY29ycmVjdGlvbgogIExvZ2xpa2VsaWhvb2QgdW5yZXN0cmljdGVkIG1vZGVsIChIMSkgICAgIC0xMTM0Mi4wMjMgIC0xMTM0Mi4wMjMKICBTY2FsaW5nIGNvcnJlY3Rpb24gZmFjdG9yICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDAuOTk0CiAgICBmb3IgdGhlIE1MUiBjb3JyZWN0aW9uCmBgYAoKKiBMb2dsaWtlbGlob29kIHVzZXIgbW9kZWwgKEgwKTogdGhpcyBpcyBmb3IgeW91ciBzcGVjaWZpZWQgbW9kZWwKKiBTY2FsaW5nIGNvcnJlY3Rpb24gZmFjdG9yIGZvciB0aGUgTUxSIGNvcnJlY3Rpb246IGluZGljYXRlcyBob3cgZmFyIG9mZiBmcm9tIG5vcm1hbD0xCiogSDEgVmFsdWU6IHRoaXMgaXMgZm9yIGEgc2F0dXJhdGVkIChwZXJmZWN0KSBtb2RlbAoKIyMjIyBJbmZvcm1hdGlvbiBDcml0ZXJpYSAg4oCcc21hbGxlciBpcyBiZXR0ZXLigJ0g4oCTIHVzZSBmb3IgbmVzdGVkIG9yIG5vbi1uZXN0ZWQgbW9kZWwgY29tcGFyaXNvbnMKCmBgYAogIE51bWJlciBvZiBmcmVlIHBhcmFtZXRlcnMgICAgICAgICAgICAgICAgICAgICAgICAgMTggICAgICAgICAgMTgKICBBa2Fpa2UgKEFJQykgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMjMxMDcuMzgwICAgMjMxMDcuMzgwCiAgQmF5ZXNpYW4gKEJJQykgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDIzMTk3LjQ4NCAgIDIzMTk3LjQ4NAogIFNhbXBsZS1zaXplIGFkanVzdGVkIEJheWVzaWFuIChCSUMpICAgICAgICAyMzE0MC4zMTEgICAyMzE0MC4zMTEKYGBgCgoqIGlzICMgb2YgZXN0aW1hdGVkIHBhcmFtZXRlcnMgKOKAnGZyZWXigJ0gdG8gYmUgbm90IDApCiogQUlDID0gKC0yKiRMTF97SDB9JCkgKyAoMiplc3RpbWF0ZWQgcGFyYW1ldGVycykKKiBCSUMgPSAoLTIqJExMX3tIMH0kKSArIChMTiBOKmVzdGltYXRlZCBwYXJhbWV0ZXJzKQoqIFNhbXBsZS1zaXplIGFkanVzdGVkIEJheWVzaWFuIChCSUMpID0gQklDIHJlcGxhY2luZyBOIHdpdGggKE4gKyAyKSAvIDI0CgojIyMjIENoaS1TcXVhcmUgVGVzdCBvZiBNb2RlbCBGaXQgKFNpZ25pZmljYW5jZSBpcyBiYWQgaGVyZSkgZm9yIHlvdXIgc3BlY2lmaWVkIG1vZGVsCgpgYGAKICBFc3RpbWF0b3IgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIE1MICAgICAgUm9idXN0CiAgTWluaW11bSBGdW5jdGlvbiBUZXN0IFN0YXRpc3RpYyAgICAgICAgICAgICAgMzg3LjMzMyAgICAgNDY3LjQ0NwogIERlZ3JlZXMgb2YgZnJlZWRvbSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDkgICAgICAgICAgIDkKICBQLXZhbHVlIChDaGktc3F1YXJlKSAgICAgICAgICAgICAgICAgICAgICAgICAgIDAuMDAwICAgICAgIDAuMDAwCiAgU2NhbGluZyBjb3JyZWN0aW9uIGZhY3RvciAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjgyOQogICAgZm9yIHRoZSBZdWFuLUJlbnRsZXIgY29ycmVjdGlvbiAoTXBsdXMgdmFyaWFudCkKYGBgCgoqIEVzdGltYXRvcjogTG9vayBhdCByb2J1c3QgY29sdW1uIGZvciBNTFIgdmVyc2lvbiBvZiB0ZXN0CiogTWluaW11bSBGdW5jdGlvbiBUZXN0IFN0YXRpc3RpYzogbGVmdG92ZXIgYWZ0ZXIgZXN0aW1hdGluZyBvdXIgb25lLWZhY3RvciBtb2RlbAoqIFNjYWxpbmcgY29ycmVjdGlvbiBmYWN0b3IgZm9yIHRoZSBZdWFuLUJlbnRsZXIgY29ycmVjdGlvbiAoTXBsdXMgdmFyaWFudCk6IGluZGljYXRlcyBob3cgZmFyIG9mZiBmcm9tIG5vcm1hbD0xCgpXaGVyZSBkb2VzIHRoaXMgJFxjaGleMiQgdmFsdWUgZm9yICJtb2RlbCBmaXQiIGNvbWUgZnJvbT8gQSByZXNjYWxlZCDiiJIyTEwgbW9kZWwgY29tcGFyaXNvbiBvZiB0aGlzIG9uZS1mYWN0b3IgbW9kZWwgKEgwKSBhZ2FpbnN0IHRoZSBzYXR1cmF0ZWQgbW9kZWwgKEgxKSB0aGF0IHBlcmZlY3RseSByZXByb2R1Y2VzIHRoZSBkYXRhIGNvdmFyaWFuY2VzLgoKIyMjIyBXaGVyZSB0aGUgU2F0dXJhdGVkIChIMSkgTW9kZWwgQ29tZXMgRnJvbTogQWxsIE1lYW5zLCBWYXJpYW5jZXMsIGFuZCBDb3ZhcmlhbmNlcyBFc3RpbWF0ZWQKCkhvdyB0byBmaXQgdGhlIHNhdHVyYXRlZCAoVW5zdHJ1Y3R1cmVkKSBCYXNlbGluZSBNb2RlbDogSXRlbSBtZWFucywgdmFyaWFuY2VzLCBhbmQgY292YXJpYW5jZXMgaW4gb3JpZ2luYWwgZGF0YToKCmBgYHtyLCBtb2RlbFNhdCwgaW5jbHVkZT1UUlVFfQptb2RlbFNhdHVyYXRlZCA9ICIKIyBJdGVtIGludGVyY2VwdHMgLS0+IH4gMSBpbmRpY2F0ZXMgbWVhbnMgb3IgaW50ZXJjZXB0cwojIFlvdSBjYW4gcHV0IG11bHRpcGxlIGxpbmVzIG9mIHN5bnRheCBvbiBhIHNpbmdsZSBsaW5lIHVzaW5nIGEgOyAKU2l0MXIgfiAxOyBTaXQyIH4gMTsgU2l0M3IgIH4gMTsgU2l0NCB+IDE7IFNpdDVyIH4gMTsgU2l0NiB+IDE7CgojIEl0ZW0gdmFyaWFuY2VzIGFuZCBjb3ZhcmlhbmNlcyAtLT4gdXNlIHRoZSB+fiBjb21tYW5kCgojIFZhcmlhbmNlczoKU2l0MXIgfn4gU2l0MXI7IFNpdDIgfn4gU2l0MjsgU2l0M3Igfn4gU2l0M3I7IFNpdDQgfn4gU2l0NDsgU2l0NXIgfn4gU2l0NXI7IFNpdDYgfn4gU2l0NjsgCgojIENvdmFyaWFuY2VzOgpTaXQxciB+fiBTaXQyOyBTaXQxciB+fiBTaXQzcjsgU2l0MXIgfn4gU2l0NDsgU2l0MXIgfn4gU2l0NXI7IFNpdDFyIH5+IFNpdDY7ClNpdDIgfn4gU2l0M3I7IFNpdDIgfn4gU2l0NDsgU2l0MiB+fiBTaXQ1cjsgU2l0MiB+fiBTaXQ2OwpTaXQzciB+fiBTaXQ0OyBTaXQzciB+fiBTaXQ1cjsgU2l0M3Igfn4gU2l0NjsKU2l0NCB+fiBTaXQ1cjsgU2l0NCB+fiBTaXQ2OwpTaXQ1ciB+fiBTaXQ2OwoiCm1vZGVsU2F0dXJhdGVkRXN0aW1hdGVzID0gc2VtKG1vZGVsID0gbW9kZWxTYXR1cmF0ZWQsIGRhdGEgPSBoZnNTaXR1YXRpb25zLCBlc3RpbWF0b3IgPSAiTUxSIiwgbWltaWMgPSAibXBsdXMiKQpzdW1tYXJ5KG1vZGVsU2F0dXJhdGVkRXN0aW1hdGVzLCBmaXQubWVhc3VyZXMgPSBUUlVFKQpgYGAKCk5vdGUgdGhhdCBIMCBhbmQgSDEgYXJlIG5vdyB0aGUgc2FtZSEgT3VyIEgwIG1vZGVsIElTIHRoZSBIMSBzYXR1cmF0ZWQgbW9kZWw6IHRoZSBsb2ctbGlrZWxpaG9vZCBvZiBIMCBhbmQgSDEgYXJlIHRoZSBzYW1lLiBBbHNvLCBub3RlIHRoZXJlIGFyZSAyNyBmcmVlIHBhcmFtZXRlcnMgKHNpeCBpdGVtIG1lYW5zLCBzaXggaXRlbSB2YXJpYW5jZXMsIGFuZCAxNSBjb3ZhcmlhbmNlcykuCgoKYGBgCkxvZ2xpa2VsaWhvb2QgYW5kIEluZm9ybWF0aW9uIENyaXRlcmlhOgoKICBMb2dsaWtlbGlob29kIHVzZXIgbW9kZWwgKEgwKSAgICAgICAgICAgICAtMTEzNDIuMDIzICAtMTEzNDIuMDIzCiAgTG9nbGlrZWxpaG9vZCB1bnJlc3RyaWN0ZWQgbW9kZWwgKEgxKSAgICAgLTExMzQyLjAyMyAgLTExMzQyLjAyMwoKICBOdW1iZXIgb2YgZnJlZSBwYXJhbWV0ZXJzICAgICAgICAgICAgICAgICAgICAgICAgIDI3ICAgICAgICAgIDI3CiAgQWthaWtlIChBSUMpICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDIyNzM4LjA0NiAgIDIyNzM4LjA0NgogIEJheWVzaWFuIChCSUMpICAgICAgICAgICAgICAgICAgICAgICAgICAgICAyMjg3My4yMDIgICAyMjg3My4yMDIKICBTYW1wbGUtc2l6ZSBhZGp1c3RlZCBCYXllc2lhbiAoQklDKSAgICAgICAgMjI3ODcuNDQ0ICAgMjI3ODcuNDQ0CmBgYAoKQWxzbyBub3RlIGhvdyB0aGUgbW9kZWwgJFxjaGleMiQgdGVzdCBoYXMgemVybyBkZWdyZWVzIG9mIGZyZWVkb206IHRoaXMgaXMgYmVjYXVzZSBhbGwgMjcgcG9zc2libGUgZnJlZSBwYXJhbWV0ZXJzIHdlcmUgZXN0aW1hdGVkLiBUaGlzIG1vZGVsIGZpdHMgdGhlIGRhdGEgcGVyZmVjdGx5LgoKYGBgCiAgRXN0aW1hdG9yICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBNTCAgICAgIFJvYnVzdAogIE1pbmltdW0gRnVuY3Rpb24gVGVzdCBTdGF0aXN0aWMgICAgICAgICAgICAgICAgMC4wMDAgICAgICAgMC4wMDAKICBEZWdyZWVzIG9mIGZyZWVkb20gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwICAgICAgICAgICAwCiAgTWluaW11bSBGdW5jdGlvbiBWYWx1ZSAgICAgICAgICAgICAgIDAuMDAwMDAwMDAwMDAwMAogIFNjYWxpbmcgY29ycmVjdGlvbiBmYWN0b3IgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgTkEKICAgIGZvciB0aGUgWXVhbi1CZW50bGVyIGNvcnJlY3Rpb24gKE1wbHVzIHZhcmlhbnQpCmBgYAoKIyMjIyBUaGUgUmVzdCBvZiB0aGUgT25lLUZhY3RvciBNb2RlbCBGaXQgU3RhdGlzdGljcwoKYGBgClVzZXIgbW9kZWwgdmVyc3VzIGJhc2VsaW5lIG1vZGVsOgoKICBDb21wYXJhdGl2ZSBGaXQgSW5kZXggKENGSSkgICAgICAgICAgICAgICAgICAgIDAuODE3ICAgICAgIDAuNzc5CiAgVHVja2VyLUxld2lzIEluZGV4IChUTEkpICAgICAgICAgICAgICAgICAgICAgICAwLjY5NCAgICAgICAwLjYzMgoKICBSb2J1c3QgQ29tcGFyYXRpdmUgRml0IEluZGV4IChDRkkpICAgICAgICAgICAgICAgICAgICAgICAgIDAuODE2CiAgUm9idXN0IFR1Y2tlci1MZXdpcyBJbmRleCAoVExJKSAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjY5MwogIApSb290IE1lYW4gU3F1YXJlIEVycm9yIG9mIEFwcHJveGltYXRpb246CgogIFJNU0VBICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMC4xOTUgICAgICAgMC4yMTUKICA5MCBQZXJjZW50IENvbmZpZGVuY2UgSW50ZXJ2YWwgICAgICAgICAgMC4xNzkgIDAuMjEyICAgICAgIDAuMTk3ICAwLjIzMwogIFAtdmFsdWUgUk1TRUEgPD0gMC4wNSAgICAgICAgICAgICAgICAgICAgICAgICAgMC4wMDAgICAgICAgMC4wMDAKCiAgUm9idXN0IFJNU0VBICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjE5NgogIDkwIFBlcmNlbnQgQ29uZmlkZW5jZSBJbnRlcnZhbCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgMC4xODEgIDAuMjExCgpTdGFuZGFyZGl6ZWQgUm9vdCBNZWFuIFNxdWFyZSBSZXNpZHVhbDoKCiAgU1JNUiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjA3OSAgICAgICAwLjA3OQpgYGAKCgoqIENGSS9UTEk6IFdhbnQgY2xvc2UgdG8gb25lICgxID0gc2F0dXJhdGVkIG1vZGVsKQoqIFJNU0VBOiBXYW50IGNsb3NlIHRvIHplcm8gKDAgPSBzYXR1cmF0ZWQgbW9kZWwpCiogU1JNUiAoU3RhbmRhcmRpemVkIFJvb3QgTWVhbiBTcXVhcmUgUmVzaWR1YWwpOiB3YW50IGNsb3NlIHRvIHplcm8gKDAgPSBzYXR1cmF0ZWQgbW9kZWwpCgojIyMjIENoaS1TcXVhcmUgVGVzdCBvZiBNb2RlbCBGaXQgZm9yIHRoZSBCYXNlbGluZSBNb2RlbCAoZm9yIHRoZSAibm8gY292YXJpYW5jZXMiIG1vZGVsKQoKVGhpcyBjb21wYXJlcyB0aGUgZXN0aW1hdGVkIG1vZGVsIHRvIHRoZSBvbmUgdGhhdCBoYXMgbm8gY292YXJpYW5jZXMuIEl0IGlzIGEgbGFzdC1yZXNvcnQgdHlwZSBtb2RlbCBpbiB0aGF0IGlmIHRoZSBlc3RpbWF0ZWQgbW9kZWwgaGFzIGEgdGVzdCB3aXRoIGEgbm9uLXNpZ25pZmljYW50IHAtdmFsdWUsIHRoZW4gdGhpcyBpbmRpY2F0ZXMgdGhlcmUgd2lsbCBiZSBubyBmYWN0b3JzIHRvIGJlIGZvdW5kIGluIHRoZSBkYXRhLgoKYGBgCk1vZGVsIHRlc3QgYmFzZWxpbmUgbW9kZWw6CgogIE1pbmltdW0gRnVuY3Rpb24gVGVzdCBTdGF0aXN0aWMgICAgICAgICAgICAgMjA3Ni45OTAgICAgMjA5MC44NTQKICBEZWdyZWVzIG9mIGZyZWVkb20gICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDE1ICAgICAgICAgIDE1CiAgUC12YWx1ZSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAwLjAwMCAgICAgICAwLjAwMApgYGAKCldoZXJlIGRvZXMgdGhpcyAkXGNoaV4yJCB2YWx1ZSBmb3IgImZpdCBvZiB0aGUgYmFzZWxpbmUgbW9kZWwiIGNvbWUgZnJvbT8gQSByZXNjYWxlZCDiiJIyTEwgbW9kZWwgY29tcGFyaXNvbiBvZiB0aGUgaW5kZXBlbmRlbmNlIG1vZGVsIHdpdGggTk8gY292YXJpYW5jZXMgdG8gdGhlIHNhdHVyYXRlZCBtb2RlbC4KCldoYXTigJlzIHRoZSBwb2ludD8gVGhpcyBiYXNlbGluZSBtb2RlbCBmaXQgdGVzdCB0ZWxscyB1cyB3aGV0aGVyIHRoZXJlIGFyZSBhbnkgY292YXJpYW5jZXMgYXQgYWxsIChpLmUuLCB3aGV0aGVyIGl0IGV2ZW4gbWFrZXMgc2Vuc2UgdG8gdHJ5IHRvIGZpdCBsYXRlbnQgZmFjdG9ycyB0byBwcmVkaWN0IHRoZW0pLgoKIyMjIyBIb3cgdG8gZml0IHRoZSBJbmRlcGVuZGVuY2UgKE51bGwpIEJhc2VsaW5lIE1vZGVsOiBJdGVtIG1lYW5zIGFuZCB2YXJpYW5jZXMsIGJ1dCBOTyBjb3ZhcmlhbmNlcwoKCmBgYHtyLCBtb2RlbEluZCwgaW5jbHVkZT1UUlVFfQptb2RlbEluZGVwZW5kZW5jZSA9ICIKIyBJdGVtIGludGVyY2VwdHMgLS0+IH4gMSBpbmRpY2F0ZXMgbWVhbnMgb3IgaW50ZXJjZXB0cwojIFlvdSBjYW4gcHV0IG11bHRpcGxlIGxpbmVzIG9mIHN5bnRheCBvbiBhIHNpbmdsZSBsaW5lIHVzaW5nIGEgOyAKU2l0MXIgfiAxOyBTaXQyIH4gMTsgU2l0M3IgIH4gMTsgU2l0NCB+IDE7IFNpdDVyIH4gMTsgU2l0NiB+IDE7CgojIEl0ZW0gdmFyaWFuY2VzIGFuZCBjb3ZhcmlhbmNlcyAtLT4gdXNlIHRoZSB+fiBjb21tYW5kCgojIFZhcmlhbmNlczoKU2l0MXIgfn4gU2l0MXI7IFNpdDIgfn4gU2l0MjsgU2l0M3Igfn4gU2l0M3I7IFNpdDQgfn4gU2l0NDsgU2l0NXIgfn4gU2l0NXI7IFNpdDYgfn4gU2l0NjsgCgoiCm1vZGVsSW5kZXBlbmRlbmNlRXN0aW1hdGVzID0gc2VtKG1vZGVsID0gbW9kZWxJbmRlcGVuZGVuY2UsIGRhdGEgPSBoZnNTaXR1YXRpb25zLCBlc3RpbWF0b3IgPSAiTUxSIiwgbWltaWMgPSAibXBsdXMiKQpzdW1tYXJ5KG1vZGVsSW5kZXBlbmRlbmNlRXN0aW1hdGVzLCBmaXQubWVhc3VyZXMgPSBUUlVFKQpgYGAKCk5vdGUgaG93IHRoZSB0ZXN0IG9mIHRoZSBtb2RlbCB2cy4gc2F0dXJhdGVkIGlzIGlkZW50aWNhbCB0byB0aGUgdGVzdCBvZiB0aGUgbW9kZWwgdnMuIGJhc2VsaW5lOiB0aGF0IGluZGljYXRlcyB0aGlzIG1vZGVsIGlzIHRoZSBiYXNlbGluZSBtb2RlbC4KCkFsdGhvdWdoIG5vdCAwLCB0aGlzIGlzIHRoZSB3b3JzdCBwb3NzaWJsZSBSTVNFQSB3aGlsZSBzdGlsbCBhbGxvd2luZyBzZXBhcmF0ZSBtZWFucyBhbmQgdmFyaWFuY2VzIHBlciBpdGVtIGluIHRoZXNlIGRhdGEuIFJNU0VBIGlzIGEgcGFyc2ltb255LWNvcnJlY3RlZCBhYnNvbHV0ZSBmaXQgaW5kZXggKHNvLCBpdHMgZml0IGlzIHJlbGF0aXZlIHRvIHRoZSBzYXR1cmF0ZWQgbW9kZWwpLiAKCkNGSSBhbmQgVExJIGFyZSAwIGJlY2F1c2UgdGhleSBhcmUgImluY3JlbWVudGFsIGZpdCIgaW5kaWNlcyByZWxhdGl2ZSB0byB0aGUgaW5kZXBlbmRlbmNlIG1vZGVsICh3aGljaCB0aGlzIGlzKS4KClNSTVIgaXMgYWxzbyBhbiBhYnNvbHV0ZSBmaXQgaW5kZXggKHJlbGF0aXZlIHRvIHNhdHVyYXRlZCBtb2RlbCksIHNvIHRoaXMgaXMgdGhlIHdvcnN0IGl0IGdldHMgZm9yIHRoZXNlIGRhdGEsIHRvby4KCiMjIyBQb29yIE1vZGVsIEZpdDogTmVlZCBmb3IgTW9kZWwgTW9kaWZpY2F0aW9ucwoKRm9yIHRoaXMgc2VjdGlvbiwgYW55IG9mIHRoZSB0aHJlZSBlcXVpdmFsZW50IHNpbmdsZSBmYWN0b3IgbW9kZWxzIGNhbiBiZSB1c2VkLiAKCiMjIyMgTW9kaWZpY2F0aW9uIEluZGljZXMKClNvIGdsb2JhbCBmaXQgZm9yIHRoZSBvbmUtZmFjdG9yIG1vZGVsIGlzIG5vdCBzbyBnb29kIChSTVNFQSA9IC4xNzMsIENGSSA9IC43MzIpLiBXaGF0IGRvIHRoZSB2b29kb28gbW9kaWZpY2F0aW9uIGluZGljZXMgc3VnZ2VzdCB3ZSBkbyB0byBmaXggaXQ/IFRvIGdldCBtb2RpZmljYXRpb24gaW5kaWNlcywgdXNlIHRoZSBgYGBtb2RpZmljYXRpb25pbmRpY2VzKClgYGAgZnVuY3Rpb24uIEhlcmUsIHRoZSBmdW5jdGlvbiBpcyBjYWxsZWQgd2l0aCBvcHRpb25zOgoKKiBgYGBvYmplY3QgPSBtb2RlbDAxRXN0aW1hdGVzYGBgOiBUaGUgbW9kZWwgZXN0aW1hdGVzIG9iamVjdCBmcm9tIHdoaWNoIHRvIGRlcml2ZSBtb2RpZmljYXRpb24gaW5kaWNlcy4KKiBgYGBzb3J0LiA9IFRSVUVgYGA6IFNvcnQgdGhlIG91dHB1dCBmcm9tIGhpZ2hlc3QgdG8gbG93ZXN0IG1vZGlmaWNhdGlvbiBpbmRleC4KCmBgYHtyIG1vZGluZGljZXMsIGluY2x1ZGU9VFJVRX0KbW9kaWZpY2F0aW9uaW5kaWNlcyhvYmplY3QgPSBtb2RlbDAxRXN0aW1hdGVzLCBzb3J0LiA9IFRSVUUpCmBgYAoKVGhlIG91dHB1dCBpbmNsdWRlczoKCiogYGBgbGhzYGBgOiBMZWZ0IGhhbmQgc2lkZSBmb3IgcGFyYW1ldGVyIChpbiBgYGBsYXZhYW5gYGAgc3ludGF4KQoqIGBgYG9wYGBgOiBPcGVyYXRpb24gb2YgcGFyYW1ldGVyOiBgYGB+fmBgYCBpcyBmb3IgKHJlc2lkdWFsKSBjb3ZhcmlhbmNlczsgYGBgPX5gYGAgaXMgZm9yIGFkZGl0aW9uYWwgZmFjdG9yIGxvYWRpbmdzLiBBbGwgb3RoZXIgYGBgbGF2YWFuYGBgIHN5bnRheCB0eXBlcyBhcmUgcG9zc2libGUsIHRvbywgYnV0IGhlcmUgaXRlbSBtZWFucyBhbmQgdmFyaWFuY2VzIGZpdCBwZXJmZWN0bHkgKHNlZSBiZWxvdykKKiBgYGByaHNgYGA6IFJpZ2h0IGhhbmQgc2lkZSBmb3IgcGFyYW1ldGVyIChpbiBgYGBsYXZhYW5gYGAgc3ludGF4KQoqIGBgYG1pYGBgOiBNb2RpZmljYXRpb24gaW5kZXggdXNpbmcgTUwgCiogYGBgbWkuc2NhbGVkYGBgOiBNb2RpZmljYXRpb24gaW5kZXggdXNpbmcgTUxSICh1c2UgdGhpcyBvbmUpCiogYGBgZXBjYGBgOiBFeHBlY3RlZCBwYXJhbWV0ZXIgY2hhbmdlIChmcm9tIHplcm8pCiogYGBgc2VwYy5sdmBgYDogU3RhbmRhcmRpemVkIGV4cGVjdGVkIHBhcmFtZXRlciBjaGFuZ2UgdXNpbmcgYGBgc3RkLmx2YGBgIHN0YW5kYXJkaXphdGlvbgoqIGBgYHNlcGMuYWxsYGBgOiBTdGFuZGFyZGl6ZWQgZXhwZWN0ZWQgcGFyYW1ldGVyIGNoYW5nZSB1c2luZyBgYGBzdGQuYWxsYGBgIHN0YW5kYXJkaXphdGlvbgoqIGBgYHNlcGMubm94YGBgOiBTdGFuZGFyZGl6ZWQgZXhwZWN0ZWQgcGFyYW1ldGVyIGNoYW5nZSB1c2luZyBgYGBzdGQubm94YGBgIHN0YW5kYXJkaXphdGlvbgoKSGlnaGVzdCB2YWx1ZXMgYXJlIGZvciBlcnJvciBjb3ZhcmlhbmNlcyAoZm9yIHVua25vd24gbXVsdGlkaW1lbnNpb25hbGl0eSkuCgojIyMjIEFub3RoZXIgYXBwcm9hY2g6IFJlc2lkdWFsIENvdmFyaWFuY2UgTWF0cmljZXMKCkFub3RoZXIgYXBwcm9hY2jigJRob3cgYWJvdXQgd2UgZXhhbWluZSBsb2NhbCBmaXQgYW5kIHNlZSB3aGVyZSB0aGUgcHJvYmxlbXMgc2VlbSB0byBiZT8gCgpUaGUgbWVhbnMgYW5kIHZhcmlhbmNlcyBvZiB0aGUgaXRlbXMgd2lsbCBiZSBwZXJmZWN0bHkgcmVwcm9kdWNlZCwgc28gdGhhdOKAmXMgbm90IGFuIGlzc3VlLiBNaXNmaXQgcmVzdWx0cyBmcm9tIHRoZSBkaWZmZXJlbmNlIGJldHdlZW4gdGhlIG9ic2VydmVkIGFuZCBtb2RlbC1wcmVkaWN0ZWQgY292YXJpYW5jZXMuCgpgYGBsYXZhYW5gYGAgZ2l2ZXMgdXMgdGhlICJyZXNpZHVhbCIgKGRlZmluZWQgYXMgb2JzZXJ2ZWQg4oCTIHByZWRpY3RlZCkgb3IgImxlZnRvdmVyIiBjb3ZhcmlhbmNlIG1hdHJpeCwgYnV0IGl0IGlzIHNjYWxlIGRlcGVuZGVudCBhbmQgdGh1cyBub3Qgc28gaGVscGZ1bC4gV2UgY2FuIHVzZSB0aGUgYGBgcmVzaWQoKWBgYCBmdW5jdGlvbiB0byBvYnRhaW4gdGhlIHJlc2lkdWFsIGNvdmFyaWFuY2UgbWF0cml4IChvYnNlcnZlZCBjb3ZhcmlhbmNlcyBtaW51cyBtb2RlbC1pbXBsaWVkIGNvdmFyaWFuY2VzKToKCmBgYHtyIHJlc2lkLCBpbmNsdWRlPVRSVUV9CnJlc2lkKG9iamVjdCA9IG1vZGVsMDFFc3RpbWF0ZXMsIHR5cGUgPSAicmF3IikKYGBgCmBgYGxhdmFhbmBgYCBhbHNvIGdpdmVzIHVzICJub3JtYWxpemVkIiByZXNpZHVhbHMsIHdoaWNoIGNhbiBiZSB0aG91Z2h0IG9mIGFzIHotc2NvcmVzIGZvciBob3cgbGFyZ2UgdGhlIHJlc2lkdWFsIGxlZnRvdmVyIGNvdmFyaWFuY2UgaXMgaW4gYWJzb2x1dGUgdGVybXMuIEJlY2F1c2UgdGhlIGRlbm9taW5hdG9yIGRlY3JlYXNlcyB3aXRoIHNhbXBsZSBzaXplLCBob3dldmVyLCB0aGVzZSB2YWx1ZXMgbWF5IGJlIGluZmxhdGVkIGluIGxhcmdlIHNhbXBsZXMsIHNvIGxvb2sgZm9yIHJlbGF0aXZlbHkgbGFyZ2UgdmFsdWVzLgoKIk5vcm1hbGl6ZWQiIFJlc2lkdWFscyBmb3IgSW50ZXItSXRlbSBDb3ZhcmlhbmNlcyA9IChvYnNlcnZlZCDigJMgcHJlZGljdGVkKSAvIFNEKG9ic2VydmVkKToKCmBgYHtyIHJlc2lkTiwgaW5jbHVkZT1UUlVFfQpyZXNpZChvYmplY3QgPSBtb2RlbDAxRXN0aW1hdGVzLCB0eXBlID0gIm5vcm1hbGl6ZWQiKQpgYGAKTkVHQVRJVkUgTk9STUFMSVpFRCBSRVNJRFVBTDogTGVzcyByZWxhdGVkIHRoYW4geW91IHByZWRpY3RlZCAoZG9u4oCZdCB3YW50IHRvIGJlIHRvZ2V0aGVyKQpQT1NJVElWRSBOT1JNQUxJWkVEIFJFU0lEVUFMOiBNb3JlIHJlbGF0ZWQgdGhhbiB5b3UgcHJlZGljdGVkICh3YW50IHRvIGJlIG1vcmUgdG9nZXRoZXIpCgpXaHkgbWlnaHQgdGhlIG5vcm1hbGl6ZWQgcmVzaWR1YWxzIChsZWZ0b3ZlciBjb3JyZWxhdGlvbnMpIGZvciB0aGUgcG9zaXRpdmUtd29yZGVkIGl0ZW1zIGJlIGxhcmdlciB0aGFuIGZvciB0aGUgbmVnYXRpdmVseS13b3JkZWQgaXRlbXM/IAoKVGhlc2UgcmVzdWx0cyBzdWdnZXN0IHRoYXQgd29yZGluZyB2YWxlbmNlIGlzIHBsYXlpbmcgYSBsYXJnZXIgcm9sZSBpbiB0aGUgcGF0dGVybiBvZiBjb3ZhcmlhbmNlIGFjcm9zcyBpdGVtcyB0aGFuIHdoYXQgdGhlIG9uZS1mYWN0b3IgbW9kZWwgcHJlZGljdHMuIFJhdGhlciB0aGFuIGFkZGluZyB2b29kb28gY292YXJpYW5jZXMgYW1vbmcgdGhlIHJlc2lkdWFscyBmb3Igc3BlY2lmaWMgaXRlbXMsIGhvdyBhYm91dCBhIHR3by1mYWN0b3IgbW9kZWwgYmFzZWQgb24gd29yZGluZyBpbnN0ZWFkPwoKIyMjIE1vZGVsIDQuIEZ1bGx5IFotU2NvcmVkLCAyLUZhY3RvciBNb2RlbAoKSGVyZSwgd2UgdXNlIHRoZSBzaG9ydGVuZWQgc3ludGF4IGFuZCB0aGUgYGBgc2VtKClgYGAgZnVuY3Rpb24gdG8gZ2V0IHJlc3VsdHMuCgpgYGB7ciBtb2RlbDA0LCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDRTeW50YXggPSAiCgojIFNpdFAgbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdFAgPX4gU2l0MiArIFNpdDQgKyBTaXQ2CgojIFNpdE4gbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdE4gPX4gU2l0MXIgKyBTaXQzciArIFNpdDVyCgoiCgptb2RlbDA0RXN0aW1hdGVzID0gc2VtKG1vZGVsID0gbW9kZWwwNFN5bnRheCwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIsIHN0ZC5sdiA9IFRSVUUpCnN1bW1hcnkobW9kZWwwNEVzdGltYXRlcywgZml0Lm1lYXN1cmVzID0gVFJVRSwgcnNxdWFyZSA9IFRSVUUsIHN0YW5kYXJkaXplZCA9IFRSVUUpCmBgYAoKVGhpcyBtb2RlbCBmaXRzIGJldHRlciAod2Ugd291bGQgY2FsbCB0aGlzIGdvb2QgZml0KS4gV2UgY2FuIGFsc28gY29tcGFyZSB0aGUgZml0IG9mIHRoaXMgbW9kZWwgd2l0aCBNb2RlbCAxIHVzaW5nIHRoZSBgYGBhbm92YSgpYGBgIGZ1bmN0aW9uLiBIZXJlLCB0aGUgbnVsbCBoeXBvdGhlc2lzIGlzIHRoYXQgTW9kZWwgMSBmaXRzIGFzIHdlbGwgYXMgTW9kZWwgNC4KCmBgYHtyIG1vZGVsQ29tcCwgaW5jbHVkZT1UUlVFfQphbm92YShtb2RlbDAxRXN0aW1hdGVzLCBtb2RlbDA0RXN0aW1hdGVzKQpgYGAKCgoKCgoKCgoKClRoaXMgZnVuY3Rpb24gY29uZHVjdHMgdGhlIE1MUiB2ZXJzaW9uIG9mIHRoZSBsaWtlbGlob29kIHJhdGlvIHRlc3QgZm9yIHVzLiBUaGUgc2lnbmlmaWNhbnQgZGlmZmVyZW5jZSBpbmRpY2F0ZXMgdGhhdCBNb2RlbCA0IGZpdHMgYmV0dGVyIHRoYW4gTW9kZWwgMS4gCgpMZXTigJlzIHNlZTogQW55IG1vcmUgbG9jYWwgZml0IHByb2JsZW1zPyBUaGUgbW9kaWZpY2F0aW9uIGluZGljZXMgYXJlIGJldHRlciAodmFsdWVzIG9mIGEgbGl0dGxlIG92ZXIgMTAgc2VlbSBva2F5KS4KCmBgYHtyIHBvc3RGaXQsIGluY2x1ZGU9VFJVRX0KbW9kaWZpY2F0aW9uaW5kaWNlcyhvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCBzb3J0LiA9IFRSVUUpCgpgYGAKClRoZSBub3JtYWxpemVkIHJlc2lkdWFscyBoYXZlIHR3byB2YWx1ZXMgdGhhdCBhcmUgYmlnZ2VyIGluIGFic29sdXRlIHZhbHVlIHRoYW4gMjoKCmBgYHtyIHBvc3RGaXQyLCBpbmNsdWRlPVRSVUV9CnJlc2lkKG9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMsIHR5cGUgPSAibm9ybWFsaXplZCIpCmBgYApCZWNhdXNlIHdlIGhhdmUgbm8gcmVhbCB0aGVvcmV0aWNhbCBvciBkZWZlbnNpYmxlIHJlYXNvbiB0byBmaXQgYW55IG9mIHRoZXNlIHN1Z2dlc3RlZCBwYXJhbWV0ZXJzLCB3ZSB3aWxsIG5vdCBhZGQgYW55IG5ldyBwYXJhbWV0ZXJzLiBUaGlzIHdpbGwgYmUgYWJvdXQgYXMgZ29vZCBhcyBpdCBnZXRzLiAKCkhlcmUgaXMgdGhlIHBhdGggZGlhZ3JhbSBvZiB0aGUgbW9kZWwgdXNpbmcgdGhlIHN0YW5kYXJkaXplZCBlc3RpbWF0ZXM6CgpgYGB7ciBwYXRoNCwgaW5jbHVkZT1UUlVFfQpzZW1QYXRocyhvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCB3aGF0ID0gInN0ZCIpCmBgYAoKIyMjIENhbGN1bGF0aW5nIFJlbGlhYmlsaXRpZXMKCkFzIHdlIGhhdmUgZGVtb25zdHJhdGVkIGdvb2QgbW9kZWwgZml0LCBlc3RpbWF0ZXMgb2YgdHJhaXQgcmVsaWFiaWxpdGllcyBjYW4gbm93IGJlIGZvdW5kLiBBbHRob3VnaCBJIGRvIG5vdCBkaXNwZW5zZSBzdWNoIGFkdmljZSwgbWFueSBwZW9wbGUgdXNlIGEgQ0ZBIHRvIGluZGljYXRlIG1vZGVsIGZpdCB0aGVuIHByb2NlZWQgdG8gdXNlIHN1bSBzY29yZXMgZm9yIGVhY2ggdHJhaXQgaW4gYSBtb2RlbC4gSSBkbyBub3QgbGlrZSB0aGlzIGJlY2F1c2Ugc3VtIHNjb3JlcyBhcmUgcGVyZmVjdGx5IGNvcnJlbGF0ZWQgd2l0aCB0aGUgZmFjdG9yIHNjb3JlcyBmcm9tIHRoZSBwYXJhbGxlbCBpdGVtcyBtb2RlbCAtLSBidXQgd2UgbmV2ZXIgdGVzdGVkIHRoYXQgbW9kZWwgKHNob3VsZCBpdCBub3QgZml0IHdlIG1heSBnZXQgYSByZXZlcnNhbCBpbiB0aGUgcmFuayBvcmRlcmluZyBvZiBwZW9wbGUgYnkgc2NvcmUpLgoKIyMjIyBSZWxpYWJpbGl0aWVzIGZvciBTdW0gU2NvcmVzIChPbWVnYSkKClRoYXQgc2FpZCwgcmVsaWFiaWxpdGllcyBmb3Igc3VtIHNjb3JlcyBjYW4gYmUgZm91bmQgYnkgdXNpbmcgQ0ZBIG1vZGVsIHBhcmFtZXRlcnMuIFRoaXMgcmVsaWFiaWxpdHkgY29lZmZpY2llbnQgaXMgY2FsbGVkICJPbWVnYSIgYnkgUm9kIE1jRG9uYWxkIGFuZCBpcyBjYWxjdWxhdGVkOgoKJCQgXHJob19cb21lZ2EgPSBcZnJhY3tcc2lnbWFeMl9GXGxlZnQoIFxzdW1fe2k9MX1ee0l0ZW1zfSBcbGFtYmRhX2kgXHJpZ2h0KV4yfXtcc2lnbWFeMl9GXGxlZnQoIFxzdW1fe2k9MX1ee0l0ZW1zfSBcbGFtYmRhX2kgXHJpZ2h0KV4yIFxzdW1fe2k9MX1ee0l0ZW1zfSBcc3VtX3tqPTF9XntJdGVtc30gXHBzaV97aWp9fSQkCgpJbiB3b3JkcywgT21lZ2EgPSBWYXIoRmFjdG9yKSogKFN1bSBvZiBsb2FkaW5ncyleMiAvIFsgVmFyKEZhY3RvcikqIChTdW0gb2YgbG9hZGluZ3MpXjIgKyBTdW0gb2YgZXJyb3IgdmFyaWFuY2VzICsgMiogU3VtIG9mIGVycm9yIGNvdmFyaWFuY2VzXQoKCiMjIyMgQ2FsY3VsYXRpbmcgT21lZ2EgZnJvbSBgYGBsYXZhYW5gYGAKClRocm91Z2ggdGhlIHVzZSBvZiBwYXJhbWV0ZXIgbGFiZWxzIGFuZCBuZXcgcGFyYW1ldGVycywgeW91IGNhbiB1c2UgYGBgbGF2YWFuYGBgIHRvIGNhbGN1bGF0ZSBPbWVnYS4gSW4gdGhpcyBzeW50YXgsIHRoZSB0ZXJtcyBiZWZvcmUgdGhlIGl0ZW1zIGFyZSBsYWJlbHMgcmVwcmVzZW50aW5nIHRoZSBmYWN0b3IgbG9hZGluZ3MgYW5kIHVuaXF1ZSB2YXJpYW5jZXMuIFRoZXkgY2FuIGJlIHVzZWQgbGF0ZXIgaW4gdGhlIHN5bnRheCB0byBmb3JtIG5ldyBwYXJhbWV0ZXJzIG9yIHRvIHB1dCBjb25zdHJhaW50cyBvbiB0aGUgbW9kZWwuCgpgYGB7ciBtb2RlbDA0T21lZ2EsIGluY2x1ZGU9VFJVRX0KbW9kZWwwNFN5bnRheE9tZWdhID0gIgoKIyBTaXRQIGxvYWRpbmdzIChhbGwgZXN0aW1hdGVkKQpTaXRQID1+IEwyKlNpdDIgKyBMNCpTaXQ0ICsgTDYqU2l0NgoKIyBTaXROIGxvYWRpbmdzIChhbGwgZXN0aW1hdGVkKQpTaXROID1+IEwxKlNpdDFyICsgTDMqU2l0M3IgKyBMNSpTaXQ1cgoKIyBVbmlxdWUgVmFyaWFuY2VzOgpTaXQxciB+fiBFMSpTaXQxcjsgU2l0MiB+fiBFMipTaXQyOyBTaXQzciB+fiBFMypTaXQzcjsgU2l0NCB+fiBFNCpTaXQ0OyBTaXQ1ciB+fiBFNSpTaXQ1cjsgU2l0NiB+fiBFNipTaXQ2OyAKCgojIENhbGN1bGF0ZSBPbWVnYSBSZWxpYWJpbGl0eSBmb3IgU3VtIFNjb3JlczoKT21lZ2FQIDo9ICgoTDIgKyBMNCArIEw2KV4yKSAvICggKChMMiArIEw0ICsgTDYpXjIpICsgRTIgKyBFNCArIEU2KQpPbWVnYU4gOj0gKChMMSArIEwzICsgTDUpXjIpIC8gKCAoKEwxICsgTDMgKyBMNSleMikgKyBFMSArIEUzICsgRTUpCiIKCm1vZGVsMDRFc3RpbWF0ZXNPbWVnYSA9IHNlbShtb2RlbCA9IG1vZGVsMDRTeW50YXhPbWVnYSwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIsIHN0ZC5sdiA9IFRSVUUpCnN1bW1hcnkobW9kZWwwNEVzdGltYXRlc09tZWdhLCBmaXQubWVhc3VyZXMgPSBGQUxTRSwgcnNxdWFyZSA9IEZBTFNFLCBzdGFuZGFyZGl6ZWQgPSBGQUxTRSwgaGVhZGVyID0gRkFMU0UpCmBgYAoKQ2FsY3VsYXRpbmcgT21lZ2EgdGhyb3VnaCBgYGBsYXZhYW5gYCBhbHNvIHByb3ZpZGVzIGl0cyBzdGFuZGFyZCBlcnJvci4gTm90ZTogdGhlIE9tZWdhIGVxdWF0aW9uIHVzZWQgYWJvdmUgaXMgZm9yIHRoZSBaLXNjb3JlIGZhY3RvciBpZGVudGlmaWNhdGlvbiBtZXRob2QuIElmIHRoZSBtYXJrZXItaXRlbSBtZXRob2QgaXMgdXNlZCBmb3IgZmFjdG9yIGxvYWRpbmdzLCB0aGVuIG11bHRpcGx5IHRoZSBzdW0gb2YgdGhlIGxvYWRpbmdzIGJ5IHRoZSB2YXJpYW5jZSBvZiB0aGUgZmFjdG9yLCBhcyBzaG93biBpbiB0aGUgZXF1YXRpb24gYWJvdmUuCgoKT2Ygbm90ZSBhYm91dCBPbWVnYTogSWYgd2UgY29uc3RyYWluIGFsbCBmYWN0b3IgbG9hZGluZ3Mgb2YgYSB0cmFpdCB0byBiZSBlcXVhbCAoY2FsbGVkIFRhdS1FcXVpdmFsZW50KSwgT21lZ2EgaXMgZXF1YWwgdG8gQWxwaGEuIEluIHRoZSBzeW50YXggYmVsb3csIHB1dHRpbmcgdGhlIGxhYmVscyBMUCBhbmQgTE4gaW4gbXVsdGlwbGUgcGxhY2VzIGNhdXNlcyB0aGUgZmFjdG9yIGxvYWRpbmdzIGZvciB0aG9zZSBwbGFjZXMgdG8gYmUgY29uc3RyYWluZWQgdG8gYmUgZXF1YWw6CgoKYGBge3IgbW9kZWwwNEFscGhhLCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDRTeW50YXhBbHBoYSA9ICIKCiMgU2l0UCBsb2FkaW5ncyAoYWxsIGVzdGltYXRlZCkKU2l0UCA9fiBMUCpTaXQyICsgTFAqU2l0NCArIExQKlNpdDYKCiMgU2l0TiBsb2FkaW5ncyAoYWxsIGVzdGltYXRlZCkKU2l0TiA9fiBMTipTaXQxciArIExOKlNpdDNyICsgTE4qU2l0NXIKCiMgVW5pcXVlIFZhcmlhbmNlczoKU2l0MXIgfn4gRTEqU2l0MXI7IFNpdDIgfn4gRTIqU2l0MjsgU2l0M3Igfn4gRTMqU2l0M3I7IFNpdDQgfn4gRTQqU2l0NDsgU2l0NXIgfn4gRTUqU2l0NXI7IFNpdDYgfn4gRTYqU2l0NjsgCgojIENhbGN1bGF0ZSBPbWVnYSBSZWxpYWJpbGl0eSBmb3IgU3VtIFNjb3JlczoKT21lZ2FQIDo9ICgoMypMUCleMikgLyAoICgoMypMUCleMikgKyBFMiArIEU0ICsgRTYpCk9tZWdhTiA6PSAoKDMqTE4pXjIpIC8gKCAoKDMqTE4pXjIpICsgRTEgKyBFMyArIEU1KQoiCgptb2RlbDA0RXN0aW1hdGVzQWxwaGEgPSBzZW0obW9kZWwgPSBtb2RlbDA0U3ludGF4QWxwaGEsIGRhdGEgPSBoZnNTaXR1YXRpb25zLCBlc3RpbWF0b3IgPSAiTUxSIiwgbWltaWMgPSAibXBsdXMiLCBzdGQubHYgPSBUUlVFKQpzdW1tYXJ5KG1vZGVsMDRFc3RpbWF0ZXNBbHBoYSwgZml0Lm1lYXN1cmVzID0gVFJVRSwgcnNxdWFyZSA9IFRSVUUsIHN0YW5kYXJkaXplZCA9IFRSVUUpCmBgYAoKCkNvbXBhcmVkIHdpdGggd2hhdCB0aGUgYGBgcHN5Y2hgYGAgcGFja2FnZSBnaXZlczoKCmBgYHtyIGFscGhhLCBpbmNsdWRlPVRSVUV9CmFscGhhKHggPSBoZnNTaXR1YXRpb25zW2MoIlNpdDIiLCAiU2l0NCIsICJTaXQ2IildLCB1c2UgPSAiYWxsLm9icyIpCmFscGhhKHggPSBoZnNTaXR1YXRpb25zW2MoIlNpdDFyIiwgIlNpdDNyIiwgIlNpdDVyIildLCB1c2UgPSAiYWxsLm9icyIpCmBgYAoKIyMjIyBSZWxpYWJpbGl0aWVzIGZvciBGYWN0b3IgU2NvcmVzCgpGYWN0b3Igc2NvcmVzIGhhdmUgYSBsb25nIGhpc3Rvcnkgd2l0aCBtYW55IGNyaXRpcXVlcyBhbmQgY29tcGxhaW50cy4gVGhhdCBzYWlkLCBmYWN0b3Igc2NvcmVzIGNhbiBiZSBjb25zdHJ1Y3RlZCBhbmFsb2dvdXNseSBhY3Jvc3MgbWVhc3VyZW1lbnQgbW9kZWxzIHVzaW5nIEJheWVzaWFuIGVzdGltYXRlcy4gV2Ugd2lsbCBkZXNjcmliZSB0aGlzIG1vcmUgaW4gYSBsYXRlciBsZWN0dXJlLiBGb3Igb3VyIHB1cnBvc2VzLCBpbiBDRkEsIHRoZSB0d28gbWFpbiB0eXBlcyBvZiBCYXllc2lhbiBFc3RpbWF0ZXMgKE1BUDogTWF4aW11bSBBIFBvc3RlcmlvcmkgYW5kIEVBUDogRXhwZWN0ZWQgQSBQb3N0ZXJpb3JpKSBhcmUgaWRlbnRpY2FsLiBgYGBsYXZhYW5gYGAgd2lsbCBub3QgcHJvdmlkZSBzdGFuZGFyZCBlcnJvcnMgZm9yIGZhY3RvciBzY29yZXMsIHNvIEkgY3JlYXRlZCBhIGZ1bmN0aW9uIGBgYGZhY3RvclNjb3JlcygpYGBgIHRvIG5vdCBvbmx5IGNyZWF0ZSB0aGUgZmFjdG9yIHNjb3JlcyB1c2luZyBFQVAgKGFnYWluLCBpZGVudGljYWwgdG8gTUFQKSBidXQgYWxzbyB0byBnaXZlIHN0YW5kYXJkIGVycm9ycyBmb3IgZWFjaCBzY29yZS4gVGhlIGZ1bmN0aW9uIHRha2VzIHRoZSBgYGBsYXZhYW5gYGAgbW9kZWwgb3V0cHV0IGFuZCByZXR1cm5zIGEgbGlzdCBvZiB0aHJlZSBlbGVtZW50czogYGBgc2NvcmVzYGBgIGNvbnRhaW5pbmcgZmFjdG9yIHNjb3JlcyBhbmQgc3RhbmRhcmQgZXJyb3JzLCBgYGBmYWN0b3JDb3ZgYGAgY29udGFpbmluZyB0aGUgdGhlb3JldGljYWwgY292YXJpYW5jZSBtYXRyaXggb2YgdGhlIGZhY3RvciBzY29yZXMsIGFuZCBgYGBmYWN0b3JDb3JgYGAgdGhlIHRoZW9yZXRpY2FsIGNvcnJlbGF0aW9uIG1hdHJpeCBvZiB0aGUgZmFjdG9yIHNjb3Jlcy4KClRvIGRldGVybWluZSB0aGUgcmVsaWFiaWxpdHkgb2YgYSBmYWN0b3Igc2NvcmUsIHdlIG11c3QgcmV0dXJuIHRvIG91ciBjbGFzc2ljYWwgbm90aW9uIG9mIHdoYXQgcmVsaWFiaWxpdHkgbWVhbnM6CiQkIFxyaG8gPSBcZnJhY3tWYXIoVHJ1ZSl9e1ZhcihUb3RhbCl9ID0gXGZyYWN7VmFyKFRydWUpfXtWYXIoVHJ1ZSkgKyBWYXIoRXJyb3IpfSA9IFxmcmFje1ZhcihGKX17VmFyKEYpK1NFKEYpXjJ9JCQKSW4gQ0ZBLCAkVmFyKFRydWUpJCBpcyBmb3VuZCBieSB0aGUgZXN0aW1hdGVkIGZhY3RvciB2YXJpYW5jZSBhbmQgJFZhcihFcnJvcikkIGNvbWVzIGZyb20gdGhlIHNxdWFyZWQgc3RhbmRhcmQgZXJyb3Igb2YgYSBmYWN0b3Igc2NvcmUgKGZyb20gYW4gb2JzZXJ2YXRpb24gd2l0aCBjb21wbGV0ZSBkYXRhKS4KCkkgY3JlYXRlZCBhIGZ1bmN0aW9uIG5hbWVkIGBgYGZhY3RvclNjb3JlUmVsaWFiaWxpdHkoKWBgYCB0byBjYWxjdWxhdGUgdGhlIHJlbGlhYmlsaXR5IGZvciBmYWN0b3Igc2NvcmVzLiBVc2luZyB0aGUgZnVuY3Rpb24gd2UgY2FuIHNlZSB0aGF0IHRoZSByZWxpYWJpbGl0eSBvZiBvdXIgZmFjdG9yIHNjb3JlcyBpcyAuODE3IGZvciBTaXRQIGFuZCAuODUxIGZvciBTaXROLCB3aGljaCBhcmUgaGlnaGVyIHRoYW4gdGhlIE9tZWdhIHJlbGlhYmxpdGllcyBmb3Igc3VtIHNjb3Jlcy4gSW4gZ2VuZXJhbCwgZmFjdG9yIHNjb3JlIHJlbGlhYmlsaXRpZXMgYXJlIGdyZWF0ZXIgdGhhbiB3aGF0IGlzIGZvdW5kIGluIE9tZWdhIGFuZCBBbHBoYSBkdWUgdG8gdGhlIHVzZSBvZiBhIHByaW9yIGRpc3RyaWJ1dGlvbiBmb3IgdGhlIGZhY3RvciBpdHNlbGYgYW5kIGR1ZSB0byB0aGUgZmFjdG9yIGNvcnJlbGF0aW9uIGFsbG93aW5nIGluZGlyZWN0IGluZm9ybWF0aW9uIGZyb20gb3RoZXIgZmFjdG9ycyB0byBoZWxwIGluIHRoZSBlc3RpbWF0aW9uIG9mIGVhY2ggZmFjdG9yLgoKYGBge3Igc2NvcmVzLCBpbmNsdWRlPVRSVUV9CgpmYWN0b3JTY29yZXMgPSBmdW5jdGlvbihsYXZPYmplY3QpewogIG91dHB1dCA9IGluc3BlY3Qob2JqZWN0ID0gbGF2T2JqZWN0LCB3aGF0ID0gImVzdCIpCiAgCiAgc2lnbWEgPSBvdXRwdXQkbGFtYmRhICUqJSBvdXRwdXQkcHNpICUqJSB0KG91dHB1dCRsYW1iZGEpICsgb3V0cHV0JHRoZXRhCiAgbW9kZWxEYXRhID0gbGF2T2JqZWN0QERhdGFAWFtbMV1dCiAgCiAgc2NvcmVzID0gdChvdXRwdXQkYWxwaGElKiVtYXRyaXgoMSwgbnJvdz0xLCBuY29sPWRpbShtb2RlbERhdGEpWzFdKSArb3V0cHV0JHBzaSAlKiUgdChvdXRwdXQkbGFtYmRhKSAlKiUgc29sdmUoc2lnbWEpJSolKHQobW9kZWxEYXRhKSAtIG91dHB1dCRudSUqJW1hdHJpeCgxLCBucm93PTEsIG5jb2w9ZGltKG1vZGVsRGF0YSlbMV0pKSkKICB2YXJzY29yZXMgPSBvdXRwdXQkcHNpIC0gb3V0cHV0JHBzaSAlKiUgdChvdXRwdXQkbGFtYmRhKSAlKiUgc29sdmUoc2lnbWEpICUqJSBvdXRwdXQkbGFtYmRhICUqJSBvdXRwdXQkcHNpCiAgZmFjdG9yU0UgPSBzcXJ0KGRpYWcodmFyc2NvcmVzKSkKICBuYW1lcyhmYWN0b3JTRSkgPSBwYXN0ZTAobmFtZXMoZmFjdG9yU0UpLCAiLlNFIikKICBmYWN0b3JTRW1hdCA9IG1hdHJpeCgxLCBucm93PW5yb3coc2NvcmVzKSwgbmNvbCA9IDEpICUqJSBtYXRyaXgoZmFjdG9yU0UsIG5yb3cgPSAxLCBuY29sID0gbmNvbChzY29yZXMpKQogIGNvbG5hbWVzKGZhY3RvclNFbWF0KSA9IG5hbWVzKGZhY3RvclNFKQogIAogIHJlc3VsdCA9IGRhdGEuZnJhbWUoY2JpbmQoc2NvcmVzLCBmYWN0b3JTRW1hdCkpCiAgbmFtZXMocmVzdWx0KQogIG9kZHMgPSBzZXEoMSwgbmNvbChyZXN1bHQpLTEsIDIpCiAgZXZlbnMgPSBzZXEoMiwgbmNvbChyZXN1bHQpLCAyKQogIHJlc3VsdCA9IHJlc3VsdFtjKG9kZHMsZXZlbnMpXQogIAogIGZhY3RvckNvdiA9IHZhcnNjb3JlcwogIGlmIChkaW0odmFyc2NvcmVzKVsxXSA9PSAxICYgZGltKHZhcnNjb3JlcylbMl0gPT0gMSl7CiAgICBmYWN0b3JDb3JyID0gc29sdmUoc3FydCh2YXJzY29yZXMpKSAlKiUgdmFyc2NvcmVzICUqJSBzb2x2ZShzcXJ0KHZhcnNjb3JlcykpCiAgfSBlbHNlIHsKICAgIGZhY3RvckNvcnIgPSBzb2x2ZShzcXJ0KGRpYWcoZGlhZyh2YXJzY29yZXMpKSkpICUqJSB2YXJzY29yZXMgJSolIHNvbHZlKHNxcnQoZGlhZyhkaWFnKHZhcnNjb3JlcykpKSkgIAogIH0KICAKICAKICByZXR1cm4obGlzdChzY29yZXMgPSByZXN1bHQsIGZhY3RvckNvdiA9IGZhY3RvckNvdiwgZmFjdG9yQ29yciA9IGZhY3RvckNvcnIpKQp9CgoKCmZhY3RvclNjb3JlUmVsaWFiaWxpdHkgPSBmdW5jdGlvbihsYXZPYmplY3QpewogIG91dHB1dCA9IGluc3BlY3Qob2JqZWN0ID0gbGF2T2JqZWN0LCB3aGF0ID0gImVzdCIpCiAgc2lnbWEgPSBvdXRwdXQkbGFtYmRhICUqJSBvdXRwdXQkcHNpICUqJSB0KG91dHB1dCRsYW1iZGEpICsgb3V0cHV0JHRoZXRhCiAgdmFyc2NvcmVzID0gb3V0cHV0JHBzaSAtIG91dHB1dCRwc2kgJSolIHQob3V0cHV0JGxhbWJkYSkgJSolIHNvbHZlKHNpZ21hKSAlKiUgb3V0cHV0JGxhbWJkYSAlKiUgb3V0cHV0JHBzaQogIAogIHJldHVybihkaWFnKG91dHB1dCRwc2kpLyhkaWFnKG91dHB1dCRwc2kpICsgZGlhZyh2YXJzY29yZXMpKSkKICAKfQpmYWN0b3JTY29yZVJlbGlhYmlsaXR5KGxhdk9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMpCgpgYGAKCiMjIyBUZXN0aW5nIEFzc3VtcHRpb25zIG9mIENsYXNzaWNhbCBUZXN0IFRoZW9yeQoKV2UgY2FuIGFsc28gY29tcGFyZSB0aGUgbW9kZWwgZml0IG9mIHRoZSBDRkEgbW9kZWwgd2l0aCB0aGUgdGF1LWVxdWl2YWxlbnQgbW9kZWwsIGVzc2VudGlhbGx5IHRlc3Rpbmcgd2hldGhlciBvciBub3QgQ1RUIChhbmQgYWxwaGEpIGlzIGFwcHJvcHJpYXRlOgoKYGBge3IgbW9kZWxDb21wMiwgaW5jbHVkZT1UUlVFfQphbm92YShtb2RlbDA0RXN0aW1hdGVzQWxwaGEsIG1vZGVsMDRFc3RpbWF0ZXNPbWVnYSkKYGBgCgpUaGUgc2lnbmlmaWNhbnQgZGlmZmVyZW5jZSBpbmRpY2F0ZXMgdGhhdCB0aGUgdGF1LWVxdWl2YWxlbnQgYXNzdW1wdGlvbnMgb2YgZXF1YWwgaXRlbSBsb2FkaW5ncyBkbyBub3QgaG9sZCBmb3IgYWxsIG9mIHRoZSBkYXRhLiBJbiB0aGUgTXBsdXMgaGFuZG91dCwgTGVzYSBIb2ZmbWFuIHNob3dzIHRoYXQgdGF1IGVxdWl2YWxlbmNlIGhvbGRzIGZvciBvbmUgb2YgdGhlIHN1YnNjYWxlcywgYnV0ICB3ZSBkb24ndCBuZWVkIHRvIGhhdmUgdGF1IGVxdWl2YWxlbmNlIHRvIG1vdmUgZm9yd2FyZCB3aXRoIHJlc3VsdHMgYXMgQ0ZBIGlzIHN1YnN1bWVzIHRoZSB0YXUtZXF1aXZhbGVudCBtb2RlbCAobWVhbmluZyBpdCB3aWxsIGJlIHRhdSBlcXVpdmFsZW50IGlmIHRoZSBkYXRhIGFyZSB0YXUgZXF1aXZhbGVudCBidXQgY2FuIGFsc28gYmUgbW9yZSBnZW5lcmFsKS4KCkFub3RoZXIgbW9kZWwgb2Z0ZW4gZGlzY3Vzc2VkIGluIENUVCBpcyB0aGUgcGFyYWxsZWwgaXRlbXMgbW9kZWwuIFRoZSBDRkEgdmVyc2lvbiBvZiB0aGUgcGFyYWxsZWwgaXRlbXMgbW9kZWwgaXMgYSBtb2RlbCB3aGVyZSBhbGwgZmFjdG9yIGxvYWRpbmdzIGZvciBhIGZhY3RvciBhcmUgY29uc3RyYWluZWQgdG8gYmUgZXF1YWwgYW5kIGFsbCB1bmlxdWUgdmFyaWFuY2VzIGZvciBhIGZhY3RvciBhcmUgY29uc3RyYWluZWQgdG8gYmUgZXF1YWwuIFRoaXMgbW9kZWwgaXMgb25lIHN0ZXAgbW9yZSByZXN0cmljdGl2ZSB0aGFuIHRoZSB0YXUgZXF1aXZhbGVudCBpdGVtcyBtb2RlbC4gU3ludGF4IGZvciB0aGlzIG1vZGVsIGlzIGFzIGZvbGxvd3M6CgpgYGB7ciBwYXJhbGxlbEl0ZW1zLCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDRTeW50YXhTQiA9ICIKCiMgU2l0UCBsb2FkaW5ncyAoYWxsIGVzdGltYXRlZCkKU2l0UCA9fiBMUCpTaXQyICsgTFAqU2l0NCArIExQKlNpdDYKCiMgU2l0TiBsb2FkaW5ncyAoYWxsIGVzdGltYXRlZCkKU2l0TiA9fiBMTipTaXQxciArIExOKlNpdDNyICsgTE4qU2l0NXIKCiMgVW5pcXVlIFZhcmlhbmNlczoKU2l0MXIgfn4gRU4qU2l0MXI7IFNpdDIgfn4gRVAqU2l0MjsgU2l0M3Igfn4gRU4qU2l0M3I7IFNpdDQgfn4gRVAqU2l0NDsgU2l0NXIgfn4gRU4qU2l0NXI7IFNpdDYgfn4gRVAqU2l0NjsgCgojIENhbGN1bGF0ZSBPbWVnYSBSZWxpYWJpbGl0eSBmb3IgU3VtIFNjb3JlczoKT21lZ2FQIDo9ICgoMypMUCleMikgLyAoICgoMypMUCleMikgKyAzKkVQKQpPbWVnYU4gOj0gKCgzKkxOKV4yKSAvICggKCgzKkxOKV4yKSArIDMqRU4pCiIKCm1vZGVsMDRFc3RpbWF0ZXNTQiA9IHNlbShtb2RlbCA9IG1vZGVsMDRTeW50YXhTQiwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIsIHN0ZC5sdiA9IFRSVUUpCnN1bW1hcnkobW9kZWwwNEVzdGltYXRlc1NCLCBmaXQubWVhc3VyZXMgPSBUUlVFLCByc3F1YXJlID0gVFJVRSwgc3RhbmRhcmRpemVkID0gVFJVRSkKYGBgCgpUaGUgdmFsdWVzIHJlc3VsdGluZyBmcm9tIE9tZWdhIGFyZSB0aGUgU3BlYXJtYW4tQnJvd24gcmVsaWFiaWxpdHkgZXN0aW1hdGVzLiBOb3RlIHRoYXQgcmVsaWFiaWxpdHkgZm9yIHBhcmFsbGVsIGl0ZW1zIDwgcmVsaWFiaWxpdHkgZm9yIHRhdSBlcXVpdmFsZW50IGl0ZW1zIDwgcmVsaWFiaWxpdHkgZm9yIENGQSwgYnV0IHRoYXQgdGhlIGVzdGltYXRlcyBhcmUgdmVyeSBjbG9zZS4gVGhhdCBpcyBjb21tb24gd2hlbiBhIG1vZGVsIGZpdHMgdGhlIGRhdGEuCgojIyMgRXhhbWluaW5nIEZhY3RvciBTY29yZSBEaXN0cmlidXRpb25zCgpUaGUgcG9zaXRpdmUgZmFjdG9yIHNjb3JlcyBoYXZlIGFuIGVzdGltYXRlZCBtZWFuIG9mIDAgd2l0aCBhIHZhcmlhbmNlIG9mIDAuNzkgaW5zdGVhZCBvZiAxLjAwIChkdWUgdG8gdGhlIGVmZmVjdCBvZiB0aGUgcHJpb3IgZGlzdHJpYnV0aW9uIC0tIHRoaXMgaXMgY2FsbGVkICJzaHJpbmthZ2UiKS4gVGhlIFNFIGZvciBlYWNoIHBlcnNvbuKAmXMgZmFjdG9yIHNjb3JlIGlzIC40NzIuIFRyZWF0aW5nIGZhY3RvciBzY29yZXMgYXMgb2JzZXJ2ZWQgdmFyaWFibGVzIGlzIGxpa2Ugc2F5aW5nIFNFID0gMC4KCjk1JSBjb25maWRlbmNlIGludGVydmFsIGZvciBwb3NpdGl2ZSBmYWN0b3Igc2NvcmUgPSBTY29yZSDCsSAyKi40NzIgPSBTY29yZSDCsSAuOTQ0LgoKYGBge3IgcGxvdEYxLCBpbmNsdWRlPVRSVUV9CiMgY2FsY3VsYXRlIGZhY3RvciBzY29yZXMgdXNpbmcgZnVuY3Rpb24gYWJvdmU6CmZzY29yZXMgPSBmYWN0b3JTY29yZXMobGF2T2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcykKCgojc2hvdyB2YXJpYW5jZSBvZiBmYWN0b3Igc2NvcmU6CnZhcihmc2NvcmVzJHNjb3JlcyRTaXRQKQoKIyBIaXN0b2dyYW0gb3ZlcmxhaWQgd2l0aCBrZXJuZWwgZGVuc2l0eSBjdXJ2ZQpnZ3Bsb3QoZnNjb3JlcyRzY29yZXMsIGFlcyh4PVNpdFApKSArIAogICAgZ2VvbV9oaXN0b2dyYW0oYWVzKHk9Li5kZW5zaXR5Li4pLCAgICAgICMgSGlzdG9ncmFtIHdpdGggZGVuc2l0eSBpbnN0ZWFkIG9mIGNvdW50IG9uIHktYXhpcwogICAgICAgICAgICAgICAgICAgYmlud2lkdGg9LjUsCiAgICAgICAgICAgICAgICAgICBjb2xvdXI9ImJsYWNrIiwgZmlsbD0id2hpdGUiKSArIHhsaW0oYygtNCw0KSkgKyBsYWJzKHRpdGxlID0gIlBvc2l0aXZlIFNpdHVhdGlvbiBGb3JnaXZlbmVzcyBGYWN0b3IgU2NvcmUiKSArCiAgICBnZW9tX2RlbnNpdHkoYWxwaGE9LjIsIGZpbGw9IiNGRjY2NjYiKSAgICAjIE92ZXJsYXkgd2l0aCB0cmFuc3BhcmVudCBkZW5zaXR5IHBsb3QKYGBgCgoKVGhlIG5lZ2F0aXZlIGZhY3RvciBzY29yZXMgaGF2ZSBhbiBlc3RpbWF0ZWQgbWVhbiBvZiAwIHdpdGggYSB2YXJpYW5jZSBvZiAwLjgzOSBpbnN0ZWFkIG9mIDEuMDAuICBUaGUgU0UgZm9yIGVhY2ggcGVyc29u4oCZcyBmYWN0b3Igc2NvcmUgaXMgLjQxOCwgc28gdGhlIDgwJSBjb25maWRlbmNlIGludGVydmFsIGlzIFNjb3JlIMKxIC44MzYuCgpUaGUgbmVnYXRpdmUgZmFjdG9yIHNjb3JlcyByZXRhaW4gbW9yZSB2YXJpYW5jZSAoYW5kIGhhdmUgYSBzbWFsbGVyIFNFKSBiZWNhdXNlIHRoZXJlIGlzIG1vcmUgaW5mb3JtYXRpb24gaW4gdGhlbSwgZHVlIHRvIGhpZ2hlciBmYWN0b3IgbG9hZGluZ3MgKGdyZWF0ZXIgcmVsaWFiaWxpdHkpIG9mIHRoZWlyIGl0ZW1zLgoKYGBge3IgcGxvdEYyLCBpbmNsdWRlPVRSVUV9Cgojc2hvdyB2YXJpYW5jZSBvZiBmYWN0b3Igc2NvcmU6CnZhcihmc2NvcmVzJHNjb3JlcyRTaXROKQoKIyBIaXN0b2dyYW0gb3ZlcmxhaWQgd2l0aCBrZXJuZWwgZGVuc2l0eSBjdXJ2ZQpnZ3Bsb3QoZnNjb3JlcyRzY29yZXMsIGFlcyh4PVNpdE4pKSArIAogICAgZ2VvbV9oaXN0b2dyYW0oYWVzKHk9Li5kZW5zaXR5Li4pLCAgICAgICMgSGlzdG9ncmFtIHdpdGggZGVuc2l0eSBpbnN0ZWFkIG9mIGNvdW50IG9uIHktYXhpcwogICAgICAgICAgICAgICAgICAgYmlud2lkdGg9LjUsCiAgICAgICAgICAgICAgICAgICBjb2xvdXI9ImJsYWNrIiwgZmlsbD0id2hpdGUiKSArIHhsaW0oYygtNCw0KSkgKyBsYWJzKHRpdGxlID0gIk5lZ2F0aXZlIFNpdHVhdGlvbiBGb3JnaXZlbmVzcyBGYWN0b3IgU2NvcmUiKSArCiAgICBnZW9tX2RlbnNpdHkoYWxwaGE9LjIsIGZpbGw9IiNGRjY2NjYiKSAgICAjIE92ZXJsYXkgd2l0aCB0cmFuc3BhcmVudCBkZW5zaXR5IHBsb3QKYGBgCgojIyMjIEZhY3RvciBTY29yZXMgZnJvbSBQYXJhbGxlbCBJdGVtcyBNb2RlbCBhcmUgU3VtIFNjb3JlcyB3aXRoIGEgRGlmZmVyZW50IFNjYWxlCgpUaGUgcGFyYWxsZWwgaXRlbXMgbW9kZWwgY29uc3RyYWlucyB0aGUgaXRlbSBmYWN0b3IgbG9hZGluZ3MgdG8gYmUgZXF1YWwgYW5kIHVuaXF1ZSB2YXJpYW5jZXMgdG8gYmUgZXF1YWwgZm9yIGEgZ2l2ZW4gZmFjdG9yLiBXaGVuIGVzdGltYXRlZCBzZXBhcmF0ZWx5IChvciB3aGVuIHdoZW4gZXN0aW1hdGVkIHdpdGggYSBmYWN0b3IgY29ycmVsYXRpb24pLCB0aGUgY29ycmVsYXRpb24gb2YgZmFjdG9yIHNjb3JlcyBmcm9tIHRoZSBwYXJhbGxlbCBpdGVtcyBtb2RlbCBhbmQgdGhlIHN1bSBzY29yZXMgZnJvbSBDVFQgaXMgZXF1YWwgdG8gb25lLiBXaGF0IHRoaXMgbWVhbnMgaXMgdGhhdCB0byBiZSBhYmxlIHRvIHVzZSBzdW0gc2NvcmVzIGluIGFuIGFuYWx5c2lzLCB0aGUgcGFyYWxsZWwgaXRlbXMgbW9kZWwgbXVzdCBob2xkLiBUbyBkZW1vbnN0cmF0ZSwgdGhlIGBgYGxhdmFhbmBgYCBzeW50YXggYmVsb3cgc2V0cyB0aGUgZmFjdG9yIGNvdmFyaWFuY2UgdG8gemVybyAoYW5kIHRoZXJlZm9yZSB0aGUgY29ycmVsYXRpb24gYmV0d2VlbiBmYWN0b3JzIHRvIHplcm8pIGJ5IHVzaW5nIDBcKiBpbiB0aGUgc3RhdGVtZW50IGBgYFNpdFAgfn4gMCpTaXROYGBgOgoKYGBge3IgZmFjdG9yU3VtLCBpbmNsdWRlPVRSVUV9Cm1vZGVsMDRTeW50YXhTQnplcm9Db3IgPSAiCgojIFNpdFAgbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdFAgPX4gTFAqU2l0MiArIExQKlNpdDQgKyBMUCpTaXQ2CgojIFNpdE4gbG9hZGluZ3MgKGFsbCBlc3RpbWF0ZWQpClNpdE4gPX4gTE4qU2l0MXIgKyBMTipTaXQzciArIExOKlNpdDVyCgojIFVuaXF1ZSBWYXJpYW5jZXM6ClNpdDFyIH5+IEVOKlNpdDFyOyBTaXQyIH5+IEVQKlNpdDI7IFNpdDNyIH5+IEVOKlNpdDNyOyBTaXQ0IH5+IEVQKlNpdDQ7IFNpdDVyIH5+IEVOKlNpdDVyOyBTaXQ2IH5+IEVQKlNpdDY7IAoKU2l0UCB+fiAwKlNpdE4KCiMgQ2FsY3VsYXRlIE9tZWdhIFJlbGlhYmlsaXR5IGZvciBTdW0gU2NvcmVzOgpPbWVnYVAgOj0gKCgzKkxQKV4yKSAvICggKCgzKkxQKV4yKSArIDMqRVApCk9tZWdhTiA6PSAoKDMqTE4pXjIpIC8gKCAoKDMqTE4pXjIpICsgMypFTikKIgptb2RlbDA0U3ludGF4U0J6ZXJvQ29yRXN0aW1hdGVzID0gc2VtKG1vZGVsID0gbW9kZWwwNFN5bnRheFNCemVyb0NvciwgZGF0YSA9IGhmc1NpdHVhdGlvbnMsIGVzdGltYXRvciA9ICJNTFIiLCBtaW1pYyA9ICJtcGx1cyIsIHN0ZC5sdiA9IFRSVUUpCgpzdW1zY29yZXNQID0gYXBwbHkoWCA9IGhmc1NpdHVhdGlvbnNbYygiU2l0MiIsICJTaXQ0IiwgIlNpdDYiKV0sIE1BUkdJTiA9IDEsIEZVTiA9IHN1bSkKc3Vtc2NvcmVzTiA9IGFwcGx5KFggPSBoZnNTaXR1YXRpb25zW2MoIlNpdDFyIiwgIlNpdDNyIiwgIlNpdDVyIildLCBNQVJHSU4gPSAxLCBGVU4gPSBzdW0pCgpmc2NvcmVzUEkgPSBmYWN0b3JTY29yZXMobGF2T2JqZWN0ID0gbW9kZWwwNFN5bnRheFNCemVyb0NvckVzdGltYXRlcykKCnBhcihtZnJvdyA9IGMoMSwyKSkKcGxvdCh4ID0gZnNjb3JlcyRzY29yZXMkU2l0UCwgeSA9IHN1bXNjb3Jlc1AsIHhsYWIgPSAiU2l0UDogRnVsbCBDRkEgRmFjdG9yIFNjb3JlcyIsIHlsYWIgPSAiU2l0UDogU3VtIFNjb3JlIiwgeGxpbSA9IGMoLTMuNSwgMikpCnRleHQoeCA9IC0yLCB5ID0gMjAsIGxhYmVscyA9IHBhc3RlKCJyID0iLCBhcy5jaGFyYWN0ZXIocm91bmQoeCA9IGNvcihmc2NvcmVzJHNjb3JlcyRTaXRQLCBzdW1zY29yZXNQKSwgZGlnaXRzID0gMykpKSkKcGxvdCh4ID0gZnNjb3JlcyRzY29yZXMkU2l0TiwgeSA9IHN1bXNjb3Jlc04sIHhsYWIgPSAiU2l0TjogRnVsbCBDRkEgRmFjdG9yIFNjb3JlcyIsIHlsYWIgPSAiU2l0TjogU3VtIFNjb3JlIiwgeGxpbSA9IGMoLTMuNSwgMikpCnRleHQoeCA9IC0yLCB5ID0gMjAsIGxhYmVscyA9IHBhc3RlKCJyID0iLCBhcy5jaGFyYWN0ZXIocm91bmQoeCA9IGNvcihmc2NvcmVzJHNjb3JlcyRTaXROLCBzdW1zY29yZXNOKSwgZGlnaXRzID0gMykpKSkKCnBsb3QoeCA9IGZzY29yZXNQSSRzY29yZXMkU2l0UCwgeSA9IHN1bXNjb3Jlc1AsIHhsYWIgPSAiU2l0UDogRnVsbCBDRkEgRmFjdG9yIFNjb3JlcyIsIHlsYWIgPSAiU2l0UDogU3VtIFNjb3JlIiwgeGxpbT1jKC0zLjUsIDIpKQp0ZXh0KHggPSAtMiwgeSA9IDIwLCBsYWJlbHMgPSBwYXN0ZSgiciA9IiwgYXMuY2hhcmFjdGVyKHJvdW5kKHggPSBjb3IoZnNjb3Jlc1BJJHNjb3JlcyRTaXRQLCBzdW1zY29yZXNQKSwgZGlnaXRzID0gMykpKSkKCnBsb3QoeCA9IGZzY29yZXNQSSRzY29yZXMkU2l0TiwgeSA9IHN1bXNjb3Jlc04sIHhsYWIgPSAiU2l0TjogRnVsbCBDRkEgRmFjdG9yIFNjb3JlcyIsIHlsYWIgPSAiU2l0TjogU3VtIFNjb3JlIiwgeGxpbT1jKC0zLjUsIDIpKQp0ZXh0KHggPSAtMiwgeSA9IDIwLCBsYWJlbHMgPSBwYXN0ZSgiciA9IiwgYXMuY2hhcmFjdGVyKHJvdW5kKHggPSBjb3IoZnNjb3Jlc1BJJHNjb3JlcyRTaXROLCBzdW1zY29yZXNOKSwgZGlnaXRzID0gMykpKSkKcGFyKG1mcm93ID0gYygxLDEpKQpgYGAKCgojIyMgTW9kZWwtUHJlZGljdGVkIEl0ZW0gUmVzcG9uc2VzIGJ5IEZhY3RvciBTY29yZXMgd2l0aCBEYXNoZWQgTGluZXMgZm9yIEZsb29yIGFuZCBDZWlsaW5nIEVmZmVjdHM6CgpXZSBjYW4gYWxzbyBzZWUgaG93IHJlYXNvbmFibGUgb3VyIGNob2ljZSBvZiBhIGNvbnRpbnVvdXMgZGlzdHJpYnV0aW9uIHdhcyBmb3IgdGhlc2UgTGlrZXJ0IGRhdGEgYnkgcGxvdHRpbmcgdGhlIHByZWRpY3RlZCBpdGVtIHNjb3JlcyBmb3IgZWFjaCBpdGVtIGFjcm9zcyBhIHRoZSByYW5nZSBvZiBvYnNlcnZlZCBmYWN0b3Igc2NvcmVzLiBJZiBvdXIgbGluZXMgZmFsbCBvdXRzaWRlIHRoZSB0aGUgcmFuZ2Ugb2YgMSB0aHJvdWdoIDcgKHRoZSBib3VuZHMgb2YgdGhlIExpa2VydCBpdGVtcyksIHRoZW4gd2UgbWF5IGhhdmUgYW4gaXNzdWUgdXNpbmcgQ0ZBIChhIGNhdGVnb3JpY2FsIHZlcnNpb24gd291bGQgYmUgbW9yZSBhcHByb3ByaWF0ZSkuCgpgYGB7ciBpdGVtcGxvdCwgaW5jbHVkZT1UUlVFfQpsYXZPYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzCmNmYVBsb3RzID0gZnVuY3Rpb24obGF2T2JqZWN0KXsKICBvdXRwdXQgPSBpbnNwZWN0KG9iamVjdCA9IGxhdk9iamVjdCwgd2hhdCA9ICJlc3QiKQogIAogICNidWlsZCBtYXRyaXggcGxvdCBlbGVtZW50cwogIAogICNnZXQgZmFjdG9yIHNjb3JlcwogIGZzY29yZXMgPSBmYWN0b3JTY29yZXMobGF2T2JqZWN0ID0gbGF2T2JqZWN0KQogIAogIG5mYWN0b3JzID0gbmNvbChmc2NvcmVzJHNjb3JlcykvMgogIAogICNnZXQgbWF4IG9ic2VydmVkIGRhdGEKICBpdGVtTWF4ID0gbWF4KGFwcGx5KFggPSBsYXZPYmplY3RARGF0YUBYW1sxXV0sIE1BUkdJTiA9IDIsIEZVTiA9IG1heCkpCiAgaXRlbU1pbiA9IG1pbihhcHBseShYID0gbGF2T2JqZWN0QERhdGFAWFtbMV1dLCBNQVJHSU4gPSAyLCBGVU4gPSBtaW4pKQogICAgCiAgI2dldCByYW5nZSBmb3IgYWxsIHNjb3JlcwogIGZhY3Rvck1heCA9IG1heChhcHBseShYID0gZnNjb3JlcyRzY29yZXNbc2VxKDEsIG5jb2woZnNjb3JlcyRzY29yZXMpLCAyKV0sIE1BUkdJTiA9IDIsIEZVTiA9IG1heCkpCiAgZmFjdG9yTWluID0gbWluKGFwcGx5KFggPSBmc2NvcmVzJHNjb3Jlc1tzZXEoMSwgbmNvbChmc2NvcmVzJHNjb3JlcyksIDIpXSwgTUFSR0lOID0gMiwgRlVOID0gbWluKSkKICAKICAjc2V0IHVwIHggdmFsdWVzCiAgeCA9IHNlcShmYWN0b3JNaW4sIGZhY3Rvck1heCwgLjAxKQogIAogIHBhcihtZnJvdyA9IGMoMSwgbmZhY3RvcnMpKQogICNtYWtlIHBsb3RzIGJ5IGZhY3RvcgogIGZhY3Rvcj0xCiAgZm9yIChmYWN0b3IgaW4gMTpuZmFjdG9ycyl7CiAgICB4bWF0ID0gTlVMTAogICAgeW1hdCA9IE5VTEwKICAgIGluYW1lcyA9IE5VTEwKICAgIGZvciAoaXRlbSBpbiAxOm5yb3cob3V0cHV0JGxhbWJkYSkpewogICAgICBpZiAob3V0cHV0JGxhbWJkYVtpdGVtLCBmYWN0b3JdICE9IDApewogICAgICAgIGluYW1lcyA9IGMoaW5hbWVzLCByb3duYW1lcyhvdXRwdXQkbGFtYmRhKVtpdGVtXSkKICAgICAgICB5ID0gb3V0cHV0JG51W2l0ZW1dICsgb3V0cHV0JGxhbWJkYVtpdGVtLCBmYWN0b3JdKngKICAgICAgICB4bWF0ID0gY2JpbmQoeG1hdCwgeCkKICAgICAgICB5bWF0ID0gY2JpbmQoeW1hdCwgeSkKICAgICAgfQogICAgICAKICAgIH0KICAgIG1hdHBsb3QoeCA9IHhtYXQsIHkgPSB5bWF0LCB0eXBlID0gImwiLCBsd2QgPSA1LCBsdHk9MjoobmNvbCh4bWF0KSsxKSwgeWxpbSA9IGMoaXRlbU1pbi0xLCBpdGVtTWF4KzEpLCB4bGltID0gYyhmYWN0b3JNaW4sIGZhY3Rvck1heCksICAKICAgICAgICAgICAgeWxhYiA9ICJQcmVkaWN0ZWQgSXRlbSBSZXNwb25zZSIsIHhsYWIgPSBjb2xuYW1lcyhvdXRwdXQkbGFtYmRhKVtmYWN0b3JdLCBjb2wgPSAyOihuY29sKHhtYXQpKzEpKSAKICAgIGxpbmVzKHggPSBjKGZhY3Rvck1pbixmYWN0b3JNYXgpLCB5ID0gYyhpdGVtTWluLCBpdGVtTWluKSwgbHR5ID0gMywgbHdkID0gNSkKICAgIGxpbmVzKHggPSBjKGZhY3Rvck1pbixmYWN0b3JNYXgpLCB5ID0gYyhpdGVtTWF4LCBpdGVtTWF4KSwgbHR5ID0gMywgbHdkID0gNSkKICAgIGxlZ2VuZCh4ID0gLTMsIHkgPSA3LCBsZWdlbmQgPSBpbmFtZXMsIGx0eSA9IDI6KG5jb2woeG1hdCkrMSksIGx3ZCA9IDUsIGNvbCA9IDI6KG5jb2woeG1hdCkrMSkpCiAgfQogIHBhcihtZnJvdyA9IGMoMSwxKSkKfQpwYXIobWZyb3cgPSBjKDEsMikpCmNmYVBsb3RzKGxhdk9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMpCgpgYGAKCiMjIyBDb21wYXJpbmcgU3VtIFNjb3JlcyB3aXRoIEZhY3RvciBTY29yZXMKCldoYXQgaWYgd2UgaGFkIGp1c3QgdGFrZW4gdGhlIHN1bSAob3IsIGhlcmUsIHRoZSBtZWFuKSBvZiB0aGUgdGhyZWUgaXRlbXMgZm9yIGVhY2ggc3Vic2NhbGU/CgpgYGB7ciBwbG90U2NvcmVzMiwgaW5jbHVkZT1UUlVFfQpQb3NNZWFuID0gYXBwbHkoWCA9IGhmc1NpdHVhdGlvbnNbYygiU2l0MiIsICJTaXQ0IiwgIlNpdDYiKV0sIE1BUkdJTiA9IDEsIEZVTiA9IG1lYW4pCk5lZ01lYW4gPSBhcHBseShYID0gaGZzU2l0dWF0aW9uc1tjKCJTaXQxciIsICJTaXQzciIsICJTaXQ1ciIpXSwgTUFSR0lOID0gMSwgRlVOID0gbWVhbikKCnBhcihtZnJvdyA9IGMoMSwyKSkKcGxvdCh5ID0gUG9zTWVhbiwgeCA9IGZzY29yZXMkc2NvcmVzJFNpdFAsIHhsaW0gPSBjKC0zLjUsMiksIHlsaW0gPSBjKDEsNyksIHhsYWIgPSAiU2l0UCBGYWN0b3IgU2NvcmUiLCB5bGFiID0gIlBvc3RpdmUgSXRlbXMgTWVhbiIpCnRleHQoeCA9IC0zLCB5ID0gNiwgbGFiZWxzID0gcGFzdGUoInIgPSAiLCBhcy5jaGFyYWN0ZXIocm91bmQoY29yKFBvc01lYW4sIGZzY29yZXMkc2NvcmVzJFNpdFApLCBkaWdpdHMgPSAzKSkpKQpwbG90KHkgPSBOZWdNZWFuLCB4ID0gZnNjb3JlcyRzY29yZXMkU2l0TiwgeGxpbSA9IGMoLTMuNSwyKSwgeWxpbSA9IGMoMSw3KSwgeGxhYiA9ICJTaXROIEZhY3RvciBTY29yZSIsIHlsYWIgPSAiTmVnYXRpdmUgSXRlbXMgTWVhbiIpCnRleHQoeCA9IC0zLCB5ID0gNiwgbGFiZWxzID0gcGFzdGUoInIgPSAiLCBhcy5jaGFyYWN0ZXIocm91bmQoY29yKE5lZ01lYW4sIGZzY29yZXMkc2NvcmVzJFNpdE4pLCBkaWdpdHMgPSAzKSkpKQpwYXIobWZyb3cgPSBjKDEsMSkpCmBgYAoKV2UgY2FuIGFsc28gcGxvdCBob3cgdGhlIHR3byB0eXBlcyBvZiBzY29yZXMgbG9vayB0b2dldGhlcjoKCmBgYHtyIHBsb3RzY29yZXMzLCBpbmNsdWRlPVRSVUV9CnBhcihtZnJvdyA9IGMoMSwyKSkKcGxvdCh4ID0gUG9zTWVhbiwgeSA9IE5lZ01lYW4sIHhsaW0gPSBjKDEsOCksIHlsaW0gPSBjKDEsOCksIHhsYWIgID0gIlBvc3RpdmUgSXRlbXMgTWVhbiIsIHlsYWIgPSAiTmVnYXRpdmUgSXRlbXMgTWVhbiIpCnRleHQoeCA9IDEuODUsIHkgPSA4LCBsYWJlbHMgPSBwYXN0ZSgiciA9ICIsIGFzLmNoYXJhY3Rlcihyb3VuZChjb3IoUG9zTWVhbiwgTmVnTWVhbiksIGRpZ2l0cyA9IDMpKSkpCgpwbG90KHggPSBmc2NvcmVzJHNjb3JlcyRTaXRQLCB5ID0gZnNjb3JlcyRzY29yZXMkU2l0TiwgeGxpbSA9IGMoLTMuNSwyKSwgeWxpbSA9IGMoLTMuNSwyKSwgeGxhYiAgPSAiU2l0UCBGYWN0b3IgU2NvcmUiLCB5bGFiID0gIlNpdE4gRmFjdG9yIFNjb3JlIikKdGV4dCh4ID0gLTIuNSwgeSA9IDEuOSwgbGFiZWxzID0gcGFzdGUoInIgPSAiLCBhcy5jaGFyYWN0ZXIocm91bmQoY29yKGZzY29yZXMkc2NvcmVzJFNpdFAsIGZzY29yZXMkc2NvcmVzJFNpdE4pLCBkaWdpdHMgPSAzKSkpKQpwYXIobWZyb3cgPSBjKDEsMSkpCgpgYGAKClRoZXJlIGFyZSBwcm9ibGVtcyB3aXRoIGVpdGhlciBvZiB0aGVzZSBvYnNlcnZlZCB2YXJpYWJsZSBhcHByb2FjaGVzOiBUaGUgbWVhbiBvZiB0aGUgaXRlbXMgYXBwZWFycyB0byBoYXZlIGxlc3MgdmFyaWFiaWxpdHkgKGkuZS4sIGZld2VyIHBvc3NpYmxlIHNjb3JlcykgYW5kIGFzc3VtZXMgdGhhdCBhbGwgaXRlbXMgc2hvdWxkIGJlIHdlaWdodGVkIGVxdWFsbHkgYW5kIGhhdmUgbm8gZXJyb3IuIFRoZSBlc3RpbWF0ZWQgZmFjdG9yIHNjb3JlcyBkbyBub3QgaGF2ZSB0aGUgc2FtZSBwcm9wZXJ0aWVzIGFzIGVzdGltYXRlZCBmb3IgdGhlIGZhY3RvciBpbiB0aGUgbW9kZWwgKGkuZS4sIGxlc3MgdmFyaWFuY2UgZm9yIGVhY2ggZmFjdG9yLCBoaWdoZXIgY29ycmVsYXRpb24gYW1vbmcgdGhlIGZhY3RvcnMpLiBGdXJ0aGVyLCB0aGUgb3JkZXIgb2Ygc3ViamVjdHMgYnkgc2NvcmVzIGRpZmZlcnMgaW4gYm90aCBhcHByb2FjaGVzLCB3aGljaCBpcyBwcm9ibGVtYXRpYyBmb3Igb3RoZXIgYW5hbHlzZXMuIAoKV2hhdCB0byBkbyBpbnN0ZWFkIG9mIGVpdGhlciBvZiB0aGVzZT8gU3RheSB0dW5lZCBmb3IgaG93IHRvIHVzZSBwbGF1c2libGUgdmFsdWVzLCBCYXllc2lhbiBtZXRob2RzLCBvciBTRU0uCgojIyMgRXhhbXBsZSBXcml0ZS1VcCBEZXNjcmliaW5nIFRoZXNlIEFuYWx5c2VzCgpSIGNvZGUgdG8gYnVpbGQgb2JqZWN0cyByZXBvcnRlZCBpbiByZXN1bHRzIChkb24ndCBzaG93IHRoaXMgdHlwaWNhbGx5KQpgYGB7ciBwcmVyZXN1bHRzLCBpbmNsdWRlPVRSVUV9CgojbnVtYmVyIG9mIG9ic2VydmF0aW9ucwpmb3JtYXQoeCA9IG1vZGVsMDRFc3RpbWF0ZXNARGF0YUBub2JzW1sxXV1bMV0sIGJpZy5tYXJrID0gIiwiKQoKI2xvdyBhbmQgaGlnaCBzdGFuZGFyZGl6ZWQgbG9hZGluZ3MgZm9yIG9uZSBmYWN0b3IgbW9kZWwKc3RkTG9hZGluZ3MgPSBpbnNwZWN0KG9iamVjdCA9IG1vZGVsMDFFc3RpbWF0ZXMsIHdoYXQgPSAic3RkLmFsbCIpCgpzdGRMb2FkaW5nc0xvdyA9IHJvdW5kKG1pbihhcHBseShYID0gc3RkTG9hZGluZ3MkbGFtYmRhLCBNQVJHSU4gPSAyLCBGVU4gPSBmdW5jdGlvbih4KSBtaW4oeFt3aGljaCh4ICE9MCldKSkpLCBkaWdpdHMgPSAzKQpzdGRMb2FkaW5nc0hpZ2ggPSByb3VuZChtYXgoYXBwbHkoWCA9IHN0ZExvYWRpbmdzJGxhbWJkYSwgTUFSR0lOID0gMiwgRlVOID0gZnVuY3Rpb24oeCkgbWF4KHhbd2hpY2goeCAhPTApXSkpKSwgZGlnaXRzID0gMykKCiMgZXN0aW1hdGVkIGNvcnJlbGF0aW9uIGJldHdlZW4gZmFjdG9ycyBpbiB0d28tZmFjdG9yIG1vZGVsCnN0ZENvdjA0ID0gaW5zcGVjdChvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCB3aGF0ID0gInN0ZC5hbGwiKSRwc2kKZXN0Q29yciA9IGZvcm1hdCh4ID0gc3RkQ292MDRbMiwxXSwgZGlnaXRzID0gMykKCiNzdGFuZGFyZGl6ZWQgbG9hZGluZ3MgcG9zaXRpdmUKc3RkTG9hZGluZ3MwNFAgPSBpbnNwZWN0KG9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMsIHdoYXQgPSAic3RkLmFsbCIpJGxhbWJkYVssMV0KbWluU2l0UCA9IHJvdW5kKG1pbihzdGRMb2FkaW5nczA0UFt3aGljaChzdGRMb2FkaW5nczA0UCAhPSAwKV0pLCBkaWdpdHMgPSAzKQptYXhTaXRQID0gcm91bmQobWF4KHN0ZExvYWRpbmdzMDRQW3doaWNoKHN0ZExvYWRpbmdzMDRQICE9IDApXSksIGRpZ2l0cyA9IDMpCgojc3RhbmRhcmRpemVkIGxvYWRpbmdzIG5lZ2F0aXZlCnN0ZExvYWRpbmdzMDROID0gaW5zcGVjdChvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCB3aGF0ID0gInN0ZC5hbGwiKSRsYW1iZGFbLDJdCm1pblNpdE4gPSByb3VuZChtaW4oc3RkTG9hZGluZ3MwNE5bd2hpY2goc3RkTG9hZGluZ3MwNE4gIT0gMCldKSwgZGlnaXRzID0gMykKbWF4U2l0TiA9IHJvdW5kKG1heChzdGRMb2FkaW5nczA0Tlt3aGljaChzdGRMb2FkaW5nczA0TiAhPSAwKV0pLCBkaWdpdHMgPSAzKQoKZmFjdG9yUmVsID0gZmFjdG9yU2NvcmVSZWxpYWJpbGl0eShsYXZPYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzKQpgYGAKCihOb3RlOiBZb3UgbWF5IGJvcnJvdyB0aGUgcGhyYXNpbmcgY29udGFpbmVkIGluIHRoaXMgZXhhbXBsZSB0byBkZXNjcmliZSB2YXJpb3VzIGFzcGVjdHMgb2YgeW91ciBhbmFseXNlcywgYnV0IHlvdXIgb3duIHJlc3VsdHMgc2VjdGlvbnMgd2lsbCBub3QgbWltaWMgdGhpcyBleGFtcGxlIGV4YWN0bHnigJR0aGV5IHNob3VsZCBiZSBjdXN0b21pemVkIHRvIGRlc2NyaWJlIHRoZSBob3cgYW5kIHRoZSB3aHkgb2Ygd2hhdCB5b3UgZGlkLCBzcGVjaWZpY2FsbHkpLgoKKERlc2NyaXB0aXZlIGluZm9ybWF0aW9uIGZvciB0aGUgc2FtcGxlIGFuZCBpdGVtcyB3b3VsZCBoYXZlIGFscmVhZHkgYmVlbiBnaXZlbiBpbiB0aGUgbWV0aG9kIHNlY3Rpb27igKYpCgpUaGUgcmVsaWFiaWxpdHkgYW5kIGRpbWVuc2lvbmFsaXR5IG9mIHNpeCBpdGVtcyBlYWNoIGFzc2Vzc2luZyBmb3JnaXZlbmVzcyBvZiBzaXR1YXRpb25zIHdhcyBhc3Nlc3NlZCBpbiBhIHNhbXBsZSBvZiBgciBmb3JtYXQoeCA9IG1vZGVsMDRFc3RpbWF0ZXNARGF0YUBub2JzW1sxXV1bMV0sIGJpZy5tYXJrID0gIiwiKWAgcGVyc29ucyB3aXRoIGEgY29uZmlybWF0b3J5IGZhY3RvciBhbmFseXNpcyB1c2luZyByb2J1c3QgbWF4aW11bSBsaWtlbGlob29kIGVzdGltYXRpb24gKE1MUikgaW4gdGhlIF9sYXZhYW5fIHBhY2thZ2UgKFJvc3NlZWwsIDIwMTIpIGluIFIgKFIgQ29yZSBUZWFtLCAyMDE3KS4gQWxsIG1vZGVscyB3ZXJlIGlkZW50aWZpZWQgYnkgc2V0dGluZyBhbnkgbGF0ZW50IGZhY3RvciBtZWFucyB0byAwIGFuZCBsYXRlbnQgZmFjdG9yIHZhcmlhbmNlcyB0byAxLCBzdWNoIHRoYXQgYWxsIGl0ZW0gaW50ZXJjZXB0cywgaXRlbSBmYWN0b3IgbG9hZGluZ3MsIGFuZCBpdGVtIHJlc2lkdWFsIHZhcmlhbmNlcyB3ZXJlIHRoZW4gZXN0aW1hdGVkLiBUaGUgc2l4IGl0ZW1zIHV0aWxpemVkIGEgc2V2ZW4tcG9pbnQgcmVzcG9uc2Ugc2NhbGUsIGFuZCB0aHJlZSBpdGVtcyB3ZXJlIHJldmVyc2UtY29kZWQgcHJpb3IgdG8gYW5hbHlzaXMgc3VjaCB0aGF0IGhpZ2hlciB2YWx1ZXMgdGhlbiBpbmRpY2F0ZWQgZ3JlYXRlciBsZXZlbHMgb2YgZm9yZ2l2ZW5lc3Mgb2Ygc2l0dWF0aW9ucyBmb3IgYWxsIGl0ZW1zLiBNb2RlbCBmaXQgc3RhdGlzdGljcyByZXBvcnRlZCBpbiBUYWJsZSAxIGluY2x1ZGUgdGhlIG9idGFpbmVkIG1vZGVsICRcY2hpXjIkLCBpdHMgc2NhbGluZyBmYWN0b3IgKGluIHdoaWNoIHZhbHVlcyBkaWZmZXJlbnQgdGhhbiAxLjAwMCBpbmRpY2F0ZSBkZXZpYXRpb25zIGZyb20gbm9ybWFsaXR5KSwgaXRzIGRlZ3JlZXMgb2YgZnJlZWRvbSwgYW5kIGl0cyBwLXZhbHVlIChpbiB3aGljaCBub24tc2lnbmlmaWNhbmNlIGlzIGRlc2lyYWJsZSBmb3IgZ29vZCBmaXQpLCBDRkksIG9yIENvbXBhcmF0aXZlIEZpdCBJbmRleCAoaW4gd2hpY2ggdmFsdWVzIGhpZ2hlciB0aGFuIC45NSBhcmUgZGVzaXJhYmxlIGZvciBnb29kIGZpdCksIGFuZCB0aGUgUk1TRUEsIG9yIFJvb3QgTWVhbiBTcXVhcmUgRXJyb3Igb2YgQXBwcm94aW1hdGlvbiwgcG9pbnQgZXN0aW1hdGUgYW5kIDkwJSBjb25maWRlbmNlIGludGVydmFsIChpbiB3aGljaCB2YWx1ZXMgbG93ZXIgdGhhbiAuMDYgYXJlIGRlc2lyYWJsZSBmb3IgZ29vZCBmaXQpLiBBcyByZXBvcnRlZCBpbiBUYWJsZSAyLCBuZXN0ZWQgbW9kZWwgY29tcGFyaXNvbnMgd2VyZSBjb25kdWN0ZWQgdXNpbmcgdGhlIHJlc2NhbGVkICTiiJIyXERlbHRhIExMJCB3aXRoIGRlZ3JlZXMgb2YgZnJlZWRvbSBlcXVhbCB0byB0aGUgcmVzY2FsZWQgZGlmZmVyZW5jZSBpbiB0aGUgbnVtYmVyIG9mIHBhcmFtZXRlcnMgYmV0d2VlbiBtb2RlbHMgKGkuZS4sIGEgcmVzY2FsZWQgbGlrZWxpaG9vZCByYXRpbyB0ZXN0KS4gVGhlIHNwZWNpZmljIG1vZGVscyBleGFtaW5lZCBhcmUgZGVzY3JpYmVkIGluIGRldGFpbCBiZWxvdy4KCkFsdGhvdWdoIGEgb25lLWZhY3RvciBtb2RlbCB3YXMgaW5pdGlhbGx5IHBvc2l0ZWQgdG8gYWNjb3VudCBmb3IgdGhlIHBhdHRlcm4gb2YgY292YXJpYW5jZSBhY3Jvc3MgdGhlc2Ugc2l4IGl0ZW1zLCBpdCByZXN1bHRlZCBpbiBwb29yIGZpdCwgYXMgc2hvd24gaW4gVGFibGUgMS4gQWx0aG91Z2ggZWFjaCBpdGVtIGhhZCBhIHNpZ25pZmljYW50IGZhY3RvciBsb2FkaW5nICh3aXRoIHN0YW5kYXJkaXplZCBsb2FkaW5ncyByYW5naW5nIGZyb20gYHIgc3RkTG9hZGluZ3NMb3dgIHRvIGByIHN0ZExvYWRpbmdzSGlnaGApLCBhIHNpbmdsZSBsYXRlbnQgZmFjdG9yIGRpZCBub3QgYWRlcXVhdGVseSBkZXNjcmliZSB0aGUgcGF0dGVybiBvZiByZWxhdGlvbnNoaXAgYWNyb3NzIHRoZXNlIHNpeCBpdGVtcyBhcyBpbml0aWFsbHkgaHlwb3RoZXNpemVkLiBTb3VyY2VzIG9mIGxvY2FsIG1pc2ZpdCB3ZXJlIGlkZW50aWZpZWQgdXNpbmcgdGhlIG5vcm1hbGl6ZWQgcmVzaWR1YWwgY292YXJpYW5jZSBtYXRyaXgsIGF2YWlsYWJsZSB2aWEgdGhlICpyZXNpZCgpKiBmdW5jdGlvbiBpbiAqbGF2YWFuKiwgaW4gd2hpY2ggaW5kaXZpZHVhbCB2YWx1ZXMgd2VyZSBjYWxjdWxhdGVkIGFzOiAob2JzZXJ2ZWQgY292YXJpYW5jZSDigJMgZXhwZWN0ZWQgY292YXJpYW5jZSkgLyBTRChvYnNlcnZlZCBjb3ZhcmlhbmNlKS4gUmVsYXRpdmVseSBsYXJnZSBwb3NpdGl2ZSByZXNpZHVhbCBjb3ZhcmlhbmNlcyB3ZXJlIG9ic2VydmVkIGFtb25nIGl0ZW1zIDIsIDQsIGFuZCA2ICh0aGUgcG9zaXRpdmVseS13b3JkZWQgaXRlbXMpLCBpbmRpY2F0aW5nIHRoYXQgdGhlc2UgaXRlbXMgd2VyZSBtb3JlIHJlbGF0ZWQgdGhhbiB3YXMgcHJlZGljdGVkIGJ5IHRoZSBzaW5nbGUtZmFjdG9yIG1vZGVsLiBNb2RpZmljYXRpb24gaW5kaWNlcywgYXZhaWxhYmxlIHZpYSB0aGUgKm1vZGlmaWNhdGlvbmluZGljZXMoKSogZnVuY3Rpb24gaW4gKmxhdmFhbiosIGNvcnJvYm9yYXRlZCB0aGlzIHBhdHRlcm4sIGZ1cnRoZXIgc3VnZ2VzdGluZyBhZGRpdGlvbmFsIHJlbWFpbmluZyByZWxhdGlvbnNoaXBzIGFtb25nIHRoZSBuZWdhdGl2ZWx5LXdvcmRlZCBpdGVtcyBhcyB3ZWxsLiAKClRoZSBuZWNlc3NpdHkgb2Ygc2VwYXJhdGUgbGF0ZW50IGZhY3RvcnMgZm9yIHRoZSBwb3NpdGl2ZWx5LXdvcmRlZCBhbmQgbmVnYXRpdmVseS13b3JkZWQgaXRlbXMgd2FzIHRlc3RlZCBieSBzcGVjaWZ5aW5nIGEgdHdvLWZhY3RvciBtb2RlbCBpbiB3aGljaCB0aGUgcG9zaXRpdmVseS13b3JkZWQgaXRlbXMgMiwgNCwgYW5kIDYgaW5kaWNhdGVkIGEgZm9yZ2l2ZW5lc3MgZmFjdG9yLCBhbmQgaW4gd2hpY2ggbmVnYXRpdmVseS13b3JkZWQgaXRlbXMgMSwgMywgYW5kIDUgaW5kaWNhdGVkIGEgbm90IHVuZm9yZ2l2ZW5lc3MgZmFjdG9yLCBhbmQgaW4gd2hpY2ggdGhlIHR3byBmYWN0b3JzIHdlcmUgYWxsb3dlZCB0byBjb3JyZWxhdGUuIFRoZSB0d28tZmFjdG9yIG1vZGVsIGZpdCB3YXMgYWNjZXB0YWJsZSBieSBldmVyeSBjcml0ZXJpb24gZXhjZXB0IHRoZSBzaWduaWZpY2FudCAkXGNoaV4yJCwgbGlrZWx5IGR1ZSB0byB0aGUgbGFyZ2Ugc2FtcGxlLiBJbiBhZGRpdGlvbiwgdGhlIHR3by1mYWN0b3IgbW9kZWwgZml0IHNpZ25pZmljYW50bHkgYmV0dGVyIHRoYW4gdGhlIG9uZS1mYWN0b3IgbW9kZWwsIGFzIHJlcG9ydGVkIGluIFRhYmxlIDIsIGluZGljYXRpbmcgdGhhdCB0aGUgZXN0aW1hdGVkIGNvcnJlbGF0aW9uIGJldHdlZW4gdGhlIHR3byBmYWN0b3JzIG9mIGByIGVzdENvcnJgIHdhcyBzaWduaWZpY2FudGx5IGxlc3MgdGhhbiAxLjAwMC4gVGh1cywgdGhlIHNpeCBpdGVtcyBhcHBlYXJlZCB0byBtZWFzdXJlIHR3byBzZXBhcmF0ZSBidXQgcmVsYXRlZCBjb25zdHJ1Y3RzLiBGdXJ0aGVyIGV4YW1pbmF0aW9uIG9mIGxvY2FsIGZpdCB2aWEgbm9ybWFsaXplZCByZXNpZHVhbCBjb3ZhcmlhbmNlcyBhbmQgbW9kaWZpY2F0aW9uIGluZGljZXMgeWllbGRlZCBubyBpbnRlcnByZXRhYmxlIHJlbWFpbmluZyByZWxhdGlvbnNoaXBzLCBhbmQgdGh1cyB0aGlzIHR3by1mYWN0b3IgbW9kZWwgd2FzIHJldGFpbmVkLiAKClRhYmxlIDMgcHJvdmlkZXMgdGhlIGVzdGltYXRlcyBhbmQgdGhlaXIgc3RhbmRhcmQgZXJyb3JzIGZvciB0aGUgaXRlbSBmYWN0b3IgbG9hZGluZ3MsIGludGVyY2VwdHMsIGFuZCByZXNpZHVhbCB2YXJpYW5jZXMgZnJvbSBib3RoIHRoZSB1bnN0YW5kYXJkaXplZCBhbmQgc3RhbmRhcmRpemVkIHNvbHV0aW9ucy4gQWxsIGZhY3RvciBsb2FkaW5ncyBhbmQgdGhlIGZhY3RvciBjb3ZhcmlhbmNlIHdlcmUgc3RhdGlzdGljYWxseSBzaWduaWZpY2FudC4gQXMgc2hvd24gaW4gVGFibGUgMywgc3RhbmRhcmRpemVkIGxvYWRpbmdzIGZvciB0aGUgZm9yZ2l2ZW5lc3MgZmFjdG9yIGl0ZW1zIHJhbmdlZCBmcm9tIGByIG1pblNpdFBgIHRvIGByIG1heFNpdFBgICh3aXRoICRSXjIkIHZhbHVlcyBmb3IgdGhlIGFtb3VudCBvZiBpdGVtIHZhcmlhbmNlIGFjY291bnRlZCBmb3IgYnkgdGhlIGZhY3RvciByYW5naW5nIGZyb20gYHIgcm91bmQobWluU2l0UF4yLCBkaWdpdHM9MylgIHRvIGByIHJvdW5kKG1heFNpdFAsIGRpZ2l0cz0zKWApLCBhbmQgc3RhbmRhcmRpemVkIGxvYWRpbmdzIGZvciB0aGUgbm90IHVuZm9yZ2l2ZW5lc3MgZmFjdG9yIHJhbmdlZCBmcm9tIGByIG1pblNpdE5gIHRvIGByIG1heFNpdE5gICh3aXRoIFIyIHZhbHVlcyBvZiBgciByb3VuZChtaW5TaXROXjIsIGRpZ2l0cz0zKWAgdG8gYHIgcm91bmQobWF4U2l0Tl4yLCBkaWdpdHM9MylgKSwgc3VnZ2VzdGluZyB0aGUgZmFjdG9yIGxvYWRpbmdzIHdlcmUgcHJhY3RpY2FsbHkgc2lnbmlmaWNhbnQgYXMgd2VsbC4gRmFjdG9yIHNjb3JlIHJlbGlhYmlsaXR5IHdhcyBgciByb3VuZChmYWN0b3JSZWxbMV0pYCBmb3IgdGhlIGZvcmdpdmVuZXNzIGZhY3RvciBhbmQgYHIgcm91bmQoZmFjdG9yUmVsWzJdKWAgZm9yIHRoZSBub3QgdW5mb3JnaXZlbmVzcyBmYWN0b3IsIHN1Z2dlc3RpbmcgbWFyZ2luYWwgcmVsaWFiaWxpdHkgZm9yIGJvdGggb2YgdGhlIHRocmVlLWl0ZW0gc2NhbGVzLiAKClRoZSByZXN1bHRpbmcgZGlzdHJpYnV0aW9uIG9mIHRoZSBFQVAgZXN0aW1hdGVzIG9mIGZhY3RvciBzY29yZSBhcyBzaG93biBpbiBGaWd1cmUgMS4gRmlndXJlIDIgc2hvd3MgdGhlIHByZWRpY3RlZCByZXNwb25zZSBmb3IgZWFjaCBpdGVtIGFzIGEgbGluZWFyIGZ1bmN0aW9uIG9mIHRoZSBsYXRlbnQgZmFjdG9yIGJhc2VkIG9uIHRoZSBlc3RpbWF0ZWQgbW9kZWwgcGFyYW1ldGVycy4gQXMgc2hvd24sIHRoZSBwcmVkaWN0ZWQgaXRlbSByZXNwb25zZSBnb2VzIGFib3ZlIHRoZSBoaWdoZXN0IHJlc3BvbnNlIG9wdGlvbiBqdXN0IGJlZm9yZSBhIGxhdGVudCBmYWN0b3Igc2NvcmUgb2YgMiAoaS5lLiwgMiBTRHMgYWJvdmUgdGhlIG1lYW4pLCByZXN1bHRpbmcgaW4gYSBjZWlsaW5nIGVmZmVjdCBmb3IgYm90aCBzZXRzIG9mIGZhY3RvciBzY29yZXMsIGFzIGFsc28gc2hvd24gaW4gRmlndXJlIDEuIEluIGFkZGl0aW9uLCBmb3IgdGhlIG5vdCB1bmZvcmdpdmVuZXNzIGZhY3RvciwgdGhlIHByZWRpY3RlZCBpdGVtIHJlc3BvbnNlIGdvZXMgYmVsb3cgdGhlIGxvd2VzdCByZXNwb25zZSBvcHRpb24ganVzdCBiZWZvcmUgYSBsYXRlbnQgZmFjdG9yIHNjb3JlIG9mIC0zIChpLmUuLCAzIFNEcyBiZWxvdyB0aGUgbWVhbiksIHJlc3VsdGluZyBpbiBhIGZsb29yIGVmZmVjdCBmb3IgdGhlIG5vdCB1bmZvcmdpdmVuZXNzIGZhY3RvciwgYXMgYWxzbyBzaG93biBpbiBGaWd1cmUgMS4KClRoZSBleHRlbnQgdG8gd2hpY2ggdGhlIGl0ZW1zIHdpdGhpbiBlYWNoIGZhY3RvciBjb3VsZCBiZSBzZWVuIGFzIGV4Y2hhbmdlYWJsZSB3YXMgdGhlbiBleGFtaW5lZCB2aWEgYW4gYWRkaXRpb25hbCBzZXQgb2YgbmVzdGVkIG1vZGVsIGNvbXBhcmlzb25zLCBhcyByZXBvcnRlZCBpbiBUYWJsZSAxIChmb3IgZml0KSBhbmQgVGFibGUgMiAoZm9yIGNvbXBhcmlzb25zIG9mIGZpdCkuIEZpcnN0LCB0aGUgYXNzdW1wdGlvbiBvZiB0YXUtZXF1aXZhbGVuY2UgKGkuZS4sIHRydWUtc2NvcmUgZXF1aXZhbGVuY2UsIGVxdWFsIGRpc2NyaW1pbmF0aW9uIGFjcm9zcyBpdGVtcykgd2FzIGV4YW1pbmVkIGJ5IGNvbnN0cmFpbmluZyB0aGUgZmFjdG9yIGxvYWRpbmdzIHRvIGJlIGVxdWFsIHdpdGhpbiBhIGZhY3Rvci4gRm9yIHRoZSBub3QgdW5mb3JnaXZlbmVzcyBmYWN0b3IsIHRoZSB0YXUtZXF1aXZhbGVudCBtb2RlbCBmaXQgd2FzIGFjY2VwdGFibGUgYnV0IHdhcyBzaWduaWZpY2FudGx5IHdvcnNlIHRoYW4gdGhlIG9yaWdpbmFsIHR3by1mYWN0b3IgbW9kZWwgZml0IChpLmUuLCBpbiB3aGljaCBhbGwgbG9hZGluZ3Mgd2VyZSBlc3RpbWF0ZWQgZnJlZWx5KS4gRm9yIHRoZSBmb3JnaXZlbmVzcyBmYWN0b3IsIGhvd2V2ZXIsIHRoZSB0YXUtZXF1aXZhbGVudCBtb2RlbCBmaXQgd2FzIGFjY2VwdGFibGUgYW5kIHdhcyBub3Qgc2lnbmlmaWNhbnRseSB3b3JzZSB0aGFuIHRoZSBvcmlnaW5hbCB0d28tZmFjdG9yIG1vZGVsIGZpdC4gVGh1cywgdGhlIGFzc3VtcHRpb24gb2YgdGF1LWVxdWl2YWxlbmNlIGhlbGQgZm9yIHRoZSBmb3JnaXZlbmVzcyBmYWN0b3IgaXRlbXMgb25seS4gRmluYWxseSwgdGhlIGFzc3VtcHRpb24gb2YgcGFyYWxsZWwgaXRlbXMgKGkuZS4sIGVxdWFsIGZhY3RvciBsb2FkaW5ncyBhbmQgZXF1YWwgcmVzaWR1YWwgdmFyaWFuY2VzLCBvciBlcXVhbCByZWxpYWJpbGl0eSBhY3Jvc3MgaXRlbXMpIHdhcyBleGFtaW5lZCBmb3IgdGhlIGZvcmdpdmVuZXNzIGZhY3RvciBpdGVtcyBvbmx5LCBhbmQgdGhlIHJlc3VsdGluZyBtb2RlbCBmaXQgd2FzIGFjY2VwdGFibGUgYnV0IHdhcyBzaWduaWZpY2FudGx5IHdvcnNlIHRoYW4gdGhlIHRhdS1lcXVpdmFsZW50IGZvcmdpdmVuZXNzIGZhY3RvciBtb2RlbCBmaXQuIFRodXMsIHRoZSBhc3N1bXB0aW9uIG9mIHBhcmFsbGVsIGl0ZW1zIGRpZCBub3QgaG9sZCBmb3IgdGhlIGZvcmdpdmVuZXNzIGZhY3RvciBpdGVtcy4gSW4gc3VtbWFyeSwgd2hpbGUgdGhlIG5vdCB1bmZvcmdpdmVuZXNzIGZhY3RvciBpdGVtcyB3ZXJlIG5vdCBleGNoYW5nZWFibGUsIHRoZSBmb3JnaXZlbmVzcyBmYWN0b3IgaXRlbXMgd2VyZSBleGNoYW5nZWFibGUgd2l0aCByZXNwZWN0IHRvIHRoZWlyIGZhY3RvciBsb2FkaW5ncyBvbmx5IChpLmUuLCBlcXVhbCBkaXNjcmltaW5hdGlvbiwgYnV0IG5vdCBlcXVhbCByZXNpZHVhbCB2YXJpYW5jZXMgb3IgcmVsaWFiaWxpdHkpLgoKIyMjIyBSZWZlcmVuY2VzOgoKUiBDb3JlIFRlYW0gKDIwMTcpLiBSOiBBIGxhbmd1YWdlIGFuZCBlbnZpcm9ubWVudCBmb3Igc3RhdGlzdGljYWwgY29tcHV0aW5nLiBSIEZvdW5kYXRpb24gZm9yIFN0YXRpc3RpY2FsIENvbXB1dGluZywgVmllbm5hLAogIEF1c3RyaWEuIFVSTCBodHRwczovL3d3dy5SLXByb2plY3Qub3JnLy4KICAKUm9zc2VlbCwgWSAoMjAxMikuIGxhdmFhbjogQW4gUiBQYWNrYWdlIGZvciBTdHJ1Y3R1cmFsIEVxdWF0aW9uIE1vZGVsaW5nLiAqSm91cm5hbCBvZiBTdGF0aXN0aWNhbCBTb2Z0d2FyZSosIDQ4KDIpLCAxLTM2LiBVUkwKICBodHRwOi8vd3d3LmpzdGF0c29mdC5vcmcvdjQ4L2kwMi8uCiAgCmBgYHtyIGNpdGUsIGluY2x1ZGU9VFJVRX0KY2l0YXRpb24oKQpjaXRhdGlvbigibGF2YWFuIikKYGBgCgojIyMgVGFibGVzCgojIyMjIFRhYmxlIDE6IE1vZGVsIEZpdCBTdGF0aXN0aWNzIFVzaW5nIE1MUgoKYGBge3IgdGFibGUxLCBpbmNsdWRlPVRSVUUsIGVjaG89VFJVRX0KZml0c3RhdHMwMSA9IGZpdG1lYXN1cmVzKG9iamVjdCA9IG1vZGVsMDFFc3RpbWF0ZXMpCmZpdHN0YXRzMDQgPSBmaXRtZWFzdXJlcyhvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzKQpmaXRzdGF0czA0QSA9IGZpdG1lYXN1cmVzKG9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXNBbHBoYSkKCnRhYmxlMSA9IGNiaW5kKG5jb2wobW9kZWwwMUVzdGltYXRlc0BTYW1wbGVTdGF0c0Bjb3ZbWzFdXSksIGZpdHN0YXRzMDFbMV0sIGZpdHN0YXRzMDFbNl0sIGZpdHN0YXRzMDFbOV0sIGZpdHN0YXRzMDFbN10sIGZpdHN0YXRzMDFbOF0sIGZpdHN0YXRzMDFbMjVdLAogICAgICAgICAgICAgICBmaXRzdGF0czAxWzQ4XSwgZml0c3RhdHMwMVs0OV0sIGZpdHN0YXRzMDFbNTBdLCBmaXRzdGF0czAxWzUxXSkKY29sbmFtZXModGFibGUxKSA9IGMoIiMgSXRlbXMiLCAiIyBQYXJhbWV0ZXJzIiwgIlNjYWxlZCBDaGktU3F1YXJlIiwgIkNoaS1TcXVhcmUgU2NhbGUgRmFjdG9yIiwgIkRGIiwgInAtdmFsdWUiLCAiQ0ZJIiwgIlJNU0VBIiwgIlJNU0VBIExvd2VyIiwgCiAgICAgICAgICAgICAgICAgICAgICJSTVNFQSBVcHBlciIsICJSTVNFQSBwLXZhbHVlIikKcm93bmFtZXModGFibGUxKSA9ICJPbmUtRmFjdG9yIgoKdGFibGUxID0gcmJpbmQodGFibGUxLCBjYmluZChuY29sKG1vZGVsMDRFc3RpbWF0ZXNAU2FtcGxlU3RhdHNAY292W1sxXV0pLCBmaXRzdGF0czA0WzFdLCBmaXRzdGF0czA0WzZdLCBmaXRzdGF0czA0WzldLCBmaXRzdGF0czA0WzddLCBmaXRzdGF0czA0WzhdLAogICAgICAgICAgICAgICAgICAgICAgICAgZml0c3RhdHMwNFsyNV0sIGZpdHN0YXRzMDRbNDhdLCBmaXRzdGF0czA0WzQ5XSwgZml0c3RhdHMwNFs1MF0sIGZpdHN0YXRzMDRbNTFdKSkKcm93bmFtZXModGFibGUxKVsyXSA9ICJUd28tRmFjdG9yIgoKdGFibGUxID0gcmJpbmQodGFibGUxLCBjYmluZChuY29sKG1vZGVsMDRFc3RpbWF0ZXNAU2FtcGxlU3RhdHNAY292W1sxXV0pLCBmaXRzdGF0czA0QVsxXSwgZml0c3RhdHMwNEFbNl0sIGZpdHN0YXRzMDRBWzldLCBmaXRzdGF0czA0QVs3XSwgZml0c3RhdHMwNEFbOF0sCiAgICAgICAgICAgICAgICAgICAgICAgICBmaXRzdGF0czA0QVsyNV0sIGZpdHN0YXRzMDRBWzQ4XSwgZml0c3RhdHMwNEFbNDldLCBmaXRzdGF0czA0QVs1MF0sIGZpdHN0YXRzMDRBWzUxXSkpCnJvd25hbWVzKHRhYmxlMSlbM10gPSAiVHdvLUZhY3RvciBUYXUtRXF1aXZhbGVudCIKa2FibGUodGFibGUxLCBmb3JtYXQgPSAiaHRtbCIsIGRpZ2l0cyA9IDMpICU+JSBrYWJsZV9zdHlsaW5nKCJzdHJpcGVkIikKCmBgYAoKIyMjIyBUYWJsZSAyOiBNb2RlbCBDb21wYXJpc29ucwoKYGBge3IgdGFibGUyLCBpbmNsdWRlPVRSVUUsIGVjaG89VFJVRX0KdGFibGUyID0gYW5vdmEobW9kZWxTYXR1cmF0ZWRFc3RpbWF0ZXMsIG1vZGVsMDFFc3RpbWF0ZXMpWzIsLWMoMjo0KV0Kcm93bmFtZXModGFibGUyKSA9ICJPbmUtRmFjdG9yIHZzLiBTYXR1cmF0ZWQiCgp0YWJsZTIgPSByYmluZCh0YWJsZTIsYW5vdmEobW9kZWwwMUVzdGltYXRlcywgbW9kZWwwNEVzdGltYXRlcylbMiwtYygyOjQpXSkKcm93bmFtZXModGFibGUyKVsyXSA9ICJPbmUtRmFjdG9yIHZzLiBUd28tRmFjdG9yIgoKdGFibGUyID0gcmJpbmQodGFibGUyLGFub3ZhKG1vZGVsU2F0dXJhdGVkRXN0aW1hdGVzLCBtb2RlbDA0RXN0aW1hdGVzKVsyLC1jKDI6NCldKQpyb3duYW1lcyh0YWJsZTIpWzNdID0gIlR3by1GYWN0b3IgdnMuIFNhdHVyYXRlZCIKCnRhYmxlMiA9IHJiaW5kKHRhYmxlMixhbm92YShtb2RlbDA0RXN0aW1hdGVzQWxwaGEsIG1vZGVsMDRFc3RpbWF0ZXMpWzIsLWMoMjo0KV0pCnJvd25hbWVzKHRhYmxlMilbNF0gPSAiVHdvLUZhY3RvciB2cy4gVHdvLUZhY3RvciBUYXUtRXF1aXZhbGVudCIKCmthYmxlKHRhYmxlMiwgZm9ybWF0ID0gImh0bWwiLCBkaWdpdHMgPSAzKSAlPiUga2FibGVfc3R5bGluZygic3RyaXBlZCIpCmBgYAoKIyMjIyBUYWJsZSAzOiBNb2RlbCBFc3RpbWF0ZXMKCmBgYHtyIHRhYmxlMywgaW5jbHVkZT1UUlVFLCBlY2hvPVRSVUV9CnVuc3RhbmRhcmRpemVkTG9hZGluZ3MgPSBpbnNwZWN0KG9iamVjdCA9IG1vZGVsMDRFc3RpbWF0ZXMsIHdoYXQgPSAiZXN0IikKdW5zdGFuZGFyZGl6ZWRTRSA9IGluc3BlY3Qob2JqZWN0ID0gbW9kZWwwNEVzdGltYXRlcywgd2hhdCA9ICJzZSIpCnN0YW5kYXJkaXplZExvYWRpbmdzID0gaW5zcGVjdChvYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzLCB3aGF0ID0gInN0ZC5hbGwiKQoKdGFibGUzID0gY2JpbmQodW5zdGFuZGFyZGl6ZWRMb2FkaW5ncyRsYW1iZGFbMTozLDFdLCB1bnN0YW5kYXJkaXplZFNFJGxhbWJkYVsxOjMsMV0sIHN0YW5kYXJkaXplZExvYWRpbmdzJGxhbWJkYVsxOjMsMV0pCmNvbG5hbWVzKHRhYmxlMykgPSBjKCJFc3RpbWF0ZSIsICJTRSIsICJFc3RpbWF0ZSIpCnJvd25hbWVzKHRhYmxlMykgPSBjKCJJdGVtIDIiLCAiSXRlbSA0IiwgIkl0ZW0gNiIpCnRhYmxlMyA9IHJiaW5kKHRhYmxlMywgY2JpbmQoY2JpbmQodW5zdGFuZGFyZGl6ZWRMb2FkaW5ncyRsYW1iZGFbNDo2LDJdKSwgY2JpbmQodW5zdGFuZGFyZGl6ZWRTRSRsYW1iZGFbNDo2LDJdKSwgY2JpbmQoc3RhbmRhcmRpemVkTG9hZGluZ3MkbGFtYmRhWzQ6NiwyXSkpKQpyb3duYW1lcyh0YWJsZTMpWzQ6Nl0gPSBjKCJJdGVtIDEiLCAiSXRlbSAzIiwgIkl0ZW0gNSIpCnRhYmxlMyA9IHJiaW5kKHRhYmxlMywgYyh1bnN0YW5kYXJkaXplZExvYWRpbmdzJHBzaVsyLDFdLCB1bnN0YW5kYXJkaXplZFNFJHBzaVsyLDFdLCBzdGFuZGFyZGl6ZWRMb2FkaW5ncyRwc2lbMiwxXSkpCnJvd25hbWVzKHRhYmxlMylbN10gPSAiRmFjdG9yIENvdmFyaWFuY2UiCmludGVyY2VwdHNPcmRlciA9IGMoNCwxLDUsMiw2LDMpCnRhYmxlMyA9IHJiaW5kKHRhYmxlMywgY2JpbmQoY2JpbmQodW5zdGFuZGFyZGl6ZWRMb2FkaW5ncyRudVsxOjYsMV1baW50ZXJjZXB0c09yZGVyXSksIGNiaW5kKHVuc3RhbmRhcmRpemVkU0UkbnVbMTo2LDFdW2ludGVyY2VwdHNPcmRlcl0pLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNiaW5kKHN0YW5kYXJkaXplZExvYWRpbmdzJG51WzE6NiwxXVtpbnRlcmNlcHRzT3JkZXJdKSkpCnJvd25hbWVzKHRhYmxlMylbODoxM10gPSBwYXN0ZSgiSXRlbSIsIDE6NikKdGFibGUzID0gcmJpbmQodGFibGUzLCBjYmluZChjYmluZChkaWFnKHVuc3RhbmRhcmRpemVkTG9hZGluZ3MkdGhldGEpW2ludGVyY2VwdHNPcmRlcl0pLCBjYmluZChkaWFnKHVuc3RhbmRhcmRpemVkU0UkdGhldGEpW2ludGVyY2VwdHNPcmRlcl0pLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNiaW5kKGRpYWcoc3RhbmRhcmRpemVkTG9hZGluZ3MkdGhldGEpW2ludGVyY2VwdHNPcmRlcl0pKSkKCnJvd25hbWVzKHRhYmxlMylbMTQ6MTldID0gcGFzdGUoIkl0ZW0iLCAxOjYpCgoKa2FibGUodGFibGUzLCBmb3JtYXQgPSAiaHRtbCIsIGRpZ2l0cyA9IDMpICU+JSBrYWJsZV9zdHlsaW5nKCJzdHJpcGVkIikgJT4lIGFkZF9oZWFkZXJfYWJvdmUoYygiICIgPSAxLCAiVW5zdGFuZGFyZGl6ZWQiID0gMiwgIlN0YW5kYXJkaXplZCIgPSAxKSkgJT4lIGdyb3VwX3Jvd3MoIkZvcmdpdmVuZXNzIEZhY3RvciBMb2FkaW5ncyIsIDEsMykgJT4lIGdyb3VwX3Jvd3MoIk5vdCBVbmZvcmdpdmVuZXNzIEZhY3RvciBMb2FkaW5ncyIsIDQsNikgJT4lIAogIGdyb3VwX3Jvd3MoIkZhY3RvciBDb3ZhcmlhbmNlIiwgNyw3KSAlPiUgZ3JvdXBfcm93cygiSXRlbSBJbnRlcmNlcHRzIiwgOCwxMykgJT4lIGdyb3VwX3Jvd3MoIkl0ZW0gVW5pcXVlIFZhcmlhbmNlcyIsIDE0LCAxOSkKCmBgYAoKIyMjIEZpZ3VyZXMgCgojIyMjIEZpZ3VyZSAxOiBGYWN0b3IgU2NvcmUgRGlzdHJpYnV0aW9ucwoKYGBge3IsIGluY2x1ZGU9VFJVRSwgZWNobz1UUlVFfQoKIyBIaXN0b2dyYW0gb3ZlcmxhaWQgd2l0aCBrZXJuZWwgZGVuc2l0eSBjdXJ2ZQpnZ3Bsb3QoZnNjb3JlcyRzY29yZXMsIGFlcyh4PVNpdFApKSArIAogICAgZ2VvbV9oaXN0b2dyYW0oYWVzKHk9Li5kZW5zaXR5Li4pLCAgICAgICMgSGlzdG9ncmFtIHdpdGggZGVuc2l0eSBpbnN0ZWFkIG9mIGNvdW50IG9uIHktYXhpcwogICAgICAgICAgICAgICAgICAgYmlud2lkdGg9LjUsCiAgICAgICAgICAgICAgICAgICBjb2xvdXI9ImJsYWNrIiwgZmlsbD0id2hpdGUiKSArIHhsaW0oYygtNCw0KSkgKyBsYWJzKHRpdGxlID0gIlBvc2l0aXZlIFNpdHVhdGlvbiBGb3JnaXZlbmVzcyBGYWN0b3IgU2NvcmUiKSArCiAgICBnZW9tX2RlbnNpdHkoYWxwaGE9LjIsIGZpbGw9IiNGRjY2NjYiKSAgICAjIE92ZXJsYXkgd2l0aCB0cmFuc3BhcmVudCBkZW5zaXR5IHBsb3QKCiMgSGlzdG9ncmFtIG92ZXJsYWlkIHdpdGgga2VybmVsIGRlbnNpdHkgY3VydmUKZ2dwbG90KGZzY29yZXMkc2NvcmVzLCBhZXMoeD1TaXROKSkgKyAKICAgIGdlb21faGlzdG9ncmFtKGFlcyh5PS4uZGVuc2l0eS4uKSwgICAgICAjIEhpc3RvZ3JhbSB3aXRoIGRlbnNpdHkgaW5zdGVhZCBvZiBjb3VudCBvbiB5LWF4aXMKICAgICAgICAgICAgICAgICAgIGJpbndpZHRoPS41LAogICAgICAgICAgICAgICAgICAgY29sb3VyPSJibGFjayIsIGZpbGw9IndoaXRlIikgKyB4bGltKGMoLTQsNCkpICsgbGFicyh0aXRsZSA9ICJOZWdhdGl2ZSBTaXR1YXRpb24gRm9yZ2l2ZW5lc3MgRmFjdG9yIFNjb3JlIikgKwogICAgZ2VvbV9kZW5zaXR5KGFscGhhPS4yLCBmaWxsPSIjRkY2NjY2IikgICAgIyBPdmVybGF5IHdpdGggdHJhbnNwYXJlbnQgZGVuc2l0eSBwbG90CgpgYGAKCiMjIyMgRmlndXJlIDIgOiBFeHBlY3RlZCBJdGVtIFJlc3BvbnNlIFBsb3RzCgpgYGB7ciBmaWd1cmUyLCBpbmNsdWRlPVRSVUUsIGVjaG89VFJVRX0KcGFyKG1mcm93ID0gYygxLDIpKQpjZmFQbG90cyhsYXZPYmplY3QgPSBtb2RlbDA0RXN0aW1hdGVzKQpwYXIobWZyb3cgPSBjKDEsMSkpCmBgYAoKCg==