R语言与数据挖掘最佳实践和经典案例 带书签目录 pdf版
R语言与数据挖掘下载
书籍大小：30.5MB
书籍语言：简体中文
书籍类型：
书籍授权：免费软件
更新时间：
书籍类别：编程其它
购买链接：
网友评分：
应用平台：
48.6MB | 简体中文
61.03MB | 简体中文
108MB | 简体中文
118MB | 简体中文
390MB | 简体中文
17MB | 简体中文
4.6MB | 简体中文
21.58MB | 简体中文
73.34MB | 简体中文
下载错误？
R语言与数据挖掘最佳实践和经典案例 带书签目录 pdf版苹果/安卓/wp
积分 51, 距离下一级还需 34 积分
道具: 彩虹炫, 涂鸦板, 雷达卡, 热点灯, 金钱卡, 显身卡下一级可获得
权限: 自定义头衔
购买后可立即获得
权限: 隐身
道具: 金钱卡, 彩虹炫, 雷达卡, 热点灯, 涂鸦板
看到一篇文章说，如果内生变量是0/1变量，不能直接用ivreg/xtivreg，第一步最好用probit/logit，而不是LMP，刚接触2SLS，不知道怎么写代码，求问大家。
支持楼主：、
购买后，论坛将把您花费的资金全部奖励给楼主，以表示您对TA发好贴的支持
载入中......
若&内生变量是0/1变量&，不太容易找到适当的工具变量。所以有人会使用其他方式（例如 propensity score matching, PSM）来处理！
黃河泉 发表于
若&内生变量是0/1变量&，不太容易找到适当的工具变量。所以有人会使用其他方式（例如 propensity score mat ...已经找到工具变量，但是不知道第一步用probit怎么写代码，看了很多说2SLS的代码是 ivregress 2sls y ( w= z1 z2) x ,first，但是不适合内生变量是0/1的
孤单心事1 发表于
已经找到工具变量，但是不知道第一步用probit怎么写代码，看了很多说2SLS的代码是 ivregress 2sls y ( w= ...应该是可以的！
我也在做这个问题，professor说先用logit模型做first stage regression，保存fitted value，再把fiitted value带入原始model进行回归。
代码我现在自己还没研究出来
xtlogit x iv controls
predict double xhat
xtreg y xhat controls
这个是我现在定的初步
<font color="#7892846 发表于
我也在做这个问题，professor说先用logit模型做first stage regression，保存fitted value，再把fiitted va ...请教一下，工具变量为0,1变量，第一阶段用logit或probit回归，第二段用xtreg回归的问题你解决了吗？
&nbsp&nbsp|
&nbsp&nbsp|
&nbsp&nbsp|
&nbsp&nbsp|
&nbsp&nbsp|
&nbsp&nbsp|
如有投资本站或合作意向，请联系（010-）；
邮箱：service@pinggu.org
投诉或不良信息处理：（010-）
论坛法律顾问：王进律师R-SEM-paper(R语言分析结构方程模型)_甜梦文库
R-SEM-paper(R语言分析结构方程模型)
STRUCTURAL EQUATION MODELING, 13(3), 465C486 Copyright ? 2006, Lawrence Erlbaum Associates, Inc.TEACHER’S CORNERStructural Equation Modeling With the sem Package in RJohn FoxMcMaster UniversityR is free, open-source, cooperatively developed software that implements the S statistical programming language and computing environment. The current capabilities of R are extensive, and it is in wide use, especially among statisticians. The sem package provides basic structural equation modeling facilities in R, including the ability to fit structural equations in observed variable models by two-stage least squares, and to fit latent variable models by full information maximum likelihood assuming multinormality. This article briefly describes R, and then proceeds to illustrate the use of the tsls and sem functions in the sem package. The article also demonstrates the integration of the sem package with other facilities available in R, for example for computing polychoric correlations and for bootstrapping.R (Ihaka & Gentleman, 1996; R Development Core Team, 2005) is a free, open-source, cooperatively developed implementation of the S statistical programming language and computing environment (Becker, Chambers, & Wilks, 1988; Chambers, 1998; Chambers & Hastie, 1992).1 Since its introduction in the mid-1990s, R has rapidly become one of the most widely used facilities for statistical computing, especially among statisticians, and arguably now has broader coverage of statistical methods than any other statistical software. The basic R system, with capabilities roughly comparable to (say) a basic installation of SAS, can be augmented by contributed packages, which now number more than 700. TheseCorrespondence should be addressed to John Fox, Department of Sociology, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada L8S 4M4. E-mail: jfox@mcmaster.ca 1There is also a commercial implementation of the S statistical computing environment called S-PLUS, which antedates R, and which is distributed by Insightful Corporation (http://www.insightful.com/products/splus/). The sem package for R described in this article could be adapted for use with S-PLUS without too much trouble, but it does not work with S-PLUS in its current form.466FOXpackages, along with the basic R software, are available on the Comprehensive R Archive Network (CRAN) Web sites, with the main CRAN archive in Vienna (at http://cran.r-project.org/; see also the R home page, at http://www.r-project.org/). R runs on all of the major computing platforms, including Linux/UNIX systems, Microsoft Windows systems, and Macintoshes under OS/X. This article describes the sem package in R, which provides a basic structural equation modeling (SEM) facility, including the ability to estimate structural equations in observed variable models by two-stage least squares (2SLS), and to fit general (including latent variable) models by full information maximum likelihood (FIML) assuming multinormality. There is, in addition, the systemfit package, not described here, which implements a variety of observed variable structural equation estimators. The first section of this article provides a brief introduction to computing in R. Subsequent sections describe the use of the tsls function for 2SLS estimation and the sem function for fitting general structural equation models. A concluding section suggests possible future directions for the sem package. BACKGROUND: A BRIEF INTRODUCTION TO R It is not possible within the confines of this article to give more than a cursory introduction to R. The purpose of this section is to provide some background and orienting information. Beyond that, R comes with a complete set of manuals, including a good other documentation is available on the R Web site and in a number of books (e.g., Fox, 2002; Venables & Ripley, 2002). R also has an extensive online help system, reachable through the help command, ? operator, and some other commands, such as help.search. Although one can build graphical interfaces to R―for example, the Rcmdr (“R Commander”) package provides a basic statistics graphical user interface―R is fundamentally a command-driven system. The user interacts with the R interpreter either directly at a command prompt in the R console or through
the Windows version of R incorporates a simple script editor. Figure 1 shows the main R window as it appears at start-up on a Microsoft Windows XP system. The greater than (&) symbol to the left of the block cursor in the R console i commands entered at the prompt are statements in the S language, and may include mathematical and other expressions to be evaluated along with function calls. The following are some examples of simple R commands:& 1 + 2*3^2 # an arithmetic expression [1] 19 & c(1, 2, 3)*2 # vectorized arithmetic [1] 2 4 6STRUCTURAL EQUATION MODELING IN R467FIGURE 1 R console.The Windows version of R at start-up, showing the main R window and the& 2:5 # the sequence operator [1] 2 3 4 5 & (2:5)/c(2, 2, 3, 3) [1] 1....666667 & x &- rnorm(1:10) # random normal numbers & x # print x [1] 0......] -2....1573525 & mean(x) [1] 0.1736790 & mean(rnorm(100)) [1] -0.2394827? The first command is an arithmetic expression representing 1 + 2 × 32; the normal precedence of arithmetic operators applies, and so exponentiation precedes multiplication, which precedes addition. The spaces in the command are optional,468FOXand are meant to clarify the expression. The pound sign (#) is a comment character: Everything to its right is ignored by the R interpreter. ? The second command illustrates vectorized arithmetic, in which each element of a three-element vector is multiplied by 2; here c is the combine function, which constructs a vector from its arguments. As is general in S, the arguments to the c function are specified in parentheses and are arguments may be specified by position or by (abbreviated) name, in which case they need not appear in order. In many commands, some arguments have default values and therefore need not be specified explicitly. ? In the third command, the sequence operator (:) is used to generate a vector of consecutive integers, and in the following command, this vector is divided by a vector of the same length, with the operation performed element-wise on corresponding entries of the two vectors. As here, parentheses may be used to clarify expressions, or to alter the normal order of evaluation. ? In the next command, the rnorm function is called with the argument 10 to sample 10 pseudo-random numbers from the standard the result is assigned to a variable named x. Enter ?rnorm or help(rnorm) at the command prompt to see the help page for the rnorm function. The symbol &-, composed of a less than sign and a hyphen, is the an equals sign (=) may also be used for assignment. Variables (and other objects) in R can have names of arbitrary length, composed of uppercase and lowercase letters, numerals, underscores, and periods, but must start with
nonstandard names incorporating other characters are supported, but are less convenient. R is case-sensitive, and so, for example, the names x and X are distinguished. ? Notice that nothing is printed following an assignment. Subsequently typing the name of the variable x prints its contents. The number in square brackets at the start of each line of output gives the index of the first element displayed in the line. ? In the next command, the mean function is used to calculate the average of the entries in x. ? The final preliminary example shows how the result of one function (100 random normal values returned by rnorm) can be passed as an argument to another function (mean). This style is common in formulating S commands. Data can be input into R from many different sources: entered directly at the keyboard, read from plain-text files in a variety of formats, imported from other statistical packages and spreadsheet programs, read from database management systems, and so on. Case-by-variable data sets can be stored in data frame objects, which are analogous to internal data sets in statistical packages such as SAS or SPSS. R also supports many different kinds of data structures (e.g., vectors, matrices, arrays, lists, and objects created in two object-oriented programming systems) and types (e.g., numeric, character, and logical data). Indeed, an advantage of working in a statistical computing environment, as opposed to a traditional statistical package, is that in the former data are flexibly manipulable by the user, both directlySTRUCTURAL EQUATION MODELING IN R469and through programs. Moreover, the functions (programs) that the user writes are syntactically indistinguishable from the functions provided with R. Related sets of functions, data, and documentation can be collected into R packages, and either maintained for private use or contributed to CRAN. The sophisticated tools provided for writing, maintaining, building, and checking packages are one of the strengths of R. 2SLS ESTIMATION OF OBSERVED VARIABLE MODELS The tsls function in the sem package fits structural equations by two-stage least squares (2SLS) using the general S “formula” interface. S model formulas implement a variant of Wilkinson and Rogers’s (1973) notati formulas are used in a wide variety of model-fitting functions in R (e.g., the basic lm and glm functions for fitting linear and generalized linear models, respectively). 2SLS estimation is illustrated using a classical application of SEM in econometrics: Klein’s “Model I” of the U.S. economy (Klein, 1950; see also, e.g., Greene, 1993, pp. 581C582). Klein’s data, a time-series data set for the years 1920 to 1941, are included in the data frame Klein in the sem package:& library(sem) & data(Klein) & Klein Year C P 1
16.9 . . . 21
23.5Wp I K.lag X Wg 28.8 2.7 180.1 44.9 2.2 25.5 -0.2 182.8 45.6 2.7 29.3 1.9 182.6 50.1 2.9 45.0 53.3G 2.4 3.9 3.2T 3.4 7.7 3.93.3 201.2 75.7 8.0 7.4 9.6 4.9 204.5 88.4 8.5 13.8 11.6The library command loads the sem package, and the data command reads the Klein data set into memory. (The ellipses, … , represent lines elided from the output.) Greene (1993, p. 581) wrote Klein’s model as follows:Ct = α 0 + α1Pt + α 2 Pt-1 + α 3 (W pt + W gt ) + ε1t It = β0 + β1Pt + β2 Pt-1 + β3 Kt-1 + ε2t W pt = γ 0 + γ1 Xt + γ 2 Xt-1 + γ 3 At + ε3t Xt = Ct + It + Gt Pt = Xt - Tt - W pt Kt = Kt-1 + ItThe last three equations are identities, and do not figure directly in the 2SLS estimation of the model. The variables in the model, again as given by Greene, are C470FOX(consumption), I (investment), Wp (private wages), Wg (government wages), X (equilibrium demand), P (private profits), K (capital stock), A (a trend variable, expressed as yearC1931), and G (government nonwage spending). The subscript t indexes observations. Because the model includes lagged variables that are not directly supplied in the data set, the observation for the first year, 1920, is effectively lost to estimation. The lagged variables can be added to the data frame as follows, printing the first three observations:& Klein$P.lag && Klein$X.lag && Klein[1:3,] Year C P 1
16.9 c(NA, Klein$P[-22]) c(NA, Klein$X[-22]) Wp I K.lag X Wg G T P.lag X.lag 28.8 2.7 180.1 44.9 2.2 2.4 3.4 NA NA 25.5 -0.2 182.8 45.6 2.7 3.9 7.7 12.7 44.9 29.3 1.9 182.6 50.1 2.9 3.2 3.9 12.4 45.6In S, NA (not available) represents missing data, and, consistent with standard statistical notation, a negative subscript, such as -22, drops observations. Square brackets are used to index objects such as data frames (e.g., Klein[1:3,]), vectors (e.g., Klein$P[-22]), matrices, arrays, and lists. The dollar sign ($) can be used to index elements of data frames or lists. The available instrumental variables are the exogenous variables G, T, Wg, A, and the constant regressor, and the predetermined variables Kt C 1, Pt C 1, and Xt C 1. Using these instrumental variables, the structural equations can be estimated:& Klein.eqn1 &- tsls(C ~ P + P.lag + I(Wp + Wg), + instruments=~G + T + Wg + I(Year - 1931) + K.lag + P.lag + X.lag, + data=Klein) & Klein.eqn2 &- tsls(I ~ P + P.lag + K.lag, + instruments=~G + T + Wg + I(Year - 1931) + K.lag + P.lag + X.lag, + data=Klein) & Klein.eqn3 &- tsls(Wp ~ X + X.lag + I(Year - 1931), + instruments=~G + T + Wg + I(Year - 1931) + K.lag + P.lag + X.lag, + data=Klein)? The tsls function returns an object, which, in each case, has been for example, Klein.eqn1 for the first structural equation. Because of the assignment, no results are printed. We can create a brief printout by entering the name of the object, or a more complete listing via the summary function (see later). If desired, further computation could be performed on the object, such as extracting residuals or fitted values (via the residuals and fitted.values functions), or comparing two nested models by an F test (via the anova function). GenericSTRUCTURAL EQUATION MODELING IN R471functions such as summary, residuals, fitted.values, and anova have methods for handling tsls objects appropriately. The same generics are used for other classes of objects, such as linear and generalized linear models. ? We can perform arithmetic operations and function calls within a model formula. Thus I(Wp + Wg) forms a single regressor by summing th it is necessary to protect this operation with the identify function I (which returns its argument unchanged) because otherwise an arithmetic operator such as + would be accorded special meanin specifically, + means add a term to the model, and therefore, without protection, Wp + Wg would enter the two variables into the regression separately. We can read the model formula for Equation 1 as, “Regress C on P, P.lag, and the sum of Wp and Wc.” Were factors (categorical predictors) included in the model, R would automatically have generated contrasts to represent the factors, by default using dummy-coded (0/1) regressors. Interactions, nesting, transformations of variables, etc., can also be specified on the right side of a model formula, and ordinary arithmetic operations and function calls on the left side. Unless it is explicitly suppressed (by including -1 on the right side of the model formula), a constant regressor is included in the model. ? The instruments argument to tsls specifies the instrumental variables as a one-sided model formula. As in the specification of the structural equation, the constant variable is automatically included among the instruments. ? When an R command is syntactically incomplete, it is continued to the next line, as indicated in the listing by the + prompt, which is supplied at the beginning of each continuation line by the interpreter. To produce a printed summary for the first structural equation:& summary(Klein.eqn1) 2SLS Estimates Model Formula: C ~ P + P.lag + I(Wp + Wg) Instruments: ~G + T + Wg + I(Year - 1931) + K.lag + P.lag + X.lag Residuals: Min. 1st Qu. Median Mean 3rd Qu. Max. -1.89e+00 -6.16e-01 -2.46e-01 -6.60e-11 8.85e-01 2.00e+00 Estimate Std. Error (Intercept) 16.98 P 0.20 P.lag 0.22 I(Wp + Wg) 0.74 Residual standard error: 1.1357 t value Pr(&|t|) 11.e-09 0.e-01 1.e-02 18.e-12 on 17 degrees of freedomTo save space, the summaries for Equations 2 and 3 are omitted. The coefficient estimates are identical to those in Greene (1993), but the coefficient standard errors differ slightly, because the summary method for tsls ob-472FOXjects uses residual degrees of freedom (17) rather than the number of observations (21) to estimate the error variance. To recover Greene’s asymptotic standard errors, the covariance matrix of the coefficients can be extracted and adjusted, illustrating a computation on a tsls object:& sqrt(diag(vcov(Klein.eqn1)*17/21)) (Intercept) P P.lag I(Wp + Wg) 1....vcov is a generic function that returns a varianceCcovariance matrix, here for the tsls object Klein.eqn1, and diag extracts the main diagonal of this matrix.ESTIMATING GENERAL STRUCTURAL EQUATION MODELS A Structural Equation Model With Latent Exogenous and Endogenous Variables Like Klein’s Model I, Wheaton, Muthén, Alwin, and Summers’s (1977) panel data on the stability of alienation have been a staple of the SEM literature, making an appearance, for example, in both the LISREL manual (J?reskog & S?rbom, 1989) and in the documentation for the CALIS procedure in SAS (SAS Institute, 2004). The path diagram in Figure 2 is for a model fit to the Wheaton et al. data in the LISREL manual (J?reskog & S?rbom, 1989, pp. 169C177). This diagram employs the usual conventions, representing observed variables by Roman letters enclosed in rectangles and unobserved variables (including latent variables and errors) by Greek letters enclosed in ellipses and circles. Directed arrows designate regression coefficients, and bidirectional arrows signify covariances. The covariances represented by the two bidirectional arrows with broken lines are not included in an initial model specified for these data. The directed arrows are labeled with Greek letters representing the corresponding regression coefficients. Anomia and Powerlessness are two subscales of a standard alienation scale, with data collected on a panel of individuals from rural Illinois in both 1967 and 1971. (In this version of the model, data on these variables from a 1966 wave of the study are ignored.) Education is measured in years, and SEI represents a socioeconomic index based on the respondent’s occupation. The latent variable SES stands for socioeconomic status.22It is curious that the various forms of the Wheaton model treat SES as a cause of the indicators Education and SEI, rather than treating these variables as constitutive of SES (i.e., reversing the arrows in the path diagram, which produces an observationally indistinguishable model), but for consistency with the literature that specification is retained here.STRUCTURAL EQUATION MODELING IN R473FIGURE 2 Conventional path diagram for J?reskog and S?rbom’s model for the Wheaton alienation data. Adapted with permission from Figure 6.5 in J?reskog and S?rbom ().Using the common LISREL notation, this model consists of a structural submodel with two equations for the two latent endogenous variables (Alienation 67 and Alienation 71), and a measurement submodel with equations for the six indicators of the latent variables: Structural submodelη1 = γ1ξ + ζ1 η2 = γ 2 ξ + βη1 + ζ 2Measurement submodely1 = 1η1 + ε1 y2 = λ1η1 + ε2 y3 = 1η2 + ε3 y4 = λ 2 η2 + ε 4 x1 = 1ξ + δ1 x2 = λ 3 ξ + δ 2474FOXIn these equations, the variables―observed and unobserved―are expressed as deviations from their expectations, suppressing the regression constant in each equation.3 The parameters of the model to be estimated include not just regression coefficients (i.e., structural parameters and factor loadings relating observed indicators to latent variables), but also the measurement-error variances, V (εi ) = θεii , V (δ j ) = θδ the variances of the structural disturbances, V (ζ i ) = ψ the variance of the latent exogenous variable, V (ξ) = φ ; and, in some models considered next, certain measurement-error covariances C(εi , εi &#39; ) = θεii &#39; . The 1s in the measurement submodel reflect normalizing restrictions, establishing the scales of the latent variables. Internally, the sem function, which is used to fit general structural equation models in R, employs the recticular action model (RAM) formulation of the model, due to McArdle (1980) and McArdle and McDonald (1984), and it is therefore helpful to understand the str the notation used here is from McDonald and Hartmann (1992). In the RAM model, the vector v contains indicator variables, directly observed exogenous variables, and latent exogenous and
the vector u (which may overlap with v) contains directly observed and latent exogenous variables, measurement-error variables, and structural-error variables (i.e., the inputs to the system). Not all classes of variables are pr for example, there are no directly observed exogenous variables in the Wheaton model. The v and u vectors are related by the equation v = Av + u, and, therefore, the matrix A contains regression coefficients (both structural parameters and factor loadings). For example, for the Wheaton model, we haveé y1 ù é 0 ê ú ê ê y2 ú ê 0 ê ú ê ê y3 ú ê 0 ê ú ê ê y ú ê0 ê 4ú ê ê ú=ê ê x1 ú ê 0 ê ú ê ê x2 ú ê 0 ê ú ê ê η1 ú ê 0 ê ú ê êη2 ú ê 0 ê ú ê êê ξ úú êê 0 ? ? ? 0 0 0 0 0 1 0 0 0 0 0 0 λ1 0 0 0 0 0 0 0 1 0 0 0 0 0 0 λ2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 β 0 0ù ú 0 úú 0 úú 0 úú ú 1ú ú λ3 ú ú γ1 ú ú γ2 ú ú 0 úú? é y1 ù é ε1 ù ê ú ê ú ê y2 ú ê ε2 ú ê ú ê ú ê y3 ú ê ε3 ú ê ú ê ú ê y ú êε ú ê 4ú ê 4ú ê ú+ê ú ê x1 ú ê δ1 ú ê ú ê ú ê x2 ú ê δ 2 ú ê ú ê ú ê η1 ú ê ζ1 ú ê ú ê ú êη2 ú êζ 2 ú ê ú ê ú êê ξ úú êê ξ úú ? ? ? ?3A model with intercepts can be estimated by the sem function (described later) using a raw (i.e., uncorrected) moment matrix of mean sums of squares and cross-products in place of the covariance matrix among the observed variables in the model. This matrix includes sums of squares and products with a vector of ones, representing the constant regressor (see, e.g., McArdle & Epstein, 1987). The raw.moments function in the sem package will compute a raw-moments matrix from a model formula, numeric data frame, or numeric data matrix. To get correct degrees of freedom, set the argument raw = TRUE in sem.STRUCTURAL EQUATION MODELING IN R475As is typically the case, most of the entries of A are prespecified to be 0, whereas others are set to 1. In the RAM formulation, the matrix P contains covariances among the elements of u. For the Wheaton model:é ε1 ù éθε11 ê ú ê ê ε2 ú ê 0 ê ú ê ê ε3 ú êθε13 ê ú ê êε ú ê 0 ê 4ú ê P = V êê δ1 úú = êê 0 ê ú ê ê δ2 ú ê 0 ê ú ê ê ζ1 ú ê 0 ê ú ê êζ 2 ú ê 0 ê ú ê êê ξ úú êê 0 ? ? ? 0 θε θε22θε13 0 θε330 θε θε240 0 0 00 0 0 0 00 0 0 0 0 00 0 0 0 0 0 00240440 0 0 0 00 0 0 0 0 00 0 0 0 0θδ11 0 θδ22 0 0 0 0 0 0ψ11 0 ψ12 0 00ù ú 0úú 0úú 0úú ú 0ú ú 0ú ú 0ú ú 0ú ú φúú?Once again, as is typically true, the P matrix is very sparse. Let m represent the number of variables in v, and let the first n entries of v be the observed variables of the model. Then the m × n selection matrixé I n 0ù ú J=ê ê 0 0ú ? ? picks out the observed variables, where In is an order-n identity matrix and the 0s are zero matrices of appropriate order. Covariances among the observed variables are therefore given byC = E ( Jvv? J ?) = J ( I m - A)-1 P[( I m - A)-1 ]? J ?Let S denote the covariances among the observed variables computed directly from a sample of data. Estimating the parameters of the model―the unconstrained entries of A and P―entails picking values of the parameters that make C close in some sense to S. In particular, under the assumption that the latent variables and errors are multinormally distributed, maximum likelihood (ML) estimates of the parameters minimize the fitting criterionF ( A, P) = trace(SC-1 ) - n + loge det C - loge det SThe sem function minimizes the ML fitting criterion numerically using the nlm optimizer in R, which employs a Newton- sem by default uses an analytic gradient, but a numerical gradient may be optionally employed. The covariance matrix of the parameter estimates is based on the numerical Hessian re-476FOXFIGURE 3 Modified RAM-format path diagram, with variables and parameters labeled for input to the sem function.turn by nlm. Start values for the parameters may be supplied by the user or are computed by a slightly modified version of the approach given in McDonald and Hartmann (1992). One advantage of the RAM formulation of a structural equation model is that the elements of the A and P matrices can be read off the path diagram for the model, with single-headed arrows corresponding to elements of A and double-headed arrows to elements of P, taking into account the fact that variances (as opposed to covariances) of exogenous variables and errors do not appear directly in the path diagram. To make the variances explicit, it helps to modify the path diagram slightly, as in Figure 3, eliminating the error variables and showing variances as self-directed double-headed arrows. The names of variables and free parameters have been replaced with names suitable for specifying the model in R. Model specification in the sem package is handled most conveniently via the specify.model function:& mod.wh.1 &- specify.model() 1: Alienation67 -& Anomia67, 2: Alienation67 -& Powerless67, 3: Alienation71 -& Anomia71, 4: Alienation71 -& Powerless71,NA, lam1, NA, lam2,1 NA 1 NASTRUCTURAL EQUATION MODELING IN R4775: SES 6: SES 7: Alienation67 8: SES 9: SES 10: SES 11: Alienation67 12: Alienation71 13: Anomia67 14: Powerless67 15: Anomia71 16: Powerless71 17: Education 18: SEI 19: Read 18 records-& -& -& -& -& &-& &-& &-& &-& &-& &-& &-& &-& &-&Education, SEI, Alienation71, Alienation67, Alienation71, SES, Alienation67, Alienation71, Anomia67, Powerless67, Anomia71, Powerless71, Education, SEI,NA, lam3, beta, gam1, gam2, phi, psi1, psi2, the11, the22, the33, the44, thd1, thd2,1 NA NA NA NA NA NA NA NA NA NA NA NA NAThis specification is largely self-explanatory, but note the following:? The line-number prompts are supplied by specify.model, which is called here without any arguments. The entries are terminated by a blank line. The specify-model function can also read the model specification from a text file. ? There are three entries in each line, separated by commas. ? A single-headed arrow in the first entry indicates a regression coefficient and corresponds to a single-headed arrow likewise a double-headed arrow represents a variance or covariance and corresponds to a double-headed arrow in the modified path diagram in Figure 3 (disregarding for now the broken arrows labeled the13 and the24 in the diagram). ? The second entry in each line gives the (arbitrary) name of a free parameter to be estimated. Entering the name NA (missing) indicates that a parameter is to be fixed to a particular value. Assigning the same name to two or more arrows establishes an equality constraint between the corresponding parameters. For example, substituting lam for both lam1 and lam2 would imply that these two factor loadings are represented by the same parameter and hence are equal. ? The third entry in each line either assigns a value to a fixed parameter or sets a start value
in the latter case, entering NA causes sem to pick the start value. ? Finally, a word of caution: A common error in specifying models is to omit double-headed arrows representing variances of exogenous variables or error variances.To estimate the model, the covariance or raw-moment matrix among the observed variables has to be computed. In the case of the Wheaton data, the478FOXcovariances rather than the original data are available, and consequently the covariance matrix is entered directly:& S.wh &- matrix(c( + 11.834, 0, 0, 0, 0, 0, + 6.947, 9.364, 0, 0, 0, 0, + 6.819, 5.091, 12.532, 0, 0, 0, + 4.783, 5.028, 7.495, 9.986, 0, 0, + -3.839, -3.889, -3.841, -3.625, 9.610, 0, + -21.899, -18.831, -21.748, -18.775, 35.522, 450.288), + 6, 6, byrow=TRUE) & & rownames(S.wh) &- colnames(S.wh) &+ c(’Anomia67’,’Powerless67’,’Anomia71’,’Powerless71’,’Education’,’SEI’)The covariance matrix has been entered in lower-triangular form: sem will accept a lower triangular, upper triangular, or symmetric covariance matrix. One can either assign the names of the observed variables to the rows and columns of the input covariance matrix, as done here, or pass these n in either event, variables in the model specification that do not appear in the input covariance matrix are assumed by sem to be latent variables. One must therefore be careful in typing these names, because the misspelled name of an observed variable is interpreted as a latent variable, producing an erroneous model. To estimate the model:& sem.wh.1 &- sem(mod.wh.1, S.wh, N=932) & summary(sem.wh.1) Model Chisquare = 71.47 Df = 6 Pr(&Chisq) = 2.0417e-13 Goodness-of-fit index = 0.97517 Adjusted goodness-of-fit index = 0.91309 RMSEA index = 0.10826 90 % CI: (0..13145) BIC = 19.695 Normalized Residuals Min. 1st Qu. Median Mean 3rd Qu. Max. -1.26e+00 -2.12e-01 -8.35e-05 -1.53e-02 2.44e-01 1.33e+00 Parameter Estimateslam1 lam2 lam3 beta gam1 gam2 phi Estimate Std Error z value Pr(&|z|) 0.196 20.0e+00 Powerless67 &―- Alienation67 0.560 20.0e+00 Powerless71 &―- Alienation71 5.955 12.0e+00 SEI &―- SES 0.393 13.0e+00 Alienation71 &―- Alienation67 -0.270 -10.0e+00 Alienation67 &―- SES -0.244 -3.6e-03 Alienation71 &―- SES 6.394 10.0e+00 SES &―& SESSTRUCTURAL EQUATION MODELING IN R479psi1 5.105 psi2 3.844 the11 4.989 the22 3.900 the33 3.894 the44 3.365 thd1 2.395 thd2 260.663 Iterations = 8310.5 11.0 9.4 5.50........0000e+00Alienation67 &―& Alienation67 Alienation71 &―& Alienation71 Anomia67 &―& Anomia67 Powerless67 &―& Powerless67 Anomia71 &―& Anomia71 Powerless71 &―& Powerless71 Education &―& Education SEI &―& SEI? The first argument to sem is the model-specification object returned byspecify.model.? The second argument, S.wh, is the input covariance matrix. ? The third argument is the number of observations on which the covariancesare based.? There are other optional arguments, which are explained in the sem helppage (type ?sem to see it). One other argument is worth mentioning here: fixed.x takes a vector of quoted names of fixed exogenous variables, obviating the tedious necessity of enumerating the variances and covariances among these variables in the model specification. In this case, there are no fixed exogenous variables. As is typical of R programs, sem returns an object rather than a printed report. The summary method for sem objects produces the printout shown previously. One can perform additional computations on sem objects, for example, producing various kinds of residual covariances or modification indexes4 (e.g., S?rbom, 1989):& mod.indices(sem.wh.1) 5 largest modification indices, A matrix: Anomia71:Anomia67 Anomia67:Anomia71 Powerless71:Anomia67 10...024746 Anomia67:Powerless71 Powerless67:Anomia71 7.. largest modification indices, P matrix: Anomia71:Anomia67 Powerless71:Anomia67 40..377847 Powerless71:Powerless67 Education:Powerless67 26..878679Anomia71:Powerless67 32.0511554The modification indexes returned by mod.indices are slightly in error because of an apparent bug that has to this point been elusive.480FOXThe object returned by mod.indices is simply printed, which pro the summary method for these objects produces a more complete report, showing all modification indexes along with approximations to the estimates that would result were each omitted parameter included in the model. Recall that the A matrix contains regression coefficients whereas the P matrix contains covariances. The modification indexes suggest that a better fit to the data would be achieved by freeing one or more of the covariances among the measurement errors of the latent
the largest modification index is for the two anomia measures, corresponding to the broken arrow labeled the13 in Figure 3. Adding this parameter to the model produces a much better fit (but subsequently adding a parameter for the measurement error covariance the24, not shown, yields little additional improvement):& mod.wh.2 &- specify.model() 1: Alienation67 -& Anomia67, 2: Alienation67 -& Powerless67, 3: Alienation71 -& Anomia71, 4: Alienation71 -& Powerless71, 5: SES -& Education, 6: SES -& SEI, 7: Alienation67 -& Alienation71, 8: SES -& Alienation67, 9: SES -& Alienation71, 10: SES &-& SES, 11: Alienation67 &-& Alienation67, 12: Alienation71 &-& Alienation71, 13: Anomia67 &-& Anomia67, 14: Powerless67 &-& Powerless67, 15: Anomia71 &-& Anomia71, 16: Powerless71 &-& Powerless71, 17: Anomia67 &-& Anomia71, 18: Education &-& Education, 19: SEI &-& SEI, 20: Read 19 recordsNA, lam1, NA, lam2, NA, lam3, beta, gam1, gam2, phi, psi1, psi2, the11, the22, the33, the44, the13, thd1, thd2,1 NA 1 NA 1 NA NA NA NA NA NA NA NA NA NA NA NA NA NA& sem.wh.2 &- sem(mod.wh.2, S.wh, 932) & summary(sem.wh.2)Model Chisquare = 6.3307 Df = 5 Pr(&Chisq) = 0.27536 Goodness-of-fit index = 0.99773 Adjusted goodness-of-fit index = 0.99047 RMSEA index = 0. % CI: (NA, 0.050905) BIC = -36.815STRUCTURAL EQUATION MODELING IN R481Normalized Residuals Min. 1st Qu. Median Mean 3rd Qu. Max. -9.57e-01 -1.34e-01 -4.26e-02 -9.17e-02 1.82e-05 5.46e-01 Parameter EstimatesEstimate Std Error z value Pr(&|z|) lam1 1.421 19.0e+00 Powerless67 &―- Alienation67 lam2 0.611 19.0e+00 Powerless71 &―- Alienation71 lam3 5.382 12.0e+00 SEI &―- SES beta 0.483 12.0e+00 Alienation71 &―- Alienation67 gam1 -0.290 -10.0e+00 Alienation67 &―- SES gam2 -0.850 -4.0e-05 Alienation71 &―- SES phi 6.207 10.0e+00 SES &―& SES psi1 4.546 11.0e+00 Alienation67 &―& Alienation67 psi2 3.950 11.0e+00 Alienation71 &―& Alienation71 the11 5.450 13.0e+00 Anomia67 &―& Anomia67 the22 2.728 6.3e-12 Powerless67 &―& Powerless67 the33 4.357 12.0e+00 Anomia71 &―& Anomia71 the44 2.280 8.9e-16 Powerless71 &―& Powerless71 the13 1.630 7.2e-15 Anomia71 &―& Anomia67 thd1 2.741 5.0e-07 Education &―& Education thd2 266.397 14.0e+00 SEI &―& SEIIterations = 87Bootstrapping a Simple One-Factor Model for Ordinal Variables An advantage of working in an extensive system of statistical software is that one can leverage other capabilities of the software. In this example, facilities in the boot package (which is associated with Davison & Hinkley, 1997, and is part of the standard R distribution) are used to bootstrap a model fit by sem, and in my polycor package (a contributed package on CRAN) to compute polychoric correlations among ordinal variables.5 Indeed, the integration of the sem package with R is more generally advantageous: For example, there are several packages available for multiple imputation of missing data, and it would be a simple matter to use these with sem. The CNES data frame distributed with the sem package includes four variables from the 1997 Canadian National Election Study (CNES) meant to tap attitude toward “traditional values.” These variables are four-category Likert-type items, and appear in the data as factors (the S representation of categorical variables), with levels StronglyDisagree, Disagree, Agree, and StronglyAgree.5I am the author of the polycor package, which is distributed on the same basis as the sem package, and as R that is, as free, open-source software.482FOXThese variables originated as responses to the following statements on the mail-back component of the election study: MBSA2: “We should be more tolerant of people who choose to live according to their own standards, even if they are very different from our own.” MBSA7: “Newer lifestyles are contributing to the breakdown of our society.” MBSA8: “The world is always changing and we should adapt our view of moral behaviour to these changes.” MBSA9: “This country would have many fewer problems if there were more emphasis on traditional family values.” The hetcor function in the polycor package computes heterogeneous correlation matrices among ordinal and numeric variables: the productCmoment correlation between two numeric variables, the polychoric correlation between two factors (assumed to be properly ordered), and the point-polyserial correlation between a factor and a numeric variable. For the CNES data, for example:& data(CNES) & CNES[1:5,] # first 5 observations MBSA2 MBSA7 MBSA8 MBSA9 1 StronglyAgree Agree Disagree Disagree 2 Agree StronglyAgree StronglyDisagree StronglyAgree 3 Agree Disagree Disagree Agree 4 StronglyAgree Agree StronglyDisagree StronglyAgree 5 Agree StronglyDisagree Agree Disagree & library(polycor) & hetcor(CNES, ML=TRUE) Maximum-Likelihood Estimates Correlations/Type of Correlation: MBSA2 MBSA7 MBSA8 MBSA9 MBSA2 1 Polychoric Polychoric Polychoric MBSA7 -0.3028 1 Polychoric Polychoric MBSA8 0. 1 Polychoric MBSA9 -0.9 -0.3213 1 Standard Errors: MBSA2 MBSA7 MBSA8 MBSA2 MBSA7 0.02737 MBSA8 0.42 MBSA9 0.93 0.02742 n = 1529STRUCTURAL EQUATION MODELING IN R483P-values for Tests of Bivariate Normality: MBSA2 MBSA7 MBSA8 MBSA2 MBSA7 1.277e-07 MBSA8 1.852e-07 2.631e-23 MBSA9 5.085e-09 2.356e-10 1.500e-19By default, the hetcor function computes polychoric and polyserial correlations by a relatively quick two-step procedure (see Drasgow, 1986; Olsson, 1979); specifying the argument ML=TRUE causes hetcor to compute pairwise ML in this instance (and as is typically the case), the two procedures produce very similar results (see later), so the faster procedure was used for bootstrapping. The tests of bivariate normality, applied to the contingency table for each pair of variables, are highly statistically significant, indicating departures from binormality. Even though a nonparametric bootstrap is employed later, nonnormality suggests that it might not be appropriate to summarize the relations between the variabl on the other hand, the sample size (N = 1,529) is fairly large, making these tests quite sensitive. The hetcor function returns an object with correlations and other information, but for fitting and bootstrapping a structural equation model, only the correlation matrix is used. The following simple function (from the boot.sem help page), entered at the command prompt, does the trick:& hcor &- function(data) hetcor(data, std.err=FALSE)$correlations & R.CNES &- hcor(CNES) & R.CNES MBSA2 MBSA7 MBSA8 MBSA9 MBSA2 1....2230010 MBSA7 -0....5449886 MBSA8 0....3206524 MBSA9 -0....0000000Using sem to fit a one-factor confirmatory factor analysis model to the polychoric correlations produces these results:& model.CNES &- specify.model() 1: F -& MBSA2, lam1, NA 2: F -& MBSA7, lam2, NA 3: F -& MBSA8, lam3, NA 4: F -& MBSA9, lam4, NA 5: F &-& F, NA, 1 6: MBSA2 &-& MBSA2, the1, NA 7: MBSA7 &-& MBSA7, the2, NA 8: MBSA8 &-& MBSA8, the3, NA 9: MBSA9 &-& MBSA9, the4, NA 10: Read 9 records484FOX& sem.CNES &- sem(model.CNES, R.CNES, N=1529) & summary(sem. CNES) Model Chisquare = 33.211 Df = 2 Pr(&Chisq) = 6.1407e-08 Goodness-of-fit index = 0.98934 Adjusted goodness-of-fit index = 0.94668 RMSEA index = 0.10106 90 % CI: (0.061) BIC = 15.774 Normalized Residuals Min. 1st Qu. Median Mean 3rd Qu. Max. -1.76e-05 3.00e-02 2.08e-01 8.48e-01 1.04e+00 3.83e+00 Parameter Estimates Estimate Std Error z value Pr(&|z|) lam1 -0.901 -13.471 0 MBSA2 lam2 0.357 26.498 0 MBSA7 lam3 -0.845 -16.248 0 MBSA8 lam4 0.409 24.176 0 MBSA9 the1 0.900 25.788 0 MBSA2 the2 0.436 11.466 0 MBSA7 the3 0.887 24.472 0 MBSA8 the4 0.737 17.188 0 MBSA9 Iterations = 12&--&--&--&--&--& &--& &--& &--&F F F F MBSA2 MBSA7 MBSA8 MBSA9The model fit here isxi = λi ξ + δi , i = 1,..., 4 V ( ξ) = 1 V (δi ) = θii , i = 1,..., 4with ξ represented by F (for factor) in the sem specification of the model. Using the ML fitting criterion with polychoric correlations produces consistent estimators of the parameters of the model (e.g., Bollen, 1989, p. 443), but the standard errors of the estimators cannot be trusted. Consequently, the boot.sem function is used to compute bootstrap standard errors6:& system.time(boot.CNES &- boot.sem(CNES, sem.CNES, R=100, cov=hcor), + gcFirst=TRUE) Loading required package: boot [1] 113.16 0.08 113.77 NA NA& summary(boot.CNES, type=”norm”) Call: boot.sem(data = CNES, model = sem.CNES, R = 100, cov = hcor)6boot.sem implements the nonparametric bootstrap for an indep for more complex sampling schemes or parametric bootstrapping, use the facilities of the boot package directly.STRUCTURAL EQUATION MODELING IN R485Lower and upper limits are for the 95 percent norm confidence intervalEstimate Bias Std.Error Lower Upper lam1 -0.....3300048 lam2 0.....8428730 lam3 -0.....4119749 lam4 0.....7499619 the1 0.....8949041 the2 0.....5245034 the3 0.....8336184 the4 0.....6134359The system.time function was used to time the computation, which took 114 sec on a 3 GHz Windows XP the argument gcFirst=TRUE specifies that “garbage collection” take place just before the command is executed, producing a more accurate timing. Notice that boot.sem automatically loads the boot package. The arguments to boot.sem include the data set to be resampled (CNES), the sem object for the model (sem.CNES), the number of bootstrap replications (R=100, which should be sufficient for standard errors and normal-theory confidence intervals), and the function to be used in computing a covariance matrix from the resampled data (here, the hcor function). The bootstrap standard errors are mostly somewhat larger than the standard errors assuming multinormal numeric variables computed by sem.FURTHER DEVELOPMENT OF THE sem PACKAGE The latent variable modeling facility provided by the sem function is relatively basic compared to special-purpose structural equation software such as AMOS, EQS, LISREL, or Mplus. One possible future direction for the sem package, therefore, would be to expand capabilities in areas such as multiple-group models and alternative fitting functions. Some enhancements―for example, multiple-group models―should be relatively straightforward, whereas others―for example, Browne’s (1984) asymptotically distribution-free estimator―would likely require implementation in compiled code to achieve acceptable levels of performance. At present, the sem package is coded entirely in R, but R makes provisions for the incorporation of portable compiled code in C and Fortran. A second area in which the sem package could be improved is the user interface: It would be desirable to provide a graphical interface in which the user specifies a model via its path diagram. Currently, the path.diagram function in sem provides only the inverse facility, producing a description of the path diagram from a fitted model, which subsequently can be rendered by the graph-drawing program dot (Gansner, Koutsofios, & North, 2002). Although R provides tools for the con-486FOXstruction of graphical interfaces, making a path-drawing interface feasible, implementing such an interface would be a substantial undertaking. The specific future trajectory of the sem package, and the rapidity with which it is developed, will depend on user interest. REFERENCESBecker, R. A., Chambers, J. M., & Wilks, A. R. (1988). The new S language: A programming environment for data analysis and graphics. Pacific Grove, CA: Wadsworth. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley. Browne, M. W. (1984). Asymptotically distribution-free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62C83. Chambers, J. M. (1998). Programming with data: A guide to the S language. New York: Springer. Chambers, J. M., & Hastie, T. J. (Eds.). (1992). Statistical models in S. Pacific Grove, CA: Wadsworth. Davison, A. C., & Hinkley, D. V. (1997). Bootstrap methods and their application. Cambridge, UK: Cambridge University Press. Drasgow, F. (1986). Polychoric and polyserial correlations. In S. Kotz & N. Johnson (Eds.), The encyclopedia of statistics (Vol. 7, pp. 68C74). New York: Wiley. Fox, J. (2002). An R and S-PLUS companion to applied regression. Thousand Oaks, CA: Sage. Gansner, E., Koutsofios, E., & North, S. (2002). Drawing graphs with dot. Retrieved June 13, 2005, from http://www.graphviz.org/Documentation/dotguide.pdf Greene, W. H. (1993). Econometric analysis (2nd ed.). New York: Macmillan. Ihaka, R., & Gentleman, R. (1996). R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics, 5, 299C314. J?reskog, K. G., & S?rbom, D. (1989). LISREL 7: A guide to the program and applications (2nd ed.). Chicago: SPSS. Klein, L. (1950). Economic fluctuations in the United States . New York: Wiley. McArdle, J. J. (1980). Causal modeling applied to psychonomic systems simulation. Behavior Research Methods and Instrumentation, 12, 193C209. McArdle, J. J., & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110C133. McArdle, J. J., & McDonald, R. P. (1984). Some algebraic properties of the reticular action model. British Journal of Mathematical and Statistical Psychology, 37, 234C251. McDonald, R. P., & Hartmann, W. M. (1992). A procedure for obtaining initial values of parameters in the RAM model. Multivariate Behavioral Research, 27, 57C76. Olsson, U. (1979). Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika, 44, 443C460. R Development Core Team. (2005). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. SAS Institute. (2004). SAS 9.1.3 help and documentation. Cary, NC: Author. S?rbom, D. (1989). Model modification. Psychometrika, 54, 371C384. Venables, W. N., & Ripley, B. D. (2002). Modern applied statistics with S (4th ed.). New York: Springer. Wheaton, B., Muthén, B., Alwin, D. F., & Summers, G. F. (1977). Assessing reliability and stability in panel models. In D. R. Heise (Ed.), Sociological methodology 1977 (pp. 84C136). San Francisco: Jossey-Bass. Wilkinson, G. N., & Rogers, C. E. (1973). Symbolic description of factorial models for analysis of variance. Applied Statistics, 22, 392C399.
更多相关文档