Ephasizing conceptual understanding over mathematics, this user-friendly text introduces linear regression analysis to students and researchers across the social, behavioral, consumer, and health sciences. Coverage includes model construction and estimation, quantification and measurement of multivariate and partial associations, statistical control, group comparisons, moderation analysis, mediation and path analysis, and regression diagnostics, among other important topics. Engaging worked-through examples demonstrate each technique, accompanied by helpful advice and cautions. The use of SPSS, SAS, and STATA is emphasized, with an appendix on regression analysis using R. The companion website (www.afhayes.com) provides datasets for the book's examples as well as the RLM macro for SPSS and SAS. Pedagogical Features: *Chapters include SPSS, SAS, or STATA code pertinent to the analyses described, with each distinctively formatted for easy identification. *An appendix documents the RLM macro, which facilitates computations for estimating and probing interactions, dominance analysis, heteroscedasticity-consistent standard errors, and linear spline regression, among other analyses. *Students are guided to practice what they learn in each chapter using datasets provided online. *Addresses topics not usually covered, such as ways to measure a variable?s importance, coding systems for representing categorical variables, causation, and myths about testing interaction.
Concepts, Applications, and Implementation
Author: Richard B. Darlington,Andrew F. Hayes
Publisher: Guilford Publications
Category: Social Science
Combining a modern, data-analytic perspective with a focus on applications in the social sciences, the Third Edition of Applied Regression Analysis and Generalized Linear Models provides in-depth coverage of regression analysis, generalized linear models, and closely related methods, such as bootstrapping and missing data. Updated throughout, this Third Edition includes new chapters on mixed-effects models for hierarchical and longitudinal data. Although the text is largely accessible to readers with a modest background in statistics and mathematics, author John Fox also presents more advanced material in optional sections and chapters throughout the book.
Author: John Fox
Publisher: SAGE Publications
Category: Social Science
Praise for the Second Edition "An essential desktop reference book . . . it should definitely be on your bookshelf." —Technometrics A thoroughly updated book, Methods and Applications of Linear Models: Regression and the Analysis of Variance, Third Edition features innovative approaches to understanding and working with models and theory of linear regression. The Third Edition provides readers with the necessary theoretical concepts, which are presented using intuitive ideas rather than complicated proofs, to describe the inference that is appropriate for the methods being discussed. The book presents a unique discussion that combines coverage of mathematical theory of linear models with analysis of variance models, providing readers with a comprehensive understanding of both the theoretical and technical aspects of linear models. With a new focus on fixed effects models, Methods and Applications of Linear Models: Regression and the Analysis of Variance, Third Edition also features: Newly added topics including least squares, the cell means model, and graphical inspection of data in the AVE method Frequent conceptual and numerical examples for clarifying the statistical analyses and demonstrating potential pitfalls Graphics and computations developed using JMP® software to accompany the concepts and techniques presented Numerous exercises presented to test readers and deepen their understanding of the material An ideal book for courses on linear models and linear regression at the undergraduate and graduate levels, the Third Edition of Methods and Applications of Linear Models: Regression and the Analysis of Variance is also a valuable reference for applied statisticians and researchers who utilize linear model methodology.
Regression and the Analysis of Variance
Author: Ronald R. Hocking
Publisher: John Wiley & Sons
Modern scientific research often involves experiments with at most hundreds of subjects but with tens of thousands of variables for every subject. The challenge of high dimensionality has reshaped statistical thinking and modeling. Variable selection plays a pivotal role in the high-dimensional data analysis, and the combination of sparsity and accuracy is crucial for statistical theory and practical applications. Regularization methods are attractive for tackling these sparsity and accuracy issues. The first part of this thesis studies two regularization methods. First, we consider the orthogonal greedy algorithm (OGA) used in conjunction with a high-dimensional information criterion introduced by Ing& Lai (2011). Although it has been shown to have excellent performance for weakly sparse regression models, one does not know a priori in practice that the actual model is weakly sparse, and we address this problem by developing a new cross-validation approach. OGA can be viewed as L0 regularization for weakly sparse regression models. When such sparsity fails, as revealed by the cross-validation analysis, we propose to use a new way to combine L1 and L2 penalties, which we show to have important advantages over previous regularization methods. The second part of the thesis develops a Monte Carlo Cross-Validation (MCCV) method to estimate the distribution of out-of-sample prediction errors when a training sample is used to build a regression model for prediction. Asymptotic theory and simulation studies show that the proposed MCCV method mimics the actual (but unknown) prediction error distribution even when the number of regressors exceeds the sample size. Therefore MCCV provides a useful tool for comparing the predictive performance of different regularization methods for real (rather than simulated) data sets.
Publisher: Stanford University
Facts101 is your complete guide to Applied Regression Analysis and Generalized Linear Models. In this book, you will learn topics such as as those in your book plus much more. With key features such as key terms, people and places, Facts101 gives you all the information you need to prepare for your next exam. Our practice tests are specific to the textbook and we have designed tools to make the most of your limited study time.
Author: CTI Reviews
Publisher: Cram101 Textbook Reviews
A comprehensive and timely edition on an emerging new trend in time series Linear Models and Time-Series Analysis: Regression, ANOVA, ARMA and GARCH sets a strong foundation, in terms of distribution theory, for the linear model (regression and ANOVA), univariate time series analysis (ARMAX and GARCH), and some multivariate models associated primarily with modeling financial asset returns (copula-based structures and the discrete mixed normal and Laplace). It builds on the author's previous book, Fundamental Statistical Inference: A Computational Approach, which introduced the major concepts of statistical inference. Attention is explicitly paid to application and numeric computation, with examples of Matlab code throughout. The code offers a framework for discussion and illustration of numerics, and shows the mapping from theory to computation. The topic of time series analysis is on firm footing, with numerous textbooks and research journals dedicated to it. With respect to the subject/technology, many chapters in Linear Models and Time-Series Analysis cover firmly entrenched topics (regression and ARMA). Several others are dedicated to very modern methods, as used in empirical finance, asset pricing, risk management, and portfolio optimization, in order to address the severe change in performance of many pension funds, and changes in how fund managers work. Covers traditional time series analysis with new guidelines Provides access to cutting edge topics that are at the forefront of financial econometrics and industry Includes latest developments and topics such as financial returns data, notably also in a multivariate context Written by a leading expert in time series analysis Extensively classroom tested Includes a tutorial on SAS Supplemented with a companion website containing numerous Matlab programs Solutions to most exercises are provided in the book Linear Models and Time-Series Analysis: Regression, ANOVA, ARMA and GARCH is suitable for advanced masters students in statistics and quantitative finance, as well as doctoral students in economics and finance. It is also useful for quantitative financial practitioners in large financial institutions and smaller finance outlets.
Regression, ANOVA, ARMA and GARCH
Author: Marc S. Paolella
Wiley-Interscience Paperback Series The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. "The authors have put together an extraordinary presentation of concepts and methods concerning the use and analysis of nonlinear regression models . . . highly recommend[ed] . . . for anyone needing to use and/or understand issues concerning the analysis of nonlinear regression models." —Technometrics "[This book] provides a good balance of relevant theory and application with many examples . . . [and it] provides the most balanced approach to theory and application appropriate for a first course in nonlinear regression modeling for graduate statistics students." —Mathematical Reviews "[This book] joins a distinguished list of publications with a reputation for balancing technical rigor with readability, and theory with application. [It] upholds tradition . . . [and is] a worthwhile reference for the marketing researcher with a serious interest in linear models." —Journal of Marketing Research This book offers a balanced presentation of the theoretical, practical, and computational aspects of nonlinear regression and provides background material on linear regression, including the geometrical development for linear and nonlinear least squares. The authors employ real data sets throughout, and their extensive use of geometric constructs and continuing examples makes the progression of ideas appear very natural. The book also includes pseudocode for computing algorithms.
Author: Douglas M. Bates,Donald G. Watts
Author: Richard B. Darlington
Publisher: McGraw-Hill College
Praise for the Fourth Edition "As with previous editions, the authors have produced a leadingtextbook on regression." —Journal of the American Statistical Association A comprehensive and up-to-date introduction to thefundamentals of regression analysis Introduction to Linear Regression Analysis, Fifth Editioncontinues to present both the conventional and less common uses oflinear regression in today’s cutting-edge scientificresearch. The authors blend both theory and application to equipreaders with an understanding of the basic principles needed toapply regression model-building techniques in various fields ofstudy, including engineering, management, and the healthsciences. Following a general introduction to regression modeling,including typical applications, a host of technical tools areoutlined such as basic inference procedures, introductory aspectsof model adequacy checking, and polynomial regression models andtheir variations. The book then discusses how transformations andweighted least squares can be used to resolve problems of modelinadequacy and also how to deal with influential observations. TheFifth Edition features numerous newly added topics,including: A chapter on regression analysis of time series data thatpresents the Durbin-Watson test and other techniques for detectingautocorrelation as well as parameter estimation in time seriesregression models Regression models with random effects in addition to adiscussion on subsampling and the importance of the mixedmodel Tests on individual regression coefficients and subsets ofcoefficients Examples of current uses of simple linear regression models andthe use of multiple regression models for understanding patientsatisfaction data. In addition to Minitab, SAS, and S-PLUS, the authors haveincorporated JMP and the freely available R software to illustratethe discussed techniques and procedures in this new edition.Numerous exercises have been added throughout, allowing readers totest their understanding of the material. Introduction to Linear Regression Analysis, Fifth Editionis an excellent book for statistics and engineering courses onregression at the upper-undergraduate and graduate levels. The bookalso serves as a valuable, robust resource for professionals in thefields of engineering, life and biological sciences, and the socialsciences.
Author: Douglas C. Montgomery,Elizabeth A. Peck,G. Geoffrey Vining
Publisher: John Wiley & Sons
This volume presents in detail the fundamental theories of linear regression analysis and diagnosis, as well as the relevant statistical computing techniques so that readers are able to actually model the data using the methods and techniques described in the book. It covers the fundamental theories in linear regression analysis and is extremely useful for future research in this area. The examples of regression analysis using the Statistical Application System (SAS) are also included. This book is suitable for graduate students who are either majoring in statistics/biostatistics or using linear regression analysis substantially in their subject fields.
Theory and Computing
Author: Xin Yan
Publisher: World Scientific
Praise for the First Edition "The obvious enthusiasm of Myers, Montgomery, and Vining and their reliance on their many examples as a major focus of their pedagogy make Generalized Linear Models a joy to read. Every statistician working in any area of applied science should buy it and experience the excitement of these new approaches to familiar activities." —Technometrics Generalized Linear Models: With Applications in Engineering and the Sciences, Second Edition continues to provide a clear introduction to the theoretical foundations and key applications of generalized linear models (GLMs). Maintaining the same nontechnical approach as its predecessor, this update has been thoroughly extended to include the latest developments, relevant computational approaches, and modern examples from the fields of engineering and physical sciences. This new edition maintains its accessible approach to the topic by reviewing the various types of problems that support the use of GLMs and providing an overview of the basic, related concepts such as multiple linear regression, nonlinear regression, least squares, and the maximum likelihood estimation procedure. Incorporating the latest developments, new features of this Second Edition include: A new chapter on random effects and designs for GLMs A thoroughly revised chapter on logistic and Poisson regression, now with additional results on goodness of fit testing, nominal and ordinal responses, and overdispersion A new emphasis on GLM design, with added sections on designs for regression models and optimal designs for nonlinear regression models Expanded discussion of weighted least squares, including examples that illustrate how to estimate the weights Illustrations of R code to perform GLM analysis The authors demonstrate the diverse applications of GLMs through numerous examples, from classical applications in the fields of biology and biopharmaceuticals to more modern examples related to engineering and quality assurance. The Second Edition has been designed to demonstrate the growing computational nature of GLMs, as SAS®, Minitab®, JMP®, and R software packages are used throughout the book to demonstrate fitting and analysis of generalized linear models, perform inference, and conduct diagnostic checking. Numerous figures and screen shots illustrating computer output are provided, and a related FTP site houses supplementary material, including computer commands and additional data sets. Generalized Linear Models, Second Edition is an excellent book for courses on regression analysis and regression modeling at the upper-undergraduate and graduate level. It also serves as a valuable reference for engineers, scientists, and statisticians who must understand and apply GLMs in their work.
with Applications in Engineering and the Sciences
Author: Raymond H. Myers,Douglas C. Montgomery,G. Geoffrey Vining,Timothy J. Robinson
Publisher: John Wiley & Sons
An R Companion to Applied Regression is a broad introduction to the R statistical computing environment in the context of applied regression analysis. John Fox and Sanford Weisberg provide a step-by-step guide to using the free statistical software R, an emphasis on integrating statistical computing in R with the practice of data analysis, coverage of generalized linear models, and substantial web-based support materials. The Third Edition includes a new chapter on mixed-effects models, new and updated data sets, and a de-emphasis on statistical programming, while retaining a general introduction to basic R programming. The authors have substantially updated both the car and effects packages for R for this new edition, and include coverage of RStudio and R Markdown.
Author: John Fox,Sanford Weisberg
Publisher: SAGE Publications
Category: Social Science
In Correlation and Regression Analysis: A Historian's Guide Thomas J. Archdeacon provides historians with a practical introduction to the use of correlation and regression analysis. The book concentrates on the kinds of analysis that form the broad range of statistical methods used in the social sciences. It enables historians to understand and to evaluate critically the quantitative analyses that they are likely to encounter in journal literature and monographs reporting research findings in the social sciences. Without attempting to be a text in basic statistics, the book provides enough background information to allow readers to grasp the essentials of correlation and regression. Correlation analysis refers to the measurement of association between or among variables, and regression analysis focuses primarily on the use of linear models to predict changes in the value taken by one variable in terms of changes in the values of a set of explanatory variables. The book also discusses diagnostic methods for identifying shortcomings in regression models, the use of regression to analyze causation, and the application of regression and related procedures to the study of problems containing categorical as well as numerical data. Archdeacon asserts that knowing how statistical procedures are computed can clarify the theoretical structures underlying them and is essential for recognizing the conditions under which their use is appropriate. The book does not shy away from the mathematics of statistical analysis; but Archdeacon presents concepts carefully and explains the operation of equations step by step. Unlike many works in the field, the book does not assume that readers have mathematical training beyond basic algebra and geometry. In the hope of promoting the role of quantitative analysis in his discipline, Archdeacon discusses the theory and methods behind the most important interpretive paradigm for quantitative research in the social sciences. Correlation and Regression Analysis introduces statistical techniques that are indispensable to historians and enhances the presentation of them with practical examples from scholarly works.
A Historian's Guide
Author: Thomas J. Archdeacon
Publisher: Univ of Wisconsin Press
This book is about the coordinate-free, or geometric, approach to the theory of linear models; more precisely, Model I ANOVA and linear regression models with non-random predictors in a finite-dimensional setting. This approach is more insightful, more elegant, more direct, and simpler than the more common matrix approach to linear regression, analysis of variance, and analysis of covariance models in statistics. The book discusses the intuition behind and optimal properties of various methods of estimating and testing hypotheses about unknown parameters in the models. Topics covered range from linear algebra, such as inner product spaces, orthogonal projections, book orthogonal spaces, Tjur experimental designs, basic distribution theory, the geometric version of the Gauss-Markov theorem, optimal and non-optimal properties of Gauss-Markov, Bayes, and shrinkage estimators under assumption of normality, the optimal properties of F-test, and the analysis of covariance and missing observations.
Author: Michael J. Wichura
Publisher: Cambridge University Press
In recent years, there has been a great deal of interest and activity in the general area of nonparametric smoothing in statistics. This monograph concentrates on the roughness penalty method and shows how this technique provides a unifying approach to a wide range of smoothing problems. The method allows parametric assumptions to be realized in regression problems, in those approached by generalized linear modelling, and in many other contexts. The emphasis throughout is methodological rather than theoretical, and it concentrates on statistical and computation issues. Real data examples are used to illustrate the various methods and to compare them with standard parametric approaches. Some publicly available software is also discussed. The mathematical treatment is self-contained and depends mainly on simple linear algebra and calculus. This monograph will be useful both as a reference work for research and applied statisticians and as a text for graduate students and other encountering the material for the first time.
A roughness penalty approach
Author: P.J. Green,Bernard. W. Silverman
Publisher: CRC Press
The essential introduction to the theory and application of linear models—now in a valuable new edition Since most advanced statistical tools are generalizations of the linear model, it is neces-sary to first master the linear model in order to move forward to more advanced concepts. The linear model remains the main tool of the applied statistician and is central to the training of any statistician regardless of whether the focus is applied or theoretical. This completely revised and updated new edition successfully develops the basic theory of linear models for regression, analysis of variance, analysis of covariance, and linear mixed models. Recent advances in the methodology related to linear mixed models, generalized linear models, and the Bayesian linear model are also addressed. Linear Models in Statistics, Second Edition includes full coverage of advanced topics, such as mixed and generalized linear models, Bayesian linear models, two-way models with empty cells, geometry of least squares, vector-matrix calculus, simultaneous inference, and logistic and nonlinear regression. Algebraic, geometrical, frequentist, and Bayesian approaches to both the inference of linear models and the analysis of variance are also illustrated. Through the expansion of relevant material and the inclusion of the latest technological developments in the field, this book provides readers with the theoretical foundation to correctly interpret computer software output as well as effectively use, customize, and understand linear models. This modern Second Edition features: New chapters on Bayesian linear models as well as random and mixed linear models Expanded discussion of two-way models with empty cells Additional sections on the geometry of least squares Updated coverage of simultaneous inference The book is complemented with easy-to-read proofs, real data sets, and an extensive bibliography. A thorough review of the requisite matrix algebra has been addedfor transitional purposes, and numerous theoretical and applied problems have been incorporated with selected answers provided at the end of the book. A related Web site includes additional data sets and SAS® code for all numerical examples. Linear Model in Statistics, Second Edition is a must-have book for courses in statistics, biostatistics, and mathematics at the upper-undergraduate and graduate levels. It is also an invaluable reference for researchers who need to gain a better understanding of regression and analysis of variance.
Author: Alvin C. Rencher,G. Bruce Schaalje
Publisher: John Wiley & Sons
In dem Band beschreiben die Autoren erstmals klassische Regressionsansätze und moderne nicht- und semiparametrische Methoden in einer integrierten und anwendungsorientierten Form. Um Lesern die Analyse eigener Fragestellungen zu ermöglichen, demonstrieren sie die praktische Anwendung der Konzepte und Methoden anhand ausführlicher Fallstudien. Geeignet für Studierende der Statistik sowie für Wissenschaftler und Praktiker, zum Beispiel in den Wirtschafts- und Sozialwissenschaften, der Bioinformatik und -statistik, Ökonometrie und Epidemiologie.
Modelle, Methoden und Anwendungen
Author: Ludwig Fahrmeir,Thomas Kneib,Stefan Lang
Category: Business & Economics