Regression Analysis and Linear Models

Concepts, Applications, and Implementation

Author: Richard B. Darlington,Andrew F. Hayes

Publisher: Guilford Publications

ISBN: 1462521134

Category: Social Science

Page: 661

View: 2419

Ephasizing conceptual understanding over mathematics, this user-friendly text introduces linear regression analysis to students and researchers across the social, behavioral, consumer, and health sciences. Coverage includes model construction and estimation, quantification and measurement of multivariate and partial associations, statistical control, group comparisons, moderation analysis, mediation and path analysis, and regression diagnostics, among other important topics. Engaging worked-through examples demonstrate each technique, accompanied by helpful advice and cautions. The use of SPSS, SAS, and STATA is emphasized, with an appendix on regression analysis using R. The companion website (www.afhayes.com) provides datasets for the book's examples as well as the RLM macro for SPSS and SAS. Pedagogical Features: *Chapters include SPSS, SAS, or STATA code pertinent to the analyses described, with each distinctively formatted for easy identification. *An appendix documents the RLM macro, which facilitates computations for estimating and probing interactions, dominance analysis, heteroscedasticity-consistent standard errors, and linear spline regression, among other analyses. *Students are guided to practice what they learn in each chapter using datasets provided online. *Addresses topics not usually covered, such as ways to measure a variable?s importance, coding systems for representing categorical variables, causation, and myths about testing interaction.
Posted in Social Science

Applied Regression Analysis and Generalized Linear Models

Author: John Fox

Publisher: SAGE Publications

ISBN: 1483321312

Category: Social Science

Page: 816

View: 6255

Combining a modern, data-analytic perspective with a focus on applications in the social sciences, the Third Edition of Applied Regression Analysis and Generalized Linear Models provides in-depth coverage of regression analysis, generalized linear models, and closely related methods, such as bootstrapping and missing data. Updated throughout, this Third Edition includes new chapters on mixed-effects models for hierarchical and longitudinal data. Although the text is largely accessible to readers with a modest background in statistics and mathematics, author John Fox also presents more advanced material in optional sections and chapters throughout the book.
Posted in Social Science

Applied Regression Analysis, Linear Models, and Related Methods

Author: John Fox

Publisher: SAGE

ISBN: 9780803945401

Category: Social Science

Page: 597

View: 2062

An accessible, detailed, and up-to-date treatment of regression analysis, linear models, and closely related methods is provided in this book. Incorporating nearly 200 graphs and numerous examples and exercises that employ real data from the social sciences, the book begins with a consideration of the role of statistical data analysis in social research. It then moves on to cover the following topics: graphical methods for examining and transforming data; linear least-squares regression; dummy-variables regression; analysis of variance; diagnostic methods for discovering whether a linear model fit to data adequately represents the data; extensions to linear least squares, including logit and probit models, time-series regression, nonlinear
Posted in Social Science

Methods and Applications of Linear Models

Regression and the Analysis of Variance

Author: Ronald R. Hocking

Publisher: John Wiley & Sons

ISBN: 1118593022

Category: Mathematics

Page: 720

View: 3699

Praise for the Second Edition "An essential desktop reference book . . . it should definitely be on your bookshelf." —Technometrics A thoroughly updated book, Methods and Applications of Linear Models: Regression and the Analysis of Variance, Third Edition features innovative approaches to understanding and working with models and theory of linear regression. The Third Edition provides readers with the necessary theoretical concepts, which are presented using intuitive ideas rather than complicated proofs, to describe the inference that is appropriate for the methods being discussed. The book presents a unique discussion that combines coverage of mathematical theory of linear models with analysis of variance models, providing readers with a comprehensive understanding of both the theoretical and technical aspects of linear models. With a new focus on fixed effects models, Methods and Applications of Linear Models: Regression and the Analysis of Variance, Third Edition also features: Newly added topics including least squares, the cell means model, and graphical inspection of data in the AVE method Frequent conceptual and numerical examples for clarifying the statistical analyses and demonstrating potential pitfalls Graphics and computations developed using JMP® software to accompany the concepts and techniques presented Numerous exercises presented to test readers and deepen their understanding of the material An ideal book for courses on linear models and linear regression at the undergraduate and graduate levels, the Third Edition of Methods and Applications of Linear Models: Regression and the Analysis of Variance is also a valuable reference for applied statisticians and researchers who utilize linear model methodology.
Posted in Mathematics

Regression Modeling Strategies

With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis

Author: Frank Harrell

Publisher: Springer

ISBN: 3319194259

Category: Mathematics

Page: 582

View: 7294

This highly anticipated second edition features new chapters and sections, 225 new references, and comprehensive R software. In keeping with the previous edition, this book is about the art and science of data analysis and predictive modeling, which entails choosing and using multiple tools. Instead of presenting isolated techniques, this text emphasizes problem solving strategies that address the many issues arising when developing multivariable models using real data and not standard textbook examples. It includes imputation methods for dealing with missing data effectively, methods for fitting nonlinear relationships and for making the estimation of transformations a formal part of the modeling process, methods for dealing with "too many variables to analyze and not enough observations," and powerful model validation techniques based on the bootstrap. The reader will gain a keen understanding of predictive accuracy and the harm of categorizing continuous predictors or outcomes. This text realistically deals with model uncertainty and its effects on inference, to achieve "safe data mining." It also presents many graphical methods for communicating complex regression models to non-statisticians. Regression Modeling Strategies presents full-scale case studies of non-trivial datasets instead of over-simplified illustrations of each method. These case studies use freely available R functions that make the multiple imputation, model building, validation and interpretation tasks described in the book relatively easy to do. Most of the methods in this text apply to all regression models, but special emphasis is given to multiple regression using generalized least squares for longitudinal data, the binary logistic model, models for ordinal responses, parametric survival regression models and the Cox semi parametric survival model. A new emphasis is given to the robust analysis of continuous dependent variables using ordinal regression. As in the first edition, this text is intended for Masters' or Ph.D. level graduate students who have had a general introductory probability and statistics course and who are well versed in ordinary multiple regression and intermediate algebra. The book will also serve as a reference for data analysts and statistical methodologists, as it contains an up-to-date survey and bibliography of modern statistical modeling techniques. Examples used in the text mostly come from biomedical research, but the methods are applicable anywhere predictive models ("analytics") are useful, including economics, epidemiology, sociology, psychology, engineering and marketing.
Posted in Mathematics

Linear Models with R, Second Edition

Author: Julian J. Faraway

Publisher: CRC Press

ISBN: 1439887349

Category: Mathematics

Page: 286

View: 3876

A Hands-On Way to Learning Data Analysis Part of the core of statistics, linear models are used to make predictions and explain the relationship between the response and the predictors. Understanding linear models is crucial to a broader competence in the practice of statistics. Linear Models with R, Second Edition explains how to use linear models in physical science, engineering, social science, and business applications. The book incorporates several improvements that reflect how the world of R has greatly expanded since the publication of the first edition. New to the Second Edition Reorganized material on interpreting linear models, which distinguishes the main applications of prediction and explanation and introduces elementary notions of causality Additional topics, including QR decomposition, splines, additive models, Lasso, multiple imputation, and false discovery rates Extensive use of the ggplot2 graphics package in addition to base graphics Like its widely praised, best-selling predecessor, this edition combines statistics and R to seamlessly give a coherent exposition of the practice of linear modeling. The text offers up-to-date insight on essential data analysis topics, from estimation, inference, and prediction to missing data, factorial models, and block designs. Numerous examples illustrate how to apply the different methods using R.
Posted in Mathematics

Regression

Linear Models in Statistics

Author: N. H. Bingham,John M. Fry

Publisher: Springer Science & Business Media

ISBN: 9781848829695

Category: Mathematics

Page: 284

View: 7766

Regression is the branch of Statistics in which a dependent variable of interest is modelled as a linear combination of one or more predictor variables, together with a random error. The subject is inherently two- or higher- dimensional, thus an understanding of Statistics in one dimension is essential. Regression: Linear Models in Statistics fills the gap between introductory statistical theory and more specialist sources of information. In doing so, it provides the reader with a number of worked examples, and exercises with full solutions. The book begins with simple linear regression (one predictor variable), and analysis of variance (ANOVA), and then further explores the area through inclusion of topics such as multiple linear regression (several predictor variables) and analysis of covariance (ANCOVA). The book concludes with special topics such as non-parametric regression and mixed models, time series, spatial processes and design of experiments. Aimed at 2nd and 3rd year undergraduates studying Statistics, Regression: Linear Models in Statistics requires a basic knowledge of (one-dimensional) Statistics, as well as Probability and standard Linear Algebra. Possible companions include John Haigh’s Probability Models, and T. S. Blyth & E.F. Robertsons’ Basic Linear Algebra and Further Linear Algebra.
Posted in Mathematics

Linear Models in Statistics

Author: Alvin C. Rencher,G. Bruce Schaalje

Publisher: John Wiley & Sons

ISBN: 0470192607

Category: Mathematics

Page: 688

View: 1322

The essential introduction to the theory and application of linear models—now in a valuable new edition Since most advanced statistical tools are generalizations of the linear model, it is neces-sary to first master the linear model in order to move forward to more advanced concepts. The linear model remains the main tool of the applied statistician and is central to the training of any statistician regardless of whether the focus is applied or theoretical. This completely revised and updated new edition successfully develops the basic theory of linear models for regression, analysis of variance, analysis of covariance, and linear mixed models. Recent advances in the methodology related to linear mixed models, generalized linear models, and the Bayesian linear model are also addressed. Linear Models in Statistics, Second Edition includes full coverage of advanced topics, such as mixed and generalized linear models, Bayesian linear models, two-way models with empty cells, geometry of least squares, vector-matrix calculus, simultaneous inference, and logistic and nonlinear regression. Algebraic, geometrical, frequentist, and Bayesian approaches to both the inference of linear models and the analysis of variance are also illustrated. Through the expansion of relevant material and the inclusion of the latest technological developments in the field, this book provides readers with the theoretical foundation to correctly interpret computer software output as well as effectively use, customize, and understand linear models. This modern Second Edition features: New chapters on Bayesian linear models as well as random and mixed linear models Expanded discussion of two-way models with empty cells Additional sections on the geometry of least squares Updated coverage of simultaneous inference The book is complemented with easy-to-read proofs, real data sets, and an extensive bibliography. A thorough review of the requisite matrix algebra has been addedfor transitional purposes, and numerous theoretical and applied problems have been incorporated with selected answers provided at the end of the book. A related Web site includes additional data sets and SAS® code for all numerical examples. Linear Model in Statistics, Second Edition is a must-have book for courses in statistics, biostatistics, and mathematics at the upper-undergraduate and graduate levels. It is also an invaluable reference for researchers who need to gain a better understanding of regression and analysis of variance.
Posted in Mathematics

Regression Analysis and Linear Models

Author: Graham Molloy

Publisher: N.A

ISBN: 9781635497052

Category: Mathematics

Page: 243

View: 6272

As a part of statistical modeling, regression analysis is the process and technique of understanding the relationship between dependent and independent variables. It is used in forecasting and prediction. The models used to understand and build relationships, using the linear predictor function, is known as linear models. The different models that come under this vast field are hierarchical linear model, general linear model, generalized linear model, etc. This book presents the complex subject of regression analysis and linear models, in the most comprehensible and easy to understand language. Such selected concepts that redefine the subject have been presented herein. Those with an interest in the field of regression analysis and linear models would find this textbook helpful.
Posted in Mathematics

Regression and Linear Models

Author: Richard B. Darlington

Publisher: McGraw-Hill College

ISBN: N.A

Category: Mathematics

Page: 542

View: 936

Posted in Mathematics

Applied Regression Analysis

Author: Norman R. Draper,Harry Smith

Publisher: John Wiley & Sons

ISBN: 1118625684

Category: Mathematics

Page: 736

View: 2577

An outstanding introduction to the fundamentals of regression analysis-updated and expanded The methods of regression analysis are the most widely used statistical tools for discovering the relationships among variables. This classic text, with its emphasis on clear, thorough presentation of concepts and applications, offers a complete, easily accessible introduction to the fundamentals of regression analysis. Assuming only a basic knowledge of elementary statistics, Applied Regression Analysis, Third Edition focuses on the fitting and checking of both linear and nonlinear regression models, using small and large data sets, with pocket calculators or computers. This Third Edition features separate chapters on multicollinearity, generalized linear models, mixture ingredients, geometry of regression, robust regression, and resampling procedures. Extensive support materials include sets of carefully designed exercises with full or partial solutions and a series of true/false questions with answers. All data sets used in both the text and the exercises can be found on the companion disk at the back of the book. For analysts, researchers, and students in university, industrial, and government courses on regression, this text is an excellent introduction to the subject and an efficient means of learning how to use a valuable analytical tool. It will also prove an invaluable reference resource for applied scientists and statisticians.
Posted in Mathematics

Statistical Regression and Classification

From Linear Models to Machine Learning

Author: Norman Matloff

Publisher: CRC Press

ISBN: 1351645897

Category: Business & Economics

Page: 490

View: 6267

Statistical Regression and Classification: From Linear Models to Machine Learning takes an innovative look at the traditional statistical regression course, presenting a contemporary treatment in line with today's applications and users. The text takes a modern look at regression: * A thorough treatment of classical linear and generalized linear models, supplemented with introductory material on machine learning methods. * Since classification is the focus of many contemporary applications, the book covers this topic in detail, especially the multiclass case. * In view of the voluminous nature of many modern datasets, there is a chapter on Big Data. * Has special Mathematical and Computational Complements sections at ends of chapters, and exercises are partitioned into Data, Math and Complements problems. * Instructors can tailor coverage for specific audiences such as majors in Statistics, Computer Science, or Economics. * More than 75 examples using real data. The book treats classical regression methods in an innovative, contemporary manner. Though some statistical learning methods are introduced, the primary methodology used is linear and generalized linear parametric models, covering both the Description and Prediction goals of regression methods. The author is just as interested in Description applications of regression, such as measuring the gender wage gap in Silicon Valley, as in forecasting tomorrow's demand for bike rentals. An entire chapter is devoted to measuring such effects, including discussion of Simpson's Paradox, multiple inference, and causation issues. Similarly, there is an entire chapter of parametric model fit, making use of both residual analysis and assessment via nonparametric analysis. Norman Matloff is a professor of computer science at the University of California, Davis, and was a founder of the Statistics Department at that institution. His current research focus is on recommender systems, and applications of regression methods to small area estimation and bias reduction in observational studies. He is on the editorial boards of the Journal of Statistical Computation and the R Journal. An award-winning teacher, he is the author of The Art of R Programming and Parallel Computation in Data Science: With Examples in R, C++ and CUDA.
Posted in Business & Economics

Regression & Linear Modeling

Best Practices and Modern Methods

Author: Jason W. Osborne

Publisher: SAGE Publications

ISBN: 1506302785

Category: Psychology

Page: 488

View: 8052

In a conversational tone, Regression & Linear Modeling provides conceptual, user-friendly coverage of the generalized linear model (GLM). Readers will become familiar with applications of ordinary least squares (OLS) regression, binary and multinomial logistic regression, ordinal regression, Poisson regression, and loglinear models. Author Jason W. Osborne returns to certain themes throughout the text, such as testing assumptions, examining data quality, and, where appropriate, nonlinear and non-additive effects modeled within different types of linear models.
Posted in Psychology

Data Analysis Using Regression and Multilevel/Hierarchical Models

Author: Andrew Gelman,Jennifer Hill

Publisher: Cambridge University Press

ISBN: 9780521686891

Category: Mathematics

Page: 625

View: 3317

This book, first published in 2007, is for the applied researcher performing data analysis using linear and nonlinear regression and multilevel models.
Posted in Mathematics

Cross-validation and Regression Analysis in High-dimensional Sparse Linear Models

Author: N.A

Publisher: Stanford University

ISBN: N.A

Category:

Page: N.A

View: 5962

Modern scientific research often involves experiments with at most hundreds of subjects but with tens of thousands of variables for every subject. The challenge of high dimensionality has reshaped statistical thinking and modeling. Variable selection plays a pivotal role in the high-dimensional data analysis, and the combination of sparsity and accuracy is crucial for statistical theory and practical applications. Regularization methods are attractive for tackling these sparsity and accuracy issues. The first part of this thesis studies two regularization methods. First, we consider the orthogonal greedy algorithm (OGA) used in conjunction with a high-dimensional information criterion introduced by Ing& Lai (2011). Although it has been shown to have excellent performance for weakly sparse regression models, one does not know a priori in practice that the actual model is weakly sparse, and we address this problem by developing a new cross-validation approach. OGA can be viewed as L0 regularization for weakly sparse regression models. When such sparsity fails, as revealed by the cross-validation analysis, we propose to use a new way to combine L1 and L2 penalties, which we show to have important advantages over previous regularization methods. The second part of the thesis develops a Monte Carlo Cross-Validation (MCCV) method to estimate the distribution of out-of-sample prediction errors when a training sample is used to build a regression model for prediction. Asymptotic theory and simulation studies show that the proposed MCCV method mimics the actual (but unknown) prediction error distribution even when the number of regressors exceeds the sample size. Therefore MCCV provides a useful tool for comparing the predictive performance of different regularization methods for real (rather than simulated) data sets.
Posted in

Regression

Models, Methods and Applications

Author: Ludwig Fahrmeir,Thomas Kneib,Stefan Lang,Brian Marx

Publisher: Springer Science & Business Media

ISBN: 3642343333

Category: Business & Economics

Page: 698

View: 5282

The aim of this book is an applied and unified introduction into parametric, non- and semiparametric regression that closes the gap between theory and application. The most important models and methods in regression are presented on a solid formal basis, and their appropriate application is shown through many real data examples and case studies. Availability of (user-friendly) software has been a major criterion for the methods selected and presented. Thus, the book primarily targets an audience that includes students, teachers and practitioners in social, economic, and life sciences, as well as students and teachers in statistics programs, and mathematicians and computer scientists with interests in statistical modeling and data analysis. It is written on an intermediate mathematical level and assumes only knowledge of basic probability, calculus, and statistics. The most important definitions and statements are concisely summarized in boxes. Two appendices describe required matrix algebra, as well as elements of probability calculus and statistical inference.
Posted in Business & Economics

Statistical Methods for Communication Science

Author: Andrew F. Hayes

Publisher: Routledge

ISBN: 1135250898

Category: Language Arts & Disciplines

Page: 536

View: 3468

Statistical Methods for Communication Science is the only statistical methods volume currently available that focuses exclusively on statistics in communication research. Writing in a straightforward, personal style, author Andrew F. Hayes offers this accessible and thorough introduction to statistical methods, starting with the fundamentals of measurement and moving on to discuss such key topics as sampling procedures, probability, reliability, hypothesis testing, simple correlation and regression, and analyses of variance and covariance. Hayes takes readers through each topic with clear explanations and illustrations. He provides a multitude of examples, all set in the context of communication research, thus engaging readers directly and helping them to see the relevance and importance of statistics to the field of communication. Highlights of this text include: *thorough and balanced coverage of topics; *integration of classical methods with modern "resampling" approaches to inference; *consideration of practical, "real world" issues; *numerous examples and applications, all drawn from communication research; *up-to-date information, with examples justifying use of various techniques; and *a CD with macros, data sets, figures, and additional materials. This unique book can be used as a stand-alone classroom text, a supplement to traditional research methods texts, or a useful reference manual. It will be invaluable to students, faculty, researchers, and practitioners in communication, and it will serve to advance the understanding and use of statistical methods throughout the discipline.
Posted in Language Arts & Disciplines

Nonlinear Regression Analysis and Its Applications

Author: Douglas M. Bates,Donald G. Watts

Publisher: Wiley-Interscience

ISBN: 9780470139004

Category: Mathematics

Page: 392

View: 3177

Wiley-Interscience Paperback Series The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. "The authors have put together an extraordinary presentation of concepts and methods concerning the use and analysis of nonlinear regression models . . . highly recommend[ed] . . . for anyone needing to use and/or understand issues concerning the analysis of nonlinear regression models." —Technometrics "[This book] provides a good balance of relevant theory and application with many examples . . . [and it] provides the most balanced approach to theory and application appropriate for a first course in nonlinear regression modeling for graduate statistics students." —Mathematical Reviews "[This book] joins a distinguished list of publications with a reputation for balancing technical rigor with readability, and theory with application. [It] upholds tradition . . . [and is] a worthwhile reference for the marketing researcher with a serious interest in linear models." —Journal of Marketing Research This book offers a balanced presentation of the theoretical, practical, and computational aspects of nonlinear regression and provides background material on linear regression, including the geometrical development for linear and nonlinear least squares. The authors employ real data sets throughout, and their extensive use of geometric constructs and continuing examples makes the progression of ideas appear very natural. The book also includes pseudocode for computing algorithms.
Posted in Mathematics

Linear Regression Analysis

Theory and Computing

Author: Xin Yan

Publisher: World Scientific

ISBN: 9812834117

Category: Mathematics

Page: 348

View: 2516

This volume presents in detail the fundamental theories of linear regression analysis and diagnosis, as well as the relevant statistical computing techniques so that readers are able to actually model the data using the methods and techniques described in the book. It covers the fundamental theories in linear regression analysis and is extremely useful for future research in this area. The examples of regression analysis using the Statistical Application System (SAS) are also included. This book is suitable for graduate students who are either majoring in statistics/biostatistics or using linear regression analysis substantially in their subject fields.
Posted in Mathematics

Introduction to Mediation, Moderation, and Conditional Process Analysis, Second Edition

A Regression-Based Approach

Author: Andrew F. Hayes

Publisher: Guilford Publications

ISBN: 146253466X

Category: Social Science

Page: 692

View: 537

Lauded for its easy-to-understand, conversational discussion of the fundamentals of mediation, moderation, and conditional process analysis, this book has been fully revised with 50% new content, including sections on working with multicategorical antecedent variables, the use of PROCESS version 3 for SPSS and SAS for model estimation, and annotated PROCESS v3 outputs. Using the principles of ordinary least squares regression, Andrew F. Hayes carefully explains procedures for testing hypotheses about the conditions under and the mechanisms by which causal effects operate, as well as the moderation of such mechanisms. Hayes shows how to estimate and interpret direct, indirect, and conditional effects; probe and visualize interactions; test questions about moderated mediation; and report different types of analyses. Data for all the examples are available on the companion website (www.afhayes.com), along with links to download PROCESS. New to This Edition *Chapters on using each type of analysis with multicategorical antecedent variables. *Example analyses using PROCESS v3, with annotated outputs throughout the book. *More tips and advice, including new or revised discussions of formally testing moderation of a mechanism using the index of moderated mediation; effect size in mediation analysis; comparing conditional effects in models with more than one moderator; using R code for visualizing interactions; distinguishing between testing interaction and probing it; and more. *Rewritten Appendix A, which provides the only documentation of PROCESS v3, including 13 new preprogrammed models that combine moderation with serial mediation or parallel and serial mediation. *Appendix B, describing how to create customized models in PROCESS v3 or edit preprogrammed models.
Posted in Social Science