In statistics, multiple correspondence analysis (MCA) is a data analysis technique for nominal categorical data, used to detect and represent underlying structures in a data set. It does this by representing data as points in a low-dimensional Euclidean space. The procedure thus appears to be the counterpart of principal component analysis for categorical data. MCA can be viewed as an extension of simple correspondence analysis (CA) in that it is applicable to a large set of categorical variables.

As an extension of correspondence analysis

MCA is performed by applying the CA algorithm to either an indicator matrix (also called complete disjunctive table – CDT) or a Burt table formed from these variables. An indicator matrix is an individuals × variables matrix, where the rows represent individuals and the columns are dummy variables representing categories of the variables. Analyzing the indicator matrix allows the direct representation of individuals as points in geometric space. The Burt table is the symmetric matrix of all two-way cross-tabulations between the categorical variables, and has an analogy to the covariance matrix of continuous variables. Analyzing the Burt table is a more natural generalization of simple correspondence analysis, and individuals or the means of groups of individuals can be added as supplementary points to the graphical display.

Multiple correspondence analysis

In the indicator matrix approach, associations between variables are uncovered by calculating the chi-square distance between different categories of the variables and between the individuals (or respondents). These associations are then represented graphically as "maps", which eases the interpretation of the structures in the data. Oppositions between rows and columns are then maximized, in order to uncover the underlying dimensions best able to describe the central oppositions in the data. As in factor analysis or principal component analysis, the first axis is the most important dimension, the second axis the second most important, and so on, in terms of the amount of variance accounted for. The number of axes to be retained for analysis is determined by calculating modified eigenvalues.

Multiple correspondence analysis

Details

Since MCA is adapted to make statistical conclusion out of categorical variables (such as multiple choices questions), the first thing one needs to do is to transform quantitative data (such as age, size, weight, day time, etc) into categories (using for instance statistical quantiles).

Multiple correspondence analysis

When the dataset is completely represented as categorical variables, one is able to build the corresponding so called completely disjunctive table. We denote this table . If persons answered a survey with multiple choices questions with 4 answers each, will have rows and columns.

More theoretically, assume is the completely disjunctive table of observations of categorical variables. Assume also that the -th variable have different levels (categories) and set . The table is then a matrix with all coefficient being or . Set the sum of all entries of to be and introduce . In an MCA, there are also two special vectors: first , that contains the sums along the rows of , and , that contains the sums along the columns of . Note and , the diagonal matrices containing and respectively as diagonal. With these notations, computing an MCA consists essentially in the singular value decomposition of the matrix:

The decomposition of gives you , and such that with P, Q two unitary matrices and is the generalized diagonal matrix of the singular values (with the same shape as ). The positive coefficients of are the eigenvalues of .

The interest of MCA comes from the way observations (rows) and variables (columns) in can be decomposed. This decomposition is called a factor decomposition. The coordinates of the observations in the factor space are given by

The -th rows of represent the -th observation in the factor space. And similarly, the coordinates of the variables (in the same factor space as observations!) are given by

Recent works and extensions

In recent years, several students of Jean-Paul Benzécri have refined MCA and incorporated it into a more general framework of data analysis known as geometric data analysis. This involves the development of direct connections between simple correspondence analysis, principal component analysis and MCA with a form of cluster analysis known as Euclidean classification.