Skip to Main Content

Using the Intercultural Development Inventory to Assess Liberal Arts Outcomes

What is being measured?

The Intercultural Development Inventory (IDI) is a short paper and pencil survey that measures an individual’s awareness of and sensitivity to cultural differences.  Based on Bennett’s (1, 2) Developmental Model of Intercultural Sensitivity (DMIS), the IDI generates an individual or group profile that corresponds to a particular stage of intercultural development, ranging from ethnocentrism, in which one’s own culture is experienced as central to reality, to ethnorelativism, in which one’s own culture is experienced in the context of other cultures.

Are there liberal arts outcomes being measured?

The IDI tracks an individual’s movement from rigid and dualistic thinking patterns to higher-ordered cognitive processes characterized by openness, flexibility, and the ability to incorporate multiple perspectives into one’s worldviews.

Population

The IDI can be used to assess students at both the undergraduate and graduate level.

Introduction

In order for a liberal arts education to successfully occur, "an institutional ethos and tradition which places greater value on developing a set of intellectual arts, than professional or vocational skills" must be present (Center of Inquiry in the Liberal Arts, 2004).   Embedded within this notion of the "intellectual arts," is an emphasis on higher-ordered learning and its relation to intellectual openness and the ability to adopt a critical perspective on one's own as well as others' beliefs, values, and positions.  Towards this end, the Intercultural Development Inventory (IDI) is an important assessment tool that measures an individual’s awareness of, and sensitivity to, cultural differences.  The IDI is a theoretically derived instrument based on Bennett’s (1,2) Developmental Model of Intercultural Sensitivity (DMIS), which traces an individual’s movement from ethnocentric to ethnorelative stages of development.  In general, ethnocentric stages refer to an individual’s avoidance of cultural difference by denying its existence, raising defenses against it, or minimizing its importance.  In contrast, the ethnorelative stages reflect ways of seeking cultural difference by accepting its importance, adapting one’s perspective to incorporate it, or integrating the entire concept into one’s identity.  In this review, the key characteristics, background, and development of the IDI are presented along with a discussion of the IDI’s relevance and importance to the goals of a liberal arts education.

Key Characteristics of the IDI

The IDI is currently administered as a paper and pencil instrument composed of 50 questions that are designed to measure an individual’s sensitivity to and awareness of cultural differences.  The survey consists of statements reflecting attitudes toward cultural difference, and responses are scored on a five-point Likert-type(a) scale.  The instrument takes approximately 20 to 30 minutes to complete.  The results are compiled and a graphic profile of an individual or group’s predominant stage of intercultural development is generated.  In addition, IDI results provide a textual interpretation of an individual or group’s stage of development and associated transition issues.  Administration of the IDI is often accompanied by a pre-interview, in which respondents are asked about their backgrounds and prior experiences with different cultures.  In addition, individuals and groups are provided with their IDI results in conjunction with a mandatory debriefing session that is facilitated by a trained and certified IDI administrator.

The IDI is a proprietary instrument that may only be administered by individuals who receive certification from the Intercultural Communication Institute (ICI)(b).   The certification process entails participation in a three-day seminar that provides a detailed overview of the theoretical underpinnings of the IDI as well as how to administer and interpret the survey to individuals and groups.  The cost of the training is $975 for educational institutions and includes all training materials and certification.  IDI surveys may be ordered directly from the ICI at a cost of $5.00 each if they are processed by ICI, with additional fees incurred depending on the type and number of profiles requested.  Certified administrators who prefer to process the IDI results at their respective institutions may do so by purchasing a CD-ROM ($200.00), which permits the generation and printing of various profile formats.  IDI assessment instruments, including CD-ROM licensing, are available from the ICI for $10.00 each.

Background

The IDI was developed and revised by Drs. Milton Bennett and Mitchell Hammer and is theoretically-based on Bennett’s (1,2) Development Model of Intercultural Sensitivity (DMIS).  Bennett developed the DMIS as a way of organizing and explaining an individual’s reactions to cultural difference.  One of the central tenets of the model is that, as an individual’s experience with cultural difference becomes more sophisticated and complex, there is a simultaneous increase in his or her competence in intercultural relations.  Each stage of development is associated with distinct cognitive phases that correspond to certain types of attitudes and behaviors related to one’s orientation toward cultural difference.  In this regard, the IDI is not a model of attitude change or skills acquisition, but rather a model of the development of a "worldview" structure. 

The DMIS incorporates six stages of development that are divided into ethnocentric and ethnorelative categorizations. The ethnocentric stages include Denial, Defense, and Minimization.  In Denial, one’s own culture is viewed as essential, and consideration of other cultures is generally avoided through psychological and/or physical isolation from difference.  The Defense stage is characterized by a general threat of cultural difference in which one’s own culture is deemed best and all others are viewed as inferior.  The final ethnocentric stage, Minimization, reflects a tendency to view one’s own culture as universal or absolute.  Although cultural differences are viewed as acceptable on the surface during this stage, deep down an individual views other cultures as essentially similar to one’s own.

The ethnorelative stages include Acceptance, Adaptation, and Integration.  In the Acceptance stage, other cultures are viewed as equally complex to one’s own culture.  In Adaptation, one is able to incorporate different cultural perspectives into their worldviews, which may result in intentional shifts in behaviors or attitudes to accommodate cultural differences.  The final stage of Integration reflects a shift in one’s experience of self in which an individual is able to move in or out of different cultural worldviews. 

Development of the IDI

Individual items on the IDI were derived from interviews with 40 subjects who represented cross-cultural and situational diversity.(c) Interviews were then categorized by a team of four raters and reviewed by a team of experts who removed those items that were not similarly classified by at least five of the seven experts. This resulted in an inventory of 145 items that corresponded to five of the six DMIS stages.(d) Items were then tested on a sample of 226 respondents, which resulted in the final set of 50 questions.(e) The IDI is considered a valid and reliable measure "that reasonably approximates the developmental model of intercultural sensitivity" (7). The IDI is also related to other standardized tests, such as the Worldmindedness Scale and the Intercultural Anxiety Scale (Sampson & Smith, 1957; Wiseman, Hammer, & Nishida, 1989; Gao & Gudykunst, 1990 as cited in Bennett & Hammer, 1998). More recent research has also demonstrated a positive association between ethnorelativism, postconventional moral reasoning, and multicultural experiences (6).

Administering and Scoring the IDI

The IDI can be administered to individuals and groups depending on the particular goals of the institution, although individual profiles require considerably more time and effort to score. Group profiles present the most obvious use for an institution wishing to understand an entering cohort’s baseline level of intercultural sensitivity. A follow-up assessment at the time of graduation can also provide a more general understanding of how students progress on the IDI during their time in college. Using the IDI over time in conjunction with other instruments designed to assess students’ experiences in college (e.g., NSSE) may yield an important understanding of how intercultural development is related to specific college experiences. The IDI may also be beneficial in assessing certain curricular or co-curricular experiences that provide students with cross-cultural opportunities that are accompanied by critical reflection and discussion.

Based on an individual or group’s responses, the IDI generates a profile that corresponds to the different ethnocentric and ethnorelative stages of intercultural development.  In each stage, respondents are designated as being either unresolved, in transition, or resolved. The stage in which the respondent receives the highest percentage of unresolved responses is designated as their current IDI profile. If individuals or groups are given their results, a certified administrator will provide them with detailed information about their stage of development and help translate IDI profiles into positive action planning. By having respondents pose the question, "what does this mean to me?," they are encouraged to consider how they can continue to develop their intercultural sensitivity. In addition to generating an IDI profile, results from the IDI produce a respondent’s perceived versus actual developmental score. Thus, administrators will also have a sense of where discrepancies lie between how one rates their perceived strengths in intercultural sensitivity versus the more objective assessment provided by the IDI. Resistance to the IDI is common for individuals or groups characterized by more ethnocentric stages of development. Therefore, the administrator might need to work through this resistance in order to help the individual or group consider how the results can guide their further intercultural development.

Institutional Uses of the IDI

Institutions that value the development of intercultural sensitivity, as evidenced by their institutional mission and goals, will likely have a range of programs and structures in place to foster such growth. Perhaps the most common arena for implementing the IDI is study abroad programs. In addition, studies intended to foster global competence, such as diversity series, service-learning and field placement opportunities, or other programs that push students beyond their comfort zones, present potential opportunities for students to acquire intercultural competencies. Curricular offerings that incorporate opportunities for cross-cultural interaction and/or a global perspective within their course structure may also be appropriate places to assess students’ intercultural development. In addition, institutions interested in assessing the development of intercultural sensitivity among their students might find it advantageous to administer the IDI at college entry and then again at the time of graduation. There is little evidence, however, that mere exposure to cultural difference without substantial opportunities for critical reflection and discussion leads to greater intercultural sensitivity (5). Thus, programs that make explicit their goals for developing intercultural sensitivity and incorporate time for genuine reflection and discussion are most appropriate for using the IDI as an assessment instrument.
 
Relation to Liberal Arts Outcomes

Bennett’s (1,2) model of intercultural sensitivity describes a critical shift from rigid to more flexible thinking. In this regard, intercultural development involves a gradual recognition and appreciation of multiple perspectives and cultural frameworks. This change in cognitive development is clearly aligned with the intellectual goals of a liberal arts education, including openness to new ideas and perspectives and the ability and desire to think critically about the beliefs, behaviors, values, and positions one might hold. The DMIS, in particular, parallels other accepted developmental paradigms such as Perry’s Scheme of Intellectual and Ethical Development (1970), Basseche’s Model of Dialectical Reasoning (1980, 1984), King and Kitchener’s Reflective Judgment Theory (1994), and Brown’s Model of Wisdom Development (2002; all cited in Doherty et al., 2003). All of these theories suggest that experience, in conjunction with cognitive development, leads to more sophisticated approaches to interpreting experience.

Benefits of the IDI

Intercultural sensitivity is viewed by many as an essential skill for transcending ethnocentrism and establishing positive relations and effective interaction across national and cultural boundaries.  Understanding students’ cognitive orientation toward cultural difference enables educators to make predictions about students’ attitudes and behaviors toward cultural difference. This information can be valuable in designing educational interventions to promote intercultural development. In a similar fashion, student affairs administrators interested in conducting a needs assessment to understand where a particular group is situated prior to entering into a culturally-based experience, may find the IDI beneficial.

One of the advantages of the IDI over other measures of intercultural competence is its reliance on theory derived from the DMIS.  As such, the IDI meets the scientific criteria for a valid psychometric test.  The IDI also measures an individual’s thought processes as opposed to a particular set of attitudes; this makes the instrument less susceptible to outside influences, more stable, and more generalizable than other commonly used tests.

Students who take the IDI are also provided with valuable feedback that can promote greater self-awareness about their intercultural sensitivity.  As such, the IDI has the added benefit of being both an assessment instrument and a potential vehicle to promote greater self-awareness and intercultural skill development.

Furthermore, intercultural competence was rated as one of the most important skills the business community desires in future graduates, over and above specific knowledge acquired from one’s academic discipline (4).  More and more campuses incorporate diversity programs into their undergraduate curriculum, and the IDI is one of the most valid and reliable instruments currently available to the education community to assess the efficacy of such programs.

Limitations to the IDI

Despite the many benefits of the IDI, several criticisms have been levied against both the IDI and the DMIS.  Dougherty et al. (5), for instance, have concerns regarding the minimization stage of the DMIS.  In particular, they suggest that the DMIS does not distinguish between "minimizing" and "synthetic" universalism, the latter being essential for achieving the goals of a liberal arts education. While minimizing universalism is characterized as a collapse of the other into the self, synthetic universalism is more integrative and refers to one’s ability to recognize the significance, richness, and uniqueness of other cultures while simultaneously recognizing cross-cultural commonalities. Dougherty et al. posit that synthetic universalization is suggestive of a stage beyond ethnorelativism, yet the DMIS does not distinguish it from the minimization stage of ethnocentrism. This neglect, they add, "is a significant limitation of the IDI with respect to our understanding of the aims of a liberal education" (p. 4).

Additional concerns about the IDI focus on the way the survey is constructed. Respondents are asked to identify a cultural group they have had the most contact or experience with and to contrast this against individuals who represent a cultural group they do not belong to.  As such, one’s dominant cultural group varies significantly across individuals, with some opting to define their cultural group by race or ethnicity and others choosing affiliations such as their religious background. Thus, the type of cultural competence the IDI taps into may vary significantly across individuals and the results should be considered within the context of the cultural group one feels he or she belongs to most. There is also some concern that students who speak non-standard English may have difficulty understanding the meaning behind some of the IDI question stems. While the IDI is currently administered in several foreign countries, one should be cautious when using the IDI with students who speak non-standard English. Perhaps the greatest limitation of the IDI is the time and resources needed to train and certify administrators.  Institutions must be willing to invest a considerable amount of time and monies to provide training opportunities for faculty and/or student affairs administrators interested in using the IDI as an assessment tool.  In addition, to gain the full benefits of the IDI, administrators need to spend a considerable amount of time learning how to present the results to individuals and groups—a process that warrants a certain degree of interpersonal skills in helping people understand the meaning behind their IDI profile as well as encouraging the continual reflection and action steps needed to further develop one’s level of intercultural sensitivity.


Footnotes

 

  1. Individuals rate their responses on a 5-point Likert-type scale that ranges from 1=Disagree to 5=Agree

     
  2. The Intercultural Communication Institute, 8835 SW Canyon Lane, Suite 238, Portland, OR, 97225, www.intercultural.org.

     
  3. Respondents came from 16 different countries and their length of stay varied from 1 year to over 7 years.

     
  4. The integration stage of the DMIS is not measured by the IDI.

     
  5. The majority of respondents were between 22-30, held a college degree or higher, and lived in the United States.




References

 

  1. Bennett, M.J. (1986). Towards ethnorelativism: A developmental model of intercultural sensitivity.  In R.M. Paige (Ed.) Cross-cultural orientation: New conceptualizations and applications (pp. 27-70). New York: University Press of America.

     
  2. Bennett, M.J. (1993). Towards ethnorelativism: A developmental model of intercultural sensitivity.  In R. M. Paige (Ed.), Education for the intercultural experience (pp. 21-71). Yarmouth, ME: Intercultural Press.

     
  3. Bennett, M.J. & Hammer, M. (1998). 

     
  4. Bikson, T.K., & Law, S.A. (1994). Global preparedness and human resources. Santa Monica, CA: Rand Institute.

     
  5. Dougherty, D., Lynch, R.A., & Ohles, F. (2003). Review of the Intercultural Development Inventory (IDI) for assessing outcomes of a liberal arts education. Center of Inquiry in the Liberal Arts: Wabash, IN.

     
  6. Endicott, L., Bock, T., & Narvaez, D. (2002, April). Learning processes at the intersection of ethical and intercultural education.  Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans.

     
  7. Paige, R., Jacobs-Cassuto, M., Yershova, Y.A., & DeJaeghere, J. (2003). Assessing intercultural sensitivity: An empirical analysis of Hammer and Bennett’s Intercultural Development Inventory. International Journal of Intercultural Relations, 27: 467-486.