Method
|
Advantages
|
Disadvantages
|
Surveys |
Mail |
- Can survey many people
- Not time-consuming
- Relatively inexpensive
- Everyone gets the same instrument
- Objective Interpretation
|
- Difficult to get much detail
- Sometimes difficult to get correct addresses
- May be problems with interpreting questions
- Sometimes a problem getting surveys completed and returned
|
Group-
Administered |
- Can survey many people
- Not time-consuming
- Relatively inexpensive
- Everyone gets the same instrument
- Objective interpretation
- Relatively inexpensive
|
- May be problems with interpreting questions
- Difficult to get much detail
|
Telephone |
- Able to ask for more detail when needed
- Everyone gets the same instrument
|
- Sometimes difficult reaching people
- Lack of anonymity
|
Interview |
- Researcher can know how people are interpreting questions
- Able to ask for more detail when needed
- Provide detailed data
|
- Time-consuming Because of time, can limit sample size
- Subjective interpretation
- Can be expensive
- Can be difficult to analyze
|
Focus Group |
- Researcher can know how people are interpreting questions
- Able to ask for more detail when needed
- Able to interview multiple people at one time, thus, more cost-effective
- Responses from one person provide stimulus for other people
|
- Group setting may inhibit some individuals from providing information
- Sometimes hard to coordinate multiple schedules
- Responses from one person provide stimulus for other people
|
Observation |
- Objective interpretation
- Low burden for people providing data
|
- Time-consuming
- Some items are not observable
- Can be expensive
- Participant behavior may be affected by observer presence
|
Student Records |
- Objective interpretation
- Low burden for people providing data
- Relatively inexpensive
|
- May not correspond to exactly what researcher wants
- May be incomplete or require additional interpretation
- May need special permission to use
|
Collection of Materials |
- Objective interpretation
- Low burden for people providing data
- Relatively inexpensive
|
- May not correspond to exactly what researcher wants
- May be incomplete or require additional interpretation
|
Taken from: Quinones, S. & Kirshstein, R. (1998). An Educator's Guide to Evaluating the Use of Technology in Schools and Classrooms. Washington, DC: U.S. Department of Education |