Ways of testing validity

Question 1

What is face validity?

Answer 1

A basic form of validity in which a measure is scrutinised to determine whether it appears to measure what it is supposed to measure
Experts can be asked to check a measure or test
EG: A test for anxiety - might measure general anxiety or worry relating to a particular events

Question 2

What is concurrent validity?

Answer 2

When the results obtained are close to or match those obtained on another recognised and well-established test
EG: A new intelligence test is given to a group of participants and their IQ scores are used in comparison

A Spearman’s Rho test would be used to see if there is consistency between the two sets of scores. A correlation co-efficient of +0.8 or more would indicate concurrent validity

Question 3

What are some ways to improve validity of experiments?

Answer 3

1. Use a control group
2. Use standardised procedures
3. Use single blind
4. Use double blind
5. Use randomisation
6. Use counterbalancing

Question 4

How does using a control group improve validity of experiments?

Answer 4

You can see whether the change in the dependent variable were due to the effect of the independent variable

Question 5

How does using standardised procedures improve validity of experiments?

Answer 5

Minimises investigator effects and participants reactivity

Question 6

How does using single blind improve validity of experiments?

Answer 6

Participants do not know the aims of the study to reduce the risk of demand characteristics

Question 7

How does using double blind improve validity of experiments?

Answer 7

A 3rd party conducts the experiment without knowing its purpose, reducing demand characteristics and investigator bias

Question 8

How does using randomisation improve validity of experiments?

Answer 8

Allocating participants to groups without bias

Question 9

How does using counterbalancing improve validity of experiments?

Answer 9

Control for order effects

Question 10

What are some ways to improve validity of questionnaires?

Answer 10

1. Use a lie scale
2. Filler questions
3. Assure anonymity
4. Avoid ambiguity/ leading questions

Question 11

How does using a lie scale improve validity of questionnaires?

Answer 11

Assesses consistency of the responder’s responses and whether social desirability bias has occured
* A lie scale includes questions designed to detect social desirability bias - when people give answers they think make them look good rather than telling the truth

Question 12

How does using filler questions improve validity of questionnaires?

Answer 12

Used to hide the aim of the study

Question 13

How does assuring anonymity improve validity of questionnaires?

Answer 13

Increases the chance that participants will give honest answers

Question 14

How does avoiding ambiguity/ leading questions improve validity of questionnaires?

Answer 14

More chance that participants will understand the questions and answer honestly

Question 15

What are some ways to improve validity of observations?

Answer 15

1. Covert observations
2. Behaviour categories

Question 16

How does using covert observations improve validity of observations?

Answer 16

Avoids participant reactivity

Question 17

How does using behaviour categories improve validity of observations?

Answer 17

Behaviour categories should be carefully designed to only include behaviours that are self evident and do not need subjective interpretation eg: happy vs laughing

Question 18

What are some ways to improve validity of qualitative research?

Answer 18

1. Depth of detail
2. Triangulation

Question 19

How does ensuring depth of detail improve validity of qualitative research?

Answer 19

Can reflect a person’s reality

Question 20

How does triangulation improve validity of qualitative research?

Answer 20

Different sources are used for evidence eg: interviews with family and friends, personal diaries, observations