A Supplemental Information About Assessment Design and Development

A.1 Differential Item Functioning Plots

The plots in this section display the best-fitting regression line for each gender group, with jittered plots representing the total linkage levels mastered for individuals in each gender group. Plots are labeled with the item ID, and only items with non-negligible effect-size changes are included. The results from the uniform and combined logistic regression models are presented separately. For a full description of the analysis, see the Evaluation of Item-Level Bias section.

A.1.1 Uniform Model

These plots show items that had a non-negligible effect-size change when comparing \(M_1\) to \(M_0\). In this model, the probability of a correct response was modeled as a function of ability and gender.

The plot of the uniform gender differential item function evidence for Mathematics item 61997. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for Mathematics item 67039. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for Mathematics item 39090. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform gender differential item function evidence for Mathematics item 60583. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the uniform race differential item function evidence for Mathematics item 64572. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis.

A.1.2 Combined Model

These plots show items that had a non-negligible effect-size change when comparing \(M_2\) to \(M_0\). In this model, the probability of a correct response was modeled as a function of ability, gender, and their interaction.

The plot of the combined gender differential item function evidence for English language arts item 70285. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 80659. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 61997. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 67039. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 10183. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 14820. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 15633. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 15635. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 33860. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 35161. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 37562. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 38067. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 38765. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 38989. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 39755. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 39766. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 39774. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 40993. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 46941. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 55611. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for English language arts item 56991. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 39090. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 41683. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 60583. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 70599. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined gender differential item function evidence for Mathematics item 70601. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for English language arts item 54118. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for English language arts item 70524. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 64572. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 69312. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 69313. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 70558. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for English language arts item 37622. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis. The plot of the combined race differential item function evidence for Mathematics item 44250. The figure contains points shaded by group. The figure also contains a logistic regression curve for each group. The total linkage levels mastered in is on the x-axis, and the probability of a correct response is on the y-axis.