In week 1, the median number of push-ups is 8.
In week 2, the median number of push-ups is 10.
The increase in the median number of push-ups from the first week to the second week is 2.
Therefore, the increase in the median number of push-ups is 2 push-ups.