In this study, we applied high-density EEG recordings (HD-EEG) to quantitatively characterize the fine-grained spatiotemporal distribution of inter-ictal epileptiform discharges (IEDs) across different sleep stages. We quantified differences in spatial extent and duration of IEDs at the scalp and cortical levels using HD-EEG source-localization, during non-rapid eye movement (NREM) sleep and rapid eye movement (REM) sleep, in six medication-refractory focal epilepsy patients during epilepsy monitoring unit admission. Statistical analyses were performed at single subject level and group level across different sleep stages for duration and distribution of IEDs. Tests were corrected for multiple comparisons across all channels and time points. Compared to NREM sleep, IEDs during REM sleep were of significantly shorter duration and spatially more restricted. Compared to NREM sleep, IEDs location in REM sleep also showed a higher concordance with electrographic ictal onset zone from scalp EEG recording. This study supports the localizing value of REM IEDs over NREM IEDs and suggests that HD-EEG may be of clinical utility in epilepsy surgery work-up.