ELI5: Why does scrubbing food stuck to a plate with a brush often not remove bits, but if you barely touch those bits with your finger after it comes right off?

ELI5: Why does scrubbing food stuck to a plate with a brush often not remove bits, but if you barely touch those bits with your finger after it comes right off?