If it's silver then it's most likely oxidization.
Generally oxidization does not appear that quickly but I have heard that metal reacts differently to each person's skin depending on the chemical composition of each individual.
Also, (you probably already know this) but its best for silver to not touch water, makes it oxidize easier and faster.
Hope that helps!