Is It Wrong To Touch A Strangers Laundry If They Leave It In The Dryer?

I live in an apartment downtown and each floor has a shared, coin-operated laundry room. Sometimes when after I have washed a load and I'm ready to move it to the dryer I notice someone has dried their clothes and left them in the dryer. What is the appropriate amount of time to wait before taking the initiative to move their laundry to make room for my clothes? I think an hour is fair. I'm always worried that the person whose laundry it is, is going to catch me setting their stuff on the table next to the dryer... or worse, see my hands on their underwear. That would be uncomfortable.