Weatherization plastic on the windows...?

When is it ok to take the plastic off my windows for summer? (the weatherization plastic that you blow-dry tight in the fall) I want some fresh air in my house but am not sure if it's the right time yet. I live in upstate NY.