Uhm, hook your fingernail between bottle and tip, and carefully (to reduce splatter) pry upwards.
It can be done, they are not glued on.
This allows you to do 2 things:
Manually stir the paint when you first get it
Add stainless steel ball bearings (if you can find them)