Ear infections are quite common, especially in children but adults can get them too. There are different parts of your ears ...
Aspergillus niger lives everywhere. It wouldn't a be shock for me if there was some on your hand right now or on your desk. It's very common. So the likelihood is it was either in the ear already ...