Horses galloping in pasture?

The other day when I was getting my horse from the pasture the herd of horses came galloping towards us. I started to get nervous so I just stayed close to my horse and all the horses ran around us. I was just wondering if that was the right thing to do, because what if my horse decided to run with them? Is there a better way to handle that situation? Thanks (: