The fact that the toe became bruised and swollen indicates bleeding which means that something was torn or broken. This can be a ligament or a bone. An X-ray will not show a hairline fracture unless the X-ray is taken in the perfect angle. Subsequent X-rays will show the bone reaction to the break. When bones are not immobilized properly, they will hurt and swell when pressure is put on them. Your toe does not swell which means either it is a fracture, but you are walking in a way that takes the pressure off; or it is not a fracture.
If it is not a fracture you would have a sprain which needs immobilization followed by therapy.
The first thing you need is a follow up X-ray, so go see your podiatrist.
One more thing, if it is a fracture, then you are on your way to developing a non-union, which is a serious condition.

Stanley Beekman