It may sound surprising but human ear helps us maintain our balance.
Inside the ear there are semicircular ducts inside which there is a fluid that help us maintain the body balance.
When someone is slapped specially over ear, the fluid inside these ducts gets disturbed and human brain misinterprets it and gets dis-balanced. Hence, falls down.