The Bible Talks about Horses.

1. “And the anger of the Lord was kindled against Israel, and he delivered them into the hand of Hazael king of Syria, and into the hand of Benhadad the son of Hazael, all their days. And Jehoahaz besought the Lord, and the Lord hearkened unto him: for he saw the oppression of Israel, because the king of Syria oppressed them. (And the Lord gave Israel a saviour, so that they went out from under the hand of the Syrians: and the children of Israel dwelt in their tents, as beforetime. Nevertheless they departed not from the sins of the house of Jeroboam, who made Israel sin, but walked therein: and there remained the grove also in Samaria.) Neither did he leave of the people to Jehoahaz but fifty horsemen, and ten chariots, and ten thousand footmen; for the king of Syria had destroyed them, and had made them like the dust by threshing.” – 2 Kings 13:3-7

2. “Behold, I am against thee, O thou most proud, saith the Lord God of hosts: for thy day is come, the time that I will visit thee. And the most proud shall stumble and fall, and none shall raise him up: and I will kindle a fire in his cities, and it shall devour all round about him. Thus saith the Lord of hosts; The children of Israel and the children of Judah were oppressed together: and all that took them captives held them fast; they refused to let them go. Their Redeemer is strong; the Lord of hosts is his name: he shall throughly plead their cause, that he may give rest to the land, and disquiet the inhabitants of Babylon. A sword is upon the Chaldeans, saith the Lord, and upon the inhabitants of Babylon, and upon her princes, and upon her wise men. A sword is upon the liars; and they shall dote: a sword is upon her mighty men; and they shall be dismayed. A sword is upon their horses, and upon their chariots, and upon all the mingled people that are in the midst of her; and they shall become as women: a sword is upon her treasures; and they shall be robbed. A drought is upon her waters; and they shall be dried up: for it is the land of graven images, and they are mad upon their idols.” -Jeremiah 50:31-38

The Bible does not specifically contain the word Horses, but discusses related themes such as warfare, the destruction of enemies, and the need for redemption.