The confusion comes when you wrongly think of sight as a (transitive) verb, such as:
- After 40 days at sea, we sighted land.
- We caught sight of the burglar.
Site is also a noun which is the context in "sight unseen"
Other uses as a noun:
- Let's go sight seeing around Sydney. (later...