Is first in first baseman an adjective, or noun?

My language arts teacher says that the "first" in first baseman is an adjective. But a first baseman in a noun overall. Which is correct?