Here's why:
* Adverbs modify verbs, adjectives, or other adverbs. In this sentence, "there" modifies the verb "built" by telling us where they built their homes.
* Adverbs often answer questions like "where," "when," "how," or "to what extent." In this case, "there" answers the question "where?"