Samurai Jack heard that a Hermit knew something about time travel. When Jack blew a horn, a house came up from the swamp. Jack somehow didn't realize hes a Midget Targaryen version of Aku. The Hemit told Jack about the Titans and Cronus. The Hermit used Jack to find three magic gems that belonged to Cronus. The Hermit tried to betray Jack, but Jack saw through him from the beginning, was able to turn the tables, and badly beat him.
The Hermit had a very cranky personality.