The connection is that the word "tad" originally referred to a small toad, and later evolved to mean "a small amount" or "a little bit." This is similar to how we still sometimes use the word "frog" to refer to something small and insignificant.
So, the next time you say "just a tad," remember that you're actually referring to a tiny toad!