What is the noun form of difficult words?

The noun form of "difficult words" is difficulty or difficulties.

You could also use hard words, challenging words, or complex words, depending on the context.