re: Are house plans supposed to be difficult?

Not diffcult if you know what you want. Focus on the floor plan and how you want the house to live and flow.
For my house, I sat with the architec with a blank sheet of paper and began with the floor plan. Once that was completed, we move to images I had of elevation options.

The most important thing is knowing what you want.