Does trying make it harder?

New to this site, and to posting blogs or questions to strangers…so please bear with me. We have been “trying” to get pregnant for 3 months now (I know, its not been long enough to complain or worry yet, but that is not the point). My ex husband and I were able to conceive our first child the first month that I went off the pill, and our second child was a surprise but not an accident—if you know what I mean. Well, now my new husband I are trying for one of our own. Great! Yay! But… he was diagnosed with testicular cancer several years ago, and eventually lost one testical to a tumor. We were told that conception would be difficult, but possible and that we would need to try for at least a year before seeking help. Then we had the morphology tests done, and the news was awful! We really are going to have a hell of a time with the baby business. This is not my current frustration though.
I have been tracking my ovulation and have discovered that I am not normal. For the first few months, my cycles were 35 days apart, but now they are 23 (this month at least). And ever stupid calendar out there really wants you to be exact and very regular. I am sure that I am complaining for no real reason, and that everything will work itself out and if I am really meant to have another child I will, but that doesn’t change my frustration.
I guess that I just wanted to get that out since I don’t really feel like I can talk to my hubby about this without him wanting to “fix” or “rationalize” everything.
So thanks for listening---even if you really weren’t. And Merry Christmas to all of you.