I had to google the disease to learn about it. It turns out that I attended a class with a women about 4 decades ago with Type 1 of NF.
First, I am so sorry for what you have and continue to suffer 
Just as nobody has a right for prevent abortion, nobody has a right to prevent parents from becoming parents. I think being a carrier of any genetic disorder is an issue that would cause people to think hard about becoming parents. Its not so very different from wondering if you can provide for children, will be there for the longer haul (eg initially Christopher and Dana Reeve were going to have another child in spite of his paralysis, but they later decided against it), etc. Knowing what you know, do you want to subject your children to the same, etc. But in the end, it is the individual's choice, or should be.
People will always have their own opinions; its the ones who think we all need to hear their opinions that are the problem.
Edit history
= new reply since forum marked as read