xmltextreader does not release a file

Question

I am reading/parsing a number of XML files using XmlTextReader. Some of the files do have errors in them. I could recover from most of this errors programmaticaly - to do that I need to open the input, write corrections into it and parse the file again. Trouble is that I cannot open the file for write since XmlTextReader does not release it. I tried using streams - unfortunately I did not suceed.
Can anybody suggest me what to do? Google didn't help me so far ...