Listing files from a web site?

Question

Hello, I am having a very hard time figuring out exactly which class I need to use to do what I need to do here.  What I need to do is to get a list of all the files in a certain directory on a remote website (using it's http:// URI), and download each of those files, even delete those files after I've fetched them.

I've been looking at the WebRequest and WebResponse objects, but I only seem to be able to get the index page from the location, not a list of the files in that directory, and the DirectoryInfo class doesn't seem to take a remote URI, only a local reference.

If anyone has an idea, I would really appreciate it!

Thanks,
Joshua