All you would have to do is setup second NIC with a seperate IP address on the second switch. This will only give him another point of presence on the the network though and unless you are trying to keep services seperate, I highly doubt he will get faster file transfers out of this because it doesn't work that way. To effectively get better transfer rates as far as the network goes, you would need to get a gigabyte switch to go along with that gig NIC. Also, you would have to make sure that the computer that is receiving files has a gigabyte NIC also, otherwise you'll just be getting 100meg transfer speeds.
If this server is serving files out to the internet, you are limited by the speeds of the connection also.
You also have to remember that you are limited to the file transfer speeds of the hardware itself.
I hope this makes sense and helps and welcome to Geeks-To-Go.