Block Internet Access But Allow Updates

I have a D-Link Wireless Router and would like to block internet browsing for one of the computers on my wireless network, but still allow it to use Windows Update and Folding@Home. Is there any way to do this through the router? If not, can I simply disallow access to Internet Explorer? How would I go about doing this?

Thanks!
~corndog