Taskbar button issue

I've had this issue before with a Windows 98SE, but I now currently have an XP and the issue has suddenly recurred. It doesn't seem to be a performance issue (everything's working fine) except that these types of things drive me crazy... not knowing how to fix it!
My taskbar (bottom of screen) displays buttons of websites I'm currently viewing, and one can close the website by right-clicking the button (or tab) and choosing CLOSE. However, sometimes a button (the one in issue right now is my ZoneAlarm) can't be manipulated... meaning, can't close it, display it, or even right click it to bring up options, and it always ends up being the button to the far left, next to START. I've tried rebooting but to no avail. I'd just like to know how to fix this and prevent it from happening in the future. I've scanned several times with Adaware, Spybot... even CCleaner. Any further info needed, just let me know. Thanks!

Windows XP
Service Pack 2

 

What you are referring to is the Quick Launch bar/menu, and you can't right click and shut the applications down that way. This is a setting that you ok to when you install the software ( it does give options to install a Quick Launch icon ). If it is the icon itself that you want to delete, then right click and select delete. The icon to stop the program ( assuming that is your intent ) will be on the right side of your tool bar.

 

the buttons directly to the right of the start button can be created and delted by draging icons to and from the desktop (as well as right clicked and deleted.) The larger buttons in the middle displaying programs currently running can closed, opened, tiled, minimized, expanded, etc. by right clicking on them. Then the buttons all the way to the right of the screen next to the clock are also cureent processes. The programs they represent usually have an option to display an icon here or not.

 

Thanks for the replies. Actually, what I was referring to are not icons, but 3D buttons for the website being viewed. For instance, if I minimized the page, it would minimize into the button at the bottom of the screen in the taskbar, or quicklaunch bar I suppose. THIS is what I can do nothing with... just the one at the right of START... any other 3D buttons next to that one work fine and can be deleted at will. My quicklaunch ICONS are at the far right corner of the screen and pose no problems. Thanks again!