The icon used by pygame is for the taskbar and window. pygame does not build exe's, py2exe does, so if you want to specify a custom icon you will have to tell py2exe which icon you want.
How is that done? I assume it's a line in setup.py?
Thanks,
Kris