Make sure the default Pygame icon (pygame.ico) is also in the same directory. (This bug is fixed in Pygame 1.7.)
Kris