This is an annoying little problem I noticed with Linux right off. This web site explains how to fix the problem:
http://startlinux.co.nz/articles/article_139.php. One change needs to be made to the information on that page. The file you need to edit in your HOME directory is
.Xclients-default, rather than .xinitrc as it says on that page.