Check the Media Settings in the Global Configuration to make sure uploads are enabled and the file type is allowed: http://www.iteachme.com/joomla-courses/reference-guides/media-settings

If that's not the problem, then there might be a permissions problem on the server for the folder you are trying to upload to.

Is an error message being displayed?