I want to post audio or video of a student musical performance. Are there any copyright issues with doing this?

A brief clip that shows the student performing would probably be permissible if it is in the context of reporting or reviewing. To show it in full, however, may be a copyright violation if the musical work is copyright protected. In that case, you would need permission to use the full piece on your site.