Does it also constitute a copyright infringement if I do not use the music commercially?

Yes, in that case, you might, in some circumstances, not just go ahead and use the music either.  With a view to performances or other communication types, what is authoritative is the fact whether or not they have public character.