To sing the praises of God upon the harp and Psaltery unquestionably formed a part of the training of the law, and of the service of God under the dispensation of shadows and figures; but they are not now to be used in public thanksgiving. We are not, indeed, forbidden to use, in private, musical instruments, but they are banished out of the churches by the plain command of the Holy Spirit, when Paul,  i 1 Cor. Xiv. 13, lays it down as an invariable rule, that we must praise God, and pray to Him only in a known tongue.

Cited from W. Robert Godfrey “John Calvin-Pilgrim and Pastor” pp. 74.