From the vocabulary word referring to a whim or something whimsical. The word came into English via French from Italian capriccio, which originally referred to a sensation of horror making the hair stand on end (from Italian capo ‘head’ + riccio ‘hedgehog’); its later meaning derives from association with the stubbornness of the goat (Italian capra).
English: from the Anglo-Norman French personal name Auvery, a Norman form of Alfred. It could also be from a variant of the Anglo-Norman French personal name Aubri (see Aubrey). At least in the case of the original Puritan settlers in New England, there has been some confusion with Averill.