The majority of the gallery's modern works were acquired from the collection of Erwin Stern of South Beach, Florida, in April of 2005.

A leading post-World War II art dealer, Mr. Stern had traveled around the world over forty times acquiring artwork.

The majority of the bronzes, as well as a number of oil paintings in the collection, had been purchased over the years at New York auctions at Sotheby's, Christie's, and Doyle's. Many of these pieces had spent parts of their lives in museums around the world.

Brought together by their mutual interest in art, the Labries, who own a winter residence in South Beach, were close friends of the Sterns. When Erwin Stern decided to retire, Michael Labrie acquired his collection in order to carry on his legacy. The collection was moved to Rye, New Hampshire and the Collector's Art Gallery opened its doors in November 2005.

In the Spring of 2006, the Gallery expanded its scope to include rotating exhibitions of contemporary artists from New England and beyond, hiring local artist and independent curator Albina Colden to oversee this endeavor. The gallery's premier contemporary art exhibition, The Naked Truth, opened in May 2006 and has been met with positive reviews.