I found this site online and they have some interesting exhibits that you can get a small taste of online. I liked the one about Monroe as a diplomat.
If you go to the past exhibits, you can also see a Monroe Christmas exhibit:
This exhibit, which was first displayed from November through January of 2005/2006, and again in 2006/2007 and 2007/2008, transformed the Rare Book Room into a festive display of an early American Christmas as James Monroe and his fellow Virginians might have enjoyed it. The exhibit was decorated in eighteenth and nineteenth century regalia such as holly, ivy, mistletoe, and mountain laurel, with additional information on Virginian customs such as the “kissing ball” which was made out of mistletoe. A buffet with an attached panel described and showcased common Christmas dishes such as candied fruits, sweetmeats, oysters, and plum pudding. The exhibit also featured information on Christmas customs that took place in Virginia, such as the shooting off of guns and firecrackers, the types of presents exchanged between parents and their children, and the role that slavery had in the Christmas festivities and how slaves might have experienced them.
As you can see there isn’t a lot here, but it is a fun few minutes of exploring. And, of course, if you are ever in Fredericksburg, you can visit them in person and actually see the exhibits (I haven’t been there as of yet, so I can’t give an opinion here).