The west wing of the house is, on the exterior, a replica of Sulgrave Manor, a submanorial house in Northamptonshire, England, belonging at one time to Lawrence Washington, an ancestor of America's first president, George Washington. The center section of the house is a reproduction of the Priory in Warwickshire, England. This Priory section exhibits the curvilinear gables that the English adopted from the Low Countries in the early seventeenth century. The strapwork design seen on the parapets and on the exterior and interior balustrades was also imported from the Low Countries. Wormleighton Manor, a Spencer-Churchill family estate in England, was the model for the east wing. The architect of Virginia House was Henry Grant Morse, who was primarily a designer of public buildings. Morse traveled in the English countryside with Mr. and Mrs. Weddell as they looked for a model for the house they hoped to build in Windsor Farms.

William Lawrence Bottomley designed the Loggia, incorporating columns imported from Spain on the south side. The painted ceiling in the Loggia came in part from a sixteenth-century house that once stood on the site of Knole in England. A frieze of old tiles on the walls of the Loggia illustrates the early use of gunpowder. The roof of the Loggia is a belvedere from which the visitor can have a view of the gardens of Virginia House and the historic James River beyond. Beyond the Loggia, the east wall of the west wing bears mason's marks from various periods, some surviving perhaps from the original Priory. A porch, built after the completion of the main house, extends from Mrs. Weddell's bedroom. Mrs. Weddell would retreat to her porch on hot summer nights to catch the breezes from the river and, in the morning, she and Mr. Weddell would have breakfast served to them there.