Although lawyers were the earliest householders in this new quarter, its chief architect encountered at first strong opposition from a section of the legal profession. Anxious to preserve the rural character of their neighborhood, the gentlemen of Gray's Inn were greatly displeased with the proposal to lay out Holborn Fields in streets and squares. Under date June 10, 1684, Narcissus Luttrell wrote in his diary--"Dr. Barebone, the great builder, having some time since bought the Red Lyon Fields, near Graie's Inn walks, to build on, and having for that purpose employed severall workmen to goe on with the same, the gentlemen of Graie's Inn took notice of it, and, thinking it an injury to them, went with a considerable body of 100 persons; upon which the workmen assaulted the gentlemen, and flung bricks at them, and the gentlemen at them again. So a sharp engagement ensued, but the gentlemen routed them at last, and brought away one or two of the workmen to Graie's Inn; in this skirmish one or two of the gentlemen and servants of the house were hurt, and severall of the workmen."
James Ralph's remarks on the principal localities of this district are interesting. "Bedford Row," he says, "is one of the most noble streets that London has to boast of, and yet there is not one house in it which deserves the least attention." He tells us that "Ormond Street is another place of pleasure, and that side of it next the Fields is, beyond question, one of the most charming situations about town." This 'place of pleasure' is now given up for the most part to hospitals and other charitable institutions, and to lodging-houses of an inferior sort. Passing on to Bloomsbury Square, and speaking of the Duke of Bedford's residence, which stood on the North side of the square, he says, "Then behind it has the advantage of most agreeable gardens, and a view of the country, which would make a retreat from the town almost unnecessary, besides the opportunity of exhibiting another prospect of the building, which would enrich the landscape and challenge new approbation." This was written in 1736. At that time the years of two generations were appointed to pass away ere the removal of Bedford House should make way for Lower Bedford Place, leading into Russell Square.