As the town grew many of Ayrshires landed gentry built town houses like the one on the right built for James Tait ( 16th century ), which became known as ' Loudoun Hall ' after the hereditary Sheriffs of Ayr who owned it until 1634.

The religious conflicts of the 17th century overshadowed the social and economic growth of the area. There were also plagues throughout the century but trading ventures continued despite shipwrecks and piracy.

Ayr's merchants were known as ' lively, adventurous and bold types, in the face of adversity '. This was despite the poor harbour where there was little or no defenses against storms and no pier.

At least two merchants were importing tobacco across the Atlantic and ships were arriving from America, the West Indies, Europe, the Baltic and the Mediterranean with a wide selection of goods. By 1657, 28 'Ingles traders and breweries' were listed in a 'stent roll'.