The 28-year-old made five appearances for the Os during his month-long stay without tasting defeat.
But with regular number one Jamie Jones now fit after a hernia operation, boss Russell Slade has opted not to extend Brown's stint at Brisbane Road.
Jones proved his fitness in a reserve game last week and is expected to start against MK Dons on Boxing Day.
Source: PA
Source: PA