House prices near the main site of the London 2012 Olympic Games have risen more than $96,000 on average since July 2005.