This website does readability filtering of other pages. All styles, scripts, forms and ads are stripped. If you want your website excluded or have other feedback, use this form.

Profile | Football | Olympics | Sporting Life

Web wide crawl with initial seedlist and crawler configuration from March 2011. This uses the new HQ software for distributed crawling by Kenji Nagahashi.

What’s in the data set:

Crawl start date: 09 March, 2011
Crawl end date: 23 December, 2011
Number of captures: 2,713,676,341
Number of unique URLs: 2,273,840,159
Number of hosts: 29,032,069

The seed list for this crawl was a list of Alexa’s top 1 million web sites, retrieved close to the crawl start date. We used Heritrix (3.1.1-SNAPSHOT) crawler software and respected robots.txt directives. The scope of the crawl was not limited except for a few manually excluded sites.

However this was a somewhat experimental crawl for us, as we were using newly minted software to feed URLs to the crawlers, and we know there were some operational issues with it. For example, in many cases we may not have crawled all of the embedded and linked objects in a page since the URLs for these resources were added into queues that quickly grew bigger than the intended size of the crawl (and therefore we never got to them). We also included repeated crawls of some Argentinian government sites, so looking at results by country will be somewhat skewed.

We have made many changes to how we do these wide crawls since this particular example, but we wanted to make the data available “warts and all” for people to experiment with. We have also done some further analysis of the content.

If you would like access to this set of crawl data, please contact us at info at archive dot org and let us know who you are and what you’re hoping to do with it. We may not be able to say “yes” to all requests, since we’re just figuring out whether this is a good idea, but everyone will be considered.


Sporting Life - Summer Olympics - Beijing 2008


Event Guide:

  • Sunday August 24

    0030 Athletics - Men's marathon
    0630 Boxing - Six finals
    0730 Basketball - Men's final
    1330 Closing ceremony
    All times BST
Medals Table GSBTot1 CHN 51 21 28 100 2 USA 36 38 36 110 3 RUS 23 21 28 72 4 GBR 19 13 15 47 5 GER 16 10 15 41 6 AUS 14 15 17 46

History Timeline

It all started in Athens in 1896...

Competitor List

Take a look at the British athletes heading for Beijing

Event Guide - Football

More Football Stories

Tevez inspired Argentina in Athens.

Format: Group Stage, elimination tournament
Venue: Wembley, Old Trafford, Millennium Stadium, St James' Park, Hampden Park, City of Coventry Stadium
Dates: July 25 - Aug 11
Medals: 2
GB Record: 3 Gold


The Olympic football tournament has been a regular inclusion in the modern-day Games and has seen some of the best footballers in the world emerge onto the scene.

Now it is essentially a tournament for youth players in the men's event as although professional players are allowed they must be under the age of 23, but countries are allowed three over-age players.

This allows some big-names of the world game to make their mark on the Olympics, while young superstars from around the globe can showcase their skills and realise an Olympic dream.

In the women's game there are no such age restrictions and it is a full-on contest for them that rivals the World Cup in its intensity and quality.

The men's qualifying is similar to that of the World Cup, with continental footballing confederations hosting separate Under-23 qualifying tournaments, apart from in Europe where they use the UEFA Under-21 Championship.

The women's teams are also chosen from Olympic qualifying events, although again Europe differs by using performances at the preceding World Cup.

16 teams take part in the men's event in four groups of four followed by a knock-out from the quarter-finals onwards, while 12 teams face each other in the women's event in the group stages before the knock-out begins.


USA win first women#39;s competition on home turf in 96.

Introduced firstly as an exhibition sport, football was first adopted as an official Olympic sport in 1908 at the London Games, when the host nation took the gold - just as they did four years later n Stockholm.

South America burst onto the scene with back-to-back wins for Uruguay in 1924 and 1928, while the IOC then left out football in 1932 due to the confusion over amateur status amongst players.

European teams regained their grip on the gold medal and it was Hungary who were continually challenging for the title, winning three out of five tournaments between 1952 and 1968 - showcasing the emerging great Hugarian team including Ferenc Puskas.

Great Britain made its last appearance in 1960 and after 1974 they stopped attempting to qualify for the event although there could be a return in the future.

1984 in Los Angeles saw a big change in the competition as professional footballers were allowed to take part for the first time - and a record crowd in the US of 101,799 watched the final at the Rose Bowl.

1992 saw the introduction of the Under-23 rule, with three over-aged players allowed, and this led to a shift in the balance of power as Nigeria made history in 1996 by becoming the first Africans to win Olympic gold and the first non-European winner in football for 68 years.

1996 also saw women's football introduced and the USA win the gold on home soil to signal their intent to dominate the women's game.

In 2000 in Sydeny Cameroon secured their first Olympic title with a penalty-shoot out victory over Spain in the final.

Four years later in Athens Argentina enjoyed their madien success in the Olympics with a narrow win over South Amiercan rivals Paraguay.

In Beijing Argentina retained their title with a win over Nigeria in the final.

Olympic Greats:

A young Romario top scored for Bazil in 1988.

The great Hungarian Ferenc Puskas was one of the early greats to lace up his boots in the Olympic tournament, but his namesake Ferenc Bene holds the record for most goals in a single tournament with 12 in 1964.

Denmark's Sophus Nielsen and Frenchman Gottfried Fuchs scored 11 and 10 respectively in 1908 and 1912 but in smaller tournaments with uneven standards of players in the teams.

The victorious home team at the Barcelona Games included the likes of future regulars Santiago Canizares, Pep Guardiola, Luis Enrique, Abelardo and Alfonso.

Atlanta's tournament in 1996 saw the 'Super Eagles' of Nigeria win gold two years after impressing at the World Cup also in the USA.

Also in that tournament, Brazil had Roberto Carlos, Ronaldo, Rivaldo and Bebeto in their side, Argentina Roberto Ayala, Javier Zanetti and Hernan Crespo, while Raul of Spain and the Italian defenders Allessandro Nesta, Fabio Cannavaro and Christian Panucci all featured.

Chile's Ivan Zamerano top scored in Sydney 2000 but Cameroon and Samuel Eto'o took gold, while Carlos Tevez led Argentina to gold in Athens as a Portugal side containing Cristiano Ronaldo flopped badly with defeat against Iraq the lowlight for them.

Current World Player of the Year Lionel Messi helped Argentina retain their Olympic title in Beijing.

The women have competed just three times, and America have won gold twice and silver once as they proved a real powerhouse in the game.

Mia Hamm was undoubtedly the star of women's football in general as well as within her USA team - performing wonders to star in all three campaigns.

Best Of British:

Alex Ferguson could bring back a GB team.

Not much to shout about for Great Britain in the football competition since a flying start which saw them win three golds in the first four tournaments - albeit with the first one as an exhibition.

Goals from Hubert Stapley (six) and Claude Purnell (four) fired England to success at the first tournament proper in 1908, and Harold Walden helped them retain their title with 11 goals four years later - six of those in one games against Hungary.

Great Britain were represented by the England national amateur team thanks to an agreement between the four home nations and their strength meant that they were a tough side to beat at Olympic level.

As professional players started entering the Olympics though the purely amateur side grew weaker and eventually they were broken up by the FA in 1974.

The idea of a Great Britain team going forward is continuing to be talked about although there is opposition and argument between the home nations - although with Sir Alex Ferguson's name mentioned as possible manager that may help persuade some.

Ones To Watch:

Messi looking to inspire champions Argentina.

The African teams (Ivory Coast, Nigeria and Cameroon) will be strong as usual, while Italy have gone with youth and China, Japan and Korea will hope for home conditions and support to play a part.

However, arch South American rivals Brazil and Argentina should be the big challengers for the gold, although they would meet in the semis if they win their respective groups.

The reigning champions have no Carlos Tevez but still have a formidable side based around Liverpool's Javier Mascherano, Juan Roman Riquelme, Sergio Aguero and most probably Barcelona's Lionel Messi.

Fresh from his move to Milan though, Brazil have pulled out the superstar himself Ronaldinho to spearhead their challenge, under senior national team coach Dunga - and he will hope to use the stage to show he is still one of the finest players on the planet.

In the women's competition, America have seen their star on the wane since Athens and will be without to goalscorer Abby Wambach, but their Olympic pedigree means they cannot be discounted.

World Cup holders and European champions Germany are deserved favourites after they retained their World Cup titles without conceding a goal in China last year.

Playmaker Renate Lingor and star striker Birgit Prinz will be their top performers in Beijing, but expect a tough challenge from Brazil - runners up four years ago in Athens and in last year's World Cup - who hope to go one better with the help of goalscorer Cristiane and World Player of the Year Marta.

Team GB:

Neymar: Brazil#39;s star man

No Team GB enetered for Beijing Olympics.

Did you know?

The Olympics is the only significant title Brazil have never won.

Hungary has won three football gold medals, more than any other country.


Neymar is one of the most talked players to emerge in Brazilian football in recent years with the teenager tipped for super stardom.

The 19-year-old has come through the ranks of Santos - which has played a part in him being labelled the 'New Pele' and the 'New Robinho'.

Similar in stature to both those Santos legends, he is also an attacker - who can play out wide or as a central striker.

Neymar has long been heralded as a true star of the future, indeed since he was 13 he was being tipped to be the next Santos legend.

He made his debut in 2009 but he hit double figures in his first season and the scouts were already flocking to see him in action for both Santos and with Brazil's youth side, and they have been continually impressed.

Most of Europe's top clubs have been linked with a move for Neymar with Real Madrid, Barcelona, Chelsea, Manchester City and Inter Milan all mongst those battling it out for the player.

During the 2010 season Neymar scored 27 goals in 29 starts for Santos and he picked the Campeonato Paulista Best Player for 2010 as reward for his superb form.

Neymar was the driving force behind Brazil's qualification for the Olympics, scoring nine goals in the Fifa Under 20 tournament as they beat Uruguay in the final.

The skilful attacker is one of a number of players to be lumbered with with the tag of the 'new Pele, but so far he is living up the hype and reputation he is making for himself.

It seems more than likely that Neymar will find himself playing in Europe in the next few years with the eyes of the top clubs set to be focused on him in London.


Neymar da Silva Santos Junior


He scored on his international debut for Brazil.

Around the site today

Usain Bolt and me

Georgie Thompson meets a no-nonsense Usain Bolt in Jamaica - and finds him refreshingly frank.

Stars to watch

Andy Schooler picks out 10 non-British superstars to watch at the 2010 Winter Olympics.

    365 network

    • © 2011 365 Media Group plc. All Rights Reserved