Posts Tagged 'scaling'

WikiPedia architecture and scalability

• 
• 

Details

Category: Performances

Published on Friday, 27 July 2007 23:14

Written by Administrator

Hits: 5672

This PDF is a lot more technical, but reveal some challenges WikiPedia is facing in order to maintain its infrastructure/response time. WikiPedia is simply the biggest multilingual free-content encyclopedia on the Internet. Over 7 million articles in over 200 languages, and still growing. More than 75,000 active contributors  Some 5,300,000 articles (2M in English) More than 100 languages.  100 servers in various hosting centers. See Wikipedia Statistics, visits per day Over 1,000 administrators to ensure guidelines and policies

[...] Started as Perl CGI script running on single server in 2001, site has grown into distributed platform, containing multiple technologies, all of them open. The principle of openness
forced all operation to use free & open-source software only. Having commercial alternatives out of question, WikiPedia had the challenging task to build efficient platform of freely
available components. [...]

One more time, worth reading if you are into web development, performance and scalability. It seems that lighttpd is more and more used for serving static files (html, images, js, css, pdf ...) instead of the venerable Apache

If you have still some new fresh neuron to burn, you can read the  Overall system architecture and more HERE
The most important news here is that Wikipedia currently uses APC, so I choose the right PHP cache ;-)

YouTube Scalability Talk

• 
• 

Details

Category: Performances

Published on Friday, 27 July 2007 21:30

Written by Administrator

Hits: 5531

Kyle Cordes’s blog post on the “YouTube Scalability Talk” It’s definitely worth reading!