A 2008 summary of site statistics, review of site improvements, and a look at groups and Greasefire. Want a t-shirts?
52,956,864 Pageviews in 2008
Over 1,400,000 dynamic requests per day
An average of 900 requests per minute (cpm is calls per minute) hit the rails code running the site (that is over half a billion dynamic requests per year). Pingdom lets me know when the server explodes (which happens at the worst possible times). The site has had less than 3 hours downtime over the last 3 months.
3.5TB downloaded, 0.5TB uploaded
The downstream bandwidth has averaged 971Kb per second for the year (1.4Mb per second since September!). If the site was hosted on Amazon's EC2, bandwidth would cost $445 for the year. I expect the bandwidth to double in 2009.
Constant battles with CPU
Red is BAD! To combat constant growth, there have been many rewrites and infratstucture improvements. Systems changes include sphinx for search, Phusion Passenger for app servers, Quantcast for public stats, and NewRelic for performance monitoring.
I cannot stress enough that the help given by community members in the site forum has been invaluable. After a long day working on my startup, their contributions give me the energy to spend more time in front of a computer trying to keep up with them. I'm grateful for all levels of help, from reporting a simple bug, helping newbies in forums, to writing html, css, and userscripts to improve the site.
The forum system was rewritten several times: moving script comments to forums, dealing with performance issues, read/unread status rewrite, stylistic improvements, and more. There were 44,673 posts in 2008 (and that doesn't include all the deleted spam).
The site had several major stylistic changes. The major being a new site header and script page. The year also brought many stylistic improvements from members (suggested in the forum).
Reviews were added in late October as a way to help users find the best scripts. So far 702 have been written (with 331 written in December).
Instead of overwriting the data with each upload, storing older versions of scripts was implemented. This helps answer the question "what changed?" and allows the community to watch for funny business by malicious script authors.
There are 25,386 scripts on the site, of which 15,286 were uploaded/updated in 2008.
The Future (where is my jet pack?)
In 2009 I'm concentrating on features that help users sort through all those scripts.
Steve Krulewitz wrote an open source extension called Greasefire help users know when there are scripts on userscripts.org written for the page they are viewing. Join him in the greasefire forum to discuss this new feature.
I've been working on groups with the goal of making it easier to find, share and collaborate on scripts (the first version released yesterday). A group can be centered around a site (NeoPets, Travian, Orkut, ...), concepts (using xpath), or a place for people to collaborate. The initial version of groups include members, forums and script collections. As the feature matures I hope to feature groups on the site homepage.
I plan on moving the entire site to Amazon's scalable infrastucture as I'm hitting the edge of what a single box can handle.
Last, I'm debating having a "userscripts t-shirts" made. Would you be interested in buying one? (probably $20 plus shipping for a high quality shirts) Let me know if you have opinions on the design or would buy one.
I hope that 2009 is another great year!
You could comment on this post if you were logged in.