scuttle: scalability

Sort by: Date / Title / URL

  1. An open source equivalent to Google's BigTable.
  2. Simple script to monitor mysql replication delay. It updates a value on the master every second and checks how far behind the value is on the slave. Simple yet effective.
  3. Clever approach to monitoring mysql replication with monit. Ruby script checks replication is running and then touches a file, monit in turn monitors that file's timestamp and if it gets out of date, sends an alert. Sort of like a dead man switch. Clever.
  4. YSlow rules for optimising web performance from the Yahoo Developer Network. 34 rules that make sites faster. Very useful reading.
  5. Another cloud based scale solution for MySQL, aims to simplify deploying MySQL "in the cloud".
  6. Cloud based database that tries to achieve a new type of scalable, highly available, fault tolerant persistent data storage layer in "the cloud".
  7. 1TB of data for $39 (limited offer at 18 Mar 2011). Hat tip Anthony Feint. Plugins for drupal, wordpress, etc. Data is around 10c/gb up to 50TBs, comparable to EC2.
  8. Interesting write up by James at Incsub on how they handle scale on edublogs. Some good advice although a little light on specifics, a good starting point for research.
  9. Robert Scoble hosts a webinar session on avoiding the fail whale at scale. Includes the guy who built Gmail and now Friendfeed, Technorati and iLike.
  10. YSlow is an extension for Firebug which shows ways to speed up page loads. It's published by Yahoo as part of their developer network.
  11. Collectl is a system monitoring tool. It logs a wide range of system metrics (disk, cpu, io, etc) and stores them in a variety of formats. It tries to cover all the bases unlike some other tools which focus on one or two methods.
  12. Ultra Moneky is a load balancer similar to the likes of pound and haproxy. It allows multiple web servers to be seen as 1 by the client.
  13. HAProxy is a TCP proxy / load balancer which will work for HTTP and a range of other applications. It advertises a small but expert user base and offers a range of very useful load balancing features. Apparently it competes with pound and ultramonkey.
  14. Hadoop is a distributed computing platform / filesystem. It provides HDFS which is similar to GFS (Google Filesystem) and MapReduce which splits programming tasks into small chunks. It's target is 10'000 node clusters.
  15. ChironFS is a fuse based filesystem that supports multiple backends. Writes are written to multiple hosts, reads come from a single host. It removes single points of failure and provides real time duplication / backup.
  16. WebLOAD is an open source web site stress testing tool. Useful for simulating load on servers.
  17. The Linux Virtual Server as an advanced load balancing solution can be used to build highly scalable and highly available network services, such as scalable web, cache, mail, ftp, media and VoIP services.
  18. Puppet is a system to abstract system administrator tasks such as configuring web servers, deploying database servers, and so on. It provides an abstract language to specify configurations and then handles deployment for you.
  19. A file is split into n chunks, encoded such that any m chunks (m<n) can be used to rebuild the original file. It can use half of the alternative storage requirements, but requires cpu overhead.
  20. WeoCEO is designed to provide a constant front end to Amazon EC2 / S3 services. It provides stable IP, load balancing and DNS management to ensure your app stays online.
  21. Grid computing from Sun.
  22. Perdition is a fully featured POP3 and IMAP4 proxy server. It is able to handle both SSL and non-SSL connections and redirect users to a real-server based on a database lookup.
  23. This site tries to bring together all the lore, art, science, practice, and experience of building scalable websites into one place so you can learn how to build your system with confidence.

First / Previous / Next / Last / Page 1 of 1