Posts Tagged ‘EC2’

Scalr 1.1.0 – getting in touch – Part I

Thursday, August 6th, 2009

Today my friend and business partner Raphael pointed me to the new release of Scalr. I knew Scalr from the past, but i did not get in detailed touch yet. Scalr released version 1.1.0 under the GPL v2- and now I thought about to give it a detailed try.
Scalr promise alot of value within Cloud Computing and the use of Amazon EC2.

Scalr is a fully redundant, self-curing and self-scaling hosting environment using Amazon’s EC2.

It allows you to create server farms through a web-based interface using prebuilt AMI’s for load balancers (pound, nginx, or Amazon’s load balancing service), app servers (apache, rails, others), databases (mysql master-slave, others), and a generic AMI to build on top of.

The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it.

Multiple AMI’s are provided for load balancers, mysql databases, application servers, and a generic base image to customize. Scalr allows you to further customize each image, bundle the image and use that for future nodes that are inserted into the farm. You can make changes to one machine and use that for a specific type of node. New machines of this type will be brought online to meet current levels and the old machines are terminated one by one.

Under http://www.scalr.net is also a pay service available, but i want to build my own environment.

If you want to install Scalr the wiki is a good starting point.
I droped some lines here in my blog to document my installation on a Ubuntu 9.04 Server.

Systemrequirements are definied on the project website as follows:

  • PHP 5.2.5 or higher
  • MySQL 5.0 or higher (MySQL 5.1 or higher preferred)
  • My server installation was build up with a LAMP. A good How-To for LAMP installation you can find here.

    I had to customize my PHP5 installation for the required PHP extension listed in the project wiki. I searched for the plugins with following command
    apt-cache search php5-*, and installed the required extensions manually.

    Furthermore I created a database for scalr and a valid user for it.

    # mysql -u -p
    Enter password:
    Welcome to the MySQL monitor. Commands end with ; or \g.
    Your MySQL connection id is 41
    Server version: 5.0.75-0ubuntu10.2 (Ubuntu)
    mysql> CREATE DATABASE ;
    Query OK, 1 row affected (0.00 sec)

    mysql> GRANT ALL PRIVILEGES ON .* TO ""@"localhost" IDENTIFIED BY "";
    Query OK, 0 rows affected (0.00 sec)

    mysql> FLUSH PRIVILEGES;
    Query OK, 0 rows affected (0.01 sec)

    mysql> EXIT
    Bye

    (more…)

    Ian Foster – What’s faster–a supercomputer or EC2?

    Wednesday, August 5th, 2009

    I found this interesting article about a comparison today, you should read the whole article here:

    • On EC2, I am told that it may take ~5 minutes to start 32 nodes (depending on image size), so with high probability we will finish the LU benchmark within 100 + 300 = 400 secs.
    • On the supercomputer, we can use Rich Wolksi’s QBETS queue time estimation service to get a bound on the queue time. When I tried this in June, QBETS told me that if I wanted 32 nodes for 20 seconds, the probability of me getting those nodes within 400 secs was only 34%–not good odds.
    • ianfoster.typepad.com, Ian Foster, Aug 2009

     

    These comparisons depends from my point of view always on experienced data and mainly on your various scenario Neutral declarations are hard to find. I asked Thijs Metsch for some experienced data of RESERVOIR project he mentoined in Twitter. Looking forward for an answer from him…
    Does anyone else have some own experienced data for starting EC2 images in different environments and with various scenarios?