Unexpected AWS S3 monthly statement

December 16th, 2009

At our company we are using Amazon S3 as data storage for several use cases. For debugging our services and watching traffic in/out to the S3 buckets, S3 logging on several buckets have been active. Within the bill of november, the PUT, COPY, POST, or LIST requests have literally “exploded”. Amazon charges those requests with $0.01 per 1,000 requests. In our case, the monthly statement was higher by factor 20, case we activated S3 logging on our buckets!

So be careful if you activate S3 bucket logging, your the PUT, COPY, POST, or LIST requests will be higher and you will be charged for them, although your are logging within the S3 infrastructure to another bucket.

At this point i want to recommend a nice S3 GUI tool for managing your S3 infrstructure: S3 Bucketexplorer

85 Prozent der Kandidaten zur Bundestagswahl 2009 im Netz

September 22nd, 2009

270px-Bundestag

Bei der Wahl zum 17. Deutschen Bundestag am 27. September 2009 sind etwa 62 Millionen Deutsche wahlberechtigt. 3556 Kandidatinnen und Kandidaten bewerben sich am 27. September um einen Sitz im Bundestag. „Wen wählen?“ fragen sich heute noch viele Menschen, denn immer mehr Wähler entscheiden sich immer kurzfristiger. „Etwa 40 Prozent beschäftigen sich erst in den letzten zwei Wochen mit der Wahl und entscheiden dann, für welche Partei sie stimmen – oft auch erst am Wahltag“, sagt Prof. Dr. Frank Brettschneider, Politologe an der Universität Hohenheim.

Eine Analyse der Volz Innovation GmbH zeigt, dass 3050 Kandidatinnen und Kandidaten der Bundestagswahl 2009 (rund 85%) im Internet präsent sind und so die Meinungsbildung der Wähler zusätzlich zu den Internetpräsenzen ihrer Parteien unterstützen. Die „Online-Quote“ der Bewerber um die Mandate unterscheidet sich allerdings erheblich zwischen den Parteien selbst. Die CSU ist die einzige große Partei, bei der alle Kandidaten online zu finden sind. Unter den kleinen Parteien trifft dies nur für die PBC (Partei Bibeltreuer Christen), die Freie Union und die Freien Wähler Deutschland (FWD) in Brandenburg zu. Die Schlusslichter bilden die Kandidaten der Deutschen Kommunistischen Partei (DKP) und des Zentrums, von welchen weniger als ein Fünftel Informationen über sich im Internet bereitstellen.

Informationen über die Kandidatinnen und Kandidaten der kleinen Parteien können oft nur über Kandidatenverzeichnisse wie abgeordnetenwatch.de gefunden werden. Dies ist bei über 80% der Kandidaten der Bayernpartei (BP) und der FWD der Fall. Die besten Informationen zu rund 190 Kandidaten der im Parlament vertretenen Parteien finden sich bei wahl.de. Über 60% der zur Wahl stehenden Personen nehmen den Aufwand eines eigenen Internet-Angebotes in Kauf, welches dann entweder unter eigenen Internet-Adressen oder auf Unterseiten von Internet-Adressen ihrer Partei zu finden ist.

Die einzelnen Internetauftritte sind oft nur schwer zu finden. Dies zeigt auf, dass nur wenige Bundestagskandidaten eine Suchmaschinenoptimierung vornehmen, um bei den großen Suchmaschinen unter den ersten Suchergebnissen zu stehen. Zur Demonstration des neuen Internetdienst KNOXOS (www.knoxos.com), der sich auf die Suche in selbstdefinierten Teilen des Web konzentriert, hat die Volz Innovation GmbH die Liste der Kandidatenwebseiten zusammengetragen und deren Inhalte in KNOXOS durchsuchbar gemacht.

Damit steht eine präzise Suchmaschine für die Informationen auf den Startseiten der Kandidatinnen und Kandidaten zur Verfügung, welche die eigene Wahlentscheidung unterstützen kann. KNOXOS zeigt darüber hinaus immer aktuell auf, welche Anstrengungen die Kandidaten in dieser letzten „heißen“ Woche vor der Wahl auf sich nehmen. Viele Kandidaten berichten online über Ihre öffentlichen Auftritte und nehmen Stellung zu Fragen der Wähler.

KNOXOS (www.knoxos.com) ist ein neuer Internetdienst, der interessante Inhalte im Web für seine Nutzer beobachtet und durchsuchbar macht. KNOXOS zeigt gefundene Aktualisierungen in einer Änderungsansicht sofort an. KNOXOS hilft dabei, im Web nichts mehr zu verpassen und alles wieder zu finden.

KNOXOS ist ein Internet-Dienst der Volz Innovation GmbH (www.volzinnovation.com) und wurde im Frühjahr 2009 im Gründerwettbewerb Multimedia des Bundesministerium für Wirtschaft und Technologie (BMWi) ausgezeichnet. Die neuartige Suchtechnologie in KNOXOS wurde zum Teil im Forschungsprogramm THESEUS entwickelt. THESEUS (www.theseus-programm.de) ist ein deutsches Forschungsprogramm mit dem Ziel, eine neue internetbasierte Wissensinfrastruktur zu entwickeln.

New Mechanism to Clean your Mobile Device

August 23rd, 2009

Recently, my friend Markus and I developed a prototype and filed a utility patent for a cleaning mechanism for mobile devices. The mechanism is integrated into the box that is used to carry the device, such as a belt pouch.

Foto2

Both protect and clean your mobile device
We came up with the idea when we noticed that touchscreen devices, such as digital cameras, iPhone, etc. become dirty quickly due to grease spots and finger prints on the touchscreen surface. Currently available bags and boxes only have limited support for cleaning mechanisms, e.g. a bag with microfiber lining. Such bags suffer from lack of stability and robustness of the outer shell and do not protect the device from physical damage. Therefore, our cleaning mechanism is targeted at boxes, such as belt pouches, which can be equipped with a hard shell that protects the device.

clean-your-mobile-phone-01

If you are interested in learning more about our patented mechanism or would like to get in touch to purchase a prototypical belt pouch, just drop us a line.

Publication number: DE202009002049 (U1)

Scalr 1.1.0 – getting in touch – Part II

August 21st, 2009

As I promised in a further post I document here in my blog further steps and experiences in running Scalr on an own server infrastructure.

After Scalr was set up as described in my first post, some additional configurations have to be done to get in detailed touch with Scalr 1.1.0.
First log in as admin user to the Scalr frontend and create a new system user (”Client”) and activate it. After successful login with the new created and active user, you have to enter your AWS credentials and upload your public and private key from your AWS account.

The next screenshot show the configuration within my user.
scalr system user AWS settings

Be aware to set this configuration right otherwise you will not be able to proceed.

Read the rest of this entry »

Google Insight Search – Cloud, Grid, DC, Virt

August 18th, 2009

Today I tested and played around with Google “Insight for Search” and the following terms:

  • Cloud Computing
  • Grid Computing
  • Distributed Computing
  • Virtualization

The next screenshot shows my query configuration:
google insight search query

I selected all categories because google will list those for you automaticly (in my case, the categories were: Computers & Electronics, Reference, Local, Entertainment, Society, Internet)

The interest over time is displayed in following graph:

A nice feature at this point is the “Forecast”-function. You can select it and the baseline in the graph will end in the future.

Read the rest of this entry »

The Dasein Cloud API – (another) promising approach?

August 17th, 2009

Today i found a promising news article about another Cloud API (The Dasein Cloud API – O’Reilly Broadcast). I became aware of this article because Georg Reese is behind this project. He wrote the excellent book Cloud Application Architectures – I can highly recommend it. The Dasein Cloud API is supported by enStratus, a company founded by Georg Reese. The Dasein Cloud API project site is hosted at sourceforge.

What’s about the Dasein Coud API?

Dasein Cloud provides a cloud-independent interface in Java for accessing cloud resources. If you are writing an application to manage your cloud infrastructure, you write the calls against the Dasein Cloud API without having to learn the specifics of the web services calls from different providers like Amazon Web Services and Rackspace. Cloud providers can then provide cloud-specific implementations of the API that simply plug in to your application without any need for changing your code. The model is very much like JDBC.

This approach sounds very intersting, but is from my point of view on the providers and players of cloud computing services. Georg mantoined that also in his article.

enStratus has made available its Amazon Web Services implementation both as a reference implementation and a working system for Dasein Cloud + AWS. enStratus will be releasing implementations for other providers, and hopefully providers will begin providing their own implementations.

I think about the motivation for providers to contribute to the Dasein Cloud API. Is it not likely that a provider focus on its own API sets first? I think only with a large distribution and from a certain awareness, a provider will be motivated to provide his own implementations. I’m excited about the Dasein Cloud API future progress and which providers would provide their own implementations.

It’s clear that a common standard for a independent Cloud API in general would have a positive impact for all players in Cloud Computing…

The following independent “Cloud API approaches” I have researched so far amongst others for my Master Thesis:

What are other promising projects of this kind?

If Twitter Consisted of 100 People [Gorgeous Graphics]

August 17th, 2009

If Twitter Consisted of 100 People [Gorgeous Graphics]

Posted using ShareThis

http://1.abe.nu – yet another Url Shortener built with Google App Engine

August 16th, 2009

Since Twitter and other microblogging services became so pupular, url shortener (e.g. bit.ly, tinyurl.com, ow.ly, etc.) are experiencing an other renaissance and are very popular again.

To build your own URL shortener within minutes you only need:

wmshorty is an Url Shortener for Google App Engine. You only have to follow the fews steps described on the project site, to set up wmshorty with Google App Engine. I used my own domain within Google Apps as described here. You have to configure your own domain within Google Apps. There is no other possibility to do that – for me a, at that point, disadvantage of Google App Engine – the PaaS of Google. Maybe in the future there will be other ways to configure own domains within Google App Engine…

If you are using Wordpress you might be interested in this related article “WP.me — shorten your links“. This article is about Wordpress own url shortener “wp.me”. I will use my own url shortener http://1.abe.nu , built like desrcibed above to get some performance results within Google App Engine which results (if these are meaningful) will be used in my Master Thesis research.

TED: MIT Students Turn Internet Into a Sixth Human Sense

August 16th, 2009

Would it not be awesome to have a “Sixth Sense” ? Read the interesting article TED: MIT Students Turn Internet Into a Sixth Human Sense — Video and get impressed how a “Sixth Human Sense” might look like in the future.

The research project site is available here.

What The Hell Is Cloud Computing?

August 12th, 2009

A classic: IT’s “enfant terrible” – Larry Ellison explain Cloud Computing in his irresistible nature (found on youtube):

If you ask yourself, is Larry Ellison really anti-cloud computing? This good post by William Hurley gives you a possible answer:

… Larry’s comments about cloud computing remind me of the times he bashed virtualisation back in the day. Everyone spread similar rumours then, and the transition from hatin’ to embracin’ looked almost identical.

In other words, Larry didn’t have an informed opinion the first time he was asked about virtualisation. Once he did, his story quickly changed from disparaging virtualisation to announcing Oracle VM, and eventually acquiring companies like Virtual Iron. So far my sources say the alleged cloud computing reversal is the same situation…

John Willis Guest Blogging at Force of Good – Government’s Gone Cloud

August 12th, 2009

John Willis posted a cool guest article on Lance Weatherby’s weblog. The introduction to the post:

Last week the first sentence of an article in the InformationWeek periodical specifically targeted at IT employees of the U.S. Government read as follows:

‘The General Services Administration has issued a Request For Quotation for cloud storage, Web hosting, and virtual machine services.’

You can read the whole post here.

Read the rest of this entry »

Scalr 1.1.0 – getting in touch – Part I

August 6th, 2009

Today my friend and business partner Raphael pointed me to the new release of Scalr. I knew Scalr from the past, but i did not get in detailed touch yet. Scalr released version 1.1.0 under the GPL v2- and now I thought about to give it a detailed try.
Scalr promise alot of value within Cloud Computing and the use of Amazon EC2.

Scalr is a fully redundant, self-curing and self-scaling hosting environment using Amazon’s EC2.

It allows you to create server farms through a web-based interface using prebuilt AMI’s for load balancers (pound, nginx, or Amazon’s load balancing service), app servers (apache, rails, others), databases (mysql master-slave, others), and a generic AMI to build on top of.

The health of the farm is continuously monitored and maintained. When the Load Average on a type of node goes above a configurable threshold a new node is inserted into the farm to spread the load and the cluster is reconfigured. When a node crashes a new machine of that type is inserted into the farm to replace it.

Multiple AMI’s are provided for load balancers, mysql databases, application servers, and a generic base image to customize. Scalr allows you to further customize each image, bundle the image and use that for future nodes that are inserted into the farm. You can make changes to one machine and use that for a specific type of node. New machines of this type will be brought online to meet current levels and the old machines are terminated one by one.

Under http://www.scalr.net is also a pay service available, but i want to build my own environment.

If you want to install Scalr the wiki is a good starting point.
I droped some lines here in my blog to document my installation on a Ubuntu 9.04 Server.

Systemrequirements are definied on the project website as follows:

  • PHP 5.2.5 or higher
  • MySQL 5.0 or higher (MySQL 5.1 or higher preferred)
  • My server installation was build up with a LAMP. A good How-To for LAMP installation you can find here.

    I had to customize my PHP5 installation for the required PHP extension listed in the project wiki. I searched for the plugins with following command
    apt-cache search php5-*, and installed the required extensions manually.

    Furthermore I created a database for scalr and a valid user for it.

    # mysql -u -p
    Enter password:
    Welcome to the MySQL monitor. Commands end with ; or \g.
    Your MySQL connection id is 41
    Server version: 5.0.75-0ubuntu10.2 (Ubuntu)
    mysql> CREATE DATABASE ;
    Query OK, 1 row affected (0.00 sec)

    mysql> GRANT ALL PRIVILEGES ON .* TO ""@"localhost" IDENTIFIED BY "";
    Query OK, 0 rows affected (0.00 sec)

    mysql> FLUSH PRIVILEGES;
    Query OK, 0 rows affected (0.01 sec)

    mysql> EXIT
    Bye

    Read the rest of this entry »