As you can see in the below image the new magic “OS Settings…” button is now available.

Clicking on the “OS Settings…” button takes you to the following screen to configure your operating system options and how it is updated:

Hopefully, more updates will start rolling out to the dev portal over the coming months.

Infrastructure Access Layer (IAL)

The Infrastructure Access Layer is simply a way to abstract away your underlying infrastructure from your business logic or processing. This means that I can easily change how my applications interact with the infrastructure just by changing a method within the IAL and the business logic would be none the wiser.

Lets take a simple example, I may be developing an applications that takes work items and processes them. I create a method in the IAL called GetWorkItem which will return to my business logic the work item to be processed. This method can then call out to Azure Queues to get a work item, or maybe in the future you will want to switch out where we are getting the work item from, maybe we want to use a web service to call another location, use blob storage to store large work items or listen for a work item to be passed onto a service bus. This can all be dealt with in a single place.

All the business logic knows and cares about is that it is going to call the GetWorkItem method and get a work item back, not where it came from or how it received it it.

Cloud Ready…

Even with more and more people are moving toward the cloud, there are still companies that aren’t quite ready to make the jump, but realise that in the near future may have to and want to know how to create applications that will be able to transition easily to the cloud when they are ready.

By programming against the Infrastructure Access Layer companies will be able to make this move a lot smoother, by just replacing the needed classes so that they interact with the cloud rather than the old infrastructure.

A great example of this would be using a messaging system such as MSMQ as part of your on premise application, and then being able to easily switch this out for Windows Azure Queues or the App Fabric Service Bus when moving into the cloud. Having to make minimal if any changes to your business logic.

Keeping the cloud contained

As I talked about in my last post the cloud can end up getting everywhere and you can soon end up breaking the principle of DRY (Don’t  Repeat Yourself).

With the IAL you can easily keep the cloud contained, letting a minimal number of project have access to the cloud, making SDK upgrades and maintenance easier.

Is that it?

It is indeed. As I said at the start, the IAL is a simple concept that allows you to abstract away your underlying infrastructure from your business logic and also help create cloud ready applications for when people are ready to make that push to the cloud.

Clouds can Spread …

The ash cloud started out in Iceland where it eventually moved and spread out to cover the UK and Europe, even some reports say that it got as far as Canada. Grounding planes and crippling transport for a number of weeks.

This got me thinking, not all clouds are nice white clouds, some are evil volcanic clouds that actually do more harm than good especially when not contained to where we want them to be.  (the ash cloud would have been fine if it had not strayed into European airspace).

The same is true in your applications, when developing for the cloud you can find that the cloud can end up spreading throughout your applications and if your not careful touching every section of code you write.

This can then be a real problem when the underlying SDK to interact with the cloud changes and you have to go through all of your application looking where to refractor and make changes.

Contain Your Cloud

To combat this I contain any code that will access the cloud within few specialised “cloud” projects within my application.

This means that throughout the application if I want to access the Azure message queue, I call a single method from one of my cloud project that will return me a message, meaning that no other part of you application needs to know how to deal with the cloud.

Added Benefits

Containing your cloud not only allows you to keep to the DRY principles and code re-use it, makes maintenance of your application easier and can reduce code smells. One of the biggest benefits is that it also allows you to easier test your applications without having to rely on the cloud or developer fabric, as you can create your cloud methods in a mock-able way.

I have recently been asked a number of questions both internally and from customers about when you will be billed for Azure usage.

As Eric Nelson’s recent post describes, if you suspend a service you will still be paying this is due to the fact you will still have your application deployed on the server ready to start again. With your application utilizing the server others will not be able to provision its usage.

When you select delete you will stop paying as you will no longer have servers provisioned for your application and the recourses will be freed up for others to use.

Memcached is a distributed cache used to help speeding up large scale web applications by taking pressure off the database. Memcached is used by many of the internets biggest sites, including Twitter, Wikipedia, and YouTube to name just a few.

A distributed cache is one of the things that I’ve been hoping to see released for Windows Azure for quite a while, and I am hoping that AppFabric Caching will make the move to the cloud in the coming year. However, until that happens I was determined to find a way to get a distributed cache and this great Windows Azure Memcached sample showed me how.

“Brad Fitzpatrick, I love your ass!"

Sorry, I just couldn’t help myself. I found this great quote on in the Caching Story page of the Memcached wiki.

After installing and setting up Memcached you will be able to cache any data, including data that is retrieved from your database so that the next time you need it you can get it from cache and not need to re-query your database. Therefore, reduce the pressure on the database and earning the love of our DBA.

Azure Memcached sample

You can download the sample code for Windows Azure from the codeplex download page you then need to download a Windows friendly version of Memcached (here is where I got mine). With the sample code from codeplex just add the memcached exe to your worker roles. You will now be able to run the sample code either on the dev fabric or in the cloud.

One thing to watch out for, the Memcached exe’s seem to take an age to get up and running. I actually left mine to set up overnight (glad I’m still on a CTP account) as the Memcached Worker Roles were all showing busy for a long time, during which the sample would not work correctly.

After the servers have started up you can easily set and retrieve values from the cache as shown in the screenshots below.

Under the hood

Now that we have got our distributed cache working lets have a look how the sample code works.

Memcached Server

On the server side we set up an internal endpoint that will be used to connect the clients to the Memcached server. When the node is created we launch the Memcached server that we downloaded before, passing in the nodes cache size and endpoint as arguments.

          string arguments = 	"-m " + cacheSize +
				" -l " + endpoint.Address +
				" -p " + endpoint.Port;

            ProcessStartInfo startInfo = new ProcessStartInfo();
            startInfo.CreateNoWindow = false;
            startInfo.UseShellExecute = false;
            startInfo.FileName = "memcached.exe";
            startInfo.WindowStyle = ProcessWindowStyle.Hidden;
            startInfo.Arguments = arguments;

This node is now exposing a Memcached server, which can be used by the client nodes to cache data.

Utilizing Memcached – Clients

The client node in the example looks a lot more complicated that it actually is. The most important part is adding the configuration for our memcached client within the settings tab of the node.

Then comes the interesting bit using the Enyim caching library (others libraries are available) and creating a MemcachedClient object, allowing us to get and set objects in the cache.

Each time a new MemcacedClient is needed the program loads a configuration based upon the data within the settings (picture above) and then loops through all of the instances of memcached servers nodes that we are running in our hosted service getting their endpoint, to add this to the configuration of available servers.

            _endpoints = new Dictionary();

            foreach (var endpoint in RoleEnvironment.Roles[_memcachedRoleName].Instances)
            {
                foreach (var epi in endpoint.InstanceEndpoints)
                  {
                    if (epi.Key == "memcached")
                    {

                        _endpoints.Add(epi.Value.RoleInstance.Id.ToString(),epi.Value.IPEndpoint);
                    }
                }
            }

Now that the connection to our memcached nodes we can use the caching library to set and get values in the cache.

AzureMemcached.Client.Store(StoreMode.Set, key, value);          

AzureMemcached.Client.Get(key);

With this code we now have distributed caching on Windows Azure, and can use the example to build out much bigger applications.  

The natural progression from here was to get the code working from within a web or worker role instance hosted within the cloud. Using a web role, I used the OnStart method to set up a IServiceManagent class that could then be shared with the remainder of the classes within the role.

When tracing the hosted services from either the OnStart method or from within default.aspx.cs I could successfully print out all of the services within my account. However, when I set up a WCF REST service to return these hosted services in an array I started to get an error with the connection to the Management API. Giving a argument error stating that a property with the name “httpRequest” is not present. This was even happening when I was using exactly the same code as I was elsewhere.

After a push in the right direction from Simon Davies we found out  that the issue was in the WCF REST service already having an OperationContext from the original REST call before calling out to the Service Management API. This handy blog post, help solve all my issues, all that was needed was to create a second OperationalContext before calling the management service.

using(new OperationContextScope((IContextChannel)WebRole.serviceManagement))
{
  var hostedServices = WebRole.serviceManagement.ListHostedServices(subscriberID);

  foreach (HostedService service in hostedServices)
  {
    Trace.TraceInformation("Hosted Service: {0}", service.ServiceName);
  }
}
            

Ta dar … everything now works, we can use the above code snippet to retrieve back all our hosted services by calling our own web role.

This afternoon I noticed that I was able to select Europe and Asia regions to deploy my Azure application.

I have yet to see official word of these locations being available, but this must be for the move from CTP to production.

Eye On Earth is a new application that provides air and water quality to more than 500 million people across Europe, using both measurement stations and modelling data, along with social observations from people around not only Europe, but the whole world.

This is one of the first applications to be built and run on Windows Azure and SQL Azure allowing near real-time data to be presented at air stations and in a Europe wide air quality model.

Environmental issues, Bleeding Edge Solution

Eye On Earth uses a number of bleeding edge technologies including Windows Azure, SQL Azure and Silverlight to bring a rich user experience that can be scaled on demand whilst still processing all the near real-time data.

One of the first things that you notice when you visit Eye on Earth is how great it looks- it really shows off what you can do with Silverlight and the latest Bing Maps Silverlight Control.

Windows Azure is at the core of Eye On Earth and is not only used to host the front end, but also on the back end sits on it too – with a number of worker roles that are used to process compute intense tasks, without effecting the performance of the front end.

Eye on Earth is heavily focused on data, all of which is stored and queried using SQL Azure, along with this the application has large volumes of data being entered at near real-time from the European Environmental Agency.

But I Don’t Have Silverlight …

Eye On Earth will still love you. While it was primarily designed to be run as a Silverlight application, but with not everyone being able to use this technology, a parallel site has also been created using ASP.NET (along with some blood, sweat and tears). The ASP.NET version not only allows you to run the application anywhere – it gives you the vast majority of the features you would see in the Silverlight version.

Along with ASP.NET the team utilized jQuery and the recently released Microsoft AJAX Content Delivery Network (CDN) to give all the rich user interactions without the power of Silverlight. When being re-directed to this version of the site you can hardly tell the difference between what you would have experienced in Silverlight and what you see in ASP.NET

Quick Tip – turn off Silverlight and check it out.

Lighting up Europe

Eye on Earth has a number of “light maps” that are overlaid on a Bing Map controls to show a visual representation of both the air and water stations as well as user feedback.

Different coloured dots are used to visualise where the measurement stations are and allows users to zoom in and view more fine grained data.

User feedback, for both air and water quality can be turned on and off at the top of the map control and will show a colour coded display of where users have rated the air or water in a given location. These user ratings are coloured differently to the official readings, so that the user will be able view the social rating of given areas.

As more users rate the air and water quality around the world the light map will automatically re-generate and show an updated view of the social ratings.

Each of the light map tiles in the application have been generated using using a number complex algorithms, and processed on Azure worker roles before being stored in blobs for retrieval when a user views the site. This makes it much easier to create the tiles in parallel over multiple nodes, ensuring that the process is both fast and efficient.

Modelling Air Quality

You can also see air quality models put together by the European Environmental Agency on an hourly basis. With this model, users can be given a overview of the quality of the air around Europe from either a heat map, or placing push pins.

As this data arrives it is directly input into SQL Azure and processed, and passing the a number of compute tasks to Azure worker roles so that the images are generated correctly and displayed in the fastest possible manner.

Station to Station

As you zoom into the map within the Eye on Earth application measurement station appear as icons. Round icons represent water stations and the square icons with a wind-sock represent the air stations.

You can mouse over or click on individual measurement stations, to view more in depth data about the given station. On the left hand side the station will show the official EEA rating and a break down of the measurements that give the station this rating. On the right social user ratings are displayed, giving an idea of how the general public rate the air or water quality at the given location.

As you can see in the image this station has a good user rating, but a rating of very good from the EEA.

As more users rate the station or the air in surrounding areas, the word cloud on the left will update giving an idea of keywords that users have selected when rating the quality at this location.

Eye on Earth also displays historical water data on the water stations, allowing the user to see what the station has measured the water to be like over the past couple of years. Along with a yearly update seasonal updates will be displayed, showing how the current water season has been for the location.

We Live in a Social Environment

It’s not just the EEA that get to put data on the site – as a user, you can rate the quality of air and water in your region too.

Rating a location is simple, all you need to do is identify how good the air or water quality is at this location and then select one or more rating keywords that best describe the area.

Sharing the data at a given location can be via a number of social networks, including Facebook, Twitter and Live Spaces.

I Can See my House from Up Here

Viewing the air data within Europe is not restricted only to the measurement stations within the application. Using the air model we allow users to place pushpins anywhere on the map, and if this is within the data areas for the model it will return what the quality of air is at that location.

The user will then be able to rate or share the information at this pushpin location as if they had viewed the data from a measurement station.

If the pushpin is placed outside of the air model for Europe no air data will be retrieved, however you will still be able to rate the air at the location, using the rate button. This allows something that doesn’t exit anywhere else – a worldwide air quality indication generated by users.

Data On the Go, via SMS

Users wont always be in the comfort of their own home or workplace  and therefore not always have access to a computer – and so it was a logical step to build a mobile solution into the application for the user to get data on the move.

Eye On Earth has a SMS service that allows users to text in their location, and retrieve an automated response showing what the quality is like at the given location. 

Je Ne Comprends Pas

It’s always easy to forget that English isn’t everyone’s first language – and over the next couple of weeks we’ll be adding 24 additional languages to the Eye On Earth site, enabling more and more individuals to benefit from the site via Silverlight, ASP.NET and SMS.

Eye on Earth will automatically detect your locale as it loads, and switch not only to the correct language but also giving you localized map controls.

And Finally…

Eye on Earth is a stunning, elegant and full featured application that allows businesses, governments and individuals from around Europe to view and rate the air and water quality where they are, using the latest technologies such as Azure and Silverlight. All of this data contributes to the biggest, most up-to-date Europe wide map of air and water quality publicly available on the Internet.

Go to www.eyeonearth.eu and try the site yourself.

Along with my talk, Ben Nunney will be giving a presentation on Powershell for developers. Showing how developers can make PowerShell work for them, whilst proving that the command line is still cool.

Here is a breakdown of the event with overviews of each talk:

Cloud Coffee – Dominic Green

Cloud Coffee is the latest in a wide range of coffee shops on the high-street. What makes Cloud Coffee different is that they use latest “cloud” principles, keeping costs low by using utility based staffing, maintaining a decoupled working environment and ensuring good scalability to meet customer demand. Cloud Coffee has very quickly risen to high street fame.
This analogy will help you understand how things work in the cloud, specifically Windows Azure. During this talk Dominic will elaborate and expand upon on the concept of ‘Cloud Coffee’, sharing some of the lessons he learned whilst developing one of the first production applications for the Windows Azure Platform.

The Power of PowerShell – Ben Nunney

It’s a long time since DOS ruled the world, and the classic command shell was in serious need of an upgrade. Enter PowerShell – focusing on accuracy, extensibility, and congruent syntax, it is one of the most powerful and misunderstood things to come out of Microsoft in recent years. Who says a command shell can’t be interesting? By the time the session is over you’ll have seen what PowerShell can do for you as a developer, know exactly how to get there, and who knows – you may have even fallen in love with the command line all over again.

You can find out more information and register for the event here.