Amazon data warehouse migration to Amazon Redshift

Informative video on moving an Oracle RAC and Hadoop based web log data mining solution to Amazon Redshift:

https://www.youtube.com/watch?v=P4KPPvEb_QI

EMR : Common use cases

Here are a couple of common use cases for EMR:

1. Creating sessions from weblogs : The sequence of web pages through which

a user navigated is an example of a session. Sessionization is one of the first steps in many types of log analysis and management, such as personalized website optimization, infrastructure operation optimization, and security analytics.

One study used 150 billion log entries (~24 TB) from 1 million users and produced 1.6 billion sessions. 

2. Recommendation engine : The EMR cluster reads a history of movie ratings from multiple users regarding multiple movies. Then, it builds a co-occurrence matrix that scores the similarity of each pair of movies. Combining the matrix and each user’s movie-rating history, the engine predicts a given user’s preference on unrated movies. 

AWS Oracle RDS two new features

These are two new features:

1. Rename the end point of an existing database : http://aws.amazon.com/about-aws/whats-new/2013/01/14/amazon-rds-now-provides-ability-to-rename-database-instances/
2. View database logs : http://aws.amazon.com/about-aws/whats-new/2013/03/04/amazon-rds-db-log-access/