Showing posts with label database. Show all posts
Showing posts with label database. Show all posts

Thursday, April 2, 2015

AWS Migration Sessions

Migrating large fleets of legacy applications to AWS cloud infrastructure requires careful planning, since each phase needs to balance risk tolerance against the speed of migration.
Through participation in many large-scale migration engagements with customers, AWS Professional Services has developed a set of successful best practices, tools, and techniques that help migration factories optimize speed of delivery and success rate. In this session, we cover the complete lifecycle of an application portfolio migration with special emphasis on how to organize and conduct the assessment and how to identify elements that can benefit from cloud architecture.

April 9th in SF @ Moscone 

Breakout Sessions 2:00 - 3:00

Cloud Migration, Application Modernization and Security for Partners

As AWS continues to expand, enterprise customers are increasingly looking to our partner ecosystem to assist in migrating their workloads to the cloud. This session describes the challenges, lessons learned and best practices for large scale application migrations. We will use real examples from our consulting partners and AWS Professional Services to illustrate how to move workloads to the cloud while modernizing the associated applications to take advantage of AWS’ unique benefits. We will also dive into how to use an array of AWS services and features to improve a customer’s security posture as they are migrating and once they are up and running in the cloud.


Monday, January 5, 2015

Migrating to AWS : Amazon.com

Nice session on how Amazon.com has migrated several different types of workloads to AWS:
1. Rehost - Amazon.com web site : Details on an existing workload migrated to AWS.  'Classic' web site migration of web application to AWS.
2. Rearchitecture  - Database migration : Migrating application data to AWS from a traditional data store to AWS is way to reduce costs.  This use cases uses an Information Lifecycle approach to moving data off of a live production databases to S3. 
3. Replace - Application replacement : Deprecation of an order system, and implementing the new order system on AWS.
4. Green field : Using AWS for development of a new video service used internally at Amazon.

The video goes into details on how AWS can reduce costs, improve development productivity, enable elastic infrastructure, increase scalability, and improve high availability. 

Sunday, June 22, 2014

Amazon RDS using private IP to connect to database - not the right approach

You should always connect to your Amazon RDS instance using the RDS endpoint in the AWS console. However, some IT folks chose to use the private IP address of the RDS instance.  It is easy for you to determine the private IP address of your RDS instance by using the host or dig commands as follows (Keep in mind this is not recommended but it shows how easy it is for IT personnel that don't want to use the RDS endpoint can do so):

[ec2-user@ip-10-0-0-50 ~]$ host postgres.cyve56loidht.us-west-2.rds.amazonaws.com
postgres.cyve56loidht.us-west-2.rds.amazonaws.com is an alias for ec2-54-201-99-99.us-west-2.compute.amazonaws.com.
ec2-54-201-75-58.us-west-2.compute.amazonaws.com has address 10.0.5.204
[ec2-user@ip-10-0-0-50 ~]$ ping 10.0.5.204
PING 10.0.5.204 (10.0.5.204) 56(84) bytes of data.
^C
--- 10.0.5.204 ping statistics ---
10 packets transmitted, 0 received, 100% packet loss, time 9792ms

[ec2-user@ip-10-0-0-50 ~]$ dig postgres.cyve56loidht.us-west-2.rds.amazonaws.com

; <<>> DiG 9.8.2rc1-RedHat-9.8.2-0.17.rc1.28.amzn1 <<>> postgres.cyve56loidht.us-west-2.rds.amazonaws.com
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 25864
;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 0

;; QUESTION SECTION:
;postgres.cyve56loidht.us-west-2.rds.amazonaws.com. IN A

;; ANSWER SECTION:
postgres.cyve56loidht.us-west-2.rds.amazonaws.com. 5 IN CNAME ec2-54-201-99-99.us-west-2.compute.amazonaws.com.
ec2-54-201-99-99.us-west-2.compute.amazonaws.com. 60 IN A 10.0.5.204

;; Query time: 19 msec
;; SERVER: 10.0.0.2#53(10.0.0.2)
;; WHEN: Fri Jun  6 12:28:44 2014
;; MSG SIZE  rcvd: 132

AWS EBS Performance

Here is a very good presentation on Amazon EBS performance from reInvent in 2013:
http://www.slideshare.net/AmazonWebServices/ebs-webinarfinal

AWS SLAs

Thursday, May 22, 2014

Oracle Database Huge Pages

Oracle DBAs will use Oracle Hug pages to increase Oracle database performance : http://docs.oracle.com/cd/E11882_01/server.112/e10839/appi_vlm.htm#UNXAR394

The only requirement for huge-pages (2MB pages) is that you run a HVM instance. However, all the Oracle AMIs are PVM.

For now to use huge pages with Oracle on EC2,  the best option would be to go with SUSE HVM AMI and then install the Oracle Database on the EC2 instance. 

Friday, May 16, 2014

MySQL horizontal scaling

ScaleBase is a distributed database built on MySQL and optimized for the cloud. It is a relational database cluster that dynamically optimizes workloads and availability by logically distributing data. ScaleBase automates the data lifecycle, including analysis, data migration and node rebalancing.  ScaleBase provides an easy to manage horizontally scalable database cluster built on MySQL that dynamically optimizes workloads across multiple instances.  is  based in Newton, MA. The AWS Marketplace offering can be found here:  https://aws.amazon.com/marketplace/pp/B00K8B5BOG.  ScaleBase provides the scalability and availability benefits of NoSQL databases while using a relational database.

Friday, May 2, 2014

Redshift SQL query tools

      Here are two tools that can be used with Amazon Redshift to issue query commands:      

1    1. SQL Workbench :
The information required regarding your Redshift cluster are:
A. JDBC or ODBC connection string: example JBDC connection string looks like this: jdbc:postgresql://redshiftexamplecluster.cvhv40lk8tel.us-east-1.redshift.amazonaws.com:5439/redexampletl?tcpKeepAlive=true
B. User ID : master
C. password : password

2. Aginity : http://www.aginity.com                       A. Server (endpoint): example looks like this: lab.cfmvmxhkrtel.us-west-        2.redshift.amazonaws.com
B. User ID : master
C. password : password
D. Database: databasename
E. Port: 5439

The nice thing about Aginity is that there is no JDBC driver to install. With SQL Workbench, you will need to download and install 



More on where to find the  JDBC driver and configure with SQL Workbench
2.     Add the downloaded driver JAR to the driver to the PostGres Driver in SQL Workbench






Monday, April 14, 2014

AWS high memory instance type : Good for Oracle Databases on AWS

The r3.8xlarage has 244 GiB of memory, 32 vCPUs, and 2 - 320 GB SSD drives. The cost is $2.80 per hour for on-demand instances.  More details here:

http://aws.amazon.com/about-aws/whats-new/2014/04/10/r3-announcing-the-next-generation-of-amazon-ec2-memory-optimized-instances/


Prior to this you had to use the i2.8xlarge instance type which also has 244 GiB of memory and 32 vCPUs. But also has 8 - 800 GB SSD drives which you will most likely not use for your Oracle Database.  The cost of i2.8xlage is $6.82 per hour for on-demand instances.  The other highest memory option is the cr1.8xlarge with 32 vCPUs and 244 GIB with 2 -120 GB SSD drives.  The cost of this option is $3.50 per hour for on-demand instances.
The R3 instances include the following features:
  • Intel Xeon E5-2670 v2 "Ivy Bridge" Processors
  • Hardware Virtualization (HVM) only
  • SSD-backed instance storage, including TRIM support
  • Enhanced Networking with lower latency, low jitter, and high packet-per-second performance

One caveat here that Oracle has not released any HVM-based instance types.  There are undocumented methods to create an HVM AMI from a PVM AMI but this new AMI may not be supported by Oracle.

Thursday, April 10, 2014

Data Center Migration to AWS

Learn how RISO Inc. used Apps Associates services to move their data center to the AWS cloud. In so doing, RISO Inc. avoided capital intensive hardware purchases and redeployed IT staff to projects that directly supported their business goals. We'll also describe how you can integrate your existing environment with the cloud to create a hybrid architecture.



Monday, April 7, 2014

Oracle RDS GoldenGate support

Oracle GoldenGate can be used with Amazon RDS for Oracle for active-active database replication, zero-downtime migration and upgrades, disaster recovery and data protection, and cross region replication. 

Friday, April 4, 2014

Oracle Spatial on Amazon EC2


The summary is:
  • Technical approach:
    ·   Oracle Database with Spatial
    ·   Deploy on Amazon EC2
    ·   J2EE Web Application Server
    ·   Multi-tenant Multi-user 100% Web software for Mapping and analyzing business data 
– eSpatial OnDemand GIS

    Amazon Overview
    ·      Elastic Cloud Computing (EC2)

    ·      Variety of Instance Types (CPU cores, memory...)
    ·      Pre-configured Amazon Machine Instances (AMI’s)
    ·      Availability Zones
    ·      Elastic Block Storage – EBS
 Simple Storage Service (S3)
 Elastic IP addresses

    ·      Load Balancing & Auto Scaling, More...
    Amazon Deployment:
    ·   Dedicated Database Server(s) with separate Web Application Servers
    ·   AMI - Oracle 11g DB & Redhat Fedora
    ·   Database on an EBS volume
    ·   ARCHIVELOG as normal – archive to a separate EBS volume
    ·   RMAN Backup to separate EBS volume
    ·   Copy backups to Amazon S3
    ·   EE & RAC or SE-1 with Standby DB
    ·   Backup from Standby DB