August 6, 2013
Basho would not be where we are today without the valuable partnerships we have forged. Our partners have made Riak much more accessible and powerful. If you’re not familiar with our range of partners, check out our Partnership Page.
A large part of our partnership program is with hosting providers. Currently, we partner with five hosting providers:
Amazon Web Services: Riak can be quickly implemented via the AMI available on the Amazon Marketplace. To help you set up and configure a Riak cluster with this AMI, check out our blog post that walks you through the process. If AMI isn’t the right option for you, we have a few other deployment options available as well.
Windows Azure: Riak is a fully supported and tested NoSQL database option available on the Microsoft VM Depot. You can quickly deploy a virtual machine image or manually install via our packaging tools. You can learn more about this partnership on our blog.
Engine Yard: Hosted Riak is officially supported on the Engine Yard cloud platform. A Riak cluster can be deployed as simply as defining some configuration values and clicking “Add Cluster.” Ines Sombra, Lead Data Engineer at Engine Yard, has put together a talk to help you get started using Riak in cloud environments.
Joyent: Riak SmartMachines, developed in partnership with Joyent, enable SmartOS users to quickly deploy Riak on the Joyent infrastructure. These SmartMachines are scalable, fault-tolerant, open source key/value database servers intended to be the primary data storage mechanism in production applications. Check out Joyent’s site for more information.
SoftLayer: Riak and Riak Enterprise are available on SoftLayer’s global cloud platform. Customers can design and deploy a complete solution through SoftLayer’s solution designer and leverage the global footprint of SoftLayer data centers to provide for multi-datacenter replication. Check out our blog post for more information.
June 27, 2013
Today, we are excited to share a recent whitepaper released by the Amazon team entitled, “NoSQL Database in the Cloud: Riak on AWS.” This paper provides technical guidance on running Riak on the Amazon platform, including an overview of:
- Basic Installation
- Riak Architecture and Scale
- Operational Considerations (including sizing and configuration)
- AWS specific security configuration
- A discussion of Replication (as enabled by Riak Enterprise)
Given the number of Riak users (both open source and enterprise) who leverage public cloud environments, either as a part of their infrastructure or as the foundation of it, Basho will continue to invest in partnerships that provide deployment choice and deployment ease. Whether it’s for a hybrid cloud model – used to address burst capacity, tenancy/data locality, and proof of concept needs – or for an investment solely in public cloud, Riak will provide the operational simplicity and scalability required for your critical data.
For more information about deploying Riak on AWS, check out our posts about the Riak AMI and our other deployment options, including automated scripts and manual installation. You can also find more information about what to consider when installing Riak on AWS in our documentation.
January 30, 2013
Many teams run Riak in public cloud environments, either as a part of their infrastructure or as the foundation of it. Increasingly, we see enterprises and startups use a hybrid implementation that leverages both private infrastructure and public cloud services. This hybrid model is often used to address burst capacity issues, tenancy/location concerns, and simple proof-of-concept implementations prior to hardware acquisition.
Over the past few years, we have seen substantive adoption of Riak on Amazon Web Services. To that end, we are pleased that Basho has been approved as an Amazon Web Services Technology Partner. We look forward to highlighting interesting use cases, publishing detailed case studies of usage, and continuing to improve the usability and deployment speed of Riak on the AWS platform.
This post provides a high-level overview of your deployment options for using Riak on Amazon.
How Many Nodes?
Before we discuss the mechanics of implementation, it is important to consider the size of your deployment. One of the most frequent questions Basho is asked is, “How many nodes should I start with?”
If you have played with the Riak Fast Track you are familiar with deploying three nodes on a single machine. However, for production deployments, we recommend that your cluster be setup with a minimum of five nodes. For more details on how this minimum ensures the performance and availability of your implementation, please read the post entitled: Why Your Riak Cluster Should Have At Least Five Nodes.
So, you have a minimum of five nodes and you’ve decided that leveraging a cloud provider is appropriate for your current business needs. Now, how do you get started?
Amazon Machine Image
At its simplest, an Amazon Machine Image (AMI) is a pre-built machine image and configuration of Riak for Amazon EC2 users.
Obtaining and configuring the image is a relatively straightforward process. However, since Riak needs the nodes in the cluster to communicate with each other, there is some manual setup involved.
First, provision the Riak AMI onto the server of your choice via the AWS marketplace.
Once the virtual machine is created, manually configure the EC2 security group to allow the Riak nodes to speak to each other. The details of this step can be found on our docs portal under Installing on AWS Marketplace. However, this is generally as simple as opening a few inbound ports and defining a “Custom TCP rule.”
At this point, the machines can be clustered together. When the individual virtual machines are provisioned and the security group is configured, simply SSH into each machine and use internal riak-admin tools to join the nodes to the cluster.
But what if you want to automate some of the configuration of your cluster? Or, what if you want the ability to setup a VPC-based stack that includes:
- a front-end load balancer,
- a cluster of application servers,
- a Riak powered demo application,
- a back-end load balancer,
- and a cluster of Riak servers.
In that case, the Basho team has made available scripts that leverage AWS CloudFormation to build out your cluster in a scripted fashion.
Since this is a much different process than the previous method, it is well worth watching the introductory video (embedded below). In addition, the scripts in the cloudformation-riak repo can be thought of as “known good” templates. We accept Pull Requests and happy forking!
As always, there is a manual option.
If you need to control the system configuration or are most comfortable with software that you have built and deployed yourself, there is always the option to install from package or source.
For a full list of supported operating systems, check out the Installing and Upgrading page of the doc portal. In addition, we have recently launched a new download page that includes the source for the OSS version of Riak.
And easier to deploy than ever before. If you have feedback on present deployment alternatives, or recommendations on ways to make Riak support for cloud infrastructure easier, please drop us a note in the mailing list.
January 18, 2012
Amazon’s unveiling earlier today of DynamoDB, Amazon’s new datastore, is good for the NoSQL movement and great for customer choice.
We were early believers in the set of principles outlined in the original Amazon Dynamo paper that was published in 2007. In fact, we were so impressed, that we built our entire company around it. We launched Riak as open source software in 2009 and this has created a community of thousands of loyal users. The result has been a distributed database that that has been tested and proven to massively scale. Just ask Voxer: Walkie Talkie App Voxer Soars Past Ten Billion Operations Per Day Powered by Riak.
More importantly, the Amazon announcement tells us the power of NoSQL. Almost five years following the release of the Dynamo paper, the world’s largest e-commerce company is doubling down on NoSQL and the role of key-value stores. This aligns with a trend that has accelerated over the past year. The advantages from a scalable database that can elastically grow and shrink, with high throughput at very low-latency, and that never loses a write are increasingly viewed as highly compelling. Not to mention the massive cost advantage – infrastructure and operational savings – versus last generation architectures. Amazon has acted (again) and it further reiterates that others should too.
At Basho, we are in favor of anything that expands customer choice. A dynamo-as-a-service offered by Amazon on their ecosystem will appeal to some. For others, the benefits of a Dynamo-inspired product that can be deployed on other public clouds, behind-the-firewall, or not on the cloud at all, will be critical.
For cloud providers, we believe they will see the wisdom in Amazon’s decision to provide a fully managed, Dynamo-inspired, NoSQL product. Of course, we know where they can get one!
Some will choose DynamoDB in the Amazon cloud, some will chose other Dynamo-inspired databases such as Riak behind their own firewall, some will chose Dynamo-inspired databases in clouds other than Amazon. It’s good to have choices.
Congratulations again to Amazon for providing leadership in cloud technology.