Tag Archives: S3

Self-Service Test Harness for Riak Cloud Storage

January 7, 2013

Riak Cloud Storage is simple, available cloud storage software built on top of Riak. It offers an S3 API, multi-tenancy and large object support for enterprises building public or private clouds. We want to make it easier to get started with Riak CS, so we’re now offering a self-service test harness. Visit riakcs.net to sign up - you can explore the functionality, test API operations, and experiment with clients and development apps. With the self-service feature, you can start playing right away.

Note that the test harness is primarily for exploring Riak CS features – if you want to do load testing and performance benchmarking, you should sign up for a developer trial that will give you access to Riak CS packages you can install and test on your own hardware.

Interested in learning more about Riak CS? All of the docs are available online.

Basho Team

Announcing Riak Cloud Storage With Multi-Datacenter Replication

November 30, 2012

Riak Cloud Storage is an S3-compatible, multi-tenant storage platform built on Riak. It combines the availability and fault tolerance of Riak with the ability to store large objects, an S3-compatible API, user administration and usage reporting. It can be used for public and private clouds or as reliable storage for applications. Today we’re announcing multi-datacenter replication support in Riak CS. Increasingly, global enterprises and apps require multi-site storage replication to achieve data locality, availability in disaster scenarios, or maintain active backups, so we’re very excited to provide these features in the latest release of Riak CS.

You can read more about multi-datacenter replication for Riak CS in the public docs, or sign up for an upcoming webcast on Thursday, December 6, which gives a technical overview of Riak CS and discussion of new features. If you want something more hands on, get a developer trial of Riak CS to take it for a test drive.

Technical Details

Multi-datacenter replication in Riak CS provides two modes of object replication: full sync and real-time sync. Data is streamed over a TCP connection, and multi-datacenter replication in Riak CS has support for SSL so data can be securely replicated between sites.

In Riak CS, large objects are broken into blocks and streamed to the underlying Riak cluster on write, where they are replicated for high availability (3 replicas by default). A manifest for each object is maintained so that blocks can be retrieved from the cluster and the full object presented to clients. For multi-site replication in Riak CS, global information for users, bucket information and manifests are streamed in real-time from a primary implementation to a secondary site so global state is maintained across locations. Objects can then be replicated in either full sync or real-time sync mode.

In full sync, objects are replicated from a primary Riak CS implementation to a secondary site on a configurable interval – the default is 6 hours. In full-sync replication, each cluster computes a hash for each key’s block value. Key/block pairs are compared, and the primary site streams any missing blocks or updates needed to the secondary site.

Real-time sync is triggered when an update is sent from a client to a primary Riak CS implementation. Once replicated in the first location, the updates are streamed in real-time to the secondary site. But what happens if a client requests an object from the secondary cluster and not all of its blocks have been replicated to that cluster? With Riak multi-site replication, the secondary cluster will request any missing blocks from the primary cluster so that the client can be served.

Try It Out

We’ve got two ways for you to try out Riak CS software. First, we can give you access to a hosted version where you can upload files, test out the API, and try s3cmd or other clients against it. If you want to try Riak CS on your own hardware, we also have a developer trial that gives you access to the Riak CS code and a little bit of our help to get you up and running. So check out the docs and then sign up to start.

Basho Team

Try Riak Cloud Storage

October 18, 2012

Riak CS is enterprise cloud storage built on top of Riak, offering S3-compatible, multi-tenant large object storage. It’s software for building public clouds, or reliable storage behind your applications. And of course, it’s designed to be fault-tolerant, highly available and easy to operate, just like Riak. Riak CS docs are available online, but we also wanted to provide an easy way for teams to get their hands on some code or a hosted version to try out.

We’ve got two ways to get you started. First, we’ve got hosted Riak CS for testing. It’s got a simple UI so you can upload files, test out the API, use s3cmd or another client against it, and generally work your way around. If you want to dig further into Riak CS, we also have a Riak CS developer trial. This gives you access to the Riak CS code (and a little bit of our help to get you up and running), so you can install it on your own machines, do all the testing you need in your own environment, and decide if it’s the right choice for you.

If either of these options sound good to you, send us a little info on you and we’ll get you started.

Riak Cloud Storage – New Features and Product Update

August 21, 2012

Earlier this year we launched Riak CS – simple, available cloud storage built on Riak. We gave it an S3-compatible API, made it multi-tenant, and added per-user reporting on network and storage utilization. Riak CS provides the core features to build public or private clouds that are distributed, fault-tolerant and easy to scale.

Since then, we’ve rolled out a startup program to make Riak CS affordable for earlier-stage shops. And we’ve talked to a number of companies who wanted to license Riak CS based on the amount of storage they need, rather than the number of nodes, so now you can do that too. (Get in touch if you want a quote.) Riak CS docs are now also publicly available on our wiki.

Today we’re announcing some new features and additions to Riak CS, including more options for user admin, auth and object metadata, plus improved stats and troubleshooting. We’ll walk thru the Riak CS architecture, operations and new functionality in an upcoming webcast, or read on.

New in Riak CS

Better User Administration

We’ve beefed up the Riak CS user API so admins can now list all users, issue new credentials to a user, or disable a user. We’ve also got new configuration options to restrict user creation to admins or let anyone create a user directly.

List All Objects in a Bucket Much Faster

User objects in Riak CS are stored in flat namespaces called “buckets”. We sped up one of the most common bucket operations: listing all of its objects. Riak CS now uses MapReduce to look up objects, yielding significant performance gains.

Arbitrary Metadata

One of our top customer requests. Now you can store some additional metadata with your Riak CS objects – whatever is most useful to you.

New Basic Health Check

If you’ve ever set up Riak, you’ve probably used the basic health check to test Riak nodes. Now you can send an HTTP “ping” to Riak CS nodes as well to make sure they are responsive. The “ping” will also fail if the Riak CS node can’t reach the underlying Riak database (Riak CS nodes have a 1×1 mapping onto Riak nodes).

Better Inspection and Troubleshooting

We have added DTrace probing in Riak CS and we are working on SmartOS packaging. We will also be working on packaging for other platforms that support DTrace. Once these packages are available it should help operators who use DTrace platforms troubleshoot any issues with Riak CS and have more visibility into their stack. We also now expose more stats information on the Riak CS runtime by HTTP request.

Improved S3 API Coverage

We also added support for query parameter authentication, increasing compliance with S3’s REST Authentication scheme. This means that Riak CS users can now authenticate thru a request header or a URL-encoded query string parameter.

Stay tuned because we’re hard at work on the next Riak CS features and improvements. What do you want to see? We’d love to hear from you.

Intro to Riak CS Webcast

**November 05, 2012**

Earlier this year we launched Riak CS – simple, available cloud storage built on Riak. We gave it an S3-compatible API, made it multi-tenant, and added per-user reporting on network and storage utilization. Riak CS provides the core features to build public or private clouds that are distributed, fault-tolerant and easy to scale.

New to Riak CS? Join us this Wednesday (11am PT / 2pm ET) for an Intro to Riak CS webcast with Basho chief architect Andy Gross and director of product management Shanley Kane. In this 30 minute webcast, we’ll cover:

* Main features, including S3-compatibility, multi-tenancy, large object support and reporting
* Operations and interfaces
* Use cases in public/private clouds and applications
* Latest release and roadmap plans

Register for the webcast [here](http://info.basho.com/IntroToRiakCSNov7.html).

[Shanley](http://twitter.com/shanley)

[Andy](https://twitter.com/argv0)