Tag Archives: Basho

Riak CS is Now Open Source

March 20, 2013

Riak CS (Cloud Storage) is simple, available cloud storage software built on Riak. Basho announced today that Riak CS is now open source under the Apache 2 license. Organizations and users can now access the source code on Github and download the latest packages from the downloads page. Also, today, we announced that Riak CS Enterprise is now available as commercial licensed software, featuring multi-datacenter replication technology and 24×7 Basho customer support.

We will be hosting an introductory webcast to Riak CS on Tuesday, April 2. Sign up here.

Riak CS can be used to build private or public clouds or as reliable, available storage behind applications and platforms. Riak CS Enterprise is currently used by large corporations including Datapipe, Deutsche Vermögensberatung (DVAG), IDC Frontier, Rovio, and Yahoo! JAPAN.

Basho is a distributed systems company dedicated to making software that is available, fault-tolerant, and easy to operate at scale. Twenty-five percent of the Fortune 50 and thousands of open source users large and small run our flagship open source database, Riak. Riak CS takes distributed systems principles derived from production Riak users and applies it to the problem of large scale storage. We are excited to share this code with the world.

Riak CS features:

  • Highly available, fault-tolerant storage
  • Large object support
  • S3-compatible API and authentication
  • Multi-tenancy and per-user reporting
  • Simple operational model for adding capacity
  • Robust stats for monitoring and metrics

For users requiring multi-datacenter replication and enterprise-level support, Riak CS Enterprise (a commercial extension of Riak CS) is available.

New Features

Today we are also announcing several new features, available now as part of the open source edition.

  • Multipart upload. Upload very large files to Riak CS as a series of parts. Parts can be between 5MB and 5GB.
  • Support for GET range queries. Retrieve a range of bytes from a single object. This functionality is implemented in the “Range” request header of GET operations.
  • Per-bucket policies to restrict access to buckets based on source IP.
  • Riak CS Control. Riak CS Control is a standalone web administration tool for user management available on Github.

Supporting Quotes

“Basho, Yahoo! JAPAN, and IDC Frontier a member of Yahoo! JAPAN group have a very strong and growing partnership. Today, Yahoo! JAPAN and IDC Frontier leverage Riak CS Enterprise to offer an S3-compatible public cloud storage service, as well as dedicated hosting options for our customers various applications. Yahoo! JAPAN and IDC Frontier are highly supportive of open source software and we view Basho’s announcement today as a positive move that will work to accelerate its ability to innovate and ultimately strengthen our cloud platform.”
- Ash Yamanaka, general manager, IDC Frontier and
- Shingo Saito, cloud product manager, Yahoo! JAPAN

“Basho clearly understands the market power of open source. Since Citrix and Basho started collaborating last year, we have seen strong enthusiasm among Citrix CloudPlatform users for Basho’s cloud object storage solution. It has also provided the Apache CloudStack community with easy access to Riak CS for multi-tenancy and S3 compatibility. With today’s announcement, Citrix CloudPlatform customers will continue to benefit from Riak CS Enterprise for its distributed data capabilities across multiple data centers.”
- Sameer Dholakia, group vice president and GM, Citrix Platforms Group, Citrix

“Over the last six months, we have deployed Riak CS Enterprise within Datapipe’s 10gig Stratosphere cloud computing platform. Riak CS provides our customers with highly available, low-latency, S3-compatible cloud object storage. Datapipe is very supportive of Basho’s decision to open source portions of Riak CS. As Basho’s open source community grows, experiments, tests and contributes to Riak CS, Datapipe clients will benefit from access to additional capabilities and higher performance.”
- Ed Laczynski, vice president, Cloud Strategy and Architecture, Datapipe

Resources

Please join us for an introductory technical webcast to Riak CS on April 2. You can also read a technical overview on our website and find full documentation here.

In the coming weeks and months, we look forward to helping new users get started with Riak CS and be successful running it in production. We’ll be expanding integration and partnerships with open source cloud computing platforms in order to provide integrated storage and compute to the marketplace. As always, we’ll be listening to feedback, engaging with the community, and accepting pull requests.

Basho

Basho Events in March

March 11, 2013

Nearly each day this month, we will be speaking at conferences, hosting meetups, and sponsoring events. For a full list of events, visit our Events Page. If you want to meet up with a Basho team member at one of these events, contact us to set up a time. Below are some of the highlights:

GigaOM Structure: Basho will be speaking at two different sessions at GigaOM Structure (March 20-21) in New York. Come hear Basho CTO, Justin Sheehy, and Technical Evangelist, Tom Santero, speak, stop by our booth, or attend our cocktail reception on March 20th.

Game Developer Conference 2013: Basho Chief Architect, Andy Gross, will be speaking at the Game Developer Conference at a session titled “Gaming on NoSQL: Building Available, Fast Services with Riak.” GDC will be held March 25-29 in San Francisco. Check out our session and booth to learn more about how gaming platforms can use Riak.

Meetups: This month, we are hosting a number of meetups all over the country. If you’re in Austin, come visit us at BlackLocus on March 11th, if you’re in Seattle, visit us on March 13th at Blue Box Group, if you’re in Chicago, visit us on March 14th at Braintree, or if you’re in Boston, check us out on March 27th at Basho’s Cambridge office. We’ll also be at Riot Games in LA on March 19th and in Portland on March 28th at NedSpace.

Sponsored Events: Basho will be sponsoring Erlang Factory 2013 in San Francisco (March 18-22), Clojure/West in Portland (March 18-20), Open Analytics Summit in Arlington, VA (March 25), and Monitorama in Boston (March 28-29).

Hope to see you soon!

Basho

Basho at the O'Reilly Strata Conference

March 6, 2013

Last week, the Basho team attended the O’Reilly Strata Conference. If you were there, we hope you stopped by our booth to learn more about the 1.3 release and get one of our brand new t-shirts!

We had a great time and met a lot of interesting people. During the conference, our own Tyler Hannan, Director of Technical Marketing, was interviewed about Riak and the conference. Check out his interview below:

Missed us at Strata? Check out our Events Page to see where Basho will be next. We’d love to chat!

Basho

Multi-Datacenter Replication: Availability Zones and Public Cloud

February 28, 2013

In the last post, we looked at how Riak Enterprise’s multi-datacenter replication can be configured for backups and data locality. In this post, we examine two other common implementations: availability zones and public cloud use cases. For more information on Riak Enterprise architecture and configuration, download the complete whitepaper.

Availability Zones

Availability zones provide efficient multi-datacenter replication and data redundancy within a geographic region (such as a coast or a country). In this configuration, data is replicated within an availability zone’s series of datacenters. In the event that one of datacenters experiences an outage or serious failure, data can still be served from other datacenters within the same region.

One approach to setting this up is to have a “primary” site in a region where all reads and writes for specific users, applications, or data sets are directed. This primary cluster can then be replicated to one or more proximal secondary clusters. In other approaches, data can be replicated in real-time from one cluster to both another datacenter and other cold backups maintained for emergency conditions. The right approach is highly dependent on the requirements of users, availability, expense of bandwidth, and other constraints.

Public Cloud Use Cases

Riak is designed to be easy to use and operate on public clouds, and is partnered with many of the leading cloud providers, including Amazon Web Services, Microsoft Azure, and Joyent. Hosted Riak is also available from Engine Yard and Riak packages can always be manually installed on any physical or virtual provider, even if a machine image isn’t explicitly supported.

There are several use cases for Riak Enterprise’s multi-datacenter replication in the public cloud. Many enterprises want to maintain a cold or hot backup of their cluster in a public cloud for business continuity in the event of a datacenter outage in their private infrastructure. For other customers, the public cloud can provide a more cost-effective way of meeting peak loads, rather than building out private infrastructure to accommodate them year-round. For example, many retailers and media providers need to offer increased capacity over the holiday season. Riak Enterprise is used to scale out capacity on public clouds over these periods, either with full-sync or real-time sync depending on the business needs.

Finally, some enterprises run certain applications or services entirely on public clouds. Riak Enterprise allows for redundancy and data locality across public cloud availability zones for this use case, ensuring optimal performance and resiliency.

For a more in-depth look at common architectures and use cases for Riak Enterprise, download our technical overview. You can also sign up for our webcast on Thursday, March 7th.

Basho

Basho and Citrix Provide Update on CloudStack and Riak CS

February 15, 2013

Basho and Citrix continue to collaborate on the integration of Apache CloudStack and Riak CS (Cloud Storage) to create a complete cloud software offering (see Basho joins Apache CloudStack Project).

On January 16, 2013, Citrix’s David Nalley and Basho’s John Burwell, detailed the underlying architecture and customer benefits of CloudStack and Basho’s Riak CS software. In the video, David Nalley provides an overview of CloudStack’s architecture and offers a walkthrough of CloudStack Administration, including provisioning of new instances and a description of the CloudStack API.

John Burwell, also a Committer to Apache CloudStack, explains the role of Secondary Storage software to store immutable assets (templates, ISO images, snapshots). John details the difference between Object Storage and Block Storage, discussing benefits such as flexible meta-data definition and custom API access. Finally, John describes enhancements in the upcoming 4.1.0 release that leverage Riak CS to synchronize assets in secondary storage across zones/data centers, reducing operational costs and complexity for multi-zone CloudStack implementations.

Basho is actively working with the CloudStack community to design CloudStack’s next generation architecture to drive deeper integration of leading edge storage technologies such as Riak CS.

Earlier this week, Basho and Datapipe announced the availability of a new object storage service on Datapipe’s 10 Gig Stratosphere Cloud Platform. The S3-compatible object storage service is built on Citrix CloudStack and fully integrates Riak CS.

Basho

Seven Riak Meetups Happening February 13th

February 7, 2013

Basho and our community have a handful of events lined up for February 13th. We have official meetups/group hacks in at least seven cities in the US.

We hope to see you next week. If you can’t attend an official Meetup, throw a Riak hack or drink up in your city and email te@basho.com to tell us about it.

Thanks for being a part of Riak.

Basho

Boston/Cambridge

  • Speaker: Weston Jossey, Software Engineer, Tapjoy
  • Talk Title: Huge Data Migrations to Riak Made Easy(er)
  • Details and RSVP

Chicago

  • Speaker: Sean Cribbs, Software Engineer, Basho Technologies
  • Talk Title: The Deep Riak
  • Details and RSVP

New York City

  • Speaker: Aaron Brown, Lead Systems Engineer, ideeli
  • Talk Title: Riak at ideeli
  • Details and RSVP

Portland, OR

San Francisco

  • Speaker: Robert Zuber, Co-Founder, Copious
  • Talk Title: Riak in a Multi-Datastore Strategy at Copious
  • Details and RSVP

Silicon Valley

  • Speaker 1: Pavan Venkatesh, Technical Evangelist, Basho Technologies
  • Talk Title 1: From Relational to Riak
  • Speaker 2: Sajith Kizhakkiniyil, Software Infrastructure and Backend Architecture Support, Apollo Group
  • Talk Title 2: Riak at Apollo
  • Details and RSVP

Seattle

  • Speaker: Adron Hall and You
  • Talk Title: Nerd Lunch and The Start of Seattle Riak
  • Details and RSVP

Basho and Tokyo Electron Device (TED) Announce Strategic Partnership Distribution Agreement


TED to Leverage Deep Relationships with Enterprise Companies to Accelerate Adoption of Riak Throughout Japan

CAMBRIDGE, MA and YOKOHAMA, JAPAN – February 7, 2013Basho Technologies, Inc. and Tokyo Electron Device Limited (TED) announced a strategic partnership and distribution agreement under which TED will resell Basho products throughout Japan and has become a strategic equity investor in Basho. Basho Technologies specializes in distributed systems technologies and is the creator of Riak, the industry leading distributed database and cloud storage software. TED provides world-class products and solutions that deliver competitive advantages to its customers. The strategic partnership enables Basho and TED to capitalize on the comprehensive resources of TED to open up new opportunities for Basho in the Japanese market. As part of the partnership, TED will build and maintain dedicated sales support and post-sales support resources specifically around Riak, Riak CS and future new products from Basho.

“Basho is very excited to enter into a long-term strategic partnership with TED,” said Sam Takagi, general manager of Basho Japan and Asia Pacific. “TED is highly regarded throughout Japan for its expertise in storage infrastructure, data backup and protection, and data warehouse design and operations. Riak’s strengths around high-availability, scalability and predictability are highly complementary to TED’s expertise and will provide an important new and innovative database and storage solution for TED’s customers. With Riak, Japanese businesses can meet demanding Internet, social and mobile requirements, as well as build highly-competitive public clouds and secure, high-performance private clouds.”

“Riak’s inherent distributed data capabilities offer a unique solution for companies building next generation applications, and cloud computing platforms that require high scalability, no downtime, and low cost operations,” said Vic Amano, VP & GM CN Business of Tokyo Electron Device Limited. “Our highly complementary expertise in data storage and our large and established network of commercial and industrial customers position us well to quickly speed adoption of Basho’s technology throughout Japan. The strategic nature of our partnership with Basho allows us to collaborate on future customer requirements and on product directions, allowing TED to maintain a competitive advantage for the next generation of database and storage technologies.”

“Through this strategic partnership, Basho is further building its global presence and particularly in the important and large market of Japan,” said Greg Collins, Basho’s president and CEO. “Our partnership with TED further underscores Basho’s commitment to the Japanese market. We are committed to building strong local capabilities and leveraging partnerships that have strong business networks and local-market expertise. TED is a terrific match for Basho. We look forward to working with TED and its customers for many years to come.”

Today’s announcement follows Basho’s recent opening of its Tokyo Office, officially launched on September 27, 2012.

About Tokyo Electron Device (TED) CN Business:

Tokyo Electron Device (TED) is a technical trading firm with a “trading business” function that provides semiconductor products and business solutions as well as a “development business” function that performs commissioned designing and the development of own-brand products. The Computer Network (CN) Business Section handles a wide range of storage systems, network-related equipment, and middleware products and provides them as part of its business solutions in the era of cloud computing. It has marketing functions in Japan and overseas to pick up on trends in the world’s advanced technologies ahead of others in order to offer products and services that cover processes that span everything from implementation to support.

For more information, visit: http://cn.teldevice.co.jp/english/.

About Basho Technologies

Basho Technologies is the leader in highly-available, distributed database technologies used to power scalable, data-intensive Web, mobile, and e-commerce applications and large cloud computing platforms. Basho customers, including fast-growing Internet-based businesses and large Fortune 500 enterprises, use the company’s flagship product, Riak, to deliver and manage digital media and unstructured data, implement multi-device user activity and sessions stores, to aggregate large amounts of data for logging, search and analytics, and to build scalable cloud storage platforms. The company is based in Cambridge, Massachusetts and operates regional offices in London, San Francisco, Tokyo and Washington DC.

For more information visit http://www.basho.com or www.basho.co.jp.

Basho Technologies Medica Contact:
Bobby Patrick Chief Marketing Officer, Basho Technologies
Tel: 1-703-362-4811
Contact: bobby@basho.com

Tokyo Electron Device Media Contact:
Yoichiro Hotta, Yoko Fukui Corporate Communications Department, Tokyo Electron Device Limited
Tel: 81-45-443-4005
Contact form: https://www.teldevice.co.jp/eng/contact_form_news.html

Product Contact:
For inquiries regarding Basho Technologies and Riak Tokyo Electron Device Limited
Tsuyoshi Yoshi Tanaka, 1-510-624-3463
CN Business Contact form: http://cn.teldevice.co.jp/company/tea/form.html

Riak on AWS – Deployment Options

January 30, 2013

Many teams run Riak in public cloud environments, either as a part of their infrastructure or as the foundation of it. Increasingly, we see enterprises and startups use a hybrid implementation that leverages both private infrastructure and public cloud services. This hybrid model is often used to address burst capacity issues, tenancy/location concerns, and simple proof-of-concept implementations prior to hardware acquisition.

Over the past few years, we have seen substantive adoption of Riak on Amazon Web Services. To that end, we are pleased that Basho has been approved as an Amazon Web Services Technology Partner. We look forward to highlighting interesting use cases, publishing detailed case studies of usage, and continuing to improve the usability and deployment speed of Riak on the AWS platform.

This post provides a high-level overview of your deployment options for using Riak on Amazon.

How Many Nodes?

Before we discuss the mechanics of implementation, it is important to consider the size of your deployment. One of the most frequent questions Basho is asked is, “How many nodes should I start with?”

If you have played with the Riak Fast Track you are familiar with deploying three nodes on a single machine. However, for production deployments, we recommend that your cluster be setup with a minimum of five nodes. For more details on how this minimum ensures the performance and availability of your implementation, please read the post entitled: Why Your Riak Cluster Should Have At Least Five Nodes.

So, you have a minimum of five nodes and you’ve decided that leveraging a cloud provider is appropriate for your current business needs. Now, how do you get started?

Amazon Machine Image

At its simplest, an Amazon Machine Image (AMI) is a pre-built machine image and configuration of Riak for Amazon EC2 users.

Obtaining and configuring the image is a relatively straightforward process. However, since Riak needs the nodes in the cluster to communicate with each other, there is some manual setup involved.

First, provision the Riak AMI onto the server of your choice via the AWS marketplace.

Once the virtual machine is created, manually configure the EC2 security group to allow the Riak nodes to speak to each other. The details of this step can be found on our docs portal under Installing on AWS Marketplace. However, this is generally as simple as opening a few inbound ports and defining a “Custom TCP rule.”

At this point, the machines can be clustered together. When the individual virtual machines are provisioned and the security group is configured, simply SSH into each machine and use internal riak-admin tools to join the nodes to the cluster.

Amazon CloudFormation

But what if you want to automate some of the configuration of your cluster? Or, what if you want the ability to setup a VPC-based stack that includes:

  • a front-end load balancer,
  • a cluster of application servers,
  • a Riak powered demo application,
  • a back-end load balancer,
  • and a cluster of Riak servers.

In that case, the Basho team has made available scripts that leverage AWS CloudFormation to build out your cluster in a scripted fashion.

Since this is a much different process than the previous method, it is well worth watching the introductory video (embedded below). In addition, the scripts in the cloudformation-riak repo can be thought of as “known good” templates. We accept Pull Requests and happy forking!

Manual Installation

As always, there is a manual option.

If you need to control the system configuration or are most comfortable with software that you have built and deployed yourself, there is always the option to install from package or source.

For a full list of supported operating systems, check out the Installing and Upgrading page of the doc portal. In addition, we have recently launched a new download page that includes the source for the OSS version of Riak.

Final Thoughts

Highly available.
Fault-tolerant.
Low latency.

And easier to deploy than ever before. If you have feedback on present deployment alternatives, or recommendations on ways to make Riak support for cloud infrastructure easier, please drop us a note in the mailing list.

The options above describe an OSS deployment of Riak. If you need multi-datacenter replication and support, contact us to discuss Riak Enterprise.

Basho

Riak in Production – Retail and eCommerce Stories

January 29, 2013

This is the first in a series of blog posts covering the benefits Riak offers to developers and operators of retail and eCommerce platforms. To learn more, join our “Retail on Riak” webcast on Friday, February 8th.

As retailers grow and have to store more and more data, traditional relational databases aren’t always the best option. Retailers want to scale easily, without the operational burden of manual sharding. Meanwhile, business requirements demand their data is always available for reads and writes. Riak is a highly available, low latency distributed database that is ideal for retailers who need to serve product data quickly and maintain “always on” shopping experiences. Riak is based on architectural principles from Amazon. Riak is designed for high availability and scale so retailers can always serve customers, even under failure conditions, and rapidly grow to meet peak loads.

Retailers of all sizes have chosen Riak to power parts of their business, including:

  • Best Buy: Best Buy is North America’s top specialty retailer of consumer electronics, personal computers, entertainment software, and appliances. Riak has been an integral part in the transformation push to re-platform Best Buy’s eCommerce platform. For more info, check out Best Buy’s talk from our 2012 developer conference, RICON.
  • ideeli: ideeli is one of the fastest growing retailers with over 5 million members and more than 1,000 brand partners. They use Riak to serve HTML documents and user-specific products. ideeli chose Riak to power their event-based shopping experience due to Riak’s ability to serve users information at low latency and provide ease of use and scale to ideeli’s operations team. Check out the complete case study for more details.
  • Copious: Copious is a social commerce marketplace that makes it easy for people to buy and sell the things they love. They currently store all registered accounts in Riak as well as the tokens that make it possible for users to authenticate with Copious via their Facebook or Twitter accounts. They chose to use Riak for their social login functionality because of its operational simplicity, which allows them to easily scale up without sharding and provides the high availability required for a smooth user experience. For more details, check out the complete Copious story on our blog.

For more information about the benefits of Riak for retailers and the retailers already using it, register for our “Retail on Riak” webcast on February 8th!

Basho

Riak for Retail and eCommerce Platforms

January 22, 2013

Traditionally, most retailers have used relational databases to manage their platforms and eCommerce sites. However, with the rapid growth of data and business requirements for high availability and scale, more retailers are looking at non-relational solutions like Riak.

Riak is a masterless, distributed database that provides retailers with high read and write availability, fault-tolerance and the ability to grow with low operational cost. Architectural, operational and development benefits for retailers include:

  • “Always On” Shopping Experience: Based on architectural principles from Amazon, Riak is designed to favor data availability, even in the event of hardware failure or network partition. For retailers, failure to accept additions to a shopping cart, or serve product information quickly, has a direct and negative impact on revenue. Riak is architected to ensure the system can always accept writes and serve reads at low-latency.
  • Resilient Infrastructure: At scale, hardware malfunction, network partition, and other failure modes are inevitable. Riak provides a number of mechanisms to ensure that retail infrastructure is resilient to failure. Data is replicated automatically within the cluster so nodes can go down but the system still responds to requests. This ensures read and write availability, even in serious failure conditions.
  • Low-Latency Data Storage: Many retailers now operate online and mobile experiences with an API or data services platform. In order to provide a fast and available experience to end users, Riak is designed to serve predictable, low-latency requests as part of a service-oriented infrastructure and is accessible via HTTP API, protocol buffers, or Riak’s many client libraries.
  • Scale to Peak Loads with Low Operational Cost: During major holidays and other periods of peak load, retailers may have to significantly increase their database capacity quickly. When new nodes are added, Riak automatically distributes data evenly to naturally prevent hot spots in the database, and yields a near-linear increase in performance and throughput when capacity is added.
  • Global Data Locality and Redundancy: Riak Enterprise’s multi-site replication allows replication of data to multiple data centers, providing both a global data footprint and the ability to survive datacenter failure.

Top retailers using Riak include Best Buy and ideeli. Best Buy selected Riak as an integral part in the transformation push to re-platform its eCommerce platform. For more information about how Best Buy is using Riak, check out this video.

ideeli uses Riak to serve HTML documents and user-specific products. ideeli chose Riak to provide its highly available, event-based shopping experience – Riak gives them the ability to serve user information at low latency and provides ease of use and scale to ideeli’s operations team. For more information on ideeli’s use of Riak check out the complete case study.

Common use cases for Riak in the retail/eCommerce space include shopping carts (due to Riak’s “always-on” capabilities), product catalogs (Riak is well suited for the storage of rapidly growing content that needs to be served at low-latency), API platforms (Riak’s flexible, schemaless design allows for rapid application development), and mobile applications (Riak is ideal for powering mobile experiences across platforms due to its low-latency, always-available small object storage capabilities).

To help retailers evaluate and adopt Riak, we’ve published a technical overview: “Retail on Riak: A Technical Introduction.” We discuss more in-depth information on modeling applications for common use cases, switching from a relational architecture, querying, multi-site replication and more.

Basho