Tag Archives: Riak

Datapipe and Riak Cloud Storage

February 11, 2013

We are excited to announce Datapipe’s Stratosphere, a globally available, high-performance managed cloud computing platform, leverages Riak Cloud Storage (CS). Riak Cloud Storage provides Datapipe and its customers with highly available, low-latency and S3-compatible storage.

Sign up here to get started with Datapipe’s 10 Gig Stratosphere cloud platform and earn a $500 credit.

Datapipe offers a single provider solution for managing and securing mission critical IT services, including cloud computing, infrastructure as a service, platform as a service, managed hosting, and colocation.

Stratosphere is Datapipe’s globally available managed cloud computing platform. With the launch of Riak CS to support cloud object storage, Datapipe customers can now access cloud object storage from any solution hosted with Datapipe and adjacent to existing solutions in any Datapipe data center. Stratosphere is designed for enterprise high I/O production environments and can also be used for development, testing and QA environments. Use cases include large-scale marketing campaigns, brand sites and analytics; applications with variable peak demand times and other dynamic workloads; and cloud disaster recovery and geographic redundancy.

Datapipe delivers services from the world’s most influential technical and financial markets including New York metro, Silicon Valley, London, Hong Kong and Shanghai.

Why Riak Cloud Storage at Datapipe?
Datapipe selected Riak Cloud Storage for its low-latency, highly available object storage, operational ease-of-use, and multi-site replication capabilities. After extensively testing solutions from a variety of vendors in the space, Datapipe selected Riak Cloud Storage for a few core reasons:

  • Built on years of developing Riak, Riak CS is designed to provide simple, available, distributed cloud storage at any scale.
  • Riak CS is compatible with major cloud object storage clients and applications with its S3-based API.
  • Riak CS meets the high performance requirements of the Stratosphere cloud-computing platform.

“Riak CS provides the high-performance, distributed datastore we need to deliver a sound foundation for our cloud storage needs now and for many years into the future,” said Ed Laczynski, VP Cloud Strategy, Datapipe.

Be on the lookout for upcoming documentation about using Riak CS-backed functionality on Stratosphere at Datapipe. Riak CS is now available with Datapipe in a limited beta, with an upcoming full release.

For a developer trial of Riak CS, sign up here.

Basho

Seven Riak Meetups Happening February 13th

February 7, 2013

Basho and our community have a handful of events lined up for February 13th. We have official meetups/group hacks in at least seven cities in the US.

We hope to see you next week. If you can’t attend an official Meetup, throw a Riak hack or drink up in your city and email te@basho.com to tell us about it.

Thanks for being a part of Riak.

Basho

Boston/Cambridge

  • Speaker: Weston Jossey, Software Engineer, Tapjoy
  • Talk Title: Huge Data Migrations to Riak Made Easy(er)
  • Details and RSVP

Chicago

  • Speaker: Sean Cribbs, Software Engineer, Basho Technologies
  • Talk Title: The Deep Riak
  • Details and RSVP

New York City

  • Speaker: Aaron Brown, Lead Systems Engineer, ideeli
  • Talk Title: Riak at ideeli
  • Details and RSVP

Portland, OR

San Francisco

  • Speaker: Robert Zuber, Co-Founder, Copious
  • Talk Title: Riak in a Multi-Datastore Strategy at Copious
  • Details and RSVP

Silicon Valley

  • Speaker 1: Pavan Venkatesh, Technical Evangelist, Basho Technologies
  • Talk Title 1: From Relational to Riak
  • Speaker 2: Sajith Kizhakkiniyil, Software Infrastructure and Backend Architecture Support, Apollo Group
  • Talk Title 2: Riak at Apollo
  • Details and RSVP

Seattle

  • Speaker: Adron Hall and You
  • Talk Title: Nerd Lunch and The Start of Seattle Riak
  • Details and RSVP

Basho and Tokyo Electron Device (TED) Announce Strategic Partnership Distribution Agreement


TED to Leverage Deep Relationships with Enterprise Companies to Accelerate Adoption of Riak Throughout Japan

CAMBRIDGE, MA and YOKOHAMA, JAPAN – February 7, 2013Basho Technologies, Inc. and Tokyo Electron Device Limited (TED) announced a strategic partnership and distribution agreement under which TED will resell Basho products throughout Japan and has become a strategic equity investor in Basho. Basho Technologies specializes in distributed systems technologies and is the creator of Riak, the industry leading distributed database and cloud storage software. TED provides world-class products and solutions that deliver competitive advantages to its customers. The strategic partnership enables Basho and TED to capitalize on the comprehensive resources of TED to open up new opportunities for Basho in the Japanese market. As part of the partnership, TED will build and maintain dedicated sales support and post-sales support resources specifically around Riak, Riak CS and future new products from Basho.

“Basho is very excited to enter into a long-term strategic partnership with TED,” said Sam Takagi, general manager of Basho Japan and Asia Pacific. “TED is highly regarded throughout Japan for its expertise in storage infrastructure, data backup and protection, and data warehouse design and operations. Riak’s strengths around high-availability, scalability and predictability are highly complementary to TED’s expertise and will provide an important new and innovative database and storage solution for TED’s customers. With Riak, Japanese businesses can meet demanding Internet, social and mobile requirements, as well as build highly-competitive public clouds and secure, high-performance private clouds.”

“Riak’s inherent distributed data capabilities offer a unique solution for companies building next generation applications, and cloud computing platforms that require high scalability, no downtime, and low cost operations,” said Vic Amano, VP & GM CN Business of Tokyo Electron Device Limited. “Our highly complementary expertise in data storage and our large and established network of commercial and industrial customers position us well to quickly speed adoption of Basho’s technology throughout Japan. The strategic nature of our partnership with Basho allows us to collaborate on future customer requirements and on product directions, allowing TED to maintain a competitive advantage for the next generation of database and storage technologies.”

“Through this strategic partnership, Basho is further building its global presence and particularly in the important and large market of Japan,” said Greg Collins, Basho’s president and CEO. “Our partnership with TED further underscores Basho’s commitment to the Japanese market. We are committed to building strong local capabilities and leveraging partnerships that have strong business networks and local-market expertise. TED is a terrific match for Basho. We look forward to working with TED and its customers for many years to come.”

Today’s announcement follows Basho’s recent opening of its Tokyo Office, officially launched on September 27, 2012.

About Tokyo Electron Device (TED) CN Business:

Tokyo Electron Device (TED) is a technical trading firm with a “trading business” function that provides semiconductor products and business solutions as well as a “development business” function that performs commissioned designing and the development of own-brand products. The Computer Network (CN) Business Section handles a wide range of storage systems, network-related equipment, and middleware products and provides them as part of its business solutions in the era of cloud computing. It has marketing functions in Japan and overseas to pick up on trends in the world’s advanced technologies ahead of others in order to offer products and services that cover processes that span everything from implementation to support.

For more information, visit: http://cn.teldevice.co.jp/english/.

About Basho Technologies

Basho Technologies is the leader in highly-available, distributed database technologies used to power scalable, data-intensive Web, mobile, and e-commerce applications and large cloud computing platforms. Basho customers, including fast-growing Internet-based businesses and large Fortune 500 enterprises, use the company’s flagship product, Riak, to deliver and manage digital media and unstructured data, implement multi-device user activity and sessions stores, to aggregate large amounts of data for logging, search and analytics, and to build scalable cloud storage platforms. The company is based in Cambridge, Massachusetts and operates regional offices in London, San Francisco, Tokyo and Washington DC.

For more information visit http://www.basho.com or www.basho.co.jp.

Basho Technologies Medica Contact:
Bobby Patrick Chief Marketing Officer, Basho Technologies
Tel: 1-703-362-4811
Contact: bobby@basho.com

Tokyo Electron Device Media Contact:
Yoichiro Hotta, Yoko Fukui Corporate Communications Department, Tokyo Electron Device Limited
Tel: 81-45-443-4005
Contact form: https://www.teldevice.co.jp/eng/contact_form_news.html

Product Contact:
For inquiries regarding Basho Technologies and Riak Tokyo Electron Device Limited
Tsuyoshi Yoshi Tanaka, 1-510-624-3463
CN Business Contact form: http://cn.teldevice.co.jp/company/tea/form.html

Basho and Riak at Rubyfuza

February 4, 2013

Basho is proud be to be sponsoring Rubyfuza, happening this week in Cape Town, South Africa. We’ve sponsored and spoke at a few events in Cape Town over the past several years, and Riak has seen successful adoption among various South Africa-based companies like Praekelt and Mad Mimi. We’re happy to support the tech community in and around “The Tavern of the Seas.”

Sadly, as was the case with PyConZA, we won’t be able to send an official Basho envoy to be a part of it. That’s why we’re excited to announce that Jeremy Thurgood, a member of the Praekelt engineering team, will be there on our behalf as the Riak Ambassador.

Jeremy and his team have been using Riak in production for various projects, and have contributed some useful code to the community along the way. Though Python is his language of choice, he’s been brushing up on his Ruby and will be on-hand to answer any Riak questions that attendees might have. There will also be some Basho and Riak swag floating around to make sure that no one goes home empty-handed.

Enjoy Rubyfuza and make sure to say his to Jeremy if you have a moment. Also, if you’re attending a conference and want to serve as an extension of the Basho Team as a Riak Ambassador, shoot an email to te@basho.com. We want to talk to you.

Mark

Yokozuna Pre-release 0.3.0 Now Available

February 4, 2013

Today I’m happy to announce the 3rd pre-release of Yokozuna. It’s light on new features but has some good performance improvements and added robustness. Here are the highlights:

  • Allow store/retrieval of schemas via HTTP.
  • Upgrade to Solr 4.1.0 and the latest Riak.
  • Improve write/index throughput by disabling Solr’s “realtime get” and switching from XML update to JSON.
  • Added robustness around AAE and default index creation.
  • Listen on ‘solr//select’ to more easily work with existing clients out of the box.

To see all changes read the full release notes. Like the last two releases, an AMI has been made, see the EC2 doc for more info.

New for this release is the addition of a source package. I hope this might encourage those who are scared off by the process of building from git to give Riak/Yokozuna a try. These four steps below will produce a ready-to-run node under ‘rel/riak’.

wget http://s3.amazonaws.com/yzami/pkgs/src/riak-yokozuna-0.3.0-src.tar.gz
tar zxvf riak-yokozuna-0.3.0-src.tar.gz
cd riak-yokozuna-0.3.0-src
make stage

Ryan Zezeski

Building Retail and eCommerce Services with Riak

January 31, 2013

This is the second in a series of blog posts covering Riak for retail and eCommerce platforms. To learn more, join our “Retail on Riak” webcast on Friday, February 8th or download the “Riak for Retail” whitepaper.

In our last post, we looked at three Riak users in the eCommerce/retail space. In this post, we will look at some common use cases for Riak and how to start building them with Riak’s key/value model and querying features.

Use Cases

  • Shopping Carts: Riak’s focus on availability makes it attractive to retailers offering shopping carts and other “buy now” functionality. If the shopping cart is unavailable, loses product additions, or responds slowly to users, it has a direct impact on revenue and user trust.
  • Product Catalogs: Retailers need to store anywhere from thousands to tens of thousands of inventory items and associated information – such as photos, descriptions, prices, and category information. Riak’s flexible, fast storage makes it a good fit for this type of data.
  • User Information: As mobile, web, and multi-channel shopping become more social and personalized, retailers have to manage increasing amounts of user information. Riak scales efficiently to meet increased data and traffic needs and ensures user data is always available for online shopping experiences.
  • Session Data: Riak provides a highly reliable platform for session storage. User/session IDs are usually stored in cookies or otherwise known at lookup time, a good fit for Riak’s key/value mode.

Data Modeling

In Riak, objects are comprised of key/value pairs, which are stored in flat namespaces called “buckets.” Riak is content-type agnostic, and stores all objects on disk as binaries, giving retailers lots of flexibility to store anything they want. Here are some common approaches to modeling the data and services discussed above in Riak:

Querying

Riak provides several features for querying data:

Riak Search: Riak Search is a distributed, full-text search engine. It provides support for various MIME types & analyzers, and robust querying.
Possible Use Cases: Searching product information or product descriptions.

Secondary Indexing: Secondary Indexing (2i) gives developers the ability, at write time, to tag an object stored in Riak with one or more values, queryable by exact matches or ranges of an index.
Possible Use Cases: Tagging products with categories, special promotion identifiers, date ranges, price or other metadata.

MapReduce: Riak offers MapReduce for analytic and aggregation tasks with support for JavaScript and Erlang.
Possible Use Cases: Filtering product information by tag, counting items, and extracting links to related products.

Check out our docs for more information on building applications and services with Riak.

For more details and examples of common Riak use cases, register for our “Retail on Riak” webcast on February 8th or download the “Riak for Retail” whitepaper.

Basho

Riak on AWS – Deployment Options

January 30, 2013

Many teams run Riak in public cloud environments, either as a part of their infrastructure or as the foundation of it. Increasingly, we see enterprises and startups use a hybrid implementation that leverages both private infrastructure and public cloud services. This hybrid model is often used to address burst capacity issues, tenancy/location concerns, and simple proof-of-concept implementations prior to hardware acquisition.

Over the past few years, we have seen substantive adoption of Riak on Amazon Web Services. To that end, we are pleased that Basho has been approved as an Amazon Web Services Technology Partner. We look forward to highlighting interesting use cases, publishing detailed case studies of usage, and continuing to improve the usability and deployment speed of Riak on the AWS platform.

This post provides a high-level overview of your deployment options for using Riak on Amazon.

How Many Nodes?

Before we discuss the mechanics of implementation, it is important to consider the size of your deployment. One of the most frequent questions Basho is asked is, “How many nodes should I start with?”

If you have played with the Riak Fast Track you are familiar with deploying three nodes on a single machine. However, for production deployments, we recommend that your cluster be setup with a minimum of five nodes. For more details on how this minimum ensures the performance and availability of your implementation, please read the post entitled: Why Your Riak Cluster Should Have At Least Five Nodes.

So, you have a minimum of five nodes and you’ve decided that leveraging a cloud provider is appropriate for your current business needs. Now, how do you get started?

Amazon Machine Image

At its simplest, an Amazon Machine Image (AMI) is a pre-built machine image and configuration of Riak for Amazon EC2 users.

Obtaining and configuring the image is a relatively straightforward process. However, since Riak needs the nodes in the cluster to communicate with each other, there is some manual setup involved.

First, provision the Riak AMI onto the server of your choice via the AWS marketplace.

Once the virtual machine is created, manually configure the EC2 security group to allow the Riak nodes to speak to each other. The details of this step can be found on our docs portal under Installing on AWS Marketplace. However, this is generally as simple as opening a few inbound ports and defining a “Custom TCP rule.”

At this point, the machines can be clustered together. When the individual virtual machines are provisioned and the security group is configured, simply SSH into each machine and use internal riak-admin tools to join the nodes to the cluster.

Amazon CloudFormation

But what if you want to automate some of the configuration of your cluster? Or, what if you want the ability to setup a VPC-based stack that includes:

  • a front-end load balancer,
  • a cluster of application servers,
  • a Riak powered demo application,
  • a back-end load balancer,
  • and a cluster of Riak servers.

In that case, the Basho team has made available scripts that leverage AWS CloudFormation to build out your cluster in a scripted fashion.

Since this is a much different process than the previous method, it is well worth watching the introductory video (embedded below). In addition, the scripts in the cloudformation-riak repo can be thought of as “known good” templates. We accept Pull Requests and happy forking!

Manual Installation

As always, there is a manual option.

If you need to control the system configuration or are most comfortable with software that you have built and deployed yourself, there is always the option to install from package or source.

For a full list of supported operating systems, check out the Installing and Upgrading page of the doc portal. In addition, we have recently launched a new download page that includes the source for the OSS version of Riak.

Final Thoughts

Highly available.
Fault-tolerant.
Low latency.

And easier to deploy than ever before. If you have feedback on present deployment alternatives, or recommendations on ways to make Riak support for cloud infrastructure easier, please drop us a note in the mailing list.

The options above describe an OSS deployment of Riak. If you need multi-datacenter replication and support, contact us to discuss Riak Enterprise.

Basho

Riak in Production – Retail and eCommerce Stories

January 29, 2013

This is the first in a series of blog posts covering the benefits Riak offers to developers and operators of retail and eCommerce platforms. To learn more, join our “Retail on Riak” webcast on Friday, February 8th.

As retailers grow and have to store more and more data, traditional relational databases aren’t always the best option. Retailers want to scale easily, without the operational burden of manual sharding. Meanwhile, business requirements demand their data is always available for reads and writes. Riak is a highly available, low latency distributed database that is ideal for retailers who need to serve product data quickly and maintain “always on” shopping experiences. Riak is based on architectural principles from Amazon. Riak is designed for high availability and scale so retailers can always serve customers, even under failure conditions, and rapidly grow to meet peak loads.

Retailers of all sizes have chosen Riak to power parts of their business, including:

  • Best Buy: Best Buy is North America’s top specialty retailer of consumer electronics, personal computers, entertainment software, and appliances. Riak has been an integral part in the transformation push to re-platform Best Buy’s eCommerce platform. For more info, check out Best Buy’s talk from our 2012 developer conference, RICON.
  • ideeli: ideeli is one of the fastest growing retailers with over 5 million members and more than 1,000 brand partners. They use Riak to serve HTML documents and user-specific products. ideeli chose Riak to power their event-based shopping experience due to Riak’s ability to serve users information at low latency and provide ease of use and scale to ideeli’s operations team. Check out the complete case study for more details.
  • Copious: Copious is a social commerce marketplace that makes it easy for people to buy and sell the things they love. They currently store all registered accounts in Riak as well as the tokens that make it possible for users to authenticate with Copious via their Facebook or Twitter accounts. They chose to use Riak for their social login functionality because of its operational simplicity, which allows them to easily scale up without sharding and provides the high availability required for a smooth user experience. For more details, check out the complete Copious story on our blog.

For more information about the benefits of Riak for retailers and the retailers already using it, register for our “Retail on Riak” webcast on February 8th!

Basho

How Copious Uses Riak for Social Logins on its eCommerce Marketplace

January 28, 2013

Copious is a social commerce marketplace that makes it easy for people to buy and sell the things they love. Copious uses social data from Facebook and Twitter to customize the shopping and selling experience for each individual user around their interests, taste, and style. This connects buyers and sellers to each other in a unique way that also presents exciting technical challenges.

Copious Homepage

In the summer of 2012, Copious decided to switch to Riak from MongoDB for their social login functionality. They currently store all registered accounts in Riak as well as the tokens that make it possible for users to authenticate with Copious via their Facebook or Twitter accounts. Copious now stores hundreds of thousands of keys in Riak.

Copious found that Riak’s key/value data model was a natural fit for their authentication scheme and that it was easy to set up and run on Amazon Web Services. They run an HTTP service in front of Riak that presents data in the appropriate form and handles events between the front-end application and the backend data storage.

“Operating in a cloud environment, our infrastructure must be resilient to failure. Sometimes machines or even entire availability zones just disappear, and Riak’s fault-tolerant design means we remain available despite these failures. Riak is one component we never worry about, and requires much less operational work than other datastores,” said Robert Zuber, co-founder of Copious.

Copious is one of the many companies now using a polyglot approach to their platform – using Riak alongside MySQL, Redis, SOLR, and other technologies depending on the problem they need to solve. They chose to use Riak for their social login functionality because of its operational simplicity, which allows them to easily scale up without sharding and provides the high availability required for a smooth user experience. Based on their success with Riak, Zuber has said that they are looking to move more data to Riak in the future.

You can sign up now on Copious to earn $10 off your first $20+ purchase, plus the added bonus of knowing that Riak is in the background helping the site do its magic. If you’re in San Francisco, make sure to attend our Riak meetup on Wednesday, February 13, where Copious will be presenting how they use Riak alongside other datastores.

To learn more about how Riak can benefit your eCommerce or retail platform, join our webcast, “Riak on Retail” on February 8th!

Basho

Riak on Engine Yard

January 25, 2013

Today we’re excited to introduce early access of Riak on Engine Yard! You can also learn more on the Engine Yard blog. With Riak on Engine Yard, you can deploy a Riak cluster as simply as defining some configuration values and clicking “Add Cluster.”

A common theme, in several of our recent blog posts, has been Basho’s key focus on ease of deployment. We excel in making highly available, low latency, distributed systems. Engine Yard’s strengths lie in providing a hardened and secure Platform as a Service where you can manage your entire platform while retaining control of the environment. In addition, Engine Yard is well known for its contributions to the Ruby, PHP, and Node.js communities. The introduction of Riak on Engine Yard further validates customer demand for reliable and easy to use cloud solutions.

If you were at Ricon2012, you were probably one of the many who attended a talk entitled “Riak in the Cloud.” If you were unable to attend, you missed an amazing session where Ines Sombra and Michael Broadhead from Engine Yard spoke about their experiences with Riak and deploying it in the cloud. It’s great to see the lessons of distributed systems that were discussed translated into reality.

We look forward to seeing what the Basho community builds using Riak on Engine Yard. Get started now with 500 hours for free on their platform.

Basho