At the recent meetup for the New York Linux Users Group (NYLUG), Basho Technical Evangelist, Tom Santero, presented “An Introduction to Basho’s Riak.” In this talk, Tom explains how Riak addresses the challenges of concurrent data storage at scale. He discusses the various design decisions, tradeoffs made, and theories at work within Riak. He also provides guidance as to how you might deploy Riak in production and why.
In addition to introducing the basics of Riak and its key/value data model, Tom presents some of the exciting features being introduced with Riak 2.0. Riak Data Types adds counters, sets, and maps to Riak – allowing for better conflict resolution. They enable developers to spend less time thinking about the complexities of vector clocks and sibling resolution and, instead, focusing on using familiar, distributed data types to support their applications’ data access patterns.
You can watch Tom’s full talk below:
For more information about Riak and how it differs from traditional databases, check out the whitepaper, “From Relational to Riak.”
To see where Basho will be presenting next, visit the Events Page.
Online payments leader, Klarna, has been on a multi-year process to upgrade its monolithic legacy purchase system to a next generation, distributed, service-oriented system. Klarna’s goal has been to build a horizontally-scalable, masterless, purchase taking front-end system that can easily handle Klarna’s rapid business growth ambitions. Klarna deployed Riak as the distributed database underlying their new purchasing system.
Recently, Malcolm Matalka, programmer at Klarna, presented on using Riak. Calling Riak a “joy to use,” Malcolm discusses how important it was to build a system that would enable them to “not be afraid of losing machines.” He explains, in detail, the challenges and benefits of moving from a huge monolithic, transaction-based system that has served Klarna well for the past eight years.
Early in the project, Klarna recognized that they wanted a system that matched the aspirations of Amazon. Malcolm notes that Riak is built on top of “very strong theoretical foundations,” citing the Amazon Dynamo paper.
Some of the highlights from his presentation include:
To help provide a basic overview of Riak, we have put together a short, “Intro to Riak” webcast. This webcast has been recorded and can be referenced and shared at any time. It is a great way to get a basic understanding of Riak and is a useful tool to send to your team as you’re evaluating Riak.
This “Intro to Riak” webcast describes Riak at a high level and looks at some of the design goals, including high availability, low latency, horizontal scalability, fault tolerance, and operational friendliness. It then dives into some of these tenets a bit more to see how Riak achieves these design goals and how developers can build apps with Riak’s key/value data model. It also looks at some of the deployment options available for Riak and how to evaluate when Riak might make sense for your use case. Finally, it discusses some case studies of Riak in production and provides a look at the Riak roadmap.
Riak is a straight key/value data store and all objects are stored on disk as binaries. It is content agnostic – meaning you can store any type of data as the value in Riak. To improve the usability and functionality of Riak, we offer multiple querying options including Riak Search, Secondary Indexing, and MapReduce. Riak Search is a full-text search that allows Riak developers to index the contents of stored values. While Riak Search offers much needed functionality, it had its flaws.
In Riak 2.0, Riak Search received a complete overhaul. Riak Search 2.0 leverages the Apache Solr full-text document indexing engine directly. Riak users now get the power of Solr, with the availability and scalability of Riak. This upgrade also supports the Solr client-queries API, which enables integration with existing software solutions.
Eric Redmond is one of the Basho engineers who works on Riak Search. At RICON, he presented “Riak Search 2.0,” which walks through what’s new with Riak Search and why you’d want to use it. He also provides some impressive demos that show off the power of Solr and Riak. His full talk is below.
For more information on Riak Search 2.0, check out these resources on Github.
At Strange Loop 2013, Garrett Eardley (Software Engineer at Riot Games) presented “Tracking Millions of Ganks in Near Real Time.” His talk focused on the popular game, League of Legends, and the challenges that come with supporting millions of concurrent players at any given moment of the day. At this scale, tracking even simple gameplay statistics results in the creation of terabytes of data that must be aggregated and presented to players in near real-time. Garrett and his team found that scaling the system and developing additional features became difficult while using Riot’s initial technology choice for statistics, MySQL.
They found that they weren’t using many of the features available with MySQL and began to evaluate some NoSQL solutions. They looked at HBase, Cassandra, CouchDB, and Riak. With this new system, they wanted high availability over consistency, which narrowed the options down to Riak and Cassandra. Based on negative past experiences and a lack of conflict resolution control, the team ultimately decided on Riak over Cassandra.
Garrett’s talk explores how Riak is leveraged for their next generation stats system, discusses why they selected Riak, looks at how they structure their data and indexes, and shares strategies for working with eventually consistent data. The complete recording of Garrett’s talk is now available. You can check out the talk and his slides here.
A few weeks ago, at AWS re:Invent 2013, The Weather Company announced their new IT platform, which focuses on next generation forecasting using big data. To build this platform, they required an architecture that was both flexible and reliable, and selected Riak to achieve that. Riak underpins the new IT platform and is used to store a variety of data from satellites, radars, forecast models, users, and weather stations worldwide.
At re:Invent, the Vice President of Enterprise Data at the Weather Company, Sathish Gaddipati, spoke about The Weather Company’s overall IT transformation in a talk titled, “How the Weather Company Monetizes Weather, the Original Big Data Problem.” If you missed Sathish’s session at re:Invent, the entire talk is now available on the AWS Youtube Channel and can be watched below.
This talk provides more details on The Weather Company’s architecture, technology choices, performance results, and business benefits realized from this IT transformation. It also discusses how the application of these technologies can help keep people safe and help businesses plan and become more profitable, thanks to the latest intersection of consumer behavior and weather forecasting and reporting.
Kivra is a Swedish company that provides secure digital mailboxes, allowing users to securely receive, upload, and store all postal mail. Their mailboxes help users organize bills and notifications while eliminating the environmental footprint created from paper mail.
At a Riak Meetup in Dublin earlier this year, Kivra CTO, Bip Thelin, spoke about how they currently use Riak. Originally, Kivra tried to build their platform on a SQL database. However, they quickly outgrew this system and decided to move their infrastructure to Erlang and Riak because of its scalability and resiliency. You can watch Bip’s full presentation below to learn more about why they chose to switch to Riak, how they built six Riak clusters, and some of the lessons they’ve learned.
Basho partner, Erlang Solutions, recently hosted a webinar that featured Riak powering the largest independent video communication service provider, ooVoo.
ooVoo has over 85 million users worldwide, with nearly 2.5 million users generating an average of 300 million minutes of video every day. These users also generate about 1,000 chat messages per second. With all of this activity, ooVoo adds nearly 40GB of data per day and now maintains tens of terabytes of data.
In 2012, ooVoo selected Riak to deploy new communication features and ensure no-single point of failure in their always-available architecture. Today, Riak is used to support cloud based chat history, rich interactive chat, group communication features, and an infinite retention policy.
In the webinar, ooVoo Senior Director and System Architect, Alex Fok, discusses their business requirements, architecture decisions, and business results from their deployment of Riak. The webinar is available here and can also be viewed below.
Earlier this month, we announced the availability of Riak CS 1.4, which added a number of performance improvements, OpenStack integration, and simpler user management. To provide more details about what was introduced with the latest release, we also hosted a “What’s New in Riak CS 1.4” webcast.
This short webcast provides an overview of both Riak CS and Riak, and discusses what’s new in Riak CS 1.4. It also looks at the fundamental features and architecture of Riak CS, talks about the key partnerships, and discusses Riak CS Enterprise – the commercial extension of Riak CS.
You can watch the complete recording below.
You can also view the slides from this webcast here.
To accompany our recent Riak 1.4 announcement, we hosted a live “What’s New in Riak 1.4” webcast. While we had many attendees that asked some great questions, we realize not everyone was able to tune in. That’s why we’re providing the complete recording below.
The webcast is about 30 minutes. It provides a quick background of the basics of Riak and discusses what’s new in the Riak 1.4 release, including the addition of eventually consistent counters, improvements in secondary indexing, and Riak Control updates. The webcast also covers Riak Enterprise and the enhancements released with 1.4. Finally, it looks at how other companies are using Riak and what’s in store for the future Riak 2.0 release later this year.