Tag Archives: Basho

Basho is pleased to announce the release of Riak CS 1.5

Basho is pleased to announce the release of Riak CS 1.5, which provides additional performance enhancements and simplifies administration and development with additional admin tools, enhanced S3 compatibility and a technical preview of an architecture to support clusters with very large amounts of storage. Highlights include:

Admin Tools

  • riak-cs-admin: Consolidates admin operations into a command line tool.
  • riak-cs-stanchion: Changes the Stanchion IP and port.
  • riak-cs-debug: Packages log, configuration and operating system command files along with Riak command results.
  • syslog: Support for standardized syslog output for log aggregation using third-party tools.

S3 API Features

  • multi-object delete: Reduces request overhead by supporting multiple deletes in a single request (up to 1,000 keys per request).
  • cache control headers: Method for providing caching instructions in a request header.
  • PUT object – copy: Creates a copy of an object that already exists in Riak CS.

A full list of S3 API compatibility can be found on the Basho docs site here.

Increased Scalability (Enterprise Feature)

Partly due to limitations with distributed Erlang, prior to 1.5 scalability, Riak CS was limited to several petabytes. CS 1.5 introduces a technical preview of an architecture that allows multiple Riak clusters to reside under a single CS namespace, thereby significantly increasing the amount of storage possible in a cluster. A production-ready version is planned for later this year, with multi-data center support to follow.

Garbage Collection Improvements

In Riak CS, deleted and updated objects are not removed immediately. Instead, a reference is written to a special bucket and later removed by the garbage collection process at regular intervals. CS 1.5 includes several garbage collection enhancements that will benefit customers with a high rate of object deletion or updates.

  • concurrent garbage collection worker processes: Speed up the rate of garbage collection with the addition of multiple workers.
  • flexible enforcement of leeway interval: In previous versions, updated and deleted objects are reaped only after they reach a predefined time-based leeway interval, which was set when an object was marked for deletion. In CS 1.5 the leeway interval is managed by the garbage collection daemon and can be changed to remove objects sooner, for example, in emergency situations where maximum storage capacity is reached.

Other Notable Enhancements

  • faster bucket listings: Optimizations in the OTP xmerl library enables faster bucket listings, in particular for large buckets.
  • setting ACLs upon PUT object: Ability to set ACLs via header at PUT object creation is now fully functional.

Riak CS 1.5 is available at: http://docs.basho.com/riakcs/latest/riakcs-downloads/. A full list of changes is available in the release notes. Watch the blog for a detailed discussion of the multi-cluster work.

Basho Introduces Riak CS 1.5

Distributed cloud storage software adds additional Amazon S3 compatibility, performance improvements, simplified admin and increased scalability

CAMBRIDGE, Mass. – August 5, 2014Basho, the creator and developer of Riak, the industry leading distributed NoSQL database, today introduced Riak CS 1.5 and Riak CS 1.5 Enterprise, Basho’s distributed object storage software. Riak CS (Cloud Storage) is open source software built on top of Riak, used to build public or private clouds, or, as reliable storage to power applications and services. Riak CS 1.5 delivers new features that improve operation, performance and scalability. Basho continues to offer enterprise-class features in Riak CS Enterprise, which includes multi-datacenter replication, world class 24 by 7 support and flexible pricing model.

Companies dealing with large amounts of unstructured data like videos, images and documents are adopting cloud object storage so that data is highly available through a seamlessly scalable architecture. Businesses in industries such as broadcasting and telecommunications are relying on stability, integration functionality and performance of Riak CS to efficiently store, organize and access data while making it simple to manage.

“We offer our customers affordable and scalable cloud storage solutions built on Basho’s Riak CS,” said Makoto Oya, vice director of IDC Frontier. “The enhanced Amazon S3 compatibility and ability to scale well into the multi-petabyte level in Riak CS 1.5 will help us better support the rapid growth we are seeing in our storage business.”

I-NET Corp, a data processing service headquartered in Japan, uses Riak CS for its cloud service called Dream Cloud® and is looking to achieve further cost efficiency thanks to the increased scalability capabilities in Riak CS 1.5.

“Cloud-based object storage is ideal for storing our customer’s growing business-critical data, and we have relied on the excellent performance, cost efficiency and high reliability of Riak CS for the I-NET Dream Cloud®,” said Tsutomu Taguchi, senior managing director, business group of I-NET Corp. “Riak CS already provides us with high availability and now that Riak CS is further optimized to scale, we believe that Riak CS 1.5 delivered by Basho will drive even higher adoption of Dream Cloud®.”

New features enhance performance for object storage to store increasing amounts of data worldwide
Basho delivers new functions in Riak CS that include:

  • Additional Amazon S3 compatibility: Expanded storage API compatibility with S3 includes features such as multi-object delete, put object copy, and cache control headers for more flexible integration with content delivery networks (CDNs).
  • Performance improvement in garbage collection process: Delivered especially for customers with high rate of object updates and deletes, Riak CS now more quickly reaps objects flagged for garbage collection.
  • New, simplified administrative features: New and consolidated admin features make organizational tasks easier for activities such as cluster management, monitoring and troubleshooting.
  • Multi-cluster support: Technology preview for increased scalability of Riak CS Enterprise by allowing multiple Riak clusters to reside under a single CS namespace, thereby expanding the maximum capacity of a single cluster.

“Providing the strongest key value solution and object store means responding to customer needs and demands attentively,” said Dave McCrory, CTO of Basho. “With Riak CS 1.5 Enterprise, new features are delivered as requested by our customers. We are committed to make it easier to consume cutting edge versions of Riak and will continue to do this by executing a more iterative approach in how we release Riak.”

Availability and Pricing  

Riak CS 1.5 is available immediately for Debian, Ubuntu, FreeBSD, OS X, Red Hat Enterprise Linux, Fedora, SmartOS and Solaris. To view the latest technical documentation or to download Riak CS, visit docs.basho.com/riakcs/latest/.

Basho delivers customized packages for its commercial software, Riak Enterprise and Riak Enterprise Plus, with health checks, as well as options for project-based Professional Services engagements. Full pricing details of Basho commercial software are at http://basho.com/riak-enterprise/#pricing. To request a trial license of Riak CS Enterprise, prospective inquiries can request a Riak CS Tech Talk at http://info.basho.com/SignUpRiakTechTalk.html.

Supporting Resources 

About Basho Technologies 

Basho is a distributed systems company dedicated to making software that is highly available, fault-tolerant and easy-to-operate at scale. Basho’s distributed database, Riak, and Basho’s cloud storage software, Riak CS, are used by fast growing Web businesses and by one third of the Fortune 50 to power their critical Web, mobile and social applications and their public and private cloud platforms.

Riak and Riak CS are available open source. Riak Enterprise and Riak CS Enterprise offer enhanced multi-datacenter replication and 24×7 Basho support. For more information, visit basho.com. Basho is headquartered in Cambridge, Massachusetts.

Basho Events in October

September 30, 2013

While the biggest event of October is Basho’s distributed systems conference, RICON West, we will still be traveling the world to attend many other events this month. Here’s a look at where you can find us during the weeks leading up to RICON.

Monktoberfest: Basho’s Director of Marketing, Tyler Hannan, will be speaking at Monktoberfest on “Medieval Art, Collective Intelligence, and Language Abuse – The Ethos of Distributed Systems.” Monktoberfest will take place in Portland, ME from Oct. 3-4.

Erlang Factory Lite: Basho will have speakers at both the Chicago event (Oct. 4th) and the Berlin event (Oct. 16th). Check out talks from Chris Meiklejohn and Steve Vinoski to learn more about Riak, Erlang, and distributed systems.

CloudConnect Chicago: Basho is a sponsor and exhibitor of CloudConnect Chicago, taking place Oct. 21-23. Basho engineer, John Burwell, will also be speaking about building private clouds with Apache CloudStack and Riak CS.

O’Reilly Strata: Basho will be exhibiting and speaking at the upcoming O’Reilly Strata conference in New York from Oct. 28-30. Stop by our booth and find out why we will all be using distributed systems in the future.

For a full list of where we’ll be for the rest of the year, check out the Events Page. And don’t forget to get tickets to our nearly sold-out developers conference, RICON West.

Basho

RICON East Videos Are Now Available

June 17, 2013

RICON East, Basho’s distributed systems conference, took place last month in New York. Hundreds of developers and academics gathered for two days to learn how distributed systems are being used in production and where they’ll be in the future.

Over the next few weeks, we will be posting the videos of the talks on the RICON East Archive. These videos are open to anyone and feature speakers from various distributed systems backgrounds. Slides for all of the talks are also available in the Archive.

The first six videos are already available on the site. These videos are:

Basho is also hosting another distributed systems conference, RICON West, in San Francisco on October 29-30th. We already have some great speakers lined up, including Jeff Dean (Google Fellow), Kate Matsudaira (Founder and CTO of Pop Forms), Peter Bailis (PhD Candidate at UC Berkeley), Justin Sheehy (CTO at Basho Technologies), Jeff Hodges (Distributed Systems Engineer at Twitter), and Diego Ongaro (PhD Candidate at Stanford University). Early bird tickets are on sale now.

Be on the lookout for more videos coming soon and we’ll see you at RICON West!

Basho

Basho Events in June

June 3, 2013

This summer, Basho will be traveling all over the world to sponsor and speak at various events. Keep an eye on our Events Page to see where we’ll be next. If you’re going to be at any of these events, we’d love to meet with you. Simply contact us and we can schedule a time for you to meet with a Basho team member.

Below are some highlights of where we will be:

Erlang User Conference: This conference brings together companies and developers using Erlang from all over the world. Join us in Stockholm, Sweden from June 10-14 to hear Bryan Fink, Basho’s Principal Software Engineer, speak on Riak Pipe and load distribution.

QCON: Basho will be at QCon in New York, NY from June 12-14, where we will be discussing how to select the right database technology and some existing and emerging data storage challenges. Basho’s Technical Evangelist, Tom Santero, will also be presenting “Riak, Latency, and Distributed Systems” on the first day.

GigaOm Structure SF: Basho is a proud sponsor of GigaOm Structure SF. This event takes place June 19-20 in San Francisco, CA. Basho’s Chief Architect, Andy Gross, will discuss the resurgence in interest in both theoretical and applied distributed systems and provide practical advice for dealing with systems in a newly distributed world.

For a full list of where we will be in June, visit our Events Page.

Basho

Closing Keynote from RICON East

May 30, 2013

Basho’s distributed systems conference, RICON East, was chock full of amazing talks from academics and professionals from all industries. Luckily, for everyone who couldn’t attend, all of the talks were recorded and will be available on the RICON site soon.

In the meantime, we have posted the slides from the closing keynote, presented by Basho Chief Architect, Andy Gross. His talk, entitled, “Lessons Learned and Questions Raised (from building distributed systems),” goes over his experience building distributed systems and how the space is changing. Check out his slides below and be on the lookout for the complete video, which will be posted soon.

Tickets are now on sale for RICON West, which will take place October 29-30 in San Francisco. You can get early bird pricing now through August 29th.

Basho

Riak Training, New York

May 1, 2013

On May 15 & 16, immediately following Basho’s Distributed Systems conference RICON East, Basho will be hosting Riak Training in New York. The cost to attend is $400. In addition, a 50% discount is extended to those holding a conference pass to RICON East.

If you’re interested in attending, tickets can be purchased at the Riak Training in New York page. Seats are limited. If you have any questions, you can reach out to casey@basho.com.

Riak training is a two day, hands-on, in-depth look at Riak. It is designed for engineers, developers, and operations staff to learn how to run, operate, and build apps with Riak. During this training, participants will learn how to:

  • Set up a small Riak cluster
  • Query the cluster using basic Key/Value, Links, 2i, and Map/Reduce
  • Understand deployment and performance considerations
  • Evaluate application Access Patterns
  • Consider data modeling implications in a distributed system

This training will also go over a number of topics, including:

  • Introduction to Riak
  • Basic Querying
  • Riak Under-the-Hood
  • Deployment Considerations
  • Performance Tuning
  • Monitoring/Troubleshooting
  • Application Development
  • Data Modeling
  • Distributed Systems Engineering

In addition we are offering Riak training in San Francisco from May 20-21. Tickets for the San Francisco training can be purchased on the Riak Training in San Francisco page.

Basho

Top Five Questions About Riak CS

May 1, 2013

This post looks at five commonly asked questions about Riak CS – simple, available, open source storage built on top of Riak. For more information, please review our full documentation, or sign up for an intro to Riak CS webcast on Friday, May 10.

What is the relationship between Riak and Riak CS?

Riak CS is built on top of Riak, exposing higher-level storage functions including large object support, an S3-compatible API, multi-tenancy, and per-user storage and access statistics. Riak itself provides the replication, availability, fault-tolerance, and underlying storage functions for the Riak CS implementation. Riak and Riak CS should both be installed on every node in your cluster. While Riak and Riak CS could be run on separate virtual or physical nodes, running them on the same machine minimizes intra-cluster bandwidth usage and is the recommended approach. As with Riak, we advise a minimum 5-node cluster.

When objects are uploaded to Riak CS, the object is broken up into smaller chunks which are then streamed, stored, and replicated in the underlying cluster. A manifest is maintained for each object, that points to which blocks comprise the object, and is used to retrieve all blocks and present them to the client on read. In addition to running Riak and Riak CS on each node, Stanchion, a request serializer, must be installed on at least one node in the cluster. This ensures that global entities, such as users and buckets, are unique in the system.

What use cases does Riak CS support that Riak doesn’t?

Riak CS has several features that are not provided in the standalone Riak database. One of the most obvious differences is in the size of objects supported. Riak CS exposes large object support, and includes multi-part upload so you can upload objects as a series of parts. This allows you to upload single objects to the system into the terabyte range. In Riak, the data model is simply key/value; in Riak CS, the key/value model provides the underlying structure for higher-level storage semantics – users, buckets and objects. The Riak CS interface is an S3-compatible HTTP API, allowing you to use existing S3 libraries and tools. In contrast, Riak exposes an HTTP and protobufs API and offers many language-specific clients. Unlike Riak, Riak CS is multi-tenant, with the concept of “users” and per-user reporting on storage and access. This makes it a fit for both private cloud scenarios, with multiple internal users, or as a foundation for a public cloud storage offering.

How does multi-tenancy, authentication and reporting work?

Riak CS exposes an interface for user creation, disablement and credential management. Riak CS can be set so that only administrators can create new users. Administrators also have special privileges including being able to retrieve a list of all users in the system and query the user account information of any user. Once issued credentials, users are able to authenticate, create buckets, upload and download files, retrieve account information, obtain new credentials, or disable their account through the API. Riak CS supports the standard S3 authentication scheme, with support for header and query string authorization.

Riak CS exposes storage, usage and network statistics that support use cases like accounting, subscription, billing or multi-group utilization for public or private clouds. Riak CS will report information on how much storage a user is consuming and the network operations related to access. This data is exposed via an HTTP interface and can be queried on the default timespan “now” or as a range from start time through end time. Access statistics are reported as bytes in and bytes out for both object and bucket operations. Reporting of this information can be scheduled for a set interval or manually triggered.

What’s the difference between Riak CS and Riak CS Enterprise?

Riak CS Enterprise provides multi-datacenter replication on top of Riak CS. For multi-datacenter replication in Riak CS, global information for users, bucket information and manifests are streamed in real-time from a primary implementation to a secondary site so global state is maintained across locations. Objects can then be replicated in either full sync or real-time sync mode. The secondary site will replicate the object as in normal operations. Additional datacenters can be added in order to create availability zones or provide additional data redundancy and locality. Riak CS Enterprise can also be configured for bi-directional replication. Riak CS Enterprise also comes with 24/7, enterprise-level support. More information and pricing can be found here, and full technical information is available on our docs portal. Ready to get started? Sign up for a developer trial of Riak CS Enterprise.

What are your plans for integration of Riak CS with open source compute solutions?

Riak CS provides highly available, distributed storage, making it a natural fit for usage alongside compute solutions. We have partnered with Citrix to collaborate on the integration of Apache CloudStack and Riak CS to create a complete cloud software offering that combines compute and storage in an integrated platform. For more information on our partnership with CloudStack, check out this blog post with the latest update. API and authentication support for OpenStack is also in progress.

Ready to get started? You can download Riak CS here, and check out the Riak CS Fast Track for a hands-on getting started guide.

SoftLayer & Basho Partner Announcement

SoftLayer & Basho Partner for High-Performance, Scalable Riak In The Cloud
Turnkey Big Data Environments Available Across SoftLayer’s Global Infrastructure

Dallas, TX and Cambridge, MA — April 30, 2013 — Basho and SoftLayer Technologies today announced the availability of Riak and Riak Enterprise on SoftLayer’s global cloud platform. The integrated solution provides the availability, fault tolerance, operational simplicity, and scalability of Riak combined with the flexibility, performance, and agility of SoftLayer’s on-demand infrastructure.

SoftLayer and Basho have collaborated to make Riak—an open source, distributed database—deployment more accessible and flexible through a pay-as-you-go service model. The solution enables organizations to swiftly deploy scalable production-grade systems, accelerating the speed of deployment of big data applications and providing greater business agility. Organizations can design and deploy a complete solution set through SoftLayer’s Web-based Solution Designer, with ongoing management and provisioning available via the company’s portal, mobile apps and API.

Common use cases for Riak include fault-tolerant, low-latency storage for content, user and session information, mobile data, log files, JSON/XML documents, and more. For customers that require replication of clusters between multiple data centers, Riak Enterprise is available and also adds extended monitoring and 24×7 support. Customers use multi-datacenter replication, in two or more sites, to serve global traffic, maintain active backups, run secondary analytics clusters, or meet disaster recovery and regulatory compliance requirements.

“Customer demand for easy-to-deploy and manage big data cloud-based solutions continues to rise,” says Duke Skarda, CTO of SoftLayer. “We are seeing substantial adoption through joint customers, such as Bump. Our platform was built specifically to support the kind of Web-scale distributed applications that big data exemplifies, and our partnership with Basho is further validation of our commitment to deliver a complete suite of scalable, high-performance big data solutions.”

“Basho and SoftLayer have long catered to innovative developers building the next generation of web, social and mobile applications. Today, enterprise customers are demanding the same, an architecture that provides for zero-data loss and delivers zero-downtime,” says Bobby Patrick, executive vice president and CMO of Basho. “We believe distributed systems software, such as Riak, and distributed infrastructure is required to help customers truly achieve these ambitions. Basho is excited to partner with SoftLayer to help companies easily deploy applications that are truly distributed, scalable, and always available.”

Bump is one of the most popular mobile apps on the market today. The app makes it easy for users to share their contact information, photos, and other objects by simply “bumping” their smartphones. Bump uses Riak to store user data including events, communications sent and received, handset information and authentication tokens.

“Operational ease is key to our business success,” says Mark Smith, Operations Lead at Bump. “The combination of SoftLayer, who we already trust with our business and data, and Basho, who makes the database that we trust at scale, saves us time and effort and allows us to focus on our business, not our data infrastructure.”

Features & Benefits

  • Web-based SoftLayer Solution Designer makes it easy to configure and deploy Riak environments on demand and at the click of a button.
  • High performance and superior availability and scalability leveraging the broadest cloud infrastructure platform in the industry including dedicated bare metal servers and a broad range of storage options.
  • Global private network allows for high-speed, secure replication between clusters
    Optimized infrastructure and best-practice deployments based on joint insights, expertise, and experience from SoftLayer and Basho.
  • Pay-as-you-go model provides the flexibility of monthly or annual billing and no long-term contracts.

Basho Announces Initial Speaker Line-Up for RICON East

Over 30 speakers from bitly, Comcast, The Weather Channel, Turner Broadcasting System, Harvard University, and more to discuss the future of distributed systems.

New York City, NY – April 8, 2013Basho, the worldwide leader in distributed database and cloud storage software, announced today the initial speaker line up for RICON East. RICON is Basho’s global conference series that is dedicated to distributed systems and is designed by and for engineers, developers, data scientists, and architects. RICON East is being held May 13-14 in New York City, NY. Basho expects to assemble hundreds of the industry’s most influential thinkers and practitioners devoted to deploying distributed systems technologies, including NoSQL solutions and Cloud Storage.

Speakers include:
Dr. Margo L. Seltzer, Harvard University
Rich Hickey, Creator of Clojure, Datomic
Camille Fournier, Rent the Runway
Alex Payne, Breather
Hilary Mason, bitly
Theo Schlossnagle, OmniTI
Robert Treat, OmniTI
Neha Narula, Massachusetts Institute of Technology (MIT)
Neil Conway, UC Berkeley
Kyle Kingsbury, Factual
Ed Laczynski, Datapipe
Brian Akins, Turner Broadcasting System
Sathish Gaddipati, The Weather Channel
Michajlo Matijkiw, Comcast
Mark Wunsch, Gilt Groupe

Basho engineers will be featured prominently throughout RICON East. Basho speakers include: Andy Gross, Sean Cribbs, Matthew Von-Maszewski, Ryan Zezeski, Chris Tilt.

RICON East builds on Basho’s highly successful, sold-out RICON 2012 event held Fall 2012 in San Francisco. Presentations from RICON 2012 are available to view at www.ricon2012.com.

Ticket Information
Tickets are available online at http://ricon.io/east.html. Student discount prices are available online. For other discounts, including discounts for large groups, contact Mark Phillips at mark@basho.com.

Sponsorship information
Initial sponsors of RICON East include Fastly, Meraki, Engine Yard, Github and NoSQLWeekly. For more information on sponsorship opportunities, contact Tom Santero at tsantero@basho.com.

About Basho Technologies
Basho is a distributed systems company dedicated to making software that is highly available, fault-tolerant and easy-to-operate at scale. Basho’s distributed NoSQL database, Riak, and Basho’s cloud storage software, Riak CS, are used by fast growing Web businesses and by over 25% of the Fortune 50 to power their critical Web, mobile and social applications and their public and private cloud platforms.

Riak and Riak CS are available open source. Riak Enterprise and Riak CS Enterprise offer enhanced multi-datacenter replication and 24×7 Basho support. For more information, visit basho.com.

Basho is headquartered in Cambridge, Massachusetts and has offices in London, San Francisco, Tokyo and Washington DC.