Tag Archives: Youtube

Hangouts with Basho

January 29, 2014

On Fridays, Basho hosts a Hangout to discuss various topics related to Riak and distributed systems. While Basho evangelists and engineers lead these live Hangouts, they also bring in experts from various other companies, including Kyle Kingsbury (Fatcual), Jeremiah Peschka (Brent Ozar Unlimited), and Stuart Halloway (Datomic).

If you haven’t attended a Hangout, we have recorded them all and they are available on the Basho Technologies Youtube Channel. You can also watch each below.

Data Types and Search in Riak 2.0

Featuring Mark Phillips (Director of Community, Basho), Sean Cribbs (Engineer, Basho), Brett Hazen (Engineer, Basho), and Luke Bakken (Client Services Engineer, Basho)

Bucket Types and Configuration

Featuring Tom Santero (Technical Evangelist, Basho), Joe DeVivo (Engineer, Basho), and Jordan West (Engineer, Basho)

Riak 2.0: Security and Conflict Resolution

Featuring John Daily (Technical Evangelist, Basho), Andrew Thompson (Engineer, Basho), Justin Sheehy (CTO, Basho), and Kyle Kingsbury (Factual)

Fun with Java and C Clients

Featuring Seth Thomas (Technical Evangelist, Basho), Brett Hazen (Engineer, Basho), and Brian Roach (Engineer, Basho)

Property Based Testing

Featuring Tom Santero (Technical Evangelist, Basho) and Reid Draper (Engineer, Basho)

Datomic and Riak

Featuring Hector Castro (Technical Evangelist, Basho), Dmitri Zagidulin (Professional Services, Basho), and Stuart Halloway (Datomic)

CorrugatedIron

Featuring John Daily (Technical Evangelist, Basho), David Rusek (Engineer, Basho), and Jeremiah Peschka (Brent Ozar Unlimited)

A Look Back

Featuring John Daily (Technical Evangelist, Basho), Hector Castro (Technical Evangelist, Basho), Andy Gross (Chief Architect, Basho), and Mark Phillips (Director of Community, Basho)

Hangouts take place on Fridays at 11am PT/2pm ET. If you have any topics you’d like to see featured, let us know on the Riak Mailing List.

Basho

RICON West Videos: Riak Search 2.0

December 17, 2013

In addition to Riak Data Types, there were a number of other presentations about Riak 2.0 features at RICON West. With the Technical Preview of Riak 2.0, we also announced a completely redesigned Riak Search.

Riak is a straight key/value data store and all objects are stored on disk as binaries. It is content agnostic – meaning you can store any type of data as the value in Riak. To improve the usability and functionality of Riak, we offer multiple querying options including Riak Search, Secondary Indexing, and MapReduce. Riak Search is a full-text search that allows Riak developers to index the contents of stored values. While Riak Search offers much needed functionality, it had its flaws.

In Riak 2.0, Riak Search received a complete overhaul. Riak Search 2.0 leverages the Apache Solr full-text document indexing engine directly. Riak users now get the power of Solr, with the availability and scalability of Riak. This upgrade also supports the Solr client-queries API, which enables integration with existing software solutions.

Eric Redmond is one of the Basho engineers who works on Riak Search. At RICON, he presented “Riak Search 2.0,” which walks through what’s new with Riak Search and why you’d want to use it. He also provides some impressive demos that show off the power of Solr and Riak. His full talk is below.

For more information on Riak Search 2.0, check out these resources on Github.

To watch all of the sessions from RICON West 2013, visit the Basho Technologies Youtube Channel.

Basho

RICON West Videos: Distributed Systems in Academia

December 11, 2013

In the world of distributed systems, there are still a lot of unsolved problems and improvements to be made. This means that there is a lot of interesting research being done at top institutions around the world – with some of the brightest minds looking to improve distributed systems. At RICON West, Basho’s developer conference, we brought three PhD students and candidates to speak, whose work on distributed systems has been vital to both Basho and the future of the industry.

Peter Bailis is a PhD student at UC Berkeley. His talk, “Bad As I Wanna Be: Coordination and Consistency in Distributed Databases,” goes into how to reason about the trade-offs between coordination, consistency, latency, and availability, with a focus on practical takeaways from recent research both at UC Berkeley and beyond. He also talks about reconciling “consistency” in NoSQL and ACID databases and explains why, even though you probably didn’t “beat the CAP Theorem,” you (and tomorrow’s database designs) may be on to something. His full talk is below.

Lindsey Kuper is a PhD candidate at Indiana University, who studies the foundations of deterministic parallel programming. At RICON, she spoke on “LVars: Lattice-Based Data Structures for Deterministic Parallelism,” which introduces LVars (data structures that enable deterministic parallel programming). LVars generalize the single-assignment variables often found in deterministic parallel languages to allow multiple assignments that are monotonically increasing with respect to a user-specified lattice of states. LVars maintain determinism by allowing only monotonic writes and “threshold” reads to and from shared data. Her talk looks at examples of programming in an LVar-based parallel language that is provably deterministic, and explores the connection between LVars and CRDTs. The complete talk is below.

Finally, we had Diego Ongaro, a PhD student at Stanford University, talk about “The Raft Consensus Algorithm.” His talk discusses Raft, a consensus algorithm designed for understandability and developed by Diego and Professor John Ousterhout. Raft is equivalent to Paxos in fault-tolerance and performance, but it’s designed to be as easy to understand as possible, while cleanly addressing all major pieces needed for practical systems. The hope is that Raft will make consensus available to a wider audience, and that this wider audience will be able to develop a wider variety of higher quality consensus-based systems than are available today. You can learn more about Raft below.

To watch all of the sessions from RICON West 2013, visit the Basho Technologies Youtube Channel.

Basho

RICON West Videos: Netflix and Twitter

December 10, 2013

RICON is Basho’s conference series that’s focused on distributed systems. However, just because it is hosted by Basho does not mean it’s all about Riak. While the conference does feature some sessions about what’s new with Riak and Riak in production, we also try and bring speakers that are using other distributed systems to solve industry problems.

This year at RICON West, Jeff Hodges (Distributed Systems Engineer at Twitter) and Jason Brown (Senior Software Engineer at Netflix) both spoke about their experiences with distributed systems, including non-Riak systems.

Jeff Hodges’ talk, “Practicalities of Productionizing Distributed Systems,” discusses some of his tactics and strategies for getting a distributed system into production. He draws upon his experiences at Twitter and shares what he has learned from launching distributed systems at one of the largest social media companies. You can watch the full talk below.

Jason Brown’s talk, “Dynamic Dynamos: Comparing Riak and Cassandra,” provides a comparison of two popular distributed systems, Basho Riak and Apache Cassandra. Jason is a committer on the Apache Cassandra project and, due to working at Netflix, has a lot of experience using Cassandra in his day-to-day. This talk compares and contrasts these two Dynamo implementations and looks at how Riak could be used at Netflix from both a data modeling standpoint, as well as operating in a cloud-based environment. His full talk is below.

You can watch all of the talks from RICON West 2013 on Basho’s Youtube Channel.

Basho

RICON West Videos: Seagate and The Weather Company

December 3, 2013

The videos from RICON West 2013 are now available. RICON West brought together hundreds of developers to discuss distributed systems. It also featured 26 speakers over two days who spoke about new features in Riak, Riak in production, distributed systems in production, and research related to distributed systems.

In particular, there were some interesting talks related to how major companies are using Riak. James Hughes, Principal Technologist at Seagate Technology spoke on “The Seagate Kinetic Open Storage Platform: Innovation to Enable Scale Out Storage.” The week prior to RICON West, Seagate announced their Kinetic Open Storage Platform that utilized Riak as the backend. On Day One of RICON West, James Hughes did the first public demo of this platform during his session. The platform leverages Seagate’s expertise in hardware and software storage systems, integrating an open source API and Ethernet connectivity with Seagate hard drive technology. Check out his full talk below for more information on the Kinetic Open Storage Platform, how it utilizes Riak, and the live demo.

RICON West also featured two speakers from The Weather Company, Raja Selvaraj (Manager of Data Systems Engineering) and Arvinda Gillella (SUN Architect). Their talk, “Building Next Generation Weather Data Distribution and On-demand Forecast Systems Using Riak,” describes The Weather Company’s need to effectively store and distributed terabytes of data, while still maintaining manageability, scalability and usability. Their talk focuses on the challenges they face trying to solve this problem and why they ultimately chose Riak as its solution. It also discusses their new IT platform, which uses Riak to build the next generation on-demand forecasting system. The full talk is available below:

To watch all of the sessions from RICON West 2013, visit the Basho Technologies Youtube Channel.

Basho

The Weather Company and Basho

December 2, 2013

A few weeks ago, at AWS re:Invent 2013, The Weather Company announced their new IT platform, which focuses on next generation forecasting using big data. To build this platform, they required an architecture that was both flexible and reliable, and selected Riak to achieve that. Riak underpins the new IT platform and is used to store a variety of data from satellites, radars, forecast models, users, and weather stations worldwide.

At re:Invent, the Vice President of Enterprise Data at the Weather Company, Sathish Gaddipati, spoke about The Weather Company’s overall IT transformation in a talk titled, “How the Weather Company Monetizes Weather, the Original Big Data Problem.” If you missed Sathish’s session at re:Invent, the entire talk is now available on the AWS Youtube Channel and can be watched below.

This talk provides more details on The Weather Company’s architecture, technology choices, performance results, and business benefits realized from this IT transformation. It also discusses how the application of these technologies can help keep people safe and help businesses plan and become more profitable, thanks to the latest intersection of consumer behavior and weather forecasting and reporting.

For additional details on why The Weather Company selected Riak over Cassandra, MongoDB, and Hadoop, check out Doug Henschen’s InformationWeek article “Big Data Reshapes Weather Channel Predictions.”

Basho

RICON West Videos are Now Live!

November 25, 2013

RICON is Basho’s distributed systems conference series for developers. Last month, RICON West took place at the St. Regis in San Francisco and brought together hundreds of engineers, developers, scientists, and architects to discuss the theory, practice, and importance of running distributed systems in production. It was a packed two-days with 26 talks from Basho, Google, Netflix, Seagate, The Weather Company, Twitter, and many others.

All of the talks were recorded and sessions from Day One are now available on the Basho Technologies Youtube Channel! Check out the RICON West 2013 playlist to see talks from:

All talks from Day Two will be added to the playlist over the next few weeks. Be sure to subscribe to Youtube.com/BashoTechnologies for notifications about new RICON West videos and other Basho content.

Basho

A Weekly Hangout With Basho

November 11, 2013

Last Friday, the Basho team held our inaugural Riak Community Hangout.

This 30 minute session is a development focused conversation with topics changing weekly. The Hangout is planned for most Fridays at 11am Pacific/2pm Eastern/7pm GMT, with the URL published shortly before it begins. All Hangouts will be archived and hosted on the Basho Technologies Youtube channel. You should follow @basho for all updates about future Hangouts.

Over the next few weeks, these Hangouts will focus on the new features planned for Riak 2.0.

The first session was hosted by Basho’s Director of Community, Mark Phillips, who discussed Riak Data Types and Riak Search 2.0 with Basho engineers Sean Cribbs, Brett Hazen, and Luke Bakken.

The Hangout began with an overview of Riak Data Types, available with the 2.0 Technical Preview, and examined their implementation, use cases, and implementation considerations. Following this (at 18 minutes, 35 seconds), Brett Hazen provided an overview of Riak Search 2.0 (codenamed Yokozuna) and Luke Bakken queried a portion of the Twitter stream on a cluster running the newest Riak Search 2.0 code.

Upcoming sessions will focus on Riak/Riak CS internals, application building, data modeling, and community requested topics. We are also looking for community members to join in and highlight what you’re building with Riak and Riak CS developers

If you have questions or topics you would like to hear discussed, reach out on the message list, in IRC (#riak on irc.feenode.net), or contact us.

Basho