For years, the press and industry analysts have been telling us that cloud is mainstream, but the reality is that Enterprises must shift their workloads to the cloud in an orderly, low risk manner. While there are many applications already built and running in the cloud, there are many new (or underutilized and, perhaps, misunderstood) technologies like Docker, Chef and object storage that are changing the way cloud applications are implemented.
At RICON 2014, Basho worked with Citrix to host “Build a Cloud Day.” Build a Cloud day sessions explore new technologies and show how to bring some order to the chaos of moving workloads to the cloud. The attendees learn the concepts and best practices to deploy a cloud computing environment using Apache CloudStack and other cloud infrastructure tools, including those from XenServer, Docker, RiakCS, Chef, Zenoss, Puppet and many others that automate server and network configuration for building highly available cloud computing environments.
Cloud Architecture: Virtualization, Orchestration and Storage
“Build a Cloud Day” started with an excellent presentation by Mark Hinkle. Many of us know him as @mrhinkle. Mark is the Senior Director of Open Source Solutions at Citrix Systems where he helps support the Apache CloudStack and Xen.org projects.
Mark has an excellent grasp of cloud computing and provides an overview of cloud computing architecture and the open source software that can be used to deploy and manage a cloud-computing environment. He looks at virtualization and containers and provides a brief description of Docker and how it is being used in today’s applications.
He also provides an overview of OpenStack. Mark closes the presentation with insights into how to deliver Platform-as-a-Service (PaaS) and what technologies can be used to compliment this evolving cloud computing paradigm.
Software is Eating Infrastructure
Other presenters at “Build a Cloud Day” included Basho’s own John Burwell (@john_burwell). John is a Senior Software Engineer at Basho Technologies. He also serves as an Apache CloudStack PMC member and committer focused on storage architecture and security integration. John’s talk explores cloud design strategies to achieve high availability and reliability using commodity components and how to apply these strategies using Apache CloudStack and Riak CS.
By migrating reliability and scalability responsibilities up the stack from specialized hardware to software, cloud orchestration platforms such as Apache CloudStack (ACS) and object stores such as Riak CS increase the utilization and density of compute and storage resources by dynamically shifting workloads based on demand.
John describes two workloads predominately managed in cloud environments — traditional virtualization and cloud — and how to use Apache CloudStack to efficiently manage both simultaneously. He then explores storage design to support this dual workload model, including the use of Riak CS with Apache CloudStack to reduce infrastructure costs without sacrificing reliability.
Riak CS provides software-defined, fault-tolerant object storage uniquely built to handle a variety of unstructured and big data needs using commodity hardware.
Apache CloudStack, Apache Brooklyn and more…
There were many great presentations at “Build a Cloud Day” including:
- Primary Storage in CloudStack by Mike Tutkowski (Slides | Video)
- Introduction to Apache CloudStack by David Nalley (Slides | Video)
- Hypervisor Selection in the Cloud by Tim Mackey (Slides | Video)
- Cloud Application Blueprints with Apache Brooklyn by Alex Henevald (Slides | Video). Alex also did a Riak-specific presentation at RICON 2014, Running Riak in a Docker Cloud using Apache Brooklyn.
You can find out more about RICON 2014 in our blog post. http://basho.com/wrapping-up-ricon-2014/.
The videos of the presentations at RICON 2014 can be found on our RICON Archive site. The Keynote by Peter Alvaro – Outwards from the Middle of the Maze is very popular.
October features Strata in New York, distributed systems events in the UK and our own conference, RICON in Las Vegas. Take a look at where Basho will be during the next few weeks.
Strata + Hadoop World (October 15-17 in New York, NY): Strata + Hadoop World is about all the tools and techniques that make data work. It’s a great opportunity to learn about new business applications of big data and emerging best practices. We will be attending and sponsoring, so stop by booth 363 or tweet us @basho if you’re interested in meeting.
All You Base (October 17 in Oxford, UK): All Your Base is the only curated database conference of its kind in the UK. We are happy to be sponsoring and are looking forward to hearing presentations from industry leaders, developers and database creators. We’d love to meet and chat, so tweet us @basho if you’re attending.
LADIS 2014 (October 23-24 in Cambridge, UK): The 8th Workshop on Large Scale Distributed Systems and Middleware (LADIS 2014) will bring together a select group of researchers and professionals in the field to discuss their work in an engaging workshop atmosphere.
Our own Russell Brown will be giving a keynote on From Paper to Product: Putting CRDTs into Riak 2.0 which will explore how to manage complex data types in Riak 2.0. His session will be on October 23 at 4:30 p.m. BST.
RICON 2014 (October 27-29 in Las Vegas, NV): RICON is a distributed systems conference hosted by Basho, bringing together developers, industry leaders, partners, customers and community members to discuss all the ways they apply distributed systems. This year’s event will kick off with Build a Cloud Day presented by Citrix Systems on October 27, which is designed to expose attendees to the concepts and best practices around deploying cloud computing infrastructure.
Then we’ll dive into two days of keynote presentations, in-depth sessions, technical tracks, panel discussions, cocktail events and more. This year’s keynote speakers include:
- Mark Interrante, SVP of engineering, HP Helion;
- Marten Mickos, SVP and general manager of cloud, HP (previously CEO of Eucalyptus); and
- Mac Devine, director of cloud innovation and CTO, IBM Cloud Services Division.
RICON will also feature presentations from the following organizations: AdRoll, Alert Logic, Basho Technologies, Bitly, Braintree – a PayPal Company, Chartbeat, Cloudsoft, Comcast, Dataloop.io, Google, HashiCorp, MIT CSAIL, OpenX, Percona, Riot Games, SWI-Prolog, Two Sigma, UC Berkeley, Universidade Nova de Lisboa, Universidade do Minho, University of Kaiserslautern, UPMC/INRIA, Yahoo!.
For more information and to register, visit ricon.io.
Distributed systems conference to feature provocative discussions and presentations on the future of distributed systems with industry thought leaders from HP and IBM
HERNDON, Va. – September 25, 2014 – Basho Technologies, the creator and developer of Riak, the industry leading distributed NoSQL database, today introduced keynote speakers and a preliminary speaker list for RICON 2014, the distributed systems conference hosted by Basho. This year’s event will feature keynote speakers: Mark Interrante, SVP of engineering, HP Helion; Marten Mickos, SVP and general manager of cloud, HP (previously CEO of Eucalyptus); and Mac Devine, director of cloud innovation and CTO, IBM Cloud Services Division.
“We are thrilled to have attracted such an influential lineup of speakers at this year’s RICON conference,” said Adam Wray, CEO of Basho. “Mark, Marten and Mac all have extensive experience in the open source, infrastructure software and cloud industries, so it will be interesting for attendees to hear their perspectives on distributed systems trends. This year’s RICON is shaping up to be the biggest yet and we hope our attendees gain valuable insights as they build out their scalable database initiatives.”
Interrante, Mickos and Devine have experience leading cloud and software enterprise companies in distributed systems and are sought-after speakers at industry events. Their keynote presentations will be introduced by Wray and Basho CTO, Dave McCrory. Speakers will cover topics such as the state of open source, big data, IoT and public and private clouds all within the context of distributed systems.
- Mark Interrante, SVP of engineering, HP Helion, has more than 14 years of VP-level product development experience with Internet companies ranging from startups to global Fortune 500s. Prior to joining HP in early 2014, he was SVP of product at Rackspace where he helped invent, design, build and operate the world’s largest open cloud.
- Mac Devine, director of cloud innovation and CTO, IBM Cloud Services Division, has more than 20 years of experience with networking and virtualization. Before joining IBM in 2008, he started the zCloud Innovation team and served as its chief architect. Devine is an IBM Master Inventor and a member of IBM’s prestigious Academy of Technology.
- Marten Mickos, SVP and general manager of cloud, HP, is a veteran of open source, infrastructure software and global businesses, served as CEO of Eucalyptus (now in agreements to be acquired by HP) and will join HP as SVP and general manager of cloud. Previously, he was CEO of MySQL AB where he grew the company from a garage startup to the second largest open source software company in the world.
“RICON is a significant gathering of the distributed systems industry, bringing together luminaries from vendors to end users to academia,” said Devine. “I look forward to being a part of this year’s conference and interacting with other members of the cloud ecosystem at the show. My focus will be to get at the center of how cloud services will transform in the evolution of distributed systems.”
The preliminary speaker list is posted on the RICON site, ricon.io. Speaker sessions are expected from the following organizations : AdRoll, Alert Logic, Basho Technologies, Bitly, Braintree – a PayPal Company, Chartbeat, Cloudsoft, Comcast, Dataloop.io, Google, HashiCorp, MIT CSAIL, OpenX, Percona, Riot Games, SWI-Prolog, Two Sigma, UC Berkeley, Universidade Nova de Lisboa, Universidade do Minho, University of Kaiserslautern, UPMC/INRIA, Yahoo!. Below are highlights of a few of the speakers and their sessions.
- Peter Alvaro is a doctorate candidate at the University of California, Berkeley, where he is advised by Joseph M. Hellerstein. His principal research interests are databases, distributed systems and programming languages. His session will be: Outwards from the Middle of the Maze: Using Lineage to find Bugs at Scale.
- Armon Dadgar is CTO of HashiCorp, where he is focused is on the real-world application of distributed systems to solve problems, specifically in the world of DevOps and application orchestration. His session will be: Consul: Service Oriented at Scale.
- Aysylu Greenberg works at Google. In her spare time, she works on open source projects in Clojure, ponders the design of systems that deal with inaccuracies, paints and sculpts. Her session will be: Benchmarking: You’re Doing It Wrong.
- Alex Heneveld is the CTO of Cloudsoft and brings 20 years of experience designing software solutions in the enterprise, start-up and academic sectors. His session will be: Using Clocker to Deploy and Manage Distributed Applications in a Docker Cloud, and is co-presented with Andrew Kennedy, a senior engineer for Cloudsoft.
- Neha Narula is a doctorate candidate at MIT, building fast, scalable multi-core and distributed systems. Her session will be: Multicore and Distributed Systems: Sharing Ideas to Build a Scalable Database.
- David Pick is a software engineer at Braintree, a PayPal company, and currently leads Braintree’s data engineering team to solve problems around data access and performance at scale. His session will be: Building a Real-Time Data Pipeline with Clojure and Kafka.
RICON will take place October 28-29 at the Palms Resort and Casino in Las Vegas. It will also feature a training day called Build a Cloud Day presented by Citrix Systems, Inc., on October 27, which is a program designed to expose attendees to the concepts and best practices around deploying cloud computing infrastructure. RICON immediately follows with two days of distributed systems keynote presentations, in-depth sessions, technical tracks, panel discussions, cocktail events and more. A discounted registration price is available for the next 48 hours with bit.ly/RICONPR.
- RICON registration (ly/RICONPR)
- Sponsorships (io/ricon-sponsors/index.html)
- Build a Cloud Day (http://open.citrix.com/about-diy-cloud-computing/cloud-events/viewevent/291-build-a-cloud-day-vegas.html)
- Twitter: @RICONconf (com/riconconf)
- RICON 2014 website (io/)
RICON is a distributed systems conference hosted by Basho. It brings together developers, industry leaders, partners, customers and community members to discuss all the ways they apply distributed systems and networks, and see innovations in the industry. RICON 2014 is being held October 28-29 at the Palms Resort and Casino in Las Vegas, NV. For more information, visit ricon.io.
About Basho Technologies
Basho is a distributed systems company dedicated to making software that is highly available, fault-tolerant and easy-to-operate at scale. Basho’s distributed database, Riak, the industry leading distributed NoSQL database, and Basho’s cloud storage software, Riak CS, are used by fast growing Web businesses and by one third of the Fortune 50 to power their critical Web, mobile and social applications, and their public and private cloud platforms.
Riak and Riak CS are available open source. Riak Enterprise and Riak CS Enterprise offer enhanced multi-datacenter replication and 24×7 Basho support. For more information, visit basho.com.
# # #
September features developer conferences, Chicago Erlang, and even an “unconference.” Take a look at where Basho will be around the U.S. this month.
Strangeloop (September 17-19 in St. Louis, MO): Strangeloop is a great opportunity to learn about emerging languages, concurrent and distributed systems, and new database technologies. Basho is attending, so tweet us @basho if you’re interested in meeting.
Analytics and Big Data Summit (September 18 in San Jose, CA at 3:05 p.m. PT): Produced by the Storage Networking Industry Association (SNIA), the Analytics and Big Data Summit brings together IT professionals to discuss how to leverage analytics, and big data applications and systems. Seema Jethani from Basho will be presenting on Optimizing Cloud Storage to Manage Big Data, which will explore different data types and storage solutions. Attendees will gain an understanding of the needs of big data storage and the current cloud storage options available to organizations.
2014 High Performance Computing for Wall Street (September 22 in New York, NY at 2:30 p.m. ET): The 11th annual HPC networking opportunity is focused on high put-through, low latency networks, data centers and lowering the costs of operations. Our director of technical marketing, Tyler Hannan, will be presenting a Code Writing Session – Architecting for Global Scale.
Chicago Erlang (September 22 in Chicago, IL): Chicago Erlang is a one-day event focused on real world applications of Erlang. At 10:40 a.m. CT, Basho’s Reid Draper will present on Building Fault Tolerant Teams at Basho during which he will explain how Basho coordinates the activities of more than 25 Erlang programmers to build Riak. Then, at 3:20 p.m. CT, Steve Vinoski from Basho will discuss Optimizing Native Code for Erlang.
REST Fest 2014 (September 25-27 in Greenville, SC): REST Fest is an “unconference” with the objective of bringing together people interested in REST, hypermedia APIs, web service APIs and related topics to share ideas, trade stories and show examples of current work. Sean Cribbs from Basho will be the opening keynote! His keynote, HTTP: The Good Parts, will explore interesting and powerful ways to enhance interaction and efficiency when developing applications. Sean will leverage his 10 years of experience as a developer to provide insight into HTTP features and how you can tap into them more declaratively.
Surge 2014 (September 24-26 in National Harbor, MD): We will be attending and sponsoring OmniTI’s scalability and performance conference, Surge. We’d love to meet and chat, so tweet us @basho if you’re attending.
Lastly, RICON 2014 is just one month away, October 28-29. Early bird prices are good through September 22. Register here.
The Weather Company VP of Enterprise Data to Unveil New IT Platform at Amazon AWS re:Invent 2013
LAS VEGAS, CA – November 13, 2013 – Amazon AWS re:Invent 2013 – During the past year, The Weather Company has undergone a remarkable transformation to its technology infrastructure as a data-driven media and technology company. As a part of the transformation, The Weather Company, which oversees popular brands such as The Weather Channel, weather.com, Weather Underground, Intellicast and WSI, has selected next generation technologies to underpin its new IT platform, including Basho’s Riak, Apache Hadoop, and Dasein.
“Weather is the original big data. However, weather changes, and so must IT,” commented Bryson Koehler, executive vice president and CIO, The Weather Company. “A massive data explosion is at the center of our growth strategy. The Weather Company requires an architecture that is both flexible and reliable, allowing us to deliver higher accuracy through superior data. Basho has been a valuable partner in our transformation and Riak has proven to be a critical component as the NoSQL distributed database powering our new platform.”
Since joining The Weather Company in July 2012 as EVP and CIO, Bryson Koehler has renewed the company’s vision for technology and executed a global IT transformation to propel their business growth strategy.
The Weather Company deployed Riak across multiple Amazon Web Services (AWS) availability zones using Riak Enterprise’s Multi-Datacenter Replication for ultra high-availability. Riak is used to store a variety of data from satellites, radars, forecast models, users, and weather stations worldwide. The next-generation data services platform enables The Weather Company to expand its ability to serve superior professional weather services in major weather-influenced markets, including media, hospitality, insurance, energy, and retail.
“The Weather Company typifies the customer that Riak was designed for,” said Greg Collins, CEO of Basho Technologies. “Aligning data services with customer consumption requires a flexible, available, and operationally simple database architecture. Riak Enterprise solves these needs while also working with the The Weather Company to ensure it is able to scale to meet the demand of an increasing set of data points and be well positioned for future initiatives.”
During Amazon re:Invent 2013, Sathish Gaddipati, vice president of enterprise data at The Weather Company will unveil their newest Weather Forecast and Data Services Platform and TWC’s overall enterprise IT transformation. Sathish’s presentation, titled How the Weather Company Monetizes Weather, the Original Big Data Problem, will be Thursday, November 14 at 5:30pm at The Venetian Las Vegas.
November 7, 2013
AWS re:Invent 2013 is the second annual Amazon Web Services’ global customer and partner conference. It is the largest gathering of developers and technical leaders from the AWS community and provides four days of sessions, training bootcamps, hands-on labs, and a Hackathon.
Sathish Gaddipati, The Weather Company VP of Data Enterprise, will be presenting at re:Invent on Thursday, November 14th at 5:30pm. His talk, “How The Weather Company Monetizes Weather, the Original Big Data Challenge,” will look at the transformation of the most widely distributed cable TV network in the United States (building on one of the world’s most visited digital properties) to create a world class Big Data platform. As part of this transformation, The Weather Company has selected Basho’s Riak to underpin their new IT platform. Gaddipati will also discuss the architecture, technology choices (including how and why they selected Riak), performance results, and business benefits realized as part of their use of AWS services to host an exciting set of weather.com solutions and generate new revenue streams.
Basho is also a gold sponsor of re:Invent and will have a booth set up to answer any questions about Riak or Riak CS. Be sure and stop by to chat and grab some great Basho swag.
October 24, 2013
Next week, Basho will be sponsoring the O’Reilly Strata conference. This conference focuses on big data technologies and brings together decision makers, architects, developers, and analysts to discuss how to collect and use data successfully. The Strata Conference is combined with Hadoop World and takes place in New York City on October 28-30th.
On Wednesday, October 30th at 1:45pm, Jim Englert will speak on “Testing Riak for Multiple Data-Center Support: A Case Study.” Jim is the Lead Software Engineer at Gilt and will discuss his experience evaluating Riak before using it as the backend for the company’s main user store. In this talk, Jim will go through the testing process, the results of this stress test, and how Gilt – one of the top eCommerce companies in the U.S. – managed to test the features in production without outages or other interruptions. He will also discuss the strategy, tools, and processes necessary to achieve this feat in just five days, and also cover Gilt’s motivation for investigating Riak (such as the ability to span multiple data centers to expand across the Gilt’s physically separated data centers and into the cloud).
Before his talk, Jim will also be hosting office hours to further discuss Gilt’s use of Riak to help solve a variety of issues including disaster recovery, data availability across data centers, and scalability.
Throughout the conference, be sure and stop by the Basho booth for more information about Riak and how it can handle critical data at scale.
September 19, 2013
Strange Loop 2013 is currently taking over St. Louis, MO through September 20th. Strange Loop is a multi-disciplinary conference that brings together developers and thinkers to discuss technologies around emerging languages, concurrent and distributed systems, mobile development, and the web. Basho is a proud sponsor and many members of our team will be there to discuss Riak CS, our open source cloud storage software.
Garrett Eardley, Software Engineer at Riot Games, will also be presenting on how Riot Games is leveraging Riak for their next generation stats system. His talk, “Tracking Millions of Ganks in Near Real Time,” will discuss why they chose to use Riak (and move from their existing MySQL architecture), how they structure their data model and indexes, and their strategies for working with eventually consistent data. His talk will take place today, September 19th, at 9:50am.
Stop by the Basho table to grab some swag and to learn more about distributed systems.
At NoSQL NOW!, industry leaders and developers come together to share ideas at the largest vendor agnostic event of disruptive NoSQL technologies for infrastructure architecture.
Basho has a strong and salient presence at this conference. Both their open source distributed database, Riak, and cloud storage software, Riak CS, are NoSQL technologies that offer high availability, fault-tolerance, and operational ease-of-use. Unlike traditional databases, Riak automatically distributes data in the cluster, eliminating the need for manual sharding, and its masterless design means that nodes can fail without bringing down the entire system. Due to this architecture, Riak has become foundational to many of the world’s fastest-growing Web-based, mobile and social applications like Comcast, Voxer, and Best Buy. The Basho team will be available at the conference to answer questions about Riak and how to move from a relational system to a distributed one.
In addition to exhibiting, Basho Chief Architect and Co-Creator, Andy Gross, will be speaking on August 22 at 3:00pm. His talk, “Dealing with Systems in a New Distributed World” will discuss the resurgence in interest of both theoretical and applied distributed systems and its consequences for software developers. He will explore new areas of promising research, and provide practical advice for dealing with systems in our new distributed world. Finally, he will discuss how technologies are shifting to meet emerging business requirements, while simultaneously minimizing immediate operational burdens and enabling ease of scale.
Andy is a distributed systems nerd, co-creator of Riak and Webmachine, and Chief Architect at Basho Technologies. Before Basho, Andy hacked on various distributed systems at Apple, Akamai, and Mochi Media.
For more information about Riak, common use cases, and an in-depth analysis of the benefits of migrating to a distributed NoSQL database, download “From Relational to Riak.”
August 8, 2013
RICON West, Basho’s distributed systems conference, will take place in San Francisco from October 29-30th. We’ve already started rolling out the speaker list, with 15 of the 23 speakers announced. Here are some of the highlights:
- Peter Bailis (UC Berkeley) – Bad As I Wanna Be: Coordination and Consistency in Distributed Databases
- Jeff Hodges (Twitter) – Practicalities of Productionizing Distributed Systems
- Ryland Degnan (Netflix) – Yuki: Functional Data Structures for Riak
- Lindsey Kuper (Indiana University) – LVars: Lattice-based Data Structures for Deterministic Parallelism
- Sam Elliott (Basho Technologies) – CRDTs: An Update (or maybe just a PUT)
- Miles O’Connell (StackMob) – More Than Just Data: Using Riak Core to Manage Distributed Services
- Michael Bernstein (Paperless Post) – Distributed Systems Archeology
- Charlie Voiselle and Justin Shoffstall (Basho Technologies) – The Seven-Layer Burrito; Troubleshooting a Distributed Database in Production
Be on the lookout next week when we announce the remaining speakers and the keynote. Until then, be sure and grab a ticket before they sell out – the early bird tickets are only available through August 29th – and make yourself known on the RICON West Lanyrd directory.
We look forward to seeing you in October.