{"id":243,"date":"2019-09-24T02:28:24","date_gmt":"2019-09-24T00:28:24","guid":{"rendered":"http:\/\/hentati.org\/?p=243"},"modified":"2021-01-06T23:56:41","modified_gmt":"2021-01-06T22:56:41","slug":"scality-ring-object-storage-software-defined","status":"publish","type":"post","link":"https:\/\/hentati.org\/index.php\/2019\/09\/24\/scality-ring-object-storage-software-defined\/","title":{"rendered":"SCALITY RING \u2013 OBJECT STORAGE &#038; SOFTWARE-DEFINED"},"content":{"rendered":"<p><span style=\"color: #000000;\">Last month, I\u2019ve had to opportunity to implement scality ring on Apollo hp server in our infrastructure, today I want to share with you what we have to know about it.<\/span><\/p>\n<p><span style=\"color: #000000;\">Scality is an object storage startup with a solid part of it\u2019s DNA coming from French horizons (which, obviously, I like a lot as the impenitent French guy I am). They have been around, according to their website, since February 2010 with their current name of, well, Scality.<\/span><\/p>\n<p><span style=\"color: #000000;\">Scality\u2019s mission is to <strong><em>\u201cbridge the gap between application vendors and industry standard hardware providers to meet cost-effective storage scale, durability, cloud and performance requirements\u201d<\/em><\/strong>. So how do they plan to achieve\u00a0this?<\/span><\/p>\n<p><span style=\"color: #000000;\">First of all, Scality is a software-only company, with their RING software able to run on any commodity x86 hardware platform. It\u00a0may\u00a0make sense to consult with Scality to ensure that the selected hardware platform will deliver up to the expectations. In other words: commodity hardware doesn\u2019t means cheap and\/or underperforming (but you already knew this).<\/span><\/p>\n<p><span style=\"color: #000000;\">Unlike other SDS solutions, the RING operating system uses a specific method to communicate between nodes, which is different to the master\/slave architecture. RING uses a peer-to-peer mesh communication model based on the\u00a0CHORD\u00a0protocol. No matter how much you scale your solution, each node is in contact with a specific set of other nodes, and the idea for this mesh architecture is to\u00a0minimise the amount of traffic and to locate objects very quickly.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"color: #000000;\"><strong>Onion RINGs Solution :<\/strong><\/span><\/p>\n<p><span style=\"color: #000000;\">The Scality RING can\u00a0be looked at like an onion: it is made of\u00a0three layers, of which the outer one manages connectivity protocols (a.k.a. Connectors), the middle one takes care of data routing, high availability, self-healing and data reliability, while the inner one provides data placement (distributed storage) and abstraction between the RING and the actual physical storage.<\/span><\/p>\n<p><span style=\"color: #000000;\">The RING OS, now in version 6.0, offers file (NFS, SMB, Fuse) and object (S3, Native Scality REST API) capacities. It is also useable with OpenStack through Cinder, Glance and Swift. These access methods are defined at the Connector level (upper layer). This level provides a persistent\u00a0shared cache and shared namespace across all connectors.<\/span><\/p>\n<p><span style=\"color: #000000;\"><img loading=\"lazy\" class=\"wp-image-244 aligncenter\" src=\"http:\/\/hentati.org\/wp-content\/uploads\/2017\/12\/scALITY-300x300.png\" alt=\"\" width=\"590\" height=\"590\" srcset=\"https:\/\/hentati.org\/wp-content\/uploads\/2017\/12\/scALITY-300x300.png 300w, https:\/\/hentati.org\/wp-content\/uploads\/2017\/12\/scALITY-150x150.png 150w\" sizes=\"(max-width: 590px) 100vw, 590px\" \/><\/span><\/p>\n<p><span style=\"color: #000000;\">The system\u00a0leverages SSD to store metadata in a logical ring, and HDD spindles to store actual objects in yet another logical ring. Most of the operations are performed at the metadata level, the goal being to touch the data residing on HDDs at the very last moment.<\/span><\/p>\n<p><span style=\"color: #000000;\">If we look at the middle layer, data protection is configurable up to the individual object level through\u00a0to policies, with up to 6 replicas per object. In terms of data durability, I recommend to\u00a0watch\u00a0Giorgio Regni\u2019s presentation at Storage Field Day 11. Finally, the RING is self-healing with rebuild processes &amp; operations happening in the background. To avoid rebuilt performance penalties, data is served temporarily from a healthy node until the rebuild has completed.<\/span><\/p>\n<p><span style=\"color: #000000;\">The bottom layer, finally, takes care of distributing storage between nodes and of low level I\/O operations.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"color: #000000;\"><b>To Note :<\/b><\/span><\/p>\n<p><span style=\"color: #000000;\">With the choice of being a pure software player in the Object Storage market, Scality is eliminating at the very least the tedious issue of maintaining a\u00a0hardware supply chain with all its inconvenients: sourcing, lifecycle refreshes, logistics &amp; customs, inventory, RMAs.<\/span><\/p>\n<p><span style=\"color: #000000;\">This software strategy is likely to pay off because in the object storage area commodity hardware is more or less the norm. Furthermore, the primary requirement of an object store is not\u00a0performance, but data reliability (shall we add durability\/retrievability) and the capacity to ingest huge amounts of data, at low prices and on standard 10 GbE network\u00a0interfaces.\u00a0A smart move is their open-source Scality S3 Server: it allows to get access to Scality\u2019s S3 implementation in a docker container environment and is a good entry point to test the features of Scality.<\/span><\/p>\n<p><span style=\"color: #000000;\">In terms of differentiators, their Active Directory and AWS IAM integration is an important aspect. Why Active Directory and IAM matter, since we are here to talk storage? Building a system with integrated Identity and Access Management makes the solution work better in enterprise environments where AD integration is often a requirement.<\/span><\/p>\n<p><span style=\"color: #000000;\">In my opinion, Scality will face the fiercest competition from\u00a0the other software players in the object storage space. I am tempted to say that appliance or hardware-backed object storage providers are likely to lose ground in this area. Software capabilities is where the money is made, and in object storage we can expect bring-your-own-hardware to become the standard.<\/span><\/p>\n<p><span style=\"color: #000000;\">With steady funding and a \u201cmore than just best friends\u201d partnership with HP, Scality seems to be well equipped for success -and potentially also leadership- in the object storage world.<\/span><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Last month, I\u2019ve had to opportunity to implement scality ring on Apollo hp server in our infrastructure, today I want to share with you what we have to know about &#8230;<\/p>\n","protected":false},"author":1,"featured_media":246,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[9,10],"tags":[],"_links":{"self":[{"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/posts\/243"}],"collection":[{"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/comments?post=243"}],"version-history":[{"count":9,"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/posts\/243\/revisions"}],"predecessor-version":[{"id":867,"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/posts\/243\/revisions\/867"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/media\/246"}],"wp:attachment":[{"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/media?parent=243"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/categories?post=243"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hentati.org\/index.php\/wp-json\/wp\/v2\/tags?post=243"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}