云存储原理及系统构架
灵动区块链云存储提供文章
摘要：云存储作为一个新兴的研究和应用领域，由于其快速部署、低成本、灵活调整规模等优势被越来越多的企业应用。基于以上研究云存储，本文基于《云存储解析》内容，具体分析了云存储系统构架模式、技术优势及特点，并与传统的存储架构模式进行了对比。前言 作为近几年兴起的“云计算(CloudComputing)”的一大重要组成部分，“云存储(CloudStorage)”承担着最底层以服务形式收集、存储和处理数据的任务，并在此基础上展开上层的云平台、云服务等业务。与传统的存储设备相比，云存储不仅仅是一个硬件，而是一个网络设备、存储设备、服务器、应用软件、公用访问接口、接入网和客户端程序等多个部分组成的系统。云存储提供的是存储服务，存储服务通过网络将本地数据存放在存储服务提供商(SSP)提供的在线存储空间。需要存储服务的用户不再需要建立自己的数据中心，只需向SSP申请存储服务，从而避免了存储平台的重复建设，节约了昂贵的软硬件基础设施投资。
灵动区块链云存储是以Filecoin用IPFS协议的IPFS技术
1云存储技术云存储系统与传统存储系统相比，具有如下不同：第一，从功能需求来看，云存储系统面向多种类型的网络在线存储服务，而传统存储系统则面向如高性能计算、事务处理等应用；第二，从性能需求来看，云存储服务首先需要考虑的是数据的安全、可靠、效率等指标，
而且由于用户规模大、服务范围广、网络环境复杂多变等特点，实现高质量的云存储服务必将面临更大的技术挑战；第三，从数据管理来看，云存储系统不仅要提供类似于POSIX的传统文件访问，还要能够支持海量数据管理并提供公共服务支撑功能，以方便云存储系统后台数据的维护。
基于上述特点，云存储平台整体架构可划分为4个层次，自底向上依次是：存储层、基础管理层、应用接口层以及访问层。
灵动区块链云存储Filecoin，IPFS协议，IPFS技术
云存储平台整体架构如图1所示。
图1云存储框架
(1)存储层
云存储系统对外提供多种不同的存储服务，
存放在云存储系统中，形成一个海量数据池。从大多数网络服务后台数据组织方式来看，传统基于单服务器的数据组织难以满足广域网多用户条件下的吞吐性能和存储容量需求；基于P2P架构的数据组织需要庞大的节点数量和复杂编码算法保证数据可靠性。相比而言，基于多存储服务器的数据组织方法能够更好满足在线存储服务的应用需求，在用户规模较大时，构建分布式数据中心能够为不同地理区域的用户提供更好的服务质量。
云存储的存储层将不同类型的存储设备互连起来，实现海量数据的统一管理，同时实现对存储设备的集中管理、状态监控以及容量的动态扩展，实质是一种面向服务的分布式存储系统。
(2)基础管理层
云存储系统架构中的基础管理层为上层提供不同服务间公共管理的统一视图。通过设计统一的用户管理、安全管理、副本管理及策略管理等公共数据管理功能，将底层存储与上层应用无缝衔接起来，实现多存储设备之间的协同工作，以更好的性能对外提供多种服务。
(3)应用接口层
应用接口层是云存储平台中可以灵活扩展的、直接面向用户的部分。根据用户需求，可以开发出不同的应用接口，提供相应的服务。比如数据存储服务、空间租赁服务、公共资源服务、多用户数据共享服务、数据备份服务等。 (4)访问层
通过访问层，任何一个授权用户都可以在任何地方，使用一台联
网的终端设备，按照标准的公用应用接口来登录云存储平台，享受云存储服务。
2云存储技术的优势
作为新兴的存储技术，与传统的购买存储设备和部署存储软件相比，云存储方式存在以下优点：
(1)成本低、见效快
传统的购买存储设备或软件定制方式下，企业根据信息化管理的需求，一次性投入大量资金购置硬件设备、搭建平台。软件开发则经过漫长的可行性分析、需求调研、软件设计、编码、测试这一过程。往往在软件开发完成以后，业务需求发生变化，不得不对软件进行返工，不仅影响质量，提高成本，更是延误了企业信息化进程，同时造成了企业之间的低水平重复投资以及企业内部周期性、高成本的技术升级。在云存储方式下，企业除了配置必要的终端设备接收存储服务外，不需要投入额外的资金来搭建平台。企业只需按用户数分期租用服务，规避了一次性投资的风险，降低了使用成本，而且对于选定的服务，可以立即投入使用，既方便又快捷。
(2)易于管理
传统方式下，企业需要配备专业的IT人员进行系统的维护，由此带来技术和资金成本。云存储模式下，维护工作以及系统的更新升级都由云存储服务提供商完成，企业能够以最低的成本享受到最新最专业的服务。
(3)方式灵活
传统的购买和定制模式下，一旦完成资金的一次性投入，系统无法在后续使用中动态调整。随着设备的更新换代，落后的硬件平台难以处置；随着业务需求的不断变化，软件需要不断地更新升级甚至重构来与之相适应，导致维护成本高昂，很容易发展到不可控的程度。而云存储方式一般按照客户数、使用时间、服务项目进行收费。企业可以根据业务需求变化、人员增减、资金承受能力，随时调整其租用服务方式，真正做到“按需使用”。 3云存储技术趋势
随着宽带网络的发展，集群技术、网格技术和分布式文件系统的拓展，CDN内容分发、P2P、数据压缩技术的广泛运用，以及存储虚拟化技术的完善，云存储在技术上已经趋于成熟，以“用户创造内容”和“分享”为精神的Web2.0推动了全网域用户对在线服务的认知。 从未来云存储的发展趋势来看，云存储系统主要还需从安全性、便携性及数据访问等角度进行改进。 (1)安全性
从云计算诞生，安全性一直是企业实施云计算首要考虑的问题之一。同样在云存储方面，安全仍是首要考虑的问题，对于想要进行云存储的客户来说，安全性通常是首要的商业考虑和技术考虑。但是许多用户对云存储的安全要求甚至高于它们自己的架构所能提供的安全水平。既便如此，面对如此高的不现实的安全要求，许多大型、可信赖的云存储厂商也在努力满足它们的要求，构建比多数企业数据中心安全得多的数据中心。现在用户可以发现，云存储具有更少的安全
漏洞和更高的安全环节，云存储所能提供的安全性水平要比用户自己的数据中心所能提供的安全水平还要高。 (2)便携性
一些用户在托管存储的时候还要考虑数据的便携性。一般情况下这是有保证的，一些大型服务提供商所提供的解决方案承诺其数据便携性可媲美最好的传统本地存储。有的云存储结合了强大的便携功能，可以将整个数据集传送到你所选择的任何媒介，甚至是专门的存储设备。
(3)性能和可用性
过去的一些托管存储和远程存储总是存在着延迟时间过长的问题。同样地，互联网本身的特性就严重威胁服务的可用性。最新一代云存储有突破性的成就，体现在客户端或本地设备高速缓存上，将经常使用的数据保持在本地，从而有效地缓解互联网延迟问题。通过本地高速缓存，即使面临最严重的网络中断，这些设备也可以缓解延迟性问题。这些设备还可以让经常使用的数据像本地存储那样快速反应。通过一个本地NAS网关，云存储甚至可以模仿终端NAS设备的可用性、性能和可视性，同时将数据予以远程保护。随着云存储技术的不断发展，各厂商仍将继续努力实现容量优化和WAN(广域网)优化，从而尽量减少数据传输的延迟性。
(4)数据访问
现有对云存储技术的疑虑还在于，如果执行大规模数据请求或数据恢复操作，那么云存储是否可提供足够的访问性。在未来的技术条
件下，此点大可不必担心，现有的厂商可以将大量数据传输到任何类型的媒介，可将数据直接传送给企业，且其速度之快相当于复制、粘贴操作。另外，云存储厂商还可以提供一套组件，在完全本地化的系统上模仿云地址，让本地NAS网关设备继续正常运行而无需重新设置。未来，如果大型厂商构建了更多的地区性设施，那么数据传输将更加迅捷。如此一来，即便是客户本地数据发生了灾难性的损失，云存储厂商也可以将数据重新快速传输给客户数据中心。
此文章由灵动区块链云存储提供
Cloud storage principle and system architecture
Smart block chain cloud storageprovides articles
Abstract: As an emerging research and application field, cloud storage has been used by more and more enterprises due to its advantages of rapid deployment, low cost and flexible scale adjustment. Based on the above research on cloud storage, this paper, based on the content of Cloud Storage Analysis, specifically analyzes the architecture mode, technical advantages and characteristics of the cloud storage system, and compares it with the traditional storage architecture mode. As an important part of "CloudComputing" emerging in recent years, "CloudStorage" assumes the task of collecting, storing and processing data in the form of services at the lowest level, and on this basis develops the upper cloud platform, cloud services and other businesses. Compared with traditional storage devices, cloud storage is not only a hardware, but also a network device, storage device, server, application software, common access interface, access network, client program and other parts of the system. Cloud storage provides storage services that store local data over the network in online storage space provided by the storage service provider (SSP). Users who need storage services no longer need to set up their own data centers, but only need to apply for storage services from SSP, thus avoiding the repeated construction of storage platforms and saving expensive investment in hardware and software infrastructure.
Smart blockchain cloud storage is IPFS technology based onFilecoinIPFS protocol
Compared with traditional storage systems, cloud storage systems have the following differences: First, from the perspective of functional requirements, cloud storage systems are oriented to various types of online storage services, while traditional storage systems are oriented to applications such as high-performance computing and transaction processing. Second, from the perspective of performance requirements, cloud storage service first needs to consider data security, reliability, efficiency and other indicators.
Moreover, due to the large scale of users, wide range of services, complex and changeable network environment and other characteristics, the realization of high-quality cloud storage services will face greater technical challenges; Third, from the perspective of data management, cloud storage systems should not only provide traditional file access similar to POSIX, but also be able to support mass data management and provide public service support functions to facilitate the maintenance of cloud storage system background data.
Based on the above characteristics, the overall architecture of the cloud storage platform can be divided into four levels, which are successively from bottom to top: storage layer, basic management layer, application interface layer and access layer.
The overall architecture of the cloud storage platform is shown in Figure 1.
灵动区块链云存储IPFS协议
Figure 1 cloud storage framework
(1) the storage layer
The cloud storage system provides a variety of storage services to the outside world.
Stored in the cloud storage system, forming a massive data pool. From the perspective of the background data organization of most network services, the traditional single-server-based data organization is difficult to meet the throughput performance and storage capacity requirements of wan under the condition of multiple users. Data organization based on P2P architecture requires a large number of nodes and complex coding algorithms to ensure data reliability. In comparison, the data organization method based on multi-storage server can better meet the application requirements of online storage services. When the user scale is large, the construction of distributed data center can provide better service quality for users in different geographical areas.
The storage layer of cloud storage interconnects different types of storage devices, realizes the unified management of massive data, and meanwhile realizes the centralized management of storage devices, state monitoring and dynamic expansion of capacity. In essence, it is a service-oriented distributed storage system.
(2) Basic management
The underlying management in a cloud storage system architecture provides a unified view of common management between different services at the top. Through the design of unified user management, security management, copy management, policy management and other common data management functions, the bottom storage and the upper application seamlessly connect, to achieve the collaborative work between multiple storage devices, to provide a variety of services with better performance.
(3) Application interface layer
The application interface layer (API) is a flexible and directly user-facing part of the cloud storage platform. According to user demand, different application interfaces can be developed to provide corresponding services. For example, data storage service, space rental service, common resource service, multi-user data sharing service, data backup service, etc. (4) the access layer
With the access layer, any authorized user can use a copy anywhere
The terminal equipment of the network logs on to the cloud storage platform and enjoys the cloud storage service according to the standard common application interface.
2. Advantages of cloud storage technology
As an emerging storage technology, cloud storage has the following advantages compared with traditional storage device purchase and storage software deployment:
(1) Low cost and quick effect
Under the traditional way of purchasing storage equipment or software customization, enterprises invest a large amount of money to purchase hardware equipment and build platforms in a lump sum according to the requirements of information management. Software development goes through a long process of feasibility analysis, demand research, software design, coding and testing. After software development is completed, business needs change and software has to be reworked, which not only affects quality and increases cost, but also delays the process of enterprise informatization, and at the same time causes low level of repeated investment among enterprises and periodic and high cost technology upgrading within enterprises. In the cloud storage mode, enterprises do not need to invest extra capital to build the platform except configuring the necessary terminal devices to receive storage services. Enterprises only need to rent the service by stages according to the number of users, which avoids the risk of one-time investment and reduces the use cost. Moreover, for the selected service, it can be put into use immediately, which is convenient and fast.
(2) Easy to manage
In the traditional way, enterprises need to equip professional IT personnel to maintain the system, which brings technical and capital costs. Under the cloud storage mode, the maintenance work and system update and upgrade are completed by the cloud storage service provider, so that enterprises can enjoy the latest and most professional services at the lowest cost.
(3) Flexible methods
Under the traditional mode of purchase and customization, once the one-time investment of funds is completed, the system cannot be dynamically adjusted in subsequent use. With the upgrade of equipment, the backward hardware platform is difficult to deal with. As business requirements constantly change, software needs to be updated, upgraded and even reconstructed to keep pace with them, which leads to high maintenance costs and easy development to a degree beyond control. Cloud storage is generally charged according to the number of customers, use time, and service items. Enterprises can adjust their rental service mode at any time according to the change of business needs, increase or decrease of personnel, and financial capacity, so as to truly "use on demand". Cloud storage technology trends
With the development of broadband network, cluster technology, the development of grid technology and distributed file system, CDN content distribution, P2P, data compression technique is widely used, and the improvement of the storage virtualization technology, cloud storage has been mature in technology, with "user-generated content" and "share" as the spirit of Web2.0 promoted the entire network domain user's perception of online services. From the perspective of the development trend of cloud storage in the future, cloud storage system mainly needs to be improved from the perspectives of security, portability and data access. (1) security
Since the birth of cloud computing, security has always been one of the primary considerations for enterprises to implement cloud computing. Also in cloud storage, security remains a top priority, and for customers who want to use cloud storage, security is often a top business and technical concern. But many users demand even more security from cloud storage than their own architectures can provide. Even so, faced with such unrealistic security requirements, many large, reliable cloud storage vendors are struggling to meet their requirements and build data centers that are far more secure than most enterprise data centers. Now users can find that cloud storage has less security
Vulnerabilities and higher security, cloud storage can provide a higher level of security than a user's own data center can provide. (2) portability
Some users also consider the portability of data when hosting storage. This is generally guaranteed, and some large service providers offer solutions that promise data portability comparable to the best traditional local storage. Some cloud storage combines powerful portability to deliver entire data sets to any medium of your choice, even dedicated storage devices.
(3) Performance and availability
Some managed and remote storage in the past has always had a long latency problem. Similarly, the nature of the Internet itself poses a serious threat to the availability of services. The latest generation of cloud storage has been a breakthrough achievement in client or local device caching, keeping frequently used data locally, effectively alleviating the Internet latency problem. With local caching, these devices can alleviate latency problems even in the face of the most severe network outages. These devices can also make frequently used data as responsive as local storage. Through a local NAS gateway, cloud storage can even mimic the availability, performance, and visibility of terminal NAS devices, while protecting data remotely. As cloud storage continues to evolve, vendors will continue to strive for capacity optimization and WAN(wide Area network) optimization to minimize data transfer latency.
(4) Data access
Existing concerns about cloud storage technologies also concern whether cloud storage provides adequate access if large-scale data requests or data recovery operations are performed. In the future technical bar
There is no need to worry about that. Existing vendors can transfer large amounts of data to any kind of media, sending data directly to the enterprise at the speed of a copy-and-paste operation. In addition, cloud storage vendors can provide a set of components that mimic cloud addresses on fully localized systems, allowing local NAS gateway devices to continue to function without resetting. In the future, data transfers will be faster if larger vendors build more regional facilities. That way, even in the event of a catastrophic loss of customer local data, the cloud storage vendor can quickly retransmit the data to the customer data center.
This article is provided bysmart block chain cloud torage
网友评论