Here you can find out … what Big Data Hosting is all about … what the difference to cloud services is
Price decline versus data growth
In addition to cloud computing and mobile systems, "Big Data" has recently become one of the top IT topics. At the moment, global data is doubling every two years, and the megabyte has long since depreciated as a measured value in companies.
Multimedia in focus
Data centers "do not think" today in Terabyte, but right in Petabyte - one is thus already at magnitudes of 1015. If data growth is no longer local, but globally, the Zettabyte (1021) en vogue is already in place: In 2011 the global data volume will have grown by 1.8 zettabytes. Probably we will also experience the Yottabyte with its 1024 bytes.
Data growth in the cloud
Up to the terabyte era - that is not too long ago - data growth could be easily absorbed by additional storage, processing and transmission capacities. The corresponding technologies developed largely parallel to the data volumes, the costs for the storage increased in total, however, drastically decreased per byte.
Requirements for Provider
Older IT users can still get to the first 10-Mbyte hard disks for PCs Datafluterinnern, for which one had to pay about 5000 marks. Today, 10 MBytes are available for just under 0.005 cent, with a single high-resolution photo already requiring more space.
Although the constant reduction and reduction of system components such as storage media has to come to a physical or technical limit, because atoms can not be reduced. However, the current problem with Big Data is less to accommodate these volumes of data at all on appropriate media, but rather to be able to process and manage them with reasonable effort.
The causes for the enormous data growth are diverse, whereby two are the main focus: On the one hand, the IT generates more and more data. In particular, the advancing digitalisation of technical processes means that more and more data is generated: data from digital sensors, log data, RFID data, motion data, GPS data and all data that interchanges the digital systems among themselves.
Every access to a warehouse, every process step in production, every cash transaction generates a flood of data that must be consolidated, evaluated and stored. The data generated by the system comes from those generated by the users. The classical documents are negligible in terms of the data volume today. The focus is on multimedia content, such as audio files, high-resolution photos or HD videos. These formats are not only extremely data intensive, they are also viewed more and more as a normal case by the users - like the Christmas greeting to the aunt, who, of course, has an HD video.
Social media have proven to be an acceleration factor for data growth. In addition, many data are stored more than once, and "old" data is rarely deleted, resulting in an immense "data waste"
At the same time, the high volume of data is by no means confined to the private users, even if they were stimulated by the so-called consumerization. In the context of a generally intensified media communication, multimedia content is also common in online shops, where customers are presented with high-resolution panoramic photos or videos of the products offered, or videos are components of services
The large amounts of data generated for various reasons are now regarded as a problem in IT - which is also shown by the fact that Big Data has established its own concept. Because it is not enough to store the data somewhere, rather you have to find it again at the right time, with limited effort and without high latency.
Conventional relational databases can no longer optimally process the large amounts of data, which also comprise only a small part of structured data. Data solutions, such as data warehousing or data mining, need to be found in other ways.
Storage Resource Management and Data Lifecycle Management provide the right technologies and measures that range from storage virtualization, deduplication, to prioritization of data. The main focus is on data management, which is the classic IT used by the well-known server and storage systems.
Also for hosting and service providing, ie for external data processing or in a wider sense for cloud computing in general, the strong data growth represents a huge challenge. Thus the providers are confronted with growing data volumes, which they take their business customers >
For a long time, service providers have observed that a volume of data, which until now has only been a peak load for their customers, is now becoming more and more normal. When it comes to hosting, it is not the data generated by the system, but the data generated by the users - specifically data from applications that make intensive use of graphical representations, as well as audio and video elements
When companies operate with Big Data, the providers must, of course, also be able to process such data for their existing customers. The service providers must therefore adapt themselves to the fact that the quantities of data processed in them will rise sharply in the next time (further).
Overcoming technology boundaries When companies are encountering limits on their own resources, but also their own know-how, they are increasingly looking for partners who can not only show them how they are doing, but the best The data loss completely. It is to be expected that in the next few years more companies will reach these limits - yes, many will still recognize that conventional data storage and processing, for example by means of relational databases, are limited by this.
Service providers must build and operate a correspondingly powerful infrastructure for these growing requirements. This initially comprises quantitatively more systems, more effort for cooling and expansion in the network technology. As far as the hardware is concerned, providers can here partly expect the usual price declines, which again limits the costs for the necessary system-technical extensions.
This price decline is not, however, subject to a professional hosting service. However, providers can regularly provide these services at a lower cost than companies themselves, as they use a high degree of scaling and synergy effects. Moreover, as specialists, they have the necessary know-how, experience and trained staff - resources resources that a company would have to acquire with difficulty.
Intelligent solutions are in demand Especially here, the hosting of Big Data also has a qualitative side. It is not simply about imposing more and more systems to catch the flood of data. Rather, intelligent solutions are needed to ensure a more efficient use of the existing technology, not just on the system level, but also on the application level.
In this way, the volume of data for hosted e-commerce solutions can be drastically reduced without restricting the performance: the processing of large amounts of data has to be taken into account already in the architecture and the execution logic.
For example, many online shops use high-resolution photos already for the article overview: Over time, old pictures had simply replaced by new, but the process was not adapted to the new memory-hungry pictures. Here it would suffice to use reduced pictures for the overview and to reserve the high-resolution pictures or the video for the actually clicked by the customer. This optimization would not have to do without the multimedia content, and even an improvement could be achieved for the customer because the wait times for the reloading of the pictures are omitted.
Such optimizations for hosted big-data applications presuppose, of course, that the provider is not just a hosting expert and has a powerful machine park. It must also know very well the business processes of the companies.
Here, too, it is clear that the focus of the services providers' service providers is shifting from the mere provision of remote-usable hardware towards a comprehensive range of solutions.
Diethelm Screen Clock
No comments:
Post a Comment