There are a lot of discussions about SAP HANA Platform, the costs of SAP HANA Database and doubts about the performance bottleneck of the data INSERT command to the schema table. Skybuffer decided to develop a small prototyping solution to assess the possible performance limit off the relatively small, non-productive SAP HANA Db Server.
User gets the information in .DLV data format from FTP source and needs to download and manage it in SAP HANA Database.
In the prototyping model .DLV file of Global Historical Climatology data is downloaded from the public FTP source.
The software should help to load the information from .DLV file to SAP HANA Database on maximal speed and to manage the data in real time.
SAP HANA Bulk Data Load Application
SAP HANA Bulk Data Load application could be executed from Skybuffer application port:
SAP HANA Bulk Data Load Application User Guide
The Main Screen
The main screen contains two application links.
Bulk Data Load Application Link allows to execute loading and data management functions. Average Load Speed link allows to view the results of previous Data loads.
Bulk Data Load Application Overview
While the Bulk Data Load link is chosen the initial screen appears. Tooltip message helps first time users to understand application.
The list of datasets, existing in SAP HANA Database is reflected on the screen. Application provides live search executed on database level in real time.
For example, user can execute search of stations by country
While the station is chosen, user can press it’s name and observe the historical Climatology data of the station directly from HANA Database.
The click on the station navigates to the second tab, reflecting the dataset for the current Climatology station. Application provides the possibility to apply filter to climate data based on the climate station ID in real time using live search control.
The data can be loaded from the second screen for the defined station
The file in .DLV is previously downloaded from the public FTP source and saved at the local user’s folder.
To Load the file user should push the Upload button
The file in .DLV format should be chosen from the users local folder and the Upload button should be pushed in the pop-up download dialog box.
Data load process status is reflected on the screen.
When the data is loaded the pop-up message with basic information about current load is reflected on the screen. The message shows the speed of data load from the local user’s device to the server, the quantity of rows per record and the time for loading data to SAP HANA Database.
As becomes evident from the message, that Bulk Data Load Application allows to speed up the process of load to SAP HANA Database for almost 50 000 rows per record per second!
Bulk Data Load Application Previous Loads Results Overview
The application also allows to view the information of previous loads results.
To view this user should choose the Average Load Speed link from the main screen
The link reflects information about previous loading sessions. The metrics about the speed of data transfer all app users are presented at this section. Real time search is also provided for this information.
SAP HANA Bulk Data Load Application helps to:
- Speed up the process of loading the data to SAP HANA Database
- Provide live search of the records executed on database level in real time
- Get structured view of the data load process
- Understand the average parameters of loads
To check SAP HANA Database data load possibilities via HANA Bulk Load application, it is possible to either download sample .DLY files from Global Historical Climatology web site, or to find out a few sample following this paragraph: