SAP HANA :: Bulk Data Load

There are a lot of discussions about SAP HANA Platform, the costs of SAP HANA Database and doubts about the performance bottleneck of the data INSERT command to the schema table. Skybuffer decided to develop a small prototyping solution to assess the possible performance limit off the relatively small, non-productive SAP HANA Db Server.

Business Case

User gets the information in .DLV data format from FTP source and needs to download and manage it in SAP HANA Database.

In the prototyping model .DLV file of Global Historical Climatology data is downloaded from the public FTP source.

The software should help to load the information from .DLV file to SAP HANA Database on maximal speed and to manage the data in real time.

SAP HANA Bulk Data Load Application

SAP HANA Bulk Data Load application could be executed from Skybuffer application port:

SAP HANA Bulk Data Load Application User Guide

The Main Screen

The main screen contains two application links.

Fig. 1. SAP HANA Bulk Data Load Application :: The Main Screen

Bulk Data Load Application Link allows to execute loading and data management functions. Average Load Speed link allows to view the results of previous Data loads.

Bulk Data Load Application Overview

While the Bulk Data Load link is chosen the initial screen appears. Tooltip message helps first time users to understand application.

Fig. 2. SAP HANA Bulk Data Load Application :: Loaded Data Overview

The list of datasets, existing in SAP HANA Database is reflected on the screen. Application provides live search executed on database level in real time.

For example, user can execute search of stations by country

Fig. 3. SAP HANA Bulk Data Load Application :: Live Search by Country

While the station is chosen, user can press it’s name and observe the historical Climatology data of the station directly from HANA Database.

The click on the station navigates to the second tab, reflecting the dataset for the current Climatology station. Application provides the possibility to apply filter to climate data based on the climate station ID in real time using live search control.

Fig. 4. SAP HANA Bulk Data Load Application :: Dataset overview

Data Load

The data can be loaded from the second screen for the defined station

The file in .DLV is previously downloaded from the public FTP source and saved at the local user’s folder.

To Load the file user should push the Upload button

Fig. 5. SAP HANA Bulk Data Load Application :: Data Load Process. Folder selection

The file in .DLV format should be chosen from the users local folder and the Upload button should be pushed in the pop-up download dialog box.

Fig. 6. SAP HANA Bulk Data Load Application :: Data Load Process. File Selection

Data load process status is reflected on the screen.

Fig. 7. SAP HANA Bulk Data Load Application :: Data Load Process. Process Status

When the data is loaded the pop-up message with basic information about current load is reflected on the screen. The message shows the speed of data load from the local user’s device to the server, the quantity of rows per record and the time for loading data to SAP HANA Database.

Fig. 8. SAP HANA Bulk Data Load Application :: Data Load Process. Loading Speed

As becomes evident from the message, that Bulk Data Load Application allows to speed up the process of load to SAP HANA Database for almost 50 000 rows per record per second!

Bulk Data Load Application Previous Loads Results Overview

The application also allows to view the information of previous loads results.

To view this user should choose the Average Load Speed link from the main screen

Fig. 9. SAP HANA Bulk Data Load Application :: Average Load Speed Link

The link reflects information about previous loading sessions. The metrics about the speed of data transfer all app users are presented at this section. Real time search is also provided for this information.

Fig. 10. SAP HANA Bulk Data Load Application :: Average Load Speed

Results

SAP HANA Bulk Data Load Application helps to:

  • Speed up the process of loading the data to SAP HANA Database
  • Provide live search of the records executed on database level in real time
  • Get structured view of the data load process
  • Understand the average parameters of loads

Additional Assests

To check SAP HANA Database data load possibilities via HANA Bulk Load application, it is possible to either download sample .DLY files from Global Historical Climatology web site, or to find out a few sample following this paragraph:

HANA BULK LOAD SAMPLE #1: USW00026617.dly

HANA BULK LOAD SAMPLE #2: USW00093820.dly

Leave a Comment

Contact Us

Please do not hesitate to contact us, so one of our experts will get back to you asap!

Not readable? Change text.

Start typing and press Enter to search