DataLoader

Contents

Overview

DataLoader loads the data from a data source specified in SRC/SSC.

Example

  • SRC:

    learn_1:
        type: learn
    
        data_sources:
            dl1:
                path: data.csv
                attr_schema: schema.asd
                filters:
                    - slice(1, 50, 2)
    
  • SPD

    dl1
    
    ---
    
    components:
        dl1:
            component: DataLoader
    

Details

  • In case of loading from the database, order of the loaded data depends on the database implementation.

    • Order of the loaded data from the database can be controlled by using view that was created from query with OrderBy.