Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

How many import processors are available as of now?

There are two three import processors are available in the Sprngy Platform. One is These are QUERY_IMPORT_PROCESSOR and the other one is ,IN_MEMORY_IMPORT_PROCESSOR, and RDL_IMPORT_PROCESSOR. Moreover, there are five other processors available to support basic cleaning and moving data between data lakes. These processors are EDA_COMPLETENESS_PROCESSOR, HASH_RECORDS_PROCESSOR,DROP_DELTA_RECORDS_PROCESSOR,BATCH_INFO_APPEND_PROCESSOR
,FACT_RECORDS_PROCESSOR

How do I specify the sequence of Import Processors?

...

  • For QUERY_IMPORT_PROCESSOR, currently, step numbers 0, 1 and 4 are used.

  • For RDL_IMPORT_PROCESSOR, currently step number 0 and 1 are used.

  • For IN_MEMORY_IMPORT_PROCESSOR, currently, step number 2 and step number 3 are used.

  • For EDA_COMPLETENESS_PROCESSOR, HASH_RECORDS_PROCESSOR,DROP_DELTA_RECORDS_PROCESSOR,BATCH_INFO_APPEND_PROCESSOR
    ,FACT_RECORDS_PROCESSOR, currently step number 5 is used.

What is step sequence and how it is important?

...

Import models are stored within the Importfolder of the core data lake (SPRNGYPlatformSprngyPlatform/Import/BDL/Fact).

How is the storage and retrieval of Import Models?

...