Optimizing DF Data Sources¶
It is possible to decrease the processing time of a delimited file by using the “Use tuple pattern” option of the DF data source instead of the “Use column delimiter” option (see section Delimited File Sources)
The “Tuple pattern” is a regular expression that matches the rows that you need to obtain from the file. The advantage over using a “column delimiter” is that the lines that do not match the regular expression are immediately discarded and the Server does not process them. On the other hand, when using the “Use column delimiter” option, every line of the file is parsed.
The section Delimited File Sources contains several examples of tuple patterns.