I am using VDP v7.0 with the latest upated tools and server. I have a use case where we have an SFTP server acting as a data source for us, which has CSVs dumped into it by another system which creates reports for us. For our initial load, we will have around 80 files (with 1000 rows each), and then a daily delta dump, which will need to be merged on a daily basis. So this means we will have at least a file a day which will need to be merged with all the other data.
Also, the delta may have updated data on rows that already exist, which would mean we have to update that row with the new information. All the files will have the same order of columns. Only the filenames will have datetime appended.
Is this something we can do with Denodo? Or would we have to do the merge externally before bringing it into our system. Please let me know if you need any more information.