You can translate the question and the replies:

Denodo extraction

We have a question in regards to running multiple Denodo extracts in parallel in production. In the past ( a few years back ) we attempted to run extracts simultaneously only to run into issues such as locked processes or incomplete extracts ( we speculate it was memory related ). More recently we are exploring all sorts of time saving methods to reduce the nightly cycle runtime including parallel running of multiple Denodo extracts. What are the Denodo team and vendor recommendations on the topic? Do you recommend running things in parallel or is this something that we should not attempt? Please advise.
user
27-10-2016 08:27:01 -0400

1 Answer

The recommendations will vary between different types of VDP deployments. For example, if VDP is deployed in a server with a small set of cores, this may not allow sufficient capacity for thread concurrency. The reason this is an important factor is because if you decide to run scheduler jobs with a high concurrency level, these queries will be executed against the same VDP server even in a cluster environment, so you can run into extraction issues if you do not have enough cores and processing power. Another factor is the type of queries you are running. You should not have many issues running operaional queries against the server whereas analytical queries will have a much higher impact on the server. I recommend you read through this KB Article for more general recommendations regarding the processor: https://community.denodo.com/kb/view/document/Denodo%20Admin%20and%20Development%20Best%20Practices?category=Best+practices
Denodo Team
28-10-2016 21:08:41 -0400
You must sign in to add an answer. If you do not have an account, you can register here