You can translate the question and the replies:

Setting Hive parameter configuration in the query

Hi, We need more memory for some of our queries. The below commands was needed for hive: SET mapreduce.map.memory.mb=5120; SET mapreduce.map.java.opts=-Xmx4096M; SET mapreduce.reduce.memory.mb=8192; SET mapreduce.reduce.java.opts=-Xmx6554M; How can we include the above in the base view query? We were able to include it in the database URL for the jdbc connection but that would add it for all queries using that driver. However, we only wanted to include the above parameter for 1 query alone. How can we do that? Thank you.
user
31-10-2017 01:53:06 -0400
code

1 Answer

Hi, I would try creating one data source as ds_hive with just the DataBase URI. Then as you were able to set the parameters in the Database URI, create another data source ds_hive_with_SETparameters with the SET parameters in the URI. Then create the views with the memory issues over ds_hive_with_SETparameters. This way, the views that you create over this second data source will use the memory settings and you will continue using normal memory settings for views created over ds_hive. Note that when you try to create a join view between these two data sources ds_hive and ds_hive_with_SETparameters, the pushdown capabilities will not take place. Please check if your Hive vendor recommends such settings in the JDBC connection URI. Hope this helps.
Denodo Team
17-11-2017 03:15:42 -0500
code
You must sign in to add an answer. If you do not have an account, you can register here