Category: ETL
JVM arguments: Massively parallel talend processes
-Xms8g -Xmx100g -XX:+UseParallelGC -XX:+UseAdaptiveSizePolicy -XX:GCTimeRatio=19 -XX:MinHeapFreeRatio=20 -XX:InitiatingHeapOccupancyPercent=10
Display Runtime SQL: Talend
If you need to print a SQL run by any tDBinput_ component: System.out.println(((String)(((org.talend.components.snowflake.tsnowflakeinput.TSnowflakeInputProperties)globalMap.get(“tDBInput_3_COMPONENT_RUNTIME_PROPERTIES”)).getValuedProperty(“query”).getValue()))); ? You just need to ensure you’re giving the right “tDBInput_” name
Talend display DB rejects
In a tJavaRow component: System.out.println(input_row.columnName + ” ” + input_row.errorMessage);
dsjob connection syntax
dsjob -domain <FULLY_QUALIFIED_SERVICES_TIER_SERVER_AND_DOMAIN>:<SERVICES_TIER_PORT> -user <USER> -server <FULLY_QUALIFIED_ENGINE_SERVER> <DSJOB_COMMANDS…> E.G: dsjob -domain serviceteir1.somewhere.gov.au:9446 -user admindoier -server enginetier1.somewhere.gov.au -lprojects
QualityStage Match Types
https://www.ibm.com/support/knowledgecenter/SSZJPZ_11.5.0/com.ibm.swg.im.iis.qs.ug.doc/topics/c_Selecting_output_options.html
Restart IIS
http://www-01.ibm.com/support/docview.wss?uid=swg21452589
DataStage: Handle quotes in a parameter
http://www.dsxchange.com/viewtopic.php?p=280909&sid=7f01f681cfdf54b57c1dc7c1b9b8670b My job was being called from a sequence. In the parameter value expression I used the following: “\’”:Ereplace (pParam, “,”, “\’,\’”):”\’” It looks a bit confusing because of the mixture of double and single quotes, but essentially it is …