Author: admin
Snowflake generate sequence without gaps
This example shows how to use ROW_NUMBER to generate a sequence without gaps:
Snowflake JSON
Example SQL reading native JSON data:
JVM arguments: Massively parallel talend processes
-Xms8g -Xmx100g -XX:+UseParallelGC -XX:+UseAdaptiveSizePolicy -XX:GCTimeRatio=19 -XX:MinHeapFreeRatio=20 -XX:InitiatingHeapOccupancyPercent=10
Display Runtime SQL: Talend
If you need to print a SQL run by any tDBinput_ component: System.out.println(((String)(((org.talend.components.snowflake.tsnowflakeinput.TSnowflakeInputProperties)globalMap.get(“tDBInput_3_COMPONENT_RUNTIME_PROPERTIES”)).getValuedProperty(“query”).getValue()))); ? You just need to ensure you’re giving the right “tDBInput_” name
Talend display DB rejects
In a tJavaRow component: System.out.println(input_row.columnName + ” ” + input_row.errorMessage);
Snowflake Local Timezone
To record timestamps in local timezone format nicely in via Talend use datatype: TIMESTAMPLTZ(3) To display without the offset value set session variable: ALTER SESSION SET TIMESTAMP_LTZ_OUTPUT_FORMAT = ‘YYYY-MM-DD HH24:MI:SS.FF3’
dsjob connection syntax
dsjob -domain <FULLY_QUALIFIED_SERVICES_TIER_SERVER_AND_DOMAIN>:<SERVICES_TIER_PORT> -user <USER> -server <FULLY_QUALIFIED_ENGINE_SERVER> <DSJOB_COMMANDS…> E.G: dsjob -domain serviceteir1.somewhere.gov.au:9446 -user admindoier -server enginetier1.somewhere.gov.au -lprojects