Skip to content

Snowflake table function lineage detection

SQLFlow is able to detect the Snowflake table function lineage.

Check the following sample code:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
CREATE TABLE T1
(
C1 INT,
C2 VARIANT
);

CREATE TEMPORARY TABLE T_TMP AS
    (SELECT C1,
        -- META_DATA,
        Parse_json(META_DATA.value) AS C2_ID
        FROM T1 AS table_alias
        cross join TABLE(Flatten(C2)) AS META_DATA
    ) ;

INSERT INTO T2
(C1,
-- META_DATA,
C2_ID)
(SELECT C1,
-- META_DATA,
C2_ID
FROM T_TMP);

With SQLFlow, the T1.C2 -> T_TMP.C2_ID -> T2.C2_ID lineage is properly generated.