0
votes

OrientDB Version, operating system, or hardware.

  • v2.2.5

Operating System

  • [ ] Linux

Expected behavior and actual behavior

When importing vertices and edges using ETL, it gives a timeout exception after loading some vertices and edges.

Detailed Error:

- Year.csv: id_year | year
1 | 2010
2 | 2011
3 | 2012
4 | 2013
5 | 2014
6 | 2015
7 | 2016
8 | 2017

- Month.csv: id_month | month | quarter | year
1 | January | JFM | 2010
2 | February | JFM | 2010
3 | March | JFM | 2010
4 | April | AMJ | 2010
5 | May | AMJ | 2010
6 | June | AMJ | 2010
7 | July | JAS | 2010
8 | August | JAS | 2010
9 | September | JAS | 2010
10 | October | OND | 2010
11 | November | OND | 2010
12 | December | OND | 2010
13 | January | JFM | 2011
14 | February | JFM | 2011
15 | March | JFM | 2011
16 | April | AMJ | 2011
17 | May | AMJ | 2011
18 | June | AMJ | 2011
19 | July | JAS | 2011
20 | August | JAS | 2011
21 | September | JAS | 2011
22 | October | OND | 2011
23 | November | OND | 2011
24 | December | OND | 2011
25 | January | JFM | 2012
26 | February | JFM | 2012
27 | March | JFM | 2012
28 | April | AMJ | 2012
29 | May | AMJ | 2012
30 | June | AMJ | 2012
31 | July | JAS | 2012
32 | August | JAS | 2012
33 | September | JAS | 2012
34 | October | OND | 2012
35 | November | OND | 2012
36 | December | OND | 2012
37 | January | JFM | 2013
38 | February | JFM | 2013
39 | March | JFM | 2013
40 | April | AMJ | 2013
41 | May | AMJ | 2013
42 | June | AMJ | 2013
43 | July | JAS | 2013
44 | August | JAS | 2013
45 | September | JAS | 2013
46 | October | OND | 2013
47 | November | OND | 2013
48 | December | OND | 2013
49 | January | JFM | 2014
50 | February | JFM | 2014
51 | March | JFM | 2014
52 | April | AMJ | 2014
53 | May | AMJ | 2014
54 | June | AMJ | 2014
55 | July | JAS | 2014
56 | August | JAS | 2014
57 | September | JAS | 2014
58 | October | OND | 2014
59 | November | OND | 2014
60 | December | OND | 2014
61 | January | JFM | 2015
62 | February | JFM | 2015
63 | March | JFM | 2015
64 | April | AMJ | 2015
65 | May | AMJ | 2015
66 | June | AMJ | 2015
67 | July | JAS | 2015
68 | August | JAS | 2015
69 | September | JAS | 2015
70 | October | OND | 2015
71 | November | OND | 2015
72 | December | OND | 2015
73 | January | JFM | 2016
74 | February | JFM | 2016
75 | March | JFM | 2016
76 | April | AMJ | 2016
77 | May | AMJ | 2016
78 | June | AMJ | 2016
79 | July | JAS | 2016
80 | August | JAS | 2016
81 | September | JAS | 2016
82 | October | OND | 2016
83 | November | OND | 2016
84 | December | OND | 2016
85 | January | JFM | 2017
86 | February | JFM | 2017
87 | March | JFM | 2017
88 | April | AMJ | 2017
89 | May | AMJ | 2017
90 | June | AMJ | 2017
91 | July | JAS | 2017
92 | August | JAS | 2017
93 | September | JAS | 2017
94 | October | OND | 2017
95 | November | OND | 2017
96 | December | OND | 2017

- ETL JSON for Year.csv:

{
    "source": {
        "file": {
            "path": "../testdb/data/year.csv"
        }
    },
    "extractor": {
        "row": {

        }
    },
    "transformers": [{
        "csv": {
            "separator": ",",
            "skipFrom": 1,
            "skipTo": 0,
            "nullValue": "Null",
            "columnsOnFirstLine": true
        }
    },
    {
        "vertex": {
            "class": "Year"
        }
    }
    ],
    "loader": {
        "orientdb": {
            "dbURL": "remote:1.2.3.4/testdb",
            "dbUser": "orientdb",
            "dbPassword": "orientdb",
            "serverUser": "orientdb",
            "serverPassword": "orientdb",
            "dbType": "graph",
            "classes": [{
                "name": "Year",
                "extends": "V"
            }],
            "indexes": [
                {"class":"Year", "fields":["year:string"], "type":"UNIQUE" }
            ]
        }
    }
}

- ETL JSON for Month:

{
    "config": {
        "log":"debug",
        "parallel":true
    },
    "source": {
        "file": {
            "path": "../testdb/data/month.csv"
        }
    },
    "extractor": {
        "row": {
        }
    },
    "transformers": [{
        "csv": {
            "separator": ",",
            "skipFrom": 1,
            "skipTo": 0,
            "nullValue": "Null",
            "columnsOnFirstLine": true
        }
    },
    {
        "vertex": {
            "class": "Month"
        }
    },
    {
        "edge": {
            "class":"BelongsTo",
            "joinFieldName":"year",
            "lookup":"Year.year",
            "direction":"out",
            "unresolvedLinkAction":"WARNING"
        }
    }],
    "loader": {
        "orientdb": {
            "dbURL": "remote:1.2.3.4/testdb",
            "dbUser": "orientdb",
            "dbPassword": "orientdb",
            "serverUser": "orientdb",
            "serverPassword": "orientdb",
            "dbType": "graph",
            "classes": [{
                "name": "Month",
                "extends": "V"
            }]
        }
    }
}

- ETL JSON for year.csv was loaded properly. - Error when loading ETL JSON for month.csv is as follows:

C:\orientdb-community-2.2.5\bin>oetl.bat ..\testdb\etl\loadMonth.json
BEGIN ETL PROCESSOR
[file] INFO Reading from file ../testdb/data/month.csv with encoding UTF-8
Started execution with 1 worker threads
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 1000ms 
[0 warnings, 0 errors]
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 2s [0 
warnings, 0 errors]
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 3s [0 
warnings, 0 errors]
[orientdb] DEBUG - OrientDBLoader: created vertex class 'Month' extends 'V'
[orientdb] DEBUG orientdb: found 0 vertices in class 'null'
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 4s [0 
warnings, 0 errors]
+ extracted 0 rows (0 rows/sec) - 0 rows -> loaded 0 vertices (0 vertices/sec) Total time: 5s [0 
warnings, 0 errors]
Start extracting
[0:csv] DEBUG Transformer input: id_month,month,quarter,year
[0:csv] DEBUG parsing=id_month,month,quarter,year
[0:csv] DEBUG Transformer output: null
2016-08-17 12:56:22:964 WARNI Transformer [csv] returned null, skip rest of pipeline execution 
[OETLPipeline][1:csv] DEBUG Transformer input: 1,January,JFM,2010
[1:csv] DEBUG parsing=1,January,JFM,2010
[1:csv] DEBUG document={id_month:1,month:January,quarter:JFM,year:2010}
[1:csv] DEBUG Transformer output: {id_month:1,month:January,quarter:JFM,year:2010}
[1:vertex] DEBUG Transformer input: {id_month:1,month:January,quarter:JFM,year:2010}
[1:vertex] DEBUG Transformer output: v(Month)[#45:0]
[1:edge] DEBUG Transformer input: v(Month)[#45:0]
+ extracted 97 rows (97 rows/sec) - 97 rows -> loaded 0 vertices (0 vertices/sec) Total time: 6s [0 
warnings, 0 errors]
[1:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
[1:edge] DEBUG created new edge=e[#53:0][#45:0-BelongsTo->#41:0]
[1:edge] DEBUG Transformer output: v(Month)[#45:0]
[2:csv] DEBUG Transformer input: 2,February,JFM,2010
[2:csv] DEBUG parsing=2,February,JFM,2010
[2:csv] DEBUG document={id_month:2,month:February,quarter:JFM,year:2010}
[2:csv] DEBUG Transformer output: {id_month:2,month:February,quarter:JFM,year:2010}
[2:vertex] DEBUG Transformer input: {id_month:2,month:February,quarter:JFM,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 1 vertices (1 vertices/sec) Total time: 7s [0 
warnings, 0 errors]
[2:vertex] DEBUG Transformer output: v(Month)[#46:0]
[2:edge] DEBUG Transformer input: v(Month)[#46:0]
[2:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 1 vertices (0 vertices/sec) Total time: 8s [0 

warnings, 0 errors]
[2:edge] DEBUG created new edge=e[#54:0][#46:0-BelongsTo->#41:0]
[2:edge] DEBUG Transformer output: v(Month)[#46:0]
[3:csv] DEBUG Transformer input: 3,March,JFM,2010
[3:csv] DEBUG parsing=3,March,JFM,2010
[3:csv] DEBUG document={id_month:3,month:March,quarter:JFM,year:2010}
[3:csv] DEBUG Transformer output: {id_month:3,month:March,quarter:JFM,year:2010}
[3:vertex] DEBUG Transformer input: {id_month:3,month:March,quarter:JFM,year:2010}
[3:vertex] DEBUG Transformer output: v(Month)[#45:1]
[3:edge] DEBUG Transformer input: v(Month)[#45:1]
[3:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 2 vertices (1 vertices/sec) Total time: 9s [0 

warnings, 0 errors]
[3:edge] DEBUG created new edge=e[#53:1][#45:1-BelongsTo->#41:0]
[3:edge] DEBUG Transformer output: v(Month)[#45:1]
[4:csv] DEBUG Transformer input: 4,April,AMJ,2010
[4:csv] DEBUG parsing=4,April,AMJ,2010
[4:csv] DEBUG document={id_month:4,month:April,quarter:AMJ,year:2010}
[4:csv] DEBUG Transformer output: {id_month:4,month:April,quarter:AMJ,year:2010}
[4:vertex] DEBUG Transformer input: {id_month:4,month:April,quarter:AMJ,year:2010}
[4:vertex] DEBUG Transformer output: v(Month)[#46:1]
[4:edge] DEBUG Transformer input: v(Month)[#46:1]
[4:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 3 vertices (0 vertices/sec) Total time: 

10014ms [0 warnings, 0 errors]
[4:edge] DEBUG created new edge=e[#54:1][#46:1-BelongsTo->#41:0]
[4:edge] DEBUG Transformer output: v(Month)[#46:1]
[5:csv] DEBUG Transformer input: 5,May,AMJ,2010
[5:csv] DEBUG parsing=5,May,AMJ,2010
[5:csv] DEBUG document={id_month:5,month:May,quarter:AMJ,year:2010}
[5:csv] DEBUG Transformer output: {id_month:5,month:May,quarter:AMJ,year:2010}
[5:vertex] DEBUG Transformer input: {id_month:5,month:May,quarter:AMJ,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 4 vertices (1 vertices/sec) Total time: 
11014ms [0 warnings, 0 errors]
[5:vertex] DEBUG Transformer output: v(Month)[#45:2]
[5:edge] DEBUG Transformer input: v(Month)[#45:2]
[5:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 4 vertices (0 vertices/sec) Total time: 
12014ms [0 warnings, 0 errors]
[5:edge] DEBUG created new edge=e[#53:2][#45:2-BelongsTo->#41:0]
[5:edge] DEBUG Transformer output: v(Month)[#45:2]
[6:csv] DEBUG Transformer input: 6,June,AMJ,2010
[6:csv] DEBUG parsing=6,June,AMJ,2010
[6:csv] DEBUG document={id_month:6,month:June,quarter:AMJ,year:2010}
[6:csv] DEBUG Transformer output: {id_month:6,month:June,quarter:AMJ,year:2010}
[6:vertex] DEBUG Transformer input: {id_month:6,month:June,quarter:AMJ,year:2010}
[6:vertex] DEBUG Transformer output: v(Month)[#46:2]
[6:edge] DEBUG Transformer input: v(Month)[#46:2]
[6:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 5 vertices (1 vertices/sec) Total time: 
13014ms [0 warnings, 0 errors]
[6:edge] DEBUG created new edge=e[#54:2][#46:2-BelongsTo->#41:0]
[6:edge] DEBUG Transformer output: v(Month)[#46:2]
[7:csv] DEBUG Transformer input: 7,July,JAS,2010
[7:csv] DEBUG parsing=7,July,JAS,2010
[7:csv] DEBUG document={id_month:7,month:July,quarter:JAS,year:2010}
[7:csv] DEBUG Transformer output: {id_month:7,month:July,quarter:JAS,year:2010}
[7:vertex] DEBUG Transformer input: {id_month:7,month:July,quarter:JAS,year:2010}
[7:vertex] DEBUG Transformer output: v(Month)[#45:3]
[7:edge] DEBUG Transformer input: v(Month)[#45:3]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 6 vertices (1 vertices/sec) Total time: 

14014ms [0 warnings, 0 errors]
[7:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
[7:edge] DEBUG created new edge=e[#53:3][#45:3-BelongsTo->#41:0]
[7:edge] DEBUG Transformer output: v(Month)[#45:3]
[8:csv] DEBUG Transformer input: 8,August,JAS,2010
[8:csv] DEBUG parsing=8,August,JAS,2010
[8:csv] DEBUG document={id_month:8,month:August,quarter:JAS,year:2010}
[8:csv] DEBUG Transformer output: {id_month:8,month:August,quarter:JAS,year:2010}
[8:vertex] DEBUG Transformer input: {id_month:8,month:August,quarter:JAS,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 7 vertices (1 vertices/sec) Total time: 

15014ms [0 warnings, 0 errors]
[8:vertex] DEBUG Transformer output: v(Month)[#46:3]
[8:edge] DEBUG Transformer input: v(Month)[#46:3]
[8:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 7 vertices (0 vertices/sec) Total time: 

16014ms [0 warnings, 0 errors]
[8:edge] DEBUG created new edge=e[#54:3][#46:3-BelongsTo->#41:0]
[8:edge] DEBUG Transformer output: v(Month)[#46:3]
[9:csv] DEBUG Transformer input: 9,September,JAS,2010
[9:csv] DEBUG parsing=9,September,JAS,2010
[9:csv] DEBUG document={id_month:9,month:September,quarter:JAS,year:2010}
[9:csv] DEBUG Transformer output: {id_month:9,month:September,quarter:JAS,year:2010}
[9:vertex] DEBUG Transformer input: {id_month:9,month:September,quarter:JAS,year:2010}
[9:vertex] DEBUG Transformer output: v(Month)[#45:4]
[9:edge] DEBUG Transformer input: v(Month)[#45:4]
[9:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 8 vertices (1 vertices/sec) Total time: 
17014ms [0 warnings, 0 errors]
[9:edge] DEBUG created new edge=e[#53:4][#45:4-BelongsTo->#41:0]
[9:edge] DEBUG Transformer output: v(Month)[#45:4]
[10:csv] DEBUG Transformer input: 10,October,OND,2010
[10:csv] DEBUG parsing=10,October,OND,2010
[10:csv] DEBUG document={id_month:10,month:October,quarter:OND,year:2010}
[10:csv] DEBUG Transformer output: {id_month:10,month:October,quarter:OND,year:2010}
[10:vertex] DEBUG Transformer input: {id_month:10,month:October,quarter:OND,year:2010}
[10:vertex] DEBUG Transformer output: v(Month)[#46:4]
[10:edge] DEBUG Transformer input: v(Month)[#46:4]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 9 vertices (1 vertices/sec) Total time: 
18014ms [0 warnings, 0 errors]
[10:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
[10:edge] DEBUG created new edge=e[#54:4][#46:4-BelongsTo->#41:0]
[10:edge] DEBUG Transformer output: v(Month)[#46:4]
[11:csv] DEBUG Transformer input: 11,November,OND,2010
[11:csv] DEBUG parsing=11,November,OND,2010
[11:csv] DEBUG document={id_month:11,month:November,quarter:OND,year:2010}
[11:csv] DEBUG Transformer output: {id_month:11,month:November,quarter:OND,year:2010}
[11:vertex] DEBUG Transformer input: {id_month:11,month:November,quarter:OND,year:2010}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 10 vertices (1 vertices/sec) Total time: 
19014ms [0 warnings, 0 errors]
[11:vertex] DEBUG Transformer output: v(Month)[#45:5]
[11:edge] DEBUG Transformer input: v(Month)[#45:5]
[11:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 10 vertices (0 vertices/sec) Total time: 
20014ms [0 warnings, 0 errors]
[11:edge] DEBUG created new edge=e[#53:5][#45:5-BelongsTo->#41:0]
[11:edge] DEBUG Transformer output: v(Month)[#45:5]
[12:csv] DEBUG Transformer input: 12,December,OND,2010
[12:csv] DEBUG parsing=12,December,OND,2010
[12:csv] DEBUG document={id_month:12,month:December,quarter:OND,year:2010}
[12:csv] DEBUG Transformer output: {id_month:12,month:December,quarter:OND,year:2010}
[12:vertex] DEBUG Transformer input: {id_month:12,month:December,quarter:OND,year:2010}
[12:vertex] DEBUG Transformer output: v(Month)[#46:5]
[12:edge] DEBUG Transformer input: v(Month)[#46:5]
[12:edge] DEBUG joinCurrentValue=2010, lookupResult=#41:0
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 11 vertices (1 vertices/sec) Total time: 
21014ms [0 warnings, 0 errors]
[12:edge] DEBUG created new edge=e[#54:5][#46:5-BelongsTo->#41:0]
[12:edge] DEBUG Transformer output: v(Month)[#46:5]

**<-- Skipped some rows with similar output due to space limitation-->**

[35:csv] DEBUG Transformer input: 35,November,OND,2012
[35:csv] DEBUG parsing=35,November,OND,2012
[35:csv] DEBUG document={id_month:35,month:November,quarter:OND,year:2012}
[35:csv] DEBUG Transformer output: {id_month:35,month:November,quarter:OND,year:2012}
[35:vertex] DEBUG Transformer input: {id_month:35,month:November,quarter:OND,year:2012}
[35:vertex] DEBUG Transformer output: v(Month)[#45:17]
[35:edge] DEBUG Transformer input: v(Month)[#45:17]
[35:edge] DEBUG joinCurrentValue=2012, lookupResult=#41:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 34 vertices (1 vertices/sec) Total time: 

52072ms [0 warnings, 0 errors]
[35:edge] DEBUG created new edge=e[#53:17][#45:17-BelongsTo->#41:1]
[35:edge] DEBUG Transformer output: v(Month)[#45:17]
[36:csv] DEBUG Transformer input: 36,December,OND,2012
[36:csv] DEBUG parsing=36,December,OND,2012
[36:csv] DEBUG document={id_month:36,month:December,quarter:OND,year:2012}
[36:csv] DEBUG Transformer output: {id_month:36,month:December,quarter:OND,year:2012}
[36:vertex] DEBUG Transformer input: {id_month:36,month:December,quarter:OND,year:2012}
[36:vertex] DEBUG Transformer output: v(Month)[#46:17]
[36:edge] DEBUG Transformer input: v(Month)[#46:17]
[36:edge] DEBUG joinCurrentValue=2012, lookupResult=#41:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 35 vertices (1 vertices/sec) Total time: 

53072ms [0 warnings, 0 errors]
[36:edge] DEBUG created new edge=e[#54:17][#46:17-BelongsTo->#41:1]
[36:edge] DEBUG Transformer output: v(Month)[#46:17]
[37:csv] DEBUG Transformer input: 37,January,JFM,2013
[37:csv] DEBUG parsing=37,January,JFM,2013
[37:csv] DEBUG document={id_month:37,month:January,quarter:JFM,year:2013}
[37:csv] DEBUG Transformer output: {id_month:37,month:January,quarter:JFM,year:2013}
[37:vertex] DEBUG Transformer input: {id_month:37,month:January,quarter:JFM,year:2013}
[37:vertex] DEBUG Transformer output: v(Month)[#45:18]
[37:edge] DEBUG Transformer input: v(Month)[#45:18]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 36 vertices (1 vertices/sec) Total time: 

54072ms [0 warnings, 0 errors]
[37:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 36 vertices (0 vertices/sec) Total time: 

55074ms [0 warnings, 0 errors]
[37:edge] DEBUG created new edge=e[#53:18][#45:18-BelongsTo->#42:1]
[37:edge] DEBUG Transformer output: v(Month)[#45:18]
[38:csv] DEBUG Transformer input: 38,February,JFM,2013
[38:csv] DEBUG parsing=38,February,JFM,2013
[38:csv] DEBUG document={id_month:38,month:February,quarter:JFM,year:2013}
[38:csv] DEBUG Transformer output: {id_month:38,month:February,quarter:JFM,year:2013}
[38:vertex] DEBUG Transformer input: {id_month:38,month:February,quarter:JFM,year:2013}
[38:vertex] DEBUG Transformer output: v(Month)[#46:18]
[38:edge] DEBUG Transformer input: v(Month)[#46:18]
[38:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 37 vertices (1 vertices/sec) Total time: 

56074ms [0 warnings, 0 errors]
[38:edge] DEBUG created new edge=e[#54:18][#46:18-BelongsTo->#42:1]
[38:edge] DEBUG Transformer output: v(Month)[#46:18]
[39:csv] DEBUG Transformer input: 39,March,JFM,2013
[39:csv] DEBUG parsing=39,March,JFM,2013
[39:csv] DEBUG document={id_month:39,month:March,quarter:JFM,year:2013}
[39:csv] DEBUG Transformer output: {id_month:39,month:March,quarter:JFM,year:2013}
[39:vertex] DEBUG Transformer input: {id_month:39,month:March,quarter:JFM,year:2013}
[39:vertex] DEBUG Transformer output: v(Month)[#45:19]
[39:edge] DEBUG Transformer input: v(Month)[#45:19]
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 38 vertices (1 vertices/sec) Total time: 

57074ms [0 warnings, 0 errors]
[39:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
[39:edge] DEBUG created new edge=e[#53:19][#45:19-BelongsTo->#42:1]
[39:edge] DEBUG Transformer output: v(Month)[#45:19]
[40:csv] DEBUG Transformer input: 40,April,AMJ,2013
[40:csv] DEBUG parsing=40,April,AMJ,2013
[40:csv] DEBUG document={id_month:40,month:April,quarter:AMJ,year:2013}
[40:csv] DEBUG Transformer output: {id_month:40,month:April,quarter:AMJ,year:2013}
[40:vertex] DEBUG Transformer input: {id_month:40,month:April,quarter:AMJ,year:2013}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 39 vertices (1 vertices/sec) Total time: 

58074ms [0 warnings, 0 errors]
[40:vertex] DEBUG Transformer output: v(Month)[#46:19]
[40:edge] DEBUG Transformer input: v(Month)[#46:19]
[40:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 39 vertices (0 vertices/sec) Total time: 

59074ms [0 warnings, 0 errors]
[40:edge] DEBUG created new edge=e[#54:19][#46:19-BelongsTo->#42:1]
[40:edge] DEBUG Transformer output: v(Month)[#46:19]
[41:csv] DEBUG Transformer input: 41,May,AMJ,2013
[41:csv] DEBUG parsing=41,May,AMJ,2013
[41:csv] DEBUG document={id_month:41,month:May,quarter:AMJ,year:2013}
[41:csv] DEBUG Transformer output: {id_month:41,month:May,quarter:AMJ,year:2013}
[41:vertex] DEBUG Transformer input: {id_month:41,month:May,quarter:AMJ,year:2013}
[41:vertex] DEBUG Transformer output: v(Month)[#45:20]
[41:edge] DEBUG Transformer input: v(Month)[#45:20]
[41:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 40 vertices (1 vertices/sec) Total time: 

60074ms [0 warnings, 0 errors]
[41:edge] DEBUG created new edge=e[#53:20][#45:20-BelongsTo->#42:1]
[41:edge] DEBUG Transformer output: v(Month)[#45:20]
[42:csv] DEBUG Transformer input: 42,June,AMJ,2013
[42:csv] DEBUG parsing=42,June,AMJ,2013
[42:csv] DEBUG document={id_month:42,month:June,quarter:AMJ,year:2013}
[42:csv] DEBUG Transformer output: {id_month:42,month:June,quarter:AMJ,year:2013}
[42:vertex] DEBUG Transformer input: {id_month:42,month:June,quarter:AMJ,year:2013}
[42:vertex] DEBUG Transformer output: v(Month)[#46:20]
[42:edge] DEBUG Transformer input: v(Month)[#46:20]
[42:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 41 vertices (1 vertices/sec) Total time: 

61074ms [0 warnings, 0 errors]
[42:edge] DEBUG created new edge=e[#54:20][#46:20-BelongsTo->#42:1]
[42:edge] DEBUG Transformer output: v(Month)[#46:20]
[43:csv] DEBUG Transformer input: 43,July,JAS,2013
[43:csv] DEBUG parsing=43,July,JAS,2013
[43:csv] DEBUG document={id_month:43,month:July,quarter:JAS,year:2013}
[43:csv] DEBUG Transformer output: {id_month:43,month:July,quarter:JAS,year:2013}
[43:vertex] DEBUG Transformer input: {id_month:43,month:July,quarter:JAS,year:2013}
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 42 vertices (0 vertices/sec) Total time: 

62076ms [0 warnings, 0 errors]
[43:vertex] DEBUG Transformer output: v(Month)[#45:21]
[43:edge] DEBUG Transformer input: v(Month)[#45:21]
[43:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 42 vertices (0 vertices/sec) Total time: 

63081ms [0 warnings, 0 errors]
[43:edge] DEBUG created new edge=e[#53:21][#45:21-BelongsTo->#42:1]
[43:edge] DEBUG Transformer output: v(Month)[#45:21]
[44:csv] DEBUG Transformer input: 44,August,JAS,2013
[44:csv] DEBUG parsing=44,August,JAS,2013
[44:csv] DEBUG document={id_month:44,month:August,quarter:JAS,year:2013}
[44:csv] DEBUG Transformer output: {id_month:44,month:August,quarter:JAS,year:2013}
[44:vertex] DEBUG Transformer input: {id_month:44,month:August,quarter:JAS,year:2013}
[44:vertex] DEBUG Transformer output: v(Month)[#46:21]
[44:edge] DEBUG Transformer input: v(Month)[#46:21]
[44:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 43 vertices (1 vertices/sec) Total time: 

64081ms [0 warnings, 0 errors]
[44:edge] DEBUG created new edge=e[#54:21][#46:21-BelongsTo->#42:1]
[44:edge] DEBUG Transformer output: v(Month)[#46:21]
[45:csv] DEBUG Transformer input: 45,September,JAS,2013
[45:csv] DEBUG parsing=45,September,JAS,2013
[45:csv] DEBUG document={id_month:45,month:September,quarter:JAS,year:2013}
[45:csv] DEBUG Transformer output: {id_month:45,month:September,quarter:JAS,year:2013}
[45:vertex] DEBUG Transformer input: {id_month:45,month:September,quarter:JAS,year:2013}
[45:vertex] DEBUG Transformer output: v(Month)[#45:22]
[45:edge] DEBUG Transformer input: v(Month)[#45:22]
[45:edge] DEBUG joinCurrentValue=2013, lookupResult=#42:1
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 44 vertices (1 vertices/sec) Total time: 

65081ms [0 warnings, 0 errors]
ETL process has problem: java.util.concurrent.TimeoutException
END ETL PROCESSOR
+ extracted 97 rows (0 rows/sec) - 97 rows -> loaded 44 vertices (0 vertices/sec) Total time: 

65225ms [0 warnings, 0 errors]
Error in Pipeline execution: com.orientechnologies.orient.core.exception.ODatabaseException: Error 

during saving of record with rid #45:22
    DB name="testdb"
C:\orientdb-community-2.2.5\bin>

Steps to reproduce the problem

  1. Import JSON for year.csv using ETL (Loads without error)**
  2. Import JSON for month.csv using ETL (loads some vertices and edges and then throws error after about 64000ms)
1

1 Answers

0
votes

I have tried with

"config": {
        "log":"debug",
        "maxRetries":10,
        "parallel":true
    },

and it worked.