73ae6ed8-015e-1000-89f3-94907fd76646
Load CSV to Table
bf62e045-cc1c-337d-0000-000000000000
c72c436c-5a63-35af-0000-000000000000
0.0
0.0
b1440bc0-a55b-3e68-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
bf62e045-cc1c-337d-0000-000000000000
10924146-4f7a-3544-0000-000000000000
PROCESSOR
0 sec
1
failure
bf62e045-cc1c-337d-0000-000000000000
5aea32fb-0913-3374-0000-000000000000
PROCESSOR
0
cd2361dc-f6b5-30a7-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
1238.639892578125
527.9598999023438
bf62e045-cc1c-337d-0000-000000000000
996153a7-af52-3fc9-0000-000000000000
PROCESSOR
0 sec
1
sql
bf62e045-cc1c-337d-0000-000000000000
5aea32fb-0913-3374-0000-000000000000
PROCESSOR
0
d017284c-fcc9-3cec-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
1160.8798828125
383.9599304199219
bf62e045-cc1c-337d-0000-000000000000
5aea32fb-0913-3374-0000-000000000000
PROCESSOR
0 sec
1
success
bf62e045-cc1c-337d-0000-000000000000
30e68bbe-7c4e-3801-0000-000000000000
PROCESSOR
0
f0820637-94df-36b4-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
973.6798706054688
238.5199737548828
bf62e045-cc1c-337d-0000-000000000000
30e68bbe-7c4e-3801-0000-000000000000
PROCESSOR
0 sec
0
success
bf62e045-cc1c-337d-0000-000000000000
58ecbb8e-8413-328f-0000-000000000000
PROCESSOR
0
41118b95-7754-328f-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
bf62e045-cc1c-337d-0000-000000000000
10924146-4f7a-3544-0000-000000000000
PROCESSOR
0 sec
1
failure
incompatible
bf62e045-cc1c-337d-0000-000000000000
58ecbb8e-8413-328f-0000-000000000000
PROCESSOR
0
4c909c34-7018-3873-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
bf62e045-cc1c-337d-0000-000000000000
10924146-4f7a-3544-0000-000000000000
PROCESSOR
0 sec
1
failure
bf62e045-cc1c-337d-0000-000000000000
30e68bbe-7c4e-3801-0000-000000000000
PROCESSOR
0
5b2ba57d-b9bc-3d73-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
836.8798828125
87.31999206542969
bf62e045-cc1c-337d-0000-000000000000
58ecbb8e-8413-328f-0000-000000000000
PROCESSOR
0 sec
0
success
bf62e045-cc1c-337d-0000-000000000000
de82a955-f361-3329-0000-000000000000
PROCESSOR
0
6014f380-99f9-35b4-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
1 GB
10000
bf62e045-cc1c-337d-0000-000000000000
10924146-4f7a-3544-0000-000000000000
PROCESSOR
0 sec
1
failure
bf62e045-cc1c-337d-0000-000000000000
996153a7-af52-3fc9-0000-000000000000
PROCESSOR
0
7b2c5a54-22df-3913-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
nifi-dbcp-service-nar
org.apache.nifi
1.4.0-SNAPSHOT
Database Connection URL
Database Connection URL
Database Driver Class Name
Database Driver Class Name
database-driver-locations
database-driver-locations
Database User
Database User
Password
Password
Max Wait Time
Max Wait Time
Max Total Connections
Max Total Connections
Validation-query
Validation-query
DBCPConnectionPool
false
Database Connection URL
jdbc:mysql://192.168.99.100:3306/nifi_test
Database Driver Class Name
com.mysql.jdbc.Driver
database-driver-locations
/Users/koji/Downloads/mysql-connector-java-5.1.41/mysql-connector-java-5.1.41-bin.jar
Database User
root
Password
Max Wait Time
Max Total Connections
Validation-query
ENABLED
org.apache.nifi.dbcp.DBCPConnectionPool
996153a7-af52-3fc9-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
795.1199438476563
628.7600561523436
nifi-standard-nar
org.apache.nifi
1.4.0-SNAPSHOT
WARN
1
JDBC Connection Pool
org.apache.nifi.dbcp.DBCPService
JDBC Connection Pool
Support Fragmented Transactions
Support Fragmented Transactions
Transaction Timeout
Transaction Timeout
Batch Size
Batch Size
Obtain Generated Keys
Obtain Generated Keys
rollback-on-failure
rollback-on-failure
ALL
false
30 sec
JDBC Connection Pool
7b2c5a54-22df-3913-0000-000000000000
Support Fragmented Transactions
true
Transaction Timeout
Batch Size
100
Obtain Generated Keys
false
rollback-on-failure
false
0
0 sec
TIMER_DRIVEN
1 sec
PutSQL
false
failure
true
retry
true
success
RUNNING
org.apache.nifi.processors.standard.PutSQL
de82a955-f361-3329-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
360.0
27.0
nifi-standard-nar
org.apache.nifi
1.4.0-SNAPSHOT
WARN
1
File Size
File Size
Batch Size
Batch Size
Data Format
Data Format
Unique FlowFiles
Unique FlowFiles
generate-ff-custom-text
generate-ff-custom-text
ALL
false
30 sec
File Size
0B
Batch Size
1
Data Format
Text
Unique FlowFiles
false
generate-ff-custom-text
ID,CITY_NAME,ZIP_CD,STATE_CD
001,CITY_A,1111,AA
002,CITY_B,2222,BB
003,CITY_C,3333,CC
004,CITY_D,4444,DD
0
1d
TIMER_DRIVEN
1 sec
GenerateFlowFile
false
success
RUNNING
org.apache.nifi.processors.standard.GenerateFlowFile
10924146-4f7a-3544-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
151.44000000000005
602.8399999999999
nifi-standard-nar
org.apache.nifi
1.4.0-SNAPSHOT
WARN
1
Log Level
Log Level
Log Payload
Log Payload
Attributes to Log
Attributes to Log
attributes-to-log-regex
attributes-to-log-regex
Attributes to Ignore
Attributes to Ignore
attributes-to-ignore-regex
attributes-to-ignore-regex
Log prefix
Log prefix
character-set
character-set
ALL
false
30 sec
Log Level
info
Log Payload
false
Attributes to Log
attributes-to-log-regex
.*
Attributes to Ignore
attributes-to-ignore-regex
Log prefix
character-set
UTF-8
0
0 sec
TIMER_DRIVEN
1 sec
LogAttribute
false
success
STOPPED
org.apache.nifi.processors.standard.LogAttribute
30e68bbe-7c4e-3801-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
629.520048828125
317.72004150390626
nifi-avro-nar
org.apache.nifi
1.4.0-SNAPSHOT
WARN
1
JSON container options
JSON container options
Wrap Single Record
Wrap Single Record
Avro schema
Avro schema
ALL
false
30 sec
JSON container options
array
Wrap Single Record
false
Avro schema
0
0 sec
TIMER_DRIVEN
1 sec
ConvertAvroToJSON
false
failure
false
success
RUNNING
org.apache.nifi.processors.avro.ConvertAvroToJSON
58ecbb8e-8413-328f-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
476.27996826171875
171.9600067138672
nifi-kite-nar
org.apache.nifi
1.4.0-SNAPSHOT
WARN
1
Hadoop configuration files
Hadoop configuration files
Record schema
Record schema
CSV charset
CSV charset
CSV delimiter
CSV delimiter
CSV quote character
CSV quote character
CSV escape character
CSV escape character
Use CSV header line
Use CSV header line
Lines to skip
Lines to skip
kite-compression-type
kite-compression-type
ALL
false
30 sec
Hadoop configuration files
Record schema
{
"type": "record",
"namespace": "com.example",
"name": "City",
"fields": [
{ "name": "ID", "type": "string" },
{ "name": "CITY_NAME", "type": "string" },
{ "name": "ZIP_CD", "type": "int" },
{ "name": "STATE_CD", "type": "string" }
]
}
CSV charset
utf8
CSV delimiter
,
CSV quote character
"
CSV escape character
\
Use CSV header line
false
Lines to skip
1
kite-compression-type
SNAPPY
0
0 sec
TIMER_DRIVEN
1 sec
ConvertCSVToAvro
false
failure
false
incompatible
false
success
RUNNING
org.apache.nifi.processors.kite.ConvertCSVToAvro
5aea32fb-0913-3374-0000-000000000000
bf62e045-cc1c-337d-0000-000000000000
730.3200366210938
468.9199682617186
nifi-standard-nar
org.apache.nifi
1.4.0-SNAPSHOT
WARN
1
JDBC Connection Pool
org.apache.nifi.dbcp.DBCPService
JDBC Connection Pool
Statement Type
Statement Type
Table Name
Table Name
Catalog Name
Catalog Name
Schema Name
Schema Name
Translate Field Names
Translate Field Names
Unmatched Field Behavior
Unmatched Field Behavior
Unmatched Column Behavior
Unmatched Column Behavior
Update Keys
Update Keys
jts-quoted-identifiers
jts-quoted-identifiers
jts-quoted-table-identifiers
jts-quoted-table-identifiers
ALL
false
30 sec
JDBC Connection Pool
7b2c5a54-22df-3913-0000-000000000000
Statement Type
INSERT
Table Name
cities
Catalog Name
Schema Name
Translate Field Names
true
Unmatched Field Behavior
Ignore Unmatched Fields
Unmatched Column Behavior
Fail on Unmatched Columns
Update Keys
jts-quoted-identifiers
false
jts-quoted-table-identifiers
false
0
0 sec
TIMER_DRIVEN
1 sec
ConvertJSONToSQL
false
failure
true
original
false
sql
RUNNING
org.apache.nifi.processors.standard.ConvertJSONToSQL
Load CSV to Table
09/27/2017 11:03:45 JST