Skip to content

Instantly share code, notes, and snippets.

@ram-pi

ram-pi/json-to-avro.sql

Forked from miguno/json-to-avro.sql
Created August 17, 2022 14:48
Show Gist options
  • Save ram-pi/ab083e1f33109590092b55ff434d68d2 to your computer and use it in GitHub Desktop.
Save ram-pi/ab083e1f33109590092b55ff434d68d2 to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. @miguno miguno revised this gist Dec 20, 2017. 1 changed file with 3 additions and 1 deletion.
    4 changes: 3 additions & 1 deletion json-to-avro.sql
    View file
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,6 @@

    CREATE STREAM sensor_events_json (sensor_id VARCHAR, temperature INTEGER, ...)
    WITH (KAFKA_TOPIC='events-topic', VALUE_FORMAT='JSON');

    CREATE STREAM sensor_events_avro WITH (VALUE_FORMAT='AVRO') AS SELECT * FROM sensor_events_json;
    CREATE STREAM sensor_events_avro WITH (VALUE_FORMAT='AVRO') AS SELECT * FROM sensor_events_json;

  2. @miguno miguno revised this gist Dec 20, 2017. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion json-to-avro.sql
    View file
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,4 @@
    CREATE STREAM sensor_events_json (sensor_id VARCHAR, temperature INTEGER, ...)
    WITH (KAFKA_TOPIC='pageviews-topic', VALUE_FORMAT='JSON');
    WITH (KAFKA_TOPIC='events-topic', VALUE_FORMAT='JSON');

    CREATE STREAM sensor_events_avro WITH (VALUE_FORMAT='AVRO') AS SELECT * FROM sensor_events_json;
  3. @miguno miguno revised this gist Dec 20, 2017. 1 changed file with 3 additions and 3 deletions.
    6 changes: 3 additions & 3 deletions json-to-avro.sql
    View file
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,4 @@
    CREATE STREAM pageviews_json (viewtime BIGINT, user_id VARCHAR, ...)
    WITH (KAFKA_TOPIC='pageviews-json-topic', VALUE_FORMAT='JSON');
    CREATE STREAM sensor_events_json (sensor_id VARCHAR, temperature INTEGER, ...)
    WITH (KAFKA_TOPIC='pageviews-topic', VALUE_FORMAT='JSON');

    CREATE STREAM pageviews_avro WITH (VALUE_FORMAT='AVRO') AS SELECT * FROM pageviews_json;
    CREATE STREAM sensor_events_avro WITH (VALUE_FORMAT='AVRO') AS SELECT * FROM sensor_events_json;
  4. @miguno miguno revised this gist Dec 20, 2017. 1 changed file with 1 addition and 1 deletion.
    2 changes: 1 addition & 1 deletion json-to-avro.sql
    View file
    Original file line number Diff line number Diff line change
    @@ -1,4 +1,4 @@
    CREATE STREAM pageviews_json (viewtime BIGINT, userid VARCHAR, pageid VARCHAR)
    CREATE STREAM pageviews_json (viewtime BIGINT, user_id VARCHAR, ...)
    WITH (KAFKA_TOPIC='pageviews-json-topic', VALUE_FORMAT='JSON');

    CREATE STREAM pageviews_avro WITH (VALUE_FORMAT='AVRO') AS SELECT * FROM pageviews_json;
  5. @miguno miguno revised this gist Dec 20, 2017. 1 changed file with 1 addition and 2 deletions.
    3 changes: 1 addition & 2 deletions json-to-avro.sql
    View file
    Original file line number Diff line number Diff line change
    @@ -1,5 +1,4 @@
    CREATE STREAM pageviews_json (viewtime BIGINT, userid VARCHAR, pageid VARCHAR)
    WITH (KAFKA_TOPIC='pageviews-json-topic', VALUE_FORMAT='JSON');

    CREATE STREAM pageviews_avro WITH (VALUE_FORMAT = 'AVRO') AS
    SELECT * FROM pageviews_json;
    CREATE STREAM pageviews_avro WITH (VALUE_FORMAT='AVRO') AS SELECT * FROM pageviews_json;
  6. @miguno miguno created this gist Dec 20, 2017.
    5 changes: 5 additions & 0 deletions json-to-avro.sql
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,5 @@
    CREATE STREAM pageviews_json (viewtime BIGINT, userid VARCHAR, pageid VARCHAR)
    WITH (KAFKA_TOPIC='pageviews-json-topic', VALUE_FORMAT='JSON');

    CREATE STREAM pageviews_avro WITH (VALUE_FORMAT = 'AVRO') AS
    SELECT * FROM pageviews_json;