Skip to content

Instantly share code, notes, and snippets.

View ozlmulg's full-sized avatar

Özlem Ulağ ozlmulg

View GitHub Profile
@ozlmulg
ozlmulg / kafka-cheat-sheet.md
Created July 22, 2020 19:35 — forked from filipefigcorreia/kafka-cheat-sheet.md
Apache Kafka Cheat Sheet

Kafka Topics

List existing topics

bin/kafka-topics.sh --zookeeper localhost:2181 --list

Purge a topic

bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic mytopic --config retention.ms=1000

... wait a minute ...

bin/kafka-topics.sh --zookeeper localhost:2181 --alter --topic mytopic --delete-config retention.ms

@ozlmulg
ozlmulg / SQL-Insert-Statements.sql.groovy
Created April 5, 2019 06:54 — forked from pasali/SQL-Insert-Statements.sql.groovy
SQL Bulk insert export script for DataGrip
SEP = ", "
QUOTE = "\'"
NEWLINE = System.getProperty("line.separator")
KEYWORDS_LOWERCASE = com.intellij.database.util.DbSqlUtil.areKeywordsLowerCase(PROJECT)
KW_INSERT_INTO = KEYWORDS_LOWERCASE ? "insert into " : "INSERT INTO "
KW_VALUES = KEYWORDS_LOWERCASE ? "values" : "VALUES"
KW_NULL = KEYWORDS_LOWERCASE ? "null" : "NULL"
OUT.append(KW_INSERT_INTO)
@ozlmulg
ozlmulg / how_to_reset_kafka_consumer_group_offset.md
Created June 13, 2018 09:10 — forked from marwei/how_to_reset_kafka_consumer_group_offset.md
How to Reset Kafka Consumer Group Offset

Kafka 0.11.0.0 (Confluent 3.3.0) added support to manipulate offsets for a consumer group via cli kafka-consumer-groups command.

  1. List the topics to which the group is subscribed
kafka-consumer-groups --bootstrap-server <kafkahost:port> --group <group_id> --describe

Note the values under "CURRENT-OFFSET" and "LOG-END-OFFSET". "CURRENT-OFFSET" is the offset where this consumer group is currently at in each of the partitions.

  1. Reset the consumer offset for a topic (preview)



  


  




    


          
    

      

        
        

          

              @ozlmulg
          

          

            
                ozlmulg
                / CsvCreator.java
            
            

              Last active
              August 29, 2015 14:18
                — forked from shsdev/CsvCreator.java
            

          

        

      

        

  

    
    


        



  


  

        

          
          import com.fasterxml.jackson.annotation.JsonPropertyOrder;
        

        

          
          import com.fasterxml.jackson.databind.ObjectWriter;
        

        

          
          import com.fasterxml.jackson.dataformat.csv.CsvMapper;
        

        

          
          import com.fasterxml.jackson.dataformat.csv.CsvSchema;
        

        

          
          import java.io.BufferedOutputStream;
        

        

          
          import java.io.File;
        

        

          
          import java.io.FileNotFoundException;
        

        

          
          import java.io.FileOutputStream;
        

        

          
          import java.io.IOException;
        

        

          
          import java.io.OutputStreamWriter;