Skip to content

Instantly share code, notes, and snippets.

View IanVaughan's full-sized avatar
👯‍♀️
OMG

Ian Vaughan IanVaughan

👯‍♀️
OMG
56 followers · 121 following
View GitHub Profile
@IanVaughan
IanVaughan / app.rb
Created October 17, 2024 10:16
Simple sinatra app that sleeps for even internal_ids
require 'sinatra'
require 'net/http'
require 'uri'
require 'json'
get '/frank-says' do
'Put this in your pipe & smoke it!'
end
post '/submit' do
@IanVaughan
IanVaughan / leads_csv.rb
Created May 16, 2023 10:34
Matching SalesForce Leads
# frozen_string_literal: true
require 'csv'
require 'restforce'
CONFIG = {
username: '',
password: ENV['SFDC_PASSWORD'],
client_id: '',
client_secret: ENV['SFDC_CLIENT_SECRET'],
@IanVaughan
IanVaughan / scrape.rb
Created May 13, 2023 22:18
Scrape discogs.com price data
require 'csv'
require 'nokogiri'
require 'open-uri'
require 'pry'
urls = File.read('urls.txt').split("\n")
CSV.open('scraped_data.csv', 'wb') do |csv|
urls.each do |url|
html = URI.open(url).read
@IanVaughan
IanVaughan / load-test.rb
Created April 25, 2023 13:23
Load test streaming prod data into staging
#!/usr/bin/env ruby
require 'delivery_boy'
# topic = 'raw-transactions-truelayer'
topic = ARGV[0]
command = "stream-kafka #{topic}"
CONFIG = {
brokers: ['---.europe-west1.gcp.confluent.cloud:9092'],
@IanVaughan
IanVaughan / karafka.rb
Created March 31, 2023 08:02
karafka errors on 3rd consumer_group
# frozen_string_literal: true
module Karafka
class App
CONFIG = Rails.application.credentials.kafka
setup do |config|
config.client_id = 'cas_client'
config.kafka = {
@IanVaughan
IanVaughan / server.rb
Last active October 3, 2022 08:09
Simple ruby server
require 'socket'
socket = TCPServer.new(4040)
loop do
client = socket.accept
first_line = client.gets
verb, path, _ = first_line.split
if verb == 'GET'
@IanVaughan
IanVaughan / ccloud.md
Created November 1, 2021 09:22 
ccloud kafka topic create --partitions 1 test-topic

ccloud kafka topic produce test-topic --value-format avro --schema /path/to/schema.json
{"myField":"test","myField2":1}
{"myField":"foo","myField2":2}

Finish Getting Started with Schema Registry

@IanVaughan
IanVaughan / gist:94fdf23dcd43aa7d1903740b24c6cdf3
Created July 29, 2021 11:54
Datadog CI failure
2021-07-29T11:29:38.0007456Z ##[group]Starting datadog-agent service container
2021-07-29T11:29:38.0009102Z ##[command]/usr/bin/docker pull datadog/agent:latest
2021-07-29T11:29:39.4210209Z latest: Pulling from datadog/agent
2021-07-29T11:29:39.7656448Z 1127acbecdf7: Pulling fs layer
2021-07-29T11:29:41.8115266Z 1127acbecdf7: Verifying Checksum
2021-07-29T11:29:41.8115918Z 1127acbecdf7: Download complete
2021-07-29T11:29:50.9679094Z 1127acbecdf7: Pull complete
2021-07-29T11:29:50.9742704Z Digest: sha256:da43df11da9f6052d1a8691c87c5b1df60e79352f94c4ed7a53465e1a51dac04
2021-07-29T11:29:50.9761841Z Status: Downloaded newer image for datadog/agent:latest
2021-07-29T11:29:50.9798695Z docker.io/datadog/agent:latest
@IanVaughan
IanVaughan / cred-diff
Last active April 26, 2023 15:17
cred-diff
#!/usr/bin/env bash
# Usage
# cred-diff <env> (<branch|ref>|master)
# eg
# cred-diff production master
VAR=$2
REF="${VAR:-main}"
git checkout $REF --quiet
printf .
@IanVaughan
IanVaughan / diff-creds
Last active June 25, 2021 15:04
Show difference in rails creditials
#!/usr/bin/env bash
# Usage:
# diff-creds production
git checkout master --quiet
printf .
rails credentials:show --environment $1 > /tmp/prod
printf .
git checkout - --quiet
printf .