Skip to content

Instantly share code, notes, and snippets.

@websider
websider / README.md
Created July 25, 2018 06:42 — forked from magnetikonline/README.md
Node.js HTTP receiving request dump server.

Node.js HTTP receiving request dump server

Simple HTTP server receiving requests and dumping to flat file.

Usage

Start the listening HTTP server:

$ nodejs ./httprequestdump.js
Listening on 0.0.0.0:8080
@websider
websider / parser.py
Created July 23, 2018 12:00 — forked from hreeder/parser.py
Python nginx Log Parser
#!/usr/bin/env python
import gzip
import os
import sys
import re
INPUT_DIR = "nginx-logs"
lineformat = re.compile(r"""(?P<ipaddress>\d{1,3}\.\d{1,3}\.\d{1,3}\.\d{1,3}) - - \[(?P<dateandtime>\d{2}\/[a-z]{3}\/\d{4}:\d{2}:\d{2}:\d{2} (\+|\-)\d{4})\] ((\"(GET|POST) )(?P<url>.+)(http\/1\.1")) (?P<statuscode>\d{3}) (?P<bytessent>\d+) (["](?P<refferer>(\-)|(.+))["]) (["](?P<useragent>.+)["])""", re.IGNORECASE)
@websider
websider / nginx_access_log_parser.py
Created July 23, 2018 12:00 — forked from shenfeng/nginx_access_log_parser.py
parse nginx access log in python
def seg_access_log(line):
delimiters = {'[': ']', '"': '"'}
idx, start, count, delimiter, results = 0, 0, len(line), ' ', []
while 1:
idx = line.find(delimiter, start)
delimiter = ' ' # reset
if idx < 0:
break
@websider
websider / build.sh
Created July 18, 2018 08:22 — forked from dzlab/build.sh
Configure NGINX to log HTTP POST request's body
#!/bin/bash
echo "Building NGINX along with Echo module"
# install prerequisites
yum -y install gcc gcc-c++ make zlib-devel pcre-devel openssl-devel
# download the Echo module
curl -L -O 'https://github.com/openresty/echo-nginx-module/archive/v0.58.tar.gz'
tar -xzvf v0.58.tar.gz && rm v0.58.tar.gz
mv echo-nginx-module-0.58 /tmp/echo-nginx-module
@websider
websider / nginx.conf
Created July 18, 2018 08:22 — forked from morhekil/nginx.conf
Full request/response body logging in nginx
http {
log_format bodylog '$remote_addr - $remote_user [$time_local] '
'"$request" $status $body_bytes_sent '
'"$http_referer" "$http_user_agent" $request_time '
'<"$request_body" >"$resp_body"';
lua_need_request_body on;
set $resp_body "";
body_filter_by_lua '

Kinesis로 App 로그 다루기

글쓴이: 김정주([email protected])

이 글은 AWS 블로그를 참고하고 추가/보완하여 작성되었습니다.


Kinesis는 아마존 웹서비스(AWS)에서 제공하는 실시간 데이터 처리기이다.

@websider
websider / flask.py
Created June 7, 2018 08:31 — forked from kageurufu/flask.py
Flask-WTF FieldLists with Dynamic Entries
from flask import Flask
from flask.ext.sqlalchemy import SQLAlchemy
from flask.ext.wtf import Form
from flask.ext.babel import gettext
from wtforms import SelectField, TelField, TextField, FormField, Fieldlist, SubmitField
from wtforms.validators import Optional, Required
app = Flask(__name__)
db = SQLAlchemy(app)
@websider
websider / code-1.htm
Created December 1, 2016 08:22 — forked from bennadel/code-1.htm
My Safari Browser SQLite Database Hello World Example
<!DOCTYPE HTML>
<html>
<head>
<title>Safari SQLite Hello World Example</title>
<script type="text/javascript" src="jquery-1.4.2.min.js"></script>
<script type="text/javascript">
// The first thing we want to do is create the local
// database (if it doesn't exist) or open the connection
// if it does exist. Let's define some options for our
@websider
websider / http.php
Created November 29, 2016 03:10
simple http request example in php
<?php
/*
* simple HttpRequest example using PHP
* tom slankard
*/
class HttpRequest {
public $url = null;
@websider
websider / intellij-monokai-theme.xml
Created January 24, 2016 15:34 — forked from darekkay/intellij-monokai-theme.xml
Monokai Theme for IntelliJ
<scheme name="Eclectide Monokai" version="124" parent_scheme="Default">
<option name="LINE_SPACING" value="1.0" />
<option name="EDITOR_FONT_SIZE" value="12" />
<option name="EDITOR_FONT_NAME" value="Consolas" />
<colors>
<option name="ADDED_LINES_COLOR" value="295622" />
<option name="CARET_COLOR" value="bbbbbb" />
<option name="CARET_ROW_COLOR" value="" />
<option name="CONSOLE_BACKGROUND_KEY" value="272822" />
<option name="FILESTATUS_ADDED" value="629755" />