tyong920

参考项目：

作用：海量数据的去重，时间、空间复杂度为常量：O(K)。

原理：借助redis，维护一个BitSet(位集合)。通过bloom filter算法判断一个数据是否重复。

注意：本文内容适用于 Tmux 2.3 及以上的版本，但是绝大部分的特性低版本也都适用，鼠标支持、VI 模式、插件管理在低版本可能会与本文不兼容。

Tmux 快捷键 & 速查表 & 简明教程

启动新会话：

tmux [new -s 会话名 -n 窗口名]

恢复会话：

A "Best of the Best Practices" (BOBP) guide to developing in Python.

	# This is a modified version of `orig_benchmark.py`, using different data to
	# highlight performance differences.
	import json
	import random
	import string
	import timeit
	from statistics import mean, stdev

	import orjson
	import simdjson

	import asyncio
	from pathlib import Path
	from typing import Optional

	from watchdog.events import FileSystemEvent, FileSystemEventHandler
	from watchdog.observers import Observer


	class _EventHandler(FileSystemEventHandler):
	def __init__(self, queue: asyncio.Queue, loop: asyncio.BaseEventLoop,

	# Python 3
	def to_str(bytes_or_str):
	if isinstance(bytes_or_str, bytes):
	value = bytes_or_str.decode('utf-8')
	else:
	value = bytes_or_str
	return value # Instance of str


	def to_bytes(bytes_or_str):

	#
	# Copyright (c) 2017, Venkatesh-Prasad Ranganath
	#
	# BSD 3-clause License
	#
	# Author: Venkatesh-Prasad Ranganath
	#
	import argparse
	import datetime
	import itertools

	# Pass the env-vars to MYCOMMAND
	eval $(egrep -v '^#' .env \| xargs) MYCOMMAND
	# … or ...
	# Export the vars in .env into your shell:
	export $(egrep -v '^#' .env \| xargs)

	"""
	Python Singleton with parameters (so the same parameters get you the same object)
	with support to default arguments and passing arguments as kwargs (but no support for pure kwargs).

	And implementation for MongoClient class from pymongo package.
	"""
	from pymongo import MongoClient
	import inspect

	import json

	from scrapy.crawler import Crawler
	from scrapy.contrib.loader import ItemLoader
	from scrapy.contrib.loader.processor import Join, MapCompose, TakeFirst
	from scrapy import log, signals, Spider, Item, Field
	from scrapy.settings import Settings
	from twisted.internet import reactor