Yunze Xu BewareMyPower

Topic load process

Specifically, for a partition of a partitioned persistent topic, the topic load process is as follows:

Check if the topic exists (Metadata store: /managed-ledgers/<persistence-naming-encoding>)
Get topic policies (via TopicPoliciesService#getTopicPoliciesAsync)
Check topic ownership
Check if the pending topic loading count exceeds the maxConcurrentTopicLoadRequest config (default: 5000), if not, the following steps will be executed after the previous topic loading operations are completed.
Check topic ownership again
Fetch topic properties (Metadata store: /admin/partitioned-topics///persistent/)

TL; DR, go to the last section for the conclusion.

Apache Pulsar heavily uses Netty Recycler as a memory pool to reduce heap memory usage to reduce GC pressure. Here are the full list:

$ find . -name "*.java" |  grep  "src/main" | xargs grep -n "new Recycler"

vcpkg.json:

{
  "name": "vcpkg-pulsar-demo",
  "version-string": "0.1.0",
  "builtin-baseline": "<commit-id>",
  "dependencies": [

	/*
	* Licensed to the Apache Software Foundation (ASF) under one
	* or more contributor license agreements. See the NOTICE file
	* distributed with this work for additional information
	* regarding copyright ownership. The ASF licenses this file
	* to you under the Apache License, Version 2.0 (the
	* "License"); you may not use this file except in compliance
	* with the License. You may obtain a copy of the License at
	*
	* http://www.apache.org/licenses/LICENSE-2.0

	#!/bin/bash
	set -e
	cd `dirname $0`

	VERSION=0.15.1
	RC_SUFFIX="-candidate-1"
	BASE_URL=https://dist.apache.org/repos/dist/dev/pulsar/pulsar-client-go-$VERSION$RC_SUFFIX
	FILENAME=apache-pulsar-client-go-$VERSION-src.tar.gz

	if [[ ! -f $FILENAME ]]; then

	import java.lang.reflect.InvocationTargetException;
	import java.lang.reflect.Method;
	import java.util.concurrent.ExecutorService;
	import java.util.concurrent.Executors;
	import java.util.concurrent.TimeUnit;
	import org.openjdk.jmh.annotations.Benchmark;
	import org.openjdk.jmh.annotations.Level;
	import org.openjdk.jmh.annotations.Measurement;
	import org.openjdk.jmh.annotations.Scope;
	import org.openjdk.jmh.annotations.Setup;

	package io.bewaremypower;

	import java.util.ArrayList;
	import java.util.List;
	import java.util.Random;
	import java.util.concurrent.TimeUnit;
	import org.openjdk.jmh.annotations.Benchmark;
	import org.openjdk.jmh.annotations.Level;
	import org.openjdk.jmh.annotations.Measurement;
	import org.openjdk.jmh.annotations.Scope;

	import java.util.ArrayList;
	import java.util.Collections;
	import java.util.HashMap;
	import java.util.List;
	import java.util.Map;
	import java.util.Random;
	import java.util.concurrent.ConcurrentHashMap;
	import java.util.concurrent.ExecutorService;
	import java.util.concurrent.Executors;
	import java.util.concurrent.Future;

	package org.example.benchmark;

	import java.util.ArrayList;
	import java.util.Collections;
	import java.util.HashMap;
	import java.util.List;
	import java.util.Map;
	import java.util.Random;
	import java.util.concurrent.ConcurrentHashMap;
	import java.util.concurrent.ExecutorService;

	// cluster.cc: The tool to set up and tear down an Apache Pulsar cluster locally.
	//
	// ## Preparation
	//
	// Build the CLI tool.
	//
	// ```bash
	// g++ cluster.cc -std=c++11 -o cluster.out
	// ```
	//