Skip to content

Instantly share code, notes, and snippets.

@rogarcia

rogarcia/cc-proxy.sh

Forked from olafgeibig/cc-proxy.sh
Created August 1, 2025 21:44
Show Gist options
  • Save rogarcia/c198536df4de92aa3e1b981919b414be to your computer and use it in GitHub Desktop.
Save rogarcia/c198536df4de92aa3e1b981919b414be to your computer and use it in GitHub Desktop.
Download ZIP

Revisions

  1. @olafgeibig olafgeibig revised this gist Jul 28, 2025. No changes.
  2. @olafgeibig olafgeibig revised this gist Jul 28, 2025. No changes.
  3. @olafgeibig olafgeibig revised this gist Jul 28, 2025. No changes.
  4. @olafgeibig olafgeibig revised this gist Jul 28, 2025. 3 changed files with 2 additions and 1 deletion.
    2 changes: 1 addition & 1 deletion cc-proxy.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -2,4 +2,4 @@
    export WANDB_API_KEY=<your key>
    export WANDB_PROJECT=<org/project>

    litellm --port 4000 --debug --config claude-proxy.yaml
    litellm --port 4000 --debug --config cc-proxy.yaml
    0 cc_proxy.yaml → cc-proxy.yaml
    View file
    File renamed without changes.
    1 change: 1 addition & 0 deletions code-wandb.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -3,4 +3,5 @@ export ANTHROPIC_AUTH_TOKEN=sk-1234
    export ANTHROPIC_BASE_URL=http://localhost:4000
    export CLAUDE_CODE_DISABLE_NONESSENTIAL_TRAFFIC=1

    # Startin VS Code, but could also run claude here
    code &
  5. @olafgeibig olafgeibig created this gist Jul 28, 2025.
    5 changes: 5 additions & 0 deletions cc-proxy.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,5 @@
    #!/bin/bash
    export WANDB_API_KEY=<your key>
    export WANDB_PROJECT=<org/project>

    litellm --port 4000 --debug --config claude-proxy.yaml
    55 changes: 55 additions & 0 deletions cc_proxy.yaml
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,55 @@
    litellm_settings:
    drop_params: true
    cache: True
    cache_params:
    type: local
    enable_preview_features: True

    model_list:

    - model_name: anthropic/claude-sonnet-*
    litellm_params:
    model: openai/Qwen/Qwen3-Coder-480B-A35B-Instruct
    api_key: "os.environ/WANDB_API_KEY"
    api_base: https://api.inference.wandb.ai/v1
    headers:
    OpenAI-Project: "os.environ/WANDB_PROJECT"
    max_tokens: 65536
    repetition_penalty: 1.05
    temperature: 0.7
    top_k: 20
    top_p: 0.8
    model_info:
    input_cost_per_token: 0.000001
    output_cost_per_token: 0.0000015

    - model_name: anthropic/claude-opus-*
    litellm_params:
    model: openai/Qwen/Qwen3-235B-A22B-Thinking-2507
    api_key: "os.environ/WANDB_API_KEY"
    api_base: https://api.inference.wandb.ai/v1
    headers:
    OpenAI-Project: "os.environ/WANDB_PROJECT"
    max_tokens: 65536
    repetition_penalty: 1.05
    temperature: 0.6
    top_k: 40
    top_p: 0.95
    model_info:
    input_cost_per_token: 0.0000001
    output_cost_per_token: 0.0000001

    - model_name: anthropic/claude-3-5-haiku-*
    litellm_params:
    model: openai/Qwen/Qwen3-235B-A22B-Instruct-2507
    api_key: "os.environ/WANDB_API_KEY"
    api_base: https://api.inference.wandb.ai/v1
    max_tokens: 65536
    repetition_penalty: 1.05
    temperature: 0.7
    top_k: 20
    top_p: 0.8
    headers:
    OpenAI-Project: "os.environ/WANDB_PROJECT"
    input_cost_per_token: 0.0000001
    output_cost_per_token: 0.0000001
    6 changes: 6 additions & 0 deletions code-wandb.sh
    View file
    Original file line number Diff line number Diff line change
    @@ -0,0 +1,6 @@
    #!/bin/bash
    export ANTHROPIC_AUTH_TOKEN=sk-1234
    export ANTHROPIC_BASE_URL=http://localhost:4000
    export CLAUDE_CODE_DISABLE_NONESSENTIAL_TRAFFIC=1

    code &