Greg Kisel rbctmz
rbctmz
/ sgr_assistant.py
Created
August 25, 2025 12:31
— forked from sb-static/sgr_assistant.py
SGR Demo - assistant based on small LLM (Qwen3-4B) using llama.cpp and Schema-Guided Reasoning (SGR)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| This Python code demonstrates Schema-Guided Reasoning (SGR) with llama.cpp and small model - Qwen3-4B Q8_0. It: | |
| - implements a business agent capable of planning and reasoning | |
| - implements tool calling using only SGR and simple dispatch | |
| - uses with a simple (inexpensive) non-reasoning model for that | |
| This demo is modified from https://abdullin.com/schema-guided-reasoning/demo to support local llm | |
| Test model: Qwen3-4B-Instruct-2507-Q8_0 (https://huggingface.co/unsloth/Qwen3-4B-Instruct-2507-GGUF/resolve/main/Qwen3-4B-Instruct-2507-Q8_0.gguf) |
rbctmz
/ schema-guided-reasoning.py
Created
August 25, 2025 09:31
— forked from abdullin/schema-guided-reasoning.py
Demo for a Schema-Guided Reasoning (Business Assistant)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| This Python code demonstrates Schema-Guided Reasoning (SGR) with OpenAI. It: | |
| - implements a business agent capable of planning and reasoning | |
| - implements tool calling using only SGR and simple dispatch | |
| - uses with a simple (inexpensive) non-reasoning model for that | |
| To give this agent something to work with, we ask it to help with running | |
| a small business - selling courses to help to achieve AGI faster. |
rbctmz
/ llm_sgr_agent.py
Created
August 25, 2025 09:30
— forked from MisreadableMind/llm_sgr_agent.py
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """ | |
| Schema-Guided Reasoning (SGR) Demo with OpenAI | |
| This Python code demonstrates Schema-Guided Reasoning (SGR) with OpenAI. It: | |
| - Implements a business agent capable of planning and reasoning | |
| - Implements tool calling using only SGR and simple dispatch | |
| - Uses a simple (inexpensive) non-reasoning model for that | |
| To give this agent something to work with, we ask it to help with running | |
| a small business - selling courses to help achieve AGI faster. |