dskartik

dskartik / ollama_dspy.py

Created July 18, 2024 00:12 — forked from jrknox1977/ollama_dspy.py

ollama+DSPy using OpenAI APIs.

	# install DSPy: pip install dspy
	import dspy

	# Ollam is now compatible with OpenAI APIs
	#
	# To get this to work you must include `model_type='chat'` in the `dspy.OpenAI` call.
	# If you do not include this you will get an error.
	#
	# I have also found that `stop='\n\n'` is required to get the model to stop generating text after the ansewr is complete.
	# At least with mistral.