OpenAI

How to configure and use it?

Supported Parameters

  • openai_api_key (str) - Set an OpenAI key for running the OpenAI Model. (required)

  • model_name (str) - Set which model of the OpenAI model you want to use. Defaults to gpt-3.5-turbo-16k

  • temperature (float) - The sampling temperature for text generation. Defaults to 0.

  • model_kwargs (Dict[str, Any]): Additional model parameters. (optional)

  • openai_api_base (Optional[str]): The base URL path for API requests (optional).

  • openai_organization (Optional[str]): The organization identifier (optional).

  • openai_proxy (Optional[str]): Proxy configuration for OpenAI (optional).

  • request_timeout (Optional[Union[float, Tuple[float, float]]]): Timeout for API requests (optional).

  • max_retries (int): Maximum number of retries for text generation. Defaults to 6. (optional)

  • streaming (bool): Whether to stream results. Defaults to False

  • n (int): Number of chat completions to generate for each prompt. Defaults to 1.

  • max_tokens (Optional[int]): Maximum number of tokens in the generated response (optional).

  • tiktoken_model_name (Optional[str]): Model name for token counting (optional).

Running in a Colab/Kaggle/Python scripts(s)

from genai_stack.model import OpenAIGpt35Model
from genai_stack.stack.stack import Stack

llm = OpenAIGpt35Model.from_kwargs(
    parameters={"openai_api_key": "sk-xxxx"} # Update with your OpenAI Key
) 
Stack(model=llm)  # Initialize stack
model_response = llm.predict("How long AI has been around.")
print(model_response["output"])

  1. Import the model from genai_stack.model

  2. Instantiate the class with openai_api_key

  3. Call .predict() method and pass the query you want the model to answer to.

  4. Print the response. As the response is a dictionary, get the output only.

    • The response on predict() from the model includes output.

PreviousLLMsNextGPT4All

Last updated