Chapter 8, Fine-Tuning OpenAI GPT Models
- It is useless to fine-tune an OpenAI model. (True/False)
True and false.
True because, sometimes, a pretrained standard model can be effective with good prompts.
False because, sometimes, fine-tuning is necessary to adapt a model to the tasks required.
Ultimately, fine-tuning or not remains a careful choice to make.
- Any pretrained OpenAI model can do the task we need without fine-tuning. (True/False)
False. We first need to evaluate a model and then make a decision.
- We don’t need to prepare a dataset to fine-tune an OpenAI model. (True/False)
False. Dataset preparation is a crucial aspect of fine-tuning. Transformer models, like most machine learning models, are data-driven.
- We don’t need one if no datasets are available on the web (follow-up question for question 3). (True/False)
False. A reliable dataset is a prerequisite to performing fine...
