Automated End-to-End Fine-Tuning of OpenAI Models with Google Drive Integration
-
How it Works
This n8n workflow automates fine-tuning OpenAI models through these key steps:
Manual Trigger**:
Starts with the "When clicking ‘Test workflow’" event to initiate the process.
Downloads a .jsonl file from Google Drive
Upload to OpenAI**:
Uploads the .jsonl file to OpenAI via the "Upload File" node (with purpose "fine-tune").
Create Fine-tuning Job**:
Sends a POST request to the endpoint https://api.openai.com/v1/fine_tuning/jobs with:
{
"training_file": "{{ $json.id }}",
"model": "gpt-4o-mini-2024-07-18"
}
OpenAI automatically starts training the model based on the provided file.
Interaction with the Trained Model**:
An "AI Agent" uses the custom model (e.g., ft:gpt-4o-mini-2024-07-18:n3w-italia::XXXX7B) to respond to chat messages. -
Set up Steps
To configure the workflow:
Prepare the Training File:
Create a .jsonl file following the specified syntax (e.g., travel assistant Q/A examples).
Upload it to Google Drive and update the ID in the "Google Drive" node.
Configure Credentials:
Google Drive: Connect an account via OAuth2 (googleDriveOAuth2Api).
OpenAI: Add your API key in the "OpenAI Chat Model" and "Upload File" nodes.
Customize the Model:
In the "OpenAI Chat Model" node, specify the name of your fine-tuned model (e.g., ft:gpt-4o-mini-...).
Update the HTTP request body (Create Fine-tuning Job) if needed (e.g., a different base model).
Start the Workflow:
Use the manual trigger ("Test workflow") to begin the upload and training process.
Test the model via the "Chat Trigger" (chat messages).
Integrated Documentation:
Follow the instructions in the Sticky Notes to:
Properly format the .jsonl (Step 1).
Monitor progress on OpenAI (Step 2, link: https://platform.openai.com/finetune/).
Note: Ensure the .jsonl file adheres to OpenAI’s required structure and that credentials are valid.
Related Templates
AI Weather Forecasts with MCP Integration
Real-time Weather Forecasts with MCP Tools This n8n workflow demonstrates how to integrate real-time weather intelligen...
Google Sheets UI for n8n Workflow
Google Sheets UI for Workflow Control This n8n template provides a practical and efficient way to manage your n8n workf...
Demo Workflow - How to use workflowStaticData()
This workflow demonstrates how to use the workflowStaticData() function to set any type of variable that will persist wi...
🔒 Please log in to import templates to n8n and favorite templates
Workflow Visualization
Loading...
Preparing workflow renderer
Comments (0)
Login to post comments