Automated End-to-End Fine-Tuning of OpenAI Models with Google Drive Integration
-
How it Works
This n8n workflow automates fine-tuning OpenAI models through these key steps:
Manual Trigger**:
Starts with the "When clicking ‘Test workflow’" event to initiate the process.
Downloads a .jsonl file from Google Drive
Upload to OpenAI**:
Uploads the .jsonl file to OpenAI via the "Upload File" node (with purpose "fine-tune").
Create Fine-tuning Job**:
Sends a POST request to the endpoint https://api.openai.com/v1/fine_tuning/jobs with:
{
"training_file": "{{ $json.id }}",
"model": "gpt-4o-mini-2024-07-18"
}
OpenAI automatically starts training the model based on the provided file.
Interaction with the Trained Model**:
An "AI Agent" uses the custom model (e.g., ft:gpt-4o-mini-2024-07-18:n3w-italia::XXXX7B) to respond to chat messages. -
Set up Steps
To configure the workflow:
Prepare the Training File:
Create a .jsonl file following the specified syntax (e.g., travel assistant Q/A examples).
Upload it to Google Drive and update the ID in the "Google Drive" node.
Configure Credentials:
Google Drive: Connect an account via OAuth2 (googleDriveOAuth2Api).
OpenAI: Add your API key in the "OpenAI Chat Model" and "Upload File" nodes.
Customize the Model:
In the "OpenAI Chat Model" node, specify the name of your fine-tuned model (e.g., ft:gpt-4o-mini-...).
Update the HTTP request body (Create Fine-tuning Job) if needed (e.g., a different base model).
Start the Workflow:
Use the manual trigger ("Test workflow") to begin the upload and training process.
Test the model via the "Chat Trigger" (chat messages).
Integrated Documentation:
Follow the instructions in the Sticky Notes to:
Properly format the .jsonl (Step 1).
Monitor progress on OpenAI (Step 2, link: https://platform.openai.com/finetune/).
Note: Ensure the .jsonl file adheres to OpenAI’s required structure and that credentials are valid.
Related Templates
Demo Workflow - How to use workflowStaticData()
This workflow demonstrates how to use the workflowStaticData() function to set any type of variable that will persist wi...
Bulk Automated Google Drive Files Sharing and Direct Download Link Generation
This N8N workflow automates the process of sharing files from Google Drive. It includes OAuth2 authentication, batch pro...
USDT And TRC20 Wallet Tracker API Workflow for n8n
Overview This n8n workflow is specifically designed to monitor USDT TRC20 transactions within a specified wallet. It u...
🔒 Please log in to import templates to n8n and favorite templates
Workflow Visualization
Loading...
Preparing workflow renderer
Comments (0)
Login to post comments