ShareGPT Builder
SFT
DPO
ShareGPT Builder
System:
User:
GPT:
Add Turn
DPO Builder
System:
Prompt:
Chosen:
Rejected: