Tag: data-engineering
All the articles with the tag "data-engineering".
-
Fine-tuning Qwen2.5-1.5B for function calling with QLoRA: the dataset didn't match the format I needed (Part 2)
Choosing a function-calling dataset turned out to be the easy part. Converting it into a format Qwen's chat template actually accepts, and getting loss masking right, took most of the work.