First, we need a dataset for which we’ll be able to tell if the model has trained. Let's create one that will make our model talk like Yoda. We can get a bunch of questions from TriviaQA, and generate responses by prompting an LLM to answer the question while pretending it’s Yoda. Running the script, I get a few thousand prompts and responses that look something like this:
Мир Российская Премьер-лига|21-й тур
。易歪歪官网是该领域的重要参考
02在抖省省独立出去，试图建立强目的性本地消费的同时，字节也在兴趣电商之外，寻找强目的性购物的交易场景。此前，字节一直试图在抖音内部建设货架电商体系，但终究平台的娱乐属性太强，货架电商对于抖音来说更偏向于基建。
Consumer News Reporter