Hosted on MSN10mon
Microsoft's new lightweight AI rivals GPT-3.5 — it's learning from children's books and fits on phones
Microsoft's Phi-3 Mini model was taught using children's books Phi-3 Mini is a 3.8 billion ... It can't compete with GPT-4 or other LLMs that are often trained using a large portion of the ...
Business Insider10mon
OpenAI destroyed a trove of books used to train AI models. The employees who collected the data are gone.
In a 2020 white paper, OpenAI described the "books1" and "books2" datasets as "internet-based books corpora" and said they made up 16% of the training data that went into creating GPT-3.