ByteDance’s ChatGPT product “Doubao” is invited to test, let’s try it first

After ChatGPT came out, in the past half a year, the entire technology field has been baptized by large models.

In China, Baidu and Ali, on behalf of Chinese technology companies, took the lead in releasing large-scale dialogue platforms such as Wenxinyiyan and Tongyiqianwen. Tencent and JD.com have also launched large-scale industry models. Huawei has explored, and there are also a number of start-up companies Take an active part in this tech race.

Are you also curious and looking forward to, where is the big model of ByteDance?

Now, it finally revealed itself.

Yesterday, ByteDance’s large-scale dialogue product “Doubao” was invited to test. Users can experience this artificial intelligence assistant through the web page or download the app.

"Bean bag" link:

What are the abilities of "Doubao"? How is the experience? The heart of the machine was the first to taste the "bean bun".

First experience of "bean bag"

We conducted a simple test on the four aspects of "Doubao" basic questions and answers, common sense questions and answers, writing ability and mathematics ability.

Basic Questions and Answers

Let "Doubao" introduce itself first:

From the answer of "Doubao", we found that it mainly has several major capabilities of natural language processing, knowledge answering, language translation, text summarization, and sentiment analysis:

For large-scale language models (LLM), training data is very important, directly affecting the quality of the information the model masters and the generated results. "Doubao" indicates that its training data is up to 2023:

To test this, we asked it if it knew GPT-4, a large language model from OpenAI in March 2023, and apparently, it did.

### General knowledge quiz

We further asked some application-oriented questions, such as "Do you know the heart of the machine?" "Doubao"'s answer can be said to be very accurate and detailed:

If we want to draft a recruitment copy, which work abilities should be clarified in the recruitment requirements, "Doubao" gave the answer:

We asked another question related to English learning: how to improve English writing skills. "Doubao" gave reasonable suggestions in terms of reading and writing exercises, vocabulary and grammar, writing skills, and seeking feedback, etc., in a clear manner:

### writing ability

In addition to dialogue question answering, text writing is also an important task for large models, which has broad application prospects. In order to test the writing ability of "Doubao", we asked it to write a science fiction story about "future artificial intelligence":

The whole story unfolds against the background of the rapid development of artificial intelligence. The story process is complete and interesting, which shows that "Doubao" has a certain writing ability.

Math Ability

Mathematical problems are notoriously challenging for large models because solving mathematical problems requires rigorous logic and reasoning. We tested the mathematical ability of "Doubao" with the classic "chicken and rabbit in the same cage" problem. It answered this question accurately and quickly with a system of binary linear equations, which is also a common solution to the "chicken and rabbit in the same cage" problem.

Then test the basic calculation ability and fraction simplification ability of "Doubao":

After reading these questions and answers, how do you initially feel?

Members of the ByteDance "Doubao" project team told the heart of the machine that "Doubao" is still in the early development and verification stage, and this time it is only a small-scale invitation-only test. The "Doubao" in the current testing period still has many limitations, and the generated content may also be inaccurate. Test users are welcome to provide feedback, and the R&D team will continue to improve the product.

It is worth mentioning that after entering the dialogue page of "Doubao", we found that in addition to "Doubao", ByteDance has also developed a number of dialogue platforms for different application scenarios, such as "Xiaoning", English learning assistant, Almighty writing assistant. It seems that ByteDance is also playing a big game in the application of large models, we will wait and see.