Results of the summarizing process for the arXiv paper: 2307.09705v1

The rapid advancement of large language models (LLMs) has raised concerns about potential risks and negative social impacts. As a result, evaluating the alignment of LLMs with human values has become increasingly important. However, previous research has primarily focused on assessing LLMs' performance in terms of knowledge and reasoning abilities, neglecting their alignment with human values, particularly in the Chinese context. To address this gap, this paper introduces CValues, the first Chinese human values evaluation benchmark. CValues aims to measure the alignment ability of Chinese LLMs in terms of both safety and responsibility criteria. The researchers manually collected adversarial safety prompts across 10 scenarios and induced responsibility prompts from 8 domains with the help of professional experts. To provide a comprehensive evaluation of Chinese LLMs' values alignment, the study employs both human evaluation for reliable comparison and constructs multi-choice prompts for automatic evaluation. The findings indicate that while most Chinese LLMs perform well in terms of safety, there is still significant room for improvement regarding responsibility. The study highlights the importance of both automatic and human evaluations in assessing the alignment between LLMs and human values across different aspects. The CValues benchmark and code are available on ModelScope and Github platforms. In summary, this research presents an essential contribution to evaluating the values alignment of Chinese LLMs by introducing CValues as a benchmark. By focusing on safety and responsibility criteria, it sheds light on areas where improvements can be made to enhance their alignment with human values.

• - Rapid advancement of large language models (LLMs) raises concerns about potential risks and negative social impacts
• - Evaluating the alignment of LLMs with human values is increasingly important
• - Previous research has primarily focused on knowledge and reasoning abilities, neglecting alignment with human values in the Chinese context
• - CValues is introduced as the first Chinese human values evaluation benchmark for LLMs
• - CValues measures alignment ability in terms of safety and responsibility criteria
• - Adversarial safety prompts were manually collected across 10 scenarios, responsibility prompts were induced from 8 domains with professional experts' help
• - Human evaluation and multi-choice prompts are used for comprehensive evaluation of Chinese LLMs' values alignment
• - Most Chinese LLMs perform well in terms of safety but need improvement regarding responsibility
• - Automatic and human evaluations are both important in assessing alignment between LLMs and human values
• - CValues benchmark and code are available on ModelScope and Github platforms.

Key Points1. Language models are getting better at understanding and using language, but this can have some problems. 2. It's important to check if these models understand and follow human values. 3. Previous research on this topic has focused more on knowledge and reasoning, not values in the Chinese context. 4. CValues is a way to test how well Chinese language models align with human values. 5. CValues looks at safety and responsibility to see if the models are doing a good job. Definitions- Language Models: Programs that can understand and use language like humans do. - Alignment: Making sure something matches or fits well with something else. - Human Values: The things that people believe are important or right, like being kind or fair. - Benchmark: A standard or test used to compare things and see how well they perform. - Criteria: The standards or rules used to judge or evaluate something. - Evaluation: Checking how good or effective something is by looking at different aspects of it.

Evaluating the Alignment of Chinese Language Models with Human Values

The rapid advancement of large language models (LLMs) has raised concerns about potential risks and negative social impacts. As a result, evaluating the alignment of LLMs with human values has become increasingly important. However, previous research has primarily focused on assessing LLMs' performance in terms of knowledge and reasoning abilities, neglecting their alignment with human values, particularly in the Chinese context. To address this gap, researchers have introduced CValues as the first Chinese human values evaluation benchmark to measure the alignment ability of Chinese LLMs in terms of both safety and responsibility criteria.

Introducing CValues

CValues is an evaluation benchmark that was manually created by researchers to assess the alignment between Chinese LLMs and human values across different aspects. The benchmark consists of adversarial safety prompts across 10 scenarios and responsibility prompts from 8 domains which were induced with help from professional experts. In order to provide a comprehensive evaluation of Chinese LLMs' values alignment, both automatic evaluations using multi-choice prompts and manual evaluations were employed for reliable comparison.

Findings

The findings indicate that while most Chinese LLMs perform well in terms of safety, there is still significant room for improvement regarding responsibility. This highlights the importance of both automatic and human evaluations when assessing how well these models align with human values across different aspects. The CValues benchmark code is available on ModelScope and Github platforms for further use by other researchers or developers interested in measuring their model's value alignment capabilities against those used in this study.

Conclusion

In summary, this research presents an essential contribution to evaluating the values alignment of Chinese LLMs by introducing CValues as a benchmark which focuses on safety and responsibility criteria to shed light on areas where improvements can be made to enhance their alignment with human values.