Results of the summarizing process for the arXiv paper: 2311.10075v1

Enhanced health literacy has been associated with improved health outcomes. However, there is a lack of interventions studied in this area. This study explores the potential of large language models (LLMs) to enhance health literacy in children and other populations. A total of 288 conditions were tested using 26 different prompts through ChatGPT-3.5, Microsoft Bing, and Google Bard. Due to rate limits, a subset of 150 conditions was further tested through ChatGPT-4. The primary outcome measurements focused on the reading grade level (RGL) and word counts of the output generated by the LLMs. Results showed that basic prompts like "Explain" and "What is (are)" produced outputs at or above a 10th-grade RGL across all models. When prompts specified explaining conditions from the 1st to 12th RGL, LLMs demonstrated varying abilities to tailor responses based on RGL. ChatGPT-3.5 and ChatGPT-4 performed better in achieving lower-grade level outputs compared to Bing and Bard, which tended to consistently produce outputs at a high school level regardless of the prompt. Additionally, Bard exhibited hesitancy in providing certain outputs, indicating a cautious approach towards health information dissemination. While LLMs show promise in enhancing health communication, future research should focus on verifying their accuracy and effectiveness in improving health literacy. Despite challenges in crafting outputs below a sixth-grade reading level, LLMs have shown potential in modifying outputs above this threshold to enhance health literacy and communication among pediatric populations and beyond. The study compiled a comprehensive list of 288 childhood disorders from reputable sources like Johns Hopkins Children's Center and Seattle Children's Hospital for testing purposes. Prompt selection included simple queries as well as context-based prompts tailored for different grade levels to assess the LLMs' ability to communicate complex medical information effectively. To ensure standardized comparison, formatting was removed from outputs, ancillary information was excluded, and readability assessments were conducted using Gunning Fog and Flesch readability formulas. Overall, this study highlights the potential of LLMs in improving health literacy but underscores the need for further research to optimize their use in healthcare communication settings.

• - Enhanced health literacy linked to improved health outcomes
• - Study explores using large language models (LLMs) to enhance health literacy in children and other populations
• - Testing involved 288 conditions with 26 prompts using ChatGPT-3.5, Bing, and Google Bard; subset of 150 conditions further tested with ChatGPT-4 due to rate limits
• - Primary outcome measurements focused on reading grade level (RGL) and word counts of LLM-generated output
• - Basic prompts like "Explain" and "What is (are)" produced outputs at or above a 10th-grade RGL across all models
• - LLMs varied in tailoring responses based on RGL when prompted to explain conditions from the 1st to 12th grade levels
• - ChatGPT-3.5 and ChatGPT-4 performed better at achieving lower-grade level outputs compared to Bing and Bard
• - Bard exhibited hesitancy in providing certain outputs, showing caution in health information dissemination
• - Future research should verify accuracy and effectiveness of LLMs in improving health literacy
• - Despite challenges in crafting outputs below a sixth-grade reading level, LLMs show potential in modifying higher-level outputs for enhanced communication among pediatric populations and beyond

Summary- Knowing more about staying healthy helps people stay well. - Scientists are studying how to use big talking computers to help kids and others learn about being healthy. - They tested this by asking the computers questions about 288 different health topics using special programs like ChatGPT-3.5, Bing, and Google Bard. - The main things they looked at were how easy it was to read the computer's answers and how many words they used. - The computers did a good job explaining things in simple words, especially when asked basic questions. Definitions1. Health literacy: Understanding information about staying healthy. 2. Large language models (LLMs): Big talking computers that can help explain things using lots of words. 3. Prompts: Questions or requests for information given to the computers. 4. Reading grade level (RGL): How hard or easy it is to understand written text based on school grade levels. 5. Outputs: Answers or information provided by the computers in response to questions or prompts.

Introduction: Health literacy is a crucial aspect of overall health and well-being. It refers to an individual's ability to obtain, understand, and use health information to make informed decisions about their health (1). Research has shown that individuals with higher levels of health literacy have better health outcomes, including improved disease management and prevention (2). However, there is a lack of interventions studied in this area. This research paper explores the potential of large language models (LLMs) in enhancing health literacy in children and other populations. Methodology: The study used three different LLMs - ChatGPT-3.5, Microsoft Bing, and Google Bard - to generate responses for 288 conditions from reputable sources like Johns Hopkins Children's Center and Seattle Children's Hospital. These conditions were selected based on their prevalence among pediatric populations. The prompts used for generating responses included simple queries as well as context-based prompts tailored for different grade levels. Results: The primary outcome measurements focused on the reading grade level (RGL) and word counts of the output generated by the LLMs. Results showed that basic prompts like "Explain" and "What is (are)" produced outputs at or above a 10th-grade RGL across all models. When prompts specified explaining conditions from the 1st to 12th RGL, LLMs demonstrated varying abilities to tailor responses based on RGL. ChatGPT-3.5 and ChatGPT-4 performed better in achieving lower-grade level outputs compared to Bing and Bard, which tended to consistently produce outputs at a high school level regardless of the prompt. Additionally, Bard exhibited hesitancy in providing certain outputs, indicating a cautious approach towards health information dissemination. Discussion: The results suggest that while LLMs show promise in enhancing health communication, there are limitations that need further investigation. One such limitation is crafting outputs below a sixth-grade reading level; however, LLMs have shown potential in modifying outputs above this threshold to enhance health literacy and communication among pediatric populations and beyond. Future research should focus on verifying the accuracy and effectiveness of LLMs in improving health literacy. This could involve comparing the responses generated by LLMs with those provided by healthcare professionals or conducting studies to assess the impact of using LLMs on individuals' health literacy levels. Conclusion: In conclusion, this study highlights the potential of LLMs in enhancing health literacy but underscores the need for further research to optimize their use in healthcare communication settings. The study's findings provide valuable insights into how different prompts can influence the output generated by LLMs and highlight areas for improvement. With continued advancements in technology, LLMs have the potential to revolutionize healthcare communication and improve health outcomes for individuals across all age groups.