KerasCV and KerasNLP: Vision and Language Power-Ups

AI-generated keywords: KerasCV KerasNLP Computer Vision Natural Language Processing Machine Learning

AI-generated Key Points

  • The ` and ` packages are extensions of the popular Keras API designed for and
  • They offer versatility by running on multiple frameworks such as JAX, TensorFlow, and PyTorch
  • Domain packages prioritize ease-of-use and performance to facilitate fast experimentation in their respective fields
  • Modular and layered design provides building blocks for model creation and data preprocessing at the lowest level of abstraction
  • Users can access pretrained "task" models for popular architectures like Stable Diffusion, YOLOv8, GPT2, BERT, Mistral, CLIP, Gemma, T5 and more
  • Task models come with built-in preprocessing capabilities and weights for quick deployment in various tasks
  • Both packages support XLA compilation for all models to ensure efficient training processes
  • Preprocessing tasks are handled through a compiled graph of TensorFlow operations using the tf.data API to streamline data processing workflows
  • Libraries are fully open-source under the Apache 2.0 license and available on GitHub for developers to explore and utilize in their projects
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Matthew Watson, Divyashree Shivakumar Sreepathihalli, Francois Chollet, Martin Gorner, Kiranbir Sodhia, Ramesh Sampath, Tirth Patel, Haifeng Jin, Neel Kovelamudi, Gabriel Rasskin, Samaneh Saadat, Luke Wood, Chen Qian, Jonathan Bischof, Ian Stenbit

Submitted to Journal of Machine Learning Open Source Software
License: CC BY 4.0

Abstract: We present the Keras domain packages KerasCV and KerasNLP, extensions of the Keras API for Computer Vision and Natural Language Processing workflows, capable of running on either JAX, TensorFlow, or PyTorch. These domain packages are designed to enable fast experimentation, with a focus on ease-of-use and performance. We adopt a modular, layered design: at the library's lowest level of abstraction, we provide building blocks for creating models and data preprocessing pipelines, and at the library's highest level of abstraction, we provide pretrained ``task" models for popular architectures such as Stable Diffusion, YOLOv8, GPT2, BERT, Mistral, CLIP, Gemma, T5, etc. Task models have built-in preprocessing, pretrained weights, and can be fine-tuned on raw inputs. To enable efficient training, we support XLA compilation for all models, and run all preprocessing via a compiled graph of TensorFlow operations using the tf.data API. The libraries are fully open-source (Apache 2.0 license) and available on GitHub.

Submitted to arXiv on 30 May. 2024

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2405.20247v1

The and packages are extensions of the popular Keras API designed for and . They offer versatility by running on multiple frameworks such as JAX, TensorFlow, and PyTorch. These domain packages prioritize ease-of-use and performance to facilitate fast experimentation in their respective fields. One key feature is their modular and layered design, providing building blocks for model creation and data preprocessing at the lowest level of abstraction. At the highest level, users can access pretrained "task" models for popular architectures like Stable Diffusion, YOLOv8, GPT2, BERT, Mistral, CLIP, Gemma, T5 and more. These task models come with built-in preprocessing capabilities and weights for quick deployment in various tasks. To ensure efficient training processes, both packages support XLA compilation for all models. Additionally,<KD/> all preprocessing tasks are handled through a compiled graph of TensorFlow operations using the tf.data API to streamline data processing workflows. It's worth noting that these libraries are fully open-source under the Apache 2.0 license and available on GitHub for developers to explore and utilize in their projects.
Created on 31 May. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.