Results of the summarizing process for the arXiv paper: 2102.04199v2

Deep learning compiler frameworks are becoming increasingly popular as a more portable back-end for deep learning applications on diverse hardware. They offer the potential to match the performance of hand-tuned target-specific libraries while reducing overhead costs associated with auto-tuning frameworks. To address this issue, a new paper proposes MetaTune: a meta-learning based cost model that quickly and accurately predicts the performance of optimized codes with pre-trained model parameters. MetaTune encodes convolution kernel codes as structurally similar graphs to facilitate meta-learning and then meta-trains a GNN model with a very small input data set. This enables it to predict optimization parameters for unseen convolution operations with varying sizes and structures during compilation. The resulting framework provides 8 to 13% better inference time on average for four CNN models with comparable or lower optimization time while outperforming transfer learning by 10% in cross-platform cases. The accuracy of the cost model is essential in locating ideal optimization parameters; many auto-tuning frameworks including TVM adopt machine-learning based cost models that can dynamically adapt to search results. In TVM, the combination of parameters called knobs determines optimal performance predicted by f which is updated based on hardware measurements. The key insight behind MetaTune is that f can be pre-conditioned with randomly sampled points in a small number of similar optimization spaces so that it can quickly adapt to f∗, target cost model function. Overall, MetaTune offers an efficient solution to optimize deep learning applications across different hardware platforms without sacrificing performance or increasing overhead costs associated with auto-tuning frameworks.

• - Deep learning compiler frameworks are becoming more popular for deep learning applications on diverse hardware
• - They can match the performance of target-specific libraries while reducing overhead costs
• - MetaTune is a new paper proposing a meta-learning based cost model that predicts performance of optimized codes with pre-trained model parameters
• - MetaTune encodes convolution kernel codes as structurally similar graphs to facilitate meta-learning and then meta-trains a GNN model with a small input data set
• - The resulting framework provides 8 to 13% better inference time on average for four CNN models with comparable or lower optimization time while outperforming transfer learning by 10% in cross-platform cases
• - Accuracy of the cost model is essential in locating ideal optimization parameters; many auto-tuning frameworks adopt machine-learning based cost models that can dynamically adapt to search results
• - MetaTune offers an efficient solution to optimize deep learning applications across different hardware platforms without sacrificing performance or increasing overhead costs associated with auto-tuning frameworks.

Deep learning is a type of computer program that can learn and make decisions on its own. A compiler is a tool that helps turn code into a program that can run on different devices. MetaTune is a new way to make deep learning programs run faster and better on different devices. It uses graphs and machine learning to figure out the best way to make the program work well. This makes it easier for people to use deep learning on different devices without having to spend too much time or money making it work right. Definitions - Deep learning: A type of computer program that can learn and make decisions on its own. - Compiler: A tool that helps turn code into a program that can run on different devices. - MetaTune: A new way to make deep learning programs run faster and better on different devices. - Graphs: Visual representations of data or information in the form of diagrams or charts. - Machine learning: A type of artificial intelligence where computers learn from data and improve their performance over time.

MetaTune: A Meta-Learning Based Cost Model for Optimizing Deep Learning Applications

Deep learning compiler frameworks are becoming increasingly popular as a more portable back-end for deep learning applications on diverse hardware. They offer the potential to match the performance of hand-tuned target-specific libraries while reducing overhead costs associated with auto-tuning frameworks. To address this issue, a new paper proposes MetaTune: a meta-learning based cost model that quickly and accurately predicts the performance of optimized codes with pre-trained model parameters.

Encoding Convolution Kernels as Structurally Similar Graphs

MetaTune encodes convolution kernel codes as structurally similar graphs to facilitate meta-learning and then meta-trains a GNN model with a very small input data set. This enables it to predict optimization parameters for unseen convolution operations with varying sizes and structures during compilation.

Performance Benefits of MetaTune

The resulting framework provides 8 to 13% better inference time on average for four CNN models with comparable or lower optimization time while outperforming transfer learning by 10% in cross-platform cases. The accuracy of the cost model is essential in locating ideal optimization parameters; many auto-tuning frameworks including TVM adopt machine-learning based cost models that can dynamically adapt to search results.

Adaptive Cost Model Function in TVM

In TVM, the combination of parameters called knobs determines optimal performance predicted by f which is updated based on hardware measurements. The key insight behind MetaTune is that f can be pre-conditioned with randomly sampled points in a small number of similar optimization spaces so that it can quickly adapt to f∗, target cost model function.

Conclusion

Overall, MetaTune offers an efficient solution to optimize deep learning applications across different hardware platforms without sacrificing performance or increasing overhead costs associated with auto-tuning frameworks. It provides improved inference times compared to other methods such as transfer learning while also being able to rapidly adapt its predictions when presented with new inputs due its pre trained GNN model and structurally similar graph encoding technique.