proof of concept for a transformer-based time series prediction model
This repository contains two Pytorch models for transformer-based time series prediction. Note that this is just a proof of concept and most likely not bug free nor particularly efficient.
This is the output of a single step prediction model that has been trained for 100 epochs on the daily minimum temperature dataset.
The model is also capable of multi-step predictions. In this case, the model predicted 200 steps based on 100 steps input. It was able to learn long term trend from the training data:
(input blue, prediction red)