Overview
Dynamic Graph Benchmark: Towards Better Evaluation for Dynamic Link Prediction
- All dynamic graph datasets can be downloaded from here.
- The code repo can be downloaded from here.
- An accompanying blog post can be found here.
Introduction
Despite the prevalence of recent success in learning from static graphs, learning from time-evolving graphs remains an open challenge. In this work, we design new, more stringent evaluation procedures for link prediction specific to dynamic graphs, which reflect real-world considerations, to better compare the strengths and weaknesses of methods. First, we create two visualization techniques to understand the reoccurring patterns of edges over time and show that many edges reoccur at later time steps. Based on this observation, we propose a pure memorization baseline called EdgeBank. EdgeBank achieves surprisingly strong performance across multiple settings because easy negative edges are often used in current evaluation setting. To evaluate against more difficult negative edges, we introduce two more challenging negative sampling strategies that improve robustness and better match real-world applications. Lastly, we introduce six new dynamic graph datasets from a diverse set of domains missing from current benchmarks, providing new challenges and opportunities for future research.
Project Team
Farimah Poursafaei
Shenyang(Andy) Huang
Kellin Pelrine
Abu bakar Daud
Reihaneh Rabbany
Contact
For more information, please consult the subprojects in this category or contact farimah.poursafaei@mila.quebec and shenyang.huang@mail.mcgill.ca.