Issues

• Compatibility with Huggingface models

  kakaobrain/torchgpipe#37 · Filter by author mennangok1 opened on Dec 29, 2024

• The same batch size, different micro batches, the algorithm effects are inconsistent.

  kakaobrain/torchgpipe#35 · Filter by author Kurama622 opened on Apr 3, 2024
  3

• CUDA issues

  kakaobrain/torchgpipe#33 · Filter by author linghan1997 opened on May 30, 2022

• Issues on torchgpipe project and paper

  question
  kakaobrain/torchgpipe#28 · Filter by author xshaun opened on Jun 9, 2021
  1

• [Question] What is the purpose of "always" checkpointing mode?

  question
  kakaobrain/torchgpipe#24 · Filter by author pritamdamania87 opened on Nov 30, 2020
  1

  

• Can torchgpipe work with Horovod?

  kakaobrain/torchgpipe#22 · Filter by author RainFrost1 opened on Sep 16, 2020

• Checkpoint Issues

  question
  kakaobrain/torchgpipe#12 · Filter by author vibhatha opened on Mar 3, 2020
  11

  

• convergence problem

  question
  kakaobrain/torchgpipe#9 · Filter by author yangpc615 opened on Dec 18, 2019
  6