Visitar URL original
Add Debug utility to be able to preview first samples used for training · Issue #184 · huggingface/nanotron · GitHub
Skip to content

Add Debug utility to be able to preview first samples used for training #184

Open
Open
Add Debug utility to be able to preview first samples used for training#184
Labels
good first issueGood for newcomershelp wantedExtra attention is needed

Description

@nmntz
nmntz
opened on May 27, 2024

Ensuring that we're using the correct data is crucial for training and could avoid hours of debugging. It would be cool to have a debug utility that can pull the couple first samples from the dataloader just like we do in trainer, then detokenize them and print them to the user

Activity

  1. nmntz
    added
    good first issueGood for newcomers
    help wantedExtra attention is needed
    on May 27, 2024

  2. Wodlfvllf commented on Apr 21, 2025

    @Wodlfvllf
    Wodlfvllf
    on Apr 21, 2025

    I wanna take this problem. Can you assign it if this thing is still required?

  3. garongkim
    added a commit that references this issue on May 12, 2025

    Add debug_dataloader_samples utility function (Fixes huggingface#184)

    bc10e82
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    good first issueGood for newcomershelp wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions